2024-09-16T02:54:29.985 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-16T02:54:29.997 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-16T02:54:30.081 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-15_20:00:16-rados-main-distro-default-smithi/7905827 branch: main description: rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/mon} email: ceph-qa@ceph.com first_in_suite: false job_id: '7905827' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: teuthology-2024-09-15_20:00:16-rados-main-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 3 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: main ceph: conf: mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 20 flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: fc3e0bff7468fd55478adbae7f75508b749124b6 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: fc3e0bff7468fd55478adbae7f75508b749124b6 workunit: branch: main sha1: 7498493279982dfe87f00616198a5967475f6169 owner: scheduled_teuthology@teuthology priority: 101 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - client.0 seed: 2855 sha1: fc3e0bff7468fd55478adbae7f75508b749124b6 sleep_before_teardown: 0 subset: 17936/100000 suite: rados suite_branch: main suite_path: /home/teuthworker/src/git.ceph.com_ceph_7498493279982dfe87f00616198a5967475f6169/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 7498493279982dfe87f00616198a5967475f6169 targets: smithi096.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLj2m2CjUExMOtCUnqKCEedK0UHWzBS6tIYs+qm87O/T5T7PLMkvMyjLgRmcV7TLHtb3P5lw2se8+CkSd2aVZYw= tasks: - install: null - workunit: basedir: qa/standalone clients: all: - mon teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-15_20:00:16 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-16T02:54:30.081 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_7498493279982dfe87f00616198a5967475f6169/qa; will attempt to use it 2024-09-16T02:54:30.082 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_7498493279982dfe87f00616198a5967475f6169/qa/tasks 2024-09-16T02:54:30.082 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-16T02:54:30.084 INFO:teuthology.task.internal:Checking packages... 2024-09-16T02:54:30.105 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'fc3e0bff7468fd55478adbae7f75508b749124b6' 2024-09-16T02:54:30.106 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-16T02:54:30.106 INFO:teuthology.packaging:ref: None 2024-09-16T02:54:30.106 INFO:teuthology.packaging:tag: None 2024-09-16T02:54:30.106 INFO:teuthology.packaging:branch: main 2024-09-16T02:54:30.106 INFO:teuthology.packaging:sha1: fc3e0bff7468fd55478adbae7f75508b749124b6 2024-09-16T02:54:30.106 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=main 2024-09-16T02:54:30.347 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4937-g74984932-1jammy 2024-09-16T02:54:30.349 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-16T02:54:30.359 INFO:teuthology.task.internal:no buildpackages task found 2024-09-16T02:54:30.359 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-16T02:54:30.371 INFO:teuthology.task.internal:Saving configuration 2024-09-16T02:54:30.380 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-16T02:54:30.392 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-16T02:54:30.417 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi096.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-15_20:00:16-rados-main-distro-default-smithi/7905827', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-16 02:48:56.461819', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIO5aTHfVAXVkavPofdE5A7l/GZpj0Cse/qwyKzmaKpis'} 2024-09-16T02:54:30.417 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-16T02:54:30.423 INFO:teuthology.task.internal:roles: ubuntu@smithi096.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0'] 2024-09-16T02:54:30.424 INFO:teuthology.run_tasks:Running task console_log... 2024-09-16T02:54:30.468 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb8c52aee60>, signals=[15]) 2024-09-16T02:54:30.468 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-16T02:54:30.478 INFO:teuthology.task.internal:Opening connections... 2024-09-16T02:54:30.478 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi096.front.sepia.ceph.com 2024-09-16T02:54:30.479 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T02:54:30.560 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-16T02:54:30.570 DEBUG:teuthology.orchestra.run.smithi096:> uname -m 2024-09-16T02:54:30.685 INFO:teuthology.orchestra.run.smithi096.stdout:x86_64 2024-09-16T02:54:30.685 DEBUG:teuthology.orchestra.run.smithi096:> cat /etc/os-release 2024-09-16T02:54:30.733 INFO:teuthology.orchestra.run.smithi096.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-16T02:54:30.733 INFO:teuthology.orchestra.run.smithi096.stdout:NAME="Ubuntu" 2024-09-16T02:54:30.733 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION_ID="22.04" 2024-09-16T02:54:30.733 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-16T02:54:30.733 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION_CODENAME=jammy 2024-09-16T02:54:30.733 INFO:teuthology.orchestra.run.smithi096.stdout:ID=ubuntu 2024-09-16T02:54:30.733 INFO:teuthology.orchestra.run.smithi096.stdout:ID_LIKE=debian 2024-09-16T02:54:30.733 INFO:teuthology.orchestra.run.smithi096.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-16T02:54:30.733 INFO:teuthology.orchestra.run.smithi096.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-16T02:54:30.733 INFO:teuthology.orchestra.run.smithi096.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-16T02:54:30.734 INFO:teuthology.orchestra.run.smithi096.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-16T02:54:30.734 INFO:teuthology.orchestra.run.smithi096.stdout:UBUNTU_CODENAME=jammy 2024-09-16T02:54:30.734 INFO:teuthology.lock.ops:Updating smithi096.front.sepia.ceph.com on lock server 2024-09-16T02:54:30.753 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-16T02:54:30.766 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-16T02:54:30.778 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-16T02:54:30.778 DEBUG:teuthology.orchestra.run.smithi096:> test '!' -e /home/ubuntu/cephtest 2024-09-16T02:54:30.782 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-16T02:54:30.793 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-16T02:54:30.793 DEBUG:teuthology.orchestra.run.smithi096:> test -z $(ls -A /var/lib/ceph) 2024-09-16T02:54:30.843 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-16T02:54:30.874 INFO:teuthology.run_tasks:Running task kernel... 2024-09-16T02:54:30.892 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-16T02:54:30.892 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-16T02:54:30.893 DEBUG:teuthology.orchestra.run.smithi096:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-16T02:54:30.898 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T02:54:30.898 DEBUG:teuthology.orchestra.run.smithi096:> uname -r 2024-09-16T02:54:30.945 INFO:teuthology.orchestra.run.smithi096.stdout:5.15.0-56-generic 2024-09-16T02:54:30.945 INFO:teuthology.task.kernel:Running kernel on smithi096: 5.15.0-56-generic 2024-09-16T02:54:30.945 DEBUG:teuthology.orchestra.run.smithi096:> sudo apt-get clean 2024-09-16T02:54:31.062 DEBUG:teuthology.orchestra.run.smithi096:> sudo apt-get update 2024-09-16T02:54:31.192 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-16T02:54:31.206 INFO:teuthology.orchestra.run.smithi096.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-16T02:54:31.273 INFO:teuthology.orchestra.run.smithi096.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-16T02:54:31.327 INFO:teuthology.orchestra.run.smithi096.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-16T02:54:31.452 INFO:teuthology.orchestra.run.smithi096.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [696 kB] 2024-09-16T02:54:31.519 INFO:teuthology.orchestra.run.smithi096.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,023 kB] 2024-09-16T02:54:31.554 INFO:teuthology.orchestra.run.smithi096.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [352 kB] 2024-09-16T02:54:31.557 INFO:teuthology.orchestra.run.smithi096.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-16T02:54:31.557 INFO:teuthology.orchestra.run.smithi096.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-16T02:54:31.558 INFO:teuthology.orchestra.run.smithi096.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,437 kB] 2024-09-16T02:54:31.573 INFO:teuthology.orchestra.run.smithi096.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [419 kB] 2024-09-16T02:54:31.576 INFO:teuthology.orchestra.run.smithi096.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-16T02:54:31.576 INFO:teuthology.orchestra.run.smithi096.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-16T02:54:31.581 INFO:teuthology.orchestra.run.smithi096.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-16T02:54:31.588 INFO:teuthology.orchestra.run.smithi096.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-16T02:54:31.589 INFO:teuthology.orchestra.run.smithi096.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-16T02:54:31.589 INFO:teuthology.orchestra.run.smithi096.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-16T02:54:31.590 INFO:teuthology.orchestra.run.smithi096.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-16T02:54:31.604 INFO:teuthology.orchestra.run.smithi096.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-16T02:54:31.606 INFO:teuthology.orchestra.run.smithi096.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-16T02:54:31.606 INFO:teuthology.orchestra.run.smithi096.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-16T02:54:31.607 INFO:teuthology.orchestra.run.smithi096.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-16T02:54:31.607 INFO:teuthology.orchestra.run.smithi096.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-16T02:54:31.608 INFO:teuthology.orchestra.run.smithi096.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-16T02:54:31.623 INFO:teuthology.orchestra.run.smithi096.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-16T02:54:31.623 INFO:teuthology.orchestra.run.smithi096.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-16T02:54:31.624 INFO:teuthology.orchestra.run.smithi096.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-16T02:54:31.624 INFO:teuthology.orchestra.run.smithi096.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-16T02:54:31.761 INFO:teuthology.orchestra.run.smithi096.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [539 kB] 2024-09-16T02:54:32.046 INFO:teuthology.orchestra.run.smithi096.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,806 kB] 2024-09-16T02:54:32.219 INFO:teuthology.orchestra.run.smithi096.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [295 kB] 2024-09-16T02:54:32.231 INFO:teuthology.orchestra.run.smithi096.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-16T02:54:32.233 INFO:teuthology.orchestra.run.smithi096.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,377 kB] 2024-09-16T02:54:32.318 INFO:teuthology.orchestra.run.smithi096.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-16T02:54:32.318 INFO:teuthology.orchestra.run.smithi096.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [409 kB] 2024-09-16T02:54:32.327 INFO:teuthology.orchestra.run.smithi096.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-16T02:54:32.327 INFO:teuthology.orchestra.run.smithi096.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [627 kB] 2024-09-16T02:54:32.346 INFO:teuthology.orchestra.run.smithi096.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [902 kB] 2024-09-16T02:54:32.377 INFO:teuthology.orchestra.run.smithi096.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-16T02:54:32.384 INFO:teuthology.orchestra.run.smithi096.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-16T02:54:32.384 INFO:teuthology.orchestra.run.smithi096.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-16T02:54:32.384 INFO:teuthology.orchestra.run.smithi096.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-16T02:54:32.465 INFO:teuthology.orchestra.run.smithi096.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-16T02:54:32.465 INFO:teuthology.orchestra.run.smithi096.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-16T02:54:37.812 INFO:teuthology.orchestra.run.smithi096.stdout:Fetched 16.0 MB in 2s (7,414 kB/s) 2024-09-16T02:54:39.272 INFO:teuthology.orchestra.run.smithi096.stdout:Reading package lists... 2024-09-16T02:54:39.289 DEBUG:teuthology.orchestra.run.smithi096:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-16T02:54:39.353 INFO:teuthology.orchestra.run.smithi096.stdout:Reading package lists... 2024-09-16T02:54:39.573 INFO:teuthology.orchestra.run.smithi096.stdout:Building dependency tree... 2024-09-16T02:54:39.574 INFO:teuthology.orchestra.run.smithi096.stdout:Reading state information... 2024-09-16T02:54:39.762 INFO:teuthology.orchestra.run.smithi096.stdout:The following packages were automatically installed and are no longer required: 2024-09-16T02:54:39.762 INFO:teuthology.orchestra.run.smithi096.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-16T02:54:39.763 INFO:teuthology.orchestra.run.smithi096.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-16T02:54:39.763 INFO:teuthology.orchestra.run.smithi096.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-16T02:54:39.763 INFO:teuthology.orchestra.run.smithi096.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-16T02:54:39.763 INFO:teuthology.orchestra.run.smithi096.stdout: python2.7-minimal 2024-09-16T02:54:39.764 INFO:teuthology.orchestra.run.smithi096.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-16T02:54:39.765 INFO:teuthology.orchestra.run.smithi096.stdout:The following additional packages will be installed: 2024-09-16T02:54:39.765 INFO:teuthology.orchestra.run.smithi096.stdout: linux-generic linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-16T02:54:39.765 INFO:teuthology.orchestra.run.smithi096.stdout: linux-headers-generic linux-image-5.15.0-121-generic 2024-09-16T02:54:39.765 INFO:teuthology.orchestra.run.smithi096.stdout: linux-modules-5.15.0-121-generic linux-modules-extra-5.15.0-121-generic 2024-09-16T02:54:39.767 INFO:teuthology.orchestra.run.smithi096.stdout:Suggested packages: 2024-09-16T02:54:39.767 INFO:teuthology.orchestra.run.smithi096.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-16T02:54:39.767 INFO:teuthology.orchestra.run.smithi096.stdout:Recommended packages: 2024-09-16T02:54:39.767 INFO:teuthology.orchestra.run.smithi096.stdout: thermald 2024-09-16T02:54:39.811 INFO:teuthology.orchestra.run.smithi096.stdout:The following NEW packages will be installed: 2024-09-16T02:54:39.812 INFO:teuthology.orchestra.run.smithi096.stdout: linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-16T02:54:39.812 INFO:teuthology.orchestra.run.smithi096.stdout: linux-image-5.15.0-121-generic linux-modules-5.15.0-121-generic 2024-09-16T02:54:39.812 INFO:teuthology.orchestra.run.smithi096.stdout: linux-modules-extra-5.15.0-121-generic 2024-09-16T02:54:39.813 INFO:teuthology.orchestra.run.smithi096.stdout:The following packages will be upgraded: 2024-09-16T02:54:39.814 INFO:teuthology.orchestra.run.smithi096.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-16T02:54:39.867 INFO:teuthology.orchestra.run.smithi096.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-16T02:54:39.867 INFO:teuthology.orchestra.run.smithi096.stdout:Need to get 113 MB of archives. 2024-09-16T02:54:39.867 INFO:teuthology.orchestra.run.smithi096.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-16T02:54:39.867 INFO:teuthology.orchestra.run.smithi096.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-121-generic amd64 5.15.0-121.131 [22.7 MB] 2024-09-16T02:54:40.281 INFO:teuthology.orchestra.run.smithi096.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-121-generic amd64 5.15.0-121.131 [11.5 MB] 2024-09-16T02:54:40.369 INFO:teuthology.orchestra.run.smithi096.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-121-generic amd64 5.15.0-121.131 [63.9 MB] 2024-09-16T02:54:41.166 INFO:teuthology.orchestra.run.smithi096.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.121.121 [1,694 B] 2024-09-16T02:54:41.166 INFO:teuthology.orchestra.run.smithi096.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.121.121 [2,464 B] 2024-09-16T02:54:41.166 INFO:teuthology.orchestra.run.smithi096.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121 all 5.15.0-121.131 [12.3 MB] 2024-09-16T02:54:41.284 INFO:teuthology.orchestra.run.smithi096.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121-generic amd64 5.15.0-121.131 [2,827 kB] 2024-09-16T02:54:41.304 INFO:teuthology.orchestra.run.smithi096.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.121.121 [2,316 B] 2024-09-16T02:54:41.697 INFO:teuthology.orchestra.run.smithi096.stdout:Fetched 113 MB in 1s (76.4 MB/s) 2024-09-16T02:54:41.871 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package linux-modules-5.15.0-121-generic. 2024-09-16T02:54:43.830 INFO:teuthology.orchestra.run.smithi096.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-16T02:54:43.834 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../0-linux-modules-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-16T02:54:43.903 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T02:54:46.097 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package linux-image-5.15.0-121-generic. 2024-09-16T02:54:46.118 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../1-linux-image-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-16T02:54:46.208 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T02:54:46.650 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-121-generic. 2024-09-16T02:54:46.670 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-16T02:54:46.700 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T02:54:53.173 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../3-linux-generic_5.15.0.121.121_amd64.deb ... 2024-09-16T02:54:53.296 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-16T02:54:53.629 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.121.121_amd64.deb ... 2024-09-16T02:54:53.750 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-image-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-16T02:54:54.003 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package linux-headers-5.15.0-121. 2024-09-16T02:54:54.016 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../5-linux-headers-5.15.0-121_5.15.0-121.131_all.deb ... 2024-09-16T02:54:54.061 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-16T02:54:59.896 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package linux-headers-5.15.0-121-generic. 2024-09-16T02:54:59.933 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../6-linux-headers-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-16T02:54:59.971 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T02:55:02.489 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.121.121_amd64.deb ... 2024-09-16T02:55:02.614 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-headers-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-16T02:55:02.927 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-16T02:55:03.053 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T02:55:03.179 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-headers-generic (5.15.0.121.121) ... 2024-09-16T02:55:03.315 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T02:55:04.628 INFO:teuthology.orchestra.run.smithi096.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-16T02:55:04.628 INFO:teuthology.orchestra.run.smithi096.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-16T02:55:04.628 INFO:teuthology.orchestra.run.smithi096.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-121-generic 2024-09-16T02:55:04.629 INFO:teuthology.orchestra.run.smithi096.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-121-generic 2024-09-16T02:55:04.784 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T02:55:06.185 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T02:55:07.853 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-image-generic (5.15.0.121.121) ... 2024-09-16T02:55:07.970 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-generic (5.15.0.121.121) ... 2024-09-16T02:55:08.072 INFO:teuthology.orchestra.run.smithi096.stdout:Processing triggers for linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T02:55:08.124 INFO:teuthology.orchestra.run.smithi096.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-16T02:55:08.124 INFO:teuthology.orchestra.run.smithi096.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-121-generic 2024-09-16T02:55:22.592 INFO:teuthology.orchestra.run.smithi096.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-16T02:55:22.593 INFO:teuthology.orchestra.run.smithi096.stdout:Sourcing file `/etc/default/grub' 2024-09-16T02:55:22.596 INFO:teuthology.orchestra.run.smithi096.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-16T02:55:22.629 INFO:teuthology.orchestra.run.smithi096.stdout:Generating grub configuration file ... 2024-09-16T02:55:22.969 INFO:teuthology.orchestra.run.smithi096.stdout:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-16T02:55:22.986 INFO:teuthology.orchestra.run.smithi096.stdout:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-16T02:55:23.351 INFO:teuthology.orchestra.run.smithi096.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-16T02:55:23.356 INFO:teuthology.orchestra.run.smithi096.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-16T02:55:23.419 INFO:teuthology.orchestra.run.smithi096.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-16T02:55:23.424 INFO:teuthology.orchestra.run.smithi096.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-16T02:55:23.582 INFO:teuthology.orchestra.run.smithi096.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-16T02:55:23.583 INFO:teuthology.orchestra.run.smithi096.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-16T02:55:23.583 INFO:teuthology.orchestra.run.smithi096.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-16T02:55:23.631 INFO:teuthology.orchestra.run.smithi096.stdout:done 2024-09-16T02:55:24.140 DEBUG:teuthology.orchestra.run.smithi096:> dpkg -s linux-image-generic 2024-09-16T02:55:24.166 INFO:teuthology.orchestra.run.smithi096.stdout:Package: linux-image-generic 2024-09-16T02:55:24.167 INFO:teuthology.orchestra.run.smithi096.stdout:Status: install ok installed 2024-09-16T02:55:24.167 INFO:teuthology.orchestra.run.smithi096.stdout:Priority: optional 2024-09-16T02:55:24.167 INFO:teuthology.orchestra.run.smithi096.stdout:Section: kernel 2024-09-16T02:55:24.167 INFO:teuthology.orchestra.run.smithi096.stdout:Installed-Size: 21 2024-09-16T02:55:24.167 INFO:teuthology.orchestra.run.smithi096.stdout:Maintainer: Ubuntu Kernel Team 2024-09-16T02:55:24.167 INFO:teuthology.orchestra.run.smithi096.stdout:Architecture: amd64 2024-09-16T02:55:24.167 INFO:teuthology.orchestra.run.smithi096.stdout:Source: linux-meta 2024-09-16T02:55:24.167 INFO:teuthology.orchestra.run.smithi096.stdout:Version: 5.15.0.121.121 2024-09-16T02:55:24.167 INFO:teuthology.orchestra.run.smithi096.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-16T02:55:24.167 INFO:teuthology.orchestra.run.smithi096.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-16T02:55:24.167 INFO:teuthology.orchestra.run.smithi096.stdout:Recommends: thermald 2024-09-16T02:55:24.168 INFO:teuthology.orchestra.run.smithi096.stdout:Description: Generic Linux kernel image 2024-09-16T02:55:24.168 INFO:teuthology.orchestra.run.smithi096.stdout: This package will always depend on the latest generic kernel image 2024-09-16T02:55:24.168 INFO:teuthology.orchestra.run.smithi096.stdout: available. 2024-09-16T02:55:24.168 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-121-generic 2024-09-16T02:55:24.168 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-16T02:55:24.168 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-16T02:55:24.168 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-16T02:55:24.169 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi096.front.sepia.ceph.com, path=None, version=distro) 2024-09-16T02:55:24.169 DEBUG:teuthology.orchestra.run.smithi096:> sudo apt-get clean 2024-09-16T02:55:24.300 DEBUG:teuthology.orchestra.run.smithi096:> sudo apt-get update 2024-09-16T02:55:24.548 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-16T02:55:24.548 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-16T02:55:24.619 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-16T02:55:24.701 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-16T02:55:26.017 INFO:teuthology.orchestra.run.smithi096.stdout:Reading package lists... 2024-09-16T02:55:26.035 DEBUG:teuthology.orchestra.run.smithi096:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-16T02:55:26.096 INFO:teuthology.orchestra.run.smithi096.stdout:Reading package lists... 2024-09-16T02:55:26.314 INFO:teuthology.orchestra.run.smithi096.stdout:Building dependency tree... 2024-09-16T02:55:26.321 INFO:teuthology.orchestra.run.smithi096.stdout:Reading state information... 2024-09-16T02:55:26.497 INFO:teuthology.orchestra.run.smithi096.stdout:linux-image-generic is already the newest version (5.15.0.121.121). 2024-09-16T02:55:26.497 INFO:teuthology.orchestra.run.smithi096.stdout:The following packages were automatically installed and are no longer required: 2024-09-16T02:55:26.498 INFO:teuthology.orchestra.run.smithi096.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-16T02:55:26.498 INFO:teuthology.orchestra.run.smithi096.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-16T02:55:26.498 INFO:teuthology.orchestra.run.smithi096.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-16T02:55:26.498 INFO:teuthology.orchestra.run.smithi096.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-16T02:55:26.498 INFO:teuthology.orchestra.run.smithi096.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-16T02:55:26.498 INFO:teuthology.orchestra.run.smithi096.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-16T02:55:26.538 INFO:teuthology.orchestra.run.smithi096.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-16T02:55:26.540 DEBUG:teuthology.orchestra.run.smithi096:> dpkg -s linux-image-generic 2024-09-16T02:55:26.556 INFO:teuthology.orchestra.run.smithi096.stdout:Package: linux-image-generic 2024-09-16T02:55:26.556 INFO:teuthology.orchestra.run.smithi096.stdout:Status: install ok installed 2024-09-16T02:55:26.556 INFO:teuthology.orchestra.run.smithi096.stdout:Priority: optional 2024-09-16T02:55:26.556 INFO:teuthology.orchestra.run.smithi096.stdout:Section: kernel 2024-09-16T02:55:26.556 INFO:teuthology.orchestra.run.smithi096.stdout:Installed-Size: 21 2024-09-16T02:55:26.556 INFO:teuthology.orchestra.run.smithi096.stdout:Maintainer: Ubuntu Kernel Team 2024-09-16T02:55:26.556 INFO:teuthology.orchestra.run.smithi096.stdout:Architecture: amd64 2024-09-16T02:55:26.556 INFO:teuthology.orchestra.run.smithi096.stdout:Source: linux-meta 2024-09-16T02:55:26.556 INFO:teuthology.orchestra.run.smithi096.stdout:Version: 5.15.0.121.121 2024-09-16T02:55:26.557 INFO:teuthology.orchestra.run.smithi096.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-16T02:55:26.557 INFO:teuthology.orchestra.run.smithi096.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-16T02:55:26.557 INFO:teuthology.orchestra.run.smithi096.stdout:Recommends: thermald 2024-09-16T02:55:26.557 INFO:teuthology.orchestra.run.smithi096.stdout:Description: Generic Linux kernel image 2024-09-16T02:55:26.557 INFO:teuthology.orchestra.run.smithi096.stdout: This package will always depend on the latest generic kernel image 2024-09-16T02:55:26.557 INFO:teuthology.orchestra.run.smithi096.stdout: available. 2024-09-16T02:55:26.557 DEBUG:teuthology.orchestra.run.smithi096:> mktemp 2024-09-16T02:55:26.600 INFO:teuthology.orchestra.run.smithi096.stdout:/tmp/tmp.wbKTo0puQ8 2024-09-16T02:55:26.600 DEBUG:teuthology.orchestra.run.smithi096:> sudo cp /boot/grub/grub.cfg /tmp/tmp.wbKTo0puQ8 2024-09-16T02:55:26.654 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 0666 /tmp/tmp.wbKTo0puQ8 2024-09-16T02:55:26.778 DEBUG:teuthology.orchestra.remote:smithi096:/tmp/tmp.wbKTo0puQ8 is 10KB 2024-09-16T02:55:26.788 DEBUG:teuthology.orchestra.run.smithi096:> rm -fr /tmp/tmp.wbKTo0puQ8 2024-09-16T02:55:26.794 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-16T02:55:26.847 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-09-16T02:55:26.847 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-16T02:55:26.847 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-16T02:55:26.912 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-121-generic 2024-09-16T02:55:26.912 DEBUG:teuthology.orchestra.run.smithi096:> sudo update-grub 2024-09-16T02:55:28.041 INFO:teuthology.orchestra.run.smithi096.stderr:Sourcing file `/etc/default/grub' 2024-09-16T02:55:28.042 INFO:teuthology.orchestra.run.smithi096.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-16T02:55:28.044 INFO:teuthology.orchestra.run.smithi096.stderr:Generating grub configuration file ... 2024-09-16T02:55:28.275 INFO:teuthology.orchestra.run.smithi096.stderr:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-16T02:55:28.281 INFO:teuthology.orchestra.run.smithi096.stderr:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-16T02:55:28.575 INFO:teuthology.orchestra.run.smithi096.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-16T02:55:28.581 INFO:teuthology.orchestra.run.smithi096.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-16T02:55:28.627 INFO:teuthology.orchestra.run.smithi096.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-16T02:55:28.633 INFO:teuthology.orchestra.run.smithi096.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-16T02:55:28.784 INFO:teuthology.orchestra.run.smithi096.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-16T02:55:28.784 INFO:teuthology.orchestra.run.smithi096.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-16T02:55:28.784 INFO:teuthology.orchestra.run.smithi096.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-16T02:55:28.807 INFO:teuthology.orchestra.run.smithi096.stderr:done 2024-09-16T02:55:28.816 DEBUG:teuthology.orchestra.run.smithi096:> sudo shutdown -r now 2024-09-16T02:55:58.845 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-16T02:55:58.846 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-09-16T02:55:58.847 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T02:56:33.341 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.96 2024-09-16T02:56:42.351 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-09-16T02:56:42.353 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T02:57:00.733 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.96 2024-09-16T02:57:12.745 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-09-16T02:57:12.746 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T02:57:12.749 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.96 2024-09-16T02:57:27.761 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-09-16T02:57:27.763 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T02:57:28.021 DEBUG:teuthology.orchestra.run.smithi096:> true 2024-09-16T02:57:28.543 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-09-16T02:57:28.543 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-121-generic"... 2024-09-16T02:57:28.543 DEBUG:teuthology.orchestra.run.smithi096:> uname -r 2024-09-16T02:57:28.590 INFO:teuthology.orchestra.run.smithi096.stdout:5.15.0-121-generic 2024-09-16T02:57:28.591 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-121-generic vs 5.15.0-121-generic 2024-09-16T02:57:28.591 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-16T02:57:28.591 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-16T02:57:29.592 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-16T02:57:29.592 DEBUG:teuthology.orchestra.run.smithi096:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-16T02:57:29.925 INFO:teuthology.orchestra.run.smithi096.stdout:ttyS1 2024-09-16T02:57:29.945 DEBUG:teuthology.parallel:result is None 2024-09-16T02:57:29.945 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-16T02:57:29.953 INFO:teuthology.task.internal:Creating test directory... 2024-09-16T02:57:29.953 DEBUG:teuthology.orchestra.run.smithi096:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-16T02:57:29.958 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-16T02:57:29.965 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-16T02:57:29.972 INFO:teuthology.task.internal:Creating archive directory... 2024-09-16T02:57:29.972 DEBUG:teuthology.orchestra.run.smithi096:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-16T02:57:30.020 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-16T02:57:30.027 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-16T02:57:30.027 DEBUG:teuthology.orchestra.run.smithi096:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-16T02:57:30.079 INFO:teuthology.orchestra.run.smithi096.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T02:57:30.087 INFO:teuthology.orchestra.run.smithi096.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T02:57:30.089 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-16T02:57:30.096 INFO:teuthology.task.internal:Configuring sudo... 2024-09-16T02:57:30.096 DEBUG:teuthology.orchestra.run.smithi096:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-16T02:57:30.144 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-16T02:57:30.153 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-16T02:57:30.153 DEBUG:teuthology.orchestra.run.smithi096:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-16T02:57:30.191 DEBUG:teuthology.orchestra.run.smithi096:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T02:57:30.239 DEBUG:teuthology.orchestra.run.smithi096:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T02:57:30.287 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-09-16T02:57:30.288 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-16T02:57:30.364 DEBUG:teuthology.orchestra.run.smithi096:> sudo service rsyslog restart 2024-09-16T02:57:30.436 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-16T02:57:30.443 INFO:teuthology.task.internal:Starting timer... 2024-09-16T02:57:30.443 INFO:teuthology.run_tasks:Running task pcp... 2024-09-16T02:57:30.459 INFO:teuthology.run_tasks:Running task selinux... 2024-09-16T02:57:30.505 DEBUG:teuthology.task.selinux:Excluding smithi096: OS 'ubuntu' does not support SELinux 2024-09-16T02:57:30.506 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-16T02:57:30.506 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-16T02:57:30.506 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-16T02:57:30.506 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-16T02:57:30.514 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-16T02:57:30.518 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-16T02:57:30.639 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-16T02:57:30.651 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-16T02:57:30.652 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi096.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-16T03:04:59.595 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi096.front.sepia.ceph.com')] 2024-09-16T03:04:59.596 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-09-16T03:04:59.597 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T03:04:59.683 DEBUG:teuthology.orchestra.run.smithi096:> true 2024-09-16T03:04:59.759 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-09-16T03:04:59.759 INFO:teuthology.run_tasks:Running task clock... 2024-09-16T03:04:59.769 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-16T03:04:59.770 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-16T03:04:59.770 DEBUG:teuthology.orchestra.run.smithi096:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T03:04:59.824 INFO:teuthology.orchestra.run.smithi096.stdout:16 Sep 03:04:59 ntpd[18487]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-16T03:04:59.825 INFO:teuthology.orchestra.run.smithi096.stdout:16 Sep 03:04:59 ntpd[18487]: Command line: ntpd -gq 2024-09-16T03:04:59.825 INFO:teuthology.orchestra.run.smithi096.stdout:16 Sep 03:04:59 ntpd[18487]: ---------------------------------------------------- 2024-09-16T03:04:59.825 INFO:teuthology.orchestra.run.smithi096.stdout:16 Sep 03:04:59 ntpd[18487]: ntp-4 is maintained by Network Time Foundation, 2024-09-16T03:04:59.825 INFO:teuthology.orchestra.run.smithi096.stdout:16 Sep 03:04:59 ntpd[18487]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-16T03:04:59.825 INFO:teuthology.orchestra.run.smithi096.stdout:16 Sep 03:04:59 ntpd[18487]: corporation. Support and training for ntp-4 are 2024-09-16T03:04:59.825 INFO:teuthology.orchestra.run.smithi096.stdout:16 Sep 03:04:59 ntpd[18487]: available at https://www.nwtime.org/support 2024-09-16T03:04:59.825 INFO:teuthology.orchestra.run.smithi096.stdout:16 Sep 03:04:59 ntpd[18487]: ---------------------------------------------------- 2024-09-16T03:04:59.826 INFO:teuthology.orchestra.run.smithi096.stdout:16 Sep 03:04:59 ntpd[18487]: proto: precision = 0.067 usec (-24) 2024-09-16T03:04:59.826 INFO:teuthology.orchestra.run.smithi096.stdout:16 Sep 03:04:59 ntpd[18487]: basedate set to 2022-02-04 2024-09-16T03:04:59.826 INFO:teuthology.orchestra.run.smithi096.stdout:16 Sep 03:04:59 ntpd[18487]: gps base set to 2022-02-06 (week 2196) 2024-09-16T03:04:59.826 INFO:teuthology.orchestra.run.smithi096.stdout:16 Sep 03:04:59 ntpd[18487]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-16T03:04:59.827 INFO:teuthology.orchestra.run.smithi096.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-16T03:04:59.827 INFO:teuthology.orchestra.run.smithi096.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-16T03:04:59.828 INFO:teuthology.orchestra.run.smithi096.stdout:16 Sep 03:04:59 ntpd[18487]: restrict ::: KOD does nothing without LIMITED. 2024-09-16T03:04:59.828 INFO:teuthology.orchestra.run.smithi096.stdout:16 Sep 03:04:59 ntpd[18487]: Listen and drop on 0 v6wildcard [::]:123 2024-09-16T03:04:59.828 INFO:teuthology.orchestra.run.smithi096.stdout:16 Sep 03:04:59 ntpd[18487]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-16T03:04:59.829 INFO:teuthology.orchestra.run.smithi096.stdout:16 Sep 03:04:59 ntpd[18487]: Listen normally on 2 lo 127.0.0.1:123 2024-09-16T03:04:59.829 INFO:teuthology.orchestra.run.smithi096.stdout:16 Sep 03:04:59 ntpd[18487]: Listen normally on 3 enp3s0f1 172.21.15.96:123 2024-09-16T03:04:59.829 INFO:teuthology.orchestra.run.smithi096.stdout:16 Sep 03:04:59 ntpd[18487]: Listen normally on 4 lo [::1]:123 2024-09-16T03:04:59.829 INFO:teuthology.orchestra.run.smithi096.stdout:16 Sep 03:04:59 ntpd[18487]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:cc0d%5]:123 2024-09-16T03:04:59.829 INFO:teuthology.orchestra.run.smithi096.stdout:16 Sep 03:04:59 ntpd[18487]: Listening on routing socket on fd #22 for interface updates 2024-09-16T03:05:00.825 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 03:05:00 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T03:05:00.826 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 03:05:00 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T03:05:00.826 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 03:05:00 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T03:05:00.826 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 03:05:00 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T03:05:00.826 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 03:05:00 ntpd[18487]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T03:05:00.826 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 03:05:00 ntpd[18487]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T03:05:01.825 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 03:05:01 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T03:05:01.825 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 03:05:01 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T03:05:01.825 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 03:05:01 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T03:05:01.825 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 03:05:01 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T03:05:01.825 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 03:05:01 ntpd[18487]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T03:05:01.826 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 03:05:01 ntpd[18487]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T03:05:02.825 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 03:05:02 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T03:05:02.825 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 03:05:02 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T03:05:02.826 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 03:05:02 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T03:05:02.826 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 03:05:02 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T03:05:02.826 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 03:05:02 ntpd[18487]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T03:05:02.826 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 03:05:02 ntpd[18487]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T03:05:03.826 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 03:05:03 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T03:05:03.826 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 03:05:03 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T03:05:03.826 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 03:05:03 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T03:05:03.826 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 03:05:03 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T03:05:03.826 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 03:05:03 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T03:05:03.826 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 03:05:03 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T03:05:03.826 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 03:05:03 ntpd[18487]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T03:05:03.826 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 03:05:03 ntpd[18487]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T03:05:03.827 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 03:05:03 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T03:05:03.827 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 03:05:03 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T03:05:03.827 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 03:05:03 ntpd[18487]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T03:05:03.827 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 03:05:03 ntpd[18487]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T03:05:04.826 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 03:05:04 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T03:05:04.826 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 03:05:04 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T03:05:04.826 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 03:05:04 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T03:05:04.826 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 03:05:04 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T03:05:04.826 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 03:05:04 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T03:05:04.826 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 03:05:04 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T03:05:04.827 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 03:05:04 ntpd[18487]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T03:05:04.827 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 03:05:04 ntpd[18487]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T03:05:05.826 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 03:05:05 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T03:05:05.826 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 03:05:05 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T03:05:05.826 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 03:05:05 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T03:05:05.826 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 03:05:05 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T03:05:05.826 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 03:05:05 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T03:05:05.826 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 03:05:05 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T03:05:05.826 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 03:05:05 ntpd[18487]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T03:05:05.826 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 03:05:05 ntpd[18487]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T03:05:05.827 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 03:05:05 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T03:05:05.827 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 03:05:05 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T03:05:05.827 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 03:05:05 ntpd[18487]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T03:05:05.827 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 03:05:05 ntpd[18487]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T03:05:06.825 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 03:05:06 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T03:05:06.825 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 03:05:06 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T03:05:06.826 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 03:05:06 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T03:05:06.826 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 03:05:06 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T03:05:06.826 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 03:05:06 ntpd[18487]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T03:05:06.826 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 03:05:06 ntpd[18487]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T03:05:06.826 INFO:teuthology.orchestra.run.smithi096.stdout:16 Sep 03:05:06 ntpd[18487]: ntpd: time slew -0.001042 s 2024-09-16T03:05:06.826 INFO:teuthology.orchestra.run.smithi096.stdout:ntpd: time slew -0.001042s 2024-09-16T03:05:06.827 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 03:05:06 ntpd[18487]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-16T03:05:06.827 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 03:05:06 ntpd[18487]: can't open /var/log/ntpstats/loopstats.20240916: Permission denied 2024-09-16T03:05:07.127 INFO:teuthology.orchestra.run.smithi096.stdout: remote refid st t when poll reach delay offset jitter 2024-09-16T03:05:07.127 INFO:teuthology.orchestra.run.smithi096.stdout:============================================================================== 2024-09-16T03:05:07.127 INFO:teuthology.orchestra.run.smithi096.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-16T03:05:07.127 INFO:teuthology.orchestra.run.smithi096.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-16T03:05:07.128 INFO:teuthology.orchestra.run.smithi096.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-16T03:05:07.128 INFO:teuthology.orchestra.run.smithi096.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-16T03:05:07.129 INFO:teuthology.run_tasks:Running task install... 2024-09-16T03:05:07.136 DEBUG:teuthology.task.install:project ceph 2024-09-16T03:05:07.136 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'fc3e0bff7468fd55478adbae7f75508b749124b6'}} 2024-09-16T03:05:07.137 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'fc3e0bff7468fd55478adbae7f75508b749124b6'} 2024-09-16T03:05:07.137 INFO:teuthology.task.install:Using flavor: default 2024-09-16T03:05:07.142 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-16T03:05:07.142 INFO:teuthology.task.install:extra packages: [] 2024-09-16T03:05:07.143 DEBUG:teuthology.orchestra.run.smithi096:> sudo apt-key list | grep Ceph 2024-09-16T03:05:07.241 INFO:teuthology.orchestra.run.smithi096.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-16T03:05:07.271 INFO:teuthology.orchestra.run.smithi096.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-16T03:05:07.271 INFO:teuthology.orchestra.run.smithi096.stdout:uid [ unknown] Ceph.com (release key) 2024-09-16T03:05:07.271 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-16T03:05:07.272 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=fc3e0bff7468fd55478adbae7f75508b749124b6 2024-09-16T03:05:07.420 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default/ 2024-09-16T03:05:07.420 INFO:teuthology.task.install.deb:Package version is 19.3.0-4930-gfc3e0bff-1jammy 2024-09-16T03:05:07.531 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-09-16T03:05:07.531 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-16T03:05:07.545 DEBUG:teuthology.orchestra.run.smithi096:> sudo apt-get update 2024-09-16T03:05:07.715 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-16T03:05:07.770 INFO:teuthology.orchestra.run.smithi096.stdout:Ign:2 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy InRelease 2024-09-16T03:05:07.792 INFO:teuthology.orchestra.run.smithi096.stdout:Get:3 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-16T03:05:07.815 INFO:teuthology.orchestra.run.smithi096.stdout:Ign:4 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-16T03:05:07.836 INFO:teuthology.orchestra.run.smithi096.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-09-16T03:05:07.855 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-16T03:05:07.868 INFO:teuthology.orchestra.run.smithi096.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,427 B] 2024-09-16T03:05:07.937 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-16T03:05:08.019 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-16T03:05:08.161 INFO:teuthology.orchestra.run.smithi096.stdout:Fetched 29.2 kB in 0s (67.3 kB/s) 2024-09-16T03:05:09.127 INFO:teuthology.orchestra.run.smithi096.stdout:Reading package lists... 2024-09-16T03:05:09.143 DEBUG:teuthology.orchestra.run.smithi096:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4930-gfc3e0bff-1jammy cephadm=19.3.0-4930-gfc3e0bff-1jammy ceph-mds=19.3.0-4930-gfc3e0bff-1jammy ceph-mgr=19.3.0-4930-gfc3e0bff-1jammy ceph-common=19.3.0-4930-gfc3e0bff-1jammy ceph-fuse=19.3.0-4930-gfc3e0bff-1jammy ceph-test=19.3.0-4930-gfc3e0bff-1jammy ceph-volume=19.3.0-4930-gfc3e0bff-1jammy radosgw=19.3.0-4930-gfc3e0bff-1jammy python3-rados=19.3.0-4930-gfc3e0bff-1jammy python3-rgw=19.3.0-4930-gfc3e0bff-1jammy python3-cephfs=19.3.0-4930-gfc3e0bff-1jammy python3-rbd=19.3.0-4930-gfc3e0bff-1jammy libcephfs2=19.3.0-4930-gfc3e0bff-1jammy libcephfs-dev=19.3.0-4930-gfc3e0bff-1jammy librados2=19.3.0-4930-gfc3e0bff-1jammy librbd1=19.3.0-4930-gfc3e0bff-1jammy rbd-fuse=19.3.0-4930-gfc3e0bff-1jammy 2024-09-16T03:05:09.196 INFO:teuthology.orchestra.run.smithi096.stdout:Reading package lists... 2024-09-16T03:05:09.386 INFO:teuthology.orchestra.run.smithi096.stdout:Building dependency tree... 2024-09-16T03:05:09.387 INFO:teuthology.orchestra.run.smithi096.stdout:Reading state information... 2024-09-16T03:05:09.572 INFO:teuthology.orchestra.run.smithi096.stdout:The following packages were automatically installed and are no longer required: 2024-09-16T03:05:09.572 INFO:teuthology.orchestra.run.smithi096.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-16T03:05:09.572 INFO:teuthology.orchestra.run.smithi096.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-16T03:05:09.573 INFO:teuthology.orchestra.run.smithi096.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-16T03:05:09.574 INFO:teuthology.orchestra.run.smithi096.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-16T03:05:09.574 INFO:teuthology.orchestra.run.smithi096.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-16T03:05:09.574 INFO:teuthology.orchestra.run.smithi096.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-16T03:05:09.574 INFO:teuthology.orchestra.run.smithi096.stdout:The following additional packages will be installed: 2024-09-16T03:05:09.574 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-16T03:05:09.574 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-16T03:05:09.574 INFO:teuthology.orchestra.run.smithi096.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 liboath0 2024-09-16T03:05:09.574 INFO:teuthology.orchestra.run.smithi096.stdout: libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2024-09-16T03:05:09.575 INFO:teuthology.orchestra.run.smithi096.stdout: libradosstriper1 librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph 2024-09-16T03:05:09.576 INFO:teuthology.orchestra.run.smithi096.stdout: libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli 2024-09-16T03:05:09.576 INFO:teuthology.orchestra.run.smithi096.stdout: pkg-config python-asyncssh-doc python-babel-localedata 2024-09-16T03:05:09.576 INFO:teuthology.orchestra.run.smithi096.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-16T03:05:09.576 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-certifi 2024-09-16T03:05:09.576 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cheroot python3-cherrypy3 python3-google-auth python3-idna 2024-09-16T03:05:09.576 INFO:teuthology.orchestra.run.smithi096.stdout: python3-iniconfig python3-jaraco.classes python3-jaraco.collections 2024-09-16T03:05:09.576 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco.functools python3-jaraco.text python3-jinja2 python3-joblib 2024-09-16T03:05:09.576 INFO:teuthology.orchestra.run.smithi096.stdout: python3-kubernetes python3-logutils python3-mako python3-markupsafe 2024-09-16T03:05:09.576 INFO:teuthology.orchestra.run.smithi096.stdout: python3-natsort python3-openssl python3-paste python3-pastedeploy 2024-09-16T03:05:09.576 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2024-09-16T03:05:09.576 INFO:teuthology.orchestra.run.smithi096.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2024-09-16T03:05:09.577 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pyasn1-modules python3-pygments python3-pyinotify python3-pytest 2024-09-16T03:05:09.577 INFO:teuthology.orchestra.run.smithi096.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-routes 2024-09-16T03:05:09.577 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rsa python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-16T03:05:09.577 INFO:teuthology.orchestra.run.smithi096.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-16T03:05:09.577 INFO:teuthology.orchestra.run.smithi096.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-16T03:05:09.577 INFO:teuthology.orchestra.run.smithi096.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-16T03:05:09.577 INFO:teuthology.orchestra.run.smithi096.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-16T03:05:09.577 INFO:teuthology.orchestra.run.smithi096.stdout: xmlstarlet zip 2024-09-16T03:05:09.577 INFO:teuthology.orchestra.run.smithi096.stdout:Suggested packages: 2024-09-16T03:05:09.578 INFO:teuthology.orchestra.run.smithi096.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-16T03:05:09.578 INFO:teuthology.orchestra.run.smithi096.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-16T03:05:09.578 INFO:teuthology.orchestra.run.smithi096.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-16T03:05:09.578 INFO:teuthology.orchestra.run.smithi096.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-16T03:05:09.578 INFO:teuthology.orchestra.run.smithi096.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-16T03:05:09.578 INFO:teuthology.orchestra.run.smithi096.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-16T03:05:09.578 INFO:teuthology.orchestra.run.smithi096.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-16T03:05:09.578 INFO:teuthology.orchestra.run.smithi096.stdout:Recommended packages: 2024-09-16T03:05:09.578 INFO:teuthology.orchestra.run.smithi096.stdout: btrfs-tools 2024-09-16T03:05:09.679 INFO:teuthology.orchestra.run.smithi096.stdout:The following NEW packages will be installed: 2024-09-16T03:05:09.679 INFO:teuthology.orchestra.run.smithi096.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-16T03:05:09.679 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-16T03:05:09.679 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-16T03:05:09.679 INFO:teuthology.orchestra.run.smithi096.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-16T03:05:09.680 INFO:teuthology.orchestra.run.smithi096.stdout: liblua5.3-dev libnbd0 liboath0 libonig5 libpcre2-16-0 libqt5core5a 2024-09-16T03:05:09.680 INFO:teuthology.orchestra.run.smithi096.stdout: libqt5dbus5 libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-16T03:05:09.681 INFO:teuthology.orchestra.run.smithi096.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-16T03:05:09.681 INFO:teuthology.orchestra.run.smithi096.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-16T03:05:09.681 INFO:teuthology.orchestra.run.smithi096.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-16T03:05:09.681 INFO:teuthology.orchestra.run.smithi096.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-16T03:05:09.681 INFO:teuthology.orchestra.run.smithi096.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-16T03:05:09.681 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-16T03:05:09.681 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-16T03:05:09.681 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-16T03:05:09.681 INFO:teuthology.orchestra.run.smithi096.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-16T03:05:09.682 INFO:teuthology.orchestra.run.smithi096.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-16T03:05:09.682 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-16T03:05:09.682 INFO:teuthology.orchestra.run.smithi096.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-16T03:05:09.682 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-16T03:05:09.682 INFO:teuthology.orchestra.run.smithi096.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-16T03:05:09.682 INFO:teuthology.orchestra.run.smithi096.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-16T03:05:09.682 INFO:teuthology.orchestra.run.smithi096.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-16T03:05:09.682 INFO:teuthology.orchestra.run.smithi096.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-16T03:05:09.682 INFO:teuthology.orchestra.run.smithi096.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-16T03:05:09.682 INFO:teuthology.orchestra.run.smithi096.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-16T03:05:09.682 INFO:teuthology.orchestra.run.smithi096.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-16T03:05:09.823 INFO:teuthology.orchestra.run.smithi096.stdout:0 upgraded, 119 newly installed, 0 to remove and 331 not upgraded. 2024-09-16T03:05:09.823 INFO:teuthology.orchestra.run.smithi096.stdout:Need to get 244 MB of archives. 2024-09-16T03:05:09.823 INFO:teuthology.orchestra.run.smithi096.stdout:After this operation, 909 MB of additional disk space will be used. 2024-09-16T03:05:09.823 INFO:teuthology.orchestra.run.smithi096.stdout:Get:1 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4930-gfc3e0bff-1jammy [3,633 kB] 2024-09-16T03:05:09.870 INFO:teuthology.orchestra.run.smithi096.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-16T03:05:10.004 INFO:teuthology.orchestra.run.smithi096.stdout:Get:3 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4930-gfc3e0bff-1jammy [3,334 kB] 2024-09-16T03:05:10.051 INFO:teuthology.orchestra.run.smithi096.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4930-gfc3e0bff-1jammy [721 kB] 2024-09-16T03:05:10.061 INFO:teuthology.orchestra.run.smithi096.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4930-gfc3e0bff-1jammy [356 kB] 2024-09-16T03:05:10.067 INFO:teuthology.orchestra.run.smithi096.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4930-gfc3e0bff-1jammy [32.8 kB] 2024-09-16T03:05:10.067 INFO:teuthology.orchestra.run.smithi096.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4930-gfc3e0bff-1jammy [180 kB] 2024-09-16T03:05:10.071 INFO:teuthology.orchestra.run.smithi096.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4930-gfc3e0bff-1jammy [71.3 kB] 2024-09-16T03:05:10.072 INFO:teuthology.orchestra.run.smithi096.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4930-gfc3e0bff-1jammy [338 kB] 2024-09-16T03:05:10.077 INFO:teuthology.orchestra.run.smithi096.stdout:Get:10 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4930-gfc3e0bff-1jammy [7,966 kB] 2024-09-16T03:05:10.209 INFO:teuthology.orchestra.run.smithi096.stdout:Get:11 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4930-gfc3e0bff-1jammy [112 kB] 2024-09-16T03:05:10.211 INFO:teuthology.orchestra.run.smithi096.stdout:Get:12 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4930-gfc3e0bff-1jammy [473 kB] 2024-09-16T03:05:10.217 INFO:teuthology.orchestra.run.smithi096.stdout:Get:13 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4930-gfc3e0bff-1jammy [28.2 MB] 2024-09-16T03:05:10.293 INFO:teuthology.orchestra.run.smithi096.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-16T03:05:10.305 INFO:teuthology.orchestra.run.smithi096.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-16T03:05:10.386 INFO:teuthology.orchestra.run.smithi096.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-16T03:05:10.618 INFO:teuthology.orchestra.run.smithi096.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-16T03:05:10.628 INFO:teuthology.orchestra.run.smithi096.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-16T03:05:10.658 INFO:teuthology.orchestra.run.smithi096.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-16T03:05:10.667 INFO:teuthology.orchestra.run.smithi096.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2024-09-16T03:05:10.669 INFO:teuthology.orchestra.run.smithi096.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-16T03:05:10.670 INFO:teuthology.orchestra.run.smithi096.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-16T03:05:10.671 INFO:teuthology.orchestra.run.smithi096.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-16T03:05:10.747 INFO:teuthology.orchestra.run.smithi096.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-16T03:05:10.812 INFO:teuthology.orchestra.run.smithi096.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-16T03:05:10.812 INFO:teuthology.orchestra.run.smithi096.stdout:Get:26 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4930-gfc3e0bff-1jammy [5,206 kB] 2024-09-16T03:05:10.815 INFO:teuthology.orchestra.run.smithi096.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-16T03:05:10.818 INFO:teuthology.orchestra.run.smithi096.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-16T03:05:10.818 INFO:teuthology.orchestra.run.smithi096.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-16T03:05:10.823 INFO:teuthology.orchestra.run.smithi096.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-16T03:05:10.827 INFO:teuthology.orchestra.run.smithi096.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-16T03:05:10.831 INFO:teuthology.orchestra.run.smithi096.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-16T03:05:10.832 INFO:teuthology.orchestra.run.smithi096.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-16T03:05:10.863 INFO:teuthology.orchestra.run.smithi096.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-16T03:05:10.876 INFO:teuthology.orchestra.run.smithi096.stdout:Get:35 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4930-gfc3e0bff-1jammy [251 kB] 2024-09-16T03:05:10.879 INFO:teuthology.orchestra.run.smithi096.stdout:Get:36 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4930-gfc3e0bff-1jammy [124 kB] 2024-09-16T03:05:10.881 INFO:teuthology.orchestra.run.smithi096.stdout:Get:37 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4930-gfc3e0bff-1jammy [1,561 kB] 2024-09-16T03:05:10.894 INFO:teuthology.orchestra.run.smithi096.stdout:Get:38 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4930-gfc3e0bff-1jammy [6,309 kB] 2024-09-16T03:05:10.915 INFO:teuthology.orchestra.run.smithi096.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-16T03:05:10.915 INFO:teuthology.orchestra.run.smithi096.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-16T03:05:10.916 INFO:teuthology.orchestra.run.smithi096.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-16T03:05:10.917 INFO:teuthology.orchestra.run.smithi096.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-16T03:05:10.917 INFO:teuthology.orchestra.run.smithi096.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-16T03:05:10.918 INFO:teuthology.orchestra.run.smithi096.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-16T03:05:10.919 INFO:teuthology.orchestra.run.smithi096.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-16T03:05:10.924 INFO:teuthology.orchestra.run.smithi096.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-16T03:05:10.945 INFO:teuthology.orchestra.run.smithi096.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-16T03:05:10.986 INFO:teuthology.orchestra.run.smithi096.stdout:Get:48 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4930-gfc3e0bff-1jammy [23.1 MB] 2024-09-16T03:05:11.026 INFO:teuthology.orchestra.run.smithi096.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-16T03:05:11.027 INFO:teuthology.orchestra.run.smithi096.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-16T03:05:11.029 INFO:teuthology.orchestra.run.smithi096.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-16T03:05:11.030 INFO:teuthology.orchestra.run.smithi096.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-16T03:05:11.031 INFO:teuthology.orchestra.run.smithi096.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-16T03:05:11.033 INFO:teuthology.orchestra.run.smithi096.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-16T03:05:11.035 INFO:teuthology.orchestra.run.smithi096.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-16T03:05:11.036 INFO:teuthology.orchestra.run.smithi096.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-16T03:05:11.108 INFO:teuthology.orchestra.run.smithi096.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-16T03:05:11.109 INFO:teuthology.orchestra.run.smithi096.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-16T03:05:11.128 INFO:teuthology.orchestra.run.smithi096.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-16T03:05:11.130 INFO:teuthology.orchestra.run.smithi096.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-16T03:05:11.132 INFO:teuthology.orchestra.run.smithi096.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-16T03:05:11.136 INFO:teuthology.orchestra.run.smithi096.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-16T03:05:11.191 INFO:teuthology.orchestra.run.smithi096.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-16T03:05:11.194 INFO:teuthology.orchestra.run.smithi096.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-16T03:05:11.195 INFO:teuthology.orchestra.run.smithi096.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-16T03:05:11.200 INFO:teuthology.orchestra.run.smithi096.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-16T03:05:11.271 INFO:teuthology.orchestra.run.smithi096.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-16T03:05:11.273 INFO:teuthology.orchestra.run.smithi096.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-16T03:05:11.278 INFO:teuthology.orchestra.run.smithi096.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-16T03:05:11.437 INFO:teuthology.orchestra.run.smithi096.stdout:Get:70 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4930-gfc3e0bff-1jammy [14.1 kB] 2024-09-16T03:05:11.437 INFO:teuthology.orchestra.run.smithi096.stdout:Get:71 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4930-gfc3e0bff-1jammy [880 kB] 2024-09-16T03:05:11.440 INFO:teuthology.orchestra.run.smithi096.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-16T03:05:11.508 INFO:teuthology.orchestra.run.smithi096.stdout:Get:73 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4930-gfc3e0bff-1jammy [2,452 kB] 2024-09-16T03:05:11.508 INFO:teuthology.orchestra.run.smithi096.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-16T03:05:11.510 INFO:teuthology.orchestra.run.smithi096.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-16T03:05:11.511 INFO:teuthology.orchestra.run.smithi096.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-16T03:05:11.513 INFO:teuthology.orchestra.run.smithi096.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-16T03:05:11.536 INFO:teuthology.orchestra.run.smithi096.stdout:Get:78 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4930-gfc3e0bff-1jammy [813 kB] 2024-09-16T03:05:11.548 INFO:teuthology.orchestra.run.smithi096.stdout:Get:79 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4930-gfc3e0bff-1jammy [160 kB] 2024-09-16T03:05:11.549 INFO:teuthology.orchestra.run.smithi096.stdout:Get:80 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4930-gfc3e0bff-1jammy [61.4 MB] 2024-09-16T03:05:11.556 INFO:teuthology.orchestra.run.smithi096.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-16T03:05:11.559 INFO:teuthology.orchestra.run.smithi096.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-16T03:05:11.560 INFO:teuthology.orchestra.run.smithi096.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-16T03:05:11.605 INFO:teuthology.orchestra.run.smithi096.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-16T03:05:11.606 INFO:teuthology.orchestra.run.smithi096.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-16T03:05:11.676 INFO:teuthology.orchestra.run.smithi096.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-16T03:05:11.676 INFO:teuthology.orchestra.run.smithi096.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-16T03:05:11.677 INFO:teuthology.orchestra.run.smithi096.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-16T03:05:11.678 INFO:teuthology.orchestra.run.smithi096.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-16T03:05:11.679 INFO:teuthology.orchestra.run.smithi096.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-16T03:05:11.680 INFO:teuthology.orchestra.run.smithi096.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-16T03:05:11.686 INFO:teuthology.orchestra.run.smithi096.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-16T03:05:11.757 INFO:teuthology.orchestra.run.smithi096.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-16T03:05:11.760 INFO:teuthology.orchestra.run.smithi096.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-16T03:05:11.762 INFO:teuthology.orchestra.run.smithi096.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-16T03:05:11.839 INFO:teuthology.orchestra.run.smithi096.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-16T03:05:11.845 INFO:teuthology.orchestra.run.smithi096.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-16T03:05:11.847 INFO:teuthology.orchestra.run.smithi096.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-16T03:05:11.849 INFO:teuthology.orchestra.run.smithi096.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-16T03:05:11.860 INFO:teuthology.orchestra.run.smithi096.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-16T03:05:11.861 INFO:teuthology.orchestra.run.smithi096.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-16T03:05:11.868 INFO:teuthology.orchestra.run.smithi096.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-16T03:05:11.920 INFO:teuthology.orchestra.run.smithi096.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-16T03:05:11.922 INFO:teuthology.orchestra.run.smithi096.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-16T03:05:11.922 INFO:teuthology.orchestra.run.smithi096.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-16T03:05:12.002 INFO:teuthology.orchestra.run.smithi096.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-16T03:05:12.004 INFO:teuthology.orchestra.run.smithi096.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-16T03:05:12.021 INFO:teuthology.orchestra.run.smithi096.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-16T03:05:12.021 INFO:teuthology.orchestra.run.smithi096.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-16T03:05:12.022 INFO:teuthology.orchestra.run.smithi096.stdout:Get:110 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-16T03:05:12.027 INFO:teuthology.orchestra.run.smithi096.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-16T03:05:12.029 INFO:teuthology.orchestra.run.smithi096.stdout:Get:112 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-16T03:05:12.817 INFO:teuthology.orchestra.run.smithi096.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4930-gfc3e0bff-1jammy [8,625 kB] 2024-09-16T03:05:12.973 INFO:teuthology.orchestra.run.smithi096.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4930-gfc3e0bff-1jammy [14.2 kB] 2024-09-16T03:05:12.973 INFO:teuthology.orchestra.run.smithi096.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4930-gfc3e0bff-1jammy [48.5 MB] 2024-09-16T03:05:13.989 INFO:teuthology.orchestra.run.smithi096.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4930-gfc3e0bff-1jammy [130 kB] 2024-09-16T03:05:13.992 INFO:teuthology.orchestra.run.smithi096.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4930-gfc3e0bff-1jammy [39.0 kB] 2024-09-16T03:05:13.993 INFO:teuthology.orchestra.run.smithi096.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4930-gfc3e0bff-1jammy [15.8 MB] 2024-09-16T03:05:14.299 INFO:teuthology.orchestra.run.smithi096.stdout:Get:119 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4930-gfc3e0bff-1jammy [91.2 kB] 2024-09-16T03:05:14.868 INFO:teuthology.orchestra.run.smithi096.stdout:Fetched 244 MB in 5s (52.9 MB/s) 2024-09-16T03:05:15.030 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-16T03:05:15.129 INFO:teuthology.orchestra.run.smithi096.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-16T03:05:15.134 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-16T03:05:15.228 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-16T03:05:15.573 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-16T03:05:15.600 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-16T03:05:15.640 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-16T03:05:15.976 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-16T03:05:16.002 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-16T03:05:16.053 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-16T03:05:16.513 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-16T03:05:16.539 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-16T03:05:16.588 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T03:05:16.982 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-16T03:05:17.008 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-16T03:05:17.049 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T03:05:17.411 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-16T03:05:17.436 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-16T03:05:17.493 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T03:05:17.855 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-16T03:05:17.881 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-16T03:05:17.921 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-16T03:05:18.266 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package librados2. 2024-09-16T03:05:18.292 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../007-librados2_19.3.0-4930-gfc3e0bff-1jammy_amd64.deb ... 2024-09-16T03:05:18.333 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking librados2 (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-16T03:05:18.802 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libnbd0. 2024-09-16T03:05:18.828 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../008-libnbd0_1.10.5-1_amd64.deb ... 2024-09-16T03:05:18.869 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libnbd0 (1.10.5-1) ... 2024-09-16T03:05:19.197 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package librbd1. 2024-09-16T03:05:19.222 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../009-librbd1_19.3.0-4930-gfc3e0bff-1jammy_amd64.deb ... 2024-09-16T03:05:19.263 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking librbd1 (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-16T03:05:19.708 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libcephfs2. 2024-09-16T03:05:19.733 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../010-libcephfs2_19.3.0-4930-gfc3e0bff-1jammy_amd64.deb ... 2024-09-16T03:05:19.774 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libcephfs2 (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-16T03:05:20.060 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-rados. 2024-09-16T03:05:20.086 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../011-python3-rados_19.3.0-4930-gfc3e0bff-1jammy_amd64.deb ... 2024-09-16T03:05:20.126 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-rados (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-16T03:05:20.446 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-16T03:05:20.472 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../012-python3-ceph-argparse_19.3.0-4930-gfc3e0bff-1jammy_all.deb ... 2024-09-16T03:05:20.513 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-ceph-argparse (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-16T03:05:20.723 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-cephfs. 2024-09-16T03:05:20.749 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../013-python3-cephfs_19.3.0-4930-gfc3e0bff-1jammy_amd64.deb ... 2024-09-16T03:05:20.790 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-cephfs (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-16T03:05:21.109 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-16T03:05:21.135 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../014-python3-ceph-common_19.3.0-4930-gfc3e0bff-1jammy_all.deb ... 2024-09-16T03:05:21.176 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-ceph-common (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-16T03:05:21.496 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-16T03:05:21.522 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../015-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-16T03:05:21.562 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-16T03:05:21.873 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-prettytable. 2024-09-16T03:05:21.900 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../016-python3-prettytable_2.5.0-2_all.deb ... 2024-09-16T03:05:21.940 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-16T03:05:22.201 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-rbd. 2024-09-16T03:05:22.223 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../017-python3-rbd_19.3.0-4930-gfc3e0bff-1jammy_amd64.deb ... 2024-09-16T03:05:22.259 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-rbd (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-16T03:05:22.612 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-16T03:05:22.638 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../018-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-16T03:05:22.678 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-16T03:05:22.956 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-16T03:05:22.982 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../019-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-16T03:05:23.023 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-16T03:05:23.334 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-16T03:05:23.360 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../020-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-16T03:05:23.400 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-16T03:05:23.745 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package lua5.1. 2024-09-16T03:05:23.772 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../021-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-16T03:05:23.812 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-16T03:05:24.132 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package lua-any. 2024-09-16T03:05:24.158 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../022-lua-any_27ubuntu1_all.deb ... 2024-09-16T03:05:24.198 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-16T03:05:24.400 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package zip. 2024-09-16T03:05:24.413 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../023-zip_3.0-12build2_amd64.deb ... 2024-09-16T03:05:24.450 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking zip (3.0-12build2) ... 2024-09-16T03:05:24.764 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package unzip. 2024-09-16T03:05:24.790 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../024-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-16T03:05:24.831 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-16T03:05:25.218 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package luarocks. 2024-09-16T03:05:25.245 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../025-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-16T03:05:25.284 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-16T03:05:25.650 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package librgw2. 2024-09-16T03:05:25.677 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../026-librgw2_19.3.0-4930-gfc3e0bff-1jammy_amd64.deb ... 2024-09-16T03:05:25.717 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking librgw2 (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-16T03:05:26.311 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-rgw. 2024-09-16T03:05:26.338 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../027-python3-rgw_19.3.0-4930-gfc3e0bff-1jammy_amd64.deb ... 2024-09-16T03:05:26.377 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-rgw (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-16T03:05:26.714 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-16T03:05:26.740 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../028-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-16T03:05:26.780 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-16T03:05:27.091 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libradosstriper1. 2024-09-16T03:05:27.118 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../029-libradosstriper1_19.3.0-4930-gfc3e0bff-1jammy_amd64.deb ... 2024-09-16T03:05:27.158 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libradosstriper1 (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-16T03:05:27.528 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-common. 2024-09-16T03:05:27.554 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../030-ceph-common_19.3.0-4930-gfc3e0bff-1jammy_amd64.deb ... 2024-09-16T03:05:27.586 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-common (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-16T03:05:29.175 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-base. 2024-09-16T03:05:29.201 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../031-ceph-base_19.3.0-4930-gfc3e0bff-1jammy_amd64.deb ... 2024-09-16T03:05:29.251 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-base (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-16T03:05:29.829 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-16T03:05:29.855 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../032-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-16T03:05:29.895 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-16T03:05:30.198 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-cheroot. 2024-09-16T03:05:30.225 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../033-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-16T03:05:30.265 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-16T03:05:30.635 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-16T03:05:30.661 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../034-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-16T03:05:30.701 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-16T03:05:30.970 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-16T03:05:30.996 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../035-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-16T03:05:31.028 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-16T03:05:31.331 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-16T03:05:31.358 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../036-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-16T03:05:31.398 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-16T03:05:31.701 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-tempora. 2024-09-16T03:05:31.727 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../037-python3-tempora_4.1.2-1_all.deb ... 2024-09-16T03:05:31.767 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-16T03:05:32.045 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-portend. 2024-09-16T03:05:32.072 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../038-python3-portend_3.0.0-1_all.deb ... 2024-09-16T03:05:32.111 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-16T03:05:32.398 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-16T03:05:32.424 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../039-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-16T03:05:32.464 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-16T03:05:32.767 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-16T03:05:32.794 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../040-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-16T03:05:32.834 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-16T03:05:33.120 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-natsort. 2024-09-16T03:05:33.144 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../041-python3-natsort_8.0.2-1_all.deb ... 2024-09-16T03:05:33.178 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-16T03:05:33.490 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-logutils. 2024-09-16T03:05:33.517 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../042-python3-logutils_0.3.3-8_all.deb ... 2024-09-16T03:05:33.557 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-16T03:05:33.860 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-16T03:05:33.886 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../043-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-16T03:05:33.926 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-16T03:05:34.237 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-mako. 2024-09-16T03:05:34.264 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../044-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-16T03:05:34.303 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-16T03:05:34.632 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-16T03:05:34.659 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../045-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-16T03:05:34.690 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-16T03:05:34.976 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-16T03:05:35.003 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../046-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-16T03:05:35.042 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-16T03:05:35.337 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-webob. 2024-09-16T03:05:35.363 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../047-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-16T03:05:35.403 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-16T03:05:35.749 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-waitress. 2024-09-16T03:05:35.775 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../048-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-16T03:05:35.818 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-16T03:05:36.126 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-tempita. 2024-09-16T03:05:36.153 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../049-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-16T03:05:36.192 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-16T03:05:36.437 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-paste. 2024-09-16T03:05:36.452 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../050-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-16T03:05:36.495 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-16T03:05:36.840 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-16T03:05:36.856 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../051-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-16T03:05:36.899 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-16T03:05:37.143 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-16T03:05:37.158 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../052-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-16T03:05:37.201 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-16T03:05:37.504 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-webtest. 2024-09-16T03:05:37.532 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../053-python3-webtest_2.0.35-1_all.deb ... 2024-09-16T03:05:37.570 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-16T03:05:37.890 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pecan. 2024-09-16T03:05:37.917 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../054-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-16T03:05:37.956 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-16T03:05:38.328 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-certifi. 2024-09-16T03:05:38.355 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../055-python3-certifi_2020.6.20-1_all.deb ... 2024-09-16T03:05:38.394 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-16T03:05:38.714 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-idna. 2024-09-16T03:05:38.741 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../056-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-16T03:05:38.812 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-16T03:05:39.116 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-urllib3. 2024-09-16T03:05:39.140 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../057-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-16T03:05:39.183 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-16T03:05:39.478 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-requests. 2024-09-16T03:05:39.504 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../058-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-16T03:05:39.544 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-16T03:05:39.857 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-16T03:05:39.882 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../059-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-16T03:05:39.922 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-16T03:05:40.192 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-16T03:05:40.207 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../060-ceph-mgr-modules-core_19.3.0-4930-gfc3e0bff-1jammy_all.deb ... 2024-09-16T03:05:40.242 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-16T03:05:40.622 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-16T03:05:40.648 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../061-libsqlite3-mod-ceph_19.3.0-4930-gfc3e0bff-1jammy_amd64.deb ... 2024-09-16T03:05:40.688 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-16T03:05:41.008 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-16T03:05:41.023 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../062-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-16T03:05:41.057 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-16T03:05:41.294 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-openssl. 2024-09-16T03:05:41.320 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../063-python3-openssl_21.0.0-1_all.deb ... 2024-09-16T03:05:41.360 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-16T03:05:41.713 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mgr. 2024-09-16T03:05:41.740 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../064-ceph-mgr_19.3.0-4930-gfc3e0bff-1jammy_amd64.deb ... 2024-09-16T03:05:41.780 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mgr (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-16T03:05:42.175 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mon. 2024-09-16T03:05:42.201 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../065-ceph-mon_19.3.0-4930-gfc3e0bff-1jammy_amd64.deb ... 2024-09-16T03:05:42.241 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mon (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-16T03:05:42.811 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-osd. 2024-09-16T03:05:42.840 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../066-ceph-osd_19.3.0-4930-gfc3e0bff-1jammy_amd64.deb ... 2024-09-16T03:05:42.869 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-osd (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-16T03:05:44.639 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph. 2024-09-16T03:05:44.655 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../067-ceph_19.3.0-4930-gfc3e0bff-1jammy_amd64.deb ... 2024-09-16T03:05:44.697 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-16T03:05:45.058 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-fuse. 2024-09-16T03:05:45.085 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../068-ceph-fuse_19.3.0-4930-gfc3e0bff-1jammy_amd64.deb ... 2024-09-16T03:05:45.125 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-fuse (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-16T03:05:45.503 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mds. 2024-09-16T03:05:45.530 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../069-ceph-mds_19.3.0-4930-gfc3e0bff-1jammy_amd64.deb ... 2024-09-16T03:05:45.569 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mds (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-16T03:05:45.964 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package cephadm. 2024-09-16T03:05:45.991 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../070-cephadm_19.3.0-4930-gfc3e0bff-1jammy_amd64.deb ... 2024-09-16T03:05:46.030 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking cephadm (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-16T03:05:46.342 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-16T03:05:46.368 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../071-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-16T03:05:46.408 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-16T03:05:46.711 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-16T03:05:46.726 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../072-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-16T03:05:46.769 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-16T03:05:47.782 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-babel. 2024-09-16T03:05:47.809 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../073-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-16T03:05:47.849 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-16T03:05:48.152 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-jinja2. 2024-09-16T03:05:48.167 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../074-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-16T03:05:48.201 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-16T03:05:48.530 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-16T03:05:48.557 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../075-ceph-mgr-cephadm_19.3.0-4930-gfc3e0bff-1jammy_all.deb ... 2024-09-16T03:05:48.596 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-16T03:05:48.933 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-16T03:05:48.959 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2024-09-16T03:05:49.000 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-16T03:05:49.327 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-routes. 2024-09-16T03:05:49.353 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-16T03:05:49.393 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-16T03:05:49.747 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-16T03:05:49.774 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_19.3.0-4930-gfc3e0bff-1jammy_all.deb ... 2024-09-16T03:05:49.813 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-16T03:05:52.609 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-16T03:05:52.639 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-16T03:05:52.684 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-16T03:05:53.188 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-joblib. 2024-09-16T03:05:53.215 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-16T03:05:53.254 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-16T03:05:53.616 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-16T03:05:53.644 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-16T03:05:53.682 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-16T03:05:53.993 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-sklearn. 2024-09-16T03:05:54.021 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-16T03:05:54.154 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-16T03:05:55.096 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-16T03:05:55.124 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_19.3.0-4930-gfc3e0bff-1jammy_all.deb ... 2024-09-16T03:05:55.179 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-16T03:05:56.124 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-cachetools. 2024-09-16T03:05:56.151 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2024-09-16T03:05:56.190 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-16T03:05:56.493 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-16T03:05:56.520 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-16T03:05:56.559 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-16T03:05:56.863 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-16T03:05:56.890 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-16T03:05:56.921 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-16T03:05:57.199 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-rsa. 2024-09-16T03:05:57.215 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2024-09-16T03:05:57.249 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-16T03:05:57.578 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-google-auth. 2024-09-16T03:05:57.605 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2024-09-16T03:05:57.644 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-16T03:05:57.964 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-16T03:05:57.992 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-16T03:05:58.030 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-16T03:05:58.342 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-websocket. 2024-09-16T03:05:58.369 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2024-09-16T03:05:58.408 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-16T03:05:58.703 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-16T03:05:58.731 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-16T03:05:58.761 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-16T03:05:59.442 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-16T03:05:59.470 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_19.3.0-4930-gfc3e0bff-1jammy_all.deb ... 2024-09-16T03:05:59.508 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-16T03:05:59.820 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-16T03:05:59.847 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-16T03:05:59.886 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-16T03:06:00.356 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-16T03:06:00.384 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-16T03:06:00.414 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-16T03:06:00.666 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package jq. 2024-09-16T03:06:00.683 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-16T03:06:00.725 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-16T03:06:00.969 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package socat. 2024-09-16T03:06:00.985 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-16T03:06:01.019 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-16T03:06:01.289 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package xmlstarlet. 2024-09-16T03:06:01.305 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-16T03:06:01.339 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-16T03:06:01.651 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-test. 2024-09-16T03:06:01.679 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../098-ceph-test_19.3.0-4930-gfc3e0bff-1jammy_amd64.deb ... 2024-09-16T03:06:01.717 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-test (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-16T03:06:03.974 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-volume. 2024-09-16T03:06:04.002 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../099-ceph-volume_19.3.0-4930-gfc3e0bff-1jammy_all.deb ... 2024-09-16T03:06:04.040 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-volume (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-16T03:06:04.319 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-16T03:06:04.335 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../100-libcephfs-dev_19.3.0-4930-gfc3e0bff-1jammy_amd64.deb ... 2024-09-16T03:06:04.392 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libcephfs-dev (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-16T03:06:04.697 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-16T03:06:04.725 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../101-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-16T03:06:04.772 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-16T03:06:05.102 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-16T03:06:05.130 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../102-lua-sec_1.0.2-1_amd64.deb ... 2024-09-16T03:06:05.168 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-16T03:06:05.514 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package nvme-cli. 2024-09-16T03:06:05.542 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../103-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-16T03:06:05.580 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-16T03:06:05.969 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package pkg-config. 2024-09-16T03:06:05.997 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../104-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-16T03:06:06.036 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-16T03:06:06.298 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-16T03:06:06.313 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../105-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-16T03:06:06.355 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-16T03:06:06.801 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-16T03:06:06.828 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../106-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-16T03:06:06.867 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-16T03:06:07.170 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pastescript. 2024-09-16T03:06:07.197 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2024-09-16T03:06:07.253 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-16T03:06:07.565 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pluggy. 2024-09-16T03:06:07.593 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../108-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-16T03:06:07.631 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-16T03:06:07.918 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-psutil. 2024-09-16T03:06:07.946 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../109-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-16T03:06:07.976 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-16T03:06:08.321 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-py. 2024-09-16T03:06:08.349 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../110-python3-py_1.10.0-1_all.deb ... 2024-09-16T03:06:08.387 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-16T03:06:08.658 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pygments. 2024-09-16T03:06:08.685 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../111-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-16T03:06:08.724 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-16T03:06:09.136 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-16T03:06:09.153 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../112-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-16T03:06:09.194 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-16T03:06:09.498 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-toml. 2024-09-16T03:06:09.525 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../113-python3-toml_0.10.2-1_all.deb ... 2024-09-16T03:06:09.564 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-16T03:06:09.867 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pytest. 2024-09-16T03:06:09.895 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../114-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-16T03:06:09.933 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-16T03:06:10.273 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-simplejson. 2024-09-16T03:06:10.298 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../115-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-16T03:06:10.337 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-16T03:06:10.607 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-16T03:06:10.623 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../116-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-16T03:06:10.664 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-16T03:06:11.411 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package radosgw. 2024-09-16T03:06:11.440 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../117-radosgw_19.3.0-4930-gfc3e0bff-1jammy_amd64.deb ... 2024-09-16T03:06:11.477 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking radosgw (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-16T03:06:12.372 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package rbd-fuse. 2024-09-16T03:06:12.400 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../118-rbd-fuse_19.3.0-4930-gfc3e0bff-1jammy_amd64.deb ... 2024-09-16T03:06:12.438 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking rbd-fuse (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-16T03:06:12.726 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-16T03:06:12.985 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-16T03:06:13.111 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-16T03:06:13.362 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-16T03:06:13.661 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-16T03:06:14.078 INFO:teuthology.orchestra.run.smithi096.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-16T03:06:14.364 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up cephadm (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-16T03:06:14.872 INFO:teuthology.orchestra.run.smithi096.stdout:Adding system user cephadm....done 2024-09-16T03:06:15.020 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-16T03:06:15.289 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-16T03:06:15.540 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-16T03:06:15.674 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-16T03:06:15.925 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-16T03:06:16.176 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-16T03:06:16.303 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-16T03:06:16.605 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-16T03:06:16.982 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-16T03:06:17.233 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-16T03:06:17.501 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-16T03:06:17.744 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-16T03:06:18.004 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-16T03:06:18.263 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-16T03:06:18.531 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-ceph-argparse (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-16T03:06:18.791 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-16T03:06:18.925 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libnbd0 (1.10.5-1) ... 2024-09-16T03:06:19.051 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-16T03:06:19.177 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-16T03:06:19.303 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-16T03:06:19.571 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-16T03:06:19.954 INFO:teuthology.orchestra.run.smithi096.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-16T03:06:19.985 INFO:teuthology.orchestra.run.smithi096.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-16T03:06:20.050 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-16T03:06:20.175 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-16T03:06:20.535 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-16T03:06:20.661 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-16T03:06:20.929 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-16T03:06:21.197 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-16T03:06:21.506 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up zip (3.0-12build2) ... 2024-09-16T03:06:21.633 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-16T03:06:22.284 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-16T03:06:22.544 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-16T03:06:22.645 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-16T03:06:22.771 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-16T03:06:23.072 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-16T03:06:23.474 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-16T03:06:23.725 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-16T03:06:24.101 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-16T03:06:24.394 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-16T03:06:24.754 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-16T03:06:25.014 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-16T03:06:25.140 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-ceph-common (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-16T03:06:25.441 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-16T03:06:25.776 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-16T03:06:26.965 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-16T03:06:27.225 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T03:06:27.376 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-16T03:06:27.644 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-16T03:06:27.787 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-16T03:06:27.913 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-16T03:06:28.223 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-16T03:06:28.474 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-16T03:06:28.733 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T03:06:28.859 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-16T03:06:29.152 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-16T03:06:29.404 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-16T03:06:29.697 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-16T03:06:29.956 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-16T03:06:30.341 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-16T03:06:30.600 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-16T03:06:30.726 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-16T03:06:31.020 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-16T03:06:31.547 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-16T03:06:31.855 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-16T03:06:32.173 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-16T03:06:32.432 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-16T03:06:32.558 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-16T03:06:32.684 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-16T03:06:32.766 INFO:teuthology.orchestra.run.smithi096.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-16T03:06:33.028 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-16T03:06:33.154 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-16T03:06:33.564 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-16T03:06:33.823 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-16T03:06:33.949 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-16T03:06:34.208 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T03:06:34.335 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-16T03:06:34.644 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-16T03:06:34.970 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-16T03:06:35.247 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-16T03:06:35.373 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-16T03:06:35.640 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-16T03:06:36.010 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-16T03:06:36.278 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-16T03:06:36.672 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-16T03:06:36.957 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-16T03:06:37.293 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-16T03:06:37.402 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up librados2 (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-16T03:06:37.528 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-16T03:06:37.655 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-16T03:06:37.991 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libcephfs2 (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-16T03:06:38.125 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libradosstriper1 (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-16T03:06:38.251 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-16T03:06:38.511 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up librbd1 (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-16T03:06:38.654 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mgr-modules-core (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-16T03:06:38.789 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-fuse (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-16T03:06:39.005 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-16T03:06:39.005 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-16T03:06:39.532 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libcephfs-dev (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-16T03:06:39.658 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-rados (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-16T03:06:39.800 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up librgw2 (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-16T03:06:39.927 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-16T03:06:41.072 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-rbd (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-16T03:06:41.200 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up rbd-fuse (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-16T03:06:41.324 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-rgw (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-16T03:06:41.450 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-cephfs (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-16T03:06:41.576 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-common (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-16T03:06:42.136 INFO:teuthology.orchestra.run.smithi096.stdout:Adding group ceph....done 2024-09-16T03:06:42.538 INFO:teuthology.orchestra.run.smithi096.stdout:Adding system user ceph....done 2024-09-16T03:06:42.690 INFO:teuthology.orchestra.run.smithi096.stdout:Setting system user ceph properties....done 2024-09-16T03:06:42.705 INFO:teuthology.orchestra.run.smithi096.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-16T03:06:42.841 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-16T03:06:43.217 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-16T03:06:43.687 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-test (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-16T03:06:43.838 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up radosgw (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-16T03:06:44.312 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-16T03:06:44.312 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-16T03:06:44.782 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-base (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-16T03:06:45.141 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-16T03:06:45.608 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mds (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-16T03:06:45.816 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-16T03:06:45.816 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-16T03:06:46.277 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mgr (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-16T03:06:46.490 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-16T03:06:46.490 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-16T03:06:46.971 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-osd (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-16T03:06:47.248 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-16T03:06:47.248 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-16T03:06:47.714 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-16T03:06:47.840 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-16T03:06:47.991 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mon (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-16T03:06:48.211 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-16T03:06:48.212 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-16T03:06:48.667 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mgr-cephadm (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-16T03:06:48.810 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-16T03:06:48.937 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mgr-dashboard (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-16T03:06:49.088 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-volume (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-16T03:06:49.449 INFO:teuthology.orchestra.run.smithi096.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-16T03:06:49.558 INFO:teuthology.orchestra.run.smithi096.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-16T03:06:49.694 INFO:teuthology.orchestra.run.smithi096.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-16T03:06:50.837 INFO:teuthology.orchestra.run.smithi096.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-16T03:06:51.471 INFO:teuthology.orchestra.run.smithi096.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-16T03:06:51.477 DEBUG:teuthology.parallel:result is None 2024-09-16T03:06:51.477 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=fc3e0bff7468fd55478adbae7f75508b749124b6 2024-09-16T03:06:51.627 DEBUG:teuthology.orchestra.run.smithi096:> dpkg-query -W -f '${Version}' ceph 2024-09-16T03:06:51.645 INFO:teuthology.orchestra.run.smithi096.stdout:19.3.0-4930-gfc3e0bff-1jammy 2024-09-16T03:06:51.645 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4930-gfc3e0bff-1jammy 2024-09-16T03:06:51.646 INFO:teuthology.task.install:The correct ceph version 19.3.0-4930-gfc3e0bff-1jammy is installed. 2024-09-16T03:06:51.647 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-16T03:06:51.647 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-09-16T03:06:51.648 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-16T03:06:51.698 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-16T03:06:51.698 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-09-16T03:06:51.698 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/usr/bin/daemon-helper 2024-09-16T03:06:51.754 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-16T03:06:51.805 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-16T03:06:51.805 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-09-16T03:06:51.805 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-16T03:06:51.860 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-16T03:06:51.918 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-16T03:06:51.918 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-09-16T03:06:51.918 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/usr/bin/stdin-killer 2024-09-16T03:06:51.971 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-16T03:06:52.027 INFO:teuthology.run_tasks:Running task workunit... 2024-09-16T03:06:52.042 INFO:tasks.workunit:Pulling workunits from ref 7498493279982dfe87f00616198a5967475f6169 2024-09-16T03:06:52.042 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-16T03:06:52.042 INFO:tasks.workunit:timeout=3h 2024-09-16T03:06:52.042 INFO:tasks.workunit:cleanup=True 2024-09-16T03:06:52.042 DEBUG:teuthology.orchestra.run.smithi096:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-16T03:06:52.075 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T03:06:52.075 INFO:teuthology.orchestra.run.smithi096.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-16T03:06:52.075 DEBUG:teuthology.orchestra.run.smithi096:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-16T03:06:52.122 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-16T03:06:52.123 DEBUG:teuthology.orchestra.run.smithi096:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-16T03:06:52.172 DEBUG:teuthology.orchestra.run.smithi096:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 7498493279982dfe87f00616198a5967475f6169 2024-09-16T03:06:52.222 INFO:tasks.workunit.client.0.smithi096.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-16T03:07:45.380 INFO:tasks.workunit.client.0.smithi096.stderr:Note: switching to '7498493279982dfe87f00616198a5967475f6169'. 2024-09-16T03:07:45.380 INFO:tasks.workunit.client.0.smithi096.stderr: 2024-09-16T03:07:45.380 INFO:tasks.workunit.client.0.smithi096.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-16T03:07:45.380 INFO:tasks.workunit.client.0.smithi096.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-16T03:07:45.380 INFO:tasks.workunit.client.0.smithi096.stderr:state without impacting any branches by switching back to a branch. 2024-09-16T03:07:45.381 INFO:tasks.workunit.client.0.smithi096.stderr: 2024-09-16T03:07:45.381 INFO:tasks.workunit.client.0.smithi096.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-16T03:07:45.381 INFO:tasks.workunit.client.0.smithi096.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-16T03:07:45.381 INFO:tasks.workunit.client.0.smithi096.stderr: 2024-09-16T03:07:45.381 INFO:tasks.workunit.client.0.smithi096.stderr: git switch -c 2024-09-16T03:07:45.381 INFO:tasks.workunit.client.0.smithi096.stderr: 2024-09-16T03:07:45.381 INFO:tasks.workunit.client.0.smithi096.stderr:Or undo this operation with: 2024-09-16T03:07:45.381 INFO:tasks.workunit.client.0.smithi096.stderr: 2024-09-16T03:07:45.381 INFO:tasks.workunit.client.0.smithi096.stderr: git switch - 2024-09-16T03:07:45.381 INFO:tasks.workunit.client.0.smithi096.stderr: 2024-09-16T03:07:45.382 INFO:tasks.workunit.client.0.smithi096.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-16T03:07:45.382 INFO:tasks.workunit.client.0.smithi096.stderr: 2024-09-16T03:07:45.382 INFO:tasks.workunit.client.0.smithi096.stderr:HEAD is now at 74984932799 Merge pull request #59797 from zdover23/wip-doc-2024-09-15-install-install-storage-cluster 2024-09-16T03:07:45.383 DEBUG:teuthology.orchestra.run.smithi096:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/standalone && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-16T03:07:45.431 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-09-16T03:07:45.431 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-16T03:07:45.478 INFO:tasks.workunit:Running workunits matching mon on client.0... 2024-09-16T03:07:45.478 INFO:tasks.workunit:Running workunit mon/health-mute.sh... 2024-09-16T03:07:45.479 DEBUG:teuthology.orchestra.run.smithi096:workunit test mon/health-mute.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7498493279982dfe87f00616198a5967475f6169 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh 2024-09-16T03:07:45.544 INFO:tasks.workunit.client.0.smithi096.stderr:stty: 'standard input': Inappropriate ioctl for device 2024-09-16T03:07:45.549 INFO:tasks.workunit.client.0.smithi096.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2024-09-16T03:07:45.549 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2315: main: export PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-16T03:07:45.549 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2315: main: PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-16T03:07:45.550 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2316: main: export PYTHONWARNINGS=ignore 2024-09-16T03:07:45.550 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2316: main: PYTHONWARNINGS=ignore 2024-09-16T03:07:45.550 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2317: main: export CEPH_CONF=/dev/null 2024-09-16T03:07:45.550 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2317: main: CEPH_CONF=/dev/null 2024-09-16T03:07:45.550 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2318: main: unset CEPH_ARGS 2024-09-16T03:07:45.550 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2320: main: local code 2024-09-16T03:07:45.550 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2321: main: run td/health-mute 2024-09-16T03:07:45.550 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:6: run: local dir=td/health-mute 2024-09-16T03:07:45.550 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:7: run: shift 2024-09-16T03:07:45.550 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:9: run: export CEPH_MON=127.0.0.1:7143 2024-09-16T03:07:45.550 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:9: run: CEPH_MON=127.0.0.1:7143 2024-09-16T03:07:45.550 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:10: run: export CEPH_ARGS 2024-09-16T03:07:45.551 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:11: run: uuidgen 2024-09-16T03:07:45.551 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:11: run: CEPH_ARGS+='--fsid=13dae064-b3e7-46f2-8f68-a5d53a7e19dc --auth-supported=none --mon-pg-warn-min-per-osd 0 --mon-max-pg-per-osd 1000 ' 2024-09-16T03:07:45.551 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:12: run: CEPH_ARGS+='--mon-host=127.0.0.1:7143 ' 2024-09-16T03:07:45.551 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:14: run: set 2024-09-16T03:07:45.551 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:14: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2024-09-16T03:07:45.553 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:14: run: local funcs=TEST_mute 2024-09-16T03:07:45.554 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:15: run: for func in $funcs 2024-09-16T03:07:45.554 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:16: run: setup td/health-mute 2024-09-16T03:07:45.554 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/health-mute 2024-09-16T03:07:45.554 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/health-mute 2024-09-16T03:07:45.554 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/health-mute 2024-09-16T03:07:45.554 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:07:45.554 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/health-mute KILL 2024-09-16T03:07:45.554 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:07:45.554 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:07:45.554 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:07:45.554 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:07:45.555 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:07:45.555 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:07:45.555 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:07:45.556 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:07:45.556 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:07:45.557 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:07:45.557 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:07:45.557 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:07:45.558 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:07:45.558 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:07:45.560 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:07:45.560 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:07:45.560 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:07:45.560 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:07:45.560 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/health-mute 2024-09-16T03:07:45.561 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:07:45.561 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:07:45.561 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.21529 2024-09-16T03:07:45.561 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.21529 2024-09-16T03:07:45.562 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:07:45.562 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:07:45.562 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/health-mute 2024-09-16T03:07:45.564 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T03:07:45.564 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:07:45.564 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.21529 2024-09-16T03:07:45.564 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.21529 2024-09-16T03:07:45.566 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T03:07:45.566 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2024-09-16T03:07:45.566 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2024-09-16T03:07:45.567 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T03:07:45.567 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/health-mute 1' TERM HUP INT 2024-09-16T03:07:45.567 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:17: run: TEST_mute td/health-mute 2024-09-16T03:07:45.567 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:23: TEST_mute: local dir=td/health-mute 2024-09-16T03:07:45.567 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:24: TEST_mute: setup td/health-mute 2024-09-16T03:07:45.567 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/health-mute 2024-09-16T03:07:45.567 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/health-mute 2024-09-16T03:07:45.567 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/health-mute 2024-09-16T03:07:45.567 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:07:45.567 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/health-mute KILL 2024-09-16T03:07:45.567 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:07:45.567 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:07:45.567 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:07:45.567 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:07:45.568 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:07:45.568 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:07:45.568 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:07:45.568 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:07:45.569 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:07:45.570 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:07:45.570 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:07:45.570 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:07:45.572 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:07:45.572 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:07:45.572 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:07:45.572 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:07:45.572 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:07:45.573 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:07:45.574 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/health-mute 2024-09-16T03:07:45.575 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:07:45.575 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:07:45.575 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.21529 2024-09-16T03:07:45.575 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.21529 2024-09-16T03:07:45.576 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:07:45.576 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:07:45.576 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/health-mute 2024-09-16T03:07:45.577 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T03:07:45.577 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:07:45.577 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.21529 2024-09-16T03:07:45.578 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.21529 2024-09-16T03:07:45.578 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T03:07:45.580 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2024-09-16T03:07:45.580 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T03:07:45.580 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/health-mute 1' TERM HUP INT 2024-09-16T03:07:45.580 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:26: TEST_mute: set -o pipefail 2024-09-16T03:07:45.580 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:28: TEST_mute: run_mon td/health-mute a 2024-09-16T03:07:45.580 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/health-mute 2024-09-16T03:07:45.580 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T03:07:45.580 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T03:07:45.580 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T03:07:45.580 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/health-mute/a 2024-09-16T03:07:45.580 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/health-mute/a --run-dir=td/health-mute 2024-09-16T03:07:46.137 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T03:07:46.137 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:07:46.137 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:07:46.138 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:07:46.138 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:07:46.138 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.21529 2024-09-16T03:07:46.138 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.21529/$cluster-$name.asok' 2024-09-16T03:07:46.139 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/health-mute/a '--log-file=td/health-mute/$name.log' '--admin-socket=/tmp/ceph-asok.21529/$cluster-$name.asok' --mon-cluster-log-file=td/health-mute/log --run-dir=td/health-mute '--pid-file=td/health-mute/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-09-16T03:07:46.351 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T03:07:46.356 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T03:07:46.356 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:07:46.356 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:07:46.356 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T03:07:46.356 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T03:07:46.357 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:07:46.357 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:07:46.357 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:07:46.357 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:07:46.357 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:07:46.358 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.21529 2024-09-16T03:07:46.358 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.21529/ceph-mon.a.asok 2024-09-16T03:07:46.358 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:07:46.358 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.21529/ceph-mon.a.asok config get fsid 2024-09-16T03:07:46.471 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T03:07:46.471 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:07:46.472 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:07:46.472 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T03:07:46.473 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T03:07:46.473 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:07:46.473 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:07:46.473 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:07:46.473 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:07:46.473 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:07:46.473 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.21529 2024-09-16T03:07:46.473 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.21529/ceph-mon.a.asok 2024-09-16T03:07:46.474 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:07:46.474 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.21529/ceph-mon.a.asok config get mon_host 2024-09-16T03:07:46.574 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:29: TEST_mute: run_mgr td/health-mute x 2024-09-16T03:07:46.574 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/health-mute 2024-09-16T03:07:46.574 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2024-09-16T03:07:46.574 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2024-09-16T03:07:46.574 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2024-09-16T03:07:46.574 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/health-mute/x 2024-09-16T03:07:46.574 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2024-09-16T03:07:47.521 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2024-09-16T03:07:47.521 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:07:47.521 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:07:47.521 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:07:47.521 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:07:47.522 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.21529 2024-09-16T03:07:47.522 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.21529/$cluster-$name.asok' 2024-09-16T03:07:47.522 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T03:07:47.535 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/health-mute/x '--log-file=td/health-mute/$name.log' '--admin-socket=/tmp/ceph-asok.21529/$cluster-$name.asok' --run-dir=td/health-mute '--pid-file=td/health-mute/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T03:07:47.652 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:30: TEST_mute: run_osd td/health-mute 0 2024-09-16T03:07:47.652 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/health-mute 2024-09-16T03:07:47.653 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T03:07:47.653 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2024-09-16T03:07:47.653 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T03:07:47.653 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/health-mute/0 2024-09-16T03:07:47.653 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=13dae064-b3e7-46f2-8f68-a5d53a7e19dc --auth-supported=none --mon-pg-warn-min-per-osd 0 --mon-max-pg-per-osd 1000 --mon-host=127.0.0.1:7143 ' 2024-09-16T03:07:47.653 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T03:07:47.653 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T03:07:47.653 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T03:07:47.653 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/health-mute/0' 2024-09-16T03:07:47.653 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/health-mute/0/journal' 2024-09-16T03:07:47.653 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T03:07:47.653 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T03:07:47.654 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/health-mute' 2024-09-16T03:07:47.654 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T03:07:47.654 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:07:47.654 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:07:47.654 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:07:47.654 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:07:47.654 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.21529 2024-09-16T03:07:47.654 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.21529/$cluster-$name.asok' 2024-09-16T03:07:47.654 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.21529/$cluster-$name.asok' 2024-09-16T03:07:47.654 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T03:07:47.654 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T03:07:47.654 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T03:07:47.654 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/health-mute/$name.log' 2024-09-16T03:07:47.655 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/health-mute/$name.pid' 2024-09-16T03:07:47.655 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T03:07:47.655 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T03:07:47.655 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T03:07:47.655 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T03:07:47.655 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T03:07:47.655 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T03:07:47.655 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/health-mute/0 2024-09-16T03:07:47.655 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T03:07:47.656 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=3be9eab6-aa08-438b-b708-6ea2a9b4c7a3 2024-09-16T03:07:47.656 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 3be9eab6-aa08-438b-b708-6ea2a9b4c7a3' 2024-09-16T03:07:47.656 INFO:tasks.workunit.client.0.smithi096.stdout:add osd0 3be9eab6-aa08-438b-b708-6ea2a9b4c7a3 2024-09-16T03:07:47.656 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T03:07:47.674 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQADoedmLBcmKBAAP4COEIlVh2wOW9Ei511ftQ== 2024-09-16T03:07:47.674 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQADoedmLBcmKBAAP4COEIlVh2wOW9Ei511ftQ=="}' 2024-09-16T03:07:47.674 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 3be9eab6-aa08-438b-b708-6ea2a9b4c7a3 -i td/health-mute/0/new.json 2024-09-16T03:07:47.981 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T03:07:47.996 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/health-mute/0/new.json 2024-09-16T03:07:47.997 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=13dae064-b3e7-46f2-8f68-a5d53a7e19dc --auth-supported=none --mon-pg-warn-min-per-osd 0 --mon-max-pg-per-osd 1000 --mon-host=127.0.0.1:7143 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/health-mute/0 --osd-journal=td/health-mute/0/journal --chdir= --run-dir=td/health-mute '--admin-socket=/tmp/ceph-asok.21529/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/health-mute/$name.log' '--pid-file=td/health-mute/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQADoedmLBcmKBAAP4COEIlVh2wOW9Ei511ftQ== --osd-uuid 3be9eab6-aa08-438b-b708-6ea2a9b4c7a3 2024-09-16T03:07:48.111 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:07:48.108+0000 7f43a97a17c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:07:48.141 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:07:48.136+0000 7f43a97a17c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:07:48.143 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:07:48.140+0000 7f43a97a17c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:07:48.144 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:07:48.140+0000 7f43a97a17c0 -1 bdev(0x55727aa03c00 td/health-mute/0/block) open stat got: (1) Operation not permitted 2024-09-16T03:07:48.144 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:07:48.140+0000 7f43a97a17c0 -1 bluestore(td/health-mute/0) _read_fsid unparsable uuid 2024-09-16T03:07:54.212 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/health-mute/0/keyring 2024-09-16T03:07:54.213 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T03:07:54.213 INFO:tasks.workunit.client.0.smithi096.stdout:adding osd0 key to auth repository 2024-09-16T03:07:54.214 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2024-09-16T03:07:54.214 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/health-mute/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T03:07:54.463 INFO:tasks.workunit.client.0.smithi096.stdout:start osd.0 2024-09-16T03:07:54.464 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2024-09-16T03:07:54.464 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T03:07:54.464 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T03:07:54.464 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=13dae064-b3e7-46f2-8f68-a5d53a7e19dc --auth-supported=none --mon-pg-warn-min-per-osd 0 --mon-max-pg-per-osd 1000 --mon-host=127.0.0.1:7143 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/health-mute/0 --osd-journal=td/health-mute/0/journal --chdir= --run-dir=td/health-mute '--admin-socket=/tmp/ceph-asok.21529/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/health-mute/$name.log' '--pid-file=td/health-mute/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T03:07:54.464 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T03:07:54.496 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:07:54.492+0000 7fe0df6727c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:07:54.498 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:07:54.496+0000 7fe0df6727c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:07:54.499 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:07:54.496+0000 7fe0df6727c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:07:54.683 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2024-09-16T03:07:54.683 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:07:54.683 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2024-09-16T03:07:54.683 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:07:54.683 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:07:54.683 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:07:54.684 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:07:54.684 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T03:07:54.684 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:07:54.684 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:07:54.907 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:07:55.856 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:07:55.852+0000 7fe0df6727c0 -1 Falling back to public interface 2024-09-16T03:07:55.909 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:07:55.909 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:07:55.909 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T03:07:55.909 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T03:07:55.910 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:07:55.910 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:07:56.149 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:07:57.150 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:07:57.151 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:07:57.151 INFO:tasks.workunit.client.0.smithi096.stdout:2 2024-09-16T03:07:57.151 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T03:07:57.151 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:07:57.152 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:07:57.639 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:07:58.641 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:07:58.641 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:07:58.642 INFO:tasks.workunit.client.0.smithi096.stdout:3 2024-09-16T03:07:58.642 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T03:07:58.642 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:07:58.642 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:07:58.777 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:07:58.772+0000 7fe0df6727c0 -1 osd.0 0 log_to_monitors true 2024-09-16T03:07:59.084 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:08:00.086 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:08:00.086 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:08:00.086 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T03:08:00.086 INFO:tasks.workunit.client.0.smithi096.stdout:4 2024-09-16T03:08:00.087 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:08:00.087 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:08:00.629 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:08:01.631 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:08:01.631 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:08:01.631 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T03:08:01.631 INFO:tasks.workunit.client.0.smithi096.stdout:5 2024-09-16T03:08:01.632 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:08:01.632 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:08:02.069 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:08:03.071 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:08:03.071 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:08:03.071 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T03:08:03.071 INFO:tasks.workunit.client.0.smithi096.stdout:6 2024-09-16T03:08:03.072 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:08:03.072 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:08:03.544 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:08:04.546 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:08:04.546 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:08:04.547 INFO:tasks.workunit.client.0.smithi096.stdout:7 2024-09-16T03:08:04.547 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T03:08:04.547 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:08:04.547 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:08:04.975 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:08:05.977 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:08:05.977 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:08:05.977 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T03:08:05.978 INFO:tasks.workunit.client.0.smithi096.stdout:8 2024-09-16T03:08:05.978 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:08:05.978 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:08:06.413 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:08:07.415 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:08:07.415 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:08:07.415 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T03:08:07.415 INFO:tasks.workunit.client.0.smithi096.stdout:9 2024-09-16T03:08:07.416 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:08:07.416 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:08:07.868 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:08:08.870 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:08:08.871 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:08:08.871 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T03:08:08.871 INFO:tasks.workunit.client.0.smithi096.stdout:10 2024-09-16T03:08:08.871 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:08:08.872 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:08:09.343 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:08:10.345 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:08:10.345 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:08:10.345 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T03:08:10.346 INFO:tasks.workunit.client.0.smithi096.stdout:11 2024-09-16T03:08:10.346 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:08:10.346 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:08:11.027 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:08:12.028 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:08:12.029 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:08:12.029 INFO:tasks.workunit.client.0.smithi096.stdout:12 2024-09-16T03:08:12.029 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T03:08:12.029 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:08:12.030 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:08:12.595 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:08:13.601 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:08:13.601 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:08:13.601 INFO:tasks.workunit.client.0.smithi096.stdout:13 2024-09-16T03:08:13.602 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T03:08:13.602 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:08:13.602 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:08:14.067 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:08:15.069 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:08:15.069 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:08:15.070 INFO:tasks.workunit.client.0.smithi096.stdout:14 2024-09-16T03:08:15.070 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T03:08:15.070 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:08:15.070 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:08:15.567 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:08:16.568 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:08:16.569 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:08:16.569 INFO:tasks.workunit.client.0.smithi096.stdout:15 2024-09-16T03:08:16.569 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T03:08:16.569 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:08:16.570 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:08:17.602 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:08:18.604 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:08:18.604 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:08:18.605 INFO:tasks.workunit.client.0.smithi096.stdout:16 2024-09-16T03:08:18.605 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T03:08:18.605 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:08:18.605 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:08:19.264 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:08:20.265 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:08:20.266 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:08:20.266 INFO:tasks.workunit.client.0.smithi096.stdout:17 2024-09-16T03:08:20.266 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T03:08:20.267 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:08:20.267 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:08:22.008 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:08:23.010 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:08:23.011 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:08:23.011 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 18 2024-09-16T03:08:23.011 INFO:tasks.workunit.client.0.smithi096.stdout:18 2024-09-16T03:08:23.011 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:08:23.011 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:08:23.749 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:08:24.751 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:08:24.752 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:08:24.752 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 19 2024-09-16T03:08:24.752 INFO:tasks.workunit.client.0.smithi096.stdout:19 2024-09-16T03:08:24.752 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:08:24.753 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:08:25.177 INFO:tasks.workunit.client.0.smithi096.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/653931473,v1:127.0.0.1:6801/653931473] [v2:127.0.0.1:6802/653931473,v1:127.0.0.1:6803/653931473] exists,up 3be9eab6-aa08-438b-b708-6ea2a9b4c7a3 2024-09-16T03:08:25.181 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:08:25.181 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:08:25.181 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:08:25.181 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:31: TEST_mute: run_osd td/health-mute 1 2024-09-16T03:08:25.181 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/health-mute 2024-09-16T03:08:25.182 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T03:08:25.182 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2024-09-16T03:08:25.182 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T03:08:25.182 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/health-mute/1 2024-09-16T03:08:25.182 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=13dae064-b3e7-46f2-8f68-a5d53a7e19dc --auth-supported=none --mon-pg-warn-min-per-osd 0 --mon-max-pg-per-osd 1000 --mon-host=127.0.0.1:7143 ' 2024-09-16T03:08:25.182 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T03:08:25.182 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T03:08:25.182 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T03:08:25.182 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/health-mute/1' 2024-09-16T03:08:25.182 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/health-mute/1/journal' 2024-09-16T03:08:25.182 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T03:08:25.182 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T03:08:25.183 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/health-mute' 2024-09-16T03:08:25.183 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T03:08:25.183 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:08:25.183 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:08:25.183 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:08:25.183 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:08:25.183 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.21529 2024-09-16T03:08:25.183 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.21529/$cluster-$name.asok' 2024-09-16T03:08:25.183 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.21529/$cluster-$name.asok' 2024-09-16T03:08:25.183 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T03:08:25.183 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T03:08:25.183 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T03:08:25.183 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/health-mute/$name.log' 2024-09-16T03:08:25.184 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/health-mute/$name.pid' 2024-09-16T03:08:25.184 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T03:08:25.184 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T03:08:25.184 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T03:08:25.184 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T03:08:25.184 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T03:08:25.184 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T03:08:25.184 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/health-mute/1 2024-09-16T03:08:25.184 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T03:08:25.184 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=5ce67adb-3e26-44ad-99fa-13945eb5e369 2024-09-16T03:08:25.185 INFO:tasks.workunit.client.0.smithi096.stdout:add osd1 5ce67adb-3e26-44ad-99fa-13945eb5e369 2024-09-16T03:08:25.185 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 5ce67adb-3e26-44ad-99fa-13945eb5e369' 2024-09-16T03:08:25.185 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T03:08:25.204 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQApoedmrcAtDBAARGnfmwCYb0lM0Vai+FY1wg== 2024-09-16T03:08:25.204 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQApoedmrcAtDBAARGnfmwCYb0lM0Vai+FY1wg=="}' 2024-09-16T03:08:25.204 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 5ce67adb-3e26-44ad-99fa-13945eb5e369 -i td/health-mute/1/new.json 2024-09-16T03:08:25.673 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T03:08:25.689 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/health-mute/1/new.json 2024-09-16T03:08:25.689 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=13dae064-b3e7-46f2-8f68-a5d53a7e19dc --auth-supported=none --mon-pg-warn-min-per-osd 0 --mon-max-pg-per-osd 1000 --mon-host=127.0.0.1:7143 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/health-mute/1 --osd-journal=td/health-mute/1/journal --chdir= --run-dir=td/health-mute '--admin-socket=/tmp/ceph-asok.21529/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/health-mute/$name.log' '--pid-file=td/health-mute/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQApoedmrcAtDBAARGnfmwCYb0lM0Vai+FY1wg== --osd-uuid 5ce67adb-3e26-44ad-99fa-13945eb5e369 2024-09-16T03:08:25.724 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:08:25.720+0000 7fee383627c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:08:25.747 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:08:25.744+0000 7fee383627c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:08:25.748 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:08:25.744+0000 7fee383627c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:08:25.749 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:08:25.744+0000 7fee383627c0 -1 bdev(0x55b4241b5c00 td/health-mute/1/block) open stat got: (1) Operation not permitted 2024-09-16T03:08:25.749 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:08:25.748+0000 7fee383627c0 -1 bluestore(td/health-mute/1) _read_fsid unparsable uuid 2024-09-16T03:08:31.964 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/health-mute/1/keyring 2024-09-16T03:08:31.964 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T03:08:31.965 INFO:tasks.workunit.client.0.smithi096.stdout:adding osd1 key to auth repository 2024-09-16T03:08:31.965 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2024-09-16T03:08:31.966 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/health-mute/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T03:08:32.540 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2024-09-16T03:08:32.540 INFO:tasks.workunit.client.0.smithi096.stdout:start osd.1 2024-09-16T03:08:32.541 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=13dae064-b3e7-46f2-8f68-a5d53a7e19dc --auth-supported=none --mon-pg-warn-min-per-osd 0 --mon-max-pg-per-osd 1000 --mon-host=127.0.0.1:7143 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/health-mute/1 --osd-journal=td/health-mute/1/journal --chdir= --run-dir=td/health-mute '--admin-socket=/tmp/ceph-asok.21529/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/health-mute/$name.log' '--pid-file=td/health-mute/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T03:08:32.541 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T03:08:32.541 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T03:08:32.541 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T03:08:32.572 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:08:32.568+0000 7f1828f5a7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:08:32.574 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:08:32.572+0000 7f1828f5a7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:08:32.575 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:08:32.572+0000 7f1828f5a7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:08:32.980 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2024-09-16T03:08:32.980 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:08:32.980 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2024-09-16T03:08:32.980 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:08:32.981 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:08:32.981 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:08:32.981 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:08:32.981 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T03:08:32.981 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:08:32.981 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:08:33.485 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:08:33.844 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:08:33.839+0000 7f1828f5a7c0 -1 Falling back to public interface 2024-09-16T03:08:34.487 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:08:34.487 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:08:34.487 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T03:08:34.488 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T03:08:34.488 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:08:34.488 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:08:34.976 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:08:35.978 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:08:35.978 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:08:35.978 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T03:08:35.979 INFO:tasks.workunit.client.0.smithi096.stdout:2 2024-09-16T03:08:35.979 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:08:35.979 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:08:36.410 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:08:36.696 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:08:36.691+0000 7f1828f5a7c0 -1 osd.1 0 log_to_monitors true 2024-09-16T03:08:37.411 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:08:37.412 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:08:37.412 INFO:tasks.workunit.client.0.smithi096.stdout:3 2024-09-16T03:08:37.412 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T03:08:37.412 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:08:37.413 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:08:37.844 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:08:38.846 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:08:38.846 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:08:38.846 INFO:tasks.workunit.client.0.smithi096.stdout:4 2024-09-16T03:08:38.847 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T03:08:38.847 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:08:38.847 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:08:39.558 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:08:40.559 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:08:40.559 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:08:40.559 INFO:tasks.workunit.client.0.smithi096.stdout:5 2024-09-16T03:08:40.560 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T03:08:40.560 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:08:40.560 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:08:41.112 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:08:42.113 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:08:42.114 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:08:42.114 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T03:08:42.114 INFO:tasks.workunit.client.0.smithi096.stdout:6 2024-09-16T03:08:42.114 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:08:42.114 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:08:42.681 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:08:43.683 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:08:43.683 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:08:43.683 INFO:tasks.workunit.client.0.smithi096.stdout:7 2024-09-16T03:08:43.683 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T03:08:43.684 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:08:43.684 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:08:44.124 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:08:45.126 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:08:45.126 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:08:45.127 INFO:tasks.workunit.client.0.smithi096.stdout:8 2024-09-16T03:08:45.127 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T03:08:45.127 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:08:45.127 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:08:45.680 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:08:46.681 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:08:46.681 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:08:46.682 INFO:tasks.workunit.client.0.smithi096.stdout:9 2024-09-16T03:08:46.682 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T03:08:46.682 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:08:46.682 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:08:47.155 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:08:48.157 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:08:48.157 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:08:48.158 INFO:tasks.workunit.client.0.smithi096.stdout:10 2024-09-16T03:08:48.158 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T03:08:48.158 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:08:48.158 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:08:48.698 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:08:49.699 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:08:49.699 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:08:49.700 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T03:08:49.700 INFO:tasks.workunit.client.0.smithi096.stdout:11 2024-09-16T03:08:49.700 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:08:49.700 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:08:50.278 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:08:51.279 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:08:51.279 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:08:51.279 INFO:tasks.workunit.client.0.smithi096.stdout:12 2024-09-16T03:08:51.280 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T03:08:51.280 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:08:51.280 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:08:51.980 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:08:52.981 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:08:52.981 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:08:52.981 INFO:tasks.workunit.client.0.smithi096.stdout:13 2024-09-16T03:08:52.982 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T03:08:52.982 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:08:52.982 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:08:54.038 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:08:55.039 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:08:55.039 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:08:55.039 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T03:08:55.040 INFO:tasks.workunit.client.0.smithi096.stdout:14 2024-09-16T03:08:55.040 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:08:55.040 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:08:56.236 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:08:57.237 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:08:57.237 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:08:57.237 INFO:tasks.workunit.client.0.smithi096.stdout:15 2024-09-16T03:08:57.238 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T03:08:57.238 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:08:57.238 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:08:57.986 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:08:58.988 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:08:58.988 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:08:58.988 INFO:tasks.workunit.client.0.smithi096.stdout:16 2024-09-16T03:08:58.989 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T03:08:58.989 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:08:58.989 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:09:00.088 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:09:01.091 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:09:01.091 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:09:01.091 INFO:tasks.workunit.client.0.smithi096.stdout:17 2024-09-16T03:09:01.092 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T03:09:01.092 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:09:01.092 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:09:01.521 INFO:tasks.workunit.client.0.smithi096.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/3182490974,v1:127.0.0.1:6811/3182490974] [v2:127.0.0.1:6812/3182490974,v1:127.0.0.1:6813/3182490974] exists,up 5ce67adb-3e26-44ad-99fa-13945eb5e369 2024-09-16T03:09:01.524 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:09:01.524 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:09:01.525 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:09:01.525 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:32: TEST_mute: run_osd td/health-mute 2 2024-09-16T03:09:01.525 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/health-mute 2024-09-16T03:09:01.525 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T03:09:01.525 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2024-09-16T03:09:01.525 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T03:09:01.525 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/health-mute/2 2024-09-16T03:09:01.525 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=13dae064-b3e7-46f2-8f68-a5d53a7e19dc --auth-supported=none --mon-pg-warn-min-per-osd 0 --mon-max-pg-per-osd 1000 --mon-host=127.0.0.1:7143 ' 2024-09-16T03:09:01.525 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T03:09:01.525 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T03:09:01.525 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T03:09:01.525 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/health-mute/2' 2024-09-16T03:09:01.525 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/health-mute/2/journal' 2024-09-16T03:09:01.526 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T03:09:01.526 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T03:09:01.526 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/health-mute' 2024-09-16T03:09:01.526 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T03:09:01.526 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:09:01.526 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:09:01.526 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:09:01.526 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:09:01.526 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.21529 2024-09-16T03:09:01.526 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.21529/$cluster-$name.asok' 2024-09-16T03:09:01.526 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.21529/$cluster-$name.asok' 2024-09-16T03:09:01.527 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T03:09:01.527 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T03:09:01.527 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T03:09:01.527 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/health-mute/$name.log' 2024-09-16T03:09:01.527 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/health-mute/$name.pid' 2024-09-16T03:09:01.527 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T03:09:01.527 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T03:09:01.527 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T03:09:01.527 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T03:09:01.527 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T03:09:01.527 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T03:09:01.527 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/health-mute/2 2024-09-16T03:09:01.528 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T03:09:01.528 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=ab026847-faeb-4298-931c-c9995872a1ab 2024-09-16T03:09:01.528 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 ab026847-faeb-4298-931c-c9995872a1ab' 2024-09-16T03:09:01.528 INFO:tasks.workunit.client.0.smithi096.stdout:add osd2 ab026847-faeb-4298-931c-c9995872a1ab 2024-09-16T03:09:01.529 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T03:09:01.544 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBNoedmDXtfIBAAs2qlzHrO3wCAOrTDXScvDQ== 2024-09-16T03:09:01.545 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBNoedmDXtfIBAAs2qlzHrO3wCAOrTDXScvDQ=="}' 2024-09-16T03:09:01.545 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new ab026847-faeb-4298-931c-c9995872a1ab -i td/health-mute/2/new.json 2024-09-16T03:09:02.189 INFO:tasks.workunit.client.0.smithi096.stdout:2 2024-09-16T03:09:02.206 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/health-mute/2/new.json 2024-09-16T03:09:02.207 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=13dae064-b3e7-46f2-8f68-a5d53a7e19dc --auth-supported=none --mon-pg-warn-min-per-osd 0 --mon-max-pg-per-osd 1000 --mon-host=127.0.0.1:7143 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/health-mute/2 --osd-journal=td/health-mute/2/journal --chdir= --run-dir=td/health-mute '--admin-socket=/tmp/ceph-asok.21529/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/health-mute/$name.log' '--pid-file=td/health-mute/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBNoedmDXtfIBAAs2qlzHrO3wCAOrTDXScvDQ== --osd-uuid ab026847-faeb-4298-931c-c9995872a1ab 2024-09-16T03:09:02.238 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:09:02.234+0000 7f9ed3b907c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:09:02.280 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:09:02.278+0000 7f9ed3b907c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:09:02.282 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:09:02.282+0000 7f9ed3b907c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:09:02.283 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:09:02.282+0000 7f9ed3b907c0 -1 bdev(0x5618866a5c00 td/health-mute/2/block) open stat got: (1) Operation not permitted 2024-09-16T03:09:02.283 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:09:02.282+0000 7f9ed3b907c0 -1 bluestore(td/health-mute/2) _read_fsid unparsable uuid 2024-09-16T03:09:08.635 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/health-mute/2/keyring 2024-09-16T03:09:08.636 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T03:09:08.637 INFO:tasks.workunit.client.0.smithi096.stdout:adding osd2 key to auth repository 2024-09-16T03:09:08.638 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2024-09-16T03:09:08.638 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/health-mute/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T03:09:09.252 INFO:tasks.workunit.client.0.smithi096.stdout:start osd.2 2024-09-16T03:09:09.253 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2024-09-16T03:09:09.253 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T03:09:09.253 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T03:09:09.253 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T03:09:09.253 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=13dae064-b3e7-46f2-8f68-a5d53a7e19dc --auth-supported=none --mon-pg-warn-min-per-osd 0 --mon-max-pg-per-osd 1000 --mon-host=127.0.0.1:7143 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/health-mute/2 --osd-journal=td/health-mute/2/journal --chdir= --run-dir=td/health-mute '--admin-socket=/tmp/ceph-asok.21529/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/health-mute/$name.log' '--pid-file=td/health-mute/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T03:09:09.289 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:09:09.286+0000 7fedd78b87c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:09:09.301 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:09:09.298+0000 7fedd78b87c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:09:09.303 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:09:09.302+0000 7fedd78b87c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:09:09.688 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2024-09-16T03:09:09.688 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:09:09.688 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2024-09-16T03:09:09.688 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:09:09.689 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:09:09.689 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:09:09.689 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:09:09.689 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T03:09:09.689 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:09:09.689 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:09:10.127 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:09:10.573 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:09:10.570+0000 7fedd78b87c0 -1 Falling back to public interface 2024-09-16T03:09:11.128 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:09:11.128 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:09:11.129 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T03:09:11.129 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T03:09:11.129 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:09:11.129 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:09:11.544 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:09:12.546 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:09:12.546 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:09:12.546 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T03:09:12.546 INFO:tasks.workunit.client.0.smithi096.stdout:2 2024-09-16T03:09:12.547 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:09:12.547 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:09:13.087 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:09:13.469 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:09:13.466+0000 7fedd78b87c0 -1 osd.2 0 log_to_monitors true 2024-09-16T03:09:14.088 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:09:14.088 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:09:14.089 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T03:09:14.089 INFO:tasks.workunit.client.0.smithi096.stdout:3 2024-09-16T03:09:14.089 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:09:14.089 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:09:14.701 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:09:15.703 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:09:15.703 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:09:15.703 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T03:09:15.703 INFO:tasks.workunit.client.0.smithi096.stdout:4 2024-09-16T03:09:15.704 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:09:15.704 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:09:16.193 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:09:17.194 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:09:17.194 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:09:17.195 INFO:tasks.workunit.client.0.smithi096.stdout:5 2024-09-16T03:09:17.195 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T03:09:17.195 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:09:17.195 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:09:17.646 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:09:18.648 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:09:18.648 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:09:18.648 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T03:09:18.648 INFO:tasks.workunit.client.0.smithi096.stdout:6 2024-09-16T03:09:18.649 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:09:18.649 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:09:19.173 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:09:20.174 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:09:20.174 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:09:20.175 INFO:tasks.workunit.client.0.smithi096.stdout:7 2024-09-16T03:09:20.175 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T03:09:20.175 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:09:20.175 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:09:20.764 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:09:21.766 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:09:21.766 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:09:21.766 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T03:09:21.766 INFO:tasks.workunit.client.0.smithi096.stdout:8 2024-09-16T03:09:21.767 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:09:21.767 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:09:22.207 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:09:23.208 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:09:23.208 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:09:23.208 INFO:tasks.workunit.client.0.smithi096.stdout:9 2024-09-16T03:09:23.209 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T03:09:23.209 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:09:23.209 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:09:23.748 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:09:24.749 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:09:24.750 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:09:24.750 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T03:09:24.750 INFO:tasks.workunit.client.0.smithi096.stdout:10 2024-09-16T03:09:24.750 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:09:24.750 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:09:25.232 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:09:26.233 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:09:26.234 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:09:26.234 INFO:tasks.workunit.client.0.smithi096.stdout:11 2024-09-16T03:09:26.234 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T03:09:26.234 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:09:26.235 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:09:26.981 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:09:27.983 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:09:27.984 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:09:27.984 INFO:tasks.workunit.client.0.smithi096.stdout:12 2024-09-16T03:09:27.984 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T03:09:27.984 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:09:27.985 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:09:28.501 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:09:29.502 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:09:29.502 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:09:29.502 INFO:tasks.workunit.client.0.smithi096.stdout:13 2024-09-16T03:09:29.503 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T03:09:29.503 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:09:29.503 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:09:30.322 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:09:31.323 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:09:31.323 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:09:31.323 INFO:tasks.workunit.client.0.smithi096.stdout:14 2024-09-16T03:09:31.324 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T03:09:31.324 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:09:31.324 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:09:32.089 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:09:33.091 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:09:33.091 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:09:33.091 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T03:09:33.091 INFO:tasks.workunit.client.0.smithi096.stdout:15 2024-09-16T03:09:33.092 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:09:33.092 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:09:33.902 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:09:34.904 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:09:34.904 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:09:34.904 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T03:09:34.904 INFO:tasks.workunit.client.0.smithi096.stdout:16 2024-09-16T03:09:34.905 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:09:34.905 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:09:35.487 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:09:36.489 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:09:36.489 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:09:36.489 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T03:09:36.490 INFO:tasks.workunit.client.0.smithi096.stdout:17 2024-09-16T03:09:36.490 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:09:36.490 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:09:37.513 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:09:38.515 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:09:38.515 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:09:38.515 INFO:tasks.workunit.client.0.smithi096.stdout:18 2024-09-16T03:09:38.516 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 18 2024-09-16T03:09:38.516 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:09:38.516 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:09:39.088 INFO:tasks.workunit.client.0.smithi096.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/1013827735,v1:127.0.0.1:6819/1013827735] [v2:127.0.0.1:6820/1013827735,v1:127.0.0.1:6821/1013827735] exists,up ab026847-faeb-4298-931c-c9995872a1ab 2024-09-16T03:09:39.089 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:09:39.089 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:09:39.089 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:09:39.089 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:34: TEST_mute: ceph osd pool create foo 8 2024-09-16T03:09:39.627 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'foo' already exists 2024-09-16T03:09:39.642 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:35: TEST_mute: ceph osd pool application enable foo rbd --yes-i-really-mean-it 2024-09-16T03:09:41.546 INFO:tasks.workunit.client.0.smithi096.stderr:enabled application 'rbd' on pool 'foo' 2024-09-16T03:09:41.566 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:36: TEST_mute: wait_for_clean 2024-09-16T03:09:41.566 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1633: wait_for_clean: local cmd= 2024-09-16T03:09:41.566 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1634: wait_for_clean: local num_active_clean=-1 2024-09-16T03:09:41.566 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1635: wait_for_clean: local cur_active_clean 2024-09-16T03:09:41.567 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: get_timeout_delays 90 .1 2024-09-16T03:09:41.567 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: shopt -q -o xtrace 2024-09-16T03:09:41.567 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: echo true 2024-09-16T03:09:41.568 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: local trace=true 2024-09-16T03:09:41.568 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: true 2024-09-16T03:09:41.568 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: shopt -u -o xtrace 2024-09-16T03:09:41.677 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-09-16T03:09:41.677 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: local -a delays 2024-09-16T03:09:41.677 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1637: wait_for_clean: local -i loop=0 2024-09-16T03:09:41.677 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1639: wait_for_clean: flush_pg_stats 2024-09-16T03:09:41.677 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: local timeout=300 2024-09-16T03:09:41.678 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ceph osd ls 2024-09-16T03:09:42.191 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ids='0 2024-09-16T03:09:42.191 INFO:tasks.workunit.client.0.smithi096.stderr:1 2024-09-16T03:09:42.191 INFO:tasks.workunit.client.0.smithi096.stderr:2' 2024-09-16T03:09:42.191 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2208: flush_pg_stats: seqs= 2024-09-16T03:09:42.191 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:09:42.192 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-09-16T03:09:42.340 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=21474836499 2024-09-16T03:09:42.341 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 21474836499 2024-09-16T03:09:42.341 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836499' 2024-09-16T03:09:42.341 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:09:42.341 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-09-16T03:09:42.489 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=42949672975 2024-09-16T03:09:42.489 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 42949672975 2024-09-16T03:09:42.489 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836499 1-42949672975' 2024-09-16T03:09:42.490 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:09:42.490 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-09-16T03:09:42.634 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=64424509445 2024-09-16T03:09:42.634 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 64424509445 2024-09-16T03:09:42.634 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836499 1-42949672975 2-64424509445' 2024-09-16T03:09:42.635 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:09:42.635 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 0-21474836499 2024-09-16T03:09:42.635 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:09:42.636 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=0 2024-09-16T03:09:42.637 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:09:42.637 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 0-21474836499 2024-09-16T03:09:42.637 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=21474836499 2024-09-16T03:09:42.638 INFO:tasks.workunit.client.0.smithi096.stdout:waiting osd.0 seq 21474836499 2024-09-16T03:09:42.638 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.0 seq 21474836499' 2024-09-16T03:09:42.638 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T03:09:43.075 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836497 -lt 21474836499 2024-09-16T03:09:43.075 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: flush_pg_stats: sleep 1 2024-09-16T03:09:44.076 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2224: flush_pg_stats: '[' 300 -eq 0 ']' 2024-09-16T03:09:44.077 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T03:09:44.508 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836499 -lt 21474836499 2024-09-16T03:09:44.508 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:09:44.509 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 1-42949672975 2024-09-16T03:09:44.509 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:09:44.511 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=1 2024-09-16T03:09:44.512 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 1-42949672975 2024-09-16T03:09:44.512 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:09:44.513 INFO:tasks.workunit.client.0.smithi096.stdout:waiting osd.1 seq 42949672975 2024-09-16T03:09:44.514 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=42949672975 2024-09-16T03:09:44.514 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.1 seq 42949672975' 2024-09-16T03:09:44.514 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 1 2024-09-16T03:09:44.958 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 42949672975 -lt 42949672975 2024-09-16T03:09:44.958 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:09:44.959 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 2-64424509445 2024-09-16T03:09:44.959 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:09:44.960 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=2 2024-09-16T03:09:44.961 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:09:44.961 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 2-64424509445 2024-09-16T03:09:44.962 INFO:tasks.workunit.client.0.smithi096.stdout:waiting osd.2 seq 64424509445 2024-09-16T03:09:44.962 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=64424509445 2024-09-16T03:09:44.962 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.2 seq 64424509445' 2024-09-16T03:09:44.963 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 2 2024-09-16T03:09:45.404 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 64424509446 -lt 64424509445 2024-09-16T03:09:45.404 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: get_num_pgs 2024-09-16T03:09:45.404 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:09:45.405 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:09:45.947 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: test 8 == 0 2024-09-16T03:09:45.947 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:09:45.947 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:09:45.947 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:09:45.947 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:09:45.947 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:09:45.948 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:09:45.948 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:09:46.355 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=8 2024-09-16T03:09:46.356 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:09:46.357 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:09:46.357 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:09:46.937 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 8 = 8 2024-09-16T03:09:46.937 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: break 2024-09-16T03:09:46.938 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: return 0 2024-09-16T03:09:46.938 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:38: TEST_mute: ceph -s 2024-09-16T03:09:47.494 INFO:tasks.workunit.client.0.smithi096.stdout: cluster: 2024-09-16T03:09:47.494 INFO:tasks.workunit.client.0.smithi096.stdout: id: 13dae064-b3e7-46f2-8f68-a5d53a7e19dc 2024-09-16T03:09:47.494 INFO:tasks.workunit.client.0.smithi096.stdout: health: HEALTH_OK 2024-09-16T03:09:47.495 INFO:tasks.workunit.client.0.smithi096.stdout: 2024-09-16T03:09:47.495 INFO:tasks.workunit.client.0.smithi096.stdout: services: 2024-09-16T03:09:47.495 INFO:tasks.workunit.client.0.smithi096.stdout: mon: 1 daemons, quorum a (age 2m) 2024-09-16T03:09:47.495 INFO:tasks.workunit.client.0.smithi096.stdout: mgr: x(active, since 111s) 2024-09-16T03:09:47.495 INFO:tasks.workunit.client.0.smithi096.stdout: osd: 3 osds: 3 up (since 9s), 3 in (since 45s) 2024-09-16T03:09:47.495 INFO:tasks.workunit.client.0.smithi096.stdout: 2024-09-16T03:09:47.495 INFO:tasks.workunit.client.0.smithi096.stdout: data: 2024-09-16T03:09:47.495 INFO:tasks.workunit.client.0.smithi096.stdout: pools: 1 pools, 8 pgs 2024-09-16T03:09:47.495 INFO:tasks.workunit.client.0.smithi096.stdout: objects: 0 objects, 0 B 2024-09-16T03:09:47.495 INFO:tasks.workunit.client.0.smithi096.stdout: usage: 79 MiB used, 300 GiB / 300 GiB avail 2024-09-16T03:09:47.495 INFO:tasks.workunit.client.0.smithi096.stdout: pgs: 8 active+clean 2024-09-16T03:09:47.495 INFO:tasks.workunit.client.0.smithi096.stdout: 2024-09-16T03:09:47.510 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:39: TEST_mute: ceph health 2024-09-16T03:09:47.510 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:39: TEST_mute: grep HEALTH_OK 2024-09-16T03:09:48.011 INFO:tasks.workunit.client.0.smithi096.stdout:HEALTH_OK 2024-09-16T03:09:48.011 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:41: TEST_mute: ceph osd pool set foo size 1 --yes-i-really-mean-it 2024-09-16T03:09:48.914 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 1 size to 1 2024-09-16T03:09:48.936 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:42: TEST_mute: ceph -s 2024-09-16T03:09:49.477 INFO:tasks.workunit.client.0.smithi096.stdout: cluster: 2024-09-16T03:09:49.477 INFO:tasks.workunit.client.0.smithi096.stdout: id: 13dae064-b3e7-46f2-8f68-a5d53a7e19dc 2024-09-16T03:09:49.477 INFO:tasks.workunit.client.0.smithi096.stdout: health: HEALTH_WARN 2024-09-16T03:09:49.477 INFO:tasks.workunit.client.0.smithi096.stdout: 1 pool(s) have no replicas configured 2024-09-16T03:09:49.477 INFO:tasks.workunit.client.0.smithi096.stdout: 2024-09-16T03:09:49.478 INFO:tasks.workunit.client.0.smithi096.stdout: services: 2024-09-16T03:09:49.478 INFO:tasks.workunit.client.0.smithi096.stdout: mon: 1 daemons, quorum a (age 2m) 2024-09-16T03:09:49.478 INFO:tasks.workunit.client.0.smithi096.stdout: mgr: x(active, since 113s) 2024-09-16T03:09:49.478 INFO:tasks.workunit.client.0.smithi096.stdout: osd: 3 osds: 3 up (since 11s), 3 in (since 47s) 2024-09-16T03:09:49.478 INFO:tasks.workunit.client.0.smithi096.stdout: 2024-09-16T03:09:49.478 INFO:tasks.workunit.client.0.smithi096.stdout: data: 2024-09-16T03:09:49.478 INFO:tasks.workunit.client.0.smithi096.stdout: pools: 1 pools, 8 pgs 2024-09-16T03:09:49.478 INFO:tasks.workunit.client.0.smithi096.stdout: objects: 0 objects, 0 B 2024-09-16T03:09:49.478 INFO:tasks.workunit.client.0.smithi096.stdout: usage: 79 MiB used, 300 GiB / 300 GiB avail 2024-09-16T03:09:49.478 INFO:tasks.workunit.client.0.smithi096.stdout: pgs: 8 active+clean 2024-09-16T03:09:49.478 INFO:tasks.workunit.client.0.smithi096.stdout: 2024-09-16T03:09:49.493 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:43: TEST_mute: ceph health 2024-09-16T03:09:49.494 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:43: TEST_mute: grep HEALTH_WARN 2024-09-16T03:09:50.176 INFO:tasks.workunit.client.0.smithi096.stdout:HEALTH_WARN 1 pool(s) have no replicas configured 2024-09-16T03:09:50.177 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:44: TEST_mute: ceph health detail 2024-09-16T03:09:50.177 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:44: TEST_mute: grep POOL_NO_REDUNDANCY 2024-09-16T03:09:50.778 INFO:tasks.workunit.client.0.smithi096.stdout:[WRN] POOL_NO_REDUNDANCY: 1 pool(s) have no replicas configured 2024-09-16T03:09:50.778 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:45: TEST_mute: ceph health mute POOL_NO_REDUNDANCY 2024-09-16T03:09:51.525 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:46: TEST_mute: ceph -s 2024-09-16T03:09:52.045 INFO:tasks.workunit.client.0.smithi096.stdout: cluster: 2024-09-16T03:09:52.045 INFO:tasks.workunit.client.0.smithi096.stdout: id: 13dae064-b3e7-46f2-8f68-a5d53a7e19dc 2024-09-16T03:09:52.045 INFO:tasks.workunit.client.0.smithi096.stdout: health: HEALTH_OK 2024-09-16T03:09:52.045 INFO:tasks.workunit.client.0.smithi096.stdout: (muted: POOL_NO_REDUNDANCY) 2024-09-16T03:09:52.045 INFO:tasks.workunit.client.0.smithi096.stdout: 2024-09-16T03:09:52.045 INFO:tasks.workunit.client.0.smithi096.stdout: services: 2024-09-16T03:09:52.045 INFO:tasks.workunit.client.0.smithi096.stdout: mon: 1 daemons, quorum a (age 2m) 2024-09-16T03:09:52.046 INFO:tasks.workunit.client.0.smithi096.stdout: mgr: x(active, since 116s) 2024-09-16T03:09:52.046 INFO:tasks.workunit.client.0.smithi096.stdout: osd: 3 osds: 3 up (since 14s), 3 in (since 50s) 2024-09-16T03:09:52.046 INFO:tasks.workunit.client.0.smithi096.stdout: 2024-09-16T03:09:52.046 INFO:tasks.workunit.client.0.smithi096.stdout: data: 2024-09-16T03:09:52.046 INFO:tasks.workunit.client.0.smithi096.stdout: pools: 1 pools, 8 pgs 2024-09-16T03:09:52.046 INFO:tasks.workunit.client.0.smithi096.stdout: objects: 0 objects, 0 B 2024-09-16T03:09:52.046 INFO:tasks.workunit.client.0.smithi096.stdout: usage: 79 MiB used, 300 GiB / 300 GiB avail 2024-09-16T03:09:52.046 INFO:tasks.workunit.client.0.smithi096.stdout: pgs: 8 active+clean 2024-09-16T03:09:52.046 INFO:tasks.workunit.client.0.smithi096.stdout: 2024-09-16T03:09:52.061 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:47: TEST_mute: ceph health 2024-09-16T03:09:52.072 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:47: TEST_mute: grep HEALTH_OK 2024-09-16T03:09:52.072 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:47: TEST_mute: grep POOL_NO_REDUNDANCY 2024-09-16T03:09:52.624 INFO:tasks.workunit.client.0.smithi096.stdout:HEALTH_OK (muted: POOL_NO_REDUNDANCY) 2024-09-16T03:09:52.624 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:48: TEST_mute: ceph health unmute POOL_NO_REDUNDANCY 2024-09-16T03:09:53.468 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:49: TEST_mute: ceph -s 2024-09-16T03:09:54.009 INFO:tasks.workunit.client.0.smithi096.stdout: cluster: 2024-09-16T03:09:54.009 INFO:tasks.workunit.client.0.smithi096.stdout: id: 13dae064-b3e7-46f2-8f68-a5d53a7e19dc 2024-09-16T03:09:54.009 INFO:tasks.workunit.client.0.smithi096.stdout: health: HEALTH_WARN 2024-09-16T03:09:54.009 INFO:tasks.workunit.client.0.smithi096.stdout: 1 pool(s) have no replicas configured 2024-09-16T03:09:54.009 INFO:tasks.workunit.client.0.smithi096.stdout: 2024-09-16T03:09:54.010 INFO:tasks.workunit.client.0.smithi096.stdout: services: 2024-09-16T03:09:54.010 INFO:tasks.workunit.client.0.smithi096.stdout: mon: 1 daemons, quorum a (age 2m) 2024-09-16T03:09:54.010 INFO:tasks.workunit.client.0.smithi096.stdout: mgr: x(active, since 117s) 2024-09-16T03:09:54.010 INFO:tasks.workunit.client.0.smithi096.stdout: osd: 3 osds: 3 up (since 16s), 3 in (since 52s) 2024-09-16T03:09:54.010 INFO:tasks.workunit.client.0.smithi096.stdout: 2024-09-16T03:09:54.010 INFO:tasks.workunit.client.0.smithi096.stdout: data: 2024-09-16T03:09:54.010 INFO:tasks.workunit.client.0.smithi096.stdout: pools: 1 pools, 8 pgs 2024-09-16T03:09:54.010 INFO:tasks.workunit.client.0.smithi096.stdout: objects: 0 objects, 0 B 2024-09-16T03:09:54.010 INFO:tasks.workunit.client.0.smithi096.stdout: usage: 79 MiB used, 300 GiB / 300 GiB avail 2024-09-16T03:09:54.010 INFO:tasks.workunit.client.0.smithi096.stdout: pgs: 8 active+clean 2024-09-16T03:09:54.010 INFO:tasks.workunit.client.0.smithi096.stdout: 2024-09-16T03:09:54.025 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:50: TEST_mute: ceph health 2024-09-16T03:09:54.026 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:50: TEST_mute: grep HEALTH_WARN 2024-09-16T03:09:54.544 INFO:tasks.workunit.client.0.smithi096.stdout:HEALTH_WARN 1 pool(s) have no replicas configured 2024-09-16T03:09:54.544 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:52: TEST_mute: ceph osd pool set foo size 3 2024-09-16T03:09:55.471 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 1 size to 3 2024-09-16T03:09:55.493 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:53: TEST_mute: ceph -s 2024-09-16T03:09:56.130 INFO:tasks.workunit.client.0.smithi096.stdout: cluster: 2024-09-16T03:09:56.130 INFO:tasks.workunit.client.0.smithi096.stdout: id: 13dae064-b3e7-46f2-8f68-a5d53a7e19dc 2024-09-16T03:09:56.130 INFO:tasks.workunit.client.0.smithi096.stdout: health: HEALTH_OK 2024-09-16T03:09:56.130 INFO:tasks.workunit.client.0.smithi096.stdout: 2024-09-16T03:09:56.130 INFO:tasks.workunit.client.0.smithi096.stdout: services: 2024-09-16T03:09:56.130 INFO:tasks.workunit.client.0.smithi096.stdout: mon: 1 daemons, quorum a (age 2m) 2024-09-16T03:09:56.130 INFO:tasks.workunit.client.0.smithi096.stdout: mgr: x(active, since 2m) 2024-09-16T03:09:56.131 INFO:tasks.workunit.client.0.smithi096.stdout: osd: 3 osds: 3 up (since 18s), 3 in (since 54s) 2024-09-16T03:09:56.131 INFO:tasks.workunit.client.0.smithi096.stdout: 2024-09-16T03:09:56.131 INFO:tasks.workunit.client.0.smithi096.stdout: data: 2024-09-16T03:09:56.131 INFO:tasks.workunit.client.0.smithi096.stdout: pools: 1 pools, 8 pgs 2024-09-16T03:09:56.131 INFO:tasks.workunit.client.0.smithi096.stdout: objects: 0 objects, 0 B 2024-09-16T03:09:56.131 INFO:tasks.workunit.client.0.smithi096.stdout: usage: 79 MiB used, 300 GiB / 300 GiB avail 2024-09-16T03:09:56.131 INFO:tasks.workunit.client.0.smithi096.stdout: pgs: 8 active+clean 2024-09-16T03:09:56.131 INFO:tasks.workunit.client.0.smithi096.stdout: 2024-09-16T03:09:56.148 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:54: TEST_mute: ceph health 2024-09-16T03:09:56.148 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:54: TEST_mute: grep HEALTH_OK 2024-09-16T03:09:56.654 INFO:tasks.workunit.client.0.smithi096.stdout:HEALTH_OK 2024-09-16T03:09:56.654 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:55: TEST_mute: ceph osd set noup 2024-09-16T03:09:57.324 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:09:57.342 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:56: TEST_mute: ceph -s 2024-09-16T03:09:57.921 INFO:tasks.workunit.client.0.smithi096.stdout: cluster: 2024-09-16T03:09:57.922 INFO:tasks.workunit.client.0.smithi096.stdout: id: 13dae064-b3e7-46f2-8f68-a5d53a7e19dc 2024-09-16T03:09:57.922 INFO:tasks.workunit.client.0.smithi096.stdout: health: HEALTH_WARN 2024-09-16T03:09:57.922 INFO:tasks.workunit.client.0.smithi096.stdout: noup flag(s) set 2024-09-16T03:09:57.922 INFO:tasks.workunit.client.0.smithi096.stdout: 2024-09-16T03:09:57.922 INFO:tasks.workunit.client.0.smithi096.stdout: services: 2024-09-16T03:09:57.922 INFO:tasks.workunit.client.0.smithi096.stdout: mon: 1 daemons, quorum a (age 2m) 2024-09-16T03:09:57.922 INFO:tasks.workunit.client.0.smithi096.stdout: mgr: x(active, since 2m) 2024-09-16T03:09:57.922 INFO:tasks.workunit.client.0.smithi096.stdout: osd: 3 osds: 3 up (since 20s), 3 in (since 55s) 2024-09-16T03:09:57.922 INFO:tasks.workunit.client.0.smithi096.stdout: flags noup 2024-09-16T03:09:57.922 INFO:tasks.workunit.client.0.smithi096.stdout: 2024-09-16T03:09:57.922 INFO:tasks.workunit.client.0.smithi096.stdout: data: 2024-09-16T03:09:57.922 INFO:tasks.workunit.client.0.smithi096.stdout: pools: 1 pools, 8 pgs 2024-09-16T03:09:57.923 INFO:tasks.workunit.client.0.smithi096.stdout: objects: 0 objects, 0 B 2024-09-16T03:09:57.923 INFO:tasks.workunit.client.0.smithi096.stdout: usage: 79 MiB used, 300 GiB / 300 GiB avail 2024-09-16T03:09:57.923 INFO:tasks.workunit.client.0.smithi096.stdout: pgs: 12.500% pgs not active 2024-09-16T03:09:57.923 INFO:tasks.workunit.client.0.smithi096.stdout: 7 active+clean 2024-09-16T03:09:57.923 INFO:tasks.workunit.client.0.smithi096.stdout: 1 peering 2024-09-16T03:09:57.923 INFO:tasks.workunit.client.0.smithi096.stdout: 2024-09-16T03:09:57.938 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:57: TEST_mute: ceph health detail 2024-09-16T03:09:57.938 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:57: TEST_mute: grep OSDMAP_FLAGS 2024-09-16T03:09:58.487 INFO:tasks.workunit.client.0.smithi096.stdout:[WRN] OSDMAP_FLAGS: noup flag(s) set 2024-09-16T03:09:58.487 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:58: TEST_mute: ceph osd down 0 2024-09-16T03:09:59.098 INFO:tasks.workunit.client.0.smithi096.stderr:osd.0 is already down. 2024-09-16T03:09:59.113 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:59: TEST_mute: ceph -s 2024-09-16T03:09:59.852 INFO:tasks.workunit.client.0.smithi096.stdout: cluster: 2024-09-16T03:09:59.852 INFO:tasks.workunit.client.0.smithi096.stdout: id: 13dae064-b3e7-46f2-8f68-a5d53a7e19dc 2024-09-16T03:09:59.852 INFO:tasks.workunit.client.0.smithi096.stdout: health: HEALTH_WARN 2024-09-16T03:09:59.852 INFO:tasks.workunit.client.0.smithi096.stdout: noup flag(s) set 2024-09-16T03:09:59.852 INFO:tasks.workunit.client.0.smithi096.stdout: 1 osds down 2024-09-16T03:09:59.852 INFO:tasks.workunit.client.0.smithi096.stdout: 2024-09-16T03:09:59.852 INFO:tasks.workunit.client.0.smithi096.stdout: services: 2024-09-16T03:09:59.852 INFO:tasks.workunit.client.0.smithi096.stdout: mon: 1 daemons, quorum a (age 2m) 2024-09-16T03:09:59.852 INFO:tasks.workunit.client.0.smithi096.stdout: mgr: x(active, since 2m) 2024-09-16T03:09:59.852 INFO:tasks.workunit.client.0.smithi096.stdout: osd: 3 osds: 2 up (since 0.989536s), 3 in (since 57s) 2024-09-16T03:09:59.853 INFO:tasks.workunit.client.0.smithi096.stdout: flags noup 2024-09-16T03:09:59.853 INFO:tasks.workunit.client.0.smithi096.stdout: 2024-09-16T03:09:59.853 INFO:tasks.workunit.client.0.smithi096.stdout: data: 2024-09-16T03:09:59.853 INFO:tasks.workunit.client.0.smithi096.stdout: pools: 1 pools, 8 pgs 2024-09-16T03:09:59.853 INFO:tasks.workunit.client.0.smithi096.stdout: objects: 0 objects, 0 B 2024-09-16T03:09:59.853 INFO:tasks.workunit.client.0.smithi096.stdout: usage: 79 MiB used, 300 GiB / 300 GiB avail 2024-09-16T03:09:59.853 INFO:tasks.workunit.client.0.smithi096.stdout: pgs: 75.000% pgs not active 2024-09-16T03:09:59.853 INFO:tasks.workunit.client.0.smithi096.stdout: 5 activating 2024-09-16T03:09:59.853 INFO:tasks.workunit.client.0.smithi096.stdout: 2 active+clean 2024-09-16T03:09:59.853 INFO:tasks.workunit.client.0.smithi096.stdout: 1 peering 2024-09-16T03:09:59.853 INFO:tasks.workunit.client.0.smithi096.stdout: 2024-09-16T03:09:59.868 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:60: TEST_mute: ceph health detail 2024-09-16T03:09:59.868 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:60: TEST_mute: grep OSD_DOWN 2024-09-16T03:10:00.515 INFO:tasks.workunit.client.0.smithi096.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-16T03:10:00.515 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:61: TEST_mute: ceph health detail 2024-09-16T03:10:00.515 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:61: TEST_mute: grep HEALTH_WARN 2024-09-16T03:10:01.194 INFO:tasks.workunit.client.0.smithi096.stdout:HEALTH_WARN noup flag(s) set; 1 osds down 2024-09-16T03:10:01.194 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:63: TEST_mute: ceph health mute OSD_DOWN 2024-09-16T03:10:01.998 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:64: TEST_mute: ceph health mute OSDMAP_FLAGS 2024-09-16T03:10:02.815 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:65: TEST_mute: ceph -s 2024-09-16T03:10:03.360 INFO:tasks.workunit.client.0.smithi096.stdout: cluster: 2024-09-16T03:10:03.360 INFO:tasks.workunit.client.0.smithi096.stdout: id: 13dae064-b3e7-46f2-8f68-a5d53a7e19dc 2024-09-16T03:10:03.360 INFO:tasks.workunit.client.0.smithi096.stdout: health: HEALTH_OK 2024-09-16T03:10:03.360 INFO:tasks.workunit.client.0.smithi096.stdout: (muted: OSDMAP_FLAGS OSD_DOWN) 2024-09-16T03:10:03.360 INFO:tasks.workunit.client.0.smithi096.stdout: 2024-09-16T03:10:03.361 INFO:tasks.workunit.client.0.smithi096.stdout: services: 2024-09-16T03:10:03.361 INFO:tasks.workunit.client.0.smithi096.stdout: mon: 1 daemons, quorum a (age 2m) 2024-09-16T03:10:03.361 INFO:tasks.workunit.client.0.smithi096.stdout: mgr: x(active, since 2m) 2024-09-16T03:10:03.361 INFO:tasks.workunit.client.0.smithi096.stdout: osd: 3 osds: 2 up (since 4s), 3 in (since 61s) 2024-09-16T03:10:03.361 INFO:tasks.workunit.client.0.smithi096.stdout: flags noup 2024-09-16T03:10:03.361 INFO:tasks.workunit.client.0.smithi096.stdout: 2024-09-16T03:10:03.361 INFO:tasks.workunit.client.0.smithi096.stdout: data: 2024-09-16T03:10:03.361 INFO:tasks.workunit.client.0.smithi096.stdout: pools: 1 pools, 8 pgs 2024-09-16T03:10:03.361 INFO:tasks.workunit.client.0.smithi096.stdout: objects: 0 objects, 0 B 2024-09-16T03:10:03.361 INFO:tasks.workunit.client.0.smithi096.stdout: usage: 79 MiB used, 300 GiB / 300 GiB avail 2024-09-16T03:10:03.361 INFO:tasks.workunit.client.0.smithi096.stdout: pgs: 6 active+undersized+wait 2024-09-16T03:10:03.361 INFO:tasks.workunit.client.0.smithi096.stdout: 2 active+clean 2024-09-16T03:10:03.361 INFO:tasks.workunit.client.0.smithi096.stdout: 2024-09-16T03:10:03.376 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:66: TEST_mute: ceph health 2024-09-16T03:10:03.376 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:66: TEST_mute: grep HEALTH_OK 2024-09-16T03:10:03.376 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:66: TEST_mute: grep OSD_DOWN 2024-09-16T03:10:03.376 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:66: TEST_mute: grep OSDMAP_FLAGS 2024-09-16T03:10:03.883 INFO:tasks.workunit.client.0.smithi096.stdout:HEALTH_OK (muted: OSDMAP_FLAGS OSD_DOWN) 2024-09-16T03:10:03.883 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:67: TEST_mute: ceph health unmute OSD_DOWN 2024-09-16T03:10:04.864 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:68: TEST_mute: ceph -s 2024-09-16T03:10:05.459 INFO:tasks.workunit.client.0.smithi096.stdout: cluster: 2024-09-16T03:10:05.459 INFO:tasks.workunit.client.0.smithi096.stdout: id: 13dae064-b3e7-46f2-8f68-a5d53a7e19dc 2024-09-16T03:10:05.459 INFO:tasks.workunit.client.0.smithi096.stdout: health: HEALTH_WARN 2024-09-16T03:10:05.459 INFO:tasks.workunit.client.0.smithi096.stdout: 1 osds down 2024-09-16T03:10:05.459 INFO:tasks.workunit.client.0.smithi096.stdout: (muted: OSDMAP_FLAGS) 2024-09-16T03:10:05.459 INFO:tasks.workunit.client.0.smithi096.stdout: 2024-09-16T03:10:05.459 INFO:tasks.workunit.client.0.smithi096.stdout: services: 2024-09-16T03:10:05.459 INFO:tasks.workunit.client.0.smithi096.stdout: mon: 1 daemons, quorum a (age 2m) 2024-09-16T03:10:05.460 INFO:tasks.workunit.client.0.smithi096.stdout: mgr: x(active, since 2m) 2024-09-16T03:10:05.460 INFO:tasks.workunit.client.0.smithi096.stdout: osd: 3 osds: 2 up (since 6s), 3 in (since 63s) 2024-09-16T03:10:05.460 INFO:tasks.workunit.client.0.smithi096.stdout: flags noup 2024-09-16T03:10:05.460 INFO:tasks.workunit.client.0.smithi096.stdout: 2024-09-16T03:10:05.460 INFO:tasks.workunit.client.0.smithi096.stdout: data: 2024-09-16T03:10:05.460 INFO:tasks.workunit.client.0.smithi096.stdout: pools: 1 pools, 8 pgs 2024-09-16T03:10:05.460 INFO:tasks.workunit.client.0.smithi096.stdout: objects: 0 objects, 0 B 2024-09-16T03:10:05.460 INFO:tasks.workunit.client.0.smithi096.stdout: usage: 79 MiB used, 300 GiB / 300 GiB avail 2024-09-16T03:10:05.460 INFO:tasks.workunit.client.0.smithi096.stdout: pgs: 8 active+undersized+wait 2024-09-16T03:10:05.460 INFO:tasks.workunit.client.0.smithi096.stdout: 2024-09-16T03:10:05.475 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:69: TEST_mute: ceph health 2024-09-16T03:10:05.476 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:69: TEST_mute: grep HEALTH_WARN 2024-09-16T03:10:05.971 INFO:tasks.workunit.client.0.smithi096.stdout:HEALTH_WARN 1 osds down; (muted: OSDMAP_FLAGS) 2024-09-16T03:10:05.971 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:72: TEST_mute: ceph health mute OSD_DOWN 10s 2024-09-16T03:10:06.794 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:73: TEST_mute: ceph -s 2024-09-16T03:10:07.318 INFO:tasks.workunit.client.0.smithi096.stdout: cluster: 2024-09-16T03:10:07.318 INFO:tasks.workunit.client.0.smithi096.stdout: id: 13dae064-b3e7-46f2-8f68-a5d53a7e19dc 2024-09-16T03:10:07.318 INFO:tasks.workunit.client.0.smithi096.stdout: health: HEALTH_OK 2024-09-16T03:10:07.318 INFO:tasks.workunit.client.0.smithi096.stdout: (muted: OSDMAP_FLAGS OSD_DOWN(9s)) 2024-09-16T03:10:07.318 INFO:tasks.workunit.client.0.smithi096.stdout: 2024-09-16T03:10:07.318 INFO:tasks.workunit.client.0.smithi096.stdout: services: 2024-09-16T03:10:07.318 INFO:tasks.workunit.client.0.smithi096.stdout: mon: 1 daemons, quorum a (age 2m) 2024-09-16T03:10:07.318 INFO:tasks.workunit.client.0.smithi096.stdout: mgr: x(active, since 2m) 2024-09-16T03:10:07.318 INFO:tasks.workunit.client.0.smithi096.stdout: osd: 3 osds: 2 up (since 8s), 3 in (since 65s) 2024-09-16T03:10:07.318 INFO:tasks.workunit.client.0.smithi096.stdout: flags noup 2024-09-16T03:10:07.318 INFO:tasks.workunit.client.0.smithi096.stdout: 2024-09-16T03:10:07.319 INFO:tasks.workunit.client.0.smithi096.stdout: data: 2024-09-16T03:10:07.319 INFO:tasks.workunit.client.0.smithi096.stdout: pools: 1 pools, 8 pgs 2024-09-16T03:10:07.319 INFO:tasks.workunit.client.0.smithi096.stdout: objects: 0 objects, 0 B 2024-09-16T03:10:07.319 INFO:tasks.workunit.client.0.smithi096.stdout: usage: 79 MiB used, 300 GiB / 300 GiB avail 2024-09-16T03:10:07.319 INFO:tasks.workunit.client.0.smithi096.stdout: pgs: 8 active+undersized+wait 2024-09-16T03:10:07.319 INFO:tasks.workunit.client.0.smithi096.stdout: 2024-09-16T03:10:07.334 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:74: TEST_mute: ceph health 2024-09-16T03:10:07.334 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:74: TEST_mute: grep HEALTH_OK 2024-09-16T03:10:07.836 INFO:tasks.workunit.client.0.smithi096.stdout:HEALTH_OK (muted: OSDMAP_FLAGS OSD_DOWN(8s)) 2024-09-16T03:10:07.836 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:75: TEST_mute: sleep 15 2024-09-16T03:10:22.838 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:76: TEST_mute: ceph -s 2024-09-16T03:10:23.384 INFO:tasks.workunit.client.0.smithi096.stdout: cluster: 2024-09-16T03:10:23.384 INFO:tasks.workunit.client.0.smithi096.stdout: id: 13dae064-b3e7-46f2-8f68-a5d53a7e19dc 2024-09-16T03:10:23.384 INFO:tasks.workunit.client.0.smithi096.stdout: health: HEALTH_WARN 2024-09-16T03:10:23.384 INFO:tasks.workunit.client.0.smithi096.stdout: 1 osds down 2024-09-16T03:10:23.384 INFO:tasks.workunit.client.0.smithi096.stdout: (muted: OSDMAP_FLAGS) 2024-09-16T03:10:23.384 INFO:tasks.workunit.client.0.smithi096.stdout: 2024-09-16T03:10:23.384 INFO:tasks.workunit.client.0.smithi096.stdout: services: 2024-09-16T03:10:23.384 INFO:tasks.workunit.client.0.smithi096.stdout: mon: 1 daemons, quorum a (age 2m) 2024-09-16T03:10:23.385 INFO:tasks.workunit.client.0.smithi096.stdout: mgr: x(active, since 2m) 2024-09-16T03:10:23.385 INFO:tasks.workunit.client.0.smithi096.stdout: osd: 3 osds: 2 up (since 24s), 3 in (since 81s) 2024-09-16T03:10:23.385 INFO:tasks.workunit.client.0.smithi096.stdout: flags noup 2024-09-16T03:10:23.385 INFO:tasks.workunit.client.0.smithi096.stdout: 2024-09-16T03:10:23.385 INFO:tasks.workunit.client.0.smithi096.stdout: data: 2024-09-16T03:10:23.385 INFO:tasks.workunit.client.0.smithi096.stdout: pools: 1 pools, 8 pgs 2024-09-16T03:10:23.385 INFO:tasks.workunit.client.0.smithi096.stdout: objects: 0 objects, 0 B 2024-09-16T03:10:23.385 INFO:tasks.workunit.client.0.smithi096.stdout: usage: 80 MiB used, 300 GiB / 300 GiB avail 2024-09-16T03:10:23.385 INFO:tasks.workunit.client.0.smithi096.stdout: pgs: 8 active+undersized 2024-09-16T03:10:23.385 INFO:tasks.workunit.client.0.smithi096.stdout: 2024-09-16T03:10:23.400 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:77: TEST_mute: ceph health 2024-09-16T03:10:23.400 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:77: TEST_mute: grep HEALTH_WARN 2024-09-16T03:10:23.924 INFO:tasks.workunit.client.0.smithi096.stdout:HEALTH_WARN 1 osds down; (muted: OSDMAP_FLAGS) 2024-09-16T03:10:23.924 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:80: TEST_mute: ceph health mute OSDMAP_FLAGS --sticky 2024-09-16T03:10:24.908 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:81: TEST_mute: ceph osd unset noup 2024-09-16T03:10:25.569 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:10:25.587 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:82: TEST_mute: sleep 5 2024-09-16T03:10:30.589 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:83: TEST_mute: ceph -s 2024-09-16T03:10:31.139 INFO:tasks.workunit.client.0.smithi096.stdout: cluster: 2024-09-16T03:10:31.139 INFO:tasks.workunit.client.0.smithi096.stdout: id: 13dae064-b3e7-46f2-8f68-a5d53a7e19dc 2024-09-16T03:10:31.139 INFO:tasks.workunit.client.0.smithi096.stdout: health: HEALTH_OK 2024-09-16T03:10:31.139 INFO:tasks.workunit.client.0.smithi096.stdout: (muted: OSDMAP_FLAGS) 2024-09-16T03:10:31.139 INFO:tasks.workunit.client.0.smithi096.stdout: 2024-09-16T03:10:31.139 INFO:tasks.workunit.client.0.smithi096.stdout: services: 2024-09-16T03:10:31.139 INFO:tasks.workunit.client.0.smithi096.stdout: mon: 1 daemons, quorum a (age 2m) 2024-09-16T03:10:31.140 INFO:tasks.workunit.client.0.smithi096.stdout: mgr: x(active, since 2m) 2024-09-16T03:10:31.140 INFO:tasks.workunit.client.0.smithi096.stdout: osd: 3 osds: 3 up (since 5s), 3 in (since 89s) 2024-09-16T03:10:31.140 INFO:tasks.workunit.client.0.smithi096.stdout: 2024-09-16T03:10:31.140 INFO:tasks.workunit.client.0.smithi096.stdout: data: 2024-09-16T03:10:31.140 INFO:tasks.workunit.client.0.smithi096.stdout: pools: 1 pools, 8 pgs 2024-09-16T03:10:31.140 INFO:tasks.workunit.client.0.smithi096.stdout: objects: 0 objects, 0 B 2024-09-16T03:10:31.140 INFO:tasks.workunit.client.0.smithi096.stdout: usage: 80 MiB used, 300 GiB / 300 GiB avail 2024-09-16T03:10:31.140 INFO:tasks.workunit.client.0.smithi096.stdout: pgs: 62.500% pgs not active 2024-09-16T03:10:31.140 INFO:tasks.workunit.client.0.smithi096.stdout: 5 peering 2024-09-16T03:10:31.140 INFO:tasks.workunit.client.0.smithi096.stdout: 2 active+clean 2024-09-16T03:10:31.140 INFO:tasks.workunit.client.0.smithi096.stdout: 1 active+undersized 2024-09-16T03:10:31.140 INFO:tasks.workunit.client.0.smithi096.stdout: 2024-09-16T03:10:31.155 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:84: TEST_mute: ceph health 2024-09-16T03:10:31.155 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:84: TEST_mute: grep OSDMAP_FLAGS 2024-09-16T03:10:31.652 INFO:tasks.workunit.client.0.smithi096.stdout:HEALTH_OK (muted: OSDMAP_FLAGS) 2024-09-16T03:10:31.653 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:85: TEST_mute: ceph osd set noup 2024-09-16T03:10:32.353 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:10:32.373 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:86: TEST_mute: ceph -s 2024-09-16T03:10:32.911 INFO:tasks.workunit.client.0.smithi096.stdout: cluster: 2024-09-16T03:10:32.911 INFO:tasks.workunit.client.0.smithi096.stdout: id: 13dae064-b3e7-46f2-8f68-a5d53a7e19dc 2024-09-16T03:10:32.911 INFO:tasks.workunit.client.0.smithi096.stdout: health: HEALTH_OK 2024-09-16T03:10:32.911 INFO:tasks.workunit.client.0.smithi096.stdout: (muted: OSDMAP_FLAGS) 2024-09-16T03:10:32.911 INFO:tasks.workunit.client.0.smithi096.stdout: 2024-09-16T03:10:32.911 INFO:tasks.workunit.client.0.smithi096.stdout: services: 2024-09-16T03:10:32.911 INFO:tasks.workunit.client.0.smithi096.stdout: mon: 1 daemons, quorum a (age 2m) 2024-09-16T03:10:32.912 INFO:tasks.workunit.client.0.smithi096.stdout: mgr: x(active, since 2m) 2024-09-16T03:10:32.912 INFO:tasks.workunit.client.0.smithi096.stdout: osd: 3 osds: 3 up (since 7s), 3 in (since 90s) 2024-09-16T03:10:32.912 INFO:tasks.workunit.client.0.smithi096.stdout: flags noup 2024-09-16T03:10:32.912 INFO:tasks.workunit.client.0.smithi096.stdout: 2024-09-16T03:10:32.912 INFO:tasks.workunit.client.0.smithi096.stdout: data: 2024-09-16T03:10:32.912 INFO:tasks.workunit.client.0.smithi096.stdout: pools: 1 pools, 8 pgs 2024-09-16T03:10:32.912 INFO:tasks.workunit.client.0.smithi096.stdout: objects: 0 objects, 0 B 2024-09-16T03:10:32.912 INFO:tasks.workunit.client.0.smithi096.stdout: usage: 80 MiB used, 300 GiB / 300 GiB avail 2024-09-16T03:10:32.912 INFO:tasks.workunit.client.0.smithi096.stdout: pgs: 8 active+clean 2024-09-16T03:10:32.912 INFO:tasks.workunit.client.0.smithi096.stdout: 2024-09-16T03:10:32.927 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:87: TEST_mute: ceph health 2024-09-16T03:10:32.927 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:87: TEST_mute: grep HEALTH_OK 2024-09-16T03:10:33.415 INFO:tasks.workunit.client.0.smithi096.stdout:HEALTH_OK (muted: OSDMAP_FLAGS) 2024-09-16T03:10:33.415 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:90: TEST_mute: ceph osd down 0 1 2024-09-16T03:10:34.055 INFO:tasks.workunit.client.0.smithi096.stderr:osd.0 is already down. osd.1 is already down. 2024-09-16T03:10:34.075 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:91: TEST_mute: ceph -s 2024-09-16T03:10:34.909 INFO:tasks.workunit.client.0.smithi096.stdout: cluster: 2024-09-16T03:10:34.910 INFO:tasks.workunit.client.0.smithi096.stdout: id: 13dae064-b3e7-46f2-8f68-a5d53a7e19dc 2024-09-16T03:10:34.910 INFO:tasks.workunit.client.0.smithi096.stdout: health: HEALTH_WARN 2024-09-16T03:10:34.910 INFO:tasks.workunit.client.0.smithi096.stdout: 2 osds down 2024-09-16T03:10:34.910 INFO:tasks.workunit.client.0.smithi096.stdout: (muted: OSDMAP_FLAGS) 2024-09-16T03:10:34.910 INFO:tasks.workunit.client.0.smithi096.stdout: 2024-09-16T03:10:34.910 INFO:tasks.workunit.client.0.smithi096.stdout: services: 2024-09-16T03:10:34.910 INFO:tasks.workunit.client.0.smithi096.stdout: mon: 1 daemons, quorum a (age 2m) 2024-09-16T03:10:34.910 INFO:tasks.workunit.client.0.smithi096.stdout: mgr: x(active, since 2m) 2024-09-16T03:10:34.910 INFO:tasks.workunit.client.0.smithi096.stdout: osd: 3 osds: 1 up (since 1.12156s), 3 in (since 92s) 2024-09-16T03:10:34.910 INFO:tasks.workunit.client.0.smithi096.stdout: flags noup 2024-09-16T03:10:34.910 INFO:tasks.workunit.client.0.smithi096.stdout: 2024-09-16T03:10:34.911 INFO:tasks.workunit.client.0.smithi096.stdout: data: 2024-09-16T03:10:34.911 INFO:tasks.workunit.client.0.smithi096.stdout: pools: 1 pools, 8 pgs 2024-09-16T03:10:34.911 INFO:tasks.workunit.client.0.smithi096.stdout: objects: 0 objects, 0 B 2024-09-16T03:10:34.911 INFO:tasks.workunit.client.0.smithi096.stdout: usage: 80 MiB used, 300 GiB / 300 GiB avail 2024-09-16T03:10:34.911 INFO:tasks.workunit.client.0.smithi096.stdout: pgs: 6 stale+active+clean 2024-09-16T03:10:34.911 INFO:tasks.workunit.client.0.smithi096.stdout: 2 active+clean 2024-09-16T03:10:34.911 INFO:tasks.workunit.client.0.smithi096.stdout: 2024-09-16T03:10:34.928 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:92: TEST_mute: ceph health detail 2024-09-16T03:10:34.928 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:92: TEST_mute: grep OSD_DOWN 2024-09-16T03:10:35.506 INFO:tasks.workunit.client.0.smithi096.stdout:[WRN] OSD_DOWN: 2 osds down 2024-09-16T03:10:35.506 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:94: TEST_mute: ceph health mute OSD_DOWN 2024-09-16T03:10:36.485 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:95: TEST_mute: kill_daemons td/health-mute TERM osd.0 2024-09-16T03:10:36.486 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:10:36.486 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:10:36.486 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:10:36.486 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:10:36.486 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:10:36.596 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:10:36.597 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:96: TEST_mute: ceph osd unset noup 2024-09-16T03:10:37.305 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:10:37.326 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:97: TEST_mute: sleep 10 2024-09-16T03:10:47.328 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:98: TEST_mute: ceph -s 2024-09-16T03:10:47.877 INFO:tasks.workunit.client.0.smithi096.stdout: cluster: 2024-09-16T03:10:47.877 INFO:tasks.workunit.client.0.smithi096.stdout: id: 13dae064-b3e7-46f2-8f68-a5d53a7e19dc 2024-09-16T03:10:47.877 INFO:tasks.workunit.client.0.smithi096.stdout: health: HEALTH_OK 2024-09-16T03:10:47.877 INFO:tasks.workunit.client.0.smithi096.stdout: (muted: OSDMAP_FLAGS OSD_DOWN) 2024-09-16T03:10:47.877 INFO:tasks.workunit.client.0.smithi096.stdout: 2024-09-16T03:10:47.878 INFO:tasks.workunit.client.0.smithi096.stdout: services: 2024-09-16T03:10:47.878 INFO:tasks.workunit.client.0.smithi096.stdout: mon: 1 daemons, quorum a (age 3m) 2024-09-16T03:10:47.878 INFO:tasks.workunit.client.0.smithi096.stdout: mgr: x(active, since 2m) 2024-09-16T03:10:47.878 INFO:tasks.workunit.client.0.smithi096.stdout: osd: 3 osds: 2 up (since 10s), 3 in (since 105s) 2024-09-16T03:10:47.878 INFO:tasks.workunit.client.0.smithi096.stdout: 2024-09-16T03:10:47.878 INFO:tasks.workunit.client.0.smithi096.stdout: data: 2024-09-16T03:10:47.878 INFO:tasks.workunit.client.0.smithi096.stdout: pools: 1 pools, 8 pgs 2024-09-16T03:10:47.878 INFO:tasks.workunit.client.0.smithi096.stdout: objects: 0 objects, 0 B 2024-09-16T03:10:47.878 INFO:tasks.workunit.client.0.smithi096.stdout: usage: 80 MiB used, 300 GiB / 300 GiB avail 2024-09-16T03:10:47.878 INFO:tasks.workunit.client.0.smithi096.stdout: pgs: 8 active+undersized 2024-09-16T03:10:47.878 INFO:tasks.workunit.client.0.smithi096.stdout: 2024-09-16T03:10:47.893 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:99: TEST_mute: ceph health detail 2024-09-16T03:10:47.894 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:99: TEST_mute: grep OSD_DOWN 2024-09-16T03:10:48.458 INFO:tasks.workunit.client.0.smithi096.stdout:HEALTH_OK (muted: OSDMAP_FLAGS OSD_DOWN) 2024-09-16T03:10:48.458 INFO:tasks.workunit.client.0.smithi096.stdout:(MUTED) [WRN] OSD_DOWN: 1 osds down 2024-09-16T03:10:48.459 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:100: TEST_mute: grep '1 osds down' 2024-09-16T03:10:48.459 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:100: TEST_mute: ceph health detail 2024-09-16T03:10:49.033 INFO:tasks.workunit.client.0.smithi096.stdout:(MUTED) [WRN] OSD_DOWN: 1 osds down 2024-09-16T03:10:49.034 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:101: TEST_mute: grep HEALTH_OK 2024-09-16T03:10:49.034 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:101: TEST_mute: ceph health 2024-09-16T03:10:49.564 INFO:tasks.workunit.client.0.smithi096.stdout:HEALTH_OK (muted: OSDMAP_FLAGS OSD_DOWN) 2024-09-16T03:10:49.565 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:103: TEST_mute: sleep 10 2024-09-16T03:10:59.566 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:104: TEST_mute: ceph osd set noup 2024-09-16T03:11:00.216 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:11:00.234 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:105: TEST_mute: ceph health mute OSDMAP_FLAGS 2024-09-16T03:11:01.202 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:106: TEST_mute: ceph -s 2024-09-16T03:11:01.715 INFO:tasks.workunit.client.0.smithi096.stdout: cluster: 2024-09-16T03:11:01.715 INFO:tasks.workunit.client.0.smithi096.stdout: id: 13dae064-b3e7-46f2-8f68-a5d53a7e19dc 2024-09-16T03:11:01.715 INFO:tasks.workunit.client.0.smithi096.stdout: health: HEALTH_OK 2024-09-16T03:11:01.715 INFO:tasks.workunit.client.0.smithi096.stdout: (muted: OSDMAP_FLAGS OSD_DOWN) 2024-09-16T03:11:01.715 INFO:tasks.workunit.client.0.smithi096.stdout: 2024-09-16T03:11:01.715 INFO:tasks.workunit.client.0.smithi096.stdout: services: 2024-09-16T03:11:01.715 INFO:tasks.workunit.client.0.smithi096.stdout: mon: 1 daemons, quorum a (age 3m) 2024-09-16T03:11:01.715 INFO:tasks.workunit.client.0.smithi096.stdout: mgr: x(active, since 3m) 2024-09-16T03:11:01.716 INFO:tasks.workunit.client.0.smithi096.stdout: osd: 3 osds: 2 up (since 24s), 3 in (since 119s) 2024-09-16T03:11:01.716 INFO:tasks.workunit.client.0.smithi096.stdout: flags noup 2024-09-16T03:11:01.716 INFO:tasks.workunit.client.0.smithi096.stdout: 2024-09-16T03:11:01.716 INFO:tasks.workunit.client.0.smithi096.stdout: data: 2024-09-16T03:11:01.716 INFO:tasks.workunit.client.0.smithi096.stdout: pools: 1 pools, 8 pgs 2024-09-16T03:11:01.716 INFO:tasks.workunit.client.0.smithi096.stdout: objects: 0 objects, 0 B 2024-09-16T03:11:01.716 INFO:tasks.workunit.client.0.smithi096.stdout: usage: 80 MiB used, 300 GiB / 300 GiB avail 2024-09-16T03:11:01.716 INFO:tasks.workunit.client.0.smithi096.stdout: pgs: 8 active+undersized 2024-09-16T03:11:01.716 INFO:tasks.workunit.client.0.smithi096.stdout: 2024-09-16T03:11:01.731 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:107: TEST_mute: ceph health detail 2024-09-16T03:11:02.280 INFO:tasks.workunit.client.0.smithi096.stdout:HEALTH_OK (muted: OSDMAP_FLAGS OSD_DOWN) 2024-09-16T03:11:02.280 INFO:tasks.workunit.client.0.smithi096.stdout:(MUTED) [WRN] OSDMAP_FLAGS: noup flag(s) set 2024-09-16T03:11:02.280 INFO:tasks.workunit.client.0.smithi096.stdout:(MUTED) [WRN] OSD_DOWN: 1 osds down 2024-09-16T03:11:02.280 INFO:tasks.workunit.client.0.smithi096.stdout: osd.0 (root=default,host=smithi096) is down 2024-09-16T03:11:02.296 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:108: TEST_mute: ceph health 2024-09-16T03:11:02.296 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:108: TEST_mute: grep HEALTH_OK 2024-09-16T03:11:02.831 INFO:tasks.workunit.client.0.smithi096.stdout:HEALTH_OK (muted: OSDMAP_FLAGS OSD_DOWN) 2024-09-16T03:11:02.832 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:110: TEST_mute: ceph osd down 1 2024-09-16T03:11:03.401 INFO:tasks.workunit.client.0.smithi096.stderr:osd.1 is already down. 2024-09-16T03:11:03.418 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:111: TEST_mute: ceph -s 2024-09-16T03:11:04.047 INFO:tasks.workunit.client.0.smithi096.stdout: cluster: 2024-09-16T03:11:04.047 INFO:tasks.workunit.client.0.smithi096.stdout: id: 13dae064-b3e7-46f2-8f68-a5d53a7e19dc 2024-09-16T03:11:04.047 INFO:tasks.workunit.client.0.smithi096.stdout: health: HEALTH_OK 2024-09-16T03:11:04.047 INFO:tasks.workunit.client.0.smithi096.stdout: (muted: OSDMAP_FLAGS OSD_DOWN) 2024-09-16T03:11:04.048 INFO:tasks.workunit.client.0.smithi096.stdout: 2024-09-16T03:11:04.048 INFO:tasks.workunit.client.0.smithi096.stdout: services: 2024-09-16T03:11:04.048 INFO:tasks.workunit.client.0.smithi096.stdout: mon: 1 daemons, quorum a (age 3m) 2024-09-16T03:11:04.048 INFO:tasks.workunit.client.0.smithi096.stdout: mgr: x(active, since 3m) 2024-09-16T03:11:04.048 INFO:tasks.workunit.client.0.smithi096.stdout: osd: 3 osds: 1 up (since 0.821026s), 3 in (since 2m) 2024-09-16T03:11:04.048 INFO:tasks.workunit.client.0.smithi096.stdout: flags noup 2024-09-16T03:11:04.048 INFO:tasks.workunit.client.0.smithi096.stdout: 2024-09-16T03:11:04.048 INFO:tasks.workunit.client.0.smithi096.stdout: data: 2024-09-16T03:11:04.048 INFO:tasks.workunit.client.0.smithi096.stdout: pools: 1 pools, 8 pgs 2024-09-16T03:11:04.048 INFO:tasks.workunit.client.0.smithi096.stdout: objects: 0 objects, 0 B 2024-09-16T03:11:04.048 INFO:tasks.workunit.client.0.smithi096.stdout: usage: 80 MiB used, 300 GiB / 300 GiB avail 2024-09-16T03:11:04.048 INFO:tasks.workunit.client.0.smithi096.stdout: pgs: 8 active+undersized 2024-09-16T03:11:04.048 INFO:tasks.workunit.client.0.smithi096.stdout: 2024-09-16T03:11:04.063 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:112: TEST_mute: ceph health detail 2024-09-16T03:11:04.658 INFO:tasks.workunit.client.0.smithi096.stdout:HEALTH_OK (muted: OSDMAP_FLAGS OSD_DOWN) 2024-09-16T03:11:04.658 INFO:tasks.workunit.client.0.smithi096.stdout:(MUTED) [WRN] OSDMAP_FLAGS: noup flag(s) set 2024-09-16T03:11:04.658 INFO:tasks.workunit.client.0.smithi096.stdout:(MUTED) [WRN] OSD_DOWN: 2 osds down 2024-09-16T03:11:04.658 INFO:tasks.workunit.client.0.smithi096.stdout: osd.0 (root=default,host=smithi096) is down 2024-09-16T03:11:04.659 INFO:tasks.workunit.client.0.smithi096.stdout: osd.1 (root=default,host=smithi096) is down 2024-09-16T03:11:04.674 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:113: TEST_mute: ceph health detail 2024-09-16T03:11:04.674 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:113: TEST_mute: grep '2 osds down' 2024-09-16T03:11:05.239 INFO:tasks.workunit.client.0.smithi096.stdout:(MUTED) [WRN] OSD_DOWN: 2 osds down 2024-09-16T03:11:05.239 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:115: TEST_mute: sleep 10 2024-09-16T03:11:15.241 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:116: TEST_mute: ceph -s 2024-09-16T03:11:15.797 INFO:tasks.workunit.client.0.smithi096.stdout: cluster: 2024-09-16T03:11:15.797 INFO:tasks.workunit.client.0.smithi096.stdout: id: 13dae064-b3e7-46f2-8f68-a5d53a7e19dc 2024-09-16T03:11:15.798 INFO:tasks.workunit.client.0.smithi096.stdout: health: HEALTH_WARN 2024-09-16T03:11:15.798 INFO:tasks.workunit.client.0.smithi096.stdout: 2 osds down 2024-09-16T03:11:15.798 INFO:tasks.workunit.client.0.smithi096.stdout: (muted: OSDMAP_FLAGS) 2024-09-16T03:11:15.798 INFO:tasks.workunit.client.0.smithi096.stdout: 2024-09-16T03:11:15.798 INFO:tasks.workunit.client.0.smithi096.stdout: services: 2024-09-16T03:11:15.798 INFO:tasks.workunit.client.0.smithi096.stdout: mon: 1 daemons, quorum a (age 3m) 2024-09-16T03:11:15.798 INFO:tasks.workunit.client.0.smithi096.stdout: mgr: x(active, since 3m) 2024-09-16T03:11:15.798 INFO:tasks.workunit.client.0.smithi096.stdout: osd: 3 osds: 1 up (since 12s), 3 in (since 2m) 2024-09-16T03:11:15.798 INFO:tasks.workunit.client.0.smithi096.stdout: flags noup 2024-09-16T03:11:15.798 INFO:tasks.workunit.client.0.smithi096.stdout: 2024-09-16T03:11:15.798 INFO:tasks.workunit.client.0.smithi096.stdout: data: 2024-09-16T03:11:15.798 INFO:tasks.workunit.client.0.smithi096.stdout: pools: 1 pools, 8 pgs 2024-09-16T03:11:15.798 INFO:tasks.workunit.client.0.smithi096.stdout: objects: 0 objects, 0 B 2024-09-16T03:11:15.799 INFO:tasks.workunit.client.0.smithi096.stdout: usage: 80 MiB used, 300 GiB / 300 GiB avail 2024-09-16T03:11:15.799 INFO:tasks.workunit.client.0.smithi096.stdout: pgs: 100.000% pgs not active 2024-09-16T03:11:15.799 INFO:tasks.workunit.client.0.smithi096.stdout: 8 undersized+peered 2024-09-16T03:11:15.799 INFO:tasks.workunit.client.0.smithi096.stdout: 2024-09-16T03:11:15.813 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:117: TEST_mute: ceph health detail 2024-09-16T03:11:16.357 INFO:tasks.workunit.client.0.smithi096.stdout:HEALTH_WARN 2 osds down; (muted: OSDMAP_FLAGS) 2024-09-16T03:11:16.357 INFO:tasks.workunit.client.0.smithi096.stdout:(MUTED) [WRN] OSDMAP_FLAGS: noup flag(s) set 2024-09-16T03:11:16.357 INFO:tasks.workunit.client.0.smithi096.stdout:[WRN] OSD_DOWN: 2 osds down 2024-09-16T03:11:16.357 INFO:tasks.workunit.client.0.smithi096.stdout: osd.0 (root=default,host=smithi096) is down 2024-09-16T03:11:16.357 INFO:tasks.workunit.client.0.smithi096.stdout: osd.1 (root=default,host=smithi096) is down 2024-09-16T03:11:16.374 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:118: TEST_mute: ceph health 2024-09-16T03:11:16.374 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:118: TEST_mute: grep HEALTH_WARN 2024-09-16T03:11:16.887 INFO:tasks.workunit.client.0.smithi096.stdout:HEALTH_WARN 2 osds down; (muted: OSDMAP_FLAGS) 2024-09-16T03:11:16.887 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:119: TEST_mute: ceph health detail 2024-09-16T03:11:16.888 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:119: TEST_mute: grep '2 osds down' 2024-09-16T03:11:17.422 INFO:tasks.workunit.client.0.smithi096.stdout:HEALTH_WARN 2 osds down; (muted: OSDMAP_FLAGS) 2024-09-16T03:11:17.422 INFO:tasks.workunit.client.0.smithi096.stdout:[WRN] OSD_DOWN: 2 osds down 2024-09-16T03:11:17.423 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:121: TEST_mute: teardown td/health-mute 2024-09-16T03:11:17.423 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/health-mute 2024-09-16T03:11:17.423 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:11:17.423 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/health-mute KILL 2024-09-16T03:11:17.423 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:11:17.423 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:11:17.423 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:11:17.423 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:11:17.424 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:11:17.530 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:11:17.531 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:11:17.531 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:11:17.531 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:11:17.533 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:11:17.533 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:11:17.534 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:11:17.535 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:11:17.535 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:11:17.536 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:11:17.536 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:11:17.536 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:11:17.537 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:11:17.537 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/health-mute 2024-09-16T03:11:17.558 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:11:17.559 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:11:17.559 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.21529 2024-09-16T03:11:17.559 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.21529 2024-09-16T03:11:17.560 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:11:17.560 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:11:17.560 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh:18: run: teardown td/health-mute 2024-09-16T03:11:17.560 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/health-mute 2024-09-16T03:11:17.560 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:11:17.560 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/health-mute KILL 2024-09-16T03:11:17.560 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:11:17.561 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:11:17.561 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:11:17.561 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:11:17.561 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:11:17.562 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:11:17.562 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:11:17.563 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:11:17.563 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:11:17.564 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:11:17.564 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:11:17.564 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:11:17.565 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:11:17.565 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:11:17.566 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:11:17.566 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:11:17.566 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:11:17.567 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:11:17.567 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/health-mute 2024-09-16T03:11:17.568 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:11:17.569 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:11:17.569 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.21529 2024-09-16T03:11:17.569 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.21529 2024-09-16T03:11:17.570 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:11:17.570 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:11:17.570 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2322: main: code=0 2024-09-16T03:11:17.570 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2326: main: teardown td/health-mute 0 2024-09-16T03:11:17.570 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/health-mute 2024-09-16T03:11:17.571 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2024-09-16T03:11:17.571 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/health-mute KILL 2024-09-16T03:11:17.571 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:11:17.571 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:11:17.571 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:11:17.571 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:11:17.571 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:11:17.572 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:11:17.572 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:11:17.572 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:11:17.573 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:11:17.573 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:11:17.574 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:11:17.574 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:11:17.574 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:11:17.574 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:11:17.575 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:11:17.575 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:11:17.576 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:11:17.576 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2024-09-16T03:11:17.576 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/health-mute 2024-09-16T03:11:17.577 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:11:17.577 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:11:17.578 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.21529 2024-09-16T03:11:17.578 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.21529 2024-09-16T03:11:17.579 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:11:17.579 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:11:17.579 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2327: main: return 0 2024-09-16T03:11:17.579 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-16T03:11:17.580 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-16T03:11:17.636 INFO:tasks.workunit:Running workunit mon/misc.sh... 2024-09-16T03:11:17.636 DEBUG:teuthology.orchestra.run.smithi096:workunit test mon/misc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7498493279982dfe87f00616198a5967475f6169 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh 2024-09-16T03:11:17.689 INFO:tasks.workunit.client.0.smithi096.stderr:stty: 'standard input': Inappropriate ioctl for device 2024-09-16T03:11:17.695 INFO:tasks.workunit.client.0.smithi096.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2024-09-16T03:11:17.695 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2315: main: export PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-16T03:11:17.695 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2315: main: PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-16T03:11:17.695 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2316: main: export PYTHONWARNINGS=ignore 2024-09-16T03:11:17.695 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2316: main: PYTHONWARNINGS=ignore 2024-09-16T03:11:17.695 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2317: main: export CEPH_CONF=/dev/null 2024-09-16T03:11:17.695 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2317: main: CEPH_CONF=/dev/null 2024-09-16T03:11:17.696 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2318: main: unset CEPH_ARGS 2024-09-16T03:11:17.696 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2320: main: local code 2024-09-16T03:11:17.696 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2321: main: run td/misc 2024-09-16T03:11:17.696 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:21: run: local dir=td/misc 2024-09-16T03:11:17.696 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:22: run: shift 2024-09-16T03:11:17.696 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:24: run: export CEPH_MON=127.0.0.1:7102 2024-09-16T03:11:17.696 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:24: run: CEPH_MON=127.0.0.1:7102 2024-09-16T03:11:17.696 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:25: run: export CEPH_ARGS 2024-09-16T03:11:17.696 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:26: run: uuidgen 2024-09-16T03:11:17.696 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:26: run: CEPH_ARGS+='--fsid=70ae940e-8044-45d6-a8aa-6a661a8269d2 --auth-supported=none ' 2024-09-16T03:11:17.696 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:27: run: CEPH_ARGS+='--mon-host=127.0.0.1:7102 ' 2024-09-16T03:11:17.697 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:29: run: set 2024-09-16T03:11:17.697 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:29: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2024-09-16T03:11:17.699 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:29: run: local 'funcs=TEST_mon_add_to_single_mon 2024-09-16T03:11:17.699 INFO:tasks.workunit.client.0.smithi096.stderr:TEST_mon_features 2024-09-16T03:11:17.700 INFO:tasks.workunit.client.0.smithi096.stderr:TEST_no_segfault_for_bad_keyring 2024-09-16T03:11:17.700 INFO:tasks.workunit.client.0.smithi096.stderr:TEST_osd_pool_get_set' 2024-09-16T03:11:17.700 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:30: run: for func in $funcs 2024-09-16T03:11:17.700 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:31: run: TEST_mon_add_to_single_mon td/misc 2024-09-16T03:11:17.700 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:105: TEST_mon_add_to_single_mon: local dir=td/misc 2024-09-16T03:11:17.700 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:107: TEST_mon_add_to_single_mon: uuidgen 2024-09-16T03:11:17.702 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:107: TEST_mon_add_to_single_mon: fsid=b393df8e-f628-4302-9e3d-4220be73bcfa 2024-09-16T03:11:17.702 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:108: TEST_mon_add_to_single_mon: MONA=127.0.0.1:7117 2024-09-16T03:11:17.702 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:109: TEST_mon_add_to_single_mon: MONB=127.0.0.1:7118 2024-09-16T03:11:17.702 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:110: TEST_mon_add_to_single_mon: CEPH_ARGS_orig='--fsid=70ae940e-8044-45d6-a8aa-6a661a8269d2 --auth-supported=none --mon-host=127.0.0.1:7102 ' 2024-09-16T03:11:17.702 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:111: TEST_mon_add_to_single_mon: CEPH_ARGS='--fsid=b393df8e-f628-4302-9e3d-4220be73bcfa --auth-supported=none ' 2024-09-16T03:11:17.702 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:112: TEST_mon_add_to_single_mon: CEPH_ARGS+='--mon-initial-members=a ' 2024-09-16T03:11:17.702 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:113: TEST_mon_add_to_single_mon: CEPH_ARGS+='--mon-host=127.0.0.1:7117 ' 2024-09-16T03:11:17.702 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:115: TEST_mon_add_to_single_mon: setup td/misc 2024-09-16T03:11:17.703 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/misc 2024-09-16T03:11:17.703 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/misc 2024-09-16T03:11:17.703 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/misc 2024-09-16T03:11:17.703 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:11:17.703 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/misc KILL 2024-09-16T03:11:17.703 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:11:17.703 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:11:17.703 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:11:17.703 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:11:17.703 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:11:17.704 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:11:17.704 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:11:17.704 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:11:17.704 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:11:17.705 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:11:17.705 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:11:17.705 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:11:17.706 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:11:17.706 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:11:17.706 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:11:17.706 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:11:17.707 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:11:17.708 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:11:17.708 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/misc 2024-09-16T03:11:17.709 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:11:17.709 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:11:17.709 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.29106 2024-09-16T03:11:17.709 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.29106 2024-09-16T03:11:17.710 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:11:17.710 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:11:17.710 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/misc 2024-09-16T03:11:17.711 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T03:11:17.711 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:11:17.711 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.29106 2024-09-16T03:11:17.711 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.29106 2024-09-16T03:11:17.713 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T03:11:17.713 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2024-09-16T03:11:17.713 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2024-09-16T03:11:17.713 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T03:11:17.714 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/misc 1' TERM HUP INT 2024-09-16T03:11:17.714 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:116: TEST_mon_add_to_single_mon: run_mon td/misc a --public-addr 127.0.0.1:7117 2024-09-16T03:11:17.714 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/misc 2024-09-16T03:11:17.714 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T03:11:17.714 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T03:11:17.714 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T03:11:17.714 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/misc/a 2024-09-16T03:11:17.714 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/misc/a --run-dir=td/misc --public-addr 127.0.0.1:7117 2024-09-16T03:11:18.160 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T03:11:18.160 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:11:18.160 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:11:18.161 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:11:18.161 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:11:18.161 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.29106 2024-09-16T03:11:18.161 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.29106/$cluster-$name.asok' 2024-09-16T03:11:18.161 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/misc/a '--log-file=td/misc/$name.log' '--admin-socket=/tmp/ceph-asok.29106/$cluster-$name.asok' --mon-cluster-log-file=td/misc/log --run-dir=td/misc '--pid-file=td/misc/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr 127.0.0.1:7117 2024-09-16T03:11:18.364 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T03:11:18.365 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T03:11:18.365 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:11:18.365 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:11:18.365 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T03:11:18.365 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T03:11:18.367 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:11:18.367 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:11:18.367 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:11:18.367 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:11:18.367 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:11:18.367 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.29106 2024-09-16T03:11:18.367 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.29106/ceph-mon.a.asok 2024-09-16T03:11:18.367 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:11:18.367 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.29106/ceph-mon.a.asok config get fsid 2024-09-16T03:11:18.487 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T03:11:18.487 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:11:18.487 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:11:18.487 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T03:11:18.487 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T03:11:18.487 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:11:18.487 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:11:18.487 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:11:18.488 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:11:18.488 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:11:18.488 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.29106 2024-09-16T03:11:18.488 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.29106/ceph-mon.a.asok 2024-09-16T03:11:18.488 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:11:18.488 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.29106/ceph-mon.a.asok config get mon_host 2024-09-16T03:11:18.596 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:118: TEST_mon_add_to_single_mon: timeout 120 ceph -s 2024-09-16T03:11:19.432 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:119: TEST_mon_add_to_single_mon: run_mon td/misc b --public-addr 127.0.0.1:7118 2024-09-16T03:11:19.433 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/misc 2024-09-16T03:11:19.433 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T03:11:19.433 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=b 2024-09-16T03:11:19.433 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T03:11:19.433 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/misc/b 2024-09-16T03:11:19.433 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id b --mkfs --mon-data=td/misc/b --run-dir=td/misc --public-addr 127.0.0.1:7118 2024-09-16T03:11:19.966 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T03:11:19.966 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:11:19.966 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:11:19.967 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:11:19.967 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:11:19.967 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.29106 2024-09-16T03:11:19.967 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.29106/$cluster-$name.asok' 2024-09-16T03:11:19.968 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id b --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/misc/b '--log-file=td/misc/$name.log' '--admin-socket=/tmp/ceph-asok.29106/$cluster-$name.asok' --mon-cluster-log-file=td/misc/log --run-dir=td/misc '--pid-file=td/misc/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr 127.0.0.1:7118 2024-09-16T03:11:20.170 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T03:11:20.171 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon b fsid 2024-09-16T03:11:20.171 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:11:20.171 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=b 2024-09-16T03:11:20.171 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T03:11:20.172 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T03:11:20.172 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.b 2024-09-16T03:11:20.172 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.b 2024-09-16T03:11:20.172 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.b ']' 2024-09-16T03:11:20.172 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:11:20.172 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:11:20.172 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.29106 2024-09-16T03:11:20.173 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.29106/ceph-mon.b.asok 2024-09-16T03:11:20.173 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:11:20.173 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.29106/ceph-mon.b.asok config get fsid 2024-09-16T03:11:20.292 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon b mon_host 2024-09-16T03:11:20.292 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:11:20.292 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=b 2024-09-16T03:11:20.292 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T03:11:20.293 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T03:11:20.293 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.b 2024-09-16T03:11:20.293 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.b 2024-09-16T03:11:20.294 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.b ']' 2024-09-16T03:11:20.294 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:11:20.294 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:11:20.294 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.29106 2024-09-16T03:11:20.294 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.29106/ceph-mon.b.asok 2024-09-16T03:11:20.294 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:11:20.295 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.29106/ceph-mon.b.asok config get mon_host 2024-09-16T03:11:20.409 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:120: TEST_mon_add_to_single_mon: teardown td/misc 2024-09-16T03:11:20.409 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/misc 2024-09-16T03:11:20.409 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:11:20.409 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/misc KILL 2024-09-16T03:11:20.409 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:11:20.409 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:11:20.410 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:11:20.410 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:11:20.410 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:11:20.516 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:11:20.517 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:11:20.517 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:11:20.518 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:11:20.519 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:11:20.519 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:11:20.520 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:11:20.521 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:11:20.521 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:11:20.521 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:11:20.521 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:11:20.522 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:11:20.523 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:11:20.523 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/misc 2024-09-16T03:11:20.525 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:11:20.525 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:11:20.525 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.29106 2024-09-16T03:11:20.526 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.29106 2024-09-16T03:11:20.528 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:11:20.528 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:11:20.528 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:122: TEST_mon_add_to_single_mon: setup td/misc 2024-09-16T03:11:20.528 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/misc 2024-09-16T03:11:20.528 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/misc 2024-09-16T03:11:20.528 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/misc 2024-09-16T03:11:20.528 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:11:20.528 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/misc KILL 2024-09-16T03:11:20.528 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:11:20.528 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:11:20.529 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:11:20.529 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:11:20.529 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:11:20.530 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:11:20.530 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:11:20.531 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:11:20.533 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:11:20.533 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:11:20.533 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:11:20.533 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:11:20.534 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:11:20.534 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:11:20.534 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:11:20.534 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:11:20.535 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:11:20.536 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:11:20.537 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/misc 2024-09-16T03:11:20.538 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:11:20.538 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:11:20.538 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.29106 2024-09-16T03:11:20.538 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.29106 2024-09-16T03:11:20.539 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:11:20.539 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:11:20.539 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/misc 2024-09-16T03:11:20.541 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T03:11:20.541 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:11:20.541 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.29106 2024-09-16T03:11:20.541 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.29106 2024-09-16T03:11:20.542 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T03:11:20.543 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2024-09-16T03:11:20.543 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T03:11:20.544 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/misc 1' TERM HUP INT 2024-09-16T03:11:20.544 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:123: TEST_mon_add_to_single_mon: run_mon td/misc a --public-addr 127.0.0.1:7117 2024-09-16T03:11:20.544 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/misc 2024-09-16T03:11:20.544 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T03:11:20.544 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T03:11:20.544 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T03:11:20.544 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/misc/a 2024-09-16T03:11:20.544 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/misc/a --run-dir=td/misc --public-addr 127.0.0.1:7117 2024-09-16T03:11:21.020 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T03:11:21.021 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:11:21.021 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:11:21.021 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:11:21.021 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:11:21.021 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.29106 2024-09-16T03:11:21.022 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.29106/$cluster-$name.asok' 2024-09-16T03:11:21.022 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/misc/a '--log-file=td/misc/$name.log' '--admin-socket=/tmp/ceph-asok.29106/$cluster-$name.asok' --mon-cluster-log-file=td/misc/log --run-dir=td/misc '--pid-file=td/misc/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr 127.0.0.1:7117 2024-09-16T03:11:21.224 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T03:11:21.224 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T03:11:21.225 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:11:21.225 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:11:21.225 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T03:11:21.226 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T03:11:21.226 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:11:21.226 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:11:21.226 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:11:21.226 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:11:21.226 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:11:21.226 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.29106 2024-09-16T03:11:21.226 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.29106/ceph-mon.a.asok 2024-09-16T03:11:21.227 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:11:21.227 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.29106/ceph-mon.a.asok config get fsid 2024-09-16T03:11:21.345 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T03:11:21.345 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:11:21.345 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:11:21.345 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T03:11:21.346 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T03:11:21.346 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:11:21.346 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:11:21.346 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:11:21.346 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:11:21.347 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:11:21.347 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.29106 2024-09-16T03:11:21.347 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.29106/ceph-mon.a.asok 2024-09-16T03:11:21.347 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:11:21.347 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.29106/ceph-mon.a.asok config get mon_host 2024-09-16T03:11:21.463 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:126: TEST_mon_add_to_single_mon: run_mon td/misc b --public-addr 127.0.0.1:7118 2024-09-16T03:11:21.463 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/misc 2024-09-16T03:11:21.463 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T03:11:21.463 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=b 2024-09-16T03:11:21.464 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T03:11:21.464 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/misc/b 2024-09-16T03:11:21.464 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id b --mkfs --mon-data=td/misc/b --run-dir=td/misc --public-addr 127.0.0.1:7118 2024-09-16T03:11:22.354 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T03:11:22.354 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:11:22.354 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:11:22.355 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:11:22.355 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:11:22.355 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.29106 2024-09-16T03:11:22.355 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.29106/$cluster-$name.asok' 2024-09-16T03:11:22.355 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id b --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/misc/b '--log-file=td/misc/$name.log' '--admin-socket=/tmp/ceph-asok.29106/$cluster-$name.asok' --mon-cluster-log-file=td/misc/log --run-dir=td/misc '--pid-file=td/misc/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr 127.0.0.1:7118 2024-09-16T03:11:22.570 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T03:11:22.571 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon b fsid 2024-09-16T03:11:22.572 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:11:22.572 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=b 2024-09-16T03:11:22.572 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T03:11:22.573 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T03:11:22.573 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.b 2024-09-16T03:11:22.573 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.b 2024-09-16T03:11:22.573 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.b ']' 2024-09-16T03:11:22.573 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:11:22.573 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:11:22.573 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.29106 2024-09-16T03:11:22.573 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.29106/ceph-mon.b.asok 2024-09-16T03:11:22.574 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:11:22.574 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.29106/ceph-mon.b.asok config get fsid 2024-09-16T03:11:22.690 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon b mon_host 2024-09-16T03:11:22.690 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:11:22.691 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=b 2024-09-16T03:11:22.691 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T03:11:22.692 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T03:11:22.692 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.b 2024-09-16T03:11:22.692 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.b 2024-09-16T03:11:22.692 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.b ']' 2024-09-16T03:11:22.692 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:11:22.692 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:11:22.692 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.29106 2024-09-16T03:11:22.692 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.29106/ceph-mon.b.asok 2024-09-16T03:11:22.692 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:11:22.693 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.29106/ceph-mon.b.asok config get mon_host 2024-09-16T03:11:22.804 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:128: TEST_mon_add_to_single_mon: sleep 2 2024-09-16T03:11:24.805 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:130: TEST_mon_add_to_single_mon: timeout 120 ceph -s 2024-09-16T03:11:28.049 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:131: TEST_mon_add_to_single_mon: ceph mon dump 2024-09-16T03:11:28.369 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 2 2024-09-16T03:11:28.369 INFO:tasks.workunit.client.0.smithi096.stdout:fsid b393df8e-f628-4302-9e3d-4220be73bcfa 2024-09-16T03:11:28.369 INFO:tasks.workunit.client.0.smithi096.stdout:last_changed 2024-09-16T03:11:22.570774+0000 2024-09-16T03:11:28.369 INFO:tasks.workunit.client.0.smithi096.stdout:created 2024-09-16T03:11:20.569238+0000 2024-09-16T03:11:28.369 INFO:tasks.workunit.client.0.smithi096.stdout:min_mon_release 19 (squid) 2024-09-16T03:11:28.369 INFO:tasks.workunit.client.0.smithi096.stdout:election_strategy: 1 2024-09-16T03:11:28.369 INFO:tasks.workunit.client.0.smithi096.stdout:0: v2:127.0.0.1:7117/0 mon.a 2024-09-16T03:11:28.369 INFO:tasks.workunit.client.0.smithi096.stdout:1: v2:127.0.0.1:7118/0 mon.b 2024-09-16T03:11:28.370 INFO:tasks.workunit.client.0.smithi096.stderr:dumped monmap epoch 2 2024-09-16T03:11:28.384 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:132: TEST_mon_add_to_single_mon: ceph mon dump -f json-pretty 2024-09-16T03:11:28.610 INFO:tasks.workunit.client.0.smithi096.stdout: 2024-09-16T03:11:28.610 INFO:tasks.workunit.client.0.smithi096.stdout:{ 2024-09-16T03:11:28.610 INFO:tasks.workunit.client.0.smithi096.stdout: "epoch": 2, 2024-09-16T03:11:28.610 INFO:tasks.workunit.client.0.smithi096.stdout: "fsid": "b393df8e-f628-4302-9e3d-4220be73bcfa", 2024-09-16T03:11:28.610 INFO:tasks.workunit.client.0.smithi096.stdout: "modified": "2024-09-16T03:11:22.570774Z", 2024-09-16T03:11:28.610 INFO:tasks.workunit.client.0.smithi096.stdout: "created": "2024-09-16T03:11:20.569238Z", 2024-09-16T03:11:28.610 INFO:tasks.workunit.client.0.smithi096.stdout: "min_mon_release": 19, 2024-09-16T03:11:28.611 INFO:tasks.workunit.client.0.smithi096.stdout: "min_mon_release_name": "squid", 2024-09-16T03:11:28.611 INFO:tasks.workunit.client.0.smithi096.stdout: "election_strategy": 1, 2024-09-16T03:11:28.611 INFO:tasks.workunit.client.0.smithi096.stdout: "disallowed_leaders: ": "", 2024-09-16T03:11:28.611 INFO:tasks.workunit.client.0.smithi096.stdout: "stretch_mode": false, 2024-09-16T03:11:28.611 INFO:tasks.workunit.client.0.smithi096.stdout: "tiebreaker_mon": "", 2024-09-16T03:11:28.611 INFO:tasks.workunit.client.0.smithi096.stdout: "removed_ranks: ": "", 2024-09-16T03:11:28.611 INFO:tasks.workunit.client.0.smithi096.stdout: "features": { 2024-09-16T03:11:28.611 INFO:tasks.workunit.client.0.smithi096.stdout: "persistent": [ 2024-09-16T03:11:28.611 INFO:tasks.workunit.client.0.smithi096.stdout: "kraken", 2024-09-16T03:11:28.611 INFO:tasks.workunit.client.0.smithi096.stdout: "luminous", 2024-09-16T03:11:28.612 INFO:tasks.workunit.client.0.smithi096.stdout: "mimic", 2024-09-16T03:11:28.612 INFO:tasks.workunit.client.0.smithi096.stdout: "osdmap-prune", 2024-09-16T03:11:28.612 INFO:tasks.workunit.client.0.smithi096.stdout: "nautilus", 2024-09-16T03:11:28.612 INFO:tasks.workunit.client.0.smithi096.stdout: "octopus", 2024-09-16T03:11:28.612 INFO:tasks.workunit.client.0.smithi096.stdout: "pacific", 2024-09-16T03:11:28.612 INFO:tasks.workunit.client.0.smithi096.stdout: "elector-pinging", 2024-09-16T03:11:28.612 INFO:tasks.workunit.client.0.smithi096.stdout: "quincy", 2024-09-16T03:11:28.612 INFO:tasks.workunit.client.0.smithi096.stdout: "reef", 2024-09-16T03:11:28.612 INFO:tasks.workunit.client.0.smithi096.stdout: "squid" 2024-09-16T03:11:28.612 INFO:tasks.workunit.client.0.smithi096.stdout: ], 2024-09-16T03:11:28.613 INFO:tasks.workunit.client.0.smithi096.stdout: "optional": [] 2024-09-16T03:11:28.613 INFO:tasks.workunit.client.0.smithi096.stdout: }, 2024-09-16T03:11:28.613 INFO:tasks.workunit.client.0.smithi096.stdout: "mons": [ 2024-09-16T03:11:28.613 INFO:tasks.workunit.client.0.smithi096.stdout: { 2024-09-16T03:11:28.613 INFO:tasks.workunit.client.0.smithi096.stdout: "rank": 0, 2024-09-16T03:11:28.613 INFO:tasks.workunit.client.0.smithi096.stdout: "name": "a", 2024-09-16T03:11:28.613 INFO:tasks.workunit.client.0.smithi096.stdout: "public_addrs": { 2024-09-16T03:11:28.613 INFO:tasks.workunit.client.0.smithi096.stdout: "addrvec": [ 2024-09-16T03:11:28.613 INFO:tasks.workunit.client.0.smithi096.stdout: { 2024-09-16T03:11:28.613 INFO:tasks.workunit.client.0.smithi096.stdout: "type": "v2", 2024-09-16T03:11:28.613 INFO:tasks.workunit.client.0.smithi096.stdout: "addr": "127.0.0.1:7117", 2024-09-16T03:11:28.614 INFO:tasks.workunit.client.0.smithi096.stdout: "nonce": 0 2024-09-16T03:11:28.614 INFO:tasks.workunit.client.0.smithi096.stdout: } 2024-09-16T03:11:28.614 INFO:tasks.workunit.client.0.smithi096.stdout: ] 2024-09-16T03:11:28.614 INFO:tasks.workunit.client.0.smithi096.stdout: }, 2024-09-16T03:11:28.614 INFO:tasks.workunit.client.0.smithi096.stdout: "addr": "127.0.0.1:7117/0", 2024-09-16T03:11:28.615 INFO:tasks.workunit.client.0.smithi096.stdout: "public_addr": "127.0.0.1:7117/0", 2024-09-16T03:11:28.615 INFO:tasks.workunit.client.0.smithi096.stdout: "priority": 0, 2024-09-16T03:11:28.615 INFO:tasks.workunit.client.0.smithi096.stdout: "weight": 0, 2024-09-16T03:11:28.615 INFO:tasks.workunit.client.0.smithi096.stdout: "crush_location": "{}" 2024-09-16T03:11:28.615 INFO:tasks.workunit.client.0.smithi096.stdout: }, 2024-09-16T03:11:28.615 INFO:tasks.workunit.client.0.smithi096.stdout: { 2024-09-16T03:11:28.615 INFO:tasks.workunit.client.0.smithi096.stdout: "rank": 1, 2024-09-16T03:11:28.615 INFO:tasks.workunit.client.0.smithi096.stdout: "name": "b", 2024-09-16T03:11:28.616 INFO:tasks.workunit.client.0.smithi096.stdout: "public_addrs": { 2024-09-16T03:11:28.616 INFO:tasks.workunit.client.0.smithi096.stdout: "addrvec": [ 2024-09-16T03:11:28.616 INFO:tasks.workunit.client.0.smithi096.stdout: { 2024-09-16T03:11:28.616 INFO:tasks.workunit.client.0.smithi096.stdout: "type": "v2", 2024-09-16T03:11:28.616 INFO:tasks.workunit.client.0.smithi096.stdout: "addr": "127.0.0.1:7118", 2024-09-16T03:11:28.616 INFO:tasks.workunit.client.0.smithi096.stdout: "nonce": 0 2024-09-16T03:11:28.616 INFO:tasks.workunit.client.0.smithi096.stdout: } 2024-09-16T03:11:28.616 INFO:tasks.workunit.client.0.smithi096.stdout: ] 2024-09-16T03:11:28.616 INFO:tasks.workunit.client.0.smithi096.stdout: }, 2024-09-16T03:11:28.616 INFO:tasks.workunit.client.0.smithi096.stdout: "addr": "127.0.0.1:7118/0", 2024-09-16T03:11:28.616 INFO:tasks.workunit.client.0.smithi096.stdout: "public_addr": "127.0.0.1:7118/0", 2024-09-16T03:11:28.616 INFO:tasks.workunit.client.0.smithi096.stdout: "priority": 0, 2024-09-16T03:11:28.617 INFO:tasks.workunit.client.0.smithi096.stdout: "weight": 0, 2024-09-16T03:11:28.617 INFO:tasks.workunit.client.0.smithi096.stdout: "crush_location": "{}" 2024-09-16T03:11:28.617 INFO:tasks.workunit.client.0.smithi096.stdout: } 2024-09-16T03:11:28.617 INFO:tasks.workunit.client.0.smithi096.stdout: ], 2024-09-16T03:11:28.617 INFO:tasks.workunit.client.0.smithi096.stdout: "quorum": [ 2024-09-16T03:11:28.617 INFO:tasks.workunit.client.0.smithi096.stdout: 0, 2024-09-16T03:11:28.617 INFO:tasks.workunit.client.0.smithi096.stdout: 1 2024-09-16T03:11:28.617 INFO:tasks.workunit.client.0.smithi096.stdout: ] 2024-09-16T03:11:28.617 INFO:tasks.workunit.client.0.smithi096.stdout:} 2024-09-16T03:11:28.617 INFO:tasks.workunit.client.0.smithi096.stderr:dumped monmap epoch 2 2024-09-16T03:11:28.625 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:133: TEST_mon_add_to_single_mon: local num_mons 2024-09-16T03:11:28.626 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:134: TEST_mon_add_to_single_mon: ceph mon dump --format=json 2024-09-16T03:11:28.626 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:134: TEST_mon_add_to_single_mon: jq '.mons | length' 2024-09-16T03:11:28.914 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:134: TEST_mon_add_to_single_mon: num_mons=2 2024-09-16T03:11:28.915 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:135: TEST_mon_add_to_single_mon: '[' 2 == 2 ']' 2024-09-16T03:11:28.915 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:137: TEST_mon_add_to_single_mon: timeout 120 ceph mon add b 127.0.0.1:7118 2024-09-16T03:11:29.187 INFO:tasks.workunit.client.0.smithi096.stderr:mon.b at v2:127.0.0.1:7118/0 already exists 2024-09-16T03:11:29.203 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:138: TEST_mon_add_to_single_mon: teardown td/misc 2024-09-16T03:11:29.203 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/misc 2024-09-16T03:11:29.203 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:11:29.203 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/misc KILL 2024-09-16T03:11:29.204 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:11:29.204 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:11:29.204 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:11:29.204 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:11:29.204 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:11:29.312 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:11:29.312 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:11:29.314 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:11:29.314 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:11:29.315 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:11:29.315 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:11:29.316 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:11:29.317 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:11:29.317 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:11:29.317 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:11:29.317 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:11:29.318 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:11:29.319 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:11:29.319 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/misc 2024-09-16T03:11:29.322 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:11:29.322 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:11:29.322 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.29106 2024-09-16T03:11:29.322 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.29106 2024-09-16T03:11:29.324 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:11:29.324 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:11:29.324 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:30: run: for func in $funcs 2024-09-16T03:11:29.324 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:31: run: TEST_mon_features td/misc 2024-09-16T03:11:29.324 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:163: TEST_mon_features: local dir=td/misc 2024-09-16T03:11:29.324 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:164: TEST_mon_features: setup td/misc 2024-09-16T03:11:29.324 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/misc 2024-09-16T03:11:29.324 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/misc 2024-09-16T03:11:29.324 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/misc 2024-09-16T03:11:29.324 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:11:29.324 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/misc KILL 2024-09-16T03:11:29.325 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:11:29.325 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:11:29.325 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:11:29.325 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:11:29.325 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:11:29.326 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:11:29.327 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:11:29.327 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:11:29.327 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:11:29.328 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:11:29.328 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:11:29.329 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:11:29.329 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:11:29.329 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:11:29.330 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:11:29.330 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:11:29.331 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:11:29.332 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:11:29.332 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/misc 2024-09-16T03:11:29.333 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:11:29.333 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:11:29.333 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.29106 2024-09-16T03:11:29.333 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.29106 2024-09-16T03:11:29.334 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:11:29.334 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:11:29.334 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/misc 2024-09-16T03:11:29.335 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T03:11:29.335 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:11:29.335 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.29106 2024-09-16T03:11:29.336 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.29106 2024-09-16T03:11:29.337 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T03:11:29.337 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2024-09-16T03:11:29.337 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T03:11:29.337 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/misc 1' TERM HUP INT 2024-09-16T03:11:29.338 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:166: TEST_mon_features: uuidgen 2024-09-16T03:11:29.339 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:166: TEST_mon_features: fsid=ba261b2e-e65d-4c1c-b667-a6f0dc5b075c 2024-09-16T03:11:29.340 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:167: TEST_mon_features: MONA=127.0.0.1:7127 2024-09-16T03:11:29.340 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:168: TEST_mon_features: MONB=127.0.0.1:7128 2024-09-16T03:11:29.340 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:169: TEST_mon_features: MONC=127.0.0.1:7129 2024-09-16T03:11:29.340 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:170: TEST_mon_features: CEPH_ARGS_orig='--fsid=b393df8e-f628-4302-9e3d-4220be73bcfa --auth-supported=none --mon-initial-members=a --mon-host=127.0.0.1:7117 ' 2024-09-16T03:11:29.340 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:171: TEST_mon_features: CEPH_ARGS='--fsid=ba261b2e-e65d-4c1c-b667-a6f0dc5b075c --auth-supported=none ' 2024-09-16T03:11:29.340 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:172: TEST_mon_features: CEPH_ARGS+='--mon-host=127.0.0.1:7127,127.0.0.1:7128,127.0.0.1:7129 ' 2024-09-16T03:11:29.340 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:173: TEST_mon_features: CEPH_ARGS+='--mon-debug-no-initial-persistent-features ' 2024-09-16T03:11:29.340 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:174: TEST_mon_features: CEPH_ARGS+='--mon-debug-no-require-squid ' 2024-09-16T03:11:29.340 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:176: TEST_mon_features: run_mon td/misc a --public-addr 127.0.0.1:7127 2024-09-16T03:11:29.340 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/misc 2024-09-16T03:11:29.340 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T03:11:29.340 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T03:11:29.340 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T03:11:29.341 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/misc/a 2024-09-16T03:11:29.341 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/misc/a --run-dir=td/misc --public-addr 127.0.0.1:7127 2024-09-16T03:11:29.821 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T03:11:29.822 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:11:29.822 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:11:29.822 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:11:29.822 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:11:29.822 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.29106 2024-09-16T03:11:29.822 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.29106/$cluster-$name.asok' 2024-09-16T03:11:29.822 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/misc/a '--log-file=td/misc/$name.log' '--admin-socket=/tmp/ceph-asok.29106/$cluster-$name.asok' --mon-cluster-log-file=td/misc/log --run-dir=td/misc '--pid-file=td/misc/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr 127.0.0.1:7127 2024-09-16T03:11:30.023 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T03:11:30.024 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T03:11:30.024 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:11:30.024 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:11:30.024 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T03:11:30.025 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T03:11:30.025 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:11:30.025 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:11:30.025 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:11:30.026 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:11:30.026 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:11:30.026 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.29106 2024-09-16T03:11:30.026 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.29106/ceph-mon.a.asok 2024-09-16T03:11:30.026 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:11:30.026 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.29106/ceph-mon.a.asok config get fsid 2024-09-16T03:11:30.141 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T03:11:30.141 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:11:30.141 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:11:30.141 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T03:11:30.142 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:11:30.142 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:11:30.142 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:11:30.142 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T03:11:30.142 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:11:30.142 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:11:30.143 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.29106 2024-09-16T03:11:30.143 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.29106/ceph-mon.a.asok 2024-09-16T03:11:30.143 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:11:30.143 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.29106/ceph-mon.a.asok config get mon_host 2024-09-16T03:11:30.252 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:177: TEST_mon_features: run_mon td/misc b --public-addr 127.0.0.1:7128 2024-09-16T03:11:30.252 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/misc 2024-09-16T03:11:30.252 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T03:11:30.252 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=b 2024-09-16T03:11:30.252 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T03:11:30.252 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/misc/b 2024-09-16T03:11:30.252 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id b --mkfs --mon-data=td/misc/b --run-dir=td/misc --public-addr 127.0.0.1:7128 2024-09-16T03:11:30.716 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T03:11:30.716 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:11:30.716 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:11:30.717 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:11:30.717 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:11:30.717 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.29106 2024-09-16T03:11:30.717 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.29106/$cluster-$name.asok' 2024-09-16T03:11:30.718 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id b --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/misc/b '--log-file=td/misc/$name.log' '--admin-socket=/tmp/ceph-asok.29106/$cluster-$name.asok' --mon-cluster-log-file=td/misc/log --run-dir=td/misc '--pid-file=td/misc/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr 127.0.0.1:7128 2024-09-16T03:11:30.936 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T03:11:30.937 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon b fsid 2024-09-16T03:11:30.937 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:11:30.937 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=b 2024-09-16T03:11:30.937 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T03:11:30.938 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T03:11:30.938 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.b 2024-09-16T03:11:30.939 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.b 2024-09-16T03:11:30.939 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.b ']' 2024-09-16T03:11:30.939 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:11:30.939 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:11:30.939 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.29106 2024-09-16T03:11:30.939 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.29106/ceph-mon.b.asok 2024-09-16T03:11:30.939 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:11:30.939 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.29106/ceph-mon.b.asok config get fsid 2024-09-16T03:11:31.055 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon b mon_host 2024-09-16T03:11:31.055 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:11:31.055 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=b 2024-09-16T03:11:31.055 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T03:11:31.055 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T03:11:31.056 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.b 2024-09-16T03:11:31.056 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.b 2024-09-16T03:11:31.056 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.b ']' 2024-09-16T03:11:31.057 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:11:31.057 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:11:31.057 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.29106 2024-09-16T03:11:31.057 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.29106/ceph-mon.b.asok 2024-09-16T03:11:31.057 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:11:31.057 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.29106/ceph-mon.b.asok config get mon_host 2024-09-16T03:11:31.172 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:178: TEST_mon_features: timeout 120 ceph -s 2024-09-16T03:11:43.414 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:181: TEST_mon_features: ceph quorum_status --format=json 2024-09-16T03:11:43.717 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:181: TEST_mon_features: jqinput=' 2024-09-16T03:11:43.717 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:11:29.365018Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:11:43.718 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:182: TEST_mon_features: jq_success ' 2024-09-16T03:11:43.718 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:11:29.365018Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' '.monmap.mons | length == 3' 2024-09-16T03:11:43.718 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: jq_success: input=' 2024-09-16T03:11:43.718 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:11:29.365018Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:11:43.718 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: jq_success: filter='.monmap.mons | length == 3' 2024-09-16T03:11:43.718 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2374: jq_success: expects='""' 2024-09-16T03:11:43.719 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: printf %s ' 2024-09-16T03:11:43.719 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:11:29.365018Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:11:43.719 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-16T03:11:43.720 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: in_escaped=' 2024-09-16T03:11:43.720 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:11:29.365018Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:11:43.721 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: printf %s '.monmap.mons | length == 3' 2024-09-16T03:11:43.721 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-16T03:11:43.722 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: filter_escaped='.monmap.mons | length == 3' 2024-09-16T03:11:43.723 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: echo ' 2024-09-16T03:11:43.723 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:11:29.365018Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:11:43.723 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: jq '.monmap.mons | length == 3' 2024-09-16T03:11:43.757 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: ret=true 2024-09-16T03:11:43.757 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2380: jq_success: [[ true == \t\r\u\e ]] 2024-09-16T03:11:43.757 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2381: jq_success: return 0 2024-09-16T03:11:43.758 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:184: TEST_mon_features: jq_success ' 2024-09-16T03:11:43.758 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:11:29.365018Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' '.quorum | length == 2' 2024-09-16T03:11:43.758 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: jq_success: input=' 2024-09-16T03:11:43.758 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:11:29.365018Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:11:43.758 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: jq_success: filter='.quorum | length == 2' 2024-09-16T03:11:43.758 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2374: jq_success: expects='""' 2024-09-16T03:11:43.758 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-16T03:11:43.758 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: printf %s ' 2024-09-16T03:11:43.758 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:11:29.365018Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:11:43.759 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: in_escaped=' 2024-09-16T03:11:43.759 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:11:29.365018Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:11:43.759 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: printf %s '.quorum | length == 2' 2024-09-16T03:11:43.759 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-16T03:11:43.761 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: filter_escaped='.quorum | length == 2' 2024-09-16T03:11:43.761 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: echo ' 2024-09-16T03:11:43.761 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:11:29.365018Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:11:43.762 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: jq '.quorum | length == 2' 2024-09-16T03:11:43.801 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: ret=true 2024-09-16T03:11:43.802 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2380: jq_success: [[ true == \t\r\u\e ]] 2024-09-16T03:11:43.802 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2381: jq_success: return 0 2024-09-16T03:11:43.802 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:187: TEST_mon_features: jqfilter='.features.quorum_mon[]|select(. == "kraken")' 2024-09-16T03:11:43.802 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:188: TEST_mon_features: jq_success ' 2024-09-16T03:11:43.802 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:11:29.365018Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' '.features.quorum_mon[]|select(. == "kraken")' kraken 2024-09-16T03:11:43.802 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: jq_success: input=' 2024-09-16T03:11:43.802 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:11:29.365018Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:11:43.802 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: jq_success: filter='.features.quorum_mon[]|select(. == "kraken")' 2024-09-16T03:11:43.802 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2374: jq_success: expects='"kraken"' 2024-09-16T03:11:43.802 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: printf %s ' 2024-09-16T03:11:43.802 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:11:29.365018Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:11:43.802 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-16T03:11:43.803 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: in_escaped=' 2024-09-16T03:11:43.803 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:11:29.365018Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:11:43.803 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: printf %s '.features.quorum_mon[]|select(. == "kraken")' 2024-09-16T03:11:43.804 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-16T03:11:43.805 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: filter_escaped='.features.quorum_mon[]|select(. == "kraken")' 2024-09-16T03:11:43.806 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: echo ' 2024-09-16T03:11:43.806 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:11:29.365018Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:11:43.806 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: jq '.features.quorum_mon[]|select(. == "kraken")' 2024-09-16T03:11:43.843 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: ret='"kraken"' 2024-09-16T03:11:43.843 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2380: jq_success: [[ "kraken" == \t\r\u\e ]] 2024-09-16T03:11:43.843 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2382: jq_success: [[ -n "kraken" ]] 2024-09-16T03:11:43.843 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2383: jq_success: [[ "kraken" == \"\k\r\a\k\e\n\" ]] 2024-09-16T03:11:43.843 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2384: jq_success: return 0 2024-09-16T03:11:43.844 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:189: TEST_mon_features: jqfilter='.features.quorum_mon[]|select(. == "luminous")' 2024-09-16T03:11:43.844 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:190: TEST_mon_features: jq_success ' 2024-09-16T03:11:43.844 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:11:29.365018Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' '.features.quorum_mon[]|select(. == "luminous")' luminous 2024-09-16T03:11:43.844 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: jq_success: input=' 2024-09-16T03:11:43.844 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:11:29.365018Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:11:43.844 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: jq_success: filter='.features.quorum_mon[]|select(. == "luminous")' 2024-09-16T03:11:43.844 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2374: jq_success: expects='"luminous"' 2024-09-16T03:11:43.844 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: printf %s ' 2024-09-16T03:11:43.844 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:11:29.365018Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:11:43.844 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-16T03:11:43.845 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: in_escaped=' 2024-09-16T03:11:43.845 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:11:29.365018Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:11:43.845 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: printf %s '.features.quorum_mon[]|select(. == "luminous")' 2024-09-16T03:11:43.845 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-16T03:11:43.846 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: filter_escaped='.features.quorum_mon[]|select(. == "luminous")' 2024-09-16T03:11:43.847 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: echo ' 2024-09-16T03:11:43.847 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:11:29.365018Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:11:43.847 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: jq '.features.quorum_mon[]|select(. == "luminous")' 2024-09-16T03:11:43.878 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: ret='"luminous"' 2024-09-16T03:11:43.878 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2380: jq_success: [[ "luminous" == \t\r\u\e ]] 2024-09-16T03:11:43.878 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2382: jq_success: [[ -n "luminous" ]] 2024-09-16T03:11:43.878 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2383: jq_success: [[ "luminous" == \"\l\u\m\i\n\o\u\s\" ]] 2024-09-16T03:11:43.878 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2384: jq_success: return 0 2024-09-16T03:11:43.878 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:191: TEST_mon_features: jqfilter='.features.quorum_mon[]|select(. == "mimic")' 2024-09-16T03:11:43.879 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:192: TEST_mon_features: jq_success ' 2024-09-16T03:11:43.879 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:11:29.365018Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' '.features.quorum_mon[]|select(. == "mimic")' mimic 2024-09-16T03:11:43.879 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: jq_success: input=' 2024-09-16T03:11:43.879 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:11:29.365018Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:11:43.879 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: jq_success: filter='.features.quorum_mon[]|select(. == "mimic")' 2024-09-16T03:11:43.879 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2374: jq_success: expects='"mimic"' 2024-09-16T03:11:43.879 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: printf %s ' 2024-09-16T03:11:43.879 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:11:29.365018Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:11:43.879 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-16T03:11:43.880 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: in_escaped=' 2024-09-16T03:11:43.880 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:11:29.365018Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:11:43.880 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: printf %s '.features.quorum_mon[]|select(. == "mimic")' 2024-09-16T03:11:43.880 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-16T03:11:43.881 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: filter_escaped='.features.quorum_mon[]|select(. == "mimic")' 2024-09-16T03:11:43.882 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: echo ' 2024-09-16T03:11:43.882 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:11:29.365018Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:11:43.882 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: jq '.features.quorum_mon[]|select(. == "mimic")' 2024-09-16T03:11:43.913 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: ret='"mimic"' 2024-09-16T03:11:43.913 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2380: jq_success: [[ "mimic" == \t\r\u\e ]] 2024-09-16T03:11:43.914 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2382: jq_success: [[ -n "mimic" ]] 2024-09-16T03:11:43.914 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2383: jq_success: [[ "mimic" == \"\m\i\m\i\c\" ]] 2024-09-16T03:11:43.914 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2384: jq_success: return 0 2024-09-16T03:11:43.914 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:193: TEST_mon_features: jqfilter='.features.quorum_mon[]|select(. == "nautilus")' 2024-09-16T03:11:43.914 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:194: TEST_mon_features: jq_success ' 2024-09-16T03:11:43.914 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:11:29.365018Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' '.features.quorum_mon[]|select(. == "nautilus")' nautilus 2024-09-16T03:11:43.914 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: jq_success: input=' 2024-09-16T03:11:43.914 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:11:29.365018Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:11:43.914 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: jq_success: filter='.features.quorum_mon[]|select(. == "nautilus")' 2024-09-16T03:11:43.914 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2374: jq_success: expects='"nautilus"' 2024-09-16T03:11:43.914 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: printf %s ' 2024-09-16T03:11:43.914 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:11:29.365018Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:11:43.914 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-16T03:11:43.915 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: in_escaped=' 2024-09-16T03:11:43.915 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:11:29.365018Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:11:43.915 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: printf %s '.features.quorum_mon[]|select(. == "nautilus")' 2024-09-16T03:11:43.915 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-16T03:11:43.917 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: filter_escaped='.features.quorum_mon[]|select(. == "nautilus")' 2024-09-16T03:11:43.917 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: echo ' 2024-09-16T03:11:43.918 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:11:29.365018Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:11:43.918 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: jq '.features.quorum_mon[]|select(. == "nautilus")' 2024-09-16T03:11:43.951 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: ret='"nautilus"' 2024-09-16T03:11:43.951 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2380: jq_success: [[ "nautilus" == \t\r\u\e ]] 2024-09-16T03:11:43.951 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2382: jq_success: [[ -n "nautilus" ]] 2024-09-16T03:11:43.951 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2383: jq_success: [[ "nautilus" == \"\n\a\u\t\i\l\u\s\" ]] 2024-09-16T03:11:43.951 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2384: jq_success: return 0 2024-09-16T03:11:43.951 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:195: TEST_mon_features: jqfilter='.features.quorum_mon[]|select(. == "octopus")' 2024-09-16T03:11:43.951 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:196: TEST_mon_features: jq_success ' 2024-09-16T03:11:43.951 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:11:29.365018Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' '.features.quorum_mon[]|select(. == "octopus")' octopus 2024-09-16T03:11:43.951 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: jq_success: input=' 2024-09-16T03:11:43.951 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:11:29.365018Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:11:43.952 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: jq_success: filter='.features.quorum_mon[]|select(. == "octopus")' 2024-09-16T03:11:43.952 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2374: jq_success: expects='"octopus"' 2024-09-16T03:11:43.952 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: printf %s ' 2024-09-16T03:11:43.952 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:11:29.365018Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:11:43.952 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-16T03:11:43.953 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: in_escaped=' 2024-09-16T03:11:43.953 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:11:29.365018Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:11:43.953 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: printf %s '.features.quorum_mon[]|select(. == "octopus")' 2024-09-16T03:11:43.953 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-16T03:11:43.954 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: filter_escaped='.features.quorum_mon[]|select(. == "octopus")' 2024-09-16T03:11:43.954 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: echo ' 2024-09-16T03:11:43.955 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:11:29.365018Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:11:43.955 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: jq '.features.quorum_mon[]|select(. == "octopus")' 2024-09-16T03:11:43.989 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: ret='"octopus"' 2024-09-16T03:11:43.989 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2380: jq_success: [[ "octopus" == \t\r\u\e ]] 2024-09-16T03:11:43.989 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2382: jq_success: [[ -n "octopus" ]] 2024-09-16T03:11:43.989 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2383: jq_success: [[ "octopus" == \"\o\c\t\o\p\u\s\" ]] 2024-09-16T03:11:43.989 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2384: jq_success: return 0 2024-09-16T03:11:43.989 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:197: TEST_mon_features: jqfilter='.features.quorum_mon[]|select(. == "pacific")' 2024-09-16T03:11:43.989 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:198: TEST_mon_features: jq_success ' 2024-09-16T03:11:43.989 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:11:29.365018Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' '.features.quorum_mon[]|select(. == "pacific")' pacific 2024-09-16T03:11:43.989 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: jq_success: input=' 2024-09-16T03:11:43.989 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:11:29.365018Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:11:43.989 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: jq_success: filter='.features.quorum_mon[]|select(. == "pacific")' 2024-09-16T03:11:43.990 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2374: jq_success: expects='"pacific"' 2024-09-16T03:11:43.990 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: printf %s ' 2024-09-16T03:11:43.990 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:11:29.365018Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:11:43.990 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-16T03:11:43.990 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: in_escaped=' 2024-09-16T03:11:43.990 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:11:29.365018Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:11:43.991 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: printf %s '.features.quorum_mon[]|select(. == "pacific")' 2024-09-16T03:11:43.991 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-16T03:11:43.991 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: filter_escaped='.features.quorum_mon[]|select(. == "pacific")' 2024-09-16T03:11:43.993 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: echo ' 2024-09-16T03:11:43.993 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:11:29.365018Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:11:43.993 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: jq '.features.quorum_mon[]|select(. == "pacific")' 2024-09-16T03:11:44.023 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: ret='"pacific"' 2024-09-16T03:11:44.023 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2380: jq_success: [[ "pacific" == \t\r\u\e ]] 2024-09-16T03:11:44.023 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2382: jq_success: [[ -n "pacific" ]] 2024-09-16T03:11:44.024 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2383: jq_success: [[ "pacific" == \"\p\a\c\i\f\i\c\" ]] 2024-09-16T03:11:44.024 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2384: jq_success: return 0 2024-09-16T03:11:44.024 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:199: TEST_mon_features: jqfilter='.features.quorum_mon[]|select(. == "quincy")' 2024-09-16T03:11:44.024 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:200: TEST_mon_features: jq_success ' 2024-09-16T03:11:44.024 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:11:29.365018Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' '.features.quorum_mon[]|select(. == "quincy")' quincy 2024-09-16T03:11:44.024 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: jq_success: input=' 2024-09-16T03:11:44.024 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:11:29.365018Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:11:44.024 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: jq_success: filter='.features.quorum_mon[]|select(. == "quincy")' 2024-09-16T03:11:44.024 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2374: jq_success: expects='"quincy"' 2024-09-16T03:11:44.024 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: printf %s ' 2024-09-16T03:11:44.024 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:11:29.365018Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:11:44.024 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-16T03:11:44.025 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: in_escaped=' 2024-09-16T03:11:44.025 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:11:29.365018Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:11:44.025 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: printf %s '.features.quorum_mon[]|select(. == "quincy")' 2024-09-16T03:11:44.025 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-16T03:11:44.027 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: filter_escaped='.features.quorum_mon[]|select(. == "quincy")' 2024-09-16T03:11:44.027 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: echo ' 2024-09-16T03:11:44.027 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:11:29.365018Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:11:44.028 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: jq '.features.quorum_mon[]|select(. == "quincy")' 2024-09-16T03:11:44.059 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: ret='"quincy"' 2024-09-16T03:11:44.059 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2380: jq_success: [[ "quincy" == \t\r\u\e ]] 2024-09-16T03:11:44.059 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2382: jq_success: [[ -n "quincy" ]] 2024-09-16T03:11:44.060 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2383: jq_success: [[ "quincy" == \"\q\u\i\n\c\y\" ]] 2024-09-16T03:11:44.060 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2384: jq_success: return 0 2024-09-16T03:11:44.060 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:201: TEST_mon_features: jqfilter='.features.quorum_mon[]|select(. == "reef")' 2024-09-16T03:11:44.060 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:202: TEST_mon_features: jq_success ' 2024-09-16T03:11:44.060 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:11:29.365018Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' '.features.quorum_mon[]|select(. == "reef")' reef 2024-09-16T03:11:44.060 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: jq_success: input=' 2024-09-16T03:11:44.060 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:11:29.365018Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:11:44.060 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: jq_success: filter='.features.quorum_mon[]|select(. == "reef")' 2024-09-16T03:11:44.060 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2374: jq_success: expects='"reef"' 2024-09-16T03:11:44.060 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: printf %s ' 2024-09-16T03:11:44.060 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:11:29.365018Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:11:44.060 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-16T03:11:44.061 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: in_escaped=' 2024-09-16T03:11:44.061 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:11:29.365018Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:11:44.061 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: printf %s '.features.quorum_mon[]|select(. == "reef")' 2024-09-16T03:11:44.061 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-16T03:11:44.062 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: filter_escaped='.features.quorum_mon[]|select(. == "reef")' 2024-09-16T03:11:44.063 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: echo ' 2024-09-16T03:11:44.063 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:11:29.365018Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:11:44.063 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: jq '.features.quorum_mon[]|select(. == "reef")' 2024-09-16T03:11:44.099 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: ret='"reef"' 2024-09-16T03:11:44.099 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2380: jq_success: [[ "reef" == \t\r\u\e ]] 2024-09-16T03:11:44.099 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2382: jq_success: [[ -n "reef" ]] 2024-09-16T03:11:44.099 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2383: jq_success: [[ "reef" == \"\r\e\e\f\" ]] 2024-09-16T03:11:44.099 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2384: jq_success: return 0 2024-09-16T03:11:44.100 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:203: TEST_mon_features: jqfilter='.features.quorum_mon[]|select(. == "squid")' 2024-09-16T03:11:44.100 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:204: TEST_mon_features: jq_success ' 2024-09-16T03:11:44.100 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:11:29.365018Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' '.features.quorum_mon[]|select(. == "squid")' squid 2024-09-16T03:11:44.100 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: jq_success: input=' 2024-09-16T03:11:44.100 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:11:29.365018Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:11:44.100 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: jq_success: filter='.features.quorum_mon[]|select(. == "squid")' 2024-09-16T03:11:44.100 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2374: jq_success: expects='"squid"' 2024-09-16T03:11:44.100 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: printf %s ' 2024-09-16T03:11:44.101 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:11:29.365018Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:11:44.101 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-16T03:11:44.101 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: in_escaped=' 2024-09-16T03:11:44.102 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:11:29.365018Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:11:44.102 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: printf %s '.features.quorum_mon[]|select(. == "squid")' 2024-09-16T03:11:44.102 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-16T03:11:44.102 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: filter_escaped='.features.quorum_mon[]|select(. == "squid")' 2024-09-16T03:11:44.102 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: echo ' 2024-09-16T03:11:44.103 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:11:29.365018Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:11:44.103 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: jq '.features.quorum_mon[]|select(. == "squid")' 2024-09-16T03:11:44.142 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: ret='"squid"' 2024-09-16T03:11:44.142 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2380: jq_success: [[ "squid" == \t\r\u\e ]] 2024-09-16T03:11:44.142 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2382: jq_success: [[ -n "squid" ]] 2024-09-16T03:11:44.142 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2383: jq_success: [[ "squid" == \"\s\q\u\i\d\" ]] 2024-09-16T03:11:44.143 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2384: jq_success: return 0 2024-09-16T03:11:44.143 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:209: TEST_mon_features: jqfilter='.monmap.features.persistent | length == 0' 2024-09-16T03:11:44.143 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:210: TEST_mon_features: jq_success ' 2024-09-16T03:11:44.143 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:11:29.365018Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' '.monmap.features.persistent | length == 0' 2024-09-16T03:11:44.143 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: jq_success: input=' 2024-09-16T03:11:44.143 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:11:29.365018Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:11:44.143 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: jq_success: filter='.monmap.features.persistent | length == 0' 2024-09-16T03:11:44.143 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2374: jq_success: expects='""' 2024-09-16T03:11:44.143 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: printf %s ' 2024-09-16T03:11:44.143 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:11:29.365018Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:11:44.143 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-16T03:11:44.144 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: in_escaped=' 2024-09-16T03:11:44.144 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:11:29.365018Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:11:44.144 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: printf %s '.monmap.features.persistent | length == 0' 2024-09-16T03:11:44.144 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-16T03:11:44.145 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: filter_escaped='.monmap.features.persistent | length == 0' 2024-09-16T03:11:44.146 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: echo ' 2024-09-16T03:11:44.146 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:11:29.365018Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:11:44.146 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: jq '.monmap.features.persistent | length == 0' 2024-09-16T03:11:44.180 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: ret=true 2024-09-16T03:11:44.180 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2380: jq_success: [[ true == \t\r\u\e ]] 2024-09-16T03:11:44.180 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2381: jq_success: return 0 2024-09-16T03:11:44.180 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:213: TEST_mon_features: jqfilter='.monmap.features.optional | length == 0' 2024-09-16T03:11:44.180 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:214: TEST_mon_features: jq_success ' 2024-09-16T03:11:44.180 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:11:29.365018Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' '.monmap.features.optional | length == 0' 2024-09-16T03:11:44.180 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: jq_success: input=' 2024-09-16T03:11:44.180 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:11:29.365018Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:11:44.180 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: jq_success: filter='.monmap.features.optional | length == 0' 2024-09-16T03:11:44.180 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2374: jq_success: expects='""' 2024-09-16T03:11:44.180 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: printf %s ' 2024-09-16T03:11:44.181 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:11:29.365018Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:11:44.181 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-16T03:11:44.181 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: in_escaped=' 2024-09-16T03:11:44.181 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:11:29.365018Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:11:44.182 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: printf %s '.monmap.features.optional | length == 0' 2024-09-16T03:11:44.182 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-16T03:11:44.183 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: filter_escaped='.monmap.features.optional | length == 0' 2024-09-16T03:11:44.184 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: echo ' 2024-09-16T03:11:44.184 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:11:29.365018Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:11:44.184 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: jq '.monmap.features.optional | length == 0' 2024-09-16T03:11:44.216 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: ret=true 2024-09-16T03:11:44.216 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2380: jq_success: [[ true == \t\r\u\e ]] 2024-09-16T03:11:44.216 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2381: jq_success: return 0 2024-09-16T03:11:44.217 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:218: TEST_mon_features: ceph mon feature ls --format=json 2024-09-16T03:11:47.462 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:218: TEST_mon_features: jqinput=' 2024-09-16T03:11:47.462 INFO:tasks.workunit.client.0.smithi096.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' 2024-09-16T03:11:47.462 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:220: TEST_mon_features: jqfilter='.all.supported[] | select(. == "kraken")' 2024-09-16T03:11:47.463 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:221: TEST_mon_features: jq_success ' 2024-09-16T03:11:47.463 INFO:tasks.workunit.client.0.smithi096.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' '.all.supported[] | select(. == "kraken")' kraken 2024-09-16T03:11:47.463 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: jq_success: input=' 2024-09-16T03:11:47.463 INFO:tasks.workunit.client.0.smithi096.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' 2024-09-16T03:11:47.463 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: jq_success: filter='.all.supported[] | select(. == "kraken")' 2024-09-16T03:11:47.463 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2374: jq_success: expects='"kraken"' 2024-09-16T03:11:47.463 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: printf %s ' 2024-09-16T03:11:47.463 INFO:tasks.workunit.client.0.smithi096.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' 2024-09-16T03:11:47.464 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-16T03:11:47.464 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: in_escaped=' 2024-09-16T03:11:47.464 INFO:tasks.workunit.client.0.smithi096.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' 2024-09-16T03:11:47.465 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-16T03:11:47.465 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: printf %s '.all.supported[] | select(. == "kraken")' 2024-09-16T03:11:47.466 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: filter_escaped='.all.supported[] | select(. == "kraken")' 2024-09-16T03:11:47.467 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: echo ' 2024-09-16T03:11:47.467 INFO:tasks.workunit.client.0.smithi096.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' 2024-09-16T03:11:47.467 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: jq '.all.supported[] | select(. == "kraken")' 2024-09-16T03:11:47.502 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: ret='"kraken"' 2024-09-16T03:11:47.502 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2380: jq_success: [[ "kraken" == \t\r\u\e ]] 2024-09-16T03:11:47.502 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2382: jq_success: [[ -n "kraken" ]] 2024-09-16T03:11:47.502 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2383: jq_success: [[ "kraken" == \"\k\r\a\k\e\n\" ]] 2024-09-16T03:11:47.503 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2384: jq_success: return 0 2024-09-16T03:11:47.503 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:222: TEST_mon_features: jqfilter='.all.supported[] | select(. == "luminous")' 2024-09-16T03:11:47.503 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:223: TEST_mon_features: jq_success ' 2024-09-16T03:11:47.503 INFO:tasks.workunit.client.0.smithi096.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' '.all.supported[] | select(. == "luminous")' luminous 2024-09-16T03:11:47.503 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: jq_success: input=' 2024-09-16T03:11:47.503 INFO:tasks.workunit.client.0.smithi096.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' 2024-09-16T03:11:47.503 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: jq_success: filter='.all.supported[] | select(. == "luminous")' 2024-09-16T03:11:47.503 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2374: jq_success: expects='"luminous"' 2024-09-16T03:11:47.503 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: printf %s ' 2024-09-16T03:11:47.503 INFO:tasks.workunit.client.0.smithi096.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' 2024-09-16T03:11:47.503 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-16T03:11:47.504 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: in_escaped=' 2024-09-16T03:11:47.504 INFO:tasks.workunit.client.0.smithi096.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' 2024-09-16T03:11:47.504 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: printf %s '.all.supported[] | select(. == "luminous")' 2024-09-16T03:11:47.504 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-16T03:11:47.505 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: filter_escaped='.all.supported[] | select(. == "luminous")' 2024-09-16T03:11:47.506 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: echo ' 2024-09-16T03:11:47.506 INFO:tasks.workunit.client.0.smithi096.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' 2024-09-16T03:11:47.506 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: jq '.all.supported[] | select(. == "luminous")' 2024-09-16T03:11:47.541 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: ret='"luminous"' 2024-09-16T03:11:47.542 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2380: jq_success: [[ "luminous" == \t\r\u\e ]] 2024-09-16T03:11:47.542 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2382: jq_success: [[ -n "luminous" ]] 2024-09-16T03:11:47.542 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2383: jq_success: [[ "luminous" == \"\l\u\m\i\n\o\u\s\" ]] 2024-09-16T03:11:47.542 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2384: jq_success: return 0 2024-09-16T03:11:47.542 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:224: TEST_mon_features: jqfilter='.all.supported[] | select(. == "mimic")' 2024-09-16T03:11:47.542 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:225: TEST_mon_features: jq_success ' 2024-09-16T03:11:47.542 INFO:tasks.workunit.client.0.smithi096.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' '.all.supported[] | select(. == "mimic")' mimic 2024-09-16T03:11:47.542 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: jq_success: input=' 2024-09-16T03:11:47.542 INFO:tasks.workunit.client.0.smithi096.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' 2024-09-16T03:11:47.542 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: jq_success: filter='.all.supported[] | select(. == "mimic")' 2024-09-16T03:11:47.542 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2374: jq_success: expects='"mimic"' 2024-09-16T03:11:47.543 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: printf %s ' 2024-09-16T03:11:47.543 INFO:tasks.workunit.client.0.smithi096.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' 2024-09-16T03:11:47.543 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-16T03:11:47.543 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: in_escaped=' 2024-09-16T03:11:47.543 INFO:tasks.workunit.client.0.smithi096.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' 2024-09-16T03:11:47.544 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: printf %s '.all.supported[] | select(. == "mimic")' 2024-09-16T03:11:47.544 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-16T03:11:47.545 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: filter_escaped='.all.supported[] | select(. == "mimic")' 2024-09-16T03:11:47.545 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: echo ' 2024-09-16T03:11:47.545 INFO:tasks.workunit.client.0.smithi096.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' 2024-09-16T03:11:47.545 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: jq '.all.supported[] | select(. == "mimic")' 2024-09-16T03:11:47.577 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: ret='"mimic"' 2024-09-16T03:11:47.577 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2380: jq_success: [[ "mimic" == \t\r\u\e ]] 2024-09-16T03:11:47.578 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2382: jq_success: [[ -n "mimic" ]] 2024-09-16T03:11:47.578 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2383: jq_success: [[ "mimic" == \"\m\i\m\i\c\" ]] 2024-09-16T03:11:47.578 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2384: jq_success: return 0 2024-09-16T03:11:47.578 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:226: TEST_mon_features: jqfilter='.all.supported[] | select(. == "nautilus")' 2024-09-16T03:11:47.578 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:227: TEST_mon_features: jq_success ' 2024-09-16T03:11:47.578 INFO:tasks.workunit.client.0.smithi096.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' '.all.supported[] | select(. == "nautilus")' nautilus 2024-09-16T03:11:47.578 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: jq_success: input=' 2024-09-16T03:11:47.579 INFO:tasks.workunit.client.0.smithi096.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' 2024-09-16T03:11:47.579 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: jq_success: filter='.all.supported[] | select(. == "nautilus")' 2024-09-16T03:11:47.579 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2374: jq_success: expects='"nautilus"' 2024-09-16T03:11:47.579 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: printf %s ' 2024-09-16T03:11:47.579 INFO:tasks.workunit.client.0.smithi096.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' 2024-09-16T03:11:47.579 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-16T03:11:47.579 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: in_escaped=' 2024-09-16T03:11:47.579 INFO:tasks.workunit.client.0.smithi096.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' 2024-09-16T03:11:47.580 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: printf %s '.all.supported[] | select(. == "nautilus")' 2024-09-16T03:11:47.580 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-16T03:11:47.580 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: filter_escaped='.all.supported[] | select(. == "nautilus")' 2024-09-16T03:11:47.580 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: echo ' 2024-09-16T03:11:47.580 INFO:tasks.workunit.client.0.smithi096.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' 2024-09-16T03:11:47.580 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: jq '.all.supported[] | select(. == "nautilus")' 2024-09-16T03:11:47.617 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: ret='"nautilus"' 2024-09-16T03:11:47.617 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2380: jq_success: [[ "nautilus" == \t\r\u\e ]] 2024-09-16T03:11:47.618 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2382: jq_success: [[ -n "nautilus" ]] 2024-09-16T03:11:47.618 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2383: jq_success: [[ "nautilus" == \"\n\a\u\t\i\l\u\s\" ]] 2024-09-16T03:11:47.618 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2384: jq_success: return 0 2024-09-16T03:11:47.618 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:228: TEST_mon_features: jqfilter='.all.supported[] | select(. == "octopus")' 2024-09-16T03:11:47.618 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:229: TEST_mon_features: jq_success ' 2024-09-16T03:11:47.618 INFO:tasks.workunit.client.0.smithi096.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' '.all.supported[] | select(. == "octopus")' octopus 2024-09-16T03:11:47.618 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: jq_success: input=' 2024-09-16T03:11:47.618 INFO:tasks.workunit.client.0.smithi096.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' 2024-09-16T03:11:47.618 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: jq_success: filter='.all.supported[] | select(. == "octopus")' 2024-09-16T03:11:47.618 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2374: jq_success: expects='"octopus"' 2024-09-16T03:11:47.618 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: printf %s ' 2024-09-16T03:11:47.618 INFO:tasks.workunit.client.0.smithi096.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' 2024-09-16T03:11:47.618 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-16T03:11:47.619 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: in_escaped=' 2024-09-16T03:11:47.619 INFO:tasks.workunit.client.0.smithi096.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' 2024-09-16T03:11:47.619 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: printf %s '.all.supported[] | select(. == "octopus")' 2024-09-16T03:11:47.619 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-16T03:11:47.620 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: filter_escaped='.all.supported[] | select(. == "octopus")' 2024-09-16T03:11:47.621 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: echo ' 2024-09-16T03:11:47.621 INFO:tasks.workunit.client.0.smithi096.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' 2024-09-16T03:11:47.621 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: jq '.all.supported[] | select(. == "octopus")' 2024-09-16T03:11:47.651 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: ret='"octopus"' 2024-09-16T03:11:47.652 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2380: jq_success: [[ "octopus" == \t\r\u\e ]] 2024-09-16T03:11:47.652 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2382: jq_success: [[ -n "octopus" ]] 2024-09-16T03:11:47.652 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2383: jq_success: [[ "octopus" == \"\o\c\t\o\p\u\s\" ]] 2024-09-16T03:11:47.652 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2384: jq_success: return 0 2024-09-16T03:11:47.652 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:230: TEST_mon_features: jqfilter='.all.supported[] | select(. == "pacific")' 2024-09-16T03:11:47.652 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:231: TEST_mon_features: jq_success ' 2024-09-16T03:11:47.652 INFO:tasks.workunit.client.0.smithi096.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' '.all.supported[] | select(. == "pacific")' pacific 2024-09-16T03:11:47.652 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: jq_success: input=' 2024-09-16T03:11:47.652 INFO:tasks.workunit.client.0.smithi096.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' 2024-09-16T03:11:47.652 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: jq_success: filter='.all.supported[] | select(. == "pacific")' 2024-09-16T03:11:47.652 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2374: jq_success: expects='"pacific"' 2024-09-16T03:11:47.653 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: printf %s ' 2024-09-16T03:11:47.653 INFO:tasks.workunit.client.0.smithi096.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' 2024-09-16T03:11:47.653 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-16T03:11:47.654 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: in_escaped=' 2024-09-16T03:11:47.654 INFO:tasks.workunit.client.0.smithi096.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' 2024-09-16T03:11:47.654 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: printf %s '.all.supported[] | select(. == "pacific")' 2024-09-16T03:11:47.654 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-16T03:11:47.655 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: filter_escaped='.all.supported[] | select(. == "pacific")' 2024-09-16T03:11:47.655 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: echo ' 2024-09-16T03:11:47.655 INFO:tasks.workunit.client.0.smithi096.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' 2024-09-16T03:11:47.655 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: jq '.all.supported[] | select(. == "pacific")' 2024-09-16T03:11:47.687 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: ret='"pacific"' 2024-09-16T03:11:47.687 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2380: jq_success: [[ "pacific" == \t\r\u\e ]] 2024-09-16T03:11:47.687 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2382: jq_success: [[ -n "pacific" ]] 2024-09-16T03:11:47.687 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2383: jq_success: [[ "pacific" == \"\p\a\c\i\f\i\c\" ]] 2024-09-16T03:11:47.687 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2384: jq_success: return 0 2024-09-16T03:11:47.688 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:232: TEST_mon_features: jqfilter='.all.supported[] | select(. == "quincy")' 2024-09-16T03:11:47.688 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:233: TEST_mon_features: jq_success ' 2024-09-16T03:11:47.688 INFO:tasks.workunit.client.0.smithi096.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' '.all.supported[] | select(. == "quincy")' quincy 2024-09-16T03:11:47.688 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: jq_success: input=' 2024-09-16T03:11:47.688 INFO:tasks.workunit.client.0.smithi096.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' 2024-09-16T03:11:47.689 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: jq_success: filter='.all.supported[] | select(. == "quincy")' 2024-09-16T03:11:47.689 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2374: jq_success: expects='"quincy"' 2024-09-16T03:11:47.689 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-16T03:11:47.689 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: printf %s ' 2024-09-16T03:11:47.689 INFO:tasks.workunit.client.0.smithi096.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' 2024-09-16T03:11:47.689 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: in_escaped=' 2024-09-16T03:11:47.690 INFO:tasks.workunit.client.0.smithi096.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' 2024-09-16T03:11:47.690 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: printf %s '.all.supported[] | select(. == "quincy")' 2024-09-16T03:11:47.691 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-16T03:11:47.691 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: filter_escaped='.all.supported[] | select(. == "quincy")' 2024-09-16T03:11:47.691 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: echo ' 2024-09-16T03:11:47.691 INFO:tasks.workunit.client.0.smithi096.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' 2024-09-16T03:11:47.691 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: jq '.all.supported[] | select(. == "quincy")' 2024-09-16T03:11:47.729 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: ret='"quincy"' 2024-09-16T03:11:47.730 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2380: jq_success: [[ "quincy" == \t\r\u\e ]] 2024-09-16T03:11:47.730 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2382: jq_success: [[ -n "quincy" ]] 2024-09-16T03:11:47.730 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2383: jq_success: [[ "quincy" == \"\q\u\i\n\c\y\" ]] 2024-09-16T03:11:47.730 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2384: jq_success: return 0 2024-09-16T03:11:47.730 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:234: TEST_mon_features: jqfilter='.all.supported[] | select(. == "reef")' 2024-09-16T03:11:47.730 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:235: TEST_mon_features: jq_success ' 2024-09-16T03:11:47.731 INFO:tasks.workunit.client.0.smithi096.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' '.all.supported[] | select(. == "reef")' reef 2024-09-16T03:11:47.731 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: jq_success: input=' 2024-09-16T03:11:47.731 INFO:tasks.workunit.client.0.smithi096.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' 2024-09-16T03:11:47.731 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: jq_success: filter='.all.supported[] | select(. == "reef")' 2024-09-16T03:11:47.731 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2374: jq_success: expects='"reef"' 2024-09-16T03:11:47.732 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: printf %s ' 2024-09-16T03:11:47.732 INFO:tasks.workunit.client.0.smithi096.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' 2024-09-16T03:11:47.732 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-16T03:11:47.732 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: in_escaped=' 2024-09-16T03:11:47.732 INFO:tasks.workunit.client.0.smithi096.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' 2024-09-16T03:11:47.733 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: printf %s '.all.supported[] | select(. == "reef")' 2024-09-16T03:11:47.733 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-16T03:11:47.734 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: filter_escaped='.all.supported[] | select(. == "reef")' 2024-09-16T03:11:47.734 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: echo ' 2024-09-16T03:11:47.734 INFO:tasks.workunit.client.0.smithi096.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' 2024-09-16T03:11:47.734 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: jq '.all.supported[] | select(. == "reef")' 2024-09-16T03:11:47.770 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: ret='"reef"' 2024-09-16T03:11:47.770 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2380: jq_success: [[ "reef" == \t\r\u\e ]] 2024-09-16T03:11:47.770 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2382: jq_success: [[ -n "reef" ]] 2024-09-16T03:11:47.770 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2383: jq_success: [[ "reef" == \"\r\e\e\f\" ]] 2024-09-16T03:11:47.771 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2384: jq_success: return 0 2024-09-16T03:11:47.771 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:236: TEST_mon_features: jqfilter='.all.supported[] | select(. == "squid")' 2024-09-16T03:11:47.771 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:237: TEST_mon_features: jq_success ' 2024-09-16T03:11:47.771 INFO:tasks.workunit.client.0.smithi096.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' '.all.supported[] | select(. == "squid")' squid 2024-09-16T03:11:47.771 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: jq_success: input=' 2024-09-16T03:11:47.771 INFO:tasks.workunit.client.0.smithi096.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' 2024-09-16T03:11:47.771 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: jq_success: filter='.all.supported[] | select(. == "squid")' 2024-09-16T03:11:47.771 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2374: jq_success: expects='"squid"' 2024-09-16T03:11:47.772 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: printf %s ' 2024-09-16T03:11:47.772 INFO:tasks.workunit.client.0.smithi096.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' 2024-09-16T03:11:47.772 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-16T03:11:47.772 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: in_escaped=' 2024-09-16T03:11:47.772 INFO:tasks.workunit.client.0.smithi096.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' 2024-09-16T03:11:47.773 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: printf %s '.all.supported[] | select(. == "squid")' 2024-09-16T03:11:47.773 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-16T03:11:47.774 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: filter_escaped='.all.supported[] | select(. == "squid")' 2024-09-16T03:11:47.775 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: echo ' 2024-09-16T03:11:47.775 INFO:tasks.workunit.client.0.smithi096.stderr:{"all":{"supported":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"persistent":[],"optional":[],"required":[]}}' 2024-09-16T03:11:47.775 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: jq '.all.supported[] | select(. == "squid")' 2024-09-16T03:11:47.806 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: ret='"squid"' 2024-09-16T03:11:47.806 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2380: jq_success: [[ "squid" == \t\r\u\e ]] 2024-09-16T03:11:47.806 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2382: jq_success: [[ -n "squid" ]] 2024-09-16T03:11:47.806 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2383: jq_success: [[ "squid" == \"\s\q\u\i\d\" ]] 2024-09-16T03:11:47.806 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2384: jq_success: return 0 2024-09-16T03:11:47.806 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:240: TEST_mon_features: run_mon td/misc c --public-addr 127.0.0.1:7129 2024-09-16T03:11:47.806 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/misc 2024-09-16T03:11:47.807 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T03:11:47.807 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=c 2024-09-16T03:11:47.807 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T03:11:47.807 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/misc/c 2024-09-16T03:11:47.807 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id c --mkfs --mon-data=td/misc/c --run-dir=td/misc --public-addr 127.0.0.1:7129 2024-09-16T03:11:48.268 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T03:11:48.269 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:11:48.269 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:11:48.269 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:11:48.269 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:11:48.269 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.29106 2024-09-16T03:11:48.270 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.29106/$cluster-$name.asok' 2024-09-16T03:11:48.270 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id c --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/misc/c '--log-file=td/misc/$name.log' '--admin-socket=/tmp/ceph-asok.29106/$cluster-$name.asok' --mon-cluster-log-file=td/misc/log --run-dir=td/misc '--pid-file=td/misc/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr 127.0.0.1:7129 2024-09-16T03:11:48.523 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T03:11:48.524 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon c fsid 2024-09-16T03:11:48.524 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:11:48.524 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=c 2024-09-16T03:11:48.524 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T03:11:48.525 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T03:11:48.525 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.c 2024-09-16T03:11:48.526 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.c 2024-09-16T03:11:48.526 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.c ']' 2024-09-16T03:11:48.526 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:11:48.526 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:11:48.526 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.29106 2024-09-16T03:11:48.526 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.29106/ceph-mon.c.asok 2024-09-16T03:11:48.526 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:11:48.526 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.29106/ceph-mon.c.asok config get fsid 2024-09-16T03:11:48.646 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon c mon_host 2024-09-16T03:11:48.646 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:11:48.646 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=c 2024-09-16T03:11:48.646 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T03:11:48.647 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T03:11:48.648 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.c 2024-09-16T03:11:48.648 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.c 2024-09-16T03:11:48.648 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.c ']' 2024-09-16T03:11:48.648 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:11:48.648 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:11:48.648 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.29106 2024-09-16T03:11:48.648 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.29106/ceph-mon.c.asok 2024-09-16T03:11:48.648 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:11:48.649 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.29106/ceph-mon.c.asok config get mon_host 2024-09-16T03:11:48.757 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:242: TEST_mon_features: wait_for_quorum 300 3 2024-09-16T03:11:48.757 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1046: wait_for_quorum: local timeout=300 2024-09-16T03:11:48.757 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1047: wait_for_quorum: local quorumsize=3 2024-09-16T03:11:48.758 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1049: wait_for_quorum: [[ -z 300 ]] 2024-09-16T03:11:48.758 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1053: wait_for_quorum: [[ -z 3 ]] 2024-09-16T03:11:48.758 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1058: wait_for_quorum: no_quorum=1 2024-09-16T03:11:48.758 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1059: wait_for_quorum: date +%s 2024-09-16T03:11:48.758 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1059: wait_for_quorum: wait_until=1726456608 2024-09-16T03:11:48.758 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2024-09-16T03:11:48.759 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1726456308 -lt 1726456608 ]] 2024-09-16T03:11:48.759 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 3' 2024-09-16T03:11:48.759 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 300 ceph quorum_status --format=json 2024-09-16T03:11:52.020 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2024-09-16T03:11:52.020 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":9,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:11:29.365018Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:11:52.021 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":9,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:11:29.365018Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders:' '":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks:' '":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:11:52.021 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 3' 2024-09-16T03:11:52.055 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=false 2024-09-16T03:11:52.055 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ false == \t\r\u\e ]] 2024-09-16T03:11:52.056 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2024-09-16T03:11:52.057 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1726456312 -lt 1726456608 ]] 2024-09-16T03:11:52.057 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 3' 2024-09-16T03:11:52.057 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 300 ceph quorum_status --format=json 2024-09-16T03:11:52.314 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2024-09-16T03:11:52.314 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":10,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:11:29.365018Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:11:52.314 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":10,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:11:29.365018Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders:' '":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks:' '":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:11:52.315 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 3' 2024-09-16T03:11:52.347 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=false 2024-09-16T03:11:52.347 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ false == \t\r\u\e ]] 2024-09-16T03:11:52.347 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2024-09-16T03:11:52.348 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1726456312 -lt 1726456608 ]] 2024-09-16T03:11:52.348 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 3' 2024-09-16T03:11:52.348 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 300 ceph quorum_status --format=json 2024-09-16T03:11:52.626 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2024-09-16T03:11:52.626 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":10,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:11:29.365018Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:11:52.627 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":10,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:11:29.365018Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":0,"min_mon_release_name":"unknown","election_strategy":1,"disallowed_leaders:' '":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks:' '":"","features":{"persistent":[],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"noname-c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:11:52.627 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 3' 2024-09-16T03:11:52.662 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=false 2024-09-16T03:11:52.662 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ false == \t\r\u\e ]] 2024-09-16T03:11:52.662 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2024-09-16T03:11:52.663 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1726456312 -lt 1726456608 ]] 2024-09-16T03:11:52.663 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 3' 2024-09-16T03:11:52.664 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 300 ceph quorum_status --format=json 2024-09-16T03:12:07.922 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2024-09-16T03:12:07.922 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:12:01.077503Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:12:07.922 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:12:01.077503Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders:' '":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks:' '":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:12:07.922 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 3' 2024-09-16T03:12:07.957 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=true 2024-09-16T03:12:07.957 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ true == \t\r\u\e ]] 2024-09-16T03:12:07.957 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: wait_for_quorum: no_quorum=0 2024-09-16T03:12:07.957 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1066: wait_for_quorum: break 2024-09-16T03:12:07.957 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: return 0 2024-09-16T03:12:07.958 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:244: TEST_mon_features: timeout 300 ceph -s 2024-09-16T03:12:08.259 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:246: TEST_mon_features: ceph quorum_status --format=json 2024-09-16T03:12:08.644 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:246: TEST_mon_features: jqinput=' 2024-09-16T03:12:08.644 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:12:01.077503Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:12:08.644 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:248: TEST_mon_features: jqfilter='.quorum | length == 3' 2024-09-16T03:12:08.645 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:249: TEST_mon_features: jq_success ' 2024-09-16T03:12:08.645 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:12:01.077503Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' '.quorum | length == 3' 2024-09-16T03:12:08.645 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: jq_success: input=' 2024-09-16T03:12:08.645 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:12:01.077503Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:12:08.645 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: jq_success: filter='.quorum | length == 3' 2024-09-16T03:12:08.646 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2374: jq_success: expects='""' 2024-09-16T03:12:08.646 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: printf %s ' 2024-09-16T03:12:08.646 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:12:01.077503Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:12:08.646 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-16T03:12:08.647 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: in_escaped=' 2024-09-16T03:12:08.648 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:12:01.077503Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:12:08.648 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: printf %s '.quorum | length == 3' 2024-09-16T03:12:08.648 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-16T03:12:08.649 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: filter_escaped='.quorum | length == 3' 2024-09-16T03:12:08.649 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: echo ' 2024-09-16T03:12:08.650 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:12:01.077503Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:12:08.650 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: jq '.quorum | length == 3' 2024-09-16T03:12:08.688 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: ret=true 2024-09-16T03:12:08.688 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2380: jq_success: [[ true == \t\r\u\e ]] 2024-09-16T03:12:08.689 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2381: jq_success: return 0 2024-09-16T03:12:08.689 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:252: TEST_mon_features: jqfilter='.features.quorum_mon[]|select(. == "pacific")' 2024-09-16T03:12:08.689 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:253: TEST_mon_features: jq_success ' 2024-09-16T03:12:08.689 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:12:01.077503Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' '.features.quorum_mon[]|select(. == "pacific")' pacific 2024-09-16T03:12:08.689 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: jq_success: input=' 2024-09-16T03:12:08.689 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:12:01.077503Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:12:08.689 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: jq_success: filter='.features.quorum_mon[]|select(. == "pacific")' 2024-09-16T03:12:08.689 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2374: jq_success: expects='"pacific"' 2024-09-16T03:12:08.689 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: printf %s ' 2024-09-16T03:12:08.689 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:12:01.077503Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:12:08.690 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-16T03:12:08.690 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: in_escaped=' 2024-09-16T03:12:08.690 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:12:01.077503Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:12:08.690 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: printf %s '.features.quorum_mon[]|select(. == "pacific")' 2024-09-16T03:12:08.691 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-16T03:12:08.691 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: filter_escaped='.features.quorum_mon[]|select(. == "pacific")' 2024-09-16T03:12:08.692 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: echo ' 2024-09-16T03:12:08.692 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:12:01.077503Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:12:08.693 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: jq '.features.quorum_mon[]|select(. == "pacific")' 2024-09-16T03:12:08.726 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: ret='"pacific"' 2024-09-16T03:12:08.726 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2380: jq_success: [[ "pacific" == \t\r\u\e ]] 2024-09-16T03:12:08.726 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2382: jq_success: [[ -n "pacific" ]] 2024-09-16T03:12:08.726 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2383: jq_success: [[ "pacific" == \"\p\a\c\i\f\i\c\" ]] 2024-09-16T03:12:08.727 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2384: jq_success: return 0 2024-09-16T03:12:08.727 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:256: TEST_mon_features: jqfilter='.monmap.features.persistent[]|select(. == "kraken")' 2024-09-16T03:12:08.727 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:257: TEST_mon_features: jq_success ' 2024-09-16T03:12:08.727 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:12:01.077503Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' '.monmap.features.persistent[]|select(. == "kraken")' kraken 2024-09-16T03:12:08.727 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: jq_success: input=' 2024-09-16T03:12:08.727 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:12:01.077503Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:12:08.727 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: jq_success: filter='.monmap.features.persistent[]|select(. == "kraken")' 2024-09-16T03:12:08.727 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2374: jq_success: expects='"kraken"' 2024-09-16T03:12:08.727 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: printf %s ' 2024-09-16T03:12:08.727 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:12:01.077503Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:12:08.728 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-16T03:12:08.729 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: in_escaped=' 2024-09-16T03:12:08.729 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:12:01.077503Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:12:08.729 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: printf %s '.monmap.features.persistent[]|select(. == "kraken")' 2024-09-16T03:12:08.729 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-16T03:12:08.729 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: filter_escaped='.monmap.features.persistent[]|select(. == "kraken")' 2024-09-16T03:12:08.730 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: echo ' 2024-09-16T03:12:08.730 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:12:01.077503Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:12:08.730 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: jq '.monmap.features.persistent[]|select(. == "kraken")' 2024-09-16T03:12:08.771 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: ret='"kraken"' 2024-09-16T03:12:08.771 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2380: jq_success: [[ "kraken" == \t\r\u\e ]] 2024-09-16T03:12:08.771 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2382: jq_success: [[ -n "kraken" ]] 2024-09-16T03:12:08.771 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2383: jq_success: [[ "kraken" == \"\k\r\a\k\e\n\" ]] 2024-09-16T03:12:08.771 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2384: jq_success: return 0 2024-09-16T03:12:08.771 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:258: TEST_mon_features: jqfilter='.monmap.features.persistent[]|select(. == "luminous")' 2024-09-16T03:12:08.771 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:259: TEST_mon_features: jq_success ' 2024-09-16T03:12:08.771 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:12:01.077503Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' '.monmap.features.persistent[]|select(. == "luminous")' luminous 2024-09-16T03:12:08.772 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: jq_success: input=' 2024-09-16T03:12:08.772 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:12:01.077503Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:12:08.772 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: jq_success: filter='.monmap.features.persistent[]|select(. == "luminous")' 2024-09-16T03:12:08.772 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2374: jq_success: expects='"luminous"' 2024-09-16T03:12:08.772 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: printf %s ' 2024-09-16T03:12:08.772 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:12:01.077503Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:12:08.772 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-16T03:12:08.773 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: in_escaped=' 2024-09-16T03:12:08.773 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:12:01.077503Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:12:08.773 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: printf %s '.monmap.features.persistent[]|select(. == "luminous")' 2024-09-16T03:12:08.773 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-16T03:12:08.774 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: filter_escaped='.monmap.features.persistent[]|select(. == "luminous")' 2024-09-16T03:12:08.776 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: echo ' 2024-09-16T03:12:08.776 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:12:01.077503Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:12:08.776 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: jq '.monmap.features.persistent[]|select(. == "luminous")' 2024-09-16T03:12:08.812 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: ret='"luminous"' 2024-09-16T03:12:08.812 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2380: jq_success: [[ "luminous" == \t\r\u\e ]] 2024-09-16T03:12:08.812 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2382: jq_success: [[ -n "luminous" ]] 2024-09-16T03:12:08.813 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2383: jq_success: [[ "luminous" == \"\l\u\m\i\n\o\u\s\" ]] 2024-09-16T03:12:08.813 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2384: jq_success: return 0 2024-09-16T03:12:08.813 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:260: TEST_mon_features: jqfilter='.monmap.features.persistent[]|select(. == "mimic")' 2024-09-16T03:12:08.813 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:261: TEST_mon_features: jq_success ' 2024-09-16T03:12:08.813 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:12:01.077503Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' '.monmap.features.persistent[]|select(. == "mimic")' mimic 2024-09-16T03:12:08.813 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: jq_success: input=' 2024-09-16T03:12:08.813 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:12:01.077503Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:12:08.813 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: jq_success: filter='.monmap.features.persistent[]|select(. == "mimic")' 2024-09-16T03:12:08.813 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2374: jq_success: expects='"mimic"' 2024-09-16T03:12:08.813 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: printf %s ' 2024-09-16T03:12:08.813 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:12:01.077503Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:12:08.813 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-16T03:12:08.814 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: in_escaped=' 2024-09-16T03:12:08.814 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:12:01.077503Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:12:08.815 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-16T03:12:08.815 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: printf %s '.monmap.features.persistent[]|select(. == "mimic")' 2024-09-16T03:12:08.816 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: filter_escaped='.monmap.features.persistent[]|select(. == "mimic")' 2024-09-16T03:12:08.816 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: echo ' 2024-09-16T03:12:08.817 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:12:01.077503Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:12:08.817 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: jq '.monmap.features.persistent[]|select(. == "mimic")' 2024-09-16T03:12:08.855 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: ret='"mimic"' 2024-09-16T03:12:08.855 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2380: jq_success: [[ "mimic" == \t\r\u\e ]] 2024-09-16T03:12:08.855 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2382: jq_success: [[ -n "mimic" ]] 2024-09-16T03:12:08.855 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2383: jq_success: [[ "mimic" == \"\m\i\m\i\c\" ]] 2024-09-16T03:12:08.856 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2384: jq_success: return 0 2024-09-16T03:12:08.856 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:262: TEST_mon_features: jqfilter='.monmap.features.persistent[]|select(. == "osdmap-prune")' 2024-09-16T03:12:08.856 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:263: TEST_mon_features: jq_success ' 2024-09-16T03:12:08.856 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:12:01.077503Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' '.monmap.features.persistent[]|select(. == "osdmap-prune")' osdmap-prune 2024-09-16T03:12:08.856 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: jq_success: input=' 2024-09-16T03:12:08.856 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:12:01.077503Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:12:08.856 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: jq_success: filter='.monmap.features.persistent[]|select(. == "osdmap-prune")' 2024-09-16T03:12:08.856 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2374: jq_success: expects='"osdmap-prune"' 2024-09-16T03:12:08.856 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: printf %s ' 2024-09-16T03:12:08.856 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:12:01.077503Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:12:08.856 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-16T03:12:08.857 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: in_escaped=' 2024-09-16T03:12:08.857 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:12:01.077503Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:12:08.857 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: printf %s '.monmap.features.persistent[]|select(. == "osdmap-prune")' 2024-09-16T03:12:08.857 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-16T03:12:08.858 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: filter_escaped='.monmap.features.persistent[]|select(. == "osdmap-prune")' 2024-09-16T03:12:08.859 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: echo ' 2024-09-16T03:12:08.859 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:12:01.077503Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:12:08.859 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: jq '.monmap.features.persistent[]|select(. == "osdmap-prune")' 2024-09-16T03:12:08.896 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: ret='"osdmap-prune"' 2024-09-16T03:12:08.897 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2380: jq_success: [[ "osdmap-prune" == \t\r\u\e ]] 2024-09-16T03:12:08.897 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2382: jq_success: [[ -n "osdmap-prune" ]] 2024-09-16T03:12:08.897 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2383: jq_success: [[ "osdmap-prune" == \"\o\s\d\m\a\p\-\p\r\u\n\e\" ]] 2024-09-16T03:12:08.897 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2384: jq_success: return 0 2024-09-16T03:12:08.897 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:264: TEST_mon_features: jqfilter='.monmap.features.persistent[]|select(. == "nautilus")' 2024-09-16T03:12:08.897 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:265: TEST_mon_features: jq_success ' 2024-09-16T03:12:08.897 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:12:01.077503Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' '.monmap.features.persistent[]|select(. == "nautilus")' nautilus 2024-09-16T03:12:08.897 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: jq_success: input=' 2024-09-16T03:12:08.897 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:12:01.077503Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:12:08.897 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: jq_success: filter='.monmap.features.persistent[]|select(. == "nautilus")' 2024-09-16T03:12:08.897 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2374: jq_success: expects='"nautilus"' 2024-09-16T03:12:08.898 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: printf %s ' 2024-09-16T03:12:08.898 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-16T03:12:08.898 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:12:01.077503Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:12:08.899 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: in_escaped=' 2024-09-16T03:12:08.899 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:12:01.077503Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:12:08.900 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: printf %s '.monmap.features.persistent[]|select(. == "nautilus")' 2024-09-16T03:12:08.900 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-16T03:12:08.901 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: filter_escaped='.monmap.features.persistent[]|select(. == "nautilus")' 2024-09-16T03:12:08.902 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: echo ' 2024-09-16T03:12:08.902 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:12:01.077503Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:12:08.902 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: jq '.monmap.features.persistent[]|select(. == "nautilus")' 2024-09-16T03:12:08.936 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: ret='"nautilus"' 2024-09-16T03:12:08.937 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2380: jq_success: [[ "nautilus" == \t\r\u\e ]] 2024-09-16T03:12:08.937 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2382: jq_success: [[ -n "nautilus" ]] 2024-09-16T03:12:08.937 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2383: jq_success: [[ "nautilus" == \"\n\a\u\t\i\l\u\s\" ]] 2024-09-16T03:12:08.937 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2384: jq_success: return 0 2024-09-16T03:12:08.937 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:266: TEST_mon_features: jqfilter='.monmap.features.persistent[]|select(. == "octopus")' 2024-09-16T03:12:08.937 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:267: TEST_mon_features: jq_success ' 2024-09-16T03:12:08.937 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:12:01.077503Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' '.monmap.features.persistent[]|select(. == "octopus")' octopus 2024-09-16T03:12:08.937 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: jq_success: input=' 2024-09-16T03:12:08.937 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:12:01.077503Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:12:08.937 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: jq_success: filter='.monmap.features.persistent[]|select(. == "octopus")' 2024-09-16T03:12:08.937 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2374: jq_success: expects='"octopus"' 2024-09-16T03:12:08.937 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-16T03:12:08.937 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: printf %s ' 2024-09-16T03:12:08.938 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:12:01.077503Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:12:08.938 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: in_escaped=' 2024-09-16T03:12:08.939 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:12:01.077503Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:12:08.939 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: printf %s '.monmap.features.persistent[]|select(. == "octopus")' 2024-09-16T03:12:08.939 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-16T03:12:08.939 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: filter_escaped='.monmap.features.persistent[]|select(. == "octopus")' 2024-09-16T03:12:08.940 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: echo ' 2024-09-16T03:12:08.940 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:12:01.077503Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:12:08.940 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: jq '.monmap.features.persistent[]|select(. == "octopus")' 2024-09-16T03:12:08.974 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: ret='"octopus"' 2024-09-16T03:12:08.974 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2380: jq_success: [[ "octopus" == \t\r\u\e ]] 2024-09-16T03:12:08.974 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2382: jq_success: [[ -n "octopus" ]] 2024-09-16T03:12:08.975 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2383: jq_success: [[ "octopus" == \"\o\c\t\o\p\u\s\" ]] 2024-09-16T03:12:08.975 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2384: jq_success: return 0 2024-09-16T03:12:08.975 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:268: TEST_mon_features: jqfilter='.monmap.features.persistent[]|select(. == "pacific")' 2024-09-16T03:12:08.975 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:269: TEST_mon_features: jq_success ' 2024-09-16T03:12:08.975 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:12:01.077503Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' '.monmap.features.persistent[]|select(. == "pacific")' pacific 2024-09-16T03:12:08.975 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: jq_success: input=' 2024-09-16T03:12:08.975 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:12:01.077503Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:12:08.975 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: jq_success: filter='.monmap.features.persistent[]|select(. == "pacific")' 2024-09-16T03:12:08.975 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2374: jq_success: expects='"pacific"' 2024-09-16T03:12:08.975 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: printf %s ' 2024-09-16T03:12:08.975 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:12:01.077503Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:12:08.976 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-16T03:12:08.976 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: in_escaped=' 2024-09-16T03:12:08.976 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:12:01.077503Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:12:08.976 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: printf %s '.monmap.features.persistent[]|select(. == "pacific")' 2024-09-16T03:12:08.977 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-16T03:12:08.977 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: filter_escaped='.monmap.features.persistent[]|select(. == "pacific")' 2024-09-16T03:12:08.978 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: jq '.monmap.features.persistent[]|select(. == "pacific")' 2024-09-16T03:12:08.978 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: echo ' 2024-09-16T03:12:08.978 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:12:01.077503Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:12:09.010 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: ret='"pacific"' 2024-09-16T03:12:09.010 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2380: jq_success: [[ "pacific" == \t\r\u\e ]] 2024-09-16T03:12:09.010 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2382: jq_success: [[ -n "pacific" ]] 2024-09-16T03:12:09.010 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2383: jq_success: [[ "pacific" == \"\p\a\c\i\f\i\c\" ]] 2024-09-16T03:12:09.010 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2384: jq_success: return 0 2024-09-16T03:12:09.010 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:270: TEST_mon_features: jqfilter='.monmap.features.persistent[]|select(. == "elector-pinging")' 2024-09-16T03:12:09.010 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:271: TEST_mon_features: jq_success ' 2024-09-16T03:12:09.010 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:12:01.077503Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' '.monmap.features.persistent[]|select(. == "elector-pinging")' elector-pinging 2024-09-16T03:12:09.010 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: jq_success: input=' 2024-09-16T03:12:09.011 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:12:01.077503Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:12:09.011 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: jq_success: filter='.monmap.features.persistent[]|select(. == "elector-pinging")' 2024-09-16T03:12:09.011 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2374: jq_success: expects='"elector-pinging"' 2024-09-16T03:12:09.011 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: printf %s ' 2024-09-16T03:12:09.011 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:12:01.077503Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:12:09.011 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-16T03:12:09.011 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: in_escaped=' 2024-09-16T03:12:09.012 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:12:01.077503Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:12:09.012 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: printf %s '.monmap.features.persistent[]|select(. == "elector-pinging")' 2024-09-16T03:12:09.012 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-16T03:12:09.014 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: filter_escaped='.monmap.features.persistent[]|select(. == "elector-pinging")' 2024-09-16T03:12:09.015 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: echo ' 2024-09-16T03:12:09.015 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:12:01.077503Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:12:09.015 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: jq '.monmap.features.persistent[]|select(. == "elector-pinging")' 2024-09-16T03:12:09.050 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: ret='"elector-pinging"' 2024-09-16T03:12:09.050 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2380: jq_success: [[ "elector-pinging" == \t\r\u\e ]] 2024-09-16T03:12:09.050 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2382: jq_success: [[ -n "elector-pinging" ]] 2024-09-16T03:12:09.051 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2383: jq_success: [[ "elector-pinging" == \"\e\l\e\c\t\o\r\-\p\i\n\g\i\n\g\" ]] 2024-09-16T03:12:09.051 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2384: jq_success: return 0 2024-09-16T03:12:09.051 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:272: TEST_mon_features: jqfilter='.monmap.features.persistent | length == 11' 2024-09-16T03:12:09.051 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:273: TEST_mon_features: jq_success ' 2024-09-16T03:12:09.051 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:12:01.077503Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' '.monmap.features.persistent | length == 11' 2024-09-16T03:12:09.051 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: jq_success: input=' 2024-09-16T03:12:09.051 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:12:01.077503Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:12:09.051 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: jq_success: filter='.monmap.features.persistent | length == 11' 2024-09-16T03:12:09.051 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2374: jq_success: expects='""' 2024-09-16T03:12:09.051 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: printf %s ' 2024-09-16T03:12:09.051 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:12:01.077503Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:12:09.051 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-16T03:12:09.052 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: in_escaped=' 2024-09-16T03:12:09.052 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:12:01.077503Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:12:09.052 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: printf %s '.monmap.features.persistent | length == 11' 2024-09-16T03:12:09.052 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-16T03:12:09.053 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: filter_escaped='.monmap.features.persistent | length == 11' 2024-09-16T03:12:09.054 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: echo ' 2024-09-16T03:12:09.054 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:12:01.077503Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:12:09.054 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: jq '.monmap.features.persistent | length == 11' 2024-09-16T03:12:09.085 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: ret=true 2024-09-16T03:12:09.085 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2380: jq_success: [[ true == \t\r\u\e ]] 2024-09-16T03:12:09.085 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2381: jq_success: return 0 2024-09-16T03:12:09.085 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:274: TEST_mon_features: jqfilter='.monmap.features.persistent[]|select(. == "quincy")' 2024-09-16T03:12:09.085 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:275: TEST_mon_features: jq_success ' 2024-09-16T03:12:09.086 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:12:01.077503Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' '.monmap.features.persistent[]|select(. == "quincy")' quincy 2024-09-16T03:12:09.086 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: jq_success: input=' 2024-09-16T03:12:09.086 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:12:01.077503Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:12:09.086 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: jq_success: filter='.monmap.features.persistent[]|select(. == "quincy")' 2024-09-16T03:12:09.086 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2374: jq_success: expects='"quincy"' 2024-09-16T03:12:09.086 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: printf %s ' 2024-09-16T03:12:09.086 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:12:01.077503Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:12:09.086 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-16T03:12:09.087 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: in_escaped=' 2024-09-16T03:12:09.087 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:12:01.077503Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:12:09.087 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: printf %s '.monmap.features.persistent[]|select(. == "quincy")' 2024-09-16T03:12:09.087 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-16T03:12:09.089 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: filter_escaped='.monmap.features.persistent[]|select(. == "quincy")' 2024-09-16T03:12:09.090 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: echo ' 2024-09-16T03:12:09.090 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:12:01.077503Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:12:09.090 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: jq '.monmap.features.persistent[]|select(. == "quincy")' 2024-09-16T03:12:09.127 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: ret='"quincy"' 2024-09-16T03:12:09.127 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2380: jq_success: [[ "quincy" == \t\r\u\e ]] 2024-09-16T03:12:09.127 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2382: jq_success: [[ -n "quincy" ]] 2024-09-16T03:12:09.128 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2383: jq_success: [[ "quincy" == \"\q\u\i\n\c\y\" ]] 2024-09-16T03:12:09.128 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2384: jq_success: return 0 2024-09-16T03:12:09.128 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:276: TEST_mon_features: jqfilter='.monmap.features.persistent[]|select(. == "reef")' 2024-09-16T03:12:09.128 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:277: TEST_mon_features: jq_success ' 2024-09-16T03:12:09.128 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:12:01.077503Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' '.monmap.features.persistent[]|select(. == "reef")' reef 2024-09-16T03:12:09.128 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: jq_success: input=' 2024-09-16T03:12:09.128 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:12:01.077503Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:12:09.128 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: jq_success: filter='.monmap.features.persistent[]|select(. == "reef")' 2024-09-16T03:12:09.128 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2374: jq_success: expects='"reef"' 2024-09-16T03:12:09.128 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: printf %s ' 2024-09-16T03:12:09.128 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:12:01.077503Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:12:09.129 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-16T03:12:09.129 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: in_escaped=' 2024-09-16T03:12:09.129 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:12:01.077503Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:12:09.129 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: printf %s '.monmap.features.persistent[]|select(. == "reef")' 2024-09-16T03:12:09.129 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-16T03:12:09.130 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: filter_escaped='.monmap.features.persistent[]|select(. == "reef")' 2024-09-16T03:12:09.131 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: echo ' 2024-09-16T03:12:09.131 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:12:01.077503Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:12:09.131 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: jq '.monmap.features.persistent[]|select(. == "reef")' 2024-09-16T03:12:09.167 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: ret='"reef"' 2024-09-16T03:12:09.167 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2380: jq_success: [[ "reef" == \t\r\u\e ]] 2024-09-16T03:12:09.167 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2382: jq_success: [[ -n "reef" ]] 2024-09-16T03:12:09.167 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2383: jq_success: [[ "reef" == \"\r\e\e\f\" ]] 2024-09-16T03:12:09.168 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2384: jq_success: return 0 2024-09-16T03:12:09.168 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:278: TEST_mon_features: jqfilter='.monmap.features.persistent[]|select(. == "squid")' 2024-09-16T03:12:09.168 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:279: TEST_mon_features: jq_success ' 2024-09-16T03:12:09.168 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:12:01.077503Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' '.monmap.features.persistent[]|select(. == "squid")' squid 2024-09-16T03:12:09.168 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: jq_success: input=' 2024-09-16T03:12:09.168 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:12:01.077503Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:12:09.168 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: jq_success: filter='.monmap.features.persistent[]|select(. == "squid")' 2024-09-16T03:12:09.168 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2374: jq_success: expects='"squid"' 2024-09-16T03:12:09.168 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: printf %s ' 2024-09-16T03:12:09.169 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:12:01.077503Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:12:09.169 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-16T03:12:09.169 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: in_escaped=' 2024-09-16T03:12:09.169 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:12:01.077503Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:12:09.169 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: printf %s '.monmap.features.persistent[]|select(. == "squid")' 2024-09-16T03:12:09.170 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-16T03:12:09.171 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: filter_escaped='.monmap.features.persistent[]|select(. == "squid")' 2024-09-16T03:12:09.171 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: jq '.monmap.features.persistent[]|select(. == "squid")' 2024-09-16T03:12:09.171 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: echo ' 2024-09-16T03:12:09.171 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"ba261b2e-e65d-4c1c-b667-a6f0dc5b075c","modified":"2024-09-16T03:12:01.077503Z","created":"2024-09-16T03:11:29.365018Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7127","nonce":0}]},"addr":"127.0.0.1:7127/0","public_addr":"127.0.0.1:7127/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7128","nonce":0}]},"addr":"127.0.0.1:7128/0","public_addr":"127.0.0.1:7128/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7129","nonce":0}]},"addr":"127.0.0.1:7129/0","public_addr":"127.0.0.1:7129/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:12:09.202 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: ret='"squid"' 2024-09-16T03:12:09.202 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2380: jq_success: [[ "squid" == \t\r\u\e ]] 2024-09-16T03:12:09.202 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2382: jq_success: [[ -n "squid" ]] 2024-09-16T03:12:09.202 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2383: jq_success: [[ "squid" == \"\s\q\u\i\d\" ]] 2024-09-16T03:12:09.202 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2384: jq_success: return 0 2024-09-16T03:12:09.202 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:281: TEST_mon_features: CEPH_ARGS='--fsid=b393df8e-f628-4302-9e3d-4220be73bcfa --auth-supported=none --mon-initial-members=a --mon-host=127.0.0.1:7117 ' 2024-09-16T03:12:09.202 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:283: TEST_mon_features: teardown td/misc 2024-09-16T03:12:09.202 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/misc 2024-09-16T03:12:09.202 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:12:09.202 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/misc KILL 2024-09-16T03:12:09.203 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:12:09.203 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:12:09.203 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:12:09.203 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:12:09.203 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:12:09.308 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:12:09.308 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:12:09.309 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:12:09.309 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:12:09.311 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:12:09.311 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:12:09.312 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:12:09.312 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:12:09.312 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:12:09.313 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:12:09.313 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:12:09.314 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:12:09.316 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:12:09.316 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/misc 2024-09-16T03:12:09.321 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:12:09.321 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:12:09.321 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.29106 2024-09-16T03:12:09.321 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.29106 2024-09-16T03:12:09.323 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:12:09.323 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:12:09.323 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:30: run: for func in $funcs 2024-09-16T03:12:09.323 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:31: run: TEST_no_segfault_for_bad_keyring td/misc 2024-09-16T03:12:09.323 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:142: TEST_no_segfault_for_bad_keyring: local dir=td/misc 2024-09-16T03:12:09.323 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:143: TEST_no_segfault_for_bad_keyring: setup td/misc 2024-09-16T03:12:09.323 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/misc 2024-09-16T03:12:09.324 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/misc 2024-09-16T03:12:09.324 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/misc 2024-09-16T03:12:09.324 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:12:09.324 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/misc KILL 2024-09-16T03:12:09.324 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:12:09.324 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:12:09.324 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:12:09.324 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:12:09.324 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:12:09.325 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:12:09.326 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:12:09.326 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:12:09.326 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:12:09.327 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:12:09.328 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:12:09.328 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:12:09.329 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:12:09.329 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:12:09.329 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:12:09.329 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:12:09.330 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:12:09.331 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:12:09.331 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/misc 2024-09-16T03:12:09.333 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:12:09.333 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:12:09.333 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.29106 2024-09-16T03:12:09.333 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.29106 2024-09-16T03:12:09.334 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:12:09.334 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:12:09.334 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/misc 2024-09-16T03:12:09.335 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T03:12:09.335 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:12:09.335 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.29106 2024-09-16T03:12:09.336 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.29106 2024-09-16T03:12:09.336 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T03:12:09.337 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2024-09-16T03:12:09.337 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T03:12:09.337 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/misc 1' TERM HUP INT 2024-09-16T03:12:09.337 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:145: TEST_no_segfault_for_bad_keyring: ceph-authtool --create-keyring td/misc/ceph.mon.keyring --gen-key -n mon. --cap mon 'allow *' 2024-09-16T03:12:09.359 INFO:tasks.workunit.client.0.smithi096.stdout:creating td/misc/ceph.mon.keyring 2024-09-16T03:12:09.360 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:146: TEST_no_segfault_for_bad_keyring: ceph-authtool --create-keyring td/misc/ceph.client.admin.keyring --gen-key -n client.admin --cap mon 'allow *' 2024-09-16T03:12:09.388 INFO:tasks.workunit.client.0.smithi096.stdout:creating td/misc/ceph.client.admin.keyring 2024-09-16T03:12:09.389 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:147: TEST_no_segfault_for_bad_keyring: ceph-authtool td/misc/ceph.mon.keyring --import-keyring td/misc/ceph.client.admin.keyring 2024-09-16T03:12:09.409 INFO:tasks.workunit.client.0.smithi096.stdout:importing contents of td/misc/ceph.client.admin.keyring into td/misc/ceph.mon.keyring 2024-09-16T03:12:09.410 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:148: TEST_no_segfault_for_bad_keyring: uuidgen 2024-09-16T03:12:09.411 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:148: TEST_no_segfault_for_bad_keyring: CEPH_ARGS_TMP='--fsid=14b34a23-1726-42bc-a146-ac4b38f58735 --mon-host=127.0.0.1:7102 --auth-supported=cephx ' 2024-09-16T03:12:09.412 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:149: TEST_no_segfault_for_bad_keyring: CEPH_ARGS_orig='--fsid=b393df8e-f628-4302-9e3d-4220be73bcfa --auth-supported=none --mon-initial-members=a --mon-host=127.0.0.1:7117 ' 2024-09-16T03:12:09.412 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:150: TEST_no_segfault_for_bad_keyring: CEPH_ARGS='--fsid=14b34a23-1726-42bc-a146-ac4b38f58735 --mon-host=127.0.0.1:7102 --auth-supported=cephx --keyring=td/misc/ceph.mon.keyring ' 2024-09-16T03:12:09.412 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:151: TEST_no_segfault_for_bad_keyring: run_mon td/misc a 2024-09-16T03:12:09.412 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/misc 2024-09-16T03:12:09.412 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T03:12:09.412 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T03:12:09.412 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T03:12:09.412 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/misc/a 2024-09-16T03:12:09.412 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/misc/a --run-dir=td/misc 2024-09-16T03:12:09.896 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T03:12:09.896 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:12:09.896 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:12:09.897 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:12:09.897 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:12:09.897 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.29106 2024-09-16T03:12:09.898 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.29106/$cluster-$name.asok' 2024-09-16T03:12:09.898 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/misc/a '--log-file=td/misc/$name.log' '--admin-socket=/tmp/ceph-asok.29106/$cluster-$name.asok' --mon-cluster-log-file=td/misc/log --run-dir=td/misc '--pid-file=td/misc/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-09-16T03:12:10.085 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T03:12:10.086 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T03:12:10.086 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:12:10.086 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:12:10.086 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T03:12:10.087 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T03:12:10.087 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:12:10.087 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:12:10.087 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:12:10.088 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:12:10.088 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:12:10.088 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.29106 2024-09-16T03:12:10.088 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.29106/ceph-mon.a.asok 2024-09-16T03:12:10.088 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:12:10.089 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.29106/ceph-mon.a.asok config get fsid 2024-09-16T03:12:10.209 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T03:12:10.209 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:12:10.209 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:12:10.209 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T03:12:10.209 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T03:12:10.211 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:12:10.211 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:12:10.211 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:12:10.211 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:12:10.211 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:12:10.211 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.29106 2024-09-16T03:12:10.211 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.29106/ceph-mon.a.asok 2024-09-16T03:12:10.211 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:12:10.211 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.29106/ceph-mon.a.asok config get mon_host 2024-09-16T03:12:10.328 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:153: TEST_no_segfault_for_bad_keyring: echo -e '[client.admin]\nkey = BQAUlgtWoFePIxAAQ9YLzJSVgJX5V1lh5gyctg==' 2024-09-16T03:12:10.360 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:154: TEST_no_segfault_for_bad_keyring: CEPH_ARGS='--fsid=14b34a23-1726-42bc-a146-ac4b38f58735 --mon-host=127.0.0.1:7102 --auth-supported=cephx --keyring=td/misc/bad.keyring' 2024-09-16T03:12:10.360 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:155: TEST_no_segfault_for_bad_keyring: ceph osd dump 2024-09-16T03:12:10.438 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:157: TEST_no_segfault_for_bad_keyring: '[' 1 -eq 139 ']' 2024-09-16T03:12:10.438 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:158: TEST_no_segfault_for_bad_keyring: CEPH_ARGS='--fsid=b393df8e-f628-4302-9e3d-4220be73bcfa --auth-supported=none --mon-initial-members=a --mon-host=127.0.0.1:7117 ' 2024-09-16T03:12:10.438 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:159: TEST_no_segfault_for_bad_keyring: teardown td/misc 2024-09-16T03:12:10.438 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/misc 2024-09-16T03:12:10.438 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:12:10.438 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/misc KILL 2024-09-16T03:12:10.439 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:12:10.439 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:12:10.439 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:12:10.439 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:12:10.439 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:12:10.545 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:12:10.545 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:12:10.545 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:12:10.546 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:12:10.547 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:12:10.548 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:12:10.548 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:12:10.549 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:12:10.549 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:12:10.549 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:12:10.550 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:12:10.550 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:12:10.552 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:12:10.552 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/misc 2024-09-16T03:12:10.554 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:12:10.554 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:12:10.554 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.29106 2024-09-16T03:12:10.554 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.29106 2024-09-16T03:12:10.556 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:12:10.556 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:12:10.556 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:30: run: for func in $funcs 2024-09-16T03:12:10.556 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:31: run: TEST_osd_pool_get_set td/misc 2024-09-16T03:12:10.556 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:38: TEST_osd_pool_get_set: local dir=td/misc 2024-09-16T03:12:10.556 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:40: TEST_osd_pool_get_set: setup td/misc 2024-09-16T03:12:10.556 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/misc 2024-09-16T03:12:10.557 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/misc 2024-09-16T03:12:10.557 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/misc 2024-09-16T03:12:10.557 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:12:10.557 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/misc KILL 2024-09-16T03:12:10.557 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:12:10.557 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:12:10.557 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:12:10.557 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:12:10.557 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:12:10.558 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:12:10.559 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:12:10.559 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:12:10.560 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:12:10.561 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:12:10.561 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:12:10.561 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:12:10.562 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:12:10.562 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:12:10.563 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:12:10.563 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:12:10.564 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:12:10.565 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:12:10.565 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/misc 2024-09-16T03:12:10.566 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:12:10.567 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:12:10.567 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.29106 2024-09-16T03:12:10.567 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.29106 2024-09-16T03:12:10.568 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:12:10.568 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:12:10.568 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/misc 2024-09-16T03:12:10.569 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T03:12:10.570 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:12:10.570 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.29106 2024-09-16T03:12:10.570 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.29106 2024-09-16T03:12:10.571 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T03:12:10.572 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2024-09-16T03:12:10.572 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T03:12:10.572 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/misc 1' TERM HUP INT 2024-09-16T03:12:10.572 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:41: TEST_osd_pool_get_set: run_mon td/misc a 2024-09-16T03:12:10.572 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/misc 2024-09-16T03:12:10.572 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T03:12:10.572 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T03:12:10.573 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T03:12:10.573 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/misc/a 2024-09-16T03:12:10.573 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/misc/a --run-dir=td/misc 2024-09-16T03:12:11.042 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T03:12:11.042 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:12:11.043 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:12:11.043 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:12:11.043 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:12:11.043 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.29106 2024-09-16T03:12:11.044 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.29106/$cluster-$name.asok' 2024-09-16T03:12:11.044 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/misc/a '--log-file=td/misc/$name.log' '--admin-socket=/tmp/ceph-asok.29106/$cluster-$name.asok' --mon-cluster-log-file=td/misc/log --run-dir=td/misc '--pid-file=td/misc/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-09-16T03:12:11.260 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T03:12:11.261 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T03:12:11.261 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:12:11.261 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:12:11.261 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T03:12:11.262 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T03:12:11.262 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:12:11.262 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:12:11.262 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:12:11.263 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:12:11.263 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:12:11.263 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.29106 2024-09-16T03:12:11.263 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.29106/ceph-mon.a.asok 2024-09-16T03:12:11.263 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:12:11.263 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.29106/ceph-mon.a.asok config get fsid 2024-09-16T03:12:11.380 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T03:12:11.380 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:12:11.380 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:12:11.380 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T03:12:11.380 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T03:12:11.381 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:12:11.381 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:12:11.382 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:12:11.382 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:12:11.382 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:12:11.382 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.29106 2024-09-16T03:12:11.382 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.29106/ceph-mon.a.asok 2024-09-16T03:12:11.382 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:12:11.382 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.29106/ceph-mon.a.asok config get mon_host 2024-09-16T03:12:11.493 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:42: TEST_osd_pool_get_set: create_pool rbd 8 2024-09-16T03:12:11.493 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 8 2024-09-16T03:12:12.398 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'rbd' already exists 2024-09-16T03:12:12.415 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2024-09-16T03:12:13.417 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:44: TEST_osd_pool_get_set: local flag 2024-09-16T03:12:13.417 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:45: TEST_osd_pool_get_set: for flag in nodelete nopgchange nosizechange write_fadvise_dontneed noscrub nodeep-scrub 2024-09-16T03:12:13.418 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:46: TEST_osd_pool_get_set: ceph osd pool set rbd nodelete 0 2024-09-16T03:12:13.883 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 1 nodelete to 0 2024-09-16T03:12:13.902 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:47: TEST_osd_pool_get_set: ceph osd dump 2024-09-16T03:12:13.902 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:47: TEST_osd_pool_get_set: grep 'pool ' 2024-09-16T03:12:13.902 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:47: TEST_osd_pool_get_set: grep nodelete 2024-09-16T03:12:14.159 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:48: TEST_osd_pool_get_set: ceph osd pool set rbd nodelete 1 2024-09-16T03:12:14.693 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 1 nodelete to 1 2024-09-16T03:12:14.718 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:49: TEST_osd_pool_get_set: ceph osd dump 2024-09-16T03:12:14.718 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:49: TEST_osd_pool_get_set: grep 'pool ' 2024-09-16T03:12:14.718 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:49: TEST_osd_pool_get_set: grep nodelete 2024-09-16T03:12:15.013 INFO:tasks.workunit.client.0.smithi096.stdout:pool 1 'rbd' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 6 flags hashpspool,nodelete,creating stripe_width 0 2024-09-16T03:12:15.013 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:50: TEST_osd_pool_get_set: ceph osd pool set rbd nodelete false 2024-09-16T03:12:15.471 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 1 nodelete to false 2024-09-16T03:12:15.491 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:51: TEST_osd_pool_get_set: ceph osd dump 2024-09-16T03:12:15.491 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:51: TEST_osd_pool_get_set: grep 'pool ' 2024-09-16T03:12:15.491 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:51: TEST_osd_pool_get_set: grep nodelete 2024-09-16T03:12:15.756 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:52: TEST_osd_pool_get_set: ceph osd pool set rbd nodelete false 2024-09-16T03:12:16.232 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 1 nodelete to false 2024-09-16T03:12:16.253 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:54: TEST_osd_pool_get_set: ceph osd dump 2024-09-16T03:12:16.253 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:54: TEST_osd_pool_get_set: grep 'pool ' 2024-09-16T03:12:16.254 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:54: TEST_osd_pool_get_set: grep nodelete 2024-09-16T03:12:16.518 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:55: TEST_osd_pool_get_set: ceph osd pool set rbd nodelete true 2024-09-16T03:12:17.026 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 1 nodelete to true 2024-09-16T03:12:17.052 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:56: TEST_osd_pool_get_set: ceph osd dump 2024-09-16T03:12:17.052 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:56: TEST_osd_pool_get_set: grep 'pool ' 2024-09-16T03:12:17.052 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:56: TEST_osd_pool_get_set: grep nodelete 2024-09-16T03:12:17.354 INFO:tasks.workunit.client.0.smithi096.stdout:pool 1 'rbd' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 12 flags hashpspool,nodelete,creating stripe_width 0 2024-09-16T03:12:17.354 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:58: TEST_osd_pool_get_set: ceph osd pool set rbd nodelete 0 2024-09-16T03:12:17.828 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 1 nodelete to 0 2024-09-16T03:12:17.848 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:45: TEST_osd_pool_get_set: for flag in nodelete nopgchange nosizechange write_fadvise_dontneed noscrub nodeep-scrub 2024-09-16T03:12:17.849 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:46: TEST_osd_pool_get_set: ceph osd pool set rbd nopgchange 0 2024-09-16T03:12:18.314 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 1 nopgchange to 0 2024-09-16T03:12:18.339 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:47: TEST_osd_pool_get_set: ceph osd dump 2024-09-16T03:12:18.339 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:47: TEST_osd_pool_get_set: grep 'pool ' 2024-09-16T03:12:18.339 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:47: TEST_osd_pool_get_set: grep nopgchange 2024-09-16T03:12:18.600 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:48: TEST_osd_pool_get_set: ceph osd pool set rbd nopgchange 1 2024-09-16T03:12:19.083 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 1 nopgchange to 1 2024-09-16T03:12:19.102 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:49: TEST_osd_pool_get_set: ceph osd dump 2024-09-16T03:12:19.102 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:49: TEST_osd_pool_get_set: grep 'pool ' 2024-09-16T03:12:19.102 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:49: TEST_osd_pool_get_set: grep nopgchange 2024-09-16T03:12:19.376 INFO:tasks.workunit.client.0.smithi096.stdout:pool 1 'rbd' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 18 flags hashpspool,nopgchange,creating stripe_width 0 2024-09-16T03:12:19.377 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:50: TEST_osd_pool_get_set: ceph osd pool set rbd nopgchange false 2024-09-16T03:12:19.927 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 1 nopgchange to false 2024-09-16T03:12:19.953 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:51: TEST_osd_pool_get_set: ceph osd dump 2024-09-16T03:12:19.953 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:51: TEST_osd_pool_get_set: grep 'pool ' 2024-09-16T03:12:19.953 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:51: TEST_osd_pool_get_set: grep nopgchange 2024-09-16T03:12:20.247 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:52: TEST_osd_pool_get_set: ceph osd pool set rbd nopgchange false 2024-09-16T03:12:20.704 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 1 nopgchange to false 2024-09-16T03:12:20.727 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:54: TEST_osd_pool_get_set: ceph osd dump 2024-09-16T03:12:20.727 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:54: TEST_osd_pool_get_set: grep 'pool ' 2024-09-16T03:12:20.727 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:54: TEST_osd_pool_get_set: grep nopgchange 2024-09-16T03:12:20.999 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:55: TEST_osd_pool_get_set: ceph osd pool set rbd nopgchange true 2024-09-16T03:12:21.482 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 1 nopgchange to true 2024-09-16T03:12:21.507 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:56: TEST_osd_pool_get_set: ceph osd dump 2024-09-16T03:12:21.507 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:56: TEST_osd_pool_get_set: grep 'pool ' 2024-09-16T03:12:21.507 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:56: TEST_osd_pool_get_set: grep nopgchange 2024-09-16T03:12:21.775 INFO:tasks.workunit.client.0.smithi096.stdout:pool 1 'rbd' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 24 flags hashpspool,nopgchange,creating stripe_width 0 2024-09-16T03:12:21.775 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:58: TEST_osd_pool_get_set: ceph osd pool set rbd nopgchange 0 2024-09-16T03:12:22.284 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 1 nopgchange to 0 2024-09-16T03:12:22.307 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:45: TEST_osd_pool_get_set: for flag in nodelete nopgchange nosizechange write_fadvise_dontneed noscrub nodeep-scrub 2024-09-16T03:12:22.307 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:46: TEST_osd_pool_get_set: ceph osd pool set rbd nosizechange 0 2024-09-16T03:12:22.805 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 1 nosizechange to 0 2024-09-16T03:12:22.828 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:47: TEST_osd_pool_get_set: ceph osd dump 2024-09-16T03:12:22.828 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:47: TEST_osd_pool_get_set: grep 'pool ' 2024-09-16T03:12:22.829 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:47: TEST_osd_pool_get_set: grep nosizechange 2024-09-16T03:12:23.091 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:48: TEST_osd_pool_get_set: ceph osd pool set rbd nosizechange 1 2024-09-16T03:12:23.566 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 1 nosizechange to 1 2024-09-16T03:12:23.585 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:49: TEST_osd_pool_get_set: ceph osd dump 2024-09-16T03:12:23.585 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:49: TEST_osd_pool_get_set: grep 'pool ' 2024-09-16T03:12:23.586 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:49: TEST_osd_pool_get_set: grep nosizechange 2024-09-16T03:12:23.817 INFO:tasks.workunit.client.0.smithi096.stdout:pool 1 'rbd' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 30 flags hashpspool,nosizechange,creating stripe_width 0 2024-09-16T03:12:23.818 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:50: TEST_osd_pool_get_set: ceph osd pool set rbd nosizechange false 2024-09-16T03:12:24.315 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 1 nosizechange to false 2024-09-16T03:12:24.338 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:51: TEST_osd_pool_get_set: ceph osd dump 2024-09-16T03:12:24.338 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:51: TEST_osd_pool_get_set: grep 'pool ' 2024-09-16T03:12:24.338 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:51: TEST_osd_pool_get_set: grep nosizechange 2024-09-16T03:12:24.645 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:52: TEST_osd_pool_get_set: ceph osd pool set rbd nosizechange false 2024-09-16T03:12:25.112 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 1 nosizechange to false 2024-09-16T03:12:25.133 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:54: TEST_osd_pool_get_set: ceph osd dump 2024-09-16T03:12:25.133 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:54: TEST_osd_pool_get_set: grep nosizechange 2024-09-16T03:12:25.133 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:54: TEST_osd_pool_get_set: grep 'pool ' 2024-09-16T03:12:25.397 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:55: TEST_osd_pool_get_set: ceph osd pool set rbd nosizechange true 2024-09-16T03:12:25.864 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 1 nosizechange to true 2024-09-16T03:12:25.885 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:56: TEST_osd_pool_get_set: ceph osd dump 2024-09-16T03:12:25.885 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:56: TEST_osd_pool_get_set: grep 'pool ' 2024-09-16T03:12:25.885 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:56: TEST_osd_pool_get_set: grep nosizechange 2024-09-16T03:12:26.149 INFO:tasks.workunit.client.0.smithi096.stdout:pool 1 'rbd' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 36 flags hashpspool,nosizechange,creating stripe_width 0 2024-09-16T03:12:26.149 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:58: TEST_osd_pool_get_set: ceph osd pool set rbd nosizechange 0 2024-09-16T03:12:26.633 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 1 nosizechange to 0 2024-09-16T03:12:26.655 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:45: TEST_osd_pool_get_set: for flag in nodelete nopgchange nosizechange write_fadvise_dontneed noscrub nodeep-scrub 2024-09-16T03:12:26.655 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:46: TEST_osd_pool_get_set: ceph osd pool set rbd write_fadvise_dontneed 0 2024-09-16T03:12:27.202 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 1 write_fadvise_dontneed to 0 2024-09-16T03:12:27.228 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:47: TEST_osd_pool_get_set: ceph osd dump 2024-09-16T03:12:27.228 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:47: TEST_osd_pool_get_set: grep 'pool ' 2024-09-16T03:12:27.228 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:47: TEST_osd_pool_get_set: grep write_fadvise_dontneed 2024-09-16T03:12:27.487 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:48: TEST_osd_pool_get_set: ceph osd pool set rbd write_fadvise_dontneed 1 2024-09-16T03:12:27.954 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 1 write_fadvise_dontneed to 1 2024-09-16T03:12:27.981 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:49: TEST_osd_pool_get_set: ceph osd dump 2024-09-16T03:12:27.981 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:49: TEST_osd_pool_get_set: grep 'pool ' 2024-09-16T03:12:27.981 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:49: TEST_osd_pool_get_set: grep write_fadvise_dontneed 2024-09-16T03:12:28.233 INFO:tasks.workunit.client.0.smithi096.stdout:pool 1 'rbd' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 42 flags hashpspool,write_fadvise_dontneed,creating stripe_width 0 2024-09-16T03:12:28.233 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:50: TEST_osd_pool_get_set: ceph osd pool set rbd write_fadvise_dontneed false 2024-09-16T03:12:28.707 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 1 write_fadvise_dontneed to false 2024-09-16T03:12:28.732 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:51: TEST_osd_pool_get_set: ceph osd dump 2024-09-16T03:12:28.733 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:51: TEST_osd_pool_get_set: grep 'pool ' 2024-09-16T03:12:28.733 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:51: TEST_osd_pool_get_set: grep write_fadvise_dontneed 2024-09-16T03:12:29.018 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:52: TEST_osd_pool_get_set: ceph osd pool set rbd write_fadvise_dontneed false 2024-09-16T03:12:29.551 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 1 write_fadvise_dontneed to false 2024-09-16T03:12:29.573 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:54: TEST_osd_pool_get_set: ceph osd dump 2024-09-16T03:12:29.573 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:54: TEST_osd_pool_get_set: grep 'pool ' 2024-09-16T03:12:29.573 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:54: TEST_osd_pool_get_set: grep write_fadvise_dontneed 2024-09-16T03:12:29.854 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:55: TEST_osd_pool_get_set: ceph osd pool set rbd write_fadvise_dontneed true 2024-09-16T03:12:30.329 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 1 write_fadvise_dontneed to true 2024-09-16T03:12:30.351 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:56: TEST_osd_pool_get_set: ceph osd dump 2024-09-16T03:12:30.351 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:56: TEST_osd_pool_get_set: grep 'pool ' 2024-09-16T03:12:30.351 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:56: TEST_osd_pool_get_set: grep write_fadvise_dontneed 2024-09-16T03:12:30.605 INFO:tasks.workunit.client.0.smithi096.stdout:pool 1 'rbd' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 48 flags hashpspool,write_fadvise_dontneed,creating stripe_width 0 2024-09-16T03:12:30.606 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:58: TEST_osd_pool_get_set: ceph osd pool set rbd write_fadvise_dontneed 0 2024-09-16T03:12:31.098 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 1 write_fadvise_dontneed to 0 2024-09-16T03:12:31.121 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:45: TEST_osd_pool_get_set: for flag in nodelete nopgchange nosizechange write_fadvise_dontneed noscrub nodeep-scrub 2024-09-16T03:12:31.121 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:46: TEST_osd_pool_get_set: ceph osd pool set rbd noscrub 0 2024-09-16T03:12:31.600 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 1 noscrub to 0 2024-09-16T03:12:31.624 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:47: TEST_osd_pool_get_set: ceph osd dump 2024-09-16T03:12:31.624 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:47: TEST_osd_pool_get_set: grep noscrub 2024-09-16T03:12:31.624 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:47: TEST_osd_pool_get_set: grep 'pool ' 2024-09-16T03:12:31.928 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:48: TEST_osd_pool_get_set: ceph osd pool set rbd noscrub 1 2024-09-16T03:12:32.394 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 1 noscrub to 1 2024-09-16T03:12:32.416 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:49: TEST_osd_pool_get_set: ceph osd dump 2024-09-16T03:12:32.417 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:49: TEST_osd_pool_get_set: grep 'pool ' 2024-09-16T03:12:32.417 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:49: TEST_osd_pool_get_set: grep noscrub 2024-09-16T03:12:32.671 INFO:tasks.workunit.client.0.smithi096.stdout:pool 1 'rbd' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 54 flags hashpspool,noscrub,creating stripe_width 0 2024-09-16T03:12:32.672 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:50: TEST_osd_pool_get_set: ceph osd pool set rbd noscrub false 2024-09-16T03:12:33.147 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 1 noscrub to false 2024-09-16T03:12:33.172 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:51: TEST_osd_pool_get_set: ceph osd dump 2024-09-16T03:12:33.173 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:51: TEST_osd_pool_get_set: grep noscrub 2024-09-16T03:12:33.173 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:51: TEST_osd_pool_get_set: grep 'pool ' 2024-09-16T03:12:33.432 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:52: TEST_osd_pool_get_set: ceph osd pool set rbd noscrub false 2024-09-16T03:12:33.907 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 1 noscrub to false 2024-09-16T03:12:33.929 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:54: TEST_osd_pool_get_set: ceph osd dump 2024-09-16T03:12:33.929 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:54: TEST_osd_pool_get_set: grep 'pool ' 2024-09-16T03:12:33.929 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:54: TEST_osd_pool_get_set: grep noscrub 2024-09-16T03:12:34.210 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:55: TEST_osd_pool_get_set: ceph osd pool set rbd noscrub true 2024-09-16T03:12:34.701 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 1 noscrub to true 2024-09-16T03:12:34.720 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:56: TEST_osd_pool_get_set: ceph osd dump 2024-09-16T03:12:34.720 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:56: TEST_osd_pool_get_set: grep 'pool ' 2024-09-16T03:12:34.720 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:56: TEST_osd_pool_get_set: grep noscrub 2024-09-16T03:12:34.988 INFO:tasks.workunit.client.0.smithi096.stdout:pool 1 'rbd' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 60 flags hashpspool,noscrub,creating stripe_width 0 2024-09-16T03:12:34.988 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:58: TEST_osd_pool_get_set: ceph osd pool set rbd noscrub 0 2024-09-16T03:12:35.446 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 1 noscrub to 0 2024-09-16T03:12:35.465 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:45: TEST_osd_pool_get_set: for flag in nodelete nopgchange nosizechange write_fadvise_dontneed noscrub nodeep-scrub 2024-09-16T03:12:35.465 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:46: TEST_osd_pool_get_set: ceph osd pool set rbd nodeep-scrub 0 2024-09-16T03:12:35.931 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 1 nodeep-scrub to 0 2024-09-16T03:12:36.051 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:47: TEST_osd_pool_get_set: ceph osd dump 2024-09-16T03:12:36.052 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:47: TEST_osd_pool_get_set: grep 'pool ' 2024-09-16T03:12:36.052 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:47: TEST_osd_pool_get_set: grep nodeep-scrub 2024-09-16T03:12:36.217 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:48: TEST_osd_pool_get_set: ceph osd pool set rbd nodeep-scrub 1 2024-09-16T03:12:36.767 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 1 nodeep-scrub to 1 2024-09-16T03:12:36.792 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:49: TEST_osd_pool_get_set: ceph osd dump 2024-09-16T03:12:36.792 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:49: TEST_osd_pool_get_set: grep 'pool ' 2024-09-16T03:12:36.793 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:49: TEST_osd_pool_get_set: grep nodeep-scrub 2024-09-16T03:12:37.086 INFO:tasks.workunit.client.0.smithi096.stdout:pool 1 'rbd' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 66 flags hashpspool,nodeep-scrub,creating stripe_width 0 2024-09-16T03:12:37.086 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:50: TEST_osd_pool_get_set: ceph osd pool set rbd nodeep-scrub false 2024-09-16T03:12:37.553 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 1 nodeep-scrub to false 2024-09-16T03:12:37.573 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:51: TEST_osd_pool_get_set: ceph osd dump 2024-09-16T03:12:37.574 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:51: TEST_osd_pool_get_set: grep nodeep-scrub 2024-09-16T03:12:37.574 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:51: TEST_osd_pool_get_set: grep 'pool ' 2024-09-16T03:12:37.839 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:52: TEST_osd_pool_get_set: ceph osd pool set rbd nodeep-scrub false 2024-09-16T03:12:38.305 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 1 nodeep-scrub to false 2024-09-16T03:12:38.326 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:54: TEST_osd_pool_get_set: ceph osd dump 2024-09-16T03:12:38.326 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:54: TEST_osd_pool_get_set: grep 'pool ' 2024-09-16T03:12:38.327 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:54: TEST_osd_pool_get_set: grep nodeep-scrub 2024-09-16T03:12:38.591 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:55: TEST_osd_pool_get_set: ceph osd pool set rbd nodeep-scrub true 2024-09-16T03:12:39.066 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 1 nodeep-scrub to true 2024-09-16T03:12:39.088 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:56: TEST_osd_pool_get_set: ceph osd dump 2024-09-16T03:12:39.088 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:56: TEST_osd_pool_get_set: grep 'pool ' 2024-09-16T03:12:39.088 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:56: TEST_osd_pool_get_set: grep nodeep-scrub 2024-09-16T03:12:39.394 INFO:tasks.workunit.client.0.smithi096.stdout:pool 1 'rbd' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 72 flags hashpspool,nodeep-scrub,creating stripe_width 0 2024-09-16T03:12:39.395 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:58: TEST_osd_pool_get_set: ceph osd pool set rbd nodeep-scrub 0 2024-09-16T03:12:39.885 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 1 nodeep-scrub to 0 2024-09-16T03:12:39.907 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:61: TEST_osd_pool_get_set: ceph osd pool get rbd size 2024-09-16T03:12:39.907 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:61: TEST_osd_pool_get_set: awk '{print $2}' 2024-09-16T03:12:40.148 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:61: TEST_osd_pool_get_set: local size=3 2024-09-16T03:12:40.149 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:62: TEST_osd_pool_get_set: ceph osd pool get rbd min_size 2024-09-16T03:12:40.149 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:62: TEST_osd_pool_get_set: awk '{print $2}' 2024-09-16T03:12:40.383 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:62: TEST_osd_pool_get_set: local min_size=2 2024-09-16T03:12:40.384 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:63: TEST_osd_pool_get_set: expr 3 - 3 / 2 2024-09-16T03:12:40.385 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:63: TEST_osd_pool_get_set: local expected_min_size=2 2024-09-16T03:12:40.385 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:64: TEST_osd_pool_get_set: '[' 2 -ne 2 ']' 2024-09-16T03:12:40.385 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:69: TEST_osd_pool_get_set: ceph osd pool set rbd scrub_min_interval 123456 2024-09-16T03:12:40.862 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 1 scrub_min_interval to 123456 2024-09-16T03:12:40.884 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:70: TEST_osd_pool_get_set: ceph osd dump 2024-09-16T03:12:40.884 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:70: TEST_osd_pool_get_set: grep 'scrub_min_interval 123456' 2024-09-16T03:12:40.884 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:70: TEST_osd_pool_get_set: grep 'pool ' 2024-09-16T03:12:41.149 INFO:tasks.workunit.client.0.smithi096.stdout:pool 1 'rbd' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 76 flags hashpspool,creating stripe_width 0 scrub_min_interval 123456 2024-09-16T03:12:41.149 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:71: TEST_osd_pool_get_set: ceph osd pool set rbd scrub_min_interval 0 2024-09-16T03:12:41.615 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 1 scrub_min_interval to 0 2024-09-16T03:12:41.638 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:72: TEST_osd_pool_get_set: grep 'pool ' 2024-09-16T03:12:41.638 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:72: TEST_osd_pool_get_set: ceph osd dump 2024-09-16T03:12:41.638 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:72: TEST_osd_pool_get_set: grep scrub_min_interval 2024-09-16T03:12:41.900 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:73: TEST_osd_pool_get_set: ceph osd pool set rbd scrub_max_interval 123456 2024-09-16T03:12:42.367 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 1 scrub_max_interval to 123456 2024-09-16T03:12:42.391 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:74: TEST_osd_pool_get_set: ceph osd dump 2024-09-16T03:12:42.391 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:74: TEST_osd_pool_get_set: grep 'pool ' 2024-09-16T03:12:42.391 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:74: TEST_osd_pool_get_set: grep 'scrub_max_interval 123456' 2024-09-16T03:12:42.661 INFO:tasks.workunit.client.0.smithi096.stdout:pool 1 'rbd' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 80 flags hashpspool,creating stripe_width 0 scrub_max_interval 123456 2024-09-16T03:12:42.662 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:75: TEST_osd_pool_get_set: ceph osd pool set rbd scrub_max_interval 0 2024-09-16T03:12:43.203 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 1 scrub_max_interval to 0 2024-09-16T03:12:43.231 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:76: TEST_osd_pool_get_set: ceph osd dump 2024-09-16T03:12:43.231 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:76: TEST_osd_pool_get_set: grep 'pool ' 2024-09-16T03:12:43.231 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:76: TEST_osd_pool_get_set: grep scrub_max_interval 2024-09-16T03:12:43.487 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:77: TEST_osd_pool_get_set: ceph osd pool set rbd deep_scrub_interval 123456 2024-09-16T03:12:43.955 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 1 deep_scrub_interval to 123456 2024-09-16T03:12:43.977 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:78: TEST_osd_pool_get_set: ceph osd dump 2024-09-16T03:12:43.977 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:78: TEST_osd_pool_get_set: grep 'pool ' 2024-09-16T03:12:43.977 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:78: TEST_osd_pool_get_set: grep 'deep_scrub_interval 123456' 2024-09-16T03:12:44.232 INFO:tasks.workunit.client.0.smithi096.stdout:pool 1 'rbd' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 84 flags hashpspool,creating stripe_width 0 deep_scrub_interval 123456 2024-09-16T03:12:44.232 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:79: TEST_osd_pool_get_set: ceph osd pool set rbd deep_scrub_interval 0 2024-09-16T03:12:44.700 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 1 deep_scrub_interval to 0 2024-09-16T03:12:44.721 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:80: TEST_osd_pool_get_set: ceph osd dump 2024-09-16T03:12:44.721 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:80: TEST_osd_pool_get_set: grep deep_scrub_interval 2024-09-16T03:12:44.721 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:80: TEST_osd_pool_get_set: grep 'pool ' 2024-09-16T03:12:45.017 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:83: TEST_osd_pool_get_set: ceph osd pool set rbd 11 2024-09-16T03:12:45.223 INFO:tasks.workunit.client.0.smithi096.stderr:Invalid command: 11 not in size|min_size|pg_num|pgp_num|pgp_num_actual|crush_rule|hashpspool|nodelete|nopgchange|nosizechange|write_fadvise_dontneed|noscrub|nodeep-scrub|hit_set_type|hit_set_period|hit_set_count|hit_set_fpp|use_gmt_hitset|target_max_bytes|target_max_objects|cache_target_dirty_ratio|cache_target_dirty_high_ratio|cache_target_full_ratio|cache_min_flush_age|cache_min_evict_age|min_read_recency_for_promote|min_write_recency_for_promote|fast_read|hit_set_grade_decay_rate|hit_set_search_last_n|scrub_min_interval|scrub_max_interval|deep_scrub_interval|recovery_priority|recovery_op_priority|scrub_priority|compression_mode|compression_algorithm|compression_required_ratio|compression_max_blob_size|compression_min_blob_size|csum_type|csum_min_block|csum_max_block|allow_ec_overwrites|fingerprint_algorithm|pg_autoscale_mode|pg_autoscale_bias|pg_num_min|pg_num_max|target_size_bytes|target_size_ratio|dedup_tier|dedup_chunk_algorithm|dedup_cdc_chunk_size|eio|bulk|read_ratio 2024-09-16T03:12:45.223 INFO:tasks.workunit.client.0.smithi096.stderr:osd pool set [--yes-i-really-mean-it] : set pool parameter to 2024-09-16T03:12:45.223 INFO:tasks.workunit.client.0.smithi096.stderr:Error EINVAL: invalid command 2024-09-16T03:12:45.226 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:85: TEST_osd_pool_get_set: expr 3 + 1 2024-09-16T03:12:45.228 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:85: TEST_osd_pool_get_set: ceph osd pool set rbd min_size 4 2024-09-16T03:12:45.403 INFO:tasks.workunit.client.0.smithi096.stderr:Error EINVAL: pool min_size must be between 1 and size, which is set to 3 2024-09-16T03:12:45.406 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:86: TEST_osd_pool_get_set: ceph osd pool set rbd min_size 0 2024-09-16T03:12:45.618 INFO:tasks.workunit.client.0.smithi096.stderr:Error EINVAL: pool min_size must be between 1 and size, which is set to 3 2024-09-16T03:12:45.621 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:88: TEST_osd_pool_get_set: local ecpool=erasepool 2024-09-16T03:12:45.621 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:89: TEST_osd_pool_get_set: create_pool erasepool 12 12 erasure default 2024-09-16T03:12:45.621 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create erasepool 12 12 erasure default 2024-09-16T03:12:46.262 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'erasepool' already exists 2024-09-16T03:12:46.282 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2024-09-16T03:12:47.285 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:91: TEST_osd_pool_get_set: ceph osd pool get erasepool size 2024-09-16T03:12:47.285 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:91: TEST_osd_pool_get_set: awk '{print $2}' 2024-09-16T03:12:47.528 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:91: TEST_osd_pool_get_set: local size=4 2024-09-16T03:12:47.529 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:92: TEST_osd_pool_get_set: ceph osd pool get erasepool min_size 2024-09-16T03:12:47.529 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:92: TEST_osd_pool_get_set: awk '{print $2}' 2024-09-16T03:12:47.766 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:92: TEST_osd_pool_get_set: local min_size=3 2024-09-16T03:12:47.766 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:93: TEST_osd_pool_get_set: expr 3 - 1 2024-09-16T03:12:47.767 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:93: TEST_osd_pool_get_set: local k=2 2024-09-16T03:12:47.768 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:95: TEST_osd_pool_get_set: expr 4 + 1 2024-09-16T03:12:47.769 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:95: TEST_osd_pool_get_set: ceph osd pool set erasepool size 5 2024-09-16T03:12:47.945 INFO:tasks.workunit.client.0.smithi096.stderr:Error ENOTSUP: can not change the size of an erasure-coded pool 2024-09-16T03:12:47.950 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:97: TEST_osd_pool_get_set: expr 2 + 1 2024-09-16T03:12:47.950 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:97: TEST_osd_pool_get_set: ceph osd pool set erasepool min_size 3 2024-09-16T03:12:48.423 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 2 min_size to 3 2024-09-16T03:12:48.443 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:98: TEST_osd_pool_get_set: expr 2 - 1 2024-09-16T03:12:48.444 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:98: TEST_osd_pool_get_set: ceph osd pool set erasepool min_size 1 2024-09-16T03:12:48.628 INFO:tasks.workunit.client.0.smithi096.stderr:Error EINVAL: pool min_size must be between 2 and size, which is set to 4 2024-09-16T03:12:48.632 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:99: TEST_osd_pool_get_set: expr 4 + 1 2024-09-16T03:12:48.633 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:99: TEST_osd_pool_get_set: ceph osd pool set erasepool min_size 5 2024-09-16T03:12:48.843 INFO:tasks.workunit.client.0.smithi096.stderr:Error EINVAL: pool min_size must be between 2 and size, which is set to 4 2024-09-16T03:12:48.846 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh:101: TEST_osd_pool_get_set: teardown td/misc 2024-09-16T03:12:48.846 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/misc 2024-09-16T03:12:48.846 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:12:48.847 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/misc KILL 2024-09-16T03:12:48.847 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:12:48.847 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:12:48.847 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:12:48.847 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:12:48.848 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:12:48.954 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:12:48.955 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:12:48.956 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:12:48.956 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:12:48.958 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:12:48.959 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:12:48.959 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:12:48.960 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:12:48.960 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:12:48.961 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:12:48.961 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:12:48.962 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:12:48.963 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:12:48.963 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/misc 2024-09-16T03:12:48.968 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:12:48.968 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:12:48.968 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.29106 2024-09-16T03:12:48.968 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.29106 2024-09-16T03:12:48.969 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:12:48.970 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:12:48.970 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2322: main: code=0 2024-09-16T03:12:48.970 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2326: main: teardown td/misc 0 2024-09-16T03:12:48.970 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/misc 2024-09-16T03:12:48.970 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2024-09-16T03:12:48.970 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/misc KILL 2024-09-16T03:12:48.971 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:12:48.971 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:12:48.971 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:12:48.971 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:12:48.972 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:12:48.974 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:12:48.974 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:12:48.975 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:12:48.975 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:12:48.977 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:12:48.977 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:12:48.977 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:12:48.978 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:12:48.978 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:12:48.978 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:12:48.979 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:12:48.979 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:12:48.980 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2024-09-16T03:12:48.981 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/misc 2024-09-16T03:12:48.982 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:12:48.982 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:12:48.982 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.29106 2024-09-16T03:12:48.982 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.29106 2024-09-16T03:12:48.983 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:12:48.983 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:12:48.983 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2327: main: return 0 2024-09-16T03:12:48.985 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-16T03:12:48.985 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-16T03:12:48.997 INFO:tasks.workunit:Running workunit mon/mkfs.sh... 2024-09-16T03:12:48.997 DEBUG:teuthology.orchestra.run.smithi096:workunit test mon/mkfs.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7498493279982dfe87f00616198a5967475f6169 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh 2024-09-16T03:12:49.052 INFO:tasks.workunit.client.0.smithi096.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2024-09-16T03:12:49.052 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:22: : DIR=mkfs 2024-09-16T03:12:49.052 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:23: : export CEPH_CONF=/dev/null 2024-09-16T03:12:49.052 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:23: : CEPH_CONF=/dev/null 2024-09-16T03:12:49.052 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:24: : unset CEPH_ARGS 2024-09-16T03:12:49.052 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:25: : MON_ID=a 2024-09-16T03:12:49.052 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:26: : MON_DIR=mkfs/a 2024-09-16T03:12:49.052 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:27: : CEPH_MON=127.0.0.1:7110 2024-09-16T03:12:49.052 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:28: : TIMEOUT=360 2024-09-16T03:12:49.052 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:30: : EXTRAOPTS= 2024-09-16T03:12:49.053 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:188: : run 2024-09-16T03:12:49.053 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:175: run: local actions 2024-09-16T03:12:49.053 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:176: run: actions+='makedir ' 2024-09-16T03:12:49.053 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:177: run: actions+='idempotent ' 2024-09-16T03:12:49.053 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:178: run: actions+='auth_cephx_key ' 2024-09-16T03:12:49.053 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:179: run: actions+='auth_cephx_keyring ' 2024-09-16T03:12:49.053 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:180: run: actions+='auth_none ' 2024-09-16T03:12:49.053 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:181: run: for action in $actions 2024-09-16T03:12:49.053 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:182: run: setup 2024-09-16T03:12:49.053 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:33: setup: teardown 2024-09-16T03:12:49.053 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:38: teardown: kill_daemons 2024-09-16T03:12:49.053 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:73: kill_daemons: find mkfs -name pidfile 2024-09-16T03:12:49.055 INFO:tasks.workunit.client.0.smithi096.stderr:find: 'mkfs': No such file or directory 2024-09-16T03:12:49.055 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:39: teardown: rm -fr mkfs 2024-09-16T03:12:49.055 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:34: setup: mkdir mkfs 2024-09-16T03:12:49.055 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:183: run: makedir 2024-09-16T03:12:49.055 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:149: makedir: local toodeep=mkfs/a/toodeep 2024-09-16T03:12:49.055 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:153: makedir: ceph-mon --id a --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mkfs --mon-data=mkfs/a/toodeep 2024-09-16T03:12:49.055 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:158: makedir: tee mkfs/makedir.log 2024-09-16T03:12:49.079 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T03:12:49.077+0000 7fdb0285ce00 -1 mkdir(mkfs/a/toodeep) : (2) No such file or directory 2024-09-16T03:12:49.081 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:159: makedir: grep 'toodeep.*No such file' mkfs/makedir.log 2024-09-16T03:12:49.083 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:160: makedir: rm mkfs/makedir.log 2024-09-16T03:12:49.083 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:163: makedir: mkdir mkfs/a 2024-09-16T03:12:49.085 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:164: makedir: mon_mkfs --auth-supported=none 2024-09-16T03:12:49.085 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:164: makedir: tee mkfs/makedir.log 2024-09-16T03:12:49.085 INFO:tasks.workunit.client.0.smithi096.stdout://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:43: mon_mkfs: uuidgen 2024-09-16T03:12:49.086 INFO:tasks.workunit.client.0.smithi096.stdout:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:43: mon_mkfs: local fsid=3b93ccd8-688e-4bde-a92b-3761a3fb6b64 2024-09-16T03:12:49.086 INFO:tasks.workunit.client.0.smithi096.stdout:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:46: mon_mkfs: ceph-mon --id a --fsid 3b93ccd8-688e-4bde-a92b-3761a3fb6b64 --mkfs --mon-data=mkfs/a --mon-initial-members=a --mon-host=127.0.0.1:7110 --auth-supported=none 2024-09-16T03:12:49.551 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:165: makedir: grep 'mkfs/a already exists' mkfs/makedir.log 2024-09-16T03:12:49.553 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:184: run: teardown 2024-09-16T03:12:49.553 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:38: teardown: kill_daemons 2024-09-16T03:12:49.554 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:73: kill_daemons: find mkfs -name pidfile 2024-09-16T03:12:49.555 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:39: teardown: rm -fr mkfs 2024-09-16T03:12:49.557 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:181: run: for action in $actions 2024-09-16T03:12:49.557 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:182: run: setup 2024-09-16T03:12:49.557 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:33: setup: teardown 2024-09-16T03:12:49.557 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:38: teardown: kill_daemons 2024-09-16T03:12:49.557 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:73: kill_daemons: find mkfs -name pidfile 2024-09-16T03:12:49.559 INFO:tasks.workunit.client.0.smithi096.stderr:find: 'mkfs': No such file or directory 2024-09-16T03:12:49.559 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:39: teardown: rm -fr mkfs 2024-09-16T03:12:49.560 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:34: setup: mkdir mkfs 2024-09-16T03:12:49.562 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:183: run: idempotent 2024-09-16T03:12:49.562 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:169: idempotent: mon_mkfs --auth-supported=none 2024-09-16T03:12:49.562 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:43: mon_mkfs: uuidgen 2024-09-16T03:12:49.563 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:43: mon_mkfs: local fsid=d6c37f7c-a8cb-4f55-a125-daa7a8e29007 2024-09-16T03:12:49.563 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:46: mon_mkfs: ceph-mon --id a --fsid d6c37f7c-a8cb-4f55-a125-daa7a8e29007 --mkfs --mon-data=mkfs/a --mon-initial-members=a --mon-host=127.0.0.1:7110 --auth-supported=none 2024-09-16T03:12:50.045 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:170: idempotent: mon_mkfs --auth-supported=none 2024-09-16T03:12:50.045 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:170: idempotent: tee mkfs/makedir.log 2024-09-16T03:12:50.047 INFO:tasks.workunit.client.0.smithi096.stdout://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:43: mon_mkfs: uuidgen 2024-09-16T03:12:50.047 INFO:tasks.workunit.client.0.smithi096.stdout:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:43: mon_mkfs: local fsid=55749f63-0cc7-4b5b-a237-a7da3aee8075 2024-09-16T03:12:50.047 INFO:tasks.workunit.client.0.smithi096.stdout:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:46: mon_mkfs: ceph-mon --id a --fsid 55749f63-0cc7-4b5b-a237-a7da3aee8075 --mkfs --mon-data=mkfs/a --mon-initial-members=a --mon-host=127.0.0.1:7110 --auth-supported=none 2024-09-16T03:12:50.068 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T03:12:50.065+0000 7fb8f75e5e00 -1 'mkfs/a' already exists and is not empty: monitor may already exist 2024-09-16T03:12:50.070 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:171: idempotent: grep ''\''mkfs/a'\'' already exists' mkfs/makedir.log 2024-09-16T03:12:50.071 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:184: run: teardown 2024-09-16T03:12:50.071 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:38: teardown: kill_daemons 2024-09-16T03:12:50.071 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:73: kill_daemons: find mkfs -name pidfile 2024-09-16T03:12:50.072 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:39: teardown: rm -fr mkfs 2024-09-16T03:12:50.074 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:181: run: for action in $actions 2024-09-16T03:12:50.074 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:182: run: setup 2024-09-16T03:12:50.074 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:33: setup: teardown 2024-09-16T03:12:50.074 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:38: teardown: kill_daemons 2024-09-16T03:12:50.074 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:73: kill_daemons: find mkfs -name pidfile 2024-09-16T03:12:50.075 INFO:tasks.workunit.client.0.smithi096.stderr:find: 'mkfs': No such file or directory 2024-09-16T03:12:50.075 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:39: teardown: rm -fr mkfs 2024-09-16T03:12:50.076 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:34: setup: mkdir mkfs 2024-09-16T03:12:50.077 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:183: run: auth_cephx_key 2024-09-16T03:12:50.077 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:122: auth_cephx_key: '[' -f /etc/ceph/keyring ']' 2024-09-16T03:12:50.077 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:127: auth_cephx_key: ceph-authtool --gen-print-key 2024-09-16T03:12:50.095 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:127: auth_cephx_key: local key=AQAyoudmswGYBRAAPFmEUXdNOg1KCBUwzOPt/g== 2024-09-16T03:12:50.095 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:129: auth_cephx_key: mon_mkfs '--key=corrupted key' 2024-09-16T03:12:50.096 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:43: mon_mkfs: uuidgen 2024-09-16T03:12:50.096 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:43: mon_mkfs: local fsid=b562b74c-8832-4850-83f3-dd8e6c9166ec 2024-09-16T03:12:50.097 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:46: mon_mkfs: ceph-mon --id a --fsid b562b74c-8832-4850-83f3-dd8e6c9166ec --mkfs --mon-data=mkfs/a --mon-initial-members=a --mon-host=127.0.0.1:7110 '--key=corrupted key' 2024-09-16T03:12:50.460 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:12:50.457+0000 7faf16426e00 -1 mon.a@-1(???) e0 error decoding keyring [mon.] 2024-09-16T03:12:50.460 INFO:tasks.workunit.client.0.smithi096.stderr: key = corrupted key 2024-09-16T03:12:50.460 INFO:tasks.workunit.client.0.smithi096.stderr: caps mon = "allow *" 2024-09-16T03:12:50.460 INFO:tasks.workunit.client.0.smithi096.stderr:: error setting modifier for [mon.] type=key val=corrupted key: Malformed input [buffer:3] 2024-09-16T03:12:50.460 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:12:50.457+0000 7faf16426e00 -1 ceph-mon: error creating monfs: (22) Invalid argument 2024-09-16T03:12:50.463 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:132: auth_cephx_key: rm -fr mkfs/a 2024-09-16T03:12:50.464 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:135: auth_cephx_key: mon_mkfs --key=AQAyoudmswGYBRAAPFmEUXdNOg1KCBUwzOPt/g== 2024-09-16T03:12:50.465 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:43: mon_mkfs: uuidgen 2024-09-16T03:12:50.466 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:43: mon_mkfs: local fsid=9fd66ef0-0e00-4908-925c-524dcaed4454 2024-09-16T03:12:50.466 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:46: mon_mkfs: ceph-mon --id a --fsid 9fd66ef0-0e00-4908-925c-524dcaed4454 --mkfs --mon-data=mkfs/a --mon-initial-members=a --mon-host=127.0.0.1:7110 --key=AQAyoudmswGYBRAAPFmEUXdNOg1KCBUwzOPt/g== 2024-09-16T03:12:50.933 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:137: auth_cephx_key: '[' -f mkfs/a/keyring ']' 2024-09-16T03:12:50.933 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:138: auth_cephx_key: grep AQAyoudmswGYBRAAPFmEUXdNOg1KCBUwzOPt/g== mkfs/a/keyring 2024-09-16T03:12:50.934 INFO:tasks.workunit.client.0.smithi096.stdout: key = AQAyoudmswGYBRAAPFmEUXdNOg1KCBUwzOPt/g== 2024-09-16T03:12:50.935 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:140: auth_cephx_key: mon_run 2024-09-16T03:12:50.935 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:58: mon_run: ceph-mon --id a --chdir= --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data=mkfs/a --log-file=mkfs/a/log --mon-cluster-log-file=mkfs/a/log --run-dir=mkfs/a --pid-file=mkfs/a/pidfile --public-addr 127.0.0.1:7110 2024-09-16T03:12:51.136 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:142: auth_cephx_key: timeout 360 ceph --name mon. --keyring mkfs/a/keyring --mon-host 127.0.0.1:7110 mon stat 2024-09-16T03:12:51.989 INFO:tasks.workunit.client.0.smithi096.stdout:e1: 1 mons at {a=v2:127.0.0.1:7110/0} removed_ranks: {} disallowed_leaders: {}, election epoch 3, leader 0 a, quorum 0 a 2024-09-16T03:12:52.005 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:184: run: teardown 2024-09-16T03:12:52.005 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:38: teardown: kill_daemons 2024-09-16T03:12:52.005 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:73: kill_daemons: find mkfs -name pidfile 2024-09-16T03:12:52.007 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:73: kill_daemons: for pidfile in $(find $DIR -name pidfile) 2024-09-16T03:12:52.007 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:74: kill_daemons: cat mkfs/a/pidfile 2024-09-16T03:12:52.008 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:74: kill_daemons: pid=33045 2024-09-16T03:12:52.008 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:75: kill_daemons: for try in 0 1 1 1 2 3 2024-09-16T03:12:52.008 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:76: kill_daemons: kill 33045 2024-09-16T03:12:52.008 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:77: kill_daemons: sleep 0 2024-09-16T03:12:52.009 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:75: kill_daemons: for try in 0 1 1 1 2 3 2024-09-16T03:12:52.009 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:76: kill_daemons: kill 33045 2024-09-16T03:12:52.009 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:77: kill_daemons: sleep 1 2024-09-16T03:12:53.011 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:75: kill_daemons: for try in 0 1 1 1 2 3 2024-09-16T03:12:53.011 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:76: kill_daemons: kill 33045 2024-09-16T03:12:53.011 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh: line 76: kill: (33045) - No such process 2024-09-16T03:12:53.011 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:76: kill_daemons: break 2024-09-16T03:12:53.012 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:39: teardown: rm -fr mkfs 2024-09-16T03:12:53.013 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:181: run: for action in $actions 2024-09-16T03:12:53.014 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:182: run: setup 2024-09-16T03:12:53.014 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:33: setup: teardown 2024-09-16T03:12:53.014 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:38: teardown: kill_daemons 2024-09-16T03:12:53.015 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:73: kill_daemons: find mkfs -name pidfile 2024-09-16T03:12:53.015 INFO:tasks.workunit.client.0.smithi096.stderr:find: 'mkfs': No such file or directory 2024-09-16T03:12:53.015 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:39: teardown: rm -fr mkfs 2024-09-16T03:12:53.016 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:34: setup: mkdir mkfs 2024-09-16T03:12:53.017 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:183: run: auth_cephx_keyring 2024-09-16T03:12:53.017 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:103: auth_cephx_keyring: cat 2024-09-16T03:12:53.017 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:109: auth_cephx_keyring: mon_mkfs --keyring=mkfs/keyring 2024-09-16T03:12:53.018 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:43: mon_mkfs: uuidgen 2024-09-16T03:12:53.019 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:43: mon_mkfs: local fsid=8db51823-1e40-43c3-ab0f-48c3698d1dae 2024-09-16T03:12:53.019 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:46: mon_mkfs: ceph-mon --id a --fsid 8db51823-1e40-43c3-ab0f-48c3698d1dae --mkfs --mon-data=mkfs/a --mon-initial-members=a --mon-host=127.0.0.1:7110 --keyring=mkfs/keyring 2024-09-16T03:12:53.464 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:111: auth_cephx_keyring: '[' -f mkfs/a/keyring ']' 2024-09-16T03:12:53.464 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:113: auth_cephx_keyring: mon_run 2024-09-16T03:12:53.464 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:58: mon_run: ceph-mon --id a --chdir= --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data=mkfs/a --log-file=mkfs/a/log --mon-cluster-log-file=mkfs/a/log --run-dir=mkfs/a --pid-file=mkfs/a/pidfile --public-addr 127.0.0.1:7110 2024-09-16T03:12:53.659 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:115: auth_cephx_keyring: timeout 360 ceph --name mon. --keyring mkfs/a/keyring --mon-host 127.0.0.1:7110 mon stat 2024-09-16T03:12:55.309 INFO:tasks.workunit.client.0.smithi096.stdout:e1: 1 mons at {a=v2:127.0.0.1:7110/0} removed_ranks: {} disallowed_leaders: {}, election epoch 3, leader 0 a, quorum 0 a 2024-09-16T03:12:55.324 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:184: run: teardown 2024-09-16T03:12:55.324 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:38: teardown: kill_daemons 2024-09-16T03:12:55.325 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:73: kill_daemons: find mkfs -name pidfile 2024-09-16T03:12:55.327 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:73: kill_daemons: for pidfile in $(find $DIR -name pidfile) 2024-09-16T03:12:55.327 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:74: kill_daemons: cat mkfs/a/pidfile 2024-09-16T03:12:55.328 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:74: kill_daemons: pid=33142 2024-09-16T03:12:55.328 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:75: kill_daemons: for try in 0 1 1 1 2 3 2024-09-16T03:12:55.328 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:76: kill_daemons: kill 33142 2024-09-16T03:12:55.328 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:77: kill_daemons: sleep 0 2024-09-16T03:12:55.329 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:75: kill_daemons: for try in 0 1 1 1 2 3 2024-09-16T03:12:55.329 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:76: kill_daemons: kill 33142 2024-09-16T03:12:55.329 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:77: kill_daemons: sleep 1 2024-09-16T03:12:56.330 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:75: kill_daemons: for try in 0 1 1 1 2 3 2024-09-16T03:12:56.330 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:76: kill_daemons: kill 33142 2024-09-16T03:12:56.330 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh: line 76: kill: (33142) - No such process 2024-09-16T03:12:56.330 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:76: kill_daemons: break 2024-09-16T03:12:56.330 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:39: teardown: rm -fr mkfs 2024-09-16T03:12:56.331 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:181: run: for action in $actions 2024-09-16T03:12:56.331 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:182: run: setup 2024-09-16T03:12:56.332 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:33: setup: teardown 2024-09-16T03:12:56.332 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:38: teardown: kill_daemons 2024-09-16T03:12:56.332 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:73: kill_daemons: find mkfs -name pidfile 2024-09-16T03:12:56.333 INFO:tasks.workunit.client.0.smithi096.stderr:find: 'mkfs': No such file or directory 2024-09-16T03:12:56.334 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:39: teardown: rm -fr mkfs 2024-09-16T03:12:56.335 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:34: setup: mkdir mkfs 2024-09-16T03:12:56.336 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:183: run: auth_none 2024-09-16T03:12:56.336 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:83: auth_none: mon_mkfs --auth-supported=none 2024-09-16T03:12:56.337 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:43: mon_mkfs: uuidgen 2024-09-16T03:12:56.338 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:43: mon_mkfs: local fsid=75655151-9a85-4edb-be17-427dfdc08860 2024-09-16T03:12:56.338 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:46: mon_mkfs: ceph-mon --id a --fsid 75655151-9a85-4edb-be17-427dfdc08860 --mkfs --mon-data=mkfs/a --mon-initial-members=a --mon-host=127.0.0.1:7110 --auth-supported=none 2024-09-16T03:12:56.802 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:86: auth_none: ceph-mon --id a --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data=mkfs/a --extract-monmap mkfs/a/monmap 2024-09-16T03:12:56.989 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:12:56.984+0000 7f32a0449e00 -1 wrote monmap to mkfs/a/monmap 2024-09-16T03:12:56.991 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:93: auth_none: '[' -f mkfs/a/monmap ']' 2024-09-16T03:12:56.991 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:95: auth_none: '[' '!' -f mkfs/a/keyring ']' 2024-09-16T03:12:56.992 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:97: auth_none: mon_run --auth-supported=none 2024-09-16T03:12:56.992 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:58: mon_run: ceph-mon --id a --chdir= --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data=mkfs/a --log-file=mkfs/a/log --mon-cluster-log-file=mkfs/a/log --run-dir=mkfs/a --pid-file=mkfs/a/pidfile --public-addr 127.0.0.1:7110 --auth-supported=none 2024-09-16T03:12:57.173 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:99: auth_none: timeout 360 ceph --mon-host 127.0.0.1:7110 mon stat 2024-09-16T03:12:57.286 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:12:57.280+0000 7fd12ee0d640 -1 auth: unable to find a keyring on /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin: (2) No such file or directory 2024-09-16T03:12:57.286 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:12:57.280+0000 7fd12ee0d640 -1 AuthRegistry(0x7fd1280697d0) no keyring found at /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin, disabling cephx 2024-09-16T03:12:57.286 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:12:57.284+0000 7fd12ee0d640 -1 auth: unable to find a keyring on /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin: (2) No such file or directory 2024-09-16T03:12:57.287 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:12:57.284+0000 7fd12ee0d640 -1 AuthRegistry(0x7fd12ee0bf50) no keyring found at /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin, disabling cephx 2024-09-16T03:12:57.898 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:12:57.892+0000 7fd12ee0d640 -1 auth: unable to find a keyring on /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin: (2) No such file or directory 2024-09-16T03:12:57.899 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:12:57.892+0000 7fd12ee0d640 -1 AuthRegistry(0x7fd128066b60) no keyring found at /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin, disabling cephx 2024-09-16T03:12:57.899 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:12:57.892+0000 7fd12ee0d640 -1 auth: unable to find a keyring on /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin: (2) No such file or directory 2024-09-16T03:12:57.899 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:12:57.892+0000 7fd12ee0d640 -1 AuthRegistry(0x7fd128107ed0) no keyring found at /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin, disabling cephx 2024-09-16T03:12:57.899 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:12:57.896+0000 7fd12ee0d640 -1 auth: unable to find a keyring on /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin: (2) No such file or directory 2024-09-16T03:12:57.899 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:12:57.896+0000 7fd12ee0d640 -1 AuthRegistry(0x7fd128066b60) no keyring found at /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin, disabling cephx 2024-09-16T03:12:58.013 INFO:tasks.workunit.client.0.smithi096.stdout:e1: 1 mons at {a=v2:127.0.0.1:7110/0} removed_ranks: {} disallowed_leaders: {}, election epoch 3, leader 0 a, quorum 0 a 2024-09-16T03:12:58.028 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:184: run: teardown 2024-09-16T03:12:58.028 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:38: teardown: kill_daemons 2024-09-16T03:12:58.028 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:73: kill_daemons: find mkfs -name pidfile 2024-09-16T03:12:58.029 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:73: kill_daemons: for pidfile in $(find $DIR -name pidfile) 2024-09-16T03:12:58.030 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:74: kill_daemons: cat mkfs/a/pidfile 2024-09-16T03:12:58.030 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:74: kill_daemons: pid=33260 2024-09-16T03:12:58.030 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:75: kill_daemons: for try in 0 1 1 1 2 3 2024-09-16T03:12:58.031 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:76: kill_daemons: kill 33260 2024-09-16T03:12:58.031 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:77: kill_daemons: sleep 0 2024-09-16T03:12:58.031 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:75: kill_daemons: for try in 0 1 1 1 2 3 2024-09-16T03:12:58.031 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:76: kill_daemons: kill 33260 2024-09-16T03:12:58.031 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:77: kill_daemons: sleep 1 2024-09-16T03:12:59.033 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:75: kill_daemons: for try in 0 1 1 1 2 3 2024-09-16T03:12:59.033 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:76: kill_daemons: kill 33260 2024-09-16T03:12:59.033 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh: line 76: kill: (33260) - No such process 2024-09-16T03:12:59.033 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:76: kill_daemons: break 2024-09-16T03:12:59.033 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh:39: teardown: rm -fr mkfs 2024-09-16T03:12:59.036 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-16T03:12:59.036 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-16T03:12:59.092 INFO:tasks.workunit:Running workunit mon/mon-bind.sh... 2024-09-16T03:12:59.092 DEBUG:teuthology.orchestra.run.smithi096:workunit test mon/mon-bind.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7498493279982dfe87f00616198a5967475f6169 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh 2024-09-16T03:12:59.147 INFO:tasks.workunit.client.0.smithi096.stderr:stty: 'standard input': Inappropriate ioctl for device 2024-09-16T03:12:59.153 INFO:tasks.workunit.client.0.smithi096.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2024-09-16T03:12:59.153 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2315: main: export PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-16T03:12:59.153 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2315: main: PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-16T03:12:59.153 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2316: main: export PYTHONWARNINGS=ignore 2024-09-16T03:12:59.153 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2316: main: PYTHONWARNINGS=ignore 2024-09-16T03:12:59.153 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2317: main: export CEPH_CONF=/dev/null 2024-09-16T03:12:59.154 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2317: main: CEPH_CONF=/dev/null 2024-09-16T03:12:59.154 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2318: main: unset CEPH_ARGS 2024-09-16T03:12:59.154 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2320: main: local code 2024-09-16T03:12:59.154 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2321: main: run td/mon-bind 2024-09-16T03:12:59.154 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:37: run: local dir=td/mon-bind 2024-09-16T03:12:59.154 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:38: run: shift 2024-09-16T03:12:59.154 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:40: run: export MON_IP=127.0.0.1 2024-09-16T03:12:59.154 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:40: run: MON_IP=127.0.0.1 2024-09-16T03:12:59.154 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:41: run: export MONA_PUBLIC=7132 2024-09-16T03:12:59.154 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:41: run: MONA_PUBLIC=7132 2024-09-16T03:12:59.154 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:42: run: export MONB_PUBLIC=7133 2024-09-16T03:12:59.154 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:42: run: MONB_PUBLIC=7133 2024-09-16T03:12:59.154 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:43: run: export MONC_PUBLIC=7134 2024-09-16T03:12:59.155 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:43: run: MONC_PUBLIC=7134 2024-09-16T03:12:59.155 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:44: run: export MONA_BIND=7135 2024-09-16T03:12:59.155 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:44: run: MONA_BIND=7135 2024-09-16T03:12:59.155 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:45: run: export MONB_BIND=7136 2024-09-16T03:12:59.155 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:45: run: MONB_BIND=7136 2024-09-16T03:12:59.155 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:46: run: export MONC_BIND=7137 2024-09-16T03:12:59.155 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:46: run: MONC_BIND=7137 2024-09-16T03:12:59.155 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:47: run: export CEPH_ARGS 2024-09-16T03:12:59.155 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:48: run: uuidgen 2024-09-16T03:12:59.155 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:48: run: CEPH_ARGS+='--fsid=f50875ee-5756-4303-ab8d-45e11d049850 --auth-supported=none ' 2024-09-16T03:12:59.157 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:50: run: set 2024-09-16T03:12:59.157 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:50: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2024-09-16T03:12:59.157 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:50: run: local 'funcs=TEST_mon_client_connect 2024-09-16T03:12:59.157 INFO:tasks.workunit.client.0.smithi096.stderr:TEST_mon_client_connect_fails 2024-09-16T03:12:59.157 INFO:tasks.workunit.client.0.smithi096.stderr:TEST_mon_quorum 2024-09-16T03:12:59.158 INFO:tasks.workunit.client.0.smithi096.stderr:TEST_put_get' 2024-09-16T03:12:59.158 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:51: run: for func in $funcs 2024-09-16T03:12:59.158 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:52: run: setup td/mon-bind 2024-09-16T03:12:59.158 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/mon-bind 2024-09-16T03:12:59.158 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/mon-bind 2024-09-16T03:12:59.158 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/mon-bind 2024-09-16T03:12:59.158 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:12:59.158 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/mon-bind KILL 2024-09-16T03:12:59.158 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:12:59.158 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:12:59.158 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:12:59.158 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:12:59.158 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:12:59.159 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:12:59.159 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:12:59.160 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:12:59.160 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:12:59.161 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:12:59.161 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:12:59.162 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:12:59.162 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:12:59.163 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:12:59.163 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:12:59.163 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:12:59.164 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:12:59.165 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:12:59.165 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/mon-bind 2024-09-16T03:12:59.167 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:12:59.167 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:12:59.167 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.33333 2024-09-16T03:12:59.167 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.33333 2024-09-16T03:12:59.168 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:12:59.168 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:12:59.168 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/mon-bind 2024-09-16T03:12:59.170 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T03:12:59.170 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:12:59.170 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.33333 2024-09-16T03:12:59.170 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.33333 2024-09-16T03:12:59.171 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T03:12:59.172 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2024-09-16T03:12:59.173 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2024-09-16T03:12:59.173 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T03:12:59.173 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/mon-bind 1' TERM HUP INT 2024-09-16T03:12:59.173 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:53: run: TEST_mon_client_connect td/mon-bind 2024-09-16T03:12:59.173 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:72: TEST_mon_client_connect: local dir=td/mon-bind 2024-09-16T03:12:59.173 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:76: TEST_mon_client_connect: CEPH_ARGS+='--mon-host=127.0.0.1:7132 ' 2024-09-16T03:12:59.173 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:77: TEST_mon_client_connect: run_mon td/mon-bind a --mon-host=127.0.0.1:7132 --public-bind-addr=127.0.0.1:7135 2024-09-16T03:12:59.173 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/mon-bind 2024-09-16T03:12:59.173 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T03:12:59.173 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T03:12:59.173 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T03:12:59.173 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/mon-bind/a 2024-09-16T03:12:59.174 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/mon-bind/a --run-dir=td/mon-bind --mon-host=127.0.0.1:7132 --public-bind-addr=127.0.0.1:7135 2024-09-16T03:12:59.618 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T03:12:59.618 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:12:59.618 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:12:59.619 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:12:59.619 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:12:59.619 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.33333 2024-09-16T03:12:59.619 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.33333/$cluster-$name.asok' 2024-09-16T03:12:59.619 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/mon-bind/a '--log-file=td/mon-bind/$name.log' '--admin-socket=/tmp/ceph-asok.33333/$cluster-$name.asok' --mon-cluster-log-file=td/mon-bind/log --run-dir=td/mon-bind '--pid-file=td/mon-bind/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --mon-host=127.0.0.1:7132 --public-bind-addr=127.0.0.1:7135 2024-09-16T03:12:59.818 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T03:12:59.819 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T03:12:59.819 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:12:59.819 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:12:59.819 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T03:12:59.821 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T03:12:59.821 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:12:59.821 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:12:59.821 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:12:59.821 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:12:59.821 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:12:59.821 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.33333 2024-09-16T03:12:59.821 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.33333/ceph-mon.a.asok 2024-09-16T03:12:59.821 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:12:59.821 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.33333/ceph-mon.a.asok config get fsid 2024-09-16T03:12:59.937 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T03:12:59.937 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:12:59.937 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:12:59.937 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T03:12:59.939 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:12:59.939 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T03:12:59.939 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:12:59.939 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:12:59.939 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:12:59.939 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:12:59.939 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.33333 2024-09-16T03:12:59.939 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.33333/ceph-mon.a.asok 2024-09-16T03:12:59.939 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:12:59.940 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.33333/ceph-mon.a.asok config get mon_host 2024-09-16T03:13:00.051 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:80: TEST_mon_client_connect: port_forward 7132 7135 2024-09-16T03:13:00.051 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:20: port_forward: local source_port=7132 2024-09-16T03:13:00.051 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:21: port_forward: local target_port=7135 2024-09-16T03:13:00.051 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:24: port_forward: SOCAT_PIDS+=($!) 2024-09-16T03:13:00.051 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:23: port_forward: socat TCP-LISTEN:7132,fork,reuseaddr TCP:localhost:7135 2024-09-16T03:13:00.052 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:83: TEST_mon_client_connect: ceph ping mon.a 2024-09-16T03:13:00.992 INFO:tasks.workunit.client.0.smithi096.stdout:{ 2024-09-16T03:13:00.993 INFO:tasks.workunit.client.0.smithi096.stdout: "health": { 2024-09-16T03:13:00.993 INFO:tasks.workunit.client.0.smithi096.stdout: "status": "HEALTH_OK", 2024-09-16T03:13:00.993 INFO:tasks.workunit.client.0.smithi096.stdout: "checks": {}, 2024-09-16T03:13:00.993 INFO:tasks.workunit.client.0.smithi096.stdout: "mutes": [] 2024-09-16T03:13:00.993 INFO:tasks.workunit.client.0.smithi096.stdout: }, 2024-09-16T03:13:00.993 INFO:tasks.workunit.client.0.smithi096.stdout: "mon_status": { 2024-09-16T03:13:00.993 INFO:tasks.workunit.client.0.smithi096.stdout: "name": "a", 2024-09-16T03:13:00.993 INFO:tasks.workunit.client.0.smithi096.stdout: "rank": 0, 2024-09-16T03:13:00.993 INFO:tasks.workunit.client.0.smithi096.stdout: "state": "leader", 2024-09-16T03:13:00.993 INFO:tasks.workunit.client.0.smithi096.stdout: "election_epoch": 3, 2024-09-16T03:13:00.993 INFO:tasks.workunit.client.0.smithi096.stdout: "uptime": 1135, 2024-09-16T03:13:00.994 INFO:tasks.workunit.client.0.smithi096.stdout: "quorum": [ 2024-09-16T03:13:00.994 INFO:tasks.workunit.client.0.smithi096.stdout: 0 2024-09-16T03:13:00.994 INFO:tasks.workunit.client.0.smithi096.stdout: ], 2024-09-16T03:13:00.994 INFO:tasks.workunit.client.0.smithi096.stdout: "quorum_age": 0, 2024-09-16T03:13:00.994 INFO:tasks.workunit.client.0.smithi096.stdout: "features": { 2024-09-16T03:13:00.994 INFO:tasks.workunit.client.0.smithi096.stdout: "required_con": "2450521708007866372", 2024-09-16T03:13:00.994 INFO:tasks.workunit.client.0.smithi096.stdout: "required_mon": [ 2024-09-16T03:13:00.994 INFO:tasks.workunit.client.0.smithi096.stdout: "kraken", 2024-09-16T03:13:00.994 INFO:tasks.workunit.client.0.smithi096.stdout: "luminous", 2024-09-16T03:13:00.994 INFO:tasks.workunit.client.0.smithi096.stdout: "mimic", 2024-09-16T03:13:00.994 INFO:tasks.workunit.client.0.smithi096.stdout: "osdmap-prune", 2024-09-16T03:13:00.994 INFO:tasks.workunit.client.0.smithi096.stdout: "nautilus", 2024-09-16T03:13:00.994 INFO:tasks.workunit.client.0.smithi096.stdout: "octopus", 2024-09-16T03:13:00.994 INFO:tasks.workunit.client.0.smithi096.stdout: "pacific", 2024-09-16T03:13:00.995 INFO:tasks.workunit.client.0.smithi096.stdout: "elector-pinging", 2024-09-16T03:13:00.995 INFO:tasks.workunit.client.0.smithi096.stdout: "quincy", 2024-09-16T03:13:00.995 INFO:tasks.workunit.client.0.smithi096.stdout: "reef", 2024-09-16T03:13:00.995 INFO:tasks.workunit.client.0.smithi096.stdout: "squid" 2024-09-16T03:13:00.995 INFO:tasks.workunit.client.0.smithi096.stdout: ], 2024-09-16T03:13:00.995 INFO:tasks.workunit.client.0.smithi096.stdout: "quorum_con": "4540719139924082687", 2024-09-16T03:13:00.995 INFO:tasks.workunit.client.0.smithi096.stdout: "quorum_mon": [ 2024-09-16T03:13:00.995 INFO:tasks.workunit.client.0.smithi096.stdout: "kraken", 2024-09-16T03:13:00.995 INFO:tasks.workunit.client.0.smithi096.stdout: "luminous", 2024-09-16T03:13:00.995 INFO:tasks.workunit.client.0.smithi096.stdout: "mimic", 2024-09-16T03:13:00.995 INFO:tasks.workunit.client.0.smithi096.stdout: "osdmap-prune", 2024-09-16T03:13:00.995 INFO:tasks.workunit.client.0.smithi096.stdout: "nautilus", 2024-09-16T03:13:00.996 INFO:tasks.workunit.client.0.smithi096.stdout: "octopus", 2024-09-16T03:13:00.996 INFO:tasks.workunit.client.0.smithi096.stdout: "pacific", 2024-09-16T03:13:00.996 INFO:tasks.workunit.client.0.smithi096.stdout: "elector-pinging", 2024-09-16T03:13:00.996 INFO:tasks.workunit.client.0.smithi096.stdout: "quincy", 2024-09-16T03:13:00.996 INFO:tasks.workunit.client.0.smithi096.stdout: "reef", 2024-09-16T03:13:00.996 INFO:tasks.workunit.client.0.smithi096.stdout: "squid" 2024-09-16T03:13:00.996 INFO:tasks.workunit.client.0.smithi096.stdout: ] 2024-09-16T03:13:00.996 INFO:tasks.workunit.client.0.smithi096.stdout: }, 2024-09-16T03:13:00.996 INFO:tasks.workunit.client.0.smithi096.stdout: "outside_quorum": [], 2024-09-16T03:13:00.996 INFO:tasks.workunit.client.0.smithi096.stdout: "extra_probe_peers": [], 2024-09-16T03:13:00.996 INFO:tasks.workunit.client.0.smithi096.stdout: "sync_provider": [], 2024-09-16T03:13:00.996 INFO:tasks.workunit.client.0.smithi096.stdout: "monmap": { 2024-09-16T03:13:00.996 INFO:tasks.workunit.client.0.smithi096.stdout: "epoch": 1, 2024-09-16T03:13:00.997 INFO:tasks.workunit.client.0.smithi096.stdout: "fsid": "f50875ee-5756-4303-ab8d-45e11d049850", 2024-09-16T03:13:00.997 INFO:tasks.workunit.client.0.smithi096.stdout: "modified": "2024-09-16T03:12:59.196336Z", 2024-09-16T03:13:00.997 INFO:tasks.workunit.client.0.smithi096.stdout: "created": "2024-09-16T03:12:59.196336Z", 2024-09-16T03:13:00.997 INFO:tasks.workunit.client.0.smithi096.stdout: "min_mon_release": 19, 2024-09-16T03:13:00.997 INFO:tasks.workunit.client.0.smithi096.stdout: "min_mon_release_name": "squid", 2024-09-16T03:13:00.997 INFO:tasks.workunit.client.0.smithi096.stdout: "election_strategy": 1, 2024-09-16T03:13:00.997 INFO:tasks.workunit.client.0.smithi096.stdout: "disallowed_leaders: ": "", 2024-09-16T03:13:00.997 INFO:tasks.workunit.client.0.smithi096.stdout: "stretch_mode": false, 2024-09-16T03:13:00.997 INFO:tasks.workunit.client.0.smithi096.stdout: "tiebreaker_mon": "", 2024-09-16T03:13:00.997 INFO:tasks.workunit.client.0.smithi096.stdout: "removed_ranks: ": "", 2024-09-16T03:13:00.997 INFO:tasks.workunit.client.0.smithi096.stdout: "features": { 2024-09-16T03:13:00.997 INFO:tasks.workunit.client.0.smithi096.stdout: "persistent": [ 2024-09-16T03:13:00.998 INFO:tasks.workunit.client.0.smithi096.stdout: "kraken", 2024-09-16T03:13:00.998 INFO:tasks.workunit.client.0.smithi096.stdout: "luminous", 2024-09-16T03:13:00.998 INFO:tasks.workunit.client.0.smithi096.stdout: "mimic", 2024-09-16T03:13:00.998 INFO:tasks.workunit.client.0.smithi096.stdout: "osdmap-prune", 2024-09-16T03:13:00.998 INFO:tasks.workunit.client.0.smithi096.stdout: "nautilus", 2024-09-16T03:13:00.998 INFO:tasks.workunit.client.0.smithi096.stdout: "octopus", 2024-09-16T03:13:00.998 INFO:tasks.workunit.client.0.smithi096.stdout: "pacific", 2024-09-16T03:13:00.998 INFO:tasks.workunit.client.0.smithi096.stdout: "elector-pinging", 2024-09-16T03:13:00.998 INFO:tasks.workunit.client.0.smithi096.stdout: "quincy", 2024-09-16T03:13:00.998 INFO:tasks.workunit.client.0.smithi096.stdout: "reef", 2024-09-16T03:13:00.998 INFO:tasks.workunit.client.0.smithi096.stdout: "squid" 2024-09-16T03:13:00.999 INFO:tasks.workunit.client.0.smithi096.stdout: ], 2024-09-16T03:13:00.999 INFO:tasks.workunit.client.0.smithi096.stdout: "optional": [] 2024-09-16T03:13:00.999 INFO:tasks.workunit.client.0.smithi096.stdout: }, 2024-09-16T03:13:00.999 INFO:tasks.workunit.client.0.smithi096.stdout: "mons": [ 2024-09-16T03:13:00.999 INFO:tasks.workunit.client.0.smithi096.stdout: { 2024-09-16T03:13:00.999 INFO:tasks.workunit.client.0.smithi096.stdout: "rank": 0, 2024-09-16T03:13:00.999 INFO:tasks.workunit.client.0.smithi096.stdout: "name": "a", 2024-09-16T03:13:00.999 INFO:tasks.workunit.client.0.smithi096.stdout: "public_addrs": { 2024-09-16T03:13:00.999 INFO:tasks.workunit.client.0.smithi096.stdout: "addrvec": [ 2024-09-16T03:13:00.999 INFO:tasks.workunit.client.0.smithi096.stdout: { 2024-09-16T03:13:00.999 INFO:tasks.workunit.client.0.smithi096.stdout: "type": "v2", 2024-09-16T03:13:00.999 INFO:tasks.workunit.client.0.smithi096.stdout: "addr": "127.0.0.1:7132", 2024-09-16T03:13:00.999 INFO:tasks.workunit.client.0.smithi096.stdout: "nonce": 0 2024-09-16T03:13:01.000 INFO:tasks.workunit.client.0.smithi096.stdout: } 2024-09-16T03:13:01.000 INFO:tasks.workunit.client.0.smithi096.stdout: ] 2024-09-16T03:13:01.000 INFO:tasks.workunit.client.0.smithi096.stdout: }, 2024-09-16T03:13:01.000 INFO:tasks.workunit.client.0.smithi096.stdout: "addr": "127.0.0.1:7132/0", 2024-09-16T03:13:01.000 INFO:tasks.workunit.client.0.smithi096.stdout: "public_addr": "127.0.0.1:7132/0", 2024-09-16T03:13:01.000 INFO:tasks.workunit.client.0.smithi096.stdout: "priority": 0, 2024-09-16T03:13:01.000 INFO:tasks.workunit.client.0.smithi096.stdout: "weight": 0, 2024-09-16T03:13:01.000 INFO:tasks.workunit.client.0.smithi096.stdout: "crush_location": "{}" 2024-09-16T03:13:01.000 INFO:tasks.workunit.client.0.smithi096.stdout: } 2024-09-16T03:13:01.000 INFO:tasks.workunit.client.0.smithi096.stdout: ] 2024-09-16T03:13:01.000 INFO:tasks.workunit.client.0.smithi096.stdout: }, 2024-09-16T03:13:01.000 INFO:tasks.workunit.client.0.smithi096.stdout: "feature_map": { 2024-09-16T03:13:01.000 INFO:tasks.workunit.client.0.smithi096.stdout: "mon": [ 2024-09-16T03:13:01.001 INFO:tasks.workunit.client.0.smithi096.stdout: { 2024-09-16T03:13:01.001 INFO:tasks.workunit.client.0.smithi096.stdout: "features": "0x3f03dffffffdffff", 2024-09-16T03:13:01.001 INFO:tasks.workunit.client.0.smithi096.stdout: "release": "squid", 2024-09-16T03:13:01.001 INFO:tasks.workunit.client.0.smithi096.stdout: "num": 1 2024-09-16T03:13:01.001 INFO:tasks.workunit.client.0.smithi096.stdout: } 2024-09-16T03:13:01.001 INFO:tasks.workunit.client.0.smithi096.stdout: ], 2024-09-16T03:13:01.001 INFO:tasks.workunit.client.0.smithi096.stdout: "client": [ 2024-09-16T03:13:01.001 INFO:tasks.workunit.client.0.smithi096.stdout: { 2024-09-16T03:13:01.001 INFO:tasks.workunit.client.0.smithi096.stdout: "features": "0x3f03dffffffdffff", 2024-09-16T03:13:01.002 INFO:tasks.workunit.client.0.smithi096.stdout: "release": "squid", 2024-09-16T03:13:01.002 INFO:tasks.workunit.client.0.smithi096.stdout: "num": 1 2024-09-16T03:13:01.002 INFO:tasks.workunit.client.0.smithi096.stdout: } 2024-09-16T03:13:01.002 INFO:tasks.workunit.client.0.smithi096.stdout: ] 2024-09-16T03:13:01.002 INFO:tasks.workunit.client.0.smithi096.stdout: }, 2024-09-16T03:13:01.002 INFO:tasks.workunit.client.0.smithi096.stdout: "stretch_mode": false 2024-09-16T03:13:01.002 INFO:tasks.workunit.client.0.smithi096.stdout: } 2024-09-16T03:13:01.002 INFO:tasks.workunit.client.0.smithi096.stdout:} 2024-09-16T03:13:01.002 INFO:tasks.workunit.client.0.smithi096.stdout: 2024-09-16T03:13:01.010 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:53: run: cleanup 2024-09-16T03:13:01.010 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:28: cleanup: for p in "${SOCAT_PIDS[@]}" 2024-09-16T03:13:01.010 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:29: cleanup: kill 33436 2024-09-16T03:13:01.010 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:31: cleanup: SOCAT_PIDS=() 2024-09-16T03:13:01.010 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:54: run: teardown td/mon-bind 2024-09-16T03:13:01.010 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/mon-bind 2024-09-16T03:13:01.010 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:13:01.010 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/mon-bind KILL 2024-09-16T03:13:01.011 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:13:01.011 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:13:01.011 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:13:01.012 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:13:01.012 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:13:01.119 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:13:01.119 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:13:01.120 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:13:01.120 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:13:01.122 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:13:01.122 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:13:01.123 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:13:01.123 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:13:01.123 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:13:01.123 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:13:01.124 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:13:01.124 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:13:01.126 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:13:01.126 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/mon-bind 2024-09-16T03:13:01.128 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:13:01.128 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:13:01.128 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.33333 2024-09-16T03:13:01.128 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.33333 2024-09-16T03:13:01.130 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:13:01.130 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:13:01.130 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:51: run: for func in $funcs 2024-09-16T03:13:01.130 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:52: run: setup td/mon-bind 2024-09-16T03:13:01.131 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/mon-bind 2024-09-16T03:13:01.131 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/mon-bind 2024-09-16T03:13:01.131 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/mon-bind 2024-09-16T03:13:01.131 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:13:01.131 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/mon-bind KILL 2024-09-16T03:13:01.131 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:13:01.131 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:13:01.131 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:13:01.131 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:13:01.131 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:13:01.134 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:13:01.134 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:13:01.135 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:13:01.136 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:13:01.137 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:13:01.137 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:13:01.137 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:13:01.138 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:13:01.138 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:13:01.139 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:13:01.139 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:13:01.140 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:13:01.141 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:13:01.141 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/mon-bind 2024-09-16T03:13:01.143 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:13:01.143 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:13:01.143 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.33333 2024-09-16T03:13:01.144 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.33333 2024-09-16T03:13:01.144 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:13:01.145 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:13:01.145 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/mon-bind 2024-09-16T03:13:01.146 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T03:13:01.146 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:13:01.146 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.33333 2024-09-16T03:13:01.146 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.33333 2024-09-16T03:13:01.148 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T03:13:01.149 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2024-09-16T03:13:01.149 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T03:13:01.149 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/mon-bind 1' TERM HUP INT 2024-09-16T03:13:01.149 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:53: run: TEST_mon_client_connect_fails td/mon-bind 2024-09-16T03:13:01.150 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:59: TEST_mon_client_connect_fails: local dir=td/mon-bind 2024-09-16T03:13:01.150 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:63: TEST_mon_client_connect_fails: CEPH_ARGS+='--mon-host=127.0.0.1:7132 ' 2024-09-16T03:13:01.150 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:64: TEST_mon_client_connect_fails: run_mon td/mon-bind a --mon-host=127.0.0.1:7132 --public-bind-addr=127.0.0.1:7135 2024-09-16T03:13:01.150 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/mon-bind 2024-09-16T03:13:01.150 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T03:13:01.150 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T03:13:01.150 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T03:13:01.150 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/mon-bind/a 2024-09-16T03:13:01.150 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/mon-bind/a --run-dir=td/mon-bind --mon-host=127.0.0.1:7132 --public-bind-addr=127.0.0.1:7135 2024-09-16T03:13:01.632 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T03:13:01.632 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:13:01.633 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:13:01.633 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:13:01.634 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:13:01.634 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.33333 2024-09-16T03:13:01.634 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.33333/$cluster-$name.asok' 2024-09-16T03:13:01.634 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/mon-bind/a '--log-file=td/mon-bind/$name.log' '--admin-socket=/tmp/ceph-asok.33333/$cluster-$name.asok' --mon-cluster-log-file=td/mon-bind/log --run-dir=td/mon-bind '--pid-file=td/mon-bind/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --mon-host=127.0.0.1:7132 --public-bind-addr=127.0.0.1:7135 2024-09-16T03:13:01.845 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T03:13:01.845 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T03:13:01.845 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:13:01.846 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:13:01.846 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T03:13:01.847 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T03:13:01.847 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:13:01.847 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:13:01.847 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:13:01.847 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:13:01.847 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:13:01.847 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.33333 2024-09-16T03:13:01.848 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.33333/ceph-mon.a.asok 2024-09-16T03:13:01.848 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:13:01.848 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.33333/ceph-mon.a.asok config get fsid 2024-09-16T03:13:01.967 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T03:13:01.967 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:13:01.967 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:13:01.968 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T03:13:01.968 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T03:13:01.968 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:13:01.968 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:13:01.968 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:13:01.968 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:13:01.968 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:13:01.968 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.33333 2024-09-16T03:13:01.968 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.33333/ceph-mon.a.asok 2024-09-16T03:13:01.968 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:13:01.969 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.33333/ceph-mon.a.asok config get mon_host 2024-09-16T03:13:02.074 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:67: TEST_mon_client_connect_fails: timeout 3 ceph ping mon.a 2024-09-16T03:13:05.080 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:67: TEST_mon_client_connect_fails: return 0 2024-09-16T03:13:05.080 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:53: run: cleanup 2024-09-16T03:13:05.080 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:31: cleanup: SOCAT_PIDS=() 2024-09-16T03:13:05.080 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:54: run: teardown td/mon-bind 2024-09-16T03:13:05.080 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/mon-bind 2024-09-16T03:13:05.080 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:13:05.080 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/mon-bind KILL 2024-09-16T03:13:05.080 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:13:05.080 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:13:05.081 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:13:05.081 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:13:05.081 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:13:05.189 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:13:05.189 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:13:05.190 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:13:05.191 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:13:05.193 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:13:05.193 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:13:05.193 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:13:05.194 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:13:05.194 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:13:05.194 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:13:05.194 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:13:05.195 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:13:05.197 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:13:05.197 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/mon-bind 2024-09-16T03:13:05.199 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:13:05.199 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:13:05.199 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.33333 2024-09-16T03:13:05.199 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.33333 2024-09-16T03:13:05.200 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:13:05.200 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:13:05.200 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:51: run: for func in $funcs 2024-09-16T03:13:05.200 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:52: run: setup td/mon-bind 2024-09-16T03:13:05.201 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/mon-bind 2024-09-16T03:13:05.201 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/mon-bind 2024-09-16T03:13:05.201 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/mon-bind 2024-09-16T03:13:05.201 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:13:05.201 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/mon-bind KILL 2024-09-16T03:13:05.201 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:13:05.201 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:13:05.202 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:13:05.202 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:13:05.202 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:13:05.203 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:13:05.203 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:13:05.204 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:13:05.205 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:13:05.206 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:13:05.206 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:13:05.206 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:13:05.207 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:13:05.207 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:13:05.208 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:13:05.208 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:13:05.209 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:13:05.210 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:13:05.210 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/mon-bind 2024-09-16T03:13:05.211 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:13:05.211 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:13:05.211 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.33333 2024-09-16T03:13:05.211 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.33333 2024-09-16T03:13:05.213 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:13:05.213 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:13:05.213 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/mon-bind 2024-09-16T03:13:05.214 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T03:13:05.214 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:13:05.214 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.33333 2024-09-16T03:13:05.215 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.33333 2024-09-16T03:13:05.216 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T03:13:05.217 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2024-09-16T03:13:05.217 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T03:13:05.217 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/mon-bind 1' TERM HUP INT 2024-09-16T03:13:05.218 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:53: run: TEST_mon_quorum td/mon-bind 2024-09-16T03:13:05.218 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:87: TEST_mon_quorum: local dir=td/mon-bind 2024-09-16T03:13:05.218 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:91: TEST_mon_quorum: CEPH_ARGS+='--mon-host=127.0.0.1:7132,127.0.0.1:7133,127.0.0.1:7134 ' 2024-09-16T03:13:05.218 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:92: TEST_mon_quorum: run_mon td/mon-bind a --public-addr=127.0.0.1:7132 --public-bind-addr=127.0.0.1:7135 2024-09-16T03:13:05.218 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/mon-bind 2024-09-16T03:13:05.218 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T03:13:05.218 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T03:13:05.218 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T03:13:05.218 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/mon-bind/a 2024-09-16T03:13:05.218 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/mon-bind/a --run-dir=td/mon-bind --public-addr=127.0.0.1:7132 --public-bind-addr=127.0.0.1:7135 2024-09-16T03:13:05.763 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T03:13:05.763 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:13:05.764 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:13:05.764 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:13:05.764 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:13:05.764 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.33333 2024-09-16T03:13:05.765 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.33333/$cluster-$name.asok' 2024-09-16T03:13:05.765 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/mon-bind/a '--log-file=td/mon-bind/$name.log' '--admin-socket=/tmp/ceph-asok.33333/$cluster-$name.asok' --mon-cluster-log-file=td/mon-bind/log --run-dir=td/mon-bind '--pid-file=td/mon-bind/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr=127.0.0.1:7132 --public-bind-addr=127.0.0.1:7135 2024-09-16T03:13:05.976 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T03:13:05.977 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T03:13:05.977 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:13:05.977 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:13:05.977 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T03:13:05.978 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T03:13:05.978 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:13:05.979 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:13:05.979 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:13:05.979 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:13:05.979 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:13:05.979 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.33333 2024-09-16T03:13:05.979 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.33333/ceph-mon.a.asok 2024-09-16T03:13:05.979 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:13:05.979 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.33333/ceph-mon.a.asok config get fsid 2024-09-16T03:13:06.095 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T03:13:06.095 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:13:06.096 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:13:06.096 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T03:13:06.096 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T03:13:06.096 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:13:06.096 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:13:06.096 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:13:06.097 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:13:06.097 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:13:06.097 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.33333 2024-09-16T03:13:06.097 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.33333/ceph-mon.a.asok 2024-09-16T03:13:06.097 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:13:06.098 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.33333/ceph-mon.a.asok config get mon_host 2024-09-16T03:13:06.206 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:93: TEST_mon_quorum: run_mon td/mon-bind b --public-addr=127.0.0.1:7133 --public-bind-addr=127.0.0.1:7136 2024-09-16T03:13:06.207 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/mon-bind 2024-09-16T03:13:06.207 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T03:13:06.207 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=b 2024-09-16T03:13:06.207 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T03:13:06.207 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/mon-bind/b 2024-09-16T03:13:06.207 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id b --mkfs --mon-data=td/mon-bind/b --run-dir=td/mon-bind --public-addr=127.0.0.1:7133 --public-bind-addr=127.0.0.1:7136 2024-09-16T03:13:06.675 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T03:13:06.675 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:13:06.675 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:13:06.676 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:13:06.676 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:13:06.676 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.33333 2024-09-16T03:13:06.676 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.33333/$cluster-$name.asok' 2024-09-16T03:13:06.677 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id b --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/mon-bind/b '--log-file=td/mon-bind/$name.log' '--admin-socket=/tmp/ceph-asok.33333/$cluster-$name.asok' --mon-cluster-log-file=td/mon-bind/log --run-dir=td/mon-bind '--pid-file=td/mon-bind/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr=127.0.0.1:7133 --public-bind-addr=127.0.0.1:7136 2024-09-16T03:13:06.898 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T03:13:06.898 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon b fsid 2024-09-16T03:13:06.898 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:13:06.898 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=b 2024-09-16T03:13:06.898 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T03:13:06.898 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T03:13:06.898 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.b 2024-09-16T03:13:06.898 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.b 2024-09-16T03:13:06.898 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.b ']' 2024-09-16T03:13:06.899 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:13:06.899 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:13:06.899 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.33333 2024-09-16T03:13:06.899 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.33333/ceph-mon.b.asok 2024-09-16T03:13:06.899 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:13:06.899 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.33333/ceph-mon.b.asok config get fsid 2024-09-16T03:13:07.012 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon b mon_host 2024-09-16T03:13:07.012 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:13:07.013 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=b 2024-09-16T03:13:07.013 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T03:13:07.014 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T03:13:07.014 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.b 2024-09-16T03:13:07.014 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.b 2024-09-16T03:13:07.014 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.b ']' 2024-09-16T03:13:07.014 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:13:07.014 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:13:07.014 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.33333 2024-09-16T03:13:07.014 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.33333/ceph-mon.b.asok 2024-09-16T03:13:07.015 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:13:07.015 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.33333/ceph-mon.b.asok config get mon_host 2024-09-16T03:13:07.123 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:94: TEST_mon_quorum: run_mon td/mon-bind c --public-addr=127.0.0.1:7134 --public-bind-addr=127.0.0.1:7137 2024-09-16T03:13:07.123 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/mon-bind 2024-09-16T03:13:07.123 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T03:13:07.123 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=c 2024-09-16T03:13:07.123 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T03:13:07.123 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/mon-bind/c 2024-09-16T03:13:07.123 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id c --mkfs --mon-data=td/mon-bind/c --run-dir=td/mon-bind --public-addr=127.0.0.1:7134 --public-bind-addr=127.0.0.1:7137 2024-09-16T03:13:07.637 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T03:13:07.637 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:13:07.638 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:13:07.638 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:13:07.638 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:13:07.638 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.33333 2024-09-16T03:13:07.638 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.33333/$cluster-$name.asok' 2024-09-16T03:13:07.639 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id c --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/mon-bind/c '--log-file=td/mon-bind/$name.log' '--admin-socket=/tmp/ceph-asok.33333/$cluster-$name.asok' --mon-cluster-log-file=td/mon-bind/log --run-dir=td/mon-bind '--pid-file=td/mon-bind/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr=127.0.0.1:7134 --public-bind-addr=127.0.0.1:7137 2024-09-16T03:13:07.857 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T03:13:07.858 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon c fsid 2024-09-16T03:13:07.858 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:13:07.858 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=c 2024-09-16T03:13:07.858 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T03:13:07.859 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T03:13:07.859 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.c 2024-09-16T03:13:07.859 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.c 2024-09-16T03:13:07.859 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.c ']' 2024-09-16T03:13:07.859 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:13:07.859 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:13:07.859 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.33333 2024-09-16T03:13:07.860 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.33333/ceph-mon.c.asok 2024-09-16T03:13:07.860 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:13:07.860 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.33333/ceph-mon.c.asok config get fsid 2024-09-16T03:13:07.978 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon c mon_host 2024-09-16T03:13:07.978 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:13:07.978 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=c 2024-09-16T03:13:07.978 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T03:13:07.978 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T03:13:07.980 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.c 2024-09-16T03:13:07.980 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.c 2024-09-16T03:13:07.980 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.c ']' 2024-09-16T03:13:07.980 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:13:07.980 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:13:07.980 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.33333 2024-09-16T03:13:07.980 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.33333/ceph-mon.c.asok 2024-09-16T03:13:07.980 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:13:07.980 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.33333/ceph-mon.c.asok config get mon_host 2024-09-16T03:13:08.093 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:97: TEST_mon_quorum: port_forward 7132 7135 2024-09-16T03:13:08.094 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:20: port_forward: local source_port=7132 2024-09-16T03:13:08.094 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:21: port_forward: local target_port=7135 2024-09-16T03:13:08.094 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:24: port_forward: SOCAT_PIDS+=($!) 2024-09-16T03:13:08.094 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:98: TEST_mon_quorum: port_forward 7133 7136 2024-09-16T03:13:08.094 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:20: port_forward: local source_port=7133 2024-09-16T03:13:08.094 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:21: port_forward: local target_port=7136 2024-09-16T03:13:08.094 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:23: port_forward: socat TCP-LISTEN:7132,fork,reuseaddr TCP:localhost:7135 2024-09-16T03:13:08.094 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:24: port_forward: SOCAT_PIDS+=($!) 2024-09-16T03:13:08.094 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:99: TEST_mon_quorum: port_forward 7134 7137 2024-09-16T03:13:08.094 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:20: port_forward: local source_port=7134 2024-09-16T03:13:08.094 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:21: port_forward: local target_port=7137 2024-09-16T03:13:08.094 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:23: port_forward: socat TCP-LISTEN:7133,fork,reuseaddr TCP:localhost:7136 2024-09-16T03:13:08.095 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:24: port_forward: SOCAT_PIDS+=($!) 2024-09-16T03:13:08.095 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:23: port_forward: socat TCP-LISTEN:7134,fork,reuseaddr TCP:localhost:7137 2024-09-16T03:13:08.095 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:102: TEST_mon_quorum: ceph quorum_status --format=json 2024-09-16T03:13:17.558 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:102: TEST_mon_quorum: jqinput=' 2024-09-16T03:13:17.559 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"f50875ee-5756-4303-ab8d-45e11d049850","modified":"2024-09-16T03:13:05.242159Z","created":"2024-09-16T03:13:05.242159Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7132","nonce":0}]},"addr":"127.0.0.1:7132/0","public_addr":"127.0.0.1:7132/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7133","nonce":0}]},"addr":"127.0.0.1:7133/0","public_addr":"127.0.0.1:7133/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7134","nonce":0}]},"addr":"127.0.0.1:7134/0","public_addr":"127.0.0.1:7134/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:13:17.559 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:103: TEST_mon_quorum: jq_success ' 2024-09-16T03:13:17.559 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"f50875ee-5756-4303-ab8d-45e11d049850","modified":"2024-09-16T03:13:05.242159Z","created":"2024-09-16T03:13:05.242159Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7132","nonce":0}]},"addr":"127.0.0.1:7132/0","public_addr":"127.0.0.1:7132/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7133","nonce":0}]},"addr":"127.0.0.1:7133/0","public_addr":"127.0.0.1:7133/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7134","nonce":0}]},"addr":"127.0.0.1:7134/0","public_addr":"127.0.0.1:7134/0","priority":0,"weight":0,"crush_location":"{}"}]}}' '.monmap.mons | length == 3' 2024-09-16T03:13:17.559 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: jq_success: input=' 2024-09-16T03:13:17.559 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"f50875ee-5756-4303-ab8d-45e11d049850","modified":"2024-09-16T03:13:05.242159Z","created":"2024-09-16T03:13:05.242159Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7132","nonce":0}]},"addr":"127.0.0.1:7132/0","public_addr":"127.0.0.1:7132/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7133","nonce":0}]},"addr":"127.0.0.1:7133/0","public_addr":"127.0.0.1:7133/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7134","nonce":0}]},"addr":"127.0.0.1:7134/0","public_addr":"127.0.0.1:7134/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:13:17.559 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: jq_success: filter='.monmap.mons | length == 3' 2024-09-16T03:13:17.559 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2374: jq_success: expects='""' 2024-09-16T03:13:17.560 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-16T03:13:17.560 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: printf %s ' 2024-09-16T03:13:17.560 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"f50875ee-5756-4303-ab8d-45e11d049850","modified":"2024-09-16T03:13:05.242159Z","created":"2024-09-16T03:13:05.242159Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7132","nonce":0}]},"addr":"127.0.0.1:7132/0","public_addr":"127.0.0.1:7132/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7133","nonce":0}]},"addr":"127.0.0.1:7133/0","public_addr":"127.0.0.1:7133/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7134","nonce":0}]},"addr":"127.0.0.1:7134/0","public_addr":"127.0.0.1:7134/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:13:17.560 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: in_escaped=' 2024-09-16T03:13:17.560 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"f50875ee-5756-4303-ab8d-45e11d049850","modified":"2024-09-16T03:13:05.242159Z","created":"2024-09-16T03:13:05.242159Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7132","nonce":0}]},"addr":"127.0.0.1:7132/0","public_addr":"127.0.0.1:7132/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7133","nonce":0}]},"addr":"127.0.0.1:7133/0","public_addr":"127.0.0.1:7133/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7134","nonce":0}]},"addr":"127.0.0.1:7134/0","public_addr":"127.0.0.1:7134/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:13:17.560 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: printf %s '.monmap.mons | length == 3' 2024-09-16T03:13:17.560 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-16T03:13:17.560 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: filter_escaped='.monmap.mons | length == 3' 2024-09-16T03:13:17.560 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: echo ' 2024-09-16T03:13:17.560 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"f50875ee-5756-4303-ab8d-45e11d049850","modified":"2024-09-16T03:13:05.242159Z","created":"2024-09-16T03:13:05.242159Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7132","nonce":0}]},"addr":"127.0.0.1:7132/0","public_addr":"127.0.0.1:7132/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7133","nonce":0}]},"addr":"127.0.0.1:7133/0","public_addr":"127.0.0.1:7133/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7134","nonce":0}]},"addr":"127.0.0.1:7134/0","public_addr":"127.0.0.1:7134/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:13:17.560 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: jq '.monmap.mons | length == 3' 2024-09-16T03:13:17.598 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: ret=true 2024-09-16T03:13:17.598 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2380: jq_success: [[ true == \t\r\u\e ]] 2024-09-16T03:13:17.598 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2381: jq_success: return 0 2024-09-16T03:13:17.598 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:106: TEST_mon_quorum: wait_for_quorum 300 3 2024-09-16T03:13:17.598 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1046: wait_for_quorum: local timeout=300 2024-09-16T03:13:17.599 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1047: wait_for_quorum: local quorumsize=3 2024-09-16T03:13:17.599 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1049: wait_for_quorum: [[ -z 300 ]] 2024-09-16T03:13:17.599 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1053: wait_for_quorum: [[ -z 3 ]] 2024-09-16T03:13:17.599 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1058: wait_for_quorum: no_quorum=1 2024-09-16T03:13:17.599 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1059: wait_for_quorum: date +%s 2024-09-16T03:13:17.599 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1059: wait_for_quorum: wait_until=1726456697 2024-09-16T03:13:17.599 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2024-09-16T03:13:17.600 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1726456397 -lt 1726456697 ]] 2024-09-16T03:13:17.600 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 3' 2024-09-16T03:13:17.600 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 300 ceph quorum_status --format=json 2024-09-16T03:13:18.054 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2024-09-16T03:13:18.054 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"f50875ee-5756-4303-ab8d-45e11d049850","modified":"2024-09-16T03:13:05.242159Z","created":"2024-09-16T03:13:05.242159Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7132","nonce":0}]},"addr":"127.0.0.1:7132/0","public_addr":"127.0.0.1:7132/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7133","nonce":0}]},"addr":"127.0.0.1:7133/0","public_addr":"127.0.0.1:7133/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7134","nonce":0}]},"addr":"127.0.0.1:7134/0","public_addr":"127.0.0.1:7134/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:13:18.055 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 3' 2024-09-16T03:13:18.055 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"f50875ee-5756-4303-ab8d-45e11d049850","modified":"2024-09-16T03:13:05.242159Z","created":"2024-09-16T03:13:05.242159Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders:' '":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks:' '":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7132","nonce":0}]},"addr":"127.0.0.1:7132/0","public_addr":"127.0.0.1:7132/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7133","nonce":0}]},"addr":"127.0.0.1:7133/0","public_addr":"127.0.0.1:7133/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7134","nonce":0}]},"addr":"127.0.0.1:7134/0","public_addr":"127.0.0.1:7134/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:13:18.090 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=true 2024-09-16T03:13:18.090 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ true == \t\r\u\e ]] 2024-09-16T03:13:18.090 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: wait_for_quorum: no_quorum=0 2024-09-16T03:13:18.091 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1066: wait_for_quorum: break 2024-09-16T03:13:18.091 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: return 0 2024-09-16T03:13:18.091 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:108: TEST_mon_quorum: jqfilter='.quorum | length == 3' 2024-09-16T03:13:18.091 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:109: TEST_mon_quorum: jq_success ' 2024-09-16T03:13:18.091 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"f50875ee-5756-4303-ab8d-45e11d049850","modified":"2024-09-16T03:13:05.242159Z","created":"2024-09-16T03:13:05.242159Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7132","nonce":0}]},"addr":"127.0.0.1:7132/0","public_addr":"127.0.0.1:7132/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7133","nonce":0}]},"addr":"127.0.0.1:7133/0","public_addr":"127.0.0.1:7133/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7134","nonce":0}]},"addr":"127.0.0.1:7134/0","public_addr":"127.0.0.1:7134/0","priority":0,"weight":0,"crush_location":"{}"}]}}' '.quorum | length == 3' 2024-09-16T03:13:18.091 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: jq_success: input=' 2024-09-16T03:13:18.092 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"f50875ee-5756-4303-ab8d-45e11d049850","modified":"2024-09-16T03:13:05.242159Z","created":"2024-09-16T03:13:05.242159Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7132","nonce":0}]},"addr":"127.0.0.1:7132/0","public_addr":"127.0.0.1:7132/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7133","nonce":0}]},"addr":"127.0.0.1:7133/0","public_addr":"127.0.0.1:7133/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7134","nonce":0}]},"addr":"127.0.0.1:7134/0","public_addr":"127.0.0.1:7134/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:13:18.092 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: jq_success: filter='.quorum | length == 3' 2024-09-16T03:13:18.092 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2374: jq_success: expects='""' 2024-09-16T03:13:18.092 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: printf %s ' 2024-09-16T03:13:18.092 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"f50875ee-5756-4303-ab8d-45e11d049850","modified":"2024-09-16T03:13:05.242159Z","created":"2024-09-16T03:13:05.242159Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7132","nonce":0}]},"addr":"127.0.0.1:7132/0","public_addr":"127.0.0.1:7132/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7133","nonce":0}]},"addr":"127.0.0.1:7133/0","public_addr":"127.0.0.1:7133/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7134","nonce":0}]},"addr":"127.0.0.1:7134/0","public_addr":"127.0.0.1:7134/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:13:18.092 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-16T03:13:18.093 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: jq_success: in_escaped=' 2024-09-16T03:13:18.093 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"f50875ee-5756-4303-ab8d-45e11d049850","modified":"2024-09-16T03:13:05.242159Z","created":"2024-09-16T03:13:05.242159Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7132","nonce":0}]},"addr":"127.0.0.1:7132/0","public_addr":"127.0.0.1:7132/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7133","nonce":0}]},"addr":"127.0.0.1:7133/0","public_addr":"127.0.0.1:7133/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7134","nonce":0}]},"addr":"127.0.0.1:7134/0","public_addr":"127.0.0.1:7134/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:13:18.093 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: printf %s '.quorum | length == 3' 2024-09-16T03:13:18.093 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: sed 's/'\''/'\''\\'\'''\''/g' 2024-09-16T03:13:18.093 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: jq_success: filter_escaped='.quorum | length == 3' 2024-09-16T03:13:18.094 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: echo ' 2024-09-16T03:13:18.094 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"f50875ee-5756-4303-ab8d-45e11d049850","modified":"2024-09-16T03:13:05.242159Z","created":"2024-09-16T03:13:05.242159Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7132","nonce":0}]},"addr":"127.0.0.1:7132/0","public_addr":"127.0.0.1:7132/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7133","nonce":0}]},"addr":"127.0.0.1:7133/0","public_addr":"127.0.0.1:7133/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7134","nonce":0}]},"addr":"127.0.0.1:7134/0","public_addr":"127.0.0.1:7134/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:13:18.094 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: jq '.quorum | length == 3' 2024-09-16T03:13:18.126 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: jq_success: ret=true 2024-09-16T03:13:18.126 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2380: jq_success: [[ true == \t\r\u\e ]] 2024-09-16T03:13:18.126 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2381: jq_success: return 0 2024-09-16T03:13:18.126 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:53: run: cleanup 2024-09-16T03:13:18.126 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:28: cleanup: for p in "${SOCAT_PIDS[@]}" 2024-09-16T03:13:18.126 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:29: cleanup: kill 33834 2024-09-16T03:13:18.126 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:28: cleanup: for p in "${SOCAT_PIDS[@]}" 2024-09-16T03:13:18.127 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:29: cleanup: kill 33835 2024-09-16T03:13:18.127 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:28: cleanup: for p in "${SOCAT_PIDS[@]}" 2024-09-16T03:13:18.127 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:29: cleanup: kill 33836 2024-09-16T03:13:18.127 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:31: cleanup: SOCAT_PIDS=() 2024-09-16T03:13:18.127 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:54: run: teardown td/mon-bind 2024-09-16T03:13:18.127 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/mon-bind 2024-09-16T03:13:18.127 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:13:18.127 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/mon-bind KILL 2024-09-16T03:13:18.127 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:13:18.127 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:13:18.127 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:13:18.127 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:13:18.127 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:13:18.232 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:13:18.232 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:13:18.233 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:13:18.233 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:13:18.234 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:13:18.235 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:13:18.235 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:13:18.235 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:13:18.235 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:13:18.236 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:13:18.236 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:13:18.236 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:13:18.238 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:13:18.238 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/mon-bind 2024-09-16T03:13:18.242 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:13:18.242 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:13:18.242 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.33333 2024-09-16T03:13:18.242 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.33333 2024-09-16T03:13:18.243 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:13:18.244 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:13:18.244 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:51: run: for func in $funcs 2024-09-16T03:13:18.244 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:52: run: setup td/mon-bind 2024-09-16T03:13:18.244 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/mon-bind 2024-09-16T03:13:18.244 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/mon-bind 2024-09-16T03:13:18.244 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/mon-bind 2024-09-16T03:13:18.244 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:13:18.244 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/mon-bind KILL 2024-09-16T03:13:18.244 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:13:18.244 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:13:18.244 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:13:18.244 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:13:18.244 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:13:18.245 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:13:18.246 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:13:18.246 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:13:18.247 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:13:18.247 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:13:18.248 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:13:18.248 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:13:18.249 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:13:18.249 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:13:18.249 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:13:18.249 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:13:18.250 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:13:18.251 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:13:18.251 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/mon-bind 2024-09-16T03:13:18.252 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:13:18.252 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:13:18.253 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.33333 2024-09-16T03:13:18.253 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.33333 2024-09-16T03:13:18.253 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:13:18.253 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:13:18.253 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/mon-bind 2024-09-16T03:13:18.255 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T03:13:18.255 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:13:18.255 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.33333 2024-09-16T03:13:18.255 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.33333 2024-09-16T03:13:18.257 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T03:13:18.257 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2024-09-16T03:13:18.257 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T03:13:18.257 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/mon-bind 1' TERM HUP INT 2024-09-16T03:13:18.257 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:53: run: TEST_put_get td/mon-bind 2024-09-16T03:13:18.257 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:113: TEST_put_get: local dir=td/mon-bind 2024-09-16T03:13:18.257 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:117: TEST_put_get: CEPH_ARGS+='--mon-host=127.0.0.1:7132,127.0.0.1:7133,127.0.0.1:7134 ' 2024-09-16T03:13:18.258 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:118: TEST_put_get: run_mon td/mon-bind a --public-addr=127.0.0.1:7132 --public-bind-addr=127.0.0.1:7135 2024-09-16T03:13:18.258 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/mon-bind 2024-09-16T03:13:18.258 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T03:13:18.258 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T03:13:18.258 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T03:13:18.258 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/mon-bind/a 2024-09-16T03:13:18.258 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/mon-bind/a --run-dir=td/mon-bind --public-addr=127.0.0.1:7132 --public-bind-addr=127.0.0.1:7135 2024-09-16T03:13:18.745 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T03:13:18.745 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:13:18.745 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:13:18.746 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:13:18.746 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:13:18.746 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.33333 2024-09-16T03:13:18.746 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.33333/$cluster-$name.asok' 2024-09-16T03:13:18.747 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/mon-bind/a '--log-file=td/mon-bind/$name.log' '--admin-socket=/tmp/ceph-asok.33333/$cluster-$name.asok' --mon-cluster-log-file=td/mon-bind/log --run-dir=td/mon-bind '--pid-file=td/mon-bind/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr=127.0.0.1:7132 --public-bind-addr=127.0.0.1:7135 2024-09-16T03:13:18.949 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T03:13:18.950 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T03:13:18.950 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:13:18.950 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:13:18.950 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T03:13:18.951 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T03:13:18.951 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:13:18.951 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:13:18.951 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:13:18.951 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:13:18.951 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:13:18.952 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.33333 2024-09-16T03:13:18.952 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.33333/ceph-mon.a.asok 2024-09-16T03:13:18.952 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:13:18.952 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.33333/ceph-mon.a.asok config get fsid 2024-09-16T03:13:19.068 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T03:13:19.068 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:13:19.069 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:13:19.069 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T03:13:19.069 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T03:13:19.069 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:13:19.069 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:13:19.069 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:13:19.070 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:13:19.070 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:13:19.070 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.33333 2024-09-16T03:13:19.071 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.33333/ceph-mon.a.asok 2024-09-16T03:13:19.071 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:13:19.071 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.33333/ceph-mon.a.asok config get mon_host 2024-09-16T03:13:19.176 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:119: TEST_put_get: run_mon td/mon-bind b --public-addr=127.0.0.1:7133 --public-bind-addr=127.0.0.1:7136 2024-09-16T03:13:19.176 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/mon-bind 2024-09-16T03:13:19.176 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T03:13:19.176 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=b 2024-09-16T03:13:19.176 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T03:13:19.176 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/mon-bind/b 2024-09-16T03:13:19.177 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id b --mkfs --mon-data=td/mon-bind/b --run-dir=td/mon-bind --public-addr=127.0.0.1:7133 --public-bind-addr=127.0.0.1:7136 2024-09-16T03:13:19.640 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T03:13:19.641 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:13:19.641 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:13:19.641 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:13:19.641 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:13:19.642 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.33333 2024-09-16T03:13:19.642 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.33333/$cluster-$name.asok' 2024-09-16T03:13:19.642 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id b --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/mon-bind/b '--log-file=td/mon-bind/$name.log' '--admin-socket=/tmp/ceph-asok.33333/$cluster-$name.asok' --mon-cluster-log-file=td/mon-bind/log --run-dir=td/mon-bind '--pid-file=td/mon-bind/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr=127.0.0.1:7133 --public-bind-addr=127.0.0.1:7136 2024-09-16T03:13:19.893 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T03:13:19.894 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon b fsid 2024-09-16T03:13:19.894 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:13:19.894 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=b 2024-09-16T03:13:19.895 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T03:13:19.895 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T03:13:19.896 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.b 2024-09-16T03:13:19.896 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.b 2024-09-16T03:13:19.896 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.b ']' 2024-09-16T03:13:19.896 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:13:19.896 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:13:19.896 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.33333 2024-09-16T03:13:19.897 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.33333/ceph-mon.b.asok 2024-09-16T03:13:19.897 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:13:19.897 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.33333/ceph-mon.b.asok config get fsid 2024-09-16T03:13:20.016 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon b mon_host 2024-09-16T03:13:20.016 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:13:20.016 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=b 2024-09-16T03:13:20.016 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T03:13:20.017 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T03:13:20.017 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.b 2024-09-16T03:13:20.017 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.b 2024-09-16T03:13:20.017 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.b ']' 2024-09-16T03:13:20.017 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:13:20.017 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:13:20.018 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.33333 2024-09-16T03:13:20.018 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.33333/ceph-mon.b.asok 2024-09-16T03:13:20.018 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:13:20.018 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.33333/ceph-mon.b.asok config get mon_host 2024-09-16T03:13:20.127 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:120: TEST_put_get: run_mon td/mon-bind c --public-addr=127.0.0.1:7134 --public-bind-addr=127.0.0.1:7137 2024-09-16T03:13:20.127 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/mon-bind 2024-09-16T03:13:20.127 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T03:13:20.127 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=c 2024-09-16T03:13:20.127 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T03:13:20.127 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/mon-bind/c 2024-09-16T03:13:20.127 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id c --mkfs --mon-data=td/mon-bind/c --run-dir=td/mon-bind --public-addr=127.0.0.1:7134 --public-bind-addr=127.0.0.1:7137 2024-09-16T03:13:20.594 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T03:13:20.594 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:13:20.594 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:13:20.595 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:13:20.595 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:13:20.595 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.33333 2024-09-16T03:13:20.595 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.33333/$cluster-$name.asok' 2024-09-16T03:13:20.595 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id c --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/mon-bind/c '--log-file=td/mon-bind/$name.log' '--admin-socket=/tmp/ceph-asok.33333/$cluster-$name.asok' --mon-cluster-log-file=td/mon-bind/log --run-dir=td/mon-bind '--pid-file=td/mon-bind/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr=127.0.0.1:7134 --public-bind-addr=127.0.0.1:7137 2024-09-16T03:13:20.824 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T03:13:20.825 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon c fsid 2024-09-16T03:13:20.825 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:13:20.825 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=c 2024-09-16T03:13:20.825 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T03:13:20.826 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T03:13:20.826 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.c 2024-09-16T03:13:20.826 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.c 2024-09-16T03:13:20.826 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.c ']' 2024-09-16T03:13:20.827 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:13:20.827 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:13:20.827 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.33333 2024-09-16T03:13:20.827 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.33333/ceph-mon.c.asok 2024-09-16T03:13:20.827 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:13:20.827 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.33333/ceph-mon.c.asok config get fsid 2024-09-16T03:13:20.945 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon c mon_host 2024-09-16T03:13:20.945 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:13:20.945 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=c 2024-09-16T03:13:20.945 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T03:13:20.945 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T03:13:20.945 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.c 2024-09-16T03:13:20.945 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.c 2024-09-16T03:13:20.945 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.c ']' 2024-09-16T03:13:20.946 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:13:20.946 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:13:20.946 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.33333 2024-09-16T03:13:20.946 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.33333/ceph-mon.c.asok 2024-09-16T03:13:20.947 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:13:20.947 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.33333/ceph-mon.c.asok config get mon_host 2024-09-16T03:13:21.056 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:123: TEST_put_get: port_forward 7132 7135 2024-09-16T03:13:21.056 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:20: port_forward: local source_port=7132 2024-09-16T03:13:21.056 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:21: port_forward: local target_port=7135 2024-09-16T03:13:21.056 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:23: port_forward: socat TCP-LISTEN:7132,fork,reuseaddr TCP:localhost:7135 2024-09-16T03:13:21.057 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:24: port_forward: SOCAT_PIDS+=($!) 2024-09-16T03:13:21.057 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:124: TEST_put_get: port_forward 7133 7136 2024-09-16T03:13:21.057 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:20: port_forward: local source_port=7133 2024-09-16T03:13:21.057 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:21: port_forward: local target_port=7136 2024-09-16T03:13:21.057 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:24: port_forward: SOCAT_PIDS+=($!) 2024-09-16T03:13:21.057 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:125: TEST_put_get: port_forward 7134 7137 2024-09-16T03:13:21.057 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:20: port_forward: local source_port=7134 2024-09-16T03:13:21.057 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:21: port_forward: local target_port=7137 2024-09-16T03:13:21.057 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:23: port_forward: socat TCP-LISTEN:7133,fork,reuseaddr TCP:localhost:7136 2024-09-16T03:13:21.057 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:24: port_forward: SOCAT_PIDS+=($!) 2024-09-16T03:13:21.057 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:128: TEST_put_get: wait_for_quorum 300 3 2024-09-16T03:13:21.057 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:23: port_forward: socat TCP-LISTEN:7134,fork,reuseaddr TCP:localhost:7137 2024-09-16T03:13:21.058 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1046: wait_for_quorum: local timeout=300 2024-09-16T03:13:21.058 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1047: wait_for_quorum: local quorumsize=3 2024-09-16T03:13:21.058 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1049: wait_for_quorum: [[ -z 300 ]] 2024-09-16T03:13:21.058 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1053: wait_for_quorum: [[ -z 3 ]] 2024-09-16T03:13:21.058 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1058: wait_for_quorum: no_quorum=1 2024-09-16T03:13:21.058 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1059: wait_for_quorum: date +%s 2024-09-16T03:13:21.059 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1059: wait_for_quorum: wait_until=1726456701 2024-09-16T03:13:21.059 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2024-09-16T03:13:21.059 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1726456401 -lt 1726456701 ]] 2024-09-16T03:13:21.059 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 3' 2024-09-16T03:13:21.059 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 300 ceph quorum_status --format=json 2024-09-16T03:13:29.375 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2024-09-16T03:13:29.375 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"f50875ee-5756-4303-ab8d-45e11d049850","modified":"2024-09-16T03:13:18.285263Z","created":"2024-09-16T03:13:18.285263Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7132","nonce":0}]},"addr":"127.0.0.1:7132/0","public_addr":"127.0.0.1:7132/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7133","nonce":0}]},"addr":"127.0.0.1:7133/0","public_addr":"127.0.0.1:7133/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7134","nonce":0}]},"addr":"127.0.0.1:7134/0","public_addr":"127.0.0.1:7134/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:13:29.375 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"f50875ee-5756-4303-ab8d-45e11d049850","modified":"2024-09-16T03:13:18.285263Z","created":"2024-09-16T03:13:18.285263Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders:' '":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks:' '":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7132","nonce":0}]},"addr":"127.0.0.1:7132/0","public_addr":"127.0.0.1:7132/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7133","nonce":0}]},"addr":"127.0.0.1:7133/0","public_addr":"127.0.0.1:7133/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7134","nonce":0}]},"addr":"127.0.0.1:7134/0","public_addr":"127.0.0.1:7134/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:13:29.375 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 3' 2024-09-16T03:13:29.406 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=true 2024-09-16T03:13:29.406 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ true == \t\r\u\e ]] 2024-09-16T03:13:29.407 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: wait_for_quorum: no_quorum=0 2024-09-16T03:13:29.407 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1066: wait_for_quorum: break 2024-09-16T03:13:29.407 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: return 0 2024-09-16T03:13:29.407 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:130: TEST_put_get: run_mgr td/mon-bind x 2024-09-16T03:13:29.407 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/mon-bind 2024-09-16T03:13:29.407 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2024-09-16T03:13:29.407 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2024-09-16T03:13:29.407 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2024-09-16T03:13:29.407 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/mon-bind/x 2024-09-16T03:13:29.407 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2024-09-16T03:13:29.997 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2024-09-16T03:13:29.997 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:13:29.997 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:13:29.997 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:13:29.998 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:13:29.998 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.33333 2024-09-16T03:13:29.998 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.33333/$cluster-$name.asok' 2024-09-16T03:13:29.998 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T03:13:30.000 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/mon-bind/x '--log-file=td/mon-bind/$name.log' '--admin-socket=/tmp/ceph-asok.33333/$cluster-$name.asok' --run-dir=td/mon-bind '--pid-file=td/mon-bind/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T03:13:30.168 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:131: TEST_put_get: run_osd td/mon-bind 0 2024-09-16T03:13:30.168 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/mon-bind 2024-09-16T03:13:30.168 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T03:13:30.168 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2024-09-16T03:13:30.169 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T03:13:30.169 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/mon-bind/0 2024-09-16T03:13:30.169 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=f50875ee-5756-4303-ab8d-45e11d049850 --auth-supported=none --mon-host=127.0.0.1:7132 --mon-host=127.0.0.1:7132 --mon-host=127.0.0.1:7132,127.0.0.1:7133,127.0.0.1:7134 --mon-host=127.0.0.1:7132,127.0.0.1:7133,127.0.0.1:7134 ' 2024-09-16T03:13:30.169 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T03:13:30.169 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T03:13:30.169 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T03:13:30.169 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/mon-bind/0' 2024-09-16T03:13:30.169 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/mon-bind/0/journal' 2024-09-16T03:13:30.169 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T03:13:30.169 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T03:13:30.169 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/mon-bind' 2024-09-16T03:13:30.169 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T03:13:30.169 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:13:30.170 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:13:30.170 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:13:30.170 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:13:30.170 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.33333 2024-09-16T03:13:30.170 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.33333/$cluster-$name.asok' 2024-09-16T03:13:30.171 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.33333/$cluster-$name.asok' 2024-09-16T03:13:30.171 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T03:13:30.171 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T03:13:30.171 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T03:13:30.172 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/mon-bind/$name.log' 2024-09-16T03:13:30.172 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/mon-bind/$name.pid' 2024-09-16T03:13:30.172 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T03:13:30.172 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T03:13:30.172 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T03:13:30.172 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T03:13:30.172 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T03:13:30.172 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T03:13:30.172 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/mon-bind/0 2024-09-16T03:13:30.172 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T03:13:30.172 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=d37e51c2-2055-41db-baeb-d0420625774e 2024-09-16T03:13:30.172 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 d37e51c2-2055-41db-baeb-d0420625774e' 2024-09-16T03:13:30.173 INFO:tasks.workunit.client.0.smithi096.stdout:add osd0 d37e51c2-2055-41db-baeb-d0420625774e 2024-09-16T03:13:30.173 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T03:13:30.190 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBaoudm5p1HCxAAxrufd84mQpvTJ510YKmo3A== 2024-09-16T03:13:30.191 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBaoudm5p1HCxAAxrufd84mQpvTJ510YKmo3A=="}' 2024-09-16T03:13:30.191 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new d37e51c2-2055-41db-baeb-d0420625774e -i td/mon-bind/0/new.json 2024-09-16T03:13:30.768 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T03:13:30.784 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/mon-bind/0/new.json 2024-09-16T03:13:30.785 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=f50875ee-5756-4303-ab8d-45e11d049850 --auth-supported=none --mon-host=127.0.0.1:7132 --mon-host=127.0.0.1:7132 --mon-host=127.0.0.1:7132,127.0.0.1:7133,127.0.0.1:7134 --mon-host=127.0.0.1:7132,127.0.0.1:7133,127.0.0.1:7134 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/mon-bind/0 --osd-journal=td/mon-bind/0/journal --chdir= --run-dir=td/mon-bind '--admin-socket=/tmp/ceph-asok.33333/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/mon-bind/$name.log' '--pid-file=td/mon-bind/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBaoudm5p1HCxAAxrufd84mQpvTJ510YKmo3A== --osd-uuid d37e51c2-2055-41db-baeb-d0420625774e 2024-09-16T03:13:30.819 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:13:30.816+0000 7f1a1316f7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:13:31.124 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:13:31.120+0000 7f1a1316f7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:13:31.126 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:13:31.120+0000 7f1a1316f7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:13:31.126 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:13:31.124+0000 7f1a1316f7c0 -1 bdev(0x5640d3513c00 td/mon-bind/0/block) open stat got: (1) Operation not permitted 2024-09-16T03:13:31.126 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:13:31.124+0000 7f1a1316f7c0 -1 bluestore(td/mon-bind/0) _read_fsid unparsable uuid 2024-09-16T03:13:36.039 INFO:tasks.workunit.client.0.smithi096.stderr:2024/09/16 03:13:36 socat[35069] E write(6, 0x5572f8fb7000, 68): Broken pipe 2024-09-16T03:13:38.226 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/mon-bind/0/keyring 2024-09-16T03:13:38.226 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T03:13:38.227 INFO:tasks.workunit.client.0.smithi096.stdout:adding osd0 key to auth repository 2024-09-16T03:13:38.227 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2024-09-16T03:13:38.228 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/mon-bind/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T03:13:38.447 INFO:tasks.workunit.client.0.smithi096.stderr:2024/09/16 03:13:38 socat[35299] E write(6, 0x55b1e50c6000, 68): Broken pipe 2024-09-16T03:13:38.447 INFO:tasks.workunit.client.0.smithi096.stderr:2024/09/16 03:13:38 socat[35298] E write(6, 0x559421e02000, 68): Broken pipe 2024-09-16T03:13:39.134 INFO:tasks.workunit.client.0.smithi096.stdout:start osd.0 2024-09-16T03:13:39.134 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2024-09-16T03:13:39.135 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=f50875ee-5756-4303-ab8d-45e11d049850 --auth-supported=none --mon-host=127.0.0.1:7132 --mon-host=127.0.0.1:7132 --mon-host=127.0.0.1:7132,127.0.0.1:7133,127.0.0.1:7134 --mon-host=127.0.0.1:7132,127.0.0.1:7133,127.0.0.1:7134 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/mon-bind/0 --osd-journal=td/mon-bind/0/journal --chdir= --run-dir=td/mon-bind '--admin-socket=/tmp/ceph-asok.33333/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/mon-bind/$name.log' '--pid-file=td/mon-bind/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T03:13:39.135 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T03:13:39.135 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T03:13:39.135 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T03:13:39.165 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:13:39.160+0000 7f0b77ee57c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:13:39.299 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:13:39.296+0000 7f0b77ee57c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:13:39.301 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:13:39.296+0000 7f0b77ee57c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:13:39.435 INFO:tasks.workunit.client.0.smithi096.stderr:2024/09/16 03:13:39 socat[35348] E write(6, 0x559421e02000, 68): Broken pipe 2024-09-16T03:13:39.436 INFO:tasks.workunit.client.0.smithi096.stderr:2024/09/16 03:13:39 socat[35347] E write(6, 0x55b1e50c6000, 68): Broken pipe 2024-09-16T03:13:39.820 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2024-09-16T03:13:39.820 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:13:39.820 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2024-09-16T03:13:39.820 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:13:39.820 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:13:39.820 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:13:39.820 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T03:13:39.821 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:13:39.821 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:13:39.821 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:13:40.107 INFO:tasks.workunit.client.0.smithi096.stderr:2024/09/16 03:13:40 socat[35383] E write(6, 0x559421e02000, 68): Broken pipe 2024-09-16T03:13:40.284 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:13:40.280+0000 7f0b77ee57c0 -1 Falling back to public interface 2024-09-16T03:13:40.724 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:13:41.726 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:13:41.726 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:13:41.726 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T03:13:41.727 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T03:13:41.727 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:13:41.727 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:13:41.887 INFO:tasks.workunit.client.0.smithi096.stderr:2024/09/16 03:13:41 socat[35424] E write(6, 0x55b1e50c6000, 68): Broken pipe 2024-09-16T03:13:42.023 INFO:tasks.workunit.client.0.smithi096.stderr:2024/09/16 03:13:42 socat[35432] E write(6, 0x55b1e50c6000, 68): Broken pipe 2024-09-16T03:13:42.450 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:13:43.253 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:13:43.248+0000 7f0b77ee57c0 -1 osd.0 0 log_to_monitors true 2024-09-16T03:13:43.452 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:13:43.452 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:13:43.452 INFO:tasks.workunit.client.0.smithi096.stdout:2 2024-09-16T03:13:43.453 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T03:13:43.453 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:13:43.453 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:13:43.747 INFO:tasks.workunit.client.0.smithi096.stderr:2024/09/16 03:13:43 socat[35877] E write(6, 0x5572f8fb7000, 68): Broken pipe 2024-09-16T03:13:44.820 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:13:45.821 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:13:45.822 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:13:45.822 INFO:tasks.workunit.client.0.smithi096.stdout:3 2024-09-16T03:13:45.822 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T03:13:45.822 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:13:45.822 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:13:46.773 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:13:47.775 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:13:47.775 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:13:47.776 INFO:tasks.workunit.client.0.smithi096.stdout:4 2024-09-16T03:13:47.777 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T03:13:47.777 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:13:47.777 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:13:48.080 INFO:tasks.workunit.client.0.smithi096.stderr:2024/09/16 03:13:48 socat[35951] E write(6, 0x5572f8fb7000, 68): Broken pipe 2024-09-16T03:13:48.080 INFO:tasks.workunit.client.0.smithi096.stderr:2024/09/16 03:13:48 socat[35950] E write(6, 0x55b1e50c6000, 68): Broken pipe 2024-09-16T03:13:48.465 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:13:49.466 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:13:49.466 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:13:49.467 INFO:tasks.workunit.client.0.smithi096.stdout:5 2024-09-16T03:13:49.467 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T03:13:49.467 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:13:49.467 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:13:49.747 INFO:tasks.workunit.client.0.smithi096.stderr:2024/09/16 03:13:49 socat[35980] E write(6, 0x55b1e50c6000, 68): Broken pipe 2024-09-16T03:13:49.747 INFO:tasks.workunit.client.0.smithi096.stderr:2024/09/16 03:13:49 socat[35982] E write(6, 0x559421e02000, 68): Broken pipe 2024-09-16T03:13:50.241 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:13:51.243 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:13:51.243 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:13:51.243 INFO:tasks.workunit.client.0.smithi096.stdout:6 2024-09-16T03:13:51.244 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T03:13:51.244 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:13:51.244 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:13:52.111 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:13:53.113 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:13:53.113 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:13:53.113 INFO:tasks.workunit.client.0.smithi096.stdout:7 2024-09-16T03:13:53.114 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T03:13:53.114 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:13:53.114 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:13:53.399 INFO:tasks.workunit.client.0.smithi096.stderr:2024/09/16 03:13:53 socat[36043] E write(6, 0x5572f8fb7000, 68): Broken pipe 2024-09-16T03:13:53.399 INFO:tasks.workunit.client.0.smithi096.stderr:2024/09/16 03:13:53 socat[36044] E write(6, 0x55b1e50c6000, 68): Broken pipe 2024-09-16T03:13:54.098 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:13:55.099 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:13:55.099 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:13:55.100 INFO:tasks.workunit.client.0.smithi096.stdout:8 2024-09-16T03:13:55.100 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T03:13:55.100 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:13:55.100 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:13:56.358 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:13:57.360 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:13:57.360 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:13:57.360 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T03:13:57.361 INFO:tasks.workunit.client.0.smithi096.stdout:9 2024-09-16T03:13:57.361 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:13:57.361 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:13:57.522 INFO:tasks.workunit.client.0.smithi096.stderr:2024/09/16 03:13:57 socat[36094] E write(6, 0x5572f8fb7000, 68): Broken pipe 2024-09-16T03:13:57.523 INFO:tasks.workunit.client.0.smithi096.stderr:2024/09/16 03:13:57 socat[36096] E write(6, 0x55b1e50c6000, 68): Broken pipe 2024-09-16T03:13:59.999 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:14:01.001 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:14:01.001 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:14:01.001 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T03:14:01.001 INFO:tasks.workunit.client.0.smithi096.stdout:10 2024-09-16T03:14:01.002 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:14:01.002 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:14:01.251 INFO:tasks.workunit.client.0.smithi096.stderr:2024/09/16 03:14:01 socat[36136] E write(6, 0x5572f8fb7000, 68): Broken pipe 2024-09-16T03:14:01.251 INFO:tasks.workunit.client.0.smithi096.stderr:2024/09/16 03:14:01 socat[36135] E write(6, 0x559421e02000, 68): Broken pipe 2024-09-16T03:14:03.132 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:14:04.134 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:14:04.134 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:14:04.134 INFO:tasks.workunit.client.0.smithi096.stdout:11 2024-09-16T03:14:04.135 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T03:14:04.135 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:14:04.135 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:14:06.633 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:14:07.634 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:14:07.635 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:14:07.635 INFO:tasks.workunit.client.0.smithi096.stdout:12 2024-09-16T03:14:07.636 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T03:14:07.636 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:14:07.636 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:14:08.554 INFO:tasks.workunit.client.0.smithi096.stderr:2024/09/16 03:14:08 socat[36198] E write(6, 0x55b1e50c6000, 68): Broken pipe 2024-09-16T03:14:09.985 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:14:10.987 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:14:10.987 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:14:10.987 INFO:tasks.workunit.client.0.smithi096.stdout:13 2024-09-16T03:14:10.988 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T03:14:10.988 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:14:10.988 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:14:11.290 INFO:tasks.workunit.client.0.smithi096.stderr:2024/09/16 03:14:11 socat[36230] E write(6, 0x5572f8fb7000, 68): Broken pipe 2024-09-16T03:14:12.233 INFO:tasks.workunit.client.0.smithi096.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/640551947,v1:127.0.0.1:6803/640551947] [v2:127.0.0.1:6804/640551947,v1:127.0.0.1:6805/640551947] exists,up d37e51c2-2055-41db-baeb-d0420625774e 2024-09-16T03:14:12.235 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:14:12.235 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:14:12.235 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:14:12.235 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:132: TEST_put_get: run_osd td/mon-bind 1 2024-09-16T03:14:12.236 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/mon-bind 2024-09-16T03:14:12.236 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T03:14:12.236 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2024-09-16T03:14:12.236 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T03:14:12.236 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/mon-bind/1 2024-09-16T03:14:12.236 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=f50875ee-5756-4303-ab8d-45e11d049850 --auth-supported=none --mon-host=127.0.0.1:7132 --mon-host=127.0.0.1:7132 --mon-host=127.0.0.1:7132,127.0.0.1:7133,127.0.0.1:7134 --mon-host=127.0.0.1:7132,127.0.0.1:7133,127.0.0.1:7134 ' 2024-09-16T03:14:12.236 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T03:14:12.236 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T03:14:12.236 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T03:14:12.236 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/mon-bind/1' 2024-09-16T03:14:12.236 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/mon-bind/1/journal' 2024-09-16T03:14:12.236 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T03:14:12.237 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T03:14:12.237 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/mon-bind' 2024-09-16T03:14:12.237 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T03:14:12.237 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:14:12.237 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:14:12.237 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:14:12.237 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:14:12.237 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.33333 2024-09-16T03:14:12.237 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.33333/$cluster-$name.asok' 2024-09-16T03:14:12.238 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.33333/$cluster-$name.asok' 2024-09-16T03:14:12.238 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T03:14:12.238 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T03:14:12.238 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T03:14:12.238 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/mon-bind/$name.log' 2024-09-16T03:14:12.238 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/mon-bind/$name.pid' 2024-09-16T03:14:12.238 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T03:14:12.239 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T03:14:12.239 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T03:14:12.239 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T03:14:12.239 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T03:14:12.239 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T03:14:12.239 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/mon-bind/1 2024-09-16T03:14:12.239 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T03:14:12.239 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=b8bd2860-0db0-4dbb-a922-28f76b7563fc 2024-09-16T03:14:12.239 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 b8bd2860-0db0-4dbb-a922-28f76b7563fc' 2024-09-16T03:14:12.240 INFO:tasks.workunit.client.0.smithi096.stdout:add osd1 b8bd2860-0db0-4dbb-a922-28f76b7563fc 2024-09-16T03:14:12.240 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T03:14:12.261 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCEoudmuYF+DxAAoCz5GVkHmYcqvKPS8LhC9g== 2024-09-16T03:14:12.261 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCEoudmuYF+DxAAoCz5GVkHmYcqvKPS8LhC9g=="}' 2024-09-16T03:14:12.261 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new b8bd2860-0db0-4dbb-a922-28f76b7563fc -i td/mon-bind/1/new.json 2024-09-16T03:14:13.129 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T03:14:13.147 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/mon-bind/1/new.json 2024-09-16T03:14:13.148 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=f50875ee-5756-4303-ab8d-45e11d049850 --auth-supported=none --mon-host=127.0.0.1:7132 --mon-host=127.0.0.1:7132 --mon-host=127.0.0.1:7132,127.0.0.1:7133,127.0.0.1:7134 --mon-host=127.0.0.1:7132,127.0.0.1:7133,127.0.0.1:7134 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/mon-bind/1 --osd-journal=td/mon-bind/1/journal --chdir= --run-dir=td/mon-bind '--admin-socket=/tmp/ceph-asok.33333/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/mon-bind/$name.log' '--pid-file=td/mon-bind/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCEoudmuYF+DxAAoCz5GVkHmYcqvKPS8LhC9g== --osd-uuid b8bd2860-0db0-4dbb-a922-28f76b7563fc 2024-09-16T03:14:13.181 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:14:13.175+0000 7f73b519b7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:14:13.474 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:14:13.471+0000 7f73b519b7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:14:13.477 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:14:13.471+0000 7f73b519b7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:14:13.477 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:14:13.471+0000 7f73b519b7c0 -1 bdev(0x55e42197fc00 td/mon-bind/1/block) open stat got: (1) Operation not permitted 2024-09-16T03:14:13.477 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:14:13.471+0000 7f73b519b7c0 -1 bluestore(td/mon-bind/1) _read_fsid unparsable uuid 2024-09-16T03:14:20.324 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/mon-bind/1/keyring 2024-09-16T03:14:20.324 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T03:14:20.325 INFO:tasks.workunit.client.0.smithi096.stdout:adding osd1 key to auth repository 2024-09-16T03:14:20.326 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2024-09-16T03:14:20.326 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/mon-bind/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T03:14:20.623 INFO:tasks.workunit.client.0.smithi096.stderr:2024/09/16 03:14:20 socat[37071] E write(6, 0x55b1e50c6000, 68): Broken pipe 2024-09-16T03:14:20.623 INFO:tasks.workunit.client.0.smithi096.stderr:2024/09/16 03:14:20 socat[37070] E write(6, 0x559421e02000, 68): Broken pipe 2024-09-16T03:14:21.175 INFO:tasks.workunit.client.0.smithi096.stdout:start osd.1 2024-09-16T03:14:21.176 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2024-09-16T03:14:21.176 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T03:14:21.176 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T03:14:21.177 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=f50875ee-5756-4303-ab8d-45e11d049850 --auth-supported=none --mon-host=127.0.0.1:7132 --mon-host=127.0.0.1:7132 --mon-host=127.0.0.1:7132,127.0.0.1:7133,127.0.0.1:7134 --mon-host=127.0.0.1:7132,127.0.0.1:7133,127.0.0.1:7134 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/mon-bind/1 --osd-journal=td/mon-bind/1/journal --chdir= --run-dir=td/mon-bind '--admin-socket=/tmp/ceph-asok.33333/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/mon-bind/$name.log' '--pid-file=td/mon-bind/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T03:14:21.177 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T03:14:21.207 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:14:21.203+0000 7f3bbcdbb7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:14:21.361 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:14:21.355+0000 7f3bbcdbb7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:14:21.362 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:14:21.359+0000 7f3bbcdbb7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:14:21.454 INFO:tasks.workunit.client.0.smithi096.stderr:2024/09/16 03:14:21 socat[37118] E write(6, 0x559421e02000, 68): Broken pipe 2024-09-16T03:14:22.279 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2024-09-16T03:14:22.280 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:14:22.280 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2024-09-16T03:14:22.280 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:14:22.280 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:14:22.280 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:14:22.280 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T03:14:22.281 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:14:22.281 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:14:22.281 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:14:22.443 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:14:22.439+0000 7f3bbcdbb7c0 -1 Falling back to public interface 2024-09-16T03:14:22.630 INFO:tasks.workunit.client.0.smithi096.stderr:2024/09/16 03:14:22 socat[37162] E write(6, 0x559421e02000, 68): Broken pipe 2024-09-16T03:14:23.174 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:14:24.175 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:14:24.176 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:14:24.176 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T03:14:24.177 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T03:14:24.177 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:14:24.177 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:14:24.470 INFO:tasks.workunit.client.0.smithi096.stderr:2024/09/16 03:14:24 socat[37214] E write(6, 0x559421e02000, 68): Broken pipe 2024-09-16T03:14:24.470 INFO:tasks.workunit.client.0.smithi096.stderr:2024/09/16 03:14:24 socat[37212] E write(6, 0x5572f8fb7000, 68): Broken pipe 2024-09-16T03:14:25.100 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:14:25.749 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:14:25.743+0000 7f3bbcdbb7c0 -1 osd.1 0 log_to_monitors true 2024-09-16T03:14:26.102 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:14:26.102 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:14:26.102 INFO:tasks.workunit.client.0.smithi096.stdout:2 2024-09-16T03:14:26.103 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T03:14:26.103 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:14:26.103 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:14:26.422 INFO:tasks.workunit.client.0.smithi096.stderr:2024/09/16 03:14:26 socat[37648] E write(6, 0x55b1e50c6000, 68): Broken pipe 2024-09-16T03:14:27.124 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:14:28.126 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:14:28.126 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:14:28.126 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T03:14:28.126 INFO:tasks.workunit.client.0.smithi096.stdout:3 2024-09-16T03:14:28.127 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:14:28.127 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:14:28.832 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:14:29.832 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:14:29.833 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:14:29.833 INFO:tasks.workunit.client.0.smithi096.stdout:4 2024-09-16T03:14:29.833 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T03:14:29.834 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:14:29.834 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:14:30.088 INFO:tasks.workunit.client.0.smithi096.stderr:2024/09/16 03:14:30 socat[37711] E write(6, 0x55b1e50c6000, 68): Broken pipe 2024-09-16T03:14:30.815 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:14:31.817 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:14:31.817 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:14:31.817 INFO:tasks.workunit.client.0.smithi096.stdout:5 2024-09-16T03:14:31.818 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T03:14:31.818 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:14:31.818 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:14:32.218 INFO:tasks.workunit.client.0.smithi096.stderr:2024/09/16 03:14:32 socat[37741] E write(6, 0x5572f8fb7000, 68): Broken pipe 2024-09-16T03:14:33.062 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:14:34.064 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:14:34.064 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:14:34.064 INFO:tasks.workunit.client.0.smithi096.stdout:6 2024-09-16T03:14:34.065 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T03:14:34.065 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:14:34.065 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:14:34.318 INFO:tasks.workunit.client.0.smithi096.stderr:2024/09/16 03:14:34 socat[37771] E write(6, 0x5572f8fb7000, 72): Broken pipe 2024-09-16T03:14:34.318 INFO:tasks.workunit.client.0.smithi096.stderr:2024/09/16 03:14:34 socat[37773] E write(6, 0x55b1e50c6000, 68): Broken pipe 2024-09-16T03:14:35.201 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:14:36.203 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:14:36.203 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:14:36.204 INFO:tasks.workunit.client.0.smithi096.stdout:7 2024-09-16T03:14:36.205 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T03:14:36.205 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:14:36.205 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:14:36.498 INFO:tasks.workunit.client.0.smithi096.stderr:2024/09/16 03:14:36 socat[37804] E write(6, 0x5572f8fb7000, 68): Broken pipe 2024-09-16T03:14:37.236 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:14:38.237 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:14:38.237 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:14:38.238 INFO:tasks.workunit.client.0.smithi096.stdout:8 2024-09-16T03:14:38.238 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T03:14:38.238 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:14:38.238 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:14:38.675 INFO:tasks.workunit.client.0.smithi096.stderr:2024/09/16 03:14:38 socat[37835] E write(6, 0x5572f8fb7000, 68): Broken pipe 2024-09-16T03:14:38.675 INFO:tasks.workunit.client.0.smithi096.stderr:2024/09/16 03:14:38 socat[37834] E write(6, 0x55b1e50c6000, 68): Broken pipe 2024-09-16T03:14:39.252 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:14:40.254 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:14:40.254 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:14:40.254 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T03:14:40.254 INFO:tasks.workunit.client.0.smithi096.stdout:9 2024-09-16T03:14:40.255 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:14:40.255 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:14:40.414 INFO:tasks.workunit.client.0.smithi096.stderr:2024/09/16 03:14:40 socat[37855] E write(6, 0x559421e02000, 68): Broken pipe 2024-09-16T03:14:41.431 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:14:42.433 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:14:42.433 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:14:42.433 INFO:tasks.workunit.client.0.smithi096.stdout:10 2024-09-16T03:14:42.434 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T03:14:42.434 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:14:42.434 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:14:43.627 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:14:44.629 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:14:44.629 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:14:44.630 INFO:tasks.workunit.client.0.smithi096.stdout:11 2024-09-16T03:14:44.630 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T03:14:44.630 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:14:44.630 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:14:44.782 INFO:tasks.workunit.client.0.smithi096.stderr:2024/09/16 03:14:44 socat[37917] E write(6, 0x5572f8fb7000, 68): Broken pipe 2024-09-16T03:14:44.782 INFO:tasks.workunit.client.0.smithi096.stderr:2024/09/16 03:14:44 socat[37918] E write(6, 0x559421e02000, 68): Broken pipe 2024-09-16T03:14:44.922 INFO:tasks.workunit.client.0.smithi096.stderr:2024/09/16 03:14:44 socat[37928] E write(6, 0x5572f8fb7000, 68): Broken pipe 2024-09-16T03:14:46.953 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:14:47.955 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:14:47.955 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:14:47.956 INFO:tasks.workunit.client.0.smithi096.stdout:12 2024-09-16T03:14:47.956 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T03:14:47.956 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:14:47.956 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:14:49.121 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:14:50.123 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:14:50.123 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:14:50.123 INFO:tasks.workunit.client.0.smithi096.stdout:13 2024-09-16T03:14:50.124 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T03:14:50.124 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:14:50.124 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:14:50.278 INFO:tasks.workunit.client.0.smithi096.stderr:2024/09/16 03:14:50 socat[37978] E write(6, 0x559421e02000, 68): Broken pipe 2024-09-16T03:14:50.414 INFO:tasks.workunit.client.0.smithi096.stderr:2024/09/16 03:14:50 socat[37989] E write(6, 0x5572f8fb7000, 68): Broken pipe 2024-09-16T03:14:50.414 INFO:tasks.workunit.client.0.smithi096.stderr:2024/09/16 03:14:50 socat[37988] E write(6, 0x55b1e50c6000, 68): Broken pipe 2024-09-16T03:14:52.764 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:14:53.765 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:14:53.765 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:14:53.766 INFO:tasks.workunit.client.0.smithi096.stdout:14 2024-09-16T03:14:53.766 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T03:14:53.766 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:14:53.766 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:14:54.210 INFO:tasks.workunit.client.0.smithi096.stderr:2024/09/16 03:14:54 socat[38021] E write(6, 0x5572f8fb7000, 68): Broken pipe 2024-09-16T03:14:55.225 INFO:tasks.workunit.client.0.smithi096.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/800387803,v1:127.0.0.1:6811/800387803] [v2:127.0.0.1:6812/800387803,v1:127.0.0.1:6813/800387803] exists,up b8bd2860-0db0-4dbb-a922-28f76b7563fc 2024-09-16T03:14:55.228 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:14:55.228 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:14:55.228 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:14:55.228 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:133: TEST_put_get: run_osd td/mon-bind 2 2024-09-16T03:14:55.229 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/mon-bind 2024-09-16T03:14:55.229 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T03:14:55.229 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2024-09-16T03:14:55.229 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T03:14:55.229 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/mon-bind/2 2024-09-16T03:14:55.229 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=f50875ee-5756-4303-ab8d-45e11d049850 --auth-supported=none --mon-host=127.0.0.1:7132 --mon-host=127.0.0.1:7132 --mon-host=127.0.0.1:7132,127.0.0.1:7133,127.0.0.1:7134 --mon-host=127.0.0.1:7132,127.0.0.1:7133,127.0.0.1:7134 ' 2024-09-16T03:14:55.229 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T03:14:55.229 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T03:14:55.230 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T03:14:55.230 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/mon-bind/2' 2024-09-16T03:14:55.230 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/mon-bind/2/journal' 2024-09-16T03:14:55.230 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T03:14:55.230 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T03:14:55.230 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/mon-bind' 2024-09-16T03:14:55.230 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T03:14:55.230 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:14:55.230 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:14:55.230 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:14:55.230 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:14:55.230 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.33333 2024-09-16T03:14:55.231 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.33333/$cluster-$name.asok' 2024-09-16T03:14:55.231 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.33333/$cluster-$name.asok' 2024-09-16T03:14:55.231 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T03:14:55.231 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T03:14:55.231 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T03:14:55.231 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/mon-bind/$name.log' 2024-09-16T03:14:55.231 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/mon-bind/$name.pid' 2024-09-16T03:14:55.231 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T03:14:55.231 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T03:14:55.231 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T03:14:55.231 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T03:14:55.231 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T03:14:55.231 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T03:14:55.232 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/mon-bind/2 2024-09-16T03:14:55.232 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T03:14:55.232 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=8507ecf2-5af8-436c-8bcd-452fb625b958 2024-09-16T03:14:55.232 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 8507ecf2-5af8-436c-8bcd-452fb625b958' 2024-09-16T03:14:55.233 INFO:tasks.workunit.client.0.smithi096.stdout:add osd2 8507ecf2-5af8-436c-8bcd-452fb625b958 2024-09-16T03:14:55.233 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T03:14:55.251 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCvoudmzuv0DhAAPLeO50VDwVNNiJ0FJ8MaSQ== 2024-09-16T03:14:55.251 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCvoudmzuv0DhAAPLeO50VDwVNNiJ0FJ8MaSQ=="}' 2024-09-16T03:14:55.251 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 8507ecf2-5af8-436c-8bcd-452fb625b958 -i td/mon-bind/2/new.json 2024-09-16T03:14:55.402 INFO:tasks.workunit.client.0.smithi096.stderr:2024/09/16 03:14:55 socat[38046] E write(6, 0x559421e02000, 68): Broken pipe 2024-09-16T03:14:55.566 INFO:tasks.workunit.client.0.smithi096.stderr:2024/09/16 03:14:55 socat[38057] E write(6, 0x5572f8fb7000, 68): Broken pipe 2024-09-16T03:14:55.566 INFO:tasks.workunit.client.0.smithi096.stderr:2024/09/16 03:14:55 socat[38056] E write(6, 0x55b1e50c6000, 68): Broken pipe 2024-09-16T03:14:57.005 INFO:tasks.workunit.client.0.smithi096.stdout:2 2024-09-16T03:14:57.027 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/mon-bind/2/new.json 2024-09-16T03:14:57.029 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=f50875ee-5756-4303-ab8d-45e11d049850 --auth-supported=none --mon-host=127.0.0.1:7132 --mon-host=127.0.0.1:7132 --mon-host=127.0.0.1:7132,127.0.0.1:7133,127.0.0.1:7134 --mon-host=127.0.0.1:7132,127.0.0.1:7133,127.0.0.1:7134 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/mon-bind/2 --osd-journal=td/mon-bind/2/journal --chdir= --run-dir=td/mon-bind '--admin-socket=/tmp/ceph-asok.33333/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/mon-bind/$name.log' '--pid-file=td/mon-bind/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCvoudmzuv0DhAAPLeO50VDwVNNiJ0FJ8MaSQ== --osd-uuid 8507ecf2-5af8-436c-8bcd-452fb625b958 2024-09-16T03:14:57.062 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:14:57.059+0000 7f9f6b3997c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:14:57.259 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:14:57.255+0000 7f9f6b3997c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:14:57.261 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:14:57.259+0000 7f9f6b3997c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:14:57.262 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:14:57.259+0000 7f9f6b3997c0 -1 bdev(0x55c9f2855c00 td/mon-bind/2/block) open stat got: (1) Operation not permitted 2024-09-16T03:14:57.262 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:14:57.259+0000 7f9f6b3997c0 -1 bluestore(td/mon-bind/2) _read_fsid unparsable uuid 2024-09-16T03:15:04.403 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/mon-bind/2/keyring 2024-09-16T03:15:04.404 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T03:15:04.404 INFO:tasks.workunit.client.0.smithi096.stdout:adding osd2 key to auth repository 2024-09-16T03:15:04.405 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2024-09-16T03:15:04.405 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/mon-bind/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T03:15:05.503 INFO:tasks.workunit.client.0.smithi096.stdout:start osd.2 2024-09-16T03:15:05.503 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2024-09-16T03:15:05.503 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=f50875ee-5756-4303-ab8d-45e11d049850 --auth-supported=none --mon-host=127.0.0.1:7132 --mon-host=127.0.0.1:7132 --mon-host=127.0.0.1:7132,127.0.0.1:7133,127.0.0.1:7134 --mon-host=127.0.0.1:7132,127.0.0.1:7133,127.0.0.1:7134 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/mon-bind/2 --osd-journal=td/mon-bind/2/journal --chdir= --run-dir=td/mon-bind '--admin-socket=/tmp/ceph-asok.33333/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/mon-bind/$name.log' '--pid-file=td/mon-bind/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T03:15:05.503 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T03:15:05.504 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T03:15:05.504 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T03:15:05.534 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:15:05.531+0000 7f6429d3e7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:15:05.657 INFO:tasks.workunit.client.0.smithi096.stderr:2024/09/16 03:15:05 socat[38898] E write(6, 0x55b1e50c6000, 68): Broken pipe 2024-09-16T03:15:05.722 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:15:05.719+0000 7f6429d3e7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:15:05.724 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:15:05.719+0000 7f6429d3e7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:15:06.340 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2024-09-16T03:15:06.340 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:15:06.340 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2024-09-16T03:15:06.340 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:15:06.340 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:15:06.340 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:15:06.341 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:15:06.341 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T03:15:06.341 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:15:06.341 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:15:07.194 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:15:07.304 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:15:07.299+0000 7f6429d3e7c0 -1 Falling back to public interface 2024-09-16T03:15:08.195 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:15:08.195 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:15:08.195 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T03:15:08.196 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T03:15:08.196 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:15:08.196 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:15:09.094 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:15:10.096 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:15:10.096 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:15:10.097 INFO:tasks.workunit.client.0.smithi096.stdout:2 2024-09-16T03:15:10.097 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T03:15:10.097 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:15:10.100 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:15:10.253 INFO:tasks.workunit.client.0.smithi096.stderr:2024/09/16 03:15:10 socat[39399] E write(6, 0x559421e02000, 68): Broken pipe 2024-09-16T03:15:10.288 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:15:10.283+0000 7f6429d3e7c0 -1 osd.2 0 log_to_monitors true 2024-09-16T03:15:10.385 INFO:tasks.workunit.client.0.smithi096.stderr:2024/09/16 03:15:10 socat[39444] E write(6, 0x559421e02000, 68): Broken pipe 2024-09-16T03:15:11.581 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:15:12.583 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:15:12.583 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:15:12.583 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T03:15:12.584 INFO:tasks.workunit.client.0.smithi096.stdout:3 2024-09-16T03:15:12.584 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:15:12.584 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:15:13.750 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:15:14.752 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:15:14.752 INFO:tasks.workunit.client.0.smithi096.stdout:4 2024-09-16T03:15:14.753 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:15:14.753 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T03:15:14.753 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:15:14.753 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:15:14.909 INFO:tasks.workunit.client.0.smithi096.stderr:2024/09/16 03:15:14 socat[39496] E write(6, 0x5572f8fb7000, 68): Broken pipe 2024-09-16T03:15:15.045 INFO:tasks.workunit.client.0.smithi096.stderr:2024/09/16 03:15:15 socat[39506] E write(6, 0x559421e02000, 68): Broken pipe 2024-09-16T03:15:15.521 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:15:16.523 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:15:16.523 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:15:16.524 INFO:tasks.workunit.client.0.smithi096.stdout:5 2024-09-16T03:15:16.524 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T03:15:16.524 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:15:16.524 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:15:16.682 INFO:tasks.workunit.client.0.smithi096.stderr:2024/09/16 03:15:16 socat[39529] E write(6, 0x559421e02000, 68): Broken pipe 2024-09-16T03:15:16.813 INFO:tasks.workunit.client.0.smithi096.stderr:2024/09/16 03:15:16 socat[39537] E write(6, 0x5572f8fb7000, 68): Broken pipe 2024-09-16T03:15:17.730 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:15:18.731 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:15:18.732 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:15:18.732 INFO:tasks.workunit.client.0.smithi096.stdout:6 2024-09-16T03:15:18.732 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T03:15:18.733 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:15:18.733 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:15:20.186 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:15:21.188 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:15:21.188 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:15:21.189 INFO:tasks.workunit.client.0.smithi096.stdout:7 2024-09-16T03:15:21.189 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T03:15:21.189 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:15:21.189 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:15:21.558 INFO:tasks.workunit.client.0.smithi096.stderr:2024/09/16 03:15:21 socat[39599] E write(6, 0x559421e02000, 68): Broken pipe 2024-09-16T03:15:21.975 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:15:22.976 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:15:22.977 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:15:22.977 INFO:tasks.workunit.client.0.smithi096.stdout:8 2024-09-16T03:15:22.977 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T03:15:22.977 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:15:22.977 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:15:24.102 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:15:25.104 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:15:25.104 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:15:25.105 INFO:tasks.workunit.client.0.smithi096.stdout:9 2024-09-16T03:15:25.105 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T03:15:25.105 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:15:25.105 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:15:25.369 INFO:tasks.workunit.client.0.smithi096.stderr:2024/09/16 03:15:25 socat[39663] E write(6, 0x55b1e50c6000, 68): Broken pipe 2024-09-16T03:15:25.370 INFO:tasks.workunit.client.0.smithi096.stderr:2024/09/16 03:15:25 socat[39662] E write(6, 0x5572f8fb7000, 68): Broken pipe 2024-09-16T03:15:26.697 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:15:27.699 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:15:27.699 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:15:27.699 INFO:tasks.workunit.client.0.smithi096.stdout:10 2024-09-16T03:15:27.700 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T03:15:27.700 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:15:27.700 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:15:30.896 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:15:31.898 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:15:31.898 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:15:31.898 INFO:tasks.workunit.client.0.smithi096.stdout:11 2024-09-16T03:15:31.899 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T03:15:31.899 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:15:31.899 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:15:34.773 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:15:35.795 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:15:35.795 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:15:35.796 INFO:tasks.workunit.client.0.smithi096.stdout:12 2024-09-16T03:15:35.796 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T03:15:35.989 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:15:35.989 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:15:37.018 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:15:38.020 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:15:38.020 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:15:38.020 INFO:tasks.workunit.client.0.smithi096.stdout:13 2024-09-16T03:15:38.021 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T03:15:38.021 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:15:38.021 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:15:38.822 INFO:tasks.workunit.client.0.smithi096.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/1348997054,v1:127.0.0.1:6819/1348997054] [v2:127.0.0.1:6820/1348997054,v1:127.0.0.1:6821/1348997054] exists,up 8507ecf2-5af8-436c-8bcd-452fb625b958 2024-09-16T03:15:38.822 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:15:38.822 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:15:38.823 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:15:38.823 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:135: TEST_put_get: create_pool hello 8 2024-09-16T03:15:38.823 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create hello 8 2024-09-16T03:15:38.981 INFO:tasks.workunit.client.0.smithi096.stderr:2024/09/16 03:15:38 socat[39804] E write(6, 0x559421e02000, 68): Broken pipe 2024-09-16T03:15:41.265 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'hello' already exists 2024-09-16T03:15:41.290 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2024-09-16T03:15:42.292 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:137: TEST_put_get: echo 'hello world' 2024-09-16T03:15:42.292 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:138: TEST_put_get: rados --pool hello put foo td/mon-bind/hello 2024-09-16T03:15:42.637 INFO:tasks.workunit.client.0.smithi096.stderr:2024/09/16 03:15:42 socat[39843] E write(6, 0x5572f8fb7000, 68): Broken pipe 2024-09-16T03:15:42.637 INFO:tasks.workunit.client.0.smithi096.stderr:2024/09/16 03:15:42 socat[39841] E write(6, 0x559421e02000, 68): Broken pipe 2024-09-16T03:15:43.227 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:139: TEST_put_get: rados --pool hello get foo td/mon-bind/hello2 2024-09-16T03:15:43.256 INFO:tasks.workunit.client.0.smithi096.stderr:2024/09/16 03:15:43 socat[39864] E write(6, 0x55b1e50c6000, 68): Broken pipe 2024-09-16T03:15:43.393 INFO:tasks.workunit.client.0.smithi096.stderr:2024/09/16 03:15:43 socat[39872] E write(6, 0x55b1e50c6000, 68): Broken pipe 2024-09-16T03:15:43.561 INFO:tasks.workunit.client.0.smithi096.stderr:2024/09/16 03:15:43 socat[39879] E write(6, 0x5572f8fb7000, 68): Broken pipe 2024-09-16T03:15:43.656 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:140: TEST_put_get: diff td/mon-bind/hello td/mon-bind/hello2 2024-09-16T03:15:43.702 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:53: run: cleanup 2024-09-16T03:15:43.702 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:28: cleanup: for p in "${SOCAT_PIDS[@]}" 2024-09-16T03:15:43.702 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:29: cleanup: kill 34220 2024-09-16T03:15:43.702 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:28: cleanup: for p in "${SOCAT_PIDS[@]}" 2024-09-16T03:15:43.702 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:29: cleanup: kill 34221 2024-09-16T03:15:43.703 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:28: cleanup: for p in "${SOCAT_PIDS[@]}" 2024-09-16T03:15:43.703 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:29: cleanup: kill 34222 2024-09-16T03:15:43.703 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:31: cleanup: SOCAT_PIDS=() 2024-09-16T03:15:43.703 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh:54: run: teardown td/mon-bind 2024-09-16T03:15:43.703 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/mon-bind 2024-09-16T03:15:43.703 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:15:43.703 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/mon-bind KILL 2024-09-16T03:15:43.704 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:15:43.704 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:15:43.704 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:15:43.704 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:15:43.704 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:15:44.019 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:15:44.019 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:15:44.020 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:15:44.021 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:15:44.023 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:15:44.023 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:15:44.023 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:15:44.024 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:15:44.024 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:15:44.025 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:15:44.025 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:15:44.027 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:15:44.029 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:15:44.029 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/mon-bind 2024-09-16T03:15:44.061 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:15:44.061 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:15:44.061 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.33333 2024-09-16T03:15:44.061 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.33333 2024-09-16T03:15:44.062 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:15:44.062 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:15:44.062 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2322: main: code=0 2024-09-16T03:15:44.062 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2326: main: teardown td/mon-bind 0 2024-09-16T03:15:44.062 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/mon-bind 2024-09-16T03:15:44.062 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2024-09-16T03:15:44.062 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/mon-bind KILL 2024-09-16T03:15:44.063 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:15:44.063 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:15:44.063 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:15:44.064 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:15:44.064 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:15:44.065 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:15:44.066 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:15:44.067 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:15:44.067 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:15:44.069 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:15:44.069 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:15:44.069 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:15:44.070 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:15:44.070 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:15:44.070 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:15:44.070 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:15:44.071 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:15:44.072 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2024-09-16T03:15:44.073 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/mon-bind 2024-09-16T03:15:44.074 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:15:44.074 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:15:44.074 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.33333 2024-09-16T03:15:44.074 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.33333 2024-09-16T03:15:44.075 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:15:44.075 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:15:44.075 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2327: main: return 0 2024-09-16T03:15:44.077 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-16T03:15:44.077 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-16T03:15:44.131 INFO:tasks.workunit:Running workunit mon/mon-cluster-log.sh... 2024-09-16T03:15:44.132 DEBUG:teuthology.orchestra.run.smithi096:workunit test mon/mon-cluster-log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7498493279982dfe87f00616198a5967475f6169 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh 2024-09-16T03:15:44.184 INFO:tasks.workunit.client.0.smithi096.stderr:stty: 'standard input': Inappropriate ioctl for device 2024-09-16T03:15:44.190 INFO:tasks.workunit.client.0.smithi096.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2024-09-16T03:15:44.190 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2315: main: export PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-16T03:15:44.190 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2315: main: PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-16T03:15:44.190 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2316: main: export PYTHONWARNINGS=ignore 2024-09-16T03:15:44.190 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2316: main: PYTHONWARNINGS=ignore 2024-09-16T03:15:44.190 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2317: main: export CEPH_CONF=/dev/null 2024-09-16T03:15:44.190 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2317: main: CEPH_CONF=/dev/null 2024-09-16T03:15:44.190 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2318: main: unset CEPH_ARGS 2024-09-16T03:15:44.191 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2320: main: local code 2024-09-16T03:15:44.191 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2321: main: run td/mon-cluster-log 2024-09-16T03:15:44.191 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:21: run: local dir=td/mon-cluster-log 2024-09-16T03:15:44.191 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:22: run: shift 2024-09-16T03:15:44.191 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:24: run: export CEPH_MON=127.0.0.1:7156 2024-09-16T03:15:44.191 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:24: run: CEPH_MON=127.0.0.1:7156 2024-09-16T03:15:44.191 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:25: run: export CEPH_ARGS 2024-09-16T03:15:44.191 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:26: run: uuidgen 2024-09-16T03:15:44.192 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:26: run: CEPH_ARGS+='--fsid=cf9c268f-ba4e-4fd6-bb5f-caff86a00857 --auth-supported=none ' 2024-09-16T03:15:44.192 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:27: run: CEPH_ARGS+='--mon-host=127.0.0.1:7156 ' 2024-09-16T03:15:44.192 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:29: run: set 2024-09-16T03:15:44.192 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:29: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2024-09-16T03:15:44.194 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:29: run: local 'funcs=TEST_cluster_log_level 2024-09-16T03:15:44.194 INFO:tasks.workunit.client.0.smithi096.stderr:TEST_journald_cluster_log_level' 2024-09-16T03:15:44.195 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:30: run: for func in $funcs 2024-09-16T03:15:44.195 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:31: run: setup td/mon-cluster-log 2024-09-16T03:15:44.195 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/mon-cluster-log 2024-09-16T03:15:44.195 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/mon-cluster-log 2024-09-16T03:15:44.195 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/mon-cluster-log 2024-09-16T03:15:44.195 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:15:44.195 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/mon-cluster-log KILL 2024-09-16T03:15:44.195 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:15:44.195 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:15:44.196 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:15:44.196 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:15:44.196 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:15:44.197 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:15:44.197 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:15:44.198 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:15:44.199 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:15:44.199 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:15:44.199 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:15:44.200 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:15:44.201 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:15:44.201 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:15:44.201 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:15:44.202 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:15:44.202 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:15:44.204 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:15:44.204 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/mon-cluster-log 2024-09-16T03:15:44.205 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:15:44.206 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:15:44.206 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.39951 2024-09-16T03:15:44.206 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.39951 2024-09-16T03:15:44.207 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:15:44.207 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:15:44.207 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/mon-cluster-log 2024-09-16T03:15:44.208 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T03:15:44.208 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:15:44.208 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.39951 2024-09-16T03:15:44.209 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.39951 2024-09-16T03:15:44.211 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T03:15:44.211 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2024-09-16T03:15:44.211 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2024-09-16T03:15:44.211 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T03:15:44.211 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/mon-cluster-log 1' TERM HUP INT 2024-09-16T03:15:44.211 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:32: run: TEST_cluster_log_level td/mon-cluster-log 2024-09-16T03:15:44.211 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:38: TEST_cluster_log_level: local dir=td/mon-cluster-log 2024-09-16T03:15:44.212 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:40: TEST_cluster_log_level: run_mon td/mon-cluster-log a 2024-09-16T03:15:44.212 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/mon-cluster-log 2024-09-16T03:15:44.212 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T03:15:44.212 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T03:15:44.212 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T03:15:44.212 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/mon-cluster-log/a 2024-09-16T03:15:44.212 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/mon-cluster-log/a --run-dir=td/mon-cluster-log 2024-09-16T03:15:44.674 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T03:15:44.674 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:15:44.674 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:15:44.674 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:15:44.674 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:15:44.674 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.39951 2024-09-16T03:15:44.674 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.39951/$cluster-$name.asok' 2024-09-16T03:15:44.675 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/mon-cluster-log/a '--log-file=td/mon-cluster-log/$name.log' '--admin-socket=/tmp/ceph-asok.39951/$cluster-$name.asok' --mon-cluster-log-file=td/mon-cluster-log/log --run-dir=td/mon-cluster-log '--pid-file=td/mon-cluster-log/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-09-16T03:15:44.866 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T03:15:44.868 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T03:15:44.868 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:15:44.868 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:15:44.868 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T03:15:44.868 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T03:15:44.869 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:15:44.869 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:15:44.869 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:15:44.869 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:15:44.869 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:15:44.869 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.39951 2024-09-16T03:15:44.872 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.39951/ceph-mon.a.asok 2024-09-16T03:15:44.873 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:15:44.873 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.39951/ceph-mon.a.asok config get fsid 2024-09-16T03:15:44.986 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T03:15:44.986 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:15:44.986 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:15:44.986 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T03:15:44.987 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T03:15:44.987 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:15:44.987 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:15:44.987 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:15:44.987 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:15:44.987 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:15:44.987 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.39951 2024-09-16T03:15:44.988 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.39951/ceph-mon.a.asok 2024-09-16T03:15:44.988 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:15:44.988 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.39951/ceph-mon.a.asok config get mon_host 2024-09-16T03:15:45.089 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:41: TEST_cluster_log_level: run_mgr td/mon-cluster-log x 2024-09-16T03:15:45.089 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/mon-cluster-log 2024-09-16T03:15:45.089 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2024-09-16T03:15:45.089 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2024-09-16T03:15:45.089 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2024-09-16T03:15:45.089 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/mon-cluster-log/x 2024-09-16T03:15:45.089 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2024-09-16T03:15:46.012 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2024-09-16T03:15:46.013 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:15:46.013 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:15:46.013 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:15:46.013 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:15:46.013 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.39951 2024-09-16T03:15:46.013 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.39951/$cluster-$name.asok' 2024-09-16T03:15:46.013 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T03:15:46.014 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/mon-cluster-log/x '--log-file=td/mon-cluster-log/$name.log' '--admin-socket=/tmp/ceph-asok.39951/$cluster-$name.asok' --run-dir=td/mon-cluster-log '--pid-file=td/mon-cluster-log/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T03:15:46.050 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:42: TEST_cluster_log_level: run_osd td/mon-cluster-log 0 2024-09-16T03:15:46.050 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/mon-cluster-log 2024-09-16T03:15:46.050 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T03:15:46.050 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2024-09-16T03:15:46.050 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T03:15:46.050 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/mon-cluster-log/0 2024-09-16T03:15:46.050 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=cf9c268f-ba4e-4fd6-bb5f-caff86a00857 --auth-supported=none --mon-host=127.0.0.1:7156 ' 2024-09-16T03:15:46.050 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T03:15:46.050 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T03:15:46.050 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T03:15:46.051 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/mon-cluster-log/0' 2024-09-16T03:15:46.051 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/mon-cluster-log/0/journal' 2024-09-16T03:15:46.051 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T03:15:46.051 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T03:15:46.051 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/mon-cluster-log' 2024-09-16T03:15:46.051 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T03:15:46.051 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:15:46.051 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:15:46.051 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:15:46.051 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:15:46.051 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.39951 2024-09-16T03:15:46.051 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.39951/$cluster-$name.asok' 2024-09-16T03:15:46.051 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.39951/$cluster-$name.asok' 2024-09-16T03:15:46.052 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T03:15:46.052 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T03:15:46.052 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T03:15:46.052 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/mon-cluster-log/$name.log' 2024-09-16T03:15:46.052 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/mon-cluster-log/$name.pid' 2024-09-16T03:15:46.052 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T03:15:46.052 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T03:15:46.052 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T03:15:46.052 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T03:15:46.052 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T03:15:46.052 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T03:15:46.052 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/mon-cluster-log/0 2024-09-16T03:15:46.052 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T03:15:46.053 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=7fd4c687-e9e1-4b57-927f-157475d964c3 2024-09-16T03:15:46.053 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 7fd4c687-e9e1-4b57-927f-157475d964c3' 2024-09-16T03:15:46.053 INFO:tasks.workunit.client.0.smithi096.stdout:add osd0 7fd4c687-e9e1-4b57-927f-157475d964c3 2024-09-16T03:15:46.054 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T03:15:46.067 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDioudmqCYUBBAAfmjPxzrmrvcXbzlk4uHDOw== 2024-09-16T03:15:46.068 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDioudmqCYUBBAAfmjPxzrmrvcXbzlk4uHDOw=="}' 2024-09-16T03:15:46.068 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 7fd4c687-e9e1-4b57-927f-157475d964c3 -i td/mon-cluster-log/0/new.json 2024-09-16T03:15:46.361 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T03:15:46.377 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/mon-cluster-log/0/new.json 2024-09-16T03:15:46.378 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=cf9c268f-ba4e-4fd6-bb5f-caff86a00857 --auth-supported=none --mon-host=127.0.0.1:7156 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/mon-cluster-log/0 --osd-journal=td/mon-cluster-log/0/journal --chdir= --run-dir=td/mon-cluster-log '--admin-socket=/tmp/ceph-asok.39951/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/mon-cluster-log/$name.log' '--pid-file=td/mon-cluster-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDioudmqCYUBBAAfmjPxzrmrvcXbzlk4uHDOw== --osd-uuid 7fd4c687-e9e1-4b57-927f-157475d964c3 2024-09-16T03:15:46.406 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:15:46.402+0000 7f65796287c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:15:46.430 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:15:46.426+0000 7f65796287c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:15:46.431 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:15:46.426+0000 7f65796287c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:15:46.432 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:15:46.426+0000 7f65796287c0 -1 bdev(0x558811733c00 td/mon-cluster-log/0/block) open stat got: (1) Operation not permitted 2024-09-16T03:15:46.432 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:15:46.426+0000 7f65796287c0 -1 bluestore(td/mon-cluster-log/0) _read_fsid unparsable uuid 2024-09-16T03:15:52.674 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/mon-cluster-log/0/keyring 2024-09-16T03:15:52.674 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T03:15:52.676 INFO:tasks.workunit.client.0.smithi096.stdout:adding osd0 key to auth repository 2024-09-16T03:15:52.676 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2024-09-16T03:15:52.676 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/mon-cluster-log/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T03:15:53.240 INFO:tasks.workunit.client.0.smithi096.stdout:start osd.0 2024-09-16T03:15:53.240 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2024-09-16T03:15:53.241 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=cf9c268f-ba4e-4fd6-bb5f-caff86a00857 --auth-supported=none --mon-host=127.0.0.1:7156 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/mon-cluster-log/0 --osd-journal=td/mon-cluster-log/0/journal --chdir= --run-dir=td/mon-cluster-log '--admin-socket=/tmp/ceph-asok.39951/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/mon-cluster-log/$name.log' '--pid-file=td/mon-cluster-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T03:15:53.241 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T03:15:53.241 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T03:15:53.241 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T03:15:53.270 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:15:53.266+0000 7f2893b627c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:15:53.283 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:15:53.278+0000 7f2893b627c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:15:53.284 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:15:53.282+0000 7f2893b627c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:15:53.731 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2024-09-16T03:15:53.731 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:15:53.731 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2024-09-16T03:15:53.731 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:15:53.731 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:15:53.731 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:15:53.731 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T03:15:53.732 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:15:53.732 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:15:53.732 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:15:54.135 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:15:54.395 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:15:54.390+0000 7f2893b627c0 -1 Falling back to public interface 2024-09-16T03:15:55.137 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:15:55.137 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:15:55.137 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T03:15:55.137 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T03:15:55.138 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:15:55.138 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:15:55.558 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:15:56.560 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:15:56.560 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:15:56.560 INFO:tasks.workunit.client.0.smithi096.stdout:2 2024-09-16T03:15:56.561 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T03:15:56.561 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:15:56.561 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:15:56.975 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:15:57.138 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:15:57.134+0000 7f2893b627c0 -1 osd.0 0 log_to_monitors true 2024-09-16T03:15:57.977 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:15:57.977 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:15:57.978 INFO:tasks.workunit.client.0.smithi096.stdout:3 2024-09-16T03:15:57.978 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T03:15:57.978 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:15:57.978 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:15:58.533 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:15:59.534 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:15:59.534 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:15:59.535 INFO:tasks.workunit.client.0.smithi096.stdout:4 2024-09-16T03:15:59.535 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T03:15:59.536 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:15:59.536 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:16:00.023 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:16:01.025 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:16:01.025 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:16:01.025 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T03:16:01.026 INFO:tasks.workunit.client.0.smithi096.stdout:5 2024-09-16T03:16:01.026 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:16:01.026 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:16:01.478 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:16:02.480 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:16:02.480 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:16:02.480 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T03:16:02.480 INFO:tasks.workunit.client.0.smithi096.stdout:6 2024-09-16T03:16:02.481 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:16:02.481 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:16:03.049 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:16:04.051 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:16:04.051 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:16:04.051 INFO:tasks.workunit.client.0.smithi096.stdout:7 2024-09-16T03:16:04.052 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T03:16:04.052 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:16:04.052 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:16:04.496 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:16:05.498 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:16:05.498 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:16:05.498 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T03:16:05.498 INFO:tasks.workunit.client.0.smithi096.stdout:8 2024-09-16T03:16:05.499 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:16:05.499 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:16:06.093 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:16:07.095 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:16:07.096 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:16:07.096 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T03:16:07.096 INFO:tasks.workunit.client.0.smithi096.stdout:9 2024-09-16T03:16:07.096 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:16:07.096 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:16:07.539 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:16:08.541 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:16:08.541 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:16:08.541 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T03:16:08.541 INFO:tasks.workunit.client.0.smithi096.stdout:10 2024-09-16T03:16:08.542 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:16:08.542 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:16:09.361 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:16:10.363 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:16:10.363 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:16:10.363 INFO:tasks.workunit.client.0.smithi096.stdout:11 2024-09-16T03:16:10.364 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T03:16:10.364 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:16:10.364 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:16:11.162 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:16:12.164 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:16:12.164 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:16:12.165 INFO:tasks.workunit.client.0.smithi096.stdout:12 2024-09-16T03:16:12.165 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T03:16:12.166 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:16:12.166 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:16:12.963 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:16:13.965 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:16:13.965 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:16:13.965 INFO:tasks.workunit.client.0.smithi096.stdout:13 2024-09-16T03:16:13.966 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T03:16:13.966 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:16:13.966 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:16:14.901 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:16:15.902 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:16:15.902 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:16:15.903 INFO:tasks.workunit.client.0.smithi096.stdout:14 2024-09-16T03:16:15.903 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T03:16:15.903 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:16:15.904 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:16:16.706 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:16:17.708 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:16:17.708 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:16:17.709 INFO:tasks.workunit.client.0.smithi096.stdout:15 2024-09-16T03:16:17.709 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T03:16:17.710 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:16:17.710 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:16:18.777 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:16:19.778 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:16:19.779 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:16:19.779 INFO:tasks.workunit.client.0.smithi096.stdout:16 2024-09-16T03:16:19.779 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T03:16:19.779 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:16:19.779 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:16:20.401 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:16:21.402 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:16:21.403 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:16:21.403 INFO:tasks.workunit.client.0.smithi096.stdout:17 2024-09-16T03:16:21.403 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T03:16:21.403 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:16:21.403 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:16:21.873 INFO:tasks.workunit.client.0.smithi096.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/1835144074,v1:127.0.0.1:6803/1835144074] [v2:127.0.0.1:6804/1835144074,v1:127.0.0.1:6805/1835144074] exists,up 7fd4c687-e9e1-4b57-927f-157475d964c3 2024-09-16T03:16:21.873 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:16:21.873 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:16:21.874 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:16:21.874 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:44: TEST_cluster_log_level: ceph config set mon.a mon_cluster_log_level debug 2024-09-16T03:16:22.418 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:45: TEST_cluster_log_level: ceph osd pool create replicated1 8 8 2024-09-16T03:16:22.947 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'replicated1' already exists 2024-09-16T03:16:22.963 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:46: TEST_cluster_log_level: ceph osd pool set replicated1 size 1 --yes-i-really-mean-it 2024-09-16T03:16:24.244 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 1 size to 1 2024-09-16T03:16:24.267 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:47: TEST_cluster_log_level: ceph osd pool set replicated1 min_size 1 2024-09-16T03:16:25.215 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 1 min_size to 1 2024-09-16T03:16:25.238 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:49: TEST_cluster_log_level: WAIT_FOR_CLEAN_TIMEOUT=60 2024-09-16T03:16:25.238 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:49: TEST_cluster_log_level: wait_for_clean 2024-09-16T03:16:25.239 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1633: wait_for_clean: local cmd= 2024-09-16T03:16:25.239 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1634: wait_for_clean: local num_active_clean=-1 2024-09-16T03:16:25.239 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1635: wait_for_clean: local cur_active_clean 2024-09-16T03:16:25.239 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: get_timeout_delays 60 .1 2024-09-16T03:16:25.239 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: shopt -q -o xtrace 2024-09-16T03:16:25.240 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: echo true 2024-09-16T03:16:25.240 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: local trace=true 2024-09-16T03:16:25.240 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: true 2024-09-16T03:16:25.240 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: shopt -u -o xtrace 2024-09-16T03:16:25.336 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '4.5') 2024-09-16T03:16:25.336 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: local -a delays 2024-09-16T03:16:25.336 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1637: wait_for_clean: local -i loop=0 2024-09-16T03:16:25.336 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1639: wait_for_clean: flush_pg_stats 2024-09-16T03:16:25.337 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: local timeout=300 2024-09-16T03:16:25.337 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ceph osd ls 2024-09-16T03:16:25.813 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ids=0 2024-09-16T03:16:25.814 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2208: flush_pg_stats: seqs= 2024-09-16T03:16:25.814 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:16:25.814 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-09-16T03:16:25.993 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=21474836488 2024-09-16T03:16:25.993 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 21474836488 2024-09-16T03:16:25.993 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836488' 2024-09-16T03:16:25.993 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:16:25.994 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 0-21474836488 2024-09-16T03:16:25.994 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:16:25.995 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=0 2024-09-16T03:16:25.996 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 0-21474836488 2024-09-16T03:16:25.996 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:16:25.997 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=21474836488 2024-09-16T03:16:25.997 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.0 seq 21474836488' 2024-09-16T03:16:25.997 INFO:tasks.workunit.client.0.smithi096.stdout:waiting osd.0 seq 21474836488 2024-09-16T03:16:25.998 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T03:16:26.473 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836485 -lt 21474836488 2024-09-16T03:16:26.473 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: flush_pg_stats: sleep 1 2024-09-16T03:16:27.475 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2224: flush_pg_stats: '[' 300 -eq 0 ']' 2024-09-16T03:16:27.475 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T03:16:27.889 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836488 -lt 21474836488 2024-09-16T03:16:27.891 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: get_num_pgs 2024-09-16T03:16:27.891 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:16:27.891 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:16:28.476 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: test 8 == 0 2024-09-16T03:16:28.477 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:16:28.477 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:16:28.477 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:16:28.477 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:16:28.477 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:16:28.477 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:16:28.478 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:16:28.909 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=8 2024-09-16T03:16:28.910 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:16:28.910 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:16:28.910 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:16:29.466 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 8 = 8 2024-09-16T03:16:29.466 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: break 2024-09-16T03:16:29.466 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: return 0 2024-09-16T03:16:29.466 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:50: TEST_cluster_log_level: ERRORS=0 2024-09-16T03:16:29.466 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:51: TEST_cluster_log_level: truncate td/mon-cluster-log/log -s 0 2024-09-16T03:16:29.474 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:52: TEST_cluster_log_level: ceph pg deep-scrub 1.0 2024-09-16T03:16:29.864 INFO:tasks.workunit.client.0.smithi096.stderr:instructing pg 1.0 on osd.0 to deep-scrub 2024-09-16T03:16:29.880 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:53: TEST_cluster_log_level: search_str='cluster [[]DBG[]] 1.0 deep-scrub' 2024-09-16T03:16:29.880 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:54: TEST_cluster_log_level: TIMEOUT=60 2024-09-16T03:16:29.880 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:54: TEST_cluster_log_level: wait_for_string td/mon-cluster-log/log 'cluster [[]DBG[]] 1.0 deep-scrub' 2024-09-16T03:16:29.880 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1739: wait_for_string: local logfile=td/mon-cluster-log/log 2024-09-16T03:16:29.881 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1740: wait_for_string: local 'searchstr=cluster [[]DBG[]] 1.0 deep-scrub' 2024-09-16T03:16:29.881 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1742: wait_for_string: status=1 2024-09-16T03:16:29.881 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i=0 )) 2024-09-16T03:16:29.881 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:16:29.881 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 0 2024-09-16T03:16:29.881 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T03:16:29.881 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.0 deep-scrub' td/mon-cluster-log/log 2024-09-16T03:16:29.882 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:16:30.883 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:16:30.883 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:16:30.883 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 1 2024-09-16T03:16:30.883 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T03:16:30.883 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.0 deep-scrub' td/mon-cluster-log/log 2024-09-16T03:16:30.884 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T03:16:30.045457+0000 osd.0 (osd.0) 3 : cluster [DBG] 1.0 deep-scrub starts 2024-09-16T03:16:30.884 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T03:16:30.046362+0000 osd.0 (osd.0) 4 : cluster [DBG] 1.0 deep-scrub ok 2024-09-16T03:16:30.885 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1748: wait_for_string: status=0 2024-09-16T03:16:30.885 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1749: wait_for_string: break 2024-09-16T03:16:30.885 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1752: wait_for_string: return 0 2024-09-16T03:16:30.885 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:55: TEST_cluster_log_level: grep -q 'cluster [[]DBG[]] 1.0 deep-scrub' td/mon-cluster-log/log 2024-09-16T03:16:30.887 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:56: TEST_cluster_log_level: return_code=0 2024-09-16T03:16:30.887 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:57: TEST_cluster_log_level: '[' 0 -ne 0 ']' 2024-09-16T03:16:30.888 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:62: TEST_cluster_log_level: ceph config set mon.a mon_cluster_log_level info 2024-09-16T03:16:31.401 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:63: TEST_cluster_log_level: ceph osd down 0 2024-09-16T03:16:31.948 INFO:tasks.workunit.client.0.smithi096.stderr:osd.0 is already down. 2024-09-16T03:16:31.963 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:64: TEST_cluster_log_level: TIMEOUT=20 2024-09-16T03:16:31.964 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:64: TEST_cluster_log_level: wait_for_osd up 0 2024-09-16T03:16:31.964 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:16:31.964 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2024-09-16T03:16:31.964 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:16:31.964 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:16:31.964 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 20 )) 2024-09-16T03:16:31.964 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:16:31.964 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T03:16:31.965 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:16:31.965 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:16:32.358 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:16:33.360 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:16:33.360 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 20 )) 2024-09-16T03:16:33.361 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T03:16:33.365 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T03:16:33.365 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:16:33.365 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:16:33.834 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:16:34.836 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:16:34.836 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 20 )) 2024-09-16T03:16:34.837 INFO:tasks.workunit.client.0.smithi096.stdout:2 2024-09-16T03:16:34.837 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T03:16:34.837 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:16:34.837 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:16:35.259 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:16:36.260 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:16:36.260 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 20 )) 2024-09-16T03:16:36.261 INFO:tasks.workunit.client.0.smithi096.stdout:3 2024-09-16T03:16:36.261 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T03:16:36.261 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:16:36.261 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:16:36.676 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:16:37.677 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:16:37.677 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 20 )) 2024-09-16T03:16:37.677 INFO:tasks.workunit.client.0.smithi096.stdout:4 2024-09-16T03:16:37.678 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T03:16:37.678 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:16:37.678 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:16:38.109 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:16:39.110 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:16:39.110 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 20 )) 2024-09-16T03:16:39.111 INFO:tasks.workunit.client.0.smithi096.stdout:5 2024-09-16T03:16:39.111 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T03:16:39.111 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:16:39.111 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:16:39.548 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:16:40.549 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:16:40.549 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 20 )) 2024-09-16T03:16:40.549 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T03:16:40.550 INFO:tasks.workunit.client.0.smithi096.stdout:6 2024-09-16T03:16:40.550 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:16:40.550 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:16:40.998 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:16:41.999 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:16:42.000 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 20 )) 2024-09-16T03:16:42.000 INFO:tasks.workunit.client.0.smithi096.stdout:7 2024-09-16T03:16:42.000 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T03:16:42.001 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:16:42.001 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:16:42.459 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:16:43.460 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:16:43.460 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 20 )) 2024-09-16T03:16:43.461 INFO:tasks.workunit.client.0.smithi096.stdout:8 2024-09-16T03:16:43.461 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T03:16:43.461 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:16:43.461 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:16:43.870 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:16:44.873 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:16:44.873 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 20 )) 2024-09-16T03:16:44.873 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T03:16:44.873 INFO:tasks.workunit.client.0.smithi096.stdout:9 2024-09-16T03:16:44.873 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:16:44.874 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:16:45.288 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:16:46.290 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:16:46.290 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 20 )) 2024-09-16T03:16:46.290 INFO:tasks.workunit.client.0.smithi096.stdout:10 2024-09-16T03:16:46.291 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T03:16:46.291 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:16:46.291 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:16:46.701 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:16:47.703 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:16:47.703 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 20 )) 2024-09-16T03:16:47.703 INFO:tasks.workunit.client.0.smithi096.stdout:11 2024-09-16T03:16:47.704 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T03:16:47.704 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:16:47.704 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:16:48.173 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:16:49.175 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:16:49.175 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 20 )) 2024-09-16T03:16:49.175 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T03:16:49.176 INFO:tasks.workunit.client.0.smithi096.stdout:12 2024-09-16T03:16:49.176 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:16:49.176 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:16:49.633 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:16:50.635 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:16:50.635 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 20 )) 2024-09-16T03:16:50.635 INFO:tasks.workunit.client.0.smithi096.stdout:13 2024-09-16T03:16:50.636 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T03:16:50.636 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:16:50.636 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:16:51.094 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:16:52.095 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:16:52.095 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 20 )) 2024-09-16T03:16:52.096 INFO:tasks.workunit.client.0.smithi096.stdout:14 2024-09-16T03:16:52.096 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T03:16:52.096 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:16:52.096 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:16:52.524 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:16:53.526 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:16:53.526 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 20 )) 2024-09-16T03:16:53.526 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T03:16:53.526 INFO:tasks.workunit.client.0.smithi096.stdout:15 2024-09-16T03:16:53.527 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:16:53.527 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:16:53.989 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:16:54.990 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:16:54.990 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 20 )) 2024-09-16T03:16:54.991 INFO:tasks.workunit.client.0.smithi096.stdout:16 2024-09-16T03:16:54.991 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T03:16:54.991 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:16:54.991 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:16:55.461 INFO:tasks.workunit.client.0.smithi096.stdout:osd.0 up in weight 1 up_from 15 up_thru 15 down_at 14 last_clean_interval [5,14) [v2:127.0.0.1:6802/1835144074,v1:127.0.0.1:6803/1835144074] [v2:127.0.0.1:6810/1836144074,v1:127.0.0.1:6811/1836144074] exists,up 7fd4c687-e9e1-4b57-927f-157475d964c3 2024-09-16T03:16:55.462 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:16:55.462 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:16:55.462 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:16:55.462 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:65: TEST_cluster_log_level: grep -q 'cluster [[]INF[]] osd.0.*boot' td/mon-cluster-log/log 2024-09-16T03:16:55.463 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:66: TEST_cluster_log_level: return_code=0 2024-09-16T03:16:55.463 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:67: TEST_cluster_log_level: '[' 0 -ne 0 ']' 2024-09-16T03:16:55.463 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:72: TEST_cluster_log_level: ceph pg deep-scrub 1.1 2024-09-16T03:16:55.930 INFO:tasks.workunit.client.0.smithi096.stderr:instructing pg 1.1 on osd.0 to deep-scrub 2024-09-16T03:16:55.947 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:73: TEST_cluster_log_level: search_str='cluster [[]DBG[]] 1.1 deep-scrub' 2024-09-16T03:16:55.947 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:74: TEST_cluster_log_level: TIMEOUT=60 2024-09-16T03:16:55.947 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:74: TEST_cluster_log_level: wait_for_string td/mon-cluster-log/log 'cluster [[]DBG[]] 1.1 deep-scrub' 2024-09-16T03:16:55.948 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1739: wait_for_string: local logfile=td/mon-cluster-log/log 2024-09-16T03:16:55.948 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1740: wait_for_string: local 'searchstr=cluster [[]DBG[]] 1.1 deep-scrub' 2024-09-16T03:16:55.948 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1742: wait_for_string: status=1 2024-09-16T03:16:55.948 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i=0 )) 2024-09-16T03:16:55.948 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:16:55.948 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 0 2024-09-16T03:16:55.948 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T03:16:55.949 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-16T03:16:55.949 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:16:56.950 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:16:56.950 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:16:56.950 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T03:16:56.951 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 1 2024-09-16T03:16:56.951 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-16T03:16:56.952 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:16:57.953 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:16:57.954 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:16:57.954 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 2 2024-09-16T03:16:57.954 INFO:tasks.workunit.client.0.smithi096.stdout:2 2024-09-16T03:16:57.954 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-16T03:16:57.956 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:16:58.958 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:16:58.959 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:16:58.959 INFO:tasks.workunit.client.0.smithi096.stdout:3 2024-09-16T03:16:58.961 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 3 2024-09-16T03:16:58.961 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-16T03:16:58.961 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:16:59.962 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:16:59.962 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:16:59.962 INFO:tasks.workunit.client.0.smithi096.stdout:4 2024-09-16T03:16:59.963 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 4 2024-09-16T03:16:59.963 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-16T03:16:59.964 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:17:00.966 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:17:00.967 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:17:00.967 INFO:tasks.workunit.client.0.smithi096.stdout:5 2024-09-16T03:17:00.967 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 5 2024-09-16T03:17:00.967 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-16T03:17:00.968 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:17:01.970 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:17:01.970 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:17:01.970 INFO:tasks.workunit.client.0.smithi096.stdout:6 2024-09-16T03:17:01.971 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 6 2024-09-16T03:17:01.971 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-16T03:17:01.972 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:17:02.973 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:17:02.974 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:17:02.974 INFO:tasks.workunit.client.0.smithi096.stdout:7 2024-09-16T03:17:02.974 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 7 2024-09-16T03:17:02.974 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-16T03:17:02.976 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:17:03.977 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:17:03.978 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:17:03.978 INFO:tasks.workunit.client.0.smithi096.stdout:8 2024-09-16T03:17:03.978 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 8 2024-09-16T03:17:03.978 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-16T03:17:03.979 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:17:04.981 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:17:04.981 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:17:04.982 INFO:tasks.workunit.client.0.smithi096.stdout:9 2024-09-16T03:17:04.982 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 9 2024-09-16T03:17:04.982 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-16T03:17:04.983 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:17:05.985 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:17:05.985 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:17:05.985 INFO:tasks.workunit.client.0.smithi096.stdout:10 2024-09-16T03:17:05.986 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 10 2024-09-16T03:17:05.986 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-16T03:17:05.986 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:17:06.988 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:17:06.989 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:17:06.989 INFO:tasks.workunit.client.0.smithi096.stdout:11 2024-09-16T03:17:06.989 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 11 2024-09-16T03:17:06.989 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-16T03:17:06.991 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:17:07.992 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:17:07.992 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:17:07.995 INFO:tasks.workunit.client.0.smithi096.stdout:12 2024-09-16T03:17:07.996 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 12 2024-09-16T03:17:07.996 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-16T03:17:07.996 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:17:08.997 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:17:08.997 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:17:08.998 INFO:tasks.workunit.client.0.smithi096.stdout:13 2024-09-16T03:17:08.998 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 13 2024-09-16T03:17:08.999 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-16T03:17:08.999 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:17:10.000 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:17:10.001 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:17:10.001 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 14 2024-09-16T03:17:10.001 INFO:tasks.workunit.client.0.smithi096.stdout:14 2024-09-16T03:17:10.001 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-16T03:17:10.002 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:17:11.004 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:17:11.004 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:17:11.004 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 15 2024-09-16T03:17:11.004 INFO:tasks.workunit.client.0.smithi096.stdout:15 2024-09-16T03:17:11.005 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-16T03:17:11.006 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:17:12.008 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:17:12.008 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:17:12.009 INFO:tasks.workunit.client.0.smithi096.stdout:16 2024-09-16T03:17:12.009 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 16 2024-09-16T03:17:12.009 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-16T03:17:12.010 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:17:13.012 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:17:13.012 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:17:13.013 INFO:tasks.workunit.client.0.smithi096.stdout:17 2024-09-16T03:17:13.013 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 17 2024-09-16T03:17:13.013 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-16T03:17:13.014 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:17:14.016 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:17:14.017 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:17:14.017 INFO:tasks.workunit.client.0.smithi096.stdout:18 2024-09-16T03:17:14.017 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 18 2024-09-16T03:17:14.017 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-16T03:17:14.018 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:17:15.020 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:17:15.020 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:17:15.021 INFO:tasks.workunit.client.0.smithi096.stdout:19 2024-09-16T03:17:15.021 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 19 2024-09-16T03:17:15.021 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-16T03:17:15.022 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:17:16.024 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:17:16.024 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:17:16.024 INFO:tasks.workunit.client.0.smithi096.stdout:20 2024-09-16T03:17:16.025 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 20 2024-09-16T03:17:16.025 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-16T03:17:16.025 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:17:17.027 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:17:17.028 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:17:17.028 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 21 2024-09-16T03:17:17.028 INFO:tasks.workunit.client.0.smithi096.stdout:21 2024-09-16T03:17:17.028 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-16T03:17:17.029 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:17:18.033 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:17:18.033 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:17:18.033 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 22 2024-09-16T03:17:18.033 INFO:tasks.workunit.client.0.smithi096.stdout:22 2024-09-16T03:17:18.034 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-16T03:17:18.034 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:17:19.035 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:17:19.036 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:17:19.036 INFO:tasks.workunit.client.0.smithi096.stdout:23 2024-09-16T03:17:19.037 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 23 2024-09-16T03:17:19.037 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-16T03:17:19.038 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:17:20.039 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:17:20.039 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:17:20.040 INFO:tasks.workunit.client.0.smithi096.stdout:24 2024-09-16T03:17:20.040 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 24 2024-09-16T03:17:20.040 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-16T03:17:20.040 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:17:21.043 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:17:21.043 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:17:21.043 INFO:tasks.workunit.client.0.smithi096.stdout:25 2024-09-16T03:17:21.043 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 25 2024-09-16T03:17:21.044 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-16T03:17:21.044 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:17:22.046 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:17:22.047 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:17:22.047 INFO:tasks.workunit.client.0.smithi096.stdout:26 2024-09-16T03:17:22.047 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 26 2024-09-16T03:17:22.047 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-16T03:17:22.048 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:17:23.050 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:17:23.050 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:17:23.050 INFO:tasks.workunit.client.0.smithi096.stdout:27 2024-09-16T03:17:23.050 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 27 2024-09-16T03:17:23.051 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-16T03:17:23.052 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:17:24.053 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:17:24.053 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:17:24.054 INFO:tasks.workunit.client.0.smithi096.stdout:28 2024-09-16T03:17:24.054 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 28 2024-09-16T03:17:24.054 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-16T03:17:24.055 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:17:25.057 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:17:25.057 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:17:25.058 INFO:tasks.workunit.client.0.smithi096.stdout:29 2024-09-16T03:17:25.058 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 29 2024-09-16T03:17:25.058 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-16T03:17:25.059 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:17:26.061 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:17:26.061 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:17:26.061 INFO:tasks.workunit.client.0.smithi096.stdout:30 2024-09-16T03:17:26.061 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 30 2024-09-16T03:17:26.062 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-16T03:17:26.063 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:17:27.065 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:17:27.065 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:17:27.065 INFO:tasks.workunit.client.0.smithi096.stdout:31 2024-09-16T03:17:27.066 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 31 2024-09-16T03:17:27.066 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-16T03:17:27.067 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:17:28.069 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:17:28.069 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:17:28.070 INFO:tasks.workunit.client.0.smithi096.stdout:32 2024-09-16T03:17:28.070 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 32 2024-09-16T03:17:28.070 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-16T03:17:28.071 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:17:29.073 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:17:29.073 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:17:29.074 INFO:tasks.workunit.client.0.smithi096.stdout:33 2024-09-16T03:17:29.074 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 33 2024-09-16T03:17:29.074 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-16T03:17:29.075 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:17:30.077 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:17:30.077 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:17:30.078 INFO:tasks.workunit.client.0.smithi096.stdout:34 2024-09-16T03:17:30.078 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 34 2024-09-16T03:17:30.078 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-16T03:17:30.079 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:17:31.081 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:17:31.082 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:17:31.082 INFO:tasks.workunit.client.0.smithi096.stdout:35 2024-09-16T03:17:31.082 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 35 2024-09-16T03:17:31.082 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-16T03:17:31.083 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:17:32.085 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:17:32.085 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:17:32.085 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 36 2024-09-16T03:17:32.085 INFO:tasks.workunit.client.0.smithi096.stdout:36 2024-09-16T03:17:32.086 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-16T03:17:32.087 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:17:33.089 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:17:33.089 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:17:33.090 INFO:tasks.workunit.client.0.smithi096.stdout:37 2024-09-16T03:17:33.090 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 37 2024-09-16T03:17:33.090 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-16T03:17:33.091 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:17:34.093 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:17:34.094 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:17:34.094 INFO:tasks.workunit.client.0.smithi096.stdout:38 2024-09-16T03:17:34.094 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 38 2024-09-16T03:17:34.094 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-16T03:17:34.096 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:17:35.098 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:17:35.098 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:17:35.098 INFO:tasks.workunit.client.0.smithi096.stdout:39 2024-09-16T03:17:35.098 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 39 2024-09-16T03:17:35.098 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-16T03:17:35.099 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:17:36.101 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:17:36.101 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:17:36.102 INFO:tasks.workunit.client.0.smithi096.stdout:40 2024-09-16T03:17:36.102 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 40 2024-09-16T03:17:36.102 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-16T03:17:36.103 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:17:37.105 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:17:37.105 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:17:37.105 INFO:tasks.workunit.client.0.smithi096.stdout:41 2024-09-16T03:17:37.105 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 41 2024-09-16T03:17:37.106 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-16T03:17:37.107 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:17:38.109 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:17:38.109 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:17:38.109 INFO:tasks.workunit.client.0.smithi096.stdout:42 2024-09-16T03:17:38.110 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 42 2024-09-16T03:17:38.110 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-16T03:17:38.111 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:17:39.113 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:17:39.113 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:17:39.113 INFO:tasks.workunit.client.0.smithi096.stdout:43 2024-09-16T03:17:39.113 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 43 2024-09-16T03:17:39.114 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-16T03:17:39.115 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:17:40.116 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:17:40.117 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:17:40.117 INFO:tasks.workunit.client.0.smithi096.stdout:44 2024-09-16T03:17:40.117 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 44 2024-09-16T03:17:40.117 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-16T03:17:40.118 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:17:41.121 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:17:41.121 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:17:41.121 INFO:tasks.workunit.client.0.smithi096.stdout:45 2024-09-16T03:17:41.121 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 45 2024-09-16T03:17:41.121 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-16T03:17:41.122 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:17:42.124 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:17:42.124 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:17:42.124 INFO:tasks.workunit.client.0.smithi096.stdout:46 2024-09-16T03:17:42.125 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 46 2024-09-16T03:17:42.125 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-16T03:17:42.125 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:17:43.128 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:17:43.128 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:17:43.128 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 47 2024-09-16T03:17:43.128 INFO:tasks.workunit.client.0.smithi096.stdout:47 2024-09-16T03:17:43.128 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-16T03:17:43.130 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:17:44.132 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:17:44.132 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:17:44.132 INFO:tasks.workunit.client.0.smithi096.stdout:48 2024-09-16T03:17:44.133 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 48 2024-09-16T03:17:44.133 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-16T03:17:44.134 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:17:45.135 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:17:45.136 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:17:45.136 INFO:tasks.workunit.client.0.smithi096.stdout:49 2024-09-16T03:17:45.136 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 49 2024-09-16T03:17:45.136 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-16T03:17:45.138 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:17:46.139 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:17:46.140 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:17:46.140 INFO:tasks.workunit.client.0.smithi096.stdout:50 2024-09-16T03:17:46.140 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 50 2024-09-16T03:17:46.140 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-16T03:17:46.142 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:17:47.144 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:17:47.144 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:17:47.144 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 51 2024-09-16T03:17:47.144 INFO:tasks.workunit.client.0.smithi096.stdout:51 2024-09-16T03:17:47.145 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-16T03:17:47.146 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:17:48.148 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:17:48.148 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:17:48.148 INFO:tasks.workunit.client.0.smithi096.stdout:52 2024-09-16T03:17:48.149 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 52 2024-09-16T03:17:48.149 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-16T03:17:48.149 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:17:49.151 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:17:49.152 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:17:49.152 INFO:tasks.workunit.client.0.smithi096.stdout:53 2024-09-16T03:17:49.152 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 53 2024-09-16T03:17:49.152 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-16T03:17:49.154 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:17:50.156 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:17:50.156 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:17:50.156 INFO:tasks.workunit.client.0.smithi096.stdout:54 2024-09-16T03:17:50.157 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 54 2024-09-16T03:17:50.157 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-16T03:17:50.158 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:17:51.160 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:17:51.160 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:17:51.160 INFO:tasks.workunit.client.0.smithi096.stdout:55 2024-09-16T03:17:51.160 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 55 2024-09-16T03:17:51.161 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-16T03:17:51.162 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:17:52.163 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:17:52.164 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:17:52.164 INFO:tasks.workunit.client.0.smithi096.stdout:56 2024-09-16T03:17:52.164 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 56 2024-09-16T03:17:52.164 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-16T03:17:52.166 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:17:53.168 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:17:53.168 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:17:53.168 INFO:tasks.workunit.client.0.smithi096.stdout:57 2024-09-16T03:17:53.169 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 57 2024-09-16T03:17:53.169 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-16T03:17:53.170 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:17:54.172 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:17:54.172 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:17:54.172 INFO:tasks.workunit.client.0.smithi096.stdout:58 2024-09-16T03:17:54.172 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 58 2024-09-16T03:17:54.173 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-16T03:17:54.174 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:17:55.176 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:17:55.176 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:17:55.176 INFO:tasks.workunit.client.0.smithi096.stdout:59 2024-09-16T03:17:55.177 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 59 2024-09-16T03:17:55.177 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-16T03:17:55.178 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:17:56.180 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:17:56.180 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:17:56.180 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1752: wait_for_string: return 1 2024-09-16T03:17:56.180 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:75: TEST_cluster_log_level: grep -q 'cluster [[]DBG[]] 1.1 deep-scrub' td/mon-cluster-log/log 2024-09-16T03:17:56.182 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:76: TEST_cluster_log_level: return_code=1 2024-09-16T03:17:56.182 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:77: TEST_cluster_log_level: '[' 1 -eq 0 ']' 2024-09-16T03:17:56.182 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:82: TEST_cluster_log_level: ceph config set mon.a mon_cluster_log_level warn 2024-09-16T03:17:56.691 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:83: TEST_cluster_log_level: ceph osd set noup 2024-09-16T03:17:57.310 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:17:57.331 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:84: TEST_cluster_log_level: ceph osd down osd.0 2024-09-16T03:17:58.052 INFO:tasks.workunit.client.0.smithi096.stderr:osd.0 is already down. 2024-09-16T03:17:58.073 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:85: TEST_cluster_log_level: ceph osd unset noup 2024-09-16T03:17:58.902 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:17:58.924 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:86: TEST_cluster_log_level: TIMEOUT=60 2024-09-16T03:17:58.924 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:86: TEST_cluster_log_level: wait_for_osd up 0 2024-09-16T03:17:58.924 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:17:58.924 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2024-09-16T03:17:58.925 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:17:58.925 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:17:58.925 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 60 )) 2024-09-16T03:17:58.925 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:17:58.925 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T03:17:58.925 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:17:58.926 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:17:59.545 INFO:tasks.workunit.client.0.smithi096.stdout:osd.0 up in weight 1 up_from 23 up_thru 23 down_at 19 last_clean_interval [5,21) [v2:127.0.0.1:6802/1835144074,v1:127.0.0.1:6803/1835144074] [v2:127.0.0.1:6804/1837144074,v1:127.0.0.1:6805/1837144074] exists,up 7fd4c687-e9e1-4b57-927f-157475d964c3 2024-09-16T03:17:59.546 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:17:59.546 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:17:59.546 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:17:59.546 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:87: TEST_cluster_log_level: search_str='cluster [[]WRN[]] Health check failed: noup flag(s) set (OSDMAP_FLAGS)' 2024-09-16T03:17:59.546 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:88: TEST_cluster_log_level: grep -q 'cluster [[]WRN[]] Health check failed: noup flag(s) set (OSDMAP_FLAGS)' td/mon-cluster-log/log 2024-09-16T03:17:59.547 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:89: TEST_cluster_log_level: return_code=0 2024-09-16T03:17:59.547 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:90: TEST_cluster_log_level: '[' 0 -ne 0 ']' 2024-09-16T03:17:59.547 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:95: TEST_cluster_log_level: ceph osd out 0 2024-09-16T03:18:00.089 INFO:tasks.workunit.client.0.smithi096.stderr:osd.0 is already out. 2024-09-16T03:18:00.104 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:96: TEST_cluster_log_level: ceph osd in 0 2024-09-16T03:18:00.661 INFO:tasks.workunit.client.0.smithi096.stderr:osd.0 is already in. 2024-09-16T03:18:00.676 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:97: TEST_cluster_log_level: WAIT_FOR_CLEAN_TIMEOUT=60 2024-09-16T03:18:00.677 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:97: TEST_cluster_log_level: wait_for_clean 2024-09-16T03:18:00.677 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1633: wait_for_clean: local cmd= 2024-09-16T03:18:00.677 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1634: wait_for_clean: local num_active_clean=-1 2024-09-16T03:18:00.677 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1635: wait_for_clean: local cur_active_clean 2024-09-16T03:18:00.677 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: get_timeout_delays 60 .1 2024-09-16T03:18:00.677 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: shopt -q -o xtrace 2024-09-16T03:18:00.678 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: echo true 2024-09-16T03:18:00.678 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: local trace=true 2024-09-16T03:18:00.678 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: true 2024-09-16T03:18:00.678 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: shopt -u -o xtrace 2024-09-16T03:18:00.757 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '4.5') 2024-09-16T03:18:00.758 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: local -a delays 2024-09-16T03:18:00.758 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1637: wait_for_clean: local -i loop=0 2024-09-16T03:18:00.758 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1639: wait_for_clean: flush_pg_stats 2024-09-16T03:18:00.758 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: local timeout=300 2024-09-16T03:18:00.758 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ceph osd ls 2024-09-16T03:18:01.217 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ids=0 2024-09-16T03:18:01.217 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2208: flush_pg_stats: seqs= 2024-09-16T03:18:01.217 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:18:01.218 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-09-16T03:18:01.372 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=98784247837 2024-09-16T03:18:01.372 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 98784247837 2024-09-16T03:18:01.372 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-98784247837' 2024-09-16T03:18:01.372 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:18:01.373 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:18:01.373 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 0-98784247837 2024-09-16T03:18:01.373 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=0 2024-09-16T03:18:01.374 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 0-98784247837 2024-09-16T03:18:01.374 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:18:01.375 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=98784247837 2024-09-16T03:18:01.375 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.0 seq 98784247837' 2024-09-16T03:18:01.375 INFO:tasks.workunit.client.0.smithi096.stdout:waiting osd.0 seq 98784247837 2024-09-16T03:18:01.375 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T03:18:01.787 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 98784247835 -lt 98784247837 2024-09-16T03:18:01.787 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: flush_pg_stats: sleep 1 2024-09-16T03:18:02.788 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2224: flush_pg_stats: '[' 300 -eq 0 ']' 2024-09-16T03:18:02.789 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T03:18:03.234 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 98784247837 -lt 98784247837 2024-09-16T03:18:03.235 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: get_num_pgs 2024-09-16T03:18:03.235 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:18:03.235 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:18:03.826 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: test 8 == 0 2024-09-16T03:18:03.827 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:18:03.827 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:18:03.827 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:18:03.827 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:18:03.827 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:18:03.828 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:18:03.828 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:18:04.230 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=8 2024-09-16T03:18:04.231 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:18:04.231 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:18:04.231 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:18:04.765 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 8 = 8 2024-09-16T03:18:04.765 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: break 2024-09-16T03:18:04.766 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: return 0 2024-09-16T03:18:04.766 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:98: TEST_cluster_log_level: search_str='cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' 2024-09-16T03:18:04.766 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:99: TEST_cluster_log_level: ceph log last 1000 2024-09-16T03:18:04.766 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:99: TEST_cluster_log_level: grep -q 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' 2024-09-16T03:18:05.396 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:100: TEST_cluster_log_level: TIMEOUT=60 2024-09-16T03:18:05.396 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:100: TEST_cluster_log_level: wait_for_string td/mon-cluster-log/log 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' 2024-09-16T03:18:05.396 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1739: wait_for_string: local logfile=td/mon-cluster-log/log 2024-09-16T03:18:05.396 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1740: wait_for_string: local 'searchstr=cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' 2024-09-16T03:18:05.396 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1742: wait_for_string: status=1 2024-09-16T03:18:05.396 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i=0 )) 2024-09-16T03:18:05.396 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:18:05.397 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 0 2024-09-16T03:18:05.397 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T03:18:05.397 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-16T03:18:05.397 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:18:06.399 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:18:06.400 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:18:06.400 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T03:18:06.400 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 1 2024-09-16T03:18:06.400 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-16T03:18:06.402 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:18:07.403 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:18:07.404 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:18:07.404 INFO:tasks.workunit.client.0.smithi096.stdout:2 2024-09-16T03:18:07.404 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 2 2024-09-16T03:18:07.404 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-16T03:18:07.405 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:18:08.409 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:18:08.409 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:18:08.409 INFO:tasks.workunit.client.0.smithi096.stdout:3 2024-09-16T03:18:08.410 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 3 2024-09-16T03:18:08.410 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-16T03:18:08.410 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:18:09.411 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:18:09.412 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:18:09.412 INFO:tasks.workunit.client.0.smithi096.stdout:4 2024-09-16T03:18:09.413 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 4 2024-09-16T03:18:09.413 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-16T03:18:09.413 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:18:10.415 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:18:10.415 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:18:10.415 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 5 2024-09-16T03:18:10.415 INFO:tasks.workunit.client.0.smithi096.stdout:5 2024-09-16T03:18:10.416 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-16T03:18:10.417 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:18:11.419 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:18:11.419 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:18:11.420 INFO:tasks.workunit.client.0.smithi096.stdout:6 2024-09-16T03:18:11.420 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 6 2024-09-16T03:18:11.421 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-16T03:18:11.421 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:18:12.423 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:18:12.423 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:18:12.423 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 7 2024-09-16T03:18:12.423 INFO:tasks.workunit.client.0.smithi096.stdout:7 2024-09-16T03:18:12.423 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-16T03:18:12.425 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:18:13.426 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:18:13.427 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:18:13.427 INFO:tasks.workunit.client.0.smithi096.stdout:8 2024-09-16T03:18:13.427 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 8 2024-09-16T03:18:13.427 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-16T03:18:13.429 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:18:14.430 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:18:14.430 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:18:14.431 INFO:tasks.workunit.client.0.smithi096.stdout:9 2024-09-16T03:18:14.431 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 9 2024-09-16T03:18:14.431 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-16T03:18:14.432 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:18:15.434 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:18:15.434 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:18:15.435 INFO:tasks.workunit.client.0.smithi096.stdout:10 2024-09-16T03:18:15.435 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 10 2024-09-16T03:18:15.435 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-16T03:18:15.436 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:18:16.438 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:18:16.438 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:18:16.438 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 11 2024-09-16T03:18:16.439 INFO:tasks.workunit.client.0.smithi096.stdout:11 2024-09-16T03:18:16.439 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-16T03:18:16.439 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:18:17.441 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:18:17.442 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:18:17.442 INFO:tasks.workunit.client.0.smithi096.stdout:12 2024-09-16T03:18:17.442 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 12 2024-09-16T03:18:17.442 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-16T03:18:17.443 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:18:18.445 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:18:18.445 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:18:18.445 INFO:tasks.workunit.client.0.smithi096.stdout:13 2024-09-16T03:18:18.446 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 13 2024-09-16T03:18:18.446 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-16T03:18:18.447 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:18:19.449 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:18:19.449 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:18:19.449 INFO:tasks.workunit.client.0.smithi096.stdout:14 2024-09-16T03:18:19.450 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 14 2024-09-16T03:18:19.450 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-16T03:18:19.451 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:18:20.452 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:18:20.452 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:18:20.453 INFO:tasks.workunit.client.0.smithi096.stdout:15 2024-09-16T03:18:20.453 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 15 2024-09-16T03:18:20.453 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-16T03:18:20.453 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:18:21.455 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:18:21.456 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:18:21.456 INFO:tasks.workunit.client.0.smithi096.stdout:16 2024-09-16T03:18:21.456 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 16 2024-09-16T03:18:21.456 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-16T03:18:21.458 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:18:22.459 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:18:22.459 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:18:22.460 INFO:tasks.workunit.client.0.smithi096.stdout:17 2024-09-16T03:18:22.460 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 17 2024-09-16T03:18:22.460 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-16T03:18:22.461 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:18:23.463 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:18:23.463 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:18:23.463 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 18 2024-09-16T03:18:23.464 INFO:tasks.workunit.client.0.smithi096.stdout:18 2024-09-16T03:18:23.464 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-16T03:18:23.465 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:18:24.467 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:18:24.467 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:18:24.467 INFO:tasks.workunit.client.0.smithi096.stdout:19 2024-09-16T03:18:24.468 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 19 2024-09-16T03:18:24.468 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-16T03:18:24.469 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:18:25.471 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:18:25.471 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:18:25.471 INFO:tasks.workunit.client.0.smithi096.stdout:20 2024-09-16T03:18:25.472 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 20 2024-09-16T03:18:25.472 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-16T03:18:25.473 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:18:26.475 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:18:26.475 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:18:26.475 INFO:tasks.workunit.client.0.smithi096.stdout:21 2024-09-16T03:18:26.475 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 21 2024-09-16T03:18:26.476 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-16T03:18:26.477 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:18:27.479 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:18:27.479 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:18:27.480 INFO:tasks.workunit.client.0.smithi096.stdout:22 2024-09-16T03:18:27.480 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 22 2024-09-16T03:18:27.480 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-16T03:18:27.481 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:18:28.483 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:18:28.483 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:18:28.483 INFO:tasks.workunit.client.0.smithi096.stdout:23 2024-09-16T03:18:28.484 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 23 2024-09-16T03:18:28.484 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-16T03:18:28.485 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:18:29.487 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:18:29.487 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:18:29.487 INFO:tasks.workunit.client.0.smithi096.stdout:24 2024-09-16T03:18:29.488 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 24 2024-09-16T03:18:29.488 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-16T03:18:29.489 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:18:30.491 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:18:30.491 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:18:30.491 INFO:tasks.workunit.client.0.smithi096.stdout:25 2024-09-16T03:18:30.491 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 25 2024-09-16T03:18:30.492 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-16T03:18:30.493 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:18:31.494 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:18:31.495 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:18:31.495 INFO:tasks.workunit.client.0.smithi096.stdout:26 2024-09-16T03:18:31.495 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 26 2024-09-16T03:18:31.496 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-16T03:18:31.497 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:18:32.499 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:18:32.499 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:18:32.499 INFO:tasks.workunit.client.0.smithi096.stdout:27 2024-09-16T03:18:32.499 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 27 2024-09-16T03:18:32.500 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-16T03:18:32.501 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:18:33.503 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:18:33.503 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:18:33.503 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 28 2024-09-16T03:18:33.503 INFO:tasks.workunit.client.0.smithi096.stdout:28 2024-09-16T03:18:33.504 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-16T03:18:33.505 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:18:34.507 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:18:34.507 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:18:34.507 INFO:tasks.workunit.client.0.smithi096.stdout:29 2024-09-16T03:18:34.507 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 29 2024-09-16T03:18:34.508 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-16T03:18:34.509 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:18:35.510 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:18:35.511 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:18:35.511 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 30 2024-09-16T03:18:35.511 INFO:tasks.workunit.client.0.smithi096.stdout:30 2024-09-16T03:18:35.511 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-16T03:18:35.513 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:18:36.514 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:18:36.515 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:18:36.515 INFO:tasks.workunit.client.0.smithi096.stdout:31 2024-09-16T03:18:36.515 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 31 2024-09-16T03:18:36.515 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-16T03:18:36.517 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:18:37.518 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:18:37.518 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:18:37.519 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 32 2024-09-16T03:18:37.519 INFO:tasks.workunit.client.0.smithi096.stdout:32 2024-09-16T03:18:37.519 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-16T03:18:37.521 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:18:38.522 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:18:38.522 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:18:38.523 INFO:tasks.workunit.client.0.smithi096.stdout:33 2024-09-16T03:18:38.523 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 33 2024-09-16T03:18:38.523 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-16T03:18:38.524 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:18:39.526 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:18:39.526 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:18:39.526 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 34 2024-09-16T03:18:39.527 INFO:tasks.workunit.client.0.smithi096.stdout:34 2024-09-16T03:18:39.527 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-16T03:18:39.528 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:18:40.530 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:18:40.530 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:18:40.530 INFO:tasks.workunit.client.0.smithi096.stdout:35 2024-09-16T03:18:40.531 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 35 2024-09-16T03:18:40.531 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-16T03:18:40.532 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:18:41.535 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:18:41.535 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:18:41.535 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 36 2024-09-16T03:18:41.535 INFO:tasks.workunit.client.0.smithi096.stdout:36 2024-09-16T03:18:41.536 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-16T03:18:41.536 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:18:42.538 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:18:42.539 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:18:42.539 INFO:tasks.workunit.client.0.smithi096.stdout:37 2024-09-16T03:18:42.539 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 37 2024-09-16T03:18:42.539 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-16T03:18:42.541 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:18:43.543 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:18:43.543 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:18:43.543 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 38 2024-09-16T03:18:43.543 INFO:tasks.workunit.client.0.smithi096.stdout:38 2024-09-16T03:18:43.544 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-16T03:18:43.545 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:18:44.547 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:18:44.547 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:18:44.547 INFO:tasks.workunit.client.0.smithi096.stdout:39 2024-09-16T03:18:44.548 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 39 2024-09-16T03:18:44.548 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-16T03:18:44.549 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:18:45.551 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:18:45.551 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:18:45.551 INFO:tasks.workunit.client.0.smithi096.stdout:40 2024-09-16T03:18:45.551 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 40 2024-09-16T03:18:45.552 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-16T03:18:45.553 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:18:46.555 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:18:46.555 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:18:46.555 INFO:tasks.workunit.client.0.smithi096.stdout:41 2024-09-16T03:18:46.556 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 41 2024-09-16T03:18:46.556 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-16T03:18:46.557 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:18:47.559 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:18:47.559 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:18:47.559 INFO:tasks.workunit.client.0.smithi096.stdout:42 2024-09-16T03:18:47.560 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 42 2024-09-16T03:18:47.560 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-16T03:18:47.561 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:18:48.563 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:18:48.563 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:18:48.563 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 43 2024-09-16T03:18:48.564 INFO:tasks.workunit.client.0.smithi096.stdout:43 2024-09-16T03:18:48.564 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-16T03:18:48.564 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:18:49.566 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:18:49.566 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:18:49.567 INFO:tasks.workunit.client.0.smithi096.stdout:44 2024-09-16T03:18:49.567 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 44 2024-09-16T03:18:49.567 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-16T03:18:49.569 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:18:50.571 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:18:50.571 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:18:50.571 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 45 2024-09-16T03:18:50.571 INFO:tasks.workunit.client.0.smithi096.stdout:45 2024-09-16T03:18:50.572 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-16T03:18:50.572 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:18:51.574 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:18:51.574 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:18:51.574 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 46 2024-09-16T03:18:51.575 INFO:tasks.workunit.client.0.smithi096.stdout:46 2024-09-16T03:18:51.575 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-16T03:18:51.576 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:18:52.578 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:18:52.578 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:18:52.578 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 47 2024-09-16T03:18:52.578 INFO:tasks.workunit.client.0.smithi096.stdout:47 2024-09-16T03:18:52.579 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-16T03:18:52.580 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:18:53.582 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:18:53.582 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:18:53.582 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 48 2024-09-16T03:18:53.582 INFO:tasks.workunit.client.0.smithi096.stdout:48 2024-09-16T03:18:53.583 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-16T03:18:53.584 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:18:54.586 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:18:54.586 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:18:54.586 INFO:tasks.workunit.client.0.smithi096.stdout:49 2024-09-16T03:18:54.587 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 49 2024-09-16T03:18:54.587 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-16T03:18:54.588 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:18:55.589 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:18:55.590 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:18:55.590 INFO:tasks.workunit.client.0.smithi096.stdout:50 2024-09-16T03:18:55.590 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 50 2024-09-16T03:18:55.591 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-16T03:18:55.592 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:18:56.593 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:18:56.594 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:18:56.594 INFO:tasks.workunit.client.0.smithi096.stdout:51 2024-09-16T03:18:56.595 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 51 2024-09-16T03:18:56.595 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-16T03:18:56.595 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:18:57.597 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:18:57.597 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:18:57.597 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 52 2024-09-16T03:18:57.597 INFO:tasks.workunit.client.0.smithi096.stdout:52 2024-09-16T03:18:57.598 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-16T03:18:57.598 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:18:58.601 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:18:58.601 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:18:58.601 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 53 2024-09-16T03:18:58.601 INFO:tasks.workunit.client.0.smithi096.stdout:53 2024-09-16T03:18:58.602 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-16T03:18:58.602 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:18:59.604 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:18:59.604 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:18:59.604 INFO:tasks.workunit.client.0.smithi096.stdout:54 2024-09-16T03:18:59.605 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 54 2024-09-16T03:18:59.605 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-16T03:18:59.606 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:19:00.608 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:19:00.608 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:19:00.608 INFO:tasks.workunit.client.0.smithi096.stdout:55 2024-09-16T03:19:00.608 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 55 2024-09-16T03:19:00.609 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-16T03:19:00.610 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:19:01.612 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:19:01.612 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:19:01.612 INFO:tasks.workunit.client.0.smithi096.stdout:56 2024-09-16T03:19:01.613 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 56 2024-09-16T03:19:01.613 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-16T03:19:01.614 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:19:02.615 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:19:02.616 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:19:02.616 INFO:tasks.workunit.client.0.smithi096.stdout:57 2024-09-16T03:19:02.616 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 57 2024-09-16T03:19:02.617 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-16T03:19:02.618 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:19:03.620 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:19:03.620 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:19:03.620 INFO:tasks.workunit.client.0.smithi096.stdout:58 2024-09-16T03:19:03.621 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 58 2024-09-16T03:19:03.621 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-16T03:19:03.622 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:19:04.624 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:19:04.624 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:19:04.624 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1744: wait_for_string: echo 59 2024-09-16T03:19:04.624 INFO:tasks.workunit.client.0.smithi096.stdout:59 2024-09-16T03:19:04.625 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1745: wait_for_string: grep 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-16T03:19:04.626 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1746: wait_for_string: sleep 1 2024-09-16T03:19:05.627 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i++ )) 2024-09-16T03:19:05.628 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1743: wait_for_string: (( i < 60 )) 2024-09-16T03:19:05.628 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1752: wait_for_string: return 1 2024-09-16T03:19:05.628 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:101: TEST_cluster_log_level: grep -q 'cluster [[]INF[]] Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/log 2024-09-16T03:19:05.630 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:102: TEST_cluster_log_level: return_code=1 2024-09-16T03:19:05.630 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:103: TEST_cluster_log_level: '[' 1 -eq 0 ']' 2024-09-16T03:19:05.630 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:108: TEST_cluster_log_level: '[' 0 -gt 0 ']' 2024-09-16T03:19:05.630 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:113: TEST_cluster_log_level: echo 'TEST PASSED' 2024-09-16T03:19:05.630 INFO:tasks.workunit.client.0.smithi096.stdout:TEST PASSED 2024-09-16T03:19:05.631 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:114: TEST_cluster_log_level: return 0 2024-09-16T03:19:05.631 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:33: run: teardown td/mon-cluster-log 2024-09-16T03:19:05.631 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/mon-cluster-log 2024-09-16T03:19:05.631 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:19:05.631 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/mon-cluster-log KILL 2024-09-16T03:19:05.632 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:19:05.632 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:19:05.632 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:19:05.632 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:19:05.632 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:19:05.741 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:19:05.742 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:19:05.742 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:19:05.743 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:19:05.744 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:19:05.744 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:19:05.744 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:19:05.745 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:19:05.745 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:19:05.746 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:19:05.746 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:19:05.746 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:19:05.747 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:19:05.748 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/mon-cluster-log 2024-09-16T03:19:05.758 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:19:05.759 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:19:05.759 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.39951 2024-09-16T03:19:05.759 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.39951 2024-09-16T03:19:05.760 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:19:05.760 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:19:05.760 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:30: run: for func in $funcs 2024-09-16T03:19:05.760 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:31: run: setup td/mon-cluster-log 2024-09-16T03:19:05.760 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/mon-cluster-log 2024-09-16T03:19:05.760 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/mon-cluster-log 2024-09-16T03:19:05.760 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/mon-cluster-log 2024-09-16T03:19:05.761 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:19:05.761 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/mon-cluster-log KILL 2024-09-16T03:19:05.761 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:19:05.761 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:19:05.762 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:19:05.762 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:19:05.762 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:19:05.764 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:19:05.764 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:19:05.765 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:19:05.765 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:19:05.766 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:19:05.766 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:19:05.767 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:19:05.768 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:19:05.768 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:19:05.768 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:19:05.768 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:19:05.769 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:19:05.770 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:19:05.771 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/mon-cluster-log 2024-09-16T03:19:05.772 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:19:05.772 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:19:05.772 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.39951 2024-09-16T03:19:05.772 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.39951 2024-09-16T03:19:05.773 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:19:05.773 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:19:05.773 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/mon-cluster-log 2024-09-16T03:19:05.774 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T03:19:05.774 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:19:05.774 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.39951 2024-09-16T03:19:05.774 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.39951 2024-09-16T03:19:05.777 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T03:19:05.777 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2024-09-16T03:19:05.777 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T03:19:05.778 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/mon-cluster-log 1' TERM HUP INT 2024-09-16T03:19:05.778 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:32: run: TEST_journald_cluster_log_level td/mon-cluster-log 2024-09-16T03:19:05.778 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:118: TEST_journald_cluster_log_level: local dir=td/mon-cluster-log 2024-09-16T03:19:05.778 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:120: TEST_journald_cluster_log_level: run_mon td/mon-cluster-log a 2024-09-16T03:19:05.778 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/mon-cluster-log 2024-09-16T03:19:05.778 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T03:19:05.778 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T03:19:05.778 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T03:19:05.778 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/mon-cluster-log/a 2024-09-16T03:19:05.778 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/mon-cluster-log/a --run-dir=td/mon-cluster-log 2024-09-16T03:19:06.252 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T03:19:06.252 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:19:06.252 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:19:06.253 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:19:06.253 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:19:06.253 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.39951 2024-09-16T03:19:06.253 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.39951/$cluster-$name.asok' 2024-09-16T03:19:06.254 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/mon-cluster-log/a '--log-file=td/mon-cluster-log/$name.log' '--admin-socket=/tmp/ceph-asok.39951/$cluster-$name.asok' --mon-cluster-log-file=td/mon-cluster-log/log --run-dir=td/mon-cluster-log '--pid-file=td/mon-cluster-log/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-09-16T03:19:06.447 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T03:19:06.448 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T03:19:06.448 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:19:06.448 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:19:06.448 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T03:19:06.449 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T03:19:06.450 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:19:06.450 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:19:06.450 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:19:06.450 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:19:06.450 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:19:06.450 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.39951 2024-09-16T03:19:06.450 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.39951/ceph-mon.a.asok 2024-09-16T03:19:06.451 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:19:06.451 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.39951/ceph-mon.a.asok config get fsid 2024-09-16T03:19:06.569 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T03:19:06.569 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:19:06.570 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:19:06.570 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T03:19:06.570 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T03:19:06.570 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:19:06.571 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:19:06.571 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:19:06.571 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:19:06.571 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:19:06.571 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.39951 2024-09-16T03:19:06.571 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.39951/ceph-mon.a.asok 2024-09-16T03:19:06.572 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:19:06.572 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.39951/ceph-mon.a.asok config get mon_host 2024-09-16T03:19:06.678 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:121: TEST_journald_cluster_log_level: run_mgr td/mon-cluster-log x 2024-09-16T03:19:06.678 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/mon-cluster-log 2024-09-16T03:19:06.679 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2024-09-16T03:19:06.679 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2024-09-16T03:19:06.679 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2024-09-16T03:19:06.679 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/mon-cluster-log/x 2024-09-16T03:19:06.679 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2024-09-16T03:19:07.610 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2024-09-16T03:19:07.610 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:19:07.610 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:19:07.610 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:19:07.610 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:19:07.610 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.39951 2024-09-16T03:19:07.611 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.39951/$cluster-$name.asok' 2024-09-16T03:19:07.611 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T03:19:07.612 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/mon-cluster-log/x '--log-file=td/mon-cluster-log/$name.log' '--admin-socket=/tmp/ceph-asok.39951/$cluster-$name.asok' --run-dir=td/mon-cluster-log '--pid-file=td/mon-cluster-log/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T03:19:07.643 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:122: TEST_journald_cluster_log_level: run_osd td/mon-cluster-log 0 2024-09-16T03:19:07.643 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/mon-cluster-log 2024-09-16T03:19:07.643 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T03:19:07.643 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2024-09-16T03:19:07.643 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T03:19:07.644 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/mon-cluster-log/0 2024-09-16T03:19:07.644 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=cf9c268f-ba4e-4fd6-bb5f-caff86a00857 --auth-supported=none --mon-host=127.0.0.1:7156 ' 2024-09-16T03:19:07.644 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T03:19:07.644 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T03:19:07.644 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T03:19:07.644 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/mon-cluster-log/0' 2024-09-16T03:19:07.644 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/mon-cluster-log/0/journal' 2024-09-16T03:19:07.644 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T03:19:07.644 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T03:19:07.644 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/mon-cluster-log' 2024-09-16T03:19:07.644 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T03:19:07.644 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:19:07.644 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:19:07.645 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:19:07.645 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:19:07.645 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.39951 2024-09-16T03:19:07.645 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.39951/$cluster-$name.asok' 2024-09-16T03:19:07.645 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.39951/$cluster-$name.asok' 2024-09-16T03:19:07.645 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T03:19:07.645 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T03:19:07.645 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T03:19:07.645 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/mon-cluster-log/$name.log' 2024-09-16T03:19:07.645 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/mon-cluster-log/$name.pid' 2024-09-16T03:19:07.645 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T03:19:07.645 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T03:19:07.646 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T03:19:07.646 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T03:19:07.646 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T03:19:07.646 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T03:19:07.646 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/mon-cluster-log/0 2024-09-16T03:19:07.646 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T03:19:07.646 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=c40f9ba5-97f0-4652-abe8-adabe1eb21a1 2024-09-16T03:19:07.647 INFO:tasks.workunit.client.0.smithi096.stdout:add osd0 c40f9ba5-97f0-4652-abe8-adabe1eb21a1 2024-09-16T03:19:07.647 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 c40f9ba5-97f0-4652-abe8-adabe1eb21a1' 2024-09-16T03:19:07.647 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T03:19:07.661 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCro+dmTw6fJxAAjVfhLfpKLHRT5oDvNBXWyQ== 2024-09-16T03:19:07.661 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCro+dmTw6fJxAAjVfhLfpKLHRT5oDvNBXWyQ=="}' 2024-09-16T03:19:07.661 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new c40f9ba5-97f0-4652-abe8-adabe1eb21a1 -i td/mon-cluster-log/0/new.json 2024-09-16T03:19:07.950 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T03:19:07.966 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/mon-cluster-log/0/new.json 2024-09-16T03:19:07.966 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=cf9c268f-ba4e-4fd6-bb5f-caff86a00857 --auth-supported=none --mon-host=127.0.0.1:7156 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/mon-cluster-log/0 --osd-journal=td/mon-cluster-log/0/journal --chdir= --run-dir=td/mon-cluster-log '--admin-socket=/tmp/ceph-asok.39951/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/mon-cluster-log/$name.log' '--pid-file=td/mon-cluster-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCro+dmTw6fJxAAjVfhLfpKLHRT5oDvNBXWyQ== --osd-uuid c40f9ba5-97f0-4652-abe8-adabe1eb21a1 2024-09-16T03:19:07.991 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:19:07.993+0000 7f92eed847c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:19:08.018 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:19:08.021+0000 7f92eed847c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:19:08.019 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:19:08.021+0000 7f92eed847c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:19:08.020 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:19:08.021+0000 7f92eed847c0 -1 bdev(0x5627777b5c00 td/mon-cluster-log/0/block) open stat got: (1) Operation not permitted 2024-09-16T03:19:08.020 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:19:08.021+0000 7f92eed847c0 -1 bluestore(td/mon-cluster-log/0) _read_fsid unparsable uuid 2024-09-16T03:19:14.307 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/mon-cluster-log/0/keyring 2024-09-16T03:19:14.307 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T03:19:14.308 INFO:tasks.workunit.client.0.smithi096.stdout:adding osd0 key to auth repository 2024-09-16T03:19:14.309 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2024-09-16T03:19:14.309 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/mon-cluster-log/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T03:19:14.876 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2024-09-16T03:19:14.876 INFO:tasks.workunit.client.0.smithi096.stdout:start osd.0 2024-09-16T03:19:14.877 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=cf9c268f-ba4e-4fd6-bb5f-caff86a00857 --auth-supported=none --mon-host=127.0.0.1:7156 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/mon-cluster-log/0 --osd-journal=td/mon-cluster-log/0/journal --chdir= --run-dir=td/mon-cluster-log '--admin-socket=/tmp/ceph-asok.39951/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/mon-cluster-log/$name.log' '--pid-file=td/mon-cluster-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T03:19:14.877 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T03:19:14.877 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T03:19:14.877 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T03:19:14.900 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:19:14.901+0000 7f82fc9f67c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:19:14.923 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:19:14.925+0000 7f82fc9f67c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:19:14.925 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:19:14.925+0000 7f82fc9f67c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:19:15.343 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2024-09-16T03:19:15.343 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:19:15.343 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2024-09-16T03:19:15.344 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:19:15.344 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:19:15.344 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:19:15.344 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:19:15.344 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T03:19:15.344 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:19:15.345 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:19:15.797 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:19:16.160 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:19:16.161+0000 7f82fc9f67c0 -1 Falling back to public interface 2024-09-16T03:19:16.799 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:19:16.799 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:19:16.799 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T03:19:16.800 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T03:19:16.800 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:19:16.800 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:19:17.263 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:19:18.264 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:19:18.265 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:19:18.265 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T03:19:18.265 INFO:tasks.workunit.client.0.smithi096.stdout:2 2024-09-16T03:19:18.265 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:19:18.265 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:19:18.685 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:19:19.052 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:19:19.053+0000 7f82fc9f67c0 -1 osd.0 0 log_to_monitors true 2024-09-16T03:19:19.687 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:19:19.687 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:19:19.687 INFO:tasks.workunit.client.0.smithi096.stdout:3 2024-09-16T03:19:19.688 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T03:19:19.688 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:19:19.688 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:19:20.227 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:19:21.228 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:19:21.229 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:19:21.229 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T03:19:21.229 INFO:tasks.workunit.client.0.smithi096.stdout:4 2024-09-16T03:19:21.229 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:19:21.230 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:19:21.651 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:19:22.652 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:19:22.652 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:19:22.652 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T03:19:22.653 INFO:tasks.workunit.client.0.smithi096.stdout:5 2024-09-16T03:19:22.653 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:19:22.653 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:19:23.264 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:19:24.268 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:19:24.268 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:19:24.268 INFO:tasks.workunit.client.0.smithi096.stdout:6 2024-09-16T03:19:24.268 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T03:19:24.269 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:19:24.269 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:19:24.846 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:19:25.848 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:19:25.848 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:19:25.849 INFO:tasks.workunit.client.0.smithi096.stdout:7 2024-09-16T03:19:25.849 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T03:19:25.849 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:19:25.849 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:19:26.292 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:19:27.294 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:19:27.294 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:19:27.294 INFO:tasks.workunit.client.0.smithi096.stdout:8 2024-09-16T03:19:27.295 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T03:19:27.295 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:19:27.295 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:19:27.876 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:19:28.878 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:19:28.879 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:19:28.879 INFO:tasks.workunit.client.0.smithi096.stdout:9 2024-09-16T03:19:28.879 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T03:19:28.879 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:19:28.879 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:19:29.317 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:19:30.318 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:19:30.318 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:19:30.318 INFO:tasks.workunit.client.0.smithi096.stdout:10 2024-09-16T03:19:30.319 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T03:19:30.319 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:19:30.319 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:19:30.871 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:19:31.873 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:19:31.874 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:19:31.874 INFO:tasks.workunit.client.0.smithi096.stdout:11 2024-09-16T03:19:31.874 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T03:19:31.874 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:19:31.874 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:19:33.165 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:19:34.166 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:19:34.166 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:19:34.166 INFO:tasks.workunit.client.0.smithi096.stdout:12 2024-09-16T03:19:34.167 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T03:19:34.167 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:19:34.167 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:19:35.121 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:19:36.122 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:19:36.123 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:19:36.123 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T03:19:36.123 INFO:tasks.workunit.client.0.smithi096.stdout:13 2024-09-16T03:19:36.123 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:19:36.124 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:19:37.168 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:19:38.170 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:19:38.170 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:19:38.170 INFO:tasks.workunit.client.0.smithi096.stdout:14 2024-09-16T03:19:38.171 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T03:19:38.171 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:19:38.171 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:19:38.685 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:19:39.687 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:19:39.687 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:19:39.688 INFO:tasks.workunit.client.0.smithi096.stdout:15 2024-09-16T03:19:39.688 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T03:19:39.688 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:19:39.688 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:19:40.473 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:19:41.474 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:19:41.475 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:19:41.475 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T03:19:41.475 INFO:tasks.workunit.client.0.smithi096.stdout:16 2024-09-16T03:19:41.475 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:19:41.475 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:19:42.260 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:19:43.261 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:19:43.261 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:19:43.262 INFO:tasks.workunit.client.0.smithi096.stdout:17 2024-09-16T03:19:43.262 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T03:19:43.262 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:19:43.262 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:19:43.725 INFO:tasks.workunit.client.0.smithi096.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/1329280642,v1:127.0.0.1:6803/1329280642] [v2:127.0.0.1:6804/1329280642,v1:127.0.0.1:6805/1329280642] exists,up c40f9ba5-97f0-4652-abe8-adabe1eb21a1 2024-09-16T03:19:43.726 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:19:43.726 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:19:43.726 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:19:43.726 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:124: TEST_journald_cluster_log_level: ceph config set mon.a mon_cluster_log_level debug 2024-09-16T03:19:44.214 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:125: TEST_journald_cluster_log_level: ceph osd pool create replicated1 8 8 2024-09-16T03:19:44.761 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'replicated1' already exists 2024-09-16T03:19:44.778 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:126: TEST_journald_cluster_log_level: ceph osd pool set replicated1 size 1 --yes-i-really-mean-it 2024-09-16T03:19:45.880 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 1 size to 1 2024-09-16T03:19:45.903 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:127: TEST_journald_cluster_log_level: ceph osd pool set replicated1 min_size 1 2024-09-16T03:19:46.851 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 1 min_size to 1 2024-09-16T03:19:46.871 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:129: TEST_journald_cluster_log_level: WAIT_FOR_CLEAN_TIMEOUT=60 2024-09-16T03:19:46.872 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:129: TEST_journald_cluster_log_level: wait_for_clean 2024-09-16T03:19:46.872 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1633: wait_for_clean: local cmd= 2024-09-16T03:19:46.872 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1634: wait_for_clean: local num_active_clean=-1 2024-09-16T03:19:46.872 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1635: wait_for_clean: local cur_active_clean 2024-09-16T03:19:46.872 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: get_timeout_delays 60 .1 2024-09-16T03:19:46.873 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: shopt -q -o xtrace 2024-09-16T03:19:46.873 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: echo true 2024-09-16T03:19:46.873 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: local trace=true 2024-09-16T03:19:46.873 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: true 2024-09-16T03:19:46.873 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: shopt -u -o xtrace 2024-09-16T03:19:46.966 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '4.5') 2024-09-16T03:19:46.966 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: local -a delays 2024-09-16T03:19:46.967 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1637: wait_for_clean: local -i loop=0 2024-09-16T03:19:46.967 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1639: wait_for_clean: flush_pg_stats 2024-09-16T03:19:46.967 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: local timeout=300 2024-09-16T03:19:46.967 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ceph osd ls 2024-09-16T03:19:47.392 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ids=0 2024-09-16T03:19:47.392 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2208: flush_pg_stats: seqs= 2024-09-16T03:19:47.392 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:19:47.392 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-09-16T03:19:47.545 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=21474836487 2024-09-16T03:19:47.545 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 21474836487 2024-09-16T03:19:47.545 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836487' 2024-09-16T03:19:47.545 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:19:47.546 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:19:47.546 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 0-21474836487 2024-09-16T03:19:47.546 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=0 2024-09-16T03:19:47.547 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 0-21474836487 2024-09-16T03:19:47.547 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:19:47.548 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=21474836487 2024-09-16T03:19:47.548 INFO:tasks.workunit.client.0.smithi096.stdout:waiting osd.0 seq 21474836487 2024-09-16T03:19:47.548 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2024-09-16T03:19:47.548 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T03:19:48.008 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836485 -lt 21474836487 2024-09-16T03:19:48.008 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: flush_pg_stats: sleep 1 2024-09-16T03:19:49.009 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2224: flush_pg_stats: '[' 300 -eq 0 ']' 2024-09-16T03:19:49.010 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T03:19:49.424 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836487 -lt 21474836487 2024-09-16T03:19:49.425 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: get_num_pgs 2024-09-16T03:19:49.425 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:19:49.425 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:19:49.989 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: test 8 == 0 2024-09-16T03:19:49.989 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:19:49.989 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:19:49.989 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:19:49.990 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:19:49.990 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:19:49.990 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:19:49.990 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:19:50.390 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=8 2024-09-16T03:19:50.390 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:19:50.390 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:19:50.390 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:19:50.931 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 8 = 8 2024-09-16T03:19:50.932 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: break 2024-09-16T03:19:50.932 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: return 0 2024-09-16T03:19:50.932 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:130: TEST_journald_cluster_log_level: ERRORS=0 2024-09-16T03:19:50.932 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:131: TEST_journald_cluster_log_level: ceph config set mon.a mon_cluster_log_to_journald true 2024-09-16T03:19:51.433 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:133: TEST_journald_cluster_log_level: ceph pg deep-scrub 1.0 2024-09-16T03:19:51.814 INFO:tasks.workunit.client.0.smithi096.stderr:instructing pg 1.0 on osd.0 to deep-scrub 2024-09-16T03:19:51.829 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:134: TEST_journald_cluster_log_level: search_str='1.0 deep-scrub' 2024-09-16T03:19:51.829 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:135: TEST_journald_cluster_log_level: TIMEOUT=60 2024-09-16T03:19:51.829 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:136: TEST_journald_cluster_log_level: sleep 60 2024-09-16T03:20:51.833 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:137: TEST_journald_cluster_log_level: sudo journalctl _COMM=ceph-mon CEPH_CHANNEL=cluster PRIORITY=7 --output=json-pretty --since '60 seconds ago' 2024-09-16T03:20:51.834 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:137: TEST_journald_cluster_log_level: jq .MESSAGE 2024-09-16T03:20:51.974 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:138: TEST_journald_cluster_log_level: grep -q '1.0 deep-scrub' td/mon-cluster-log/journal.log 2024-09-16T03:20:51.977 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:139: TEST_journald_cluster_log_level: return_code=0 2024-09-16T03:20:51.977 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:140: TEST_journald_cluster_log_level: '[' 0 -ne 0 ']' 2024-09-16T03:20:51.977 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:145: TEST_journald_cluster_log_level: ceph osd down 0 2024-09-16T03:20:52.584 INFO:tasks.workunit.client.0.smithi096.stderr:osd.0 is already down. 2024-09-16T03:20:52.602 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:146: TEST_journald_cluster_log_level: TIMEOUT=20 2024-09-16T03:20:52.602 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:146: TEST_journald_cluster_log_level: wait_for_osd up 0 2024-09-16T03:20:52.602 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:20:52.602 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2024-09-16T03:20:52.602 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:20:52.603 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:20:52.603 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T03:20:52.603 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 20 )) 2024-09-16T03:20:52.603 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:20:52.603 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:20:52.604 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:20:53.234 INFO:tasks.workunit.client.0.smithi096.stdout:osd.0 up in weight 1 up_from 14 up_thru 9 down_at 13 last_clean_interval [5,13) [v2:127.0.0.1:6802/1329280642,v1:127.0.0.1:6803/1329280642] [v2:127.0.0.1:6810/1330280642,v1:127.0.0.1:6811/1330280642] exists,up c40f9ba5-97f0-4652-abe8-adabe1eb21a1 2024-09-16T03:20:53.235 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:20:53.235 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:20:53.235 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:20:53.235 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:147: TEST_journald_cluster_log_level: search_str='osd.0.*boot' 2024-09-16T03:20:53.235 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:148: TEST_journald_cluster_log_level: sudo journalctl _COMM=ceph-mon CEPH_CHANNEL=cluster PRIORITY=6 --output=json-pretty --since '60 seconds ago' 2024-09-16T03:20:53.235 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:148: TEST_journald_cluster_log_level: jq .MESSAGE 2024-09-16T03:20:53.811 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:149: TEST_journald_cluster_log_level: grep -q 'osd.0.*boot' td/mon-cluster-log/journal.log 2024-09-16T03:20:53.812 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:150: TEST_journald_cluster_log_level: return_code=0 2024-09-16T03:20:53.812 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:151: TEST_journald_cluster_log_level: '[' 0 -ne 0 ']' 2024-09-16T03:20:53.812 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:156: TEST_journald_cluster_log_level: ceph config set mon.a mon_cluster_log_level info 2024-09-16T03:20:54.315 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:157: TEST_journald_cluster_log_level: ceph pg deep-scrub 1.1 2024-09-16T03:20:54.712 INFO:tasks.workunit.client.0.smithi096.stderr:instructing pg 1.1 on osd.0 to deep-scrub 2024-09-16T03:20:54.728 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:158: TEST_journald_cluster_log_level: TIMEOUT=60 2024-09-16T03:20:54.728 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:159: TEST_journald_cluster_log_level: sleep 60 2024-09-16T03:21:54.731 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:160: TEST_journald_cluster_log_level: search_str='1.1 deep-scrub' 2024-09-16T03:21:54.731 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:161: TEST_journald_cluster_log_level: sudo journalctl _COMM=ceph-mon CEPH_CHANNEL=cluster PRIORITY=7 --output=json-pretty --since '60 seconds ago' 2024-09-16T03:21:54.732 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:161: TEST_journald_cluster_log_level: jq .MESSAGE 2024-09-16T03:21:54.770 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:162: TEST_journald_cluster_log_level: grep -q '1.1 deep-scrub' td/mon-cluster-log/journal.log 2024-09-16T03:21:54.772 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:163: TEST_journald_cluster_log_level: return_code=1 2024-09-16T03:21:54.772 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:164: TEST_journald_cluster_log_level: '[' 1 -eq 0 ']' 2024-09-16T03:21:54.772 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:169: TEST_journald_cluster_log_level: ceph config set mon.a mon_cluster_log_level warn 2024-09-16T03:21:55.271 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:170: TEST_journald_cluster_log_level: ceph osd set noup 2024-09-16T03:21:55.907 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:21:55.928 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:171: TEST_journald_cluster_log_level: ceph osd down osd.0 2024-09-16T03:21:56.597 INFO:tasks.workunit.client.0.smithi096.stderr:osd.0 is already down. 2024-09-16T03:21:56.613 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:172: TEST_journald_cluster_log_level: ceph osd unset noup 2024-09-16T03:21:57.345 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:21:57.364 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:173: TEST_journald_cluster_log_level: TIMEOUT=60 2024-09-16T03:21:57.364 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:173: TEST_journald_cluster_log_level: wait_for_osd up 0 2024-09-16T03:21:57.364 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:21:57.364 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2024-09-16T03:21:57.364 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:21:57.364 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:21:57.364 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 60 )) 2024-09-16T03:21:57.365 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T03:21:57.365 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:21:57.365 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:21:57.365 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:21:57.835 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:21:58.837 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:21:58.837 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 60 )) 2024-09-16T03:21:58.837 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T03:21:58.838 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T03:21:58.838 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:21:58.838 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:21:59.310 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:22:00.311 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:22:00.312 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 60 )) 2024-09-16T03:22:00.312 INFO:tasks.workunit.client.0.smithi096.stdout:2 2024-09-16T03:22:00.312 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T03:22:00.312 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:22:00.312 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:22:00.769 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:22:01.771 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:22:01.771 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 60 )) 2024-09-16T03:22:01.771 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T03:22:01.771 INFO:tasks.workunit.client.0.smithi096.stdout:3 2024-09-16T03:22:01.772 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:22:01.772 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:22:02.244 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:22:03.246 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:22:03.246 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 60 )) 2024-09-16T03:22:03.247 INFO:tasks.workunit.client.0.smithi096.stdout:4 2024-09-16T03:22:03.247 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T03:22:03.247 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:22:03.247 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:22:03.722 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:22:04.724 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:22:04.724 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 60 )) 2024-09-16T03:22:04.724 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T03:22:04.724 INFO:tasks.workunit.client.0.smithi096.stdout:5 2024-09-16T03:22:04.725 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:22:04.725 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:22:05.160 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:22:06.162 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:22:06.162 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 60 )) 2024-09-16T03:22:06.162 INFO:tasks.workunit.client.0.smithi096.stdout:6 2024-09-16T03:22:06.162 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T03:22:06.163 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:22:06.163 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:22:06.595 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:22:07.597 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:22:07.597 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 60 )) 2024-09-16T03:22:07.597 INFO:tasks.workunit.client.0.smithi096.stdout:7 2024-09-16T03:22:07.598 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T03:22:07.598 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:22:07.598 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:22:08.074 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:22:09.076 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:22:09.076 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 60 )) 2024-09-16T03:22:09.076 INFO:tasks.workunit.client.0.smithi096.stdout:8 2024-09-16T03:22:09.077 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T03:22:09.077 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:22:09.077 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:22:09.494 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:22:10.495 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:22:10.496 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 60 )) 2024-09-16T03:22:10.496 INFO:tasks.workunit.client.0.smithi096.stdout:9 2024-09-16T03:22:10.496 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T03:22:10.496 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:22:10.497 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:22:10.987 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:22:11.989 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:22:11.990 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 60 )) 2024-09-16T03:22:11.990 INFO:tasks.workunit.client.0.smithi096.stdout:10 2024-09-16T03:22:11.990 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T03:22:11.990 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:22:11.991 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:22:12.405 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:22:13.408 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:22:13.408 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 60 )) 2024-09-16T03:22:13.408 INFO:tasks.workunit.client.0.smithi096.stdout:11 2024-09-16T03:22:13.409 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T03:22:13.409 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:22:13.409 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:22:13.833 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:22:14.834 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:22:14.835 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 60 )) 2024-09-16T03:22:14.835 INFO:tasks.workunit.client.0.smithi096.stdout:12 2024-09-16T03:22:14.835 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T03:22:14.835 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:22:14.835 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:22:15.248 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:22:16.250 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:22:16.250 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 60 )) 2024-09-16T03:22:16.250 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T03:22:16.250 INFO:tasks.workunit.client.0.smithi096.stdout:13 2024-09-16T03:22:16.251 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:22:16.251 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:22:16.687 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:22:17.689 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:22:17.689 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 60 )) 2024-09-16T03:22:17.689 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T03:22:17.690 INFO:tasks.workunit.client.0.smithi096.stdout:14 2024-09-16T03:22:17.690 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:22:17.690 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:22:18.108 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:22:19.110 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:22:19.110 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 60 )) 2024-09-16T03:22:19.110 INFO:tasks.workunit.client.0.smithi096.stdout:15 2024-09-16T03:22:19.110 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T03:22:19.111 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:22:19.111 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:22:19.520 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:22:20.521 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:22:20.522 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 60 )) 2024-09-16T03:22:20.522 INFO:tasks.workunit.client.0.smithi096.stdout:16 2024-09-16T03:22:20.522 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T03:22:20.523 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:22:20.523 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:22:20.939 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:22:21.941 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:22:21.942 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 60 )) 2024-09-16T03:22:21.942 INFO:tasks.workunit.client.0.smithi096.stdout:17 2024-09-16T03:22:21.942 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T03:22:21.942 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:22:21.943 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:22:22.406 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:22:23.407 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:22:23.407 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 60 )) 2024-09-16T03:22:23.407 INFO:tasks.workunit.client.0.smithi096.stdout:18 2024-09-16T03:22:23.408 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 18 2024-09-16T03:22:23.408 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:22:23.408 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:22:23.816 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:22:24.817 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:22:24.818 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 60 )) 2024-09-16T03:22:24.818 INFO:tasks.workunit.client.0.smithi096.stdout:19 2024-09-16T03:22:24.818 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 19 2024-09-16T03:22:24.818 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:22:24.819 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:22:25.245 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:22:26.246 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:22:26.247 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 60 )) 2024-09-16T03:22:26.247 INFO:tasks.workunit.client.0.smithi096.stdout:20 2024-09-16T03:22:26.248 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 20 2024-09-16T03:22:26.248 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:22:26.248 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:22:26.700 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:22:27.702 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:22:27.702 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 60 )) 2024-09-16T03:22:27.702 INFO:tasks.workunit.client.0.smithi096.stdout:21 2024-09-16T03:22:27.703 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 21 2024-09-16T03:22:27.703 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:22:27.703 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:22:28.181 INFO:tasks.workunit.client.0.smithi096.stdout:osd.0 up in weight 1 up_from 21 up_thru 21 down_at 18 last_clean_interval [5,20) [v2:127.0.0.1:6802/1329280642,v1:127.0.0.1:6803/1329280642] [v2:127.0.0.1:6804/1331280642,v1:127.0.0.1:6805/1331280642] exists,up c40f9ba5-97f0-4652-abe8-adabe1eb21a1 2024-09-16T03:22:28.182 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:22:28.182 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:22:28.183 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:22:28.183 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:174: TEST_journald_cluster_log_level: search_str='Health check failed: noup flag(s) set (OSDMAP_FLAGS)' 2024-09-16T03:22:28.183 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:175: TEST_journald_cluster_log_level: sudo journalctl _COMM=ceph-mon CEPH_CHANNEL=cluster PRIORITY=4 --output=json-pretty --since '60 seconds ago' 2024-09-16T03:22:28.183 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:175: TEST_journald_cluster_log_level: jq .MESSAGE 2024-09-16T03:22:28.389 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:176: TEST_journald_cluster_log_level: grep -q 'Health check failed: noup flag(s) set (OSDMAP_FLAGS)' td/mon-cluster-log/journal.log 2024-09-16T03:22:28.391 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:177: TEST_journald_cluster_log_level: return_code=0 2024-09-16T03:22:28.391 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:178: TEST_journald_cluster_log_level: '[' 0 -ne 0 ']' 2024-09-16T03:22:28.391 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:183: TEST_journald_cluster_log_level: ceph osd out 0 2024-09-16T03:22:29.030 INFO:tasks.workunit.client.0.smithi096.stderr:osd.0 is already out. 2024-09-16T03:22:29.047 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:184: TEST_journald_cluster_log_level: ceph osd in 0 2024-09-16T03:22:29.566 INFO:tasks.workunit.client.0.smithi096.stderr:osd.0 is already in. 2024-09-16T03:22:29.583 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:185: TEST_journald_cluster_log_level: WAIT_FOR_CLEAN_TIMEOUT=60 2024-09-16T03:22:29.583 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:185: TEST_journald_cluster_log_level: wait_for_clean 2024-09-16T03:22:29.583 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1633: wait_for_clean: local cmd= 2024-09-16T03:22:29.583 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1634: wait_for_clean: local num_active_clean=-1 2024-09-16T03:22:29.583 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1635: wait_for_clean: local cur_active_clean 2024-09-16T03:22:29.583 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: get_timeout_delays 60 .1 2024-09-16T03:22:29.584 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: shopt -q -o xtrace 2024-09-16T03:22:29.584 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: echo true 2024-09-16T03:22:29.585 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: local trace=true 2024-09-16T03:22:29.585 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: true 2024-09-16T03:22:29.585 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: shopt -u -o xtrace 2024-09-16T03:22:29.671 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '4.5') 2024-09-16T03:22:29.672 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: local -a delays 2024-09-16T03:22:29.672 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1637: wait_for_clean: local -i loop=0 2024-09-16T03:22:29.672 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1639: wait_for_clean: flush_pg_stats 2024-09-16T03:22:29.672 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: local timeout=60 2024-09-16T03:22:29.672 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ceph osd ls 2024-09-16T03:22:30.205 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ids=0 2024-09-16T03:22:30.205 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2208: flush_pg_stats: seqs= 2024-09-16T03:22:30.205 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:22:30.205 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-09-16T03:22:30.372 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=90194313258 2024-09-16T03:22:30.372 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 90194313258 2024-09-16T03:22:30.372 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-90194313258' 2024-09-16T03:22:30.372 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:22:30.372 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 0-90194313258 2024-09-16T03:22:30.373 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:22:30.373 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=0 2024-09-16T03:22:30.373 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 0-90194313258 2024-09-16T03:22:30.373 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:22:30.374 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=90194313258 2024-09-16T03:22:30.375 INFO:tasks.workunit.client.0.smithi096.stdout:waiting osd.0 seq 90194313258 2024-09-16T03:22:30.375 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.0 seq 90194313258' 2024-09-16T03:22:30.375 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T03:22:30.774 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 0 -lt 90194313258 2024-09-16T03:22:30.775 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: flush_pg_stats: sleep 1 2024-09-16T03:22:31.776 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2224: flush_pg_stats: '[' 60 -eq 0 ']' 2024-09-16T03:22:31.777 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T03:22:32.257 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 0 -lt 90194313258 2024-09-16T03:22:32.257 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: flush_pg_stats: sleep 1 2024-09-16T03:22:33.258 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2224: flush_pg_stats: '[' 59 -eq 0 ']' 2024-09-16T03:22:33.259 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T03:22:33.733 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 90194313258 -lt 90194313258 2024-09-16T03:22:33.733 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: get_num_pgs 2024-09-16T03:22:33.734 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:22:33.734 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:22:34.324 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: test 8 == 0 2024-09-16T03:22:34.324 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:22:34.325 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:22:34.325 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:22:34.325 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:22:34.325 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:22:34.326 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:22:34.326 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:22:34.731 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=8 2024-09-16T03:22:34.731 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:22:34.732 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:22:34.732 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:22:35.287 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 8 = 8 2024-09-16T03:22:35.287 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: break 2024-09-16T03:22:35.287 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: return 0 2024-09-16T03:22:35.287 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:186: TEST_journald_cluster_log_level: search_str='Client client.admin marked osd.0 out, while it was still marked up' 2024-09-16T03:22:35.287 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:187: TEST_journald_cluster_log_level: ceph log last 2024-09-16T03:22:35.288 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:187: TEST_journald_cluster_log_level: grep -q 'Client client.admin marked osd.0 out, while it was still marked up' 2024-09-16T03:22:35.840 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:188: TEST_journald_cluster_log_level: sudo journalctl _COMM=ceph-mon CEPH_CHANNEL=cluster PRIORITY=6 --output=json-pretty --since '60 seconds ago' 2024-09-16T03:22:35.841 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:188: TEST_journald_cluster_log_level: jq .MESSAGE 2024-09-16T03:22:35.872 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:189: TEST_journald_cluster_log_level: grep -q 'Client client.admin marked osd.0 out, while it was still marked up' td/mon-cluster-log/journal.log 2024-09-16T03:22:35.873 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:190: TEST_journald_cluster_log_level: return_code=1 2024-09-16T03:22:35.873 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:191: TEST_journald_cluster_log_level: '[' 1 -eq 0 ']' 2024-09-16T03:22:35.873 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:196: TEST_journald_cluster_log_level: '[' 0 -gt 0 ']' 2024-09-16T03:22:35.874 INFO:tasks.workunit.client.0.smithi096.stdout:TEST PASSED 2024-09-16T03:22:35.875 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:201: TEST_journald_cluster_log_level: echo 'TEST PASSED' 2024-09-16T03:22:35.876 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:202: TEST_journald_cluster_log_level: return 0 2024-09-16T03:22:35.876 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh:33: run: teardown td/mon-cluster-log 2024-09-16T03:22:35.876 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/mon-cluster-log 2024-09-16T03:22:35.876 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:22:35.876 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/mon-cluster-log KILL 2024-09-16T03:22:35.876 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:22:35.876 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:22:35.876 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:22:35.876 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:22:35.876 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:22:36.182 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:22:36.183 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:22:36.184 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:22:36.185 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:22:36.186 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:22:36.186 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:22:36.187 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:22:36.188 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:22:36.188 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:22:36.189 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:22:36.189 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:22:36.190 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:22:36.191 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:22:36.192 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/mon-cluster-log 2024-09-16T03:22:36.204 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:22:36.204 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:22:36.204 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.39951 2024-09-16T03:22:36.204 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.39951 2024-09-16T03:22:36.206 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:22:36.206 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:22:36.206 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2322: main: code=0 2024-09-16T03:22:36.206 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2326: main: teardown td/mon-cluster-log 0 2024-09-16T03:22:36.206 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/mon-cluster-log 2024-09-16T03:22:36.207 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2024-09-16T03:22:36.207 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/mon-cluster-log KILL 2024-09-16T03:22:36.207 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:22:36.207 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:22:36.207 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:22:36.207 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:22:36.207 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:22:36.208 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:22:36.209 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:22:36.210 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:22:36.210 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:22:36.211 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:22:36.211 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:22:36.211 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:22:36.212 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:22:36.213 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:22:36.213 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:22:36.213 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:22:36.214 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:22:36.215 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2024-09-16T03:22:36.215 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/mon-cluster-log 2024-09-16T03:22:36.217 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:22:36.217 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:22:36.217 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.39951 2024-09-16T03:22:36.217 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.39951 2024-09-16T03:22:36.219 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:22:36.219 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:22:36.219 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2327: main: return 0 2024-09-16T03:22:36.219 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-16T03:22:36.219 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-16T03:22:36.232 INFO:tasks.workunit:Running workunit mon/mon-created-time.sh... 2024-09-16T03:22:36.232 DEBUG:teuthology.orchestra.run.smithi096:workunit test mon/mon-created-time.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7498493279982dfe87f00616198a5967475f6169 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-created-time.sh 2024-09-16T03:22:36.285 INFO:tasks.workunit.client.0.smithi096.stderr:stty: 'standard input': Inappropriate ioctl for device 2024-09-16T03:22:36.289 INFO:tasks.workunit.client.0.smithi096.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2024-09-16T03:22:36.289 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2315: main: export PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-16T03:22:36.290 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2315: main: PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-16T03:22:36.290 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2316: main: export PYTHONWARNINGS=ignore 2024-09-16T03:22:36.290 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2316: main: PYTHONWARNINGS=ignore 2024-09-16T03:22:36.290 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2317: main: export CEPH_CONF=/dev/null 2024-09-16T03:22:36.290 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2317: main: CEPH_CONF=/dev/null 2024-09-16T03:22:36.290 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2318: main: unset CEPH_ARGS 2024-09-16T03:22:36.290 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2320: main: local code 2024-09-16T03:22:36.290 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2321: main: run td/mon-created-time 2024-09-16T03:22:36.290 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-created-time.sh:18: run: local dir=td/mon-created-time 2024-09-16T03:22:36.290 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-created-time.sh:19: run: shift 2024-09-16T03:22:36.290 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-created-time.sh:21: run: export CEPH_MON=127.0.0.1:7125 2024-09-16T03:22:36.291 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-created-time.sh:21: run: CEPH_MON=127.0.0.1:7125 2024-09-16T03:22:36.291 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-created-time.sh:22: run: export CEPH_ARGS 2024-09-16T03:22:36.291 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-created-time.sh:23: run: uuidgen 2024-09-16T03:22:36.291 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-created-time.sh:23: run: CEPH_ARGS+='--fsid=26be41d5-06ac-41a7-9076-d6d85d0c5bc0 --auth-supported=none ' 2024-09-16T03:22:36.292 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-created-time.sh:24: run: CEPH_ARGS+='--mon-host=127.0.0.1:7125 ' 2024-09-16T03:22:36.292 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-created-time.sh:26: run: set 2024-09-16T03:22:36.292 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-created-time.sh:26: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2024-09-16T03:22:36.293 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-created-time.sh:26: run: local funcs=TEST_mon_created_time 2024-09-16T03:22:36.293 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-created-time.sh:27: run: for func in $funcs 2024-09-16T03:22:36.293 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-created-time.sh:28: run: setup td/mon-created-time 2024-09-16T03:22:36.294 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/mon-created-time 2024-09-16T03:22:36.294 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/mon-created-time 2024-09-16T03:22:36.294 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/mon-created-time 2024-09-16T03:22:36.294 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:22:36.294 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/mon-created-time KILL 2024-09-16T03:22:36.294 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:22:36.294 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:22:36.294 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:22:36.294 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:22:36.294 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:22:36.295 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:22:36.295 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:22:36.296 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:22:36.297 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:22:36.298 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:22:36.298 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:22:36.298 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:22:36.298 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:22:36.299 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:22:36.299 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:22:36.299 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:22:36.300 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:22:36.301 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:22:36.301 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/mon-created-time 2024-09-16T03:22:36.302 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:22:36.303 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:22:36.303 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.46925 2024-09-16T03:22:36.303 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.46925 2024-09-16T03:22:36.303 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:22:36.303 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:22:36.303 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/mon-created-time 2024-09-16T03:22:36.305 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T03:22:36.305 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:22:36.305 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.46925 2024-09-16T03:22:36.306 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.46925 2024-09-16T03:22:36.307 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T03:22:36.307 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2024-09-16T03:22:36.308 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2024-09-16T03:22:36.308 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T03:22:36.308 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/mon-created-time 1' TERM HUP INT 2024-09-16T03:22:36.308 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-created-time.sh:29: run: TEST_mon_created_time td/mon-created-time 2024-09-16T03:22:36.308 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-created-time.sh:35: TEST_mon_created_time: local dir=td/mon-created-time 2024-09-16T03:22:36.308 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-created-time.sh:37: TEST_mon_created_time: run_mon td/mon-created-time a 2024-09-16T03:22:36.308 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/mon-created-time 2024-09-16T03:22:36.308 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T03:22:36.308 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T03:22:36.308 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T03:22:36.308 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/mon-created-time/a 2024-09-16T03:22:36.308 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/mon-created-time/a --run-dir=td/mon-created-time 2024-09-16T03:22:36.777 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T03:22:36.778 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:22:36.778 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:22:36.778 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:22:36.778 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:22:36.778 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.46925 2024-09-16T03:22:36.779 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.46925/$cluster-$name.asok' 2024-09-16T03:22:36.779 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/mon-created-time/a '--log-file=td/mon-created-time/$name.log' '--admin-socket=/tmp/ceph-asok.46925/$cluster-$name.asok' --mon-cluster-log-file=td/mon-created-time/log --run-dir=td/mon-created-time '--pid-file=td/mon-created-time/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-09-16T03:22:36.980 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T03:22:36.981 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T03:22:36.981 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:22:36.981 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:22:36.981 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T03:22:36.983 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T03:22:36.983 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:22:36.983 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:22:36.983 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:22:36.983 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:22:36.983 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:22:36.983 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.46925 2024-09-16T03:22:36.983 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.46925/ceph-mon.a.asok 2024-09-16T03:22:36.983 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:22:36.984 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.46925/ceph-mon.a.asok config get fsid 2024-09-16T03:22:37.102 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T03:22:37.102 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:22:37.102 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:22:37.102 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T03:22:37.102 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T03:22:37.103 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:22:37.103 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:22:37.103 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:22:37.103 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:22:37.103 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:22:37.104 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.46925 2024-09-16T03:22:37.104 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.46925/ceph-mon.a.asok 2024-09-16T03:22:37.104 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:22:37.104 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.46925/ceph-mon.a.asok config get mon_host 2024-09-16T03:22:37.213 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-created-time.sh:39: TEST_mon_created_time: ceph mon dump 2024-09-16T03:22:38.033 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 1 2024-09-16T03:22:38.034 INFO:tasks.workunit.client.0.smithi096.stdout:fsid 26be41d5-06ac-41a7-9076-d6d85d0c5bc0 2024-09-16T03:22:38.034 INFO:tasks.workunit.client.0.smithi096.stdout:last_changed 2024-09-16T03:22:36.333981+0000 2024-09-16T03:22:38.034 INFO:tasks.workunit.client.0.smithi096.stdout:created 2024-09-16T03:22:36.333981+0000 2024-09-16T03:22:38.034 INFO:tasks.workunit.client.0.smithi096.stdout:min_mon_release 19 (squid) 2024-09-16T03:22:38.034 INFO:tasks.workunit.client.0.smithi096.stdout:election_strategy: 1 2024-09-16T03:22:38.034 INFO:tasks.workunit.client.0.smithi096.stdout:0: v2:127.0.0.1:7125/0 mon.a 2024-09-16T03:22:38.034 INFO:tasks.workunit.client.0.smithi096.stderr:dumped monmap epoch 1 2024-09-16T03:22:38.049 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-created-time.sh:41: TEST_mon_created_time: sed -n /created/p 2024-09-16T03:22:38.050 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-created-time.sh:41: TEST_mon_created_time: ceph mon dump 2024-09-16T03:22:38.050 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-created-time.sh:41: TEST_mon_created_time: awk '{print $NF}' 2024-09-16T03:22:38.284 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-created-time.sh:41: TEST_mon_created_time: test 2024-09-16T03:22:36.333981+0000x = x 2024-09-16T03:22:38.285 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-created-time.sh:45: TEST_mon_created_time: ceph mon dump 2024-09-16T03:22:38.285 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-created-time.sh:45: TEST_mon_created_time: sed -n /created/p 2024-09-16T03:22:38.285 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-created-time.sh:45: TEST_mon_created_time: awk '{print $NF}' 2024-09-16T03:22:38.515 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-created-time.sh:45: TEST_mon_created_time: test 2024-09-16T03:22:36.333981+0000x = 0.000000x 2024-09-16T03:22:38.515 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-created-time.sh:30: run: teardown td/mon-created-time 2024-09-16T03:22:38.515 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/mon-created-time 2024-09-16T03:22:38.515 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:22:38.515 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/mon-created-time KILL 2024-09-16T03:22:38.515 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:22:38.516 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:22:38.516 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:22:38.516 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:22:38.516 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:22:38.621 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:22:38.621 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:22:38.623 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:22:38.623 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:22:38.625 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:22:38.625 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:22:38.625 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:22:38.626 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:22:38.626 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:22:38.627 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:22:38.627 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:22:38.628 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:22:38.629 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:22:38.629 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/mon-created-time 2024-09-16T03:22:38.631 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:22:38.631 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:22:38.631 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.46925 2024-09-16T03:22:38.631 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.46925 2024-09-16T03:22:38.632 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:22:38.632 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:22:38.632 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2322: main: code=0 2024-09-16T03:22:38.632 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2326: main: teardown td/mon-created-time 0 2024-09-16T03:22:38.632 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/mon-created-time 2024-09-16T03:22:38.632 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2024-09-16T03:22:38.633 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/mon-created-time KILL 2024-09-16T03:22:38.633 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:22:38.633 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:22:38.633 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:22:38.633 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:22:38.633 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:22:38.635 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:22:38.635 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:22:38.636 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:22:38.636 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:22:38.637 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:22:38.637 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:22:38.638 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:22:38.638 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:22:38.638 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:22:38.639 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:22:38.639 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:22:38.640 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:22:38.641 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2024-09-16T03:22:38.641 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/mon-created-time 2024-09-16T03:22:38.642 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:22:38.642 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:22:38.643 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.46925 2024-09-16T03:22:38.643 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.46925 2024-09-16T03:22:38.644 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:22:38.644 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:22:38.644 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2327: main: return 0 2024-09-16T03:22:38.644 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-16T03:22:38.645 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-16T03:22:38.697 INFO:tasks.workunit:Running workunit mon/mon-handle-forward.sh... 2024-09-16T03:22:38.697 DEBUG:teuthology.orchestra.run.smithi096:workunit test mon/mon-handle-forward.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7498493279982dfe87f00616198a5967475f6169 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-handle-forward.sh 2024-09-16T03:22:38.749 INFO:tasks.workunit.client.0.smithi096.stderr:stty: 'standard input': Inappropriate ioctl for device 2024-09-16T03:22:38.755 INFO:tasks.workunit.client.0.smithi096.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2024-09-16T03:22:38.755 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2315: main: export PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-16T03:22:38.755 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2315: main: PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-16T03:22:38.755 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2316: main: export PYTHONWARNINGS=ignore 2024-09-16T03:22:38.755 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2316: main: PYTHONWARNINGS=ignore 2024-09-16T03:22:38.755 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2317: main: export CEPH_CONF=/dev/null 2024-09-16T03:22:38.756 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2317: main: CEPH_CONF=/dev/null 2024-09-16T03:22:38.756 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2318: main: unset CEPH_ARGS 2024-09-16T03:22:38.756 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2320: main: local code 2024-09-16T03:22:38.756 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2321: main: run td/mon-handle-forward 2024-09-16T03:22:38.756 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-handle-forward.sh:21: run: local dir=td/mon-handle-forward 2024-09-16T03:22:38.757 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-handle-forward.sh:23: run: setup td/mon-handle-forward 2024-09-16T03:22:38.757 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/mon-handle-forward 2024-09-16T03:22:38.757 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/mon-handle-forward 2024-09-16T03:22:38.757 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/mon-handle-forward 2024-09-16T03:22:38.757 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:22:38.757 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/mon-handle-forward KILL 2024-09-16T03:22:38.757 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:22:38.757 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:22:38.757 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:22:38.757 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:22:38.757 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:22:38.758 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:22:38.758 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:22:38.758 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:22:38.758 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:22:38.759 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:22:38.759 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:22:38.760 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:22:38.760 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:22:38.760 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:22:38.761 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:22:38.761 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:22:38.761 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:22:38.762 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:22:38.763 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/mon-handle-forward 2024-09-16T03:22:38.764 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:22:38.764 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:22:38.764 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.47139 2024-09-16T03:22:38.764 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.47139 2024-09-16T03:22:38.765 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:22:38.765 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:22:38.765 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/mon-handle-forward 2024-09-16T03:22:38.767 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T03:22:38.767 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:22:38.767 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.47139 2024-09-16T03:22:38.767 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.47139 2024-09-16T03:22:38.768 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T03:22:38.768 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2024-09-16T03:22:38.769 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2024-09-16T03:22:38.769 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T03:22:38.769 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/mon-handle-forward 1' TERM HUP INT 2024-09-16T03:22:38.769 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-handle-forward.sh:25: run: MONA=127.0.0.1:7300 2024-09-16T03:22:38.769 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-handle-forward.sh:26: run: MONB=127.0.0.1:7301 2024-09-16T03:22:38.770 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-handle-forward.sh:28: run: uuidgen 2024-09-16T03:22:38.770 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-handle-forward.sh:28: run: FSID=ff77166b-e0e0-4fc8-8bb0-1665fed3e834 2024-09-16T03:22:38.770 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-handle-forward.sh:29: run: export CEPH_ARGS 2024-09-16T03:22:38.770 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-handle-forward.sh:30: run: CEPH_ARGS+='--fsid=ff77166b-e0e0-4fc8-8bb0-1665fed3e834 --auth-supported=none ' 2024-09-16T03:22:38.770 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-handle-forward.sh:31: run: CEPH_ARGS+='--mon-host=127.0.0.1:7300,127.0.0.1:7301 ' 2024-09-16T03:22:38.771 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-handle-forward.sh:32: run: run_mon td/mon-handle-forward a --public-addr 127.0.0.1:7300 2024-09-16T03:22:38.771 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/mon-handle-forward 2024-09-16T03:22:38.771 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T03:22:38.771 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T03:22:38.771 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T03:22:38.771 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/mon-handle-forward/a 2024-09-16T03:22:38.771 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/mon-handle-forward/a --run-dir=td/mon-handle-forward --public-addr 127.0.0.1:7300 2024-09-16T03:22:39.235 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T03:22:39.235 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:22:39.235 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:22:39.236 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:22:39.236 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:22:39.236 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.47139 2024-09-16T03:22:39.236 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.47139/$cluster-$name.asok' 2024-09-16T03:22:39.236 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/mon-handle-forward/a '--log-file=td/mon-handle-forward/$name.log' '--admin-socket=/tmp/ceph-asok.47139/$cluster-$name.asok' --mon-cluster-log-file=td/mon-handle-forward/log --run-dir=td/mon-handle-forward '--pid-file=td/mon-handle-forward/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr 127.0.0.1:7300 2024-09-16T03:22:39.421 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T03:22:39.423 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T03:22:39.423 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:22:39.423 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:22:39.423 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T03:22:39.423 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T03:22:39.424 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:22:39.424 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:22:39.424 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:22:39.425 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:22:39.425 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:22:39.425 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.47139 2024-09-16T03:22:39.425 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.47139/ceph-mon.a.asok 2024-09-16T03:22:39.425 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:22:39.425 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.47139/ceph-mon.a.asok config get fsid 2024-09-16T03:22:39.545 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T03:22:39.545 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:22:39.545 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:22:39.545 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T03:22:39.545 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T03:22:39.546 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:22:39.546 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:22:39.546 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:22:39.546 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:22:39.547 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:22:39.547 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.47139 2024-09-16T03:22:39.547 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.47139/ceph-mon.a.asok 2024-09-16T03:22:39.547 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:22:39.547 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.47139/ceph-mon.a.asok config get mon_host 2024-09-16T03:22:39.658 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-handle-forward.sh:33: run: run_mon td/mon-handle-forward b --public-addr 127.0.0.1:7301 2024-09-16T03:22:39.658 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/mon-handle-forward 2024-09-16T03:22:39.658 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T03:22:39.658 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=b 2024-09-16T03:22:39.658 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T03:22:39.658 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/mon-handle-forward/b 2024-09-16T03:22:39.658 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id b --mkfs --mon-data=td/mon-handle-forward/b --run-dir=td/mon-handle-forward --public-addr 127.0.0.1:7301 2024-09-16T03:22:40.138 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T03:22:40.139 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:22:40.139 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:22:40.139 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:22:40.139 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:22:40.140 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.47139 2024-09-16T03:22:40.140 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.47139/$cluster-$name.asok' 2024-09-16T03:22:40.140 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id b --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/mon-handle-forward/b '--log-file=td/mon-handle-forward/$name.log' '--admin-socket=/tmp/ceph-asok.47139/$cluster-$name.asok' --mon-cluster-log-file=td/mon-handle-forward/log --run-dir=td/mon-handle-forward '--pid-file=td/mon-handle-forward/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr 127.0.0.1:7301 2024-09-16T03:22:40.350 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T03:22:40.351 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon b fsid 2024-09-16T03:22:40.351 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:22:40.352 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=b 2024-09-16T03:22:40.352 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T03:22:40.352 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T03:22:40.353 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.b 2024-09-16T03:22:40.353 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.b 2024-09-16T03:22:40.353 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.b ']' 2024-09-16T03:22:40.353 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:22:40.353 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:22:40.353 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.47139 2024-09-16T03:22:40.354 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.47139/ceph-mon.b.asok 2024-09-16T03:22:40.354 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:22:40.354 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.47139/ceph-mon.b.asok config get fsid 2024-09-16T03:22:40.469 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon b mon_host 2024-09-16T03:22:40.469 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:22:40.469 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=b 2024-09-16T03:22:40.469 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T03:22:40.470 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T03:22:40.470 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.b 2024-09-16T03:22:40.470 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.b 2024-09-16T03:22:40.470 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.b ']' 2024-09-16T03:22:40.470 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:22:40.470 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:22:40.470 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.47139 2024-09-16T03:22:40.470 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.47139/ceph-mon.b.asok 2024-09-16T03:22:40.470 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:22:40.471 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.47139/ceph-mon.b.asok config get mon_host 2024-09-16T03:22:40.572 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-handle-forward.sh:36: run: timeout 360 ceph --mon-host-override 127.0.0.1:7300 mon stat 2024-09-16T03:22:40.662 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:22:40.663+0000 7ff19cb94640 -1 auth: unable to find a keyring on /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin: (2) No such file or directory 2024-09-16T03:22:40.662 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:22:40.663+0000 7ff19cb94640 -1 AuthRegistry(0x7ff1980697d0) no keyring found at /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin, disabling cephx 2024-09-16T03:22:40.663 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:22:40.663+0000 7ff19cb94640 -1 auth: unable to find a keyring on /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin: (2) No such file or directory 2024-09-16T03:22:40.663 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:22:40.663+0000 7ff19cb94640 -1 AuthRegistry(0x7ff19cb92f50) no keyring found at /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin, disabling cephx 2024-09-16T03:22:43.667 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:22:43.667+0000 7ff19cb94640 -1 auth: unable to find a keyring on /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin: (2) No such file or directory 2024-09-16T03:22:43.667 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:22:43.667+0000 7ff19cb94640 -1 AuthRegistry(0x7ff198066b60) no keyring found at /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin, disabling cephx 2024-09-16T03:22:43.667 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:22:43.667+0000 7ff19cb94640 -1 auth: unable to find a keyring on /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin: (2) No such file or directory 2024-09-16T03:22:43.667 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:22:43.667+0000 7ff19cb94640 -1 AuthRegistry(0x7ff198103610) no keyring found at /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin, disabling cephx 2024-09-16T03:22:43.668 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:22:43.667+0000 7ff19cb94640 -1 auth: unable to find a keyring on /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin: (2) No such file or directory 2024-09-16T03:22:43.668 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:22:43.667+0000 7ff19cb94640 -1 AuthRegistry(0x7ff198066b60) no keyring found at /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin, disabling cephx 2024-09-16T03:22:43.787 INFO:tasks.workunit.client.0.smithi096.stdout:e1: 2 mons at {a=v2:127.0.0.1:7300/0,b=v2:127.0.0.1:7301/0} removed_ranks: {} disallowed_leaders: {}, election epoch 4, leader 0 a, quorum 0,1 a,b 2024-09-16T03:22:43.803 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-handle-forward.sh:39: run: grep '"peon"' 2024-09-16T03:22:43.804 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-handle-forward.sh:38: run: get_asok_path mon.b 2024-09-16T03:22:43.804 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.b 2024-09-16T03:22:43.804 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.b ']' 2024-09-16T03:22:43.804 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:22:43.804 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:22:43.804 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.47139 2024-09-16T03:22:43.804 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.47139/ceph-mon.b.asok 2024-09-16T03:22:43.804 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-handle-forward.sh:38: run: ceph --admin-daemon /tmp/ceph-asok.47139/ceph-mon.b.asok mon_status 2024-09-16T03:22:44.006 INFO:tasks.workunit.client.0.smithi096.stdout: "state": "peon", 2024-09-16T03:22:44.006 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-handle-forward.sh:41: run: ceph --mon-host-override 127.0.0.1:7300 osd pool create POOL1 12 2024-09-16T03:22:44.121 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:22:44.119+0000 7f367524f640 -1 auth: unable to find a keyring on /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin: (2) No such file or directory 2024-09-16T03:22:44.121 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:22:44.119+0000 7f367524f640 -1 AuthRegistry(0x7f36700697d0) no keyring found at /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin, disabling cephx 2024-09-16T03:22:44.122 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:22:44.123+0000 7f367524f640 -1 auth: unable to find a keyring on /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin: (2) No such file or directory 2024-09-16T03:22:44.122 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:22:44.123+0000 7f367524f640 -1 AuthRegistry(0x7f367524df50) no keyring found at /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin, disabling cephx 2024-09-16T03:22:44.124 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:22:44.123+0000 7f367524f640 -1 auth: unable to find a keyring on /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin: (2) No such file or directory 2024-09-16T03:22:44.124 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:22:44.123+0000 7f367524f640 -1 AuthRegistry(0x7f3670066b60) no keyring found at /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin, disabling cephx 2024-09-16T03:22:44.125 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:22:44.123+0000 7f367524f640 -1 auth: unable to find a keyring on /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin: (2) No such file or directory 2024-09-16T03:22:44.125 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:22:44.123+0000 7f367524f640 -1 AuthRegistry(0x7f36700fd910) no keyring found at /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin, disabling cephx 2024-09-16T03:22:44.125 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:22:44.123+0000 7f367524f640 -1 auth: unable to find a keyring on /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin: (2) No such file or directory 2024-09-16T03:22:44.125 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:22:44.123+0000 7f367524f640 -1 AuthRegistry(0x7f3670066b60) no keyring found at /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin, disabling cephx 2024-09-16T03:22:44.422 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'POOL1' already exists 2024-09-16T03:22:44.443 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-handle-forward.sh:42: run: get_asok_path mon.a 2024-09-16T03:22:44.443 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:22:44.443 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:22:44.443 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:22:44.443 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:22:44.443 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.47139 2024-09-16T03:22:44.443 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.47139/ceph-mon.a.asok 2024-09-16T03:22:44.444 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-handle-forward.sh:42: run: CEPH_ARGS= 2024-09-16T03:22:44.444 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-handle-forward.sh:42: run: ceph --admin-daemon /tmp/ceph-asok.47139/ceph-mon.a.asok log flush 2024-09-16T03:22:44.548 INFO:tasks.workunit.client.0.smithi096.stdout:{} 2024-09-16T03:22:44.562 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-handle-forward.sh:43: run: grep 'mon_command(.*"POOL1"' td/mon-handle-forward/mon.a.log 2024-09-16T03:22:44.564 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T03:22:44.187+0000 7f5578df3640 5 --2- v2:127.0.0.1:7300/0 >> 127.0.0.1:0/1942449210 conn(0x55d5c0576c00 0x55d5bf734100 crc :-1 s=READ_MESSAGE_COMPLETE pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_message received message m=0x55d5bf624e00 seq=6 from=client.? type=50 mon_command({"prefix": "osd pool create", "pool": "POOL1", "pg_num": 12} v 0) 2024-09-16T03:22:44.564 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T03:22:44.187+0000 7f557a5f6640 1 -- v2:127.0.0.1:7300/0 <== client.? 127.0.0.1:0/1942449210 6 ==== mon_command({"prefix": "osd pool create", "pool": "POOL1", "pg_num": 12} v 0) ==== 102+0+0 (crc 0 0 0) 0x55d5bf624e00 con 0x55d5c0576c00 2024-09-16T03:22:44.564 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T03:22:44.231+0000 7f557a5f6640 0 mon.a@0(leader) e1 handle_command mon_command({"prefix": "osd pool create", "pool": "POOL1", "pg_num": 12} v 0) 2024-09-16T03:22:44.564 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T03:22:44.231+0000 7f557a5f6640 10 mon.a@0(leader).paxosservice(osdmap 1..1) dispatch 0x55d5bf624e00 mon_command({"prefix": "osd pool create", "pool": "POOL1", "pg_num": 12} v 0) from client.? 127.0.0.1:0/1942449210 con 0x55d5c0576c00 2024-09-16T03:22:44.564 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T03:22:44.231+0000 7f557a5f6640 10 mon.a@0(leader).osd e1 preprocess_query mon_command({"prefix": "osd pool create", "pool": "POOL1", "pg_num": 12} v 0) from client.? 127.0.0.1:0/1942449210 2024-09-16T03:22:44.564 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T03:22:44.231+0000 7f557a5f6640 7 mon.a@0(leader).osd e1 prepare_update mon_command({"prefix": "osd pool create", "pool": "POOL1", "pg_num": 12} v 0) from client.? 127.0.0.1:0/1942449210 2024-09-16T03:22:44.564 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T03:22:44.371+0000 7f5578df3640 5 --2- v2:127.0.0.1:7300/0 >> 127.0.0.1:0/1942449210 conn(0x55d5c0576c00 0x55d5bf734100 crc :-1 s=READ_MESSAGE_COMPLETE pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_message received message m=0x55d5bf624c40 seq=7 from=client.? type=50 mon_command({"prefix": "osd pool create", "pool": "POOL1", "pg_num": 12} v 0) 2024-09-16T03:22:44.565 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T03:22:44.419+0000 7f557a5f6640 1 -- v2:127.0.0.1:7300/0 <== client.? 127.0.0.1:0/1942449210 7 ==== mon_command({"prefix": "osd pool create", "pool": "POOL1", "pg_num": 12} v 0) ==== 102+0+0 (crc 0 0 0) 0x55d5bf624c40 con 0x55d5c0576c00 2024-09-16T03:22:44.565 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T03:22:44.419+0000 7f557a5f6640 0 mon.a@0(leader) e1 handle_command mon_command({"prefix": "osd pool create", "pool": "POOL1", "pg_num": 12} v 0) 2024-09-16T03:22:44.565 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T03:22:44.419+0000 7f557a5f6640 10 mon.a@0(leader).paxosservice(osdmap 1..2) dispatch 0x55d5bf624c40 mon_command({"prefix": "osd pool create", "pool": "POOL1", "pg_num": 12} v 0) from client.? 127.0.0.1:0/1942449210 con 0x55d5c0576c00 2024-09-16T03:22:44.565 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T03:22:44.419+0000 7f557a5f6640 10 mon.a@0(leader).osd e2 preprocess_query mon_command({"prefix": "osd pool create", "pool": "POOL1", "pg_num": 12} v 0) from client.? 127.0.0.1:0/1942449210 2024-09-16T03:22:44.565 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T03:22:44.419+0000 7f557a5f6640 7 mon.a@0(leader).osd e2 prepare_update mon_command({"prefix": "osd pool create", "pool": "POOL1", "pg_num": 12} v 0) from client.? 127.0.0.1:0/1942449210 2024-09-16T03:22:44.566 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-handle-forward.sh:44: run: get_asok_path mon.b 2024-09-16T03:22:44.566 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.b 2024-09-16T03:22:44.566 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.b ']' 2024-09-16T03:22:44.566 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:22:44.566 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:22:44.566 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.47139 2024-09-16T03:22:44.567 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.47139/ceph-mon.b.asok 2024-09-16T03:22:44.567 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-handle-forward.sh:44: run: CEPH_ARGS= 2024-09-16T03:22:44.567 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-handle-forward.sh:44: run: ceph --admin-daemon /tmp/ceph-asok.47139/ceph-mon.b.asok log flush 2024-09-16T03:22:44.669 INFO:tasks.workunit.client.0.smithi096.stdout:{} 2024-09-16T03:22:44.682 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-handle-forward.sh:45: run: grep 'mon_command(.*"POOL1"' td/mon-handle-forward/mon.b.log 2024-09-16T03:22:44.683 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-handle-forward.sh:47: run: ceph --mon-host-override 127.0.0.1:7301 osd pool create POOL2 12 2024-09-16T03:22:44.789 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:22:44.787+0000 7f0f125a3640 -1 auth: unable to find a keyring on /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin: (2) No such file or directory 2024-09-16T03:22:44.790 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:22:44.787+0000 7f0f125a3640 -1 AuthRegistry(0x7f0f0c0697d0) no keyring found at /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin, disabling cephx 2024-09-16T03:22:44.790 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:22:44.791+0000 7f0f125a3640 -1 auth: unable to find a keyring on /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin: (2) No such file or directory 2024-09-16T03:22:44.790 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:22:44.791+0000 7f0f125a3640 -1 AuthRegistry(0x7f0f125a1f50) no keyring found at /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin, disabling cephx 2024-09-16T03:22:44.793 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:22:44.791+0000 7f0f125a3640 -1 auth: unable to find a keyring on /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin: (2) No such file or directory 2024-09-16T03:22:44.793 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:22:44.791+0000 7f0f125a3640 -1 AuthRegistry(0x7f0f0c066b60) no keyring found at /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin, disabling cephx 2024-09-16T03:22:44.793 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:22:44.791+0000 7f0f125a3640 -1 auth: unable to find a keyring on /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin: (2) No such file or directory 2024-09-16T03:22:44.793 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:22:44.791+0000 7f0f125a3640 -1 AuthRegistry(0x7f0f0c106000) no keyring found at /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin, disabling cephx 2024-09-16T03:22:44.793 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:22:44.791+0000 7f0f125a3640 -1 auth: unable to find a keyring on /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin: (2) No such file or directory 2024-09-16T03:22:44.793 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:22:44.791+0000 7f0f125a3640 -1 AuthRegistry(0x7f0f0c066b60) no keyring found at /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin, disabling cephx 2024-09-16T03:22:45.295 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'POOL2' already exists 2024-09-16T03:22:45.323 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-handle-forward.sh:48: run: get_asok_path mon.b 2024-09-16T03:22:45.323 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.b 2024-09-16T03:22:45.323 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.b ']' 2024-09-16T03:22:45.324 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:22:45.324 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:22:45.324 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.47139 2024-09-16T03:22:45.324 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.47139/ceph-mon.b.asok 2024-09-16T03:22:45.324 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-handle-forward.sh:48: run: CEPH_ARGS= 2024-09-16T03:22:45.324 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-handle-forward.sh:48: run: ceph --admin-daemon /tmp/ceph-asok.47139/ceph-mon.b.asok log flush 2024-09-16T03:22:45.433 INFO:tasks.workunit.client.0.smithi096.stdout:{} 2024-09-16T03:22:45.446 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-handle-forward.sh:49: run: grep 'forward_request.*mon_command(.*"POOL2"' td/mon-handle-forward/mon.b.log 2024-09-16T03:22:45.447 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T03:22:44.855+0000 7f1f56266640 10 mon.b@1(peon) e1 forward_request 5 request mon_command({"prefix": "osd pool create", "pool": "POOL2", "pg_num": 12} v 0) features 4540719139924082687 2024-09-16T03:22:45.448 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T03:22:45.247+0000 7f1f56266640 10 mon.b@1(peon) e1 forward_request 7 request mon_command({"prefix": "osd pool create", "pool": "POOL2", "pg_num": 12} v 0) features 4540719139924082687 2024-09-16T03:22:45.449 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-handle-forward.sh:50: run: get_asok_path mon.a 2024-09-16T03:22:45.449 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:22:45.449 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:22:45.449 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:22:45.449 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:22:45.450 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.47139 2024-09-16T03:22:45.450 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.47139/ceph-mon.a.asok 2024-09-16T03:22:45.450 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-handle-forward.sh:50: run: CEPH_ARGS= 2024-09-16T03:22:45.450 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-handle-forward.sh:50: run: ceph --admin-daemon /tmp/ceph-asok.47139/ceph-mon.a.asok log flush 2024-09-16T03:22:45.548 INFO:tasks.workunit.client.0.smithi096.stdout:{} 2024-09-16T03:22:45.561 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-handle-forward.sh:51: run: grep ' forward(mon_command(.*"POOL2"' td/mon-handle-forward/mon.a.log 2024-09-16T03:22:45.563 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T03:22:44.855+0000 7f557e5fe640 5 --2- v2:127.0.0.1:7300/0 >> v2:127.0.0.1:7301/0 conn(0x55d5c0522800 0x55d5bf732b00 crc :-1 s=READ_MESSAGE_COMPLETE pgs=3 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_message received message m=0x55d5bf709900 seq=47 from=mon.1 type=46 forward(mon_command({"prefix": "osd pool create", "pool": "POOL2", "pg_num": 12} v 0) caps allow * tid 5 con_features 4540719139924082687) 2024-09-16T03:22:45.564 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T03:22:44.855+0000 7f557a5f6640 1 -- v2:127.0.0.1:7300/0 <== mon.1 v2:127.0.0.1:7301/0 47 ==== forward(mon_command({"prefix": "osd pool create", "pool": "POOL2", "pg_num": 12} v 0) caps allow * tid 5 con_features 4540719139924082687) ==== 302+0+0 (crc 0 0 0) 0x55d5bf709900 con 0x55d5c0522800 2024-09-16T03:22:45.564 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T03:22:45.247+0000 7f557e5fe640 5 --2- v2:127.0.0.1:7300/0 >> v2:127.0.0.1:7301/0 conn(0x55d5c0522800 0x55d5bf732b00 crc :-1 s=READ_MESSAGE_COMPLETE pgs=3 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_message received message m=0x55d5c0714500 seq=53 from=mon.1 type=46 forward(mon_command({"prefix": "osd pool create", "pool": "POOL2", "pg_num": 12} v 0) caps allow * tid 7 con_features 4540719139924082687) 2024-09-16T03:22:45.564 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T03:22:45.271+0000 7f557a5f6640 1 -- v2:127.0.0.1:7300/0 <== mon.1 v2:127.0.0.1:7301/0 53 ==== forward(mon_command({"prefix": "osd pool create", "pool": "POOL2", "pg_num": 12} v 0) caps allow * tid 7 con_features 4540719139924082687) ==== 302+0+0 (crc 0 0 0) 0x55d5c0714500 con 0x55d5c0522800 2024-09-16T03:22:45.564 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-handle-forward.sh:54: run: sed -n -e 's|.*127.0.0.1:0.*accept features \([0-9][0-9]*\)|\1|p' 2024-09-16T03:22:45.573 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-handle-forward.sh:54: run: features= 2024-09-16T03:22:45.573 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-handle-forward.sh:55: run: grep ' forward(mon_command(.*"POOL2".*con_features ' td/mon-handle-forward/mon.a.log 2024-09-16T03:22:45.575 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T03:22:44.855+0000 7f557e5fe640 5 --2- v2:127.0.0.1:7300/0 >> v2:127.0.0.1:7301/0 conn(0x55d5c0522800 0x55d5bf732b00 crc :-1 s=READ_MESSAGE_COMPLETE pgs=3 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_message received message m=0x55d5bf709900 seq=47 from=mon.1 type=46 forward(mon_command({"prefix": "osd pool create", "pool": "POOL2", "pg_num": 12} v 0) caps allow * tid 5 con_features 4540719139924082687) 2024-09-16T03:22:45.575 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T03:22:44.855+0000 7f557a5f6640 1 -- v2:127.0.0.1:7300/0 <== mon.1 v2:127.0.0.1:7301/0 47 ==== forward(mon_command({"prefix": "osd pool create", "pool": "POOL2", "pg_num": 12} v 0) caps allow * tid 5 con_features 4540719139924082687) ==== 302+0+0 (crc 0 0 0) 0x55d5bf709900 con 0x55d5c0522800 2024-09-16T03:22:45.575 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T03:22:45.247+0000 7f557e5fe640 5 --2- v2:127.0.0.1:7300/0 >> v2:127.0.0.1:7301/0 conn(0x55d5c0522800 0x55d5bf732b00 crc :-1 s=READ_MESSAGE_COMPLETE pgs=3 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_message received message m=0x55d5c0714500 seq=53 from=mon.1 type=46 forward(mon_command({"prefix": "osd pool create", "pool": "POOL2", "pg_num": 12} v 0) caps allow * tid 7 con_features 4540719139924082687) 2024-09-16T03:22:45.575 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T03:22:45.271+0000 7f557a5f6640 1 -- v2:127.0.0.1:7300/0 <== mon.1 v2:127.0.0.1:7301/0 53 ==== forward(mon_command({"prefix": "osd pool create", "pool": "POOL2", "pg_num": 12} v 0) caps allow * tid 7 con_features 4540719139924082687) ==== 302+0+0 (crc 0 0 0) 0x55d5c0714500 con 0x55d5c0522800 2024-09-16T03:22:45.576 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-handle-forward.sh:57: run: teardown td/mon-handle-forward 2024-09-16T03:22:45.576 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/mon-handle-forward 2024-09-16T03:22:45.576 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:22:45.577 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/mon-handle-forward KILL 2024-09-16T03:22:45.577 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:22:45.577 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:22:45.577 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:22:45.577 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:22:45.577 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:22:45.684 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:22:45.684 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:22:45.685 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:22:45.685 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:22:45.687 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:22:45.687 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:22:45.687 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:22:45.688 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:22:45.688 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:22:45.689 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:22:45.689 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:22:45.689 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:22:45.691 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:22:45.691 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/mon-handle-forward 2024-09-16T03:22:45.693 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:22:45.694 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:22:45.694 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.47139 2024-09-16T03:22:45.694 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.47139 2024-09-16T03:22:45.696 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:22:45.696 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:22:45.696 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2322: main: code=0 2024-09-16T03:22:45.696 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2326: main: teardown td/mon-handle-forward 0 2024-09-16T03:22:45.696 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/mon-handle-forward 2024-09-16T03:22:45.697 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2024-09-16T03:22:45.697 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/mon-handle-forward KILL 2024-09-16T03:22:45.697 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:22:45.697 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:22:45.697 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:22:45.697 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:22:45.697 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:22:45.698 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:22:45.698 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:22:45.699 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:22:45.699 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:22:45.701 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:22:45.701 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:22:45.701 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:22:45.702 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:22:45.702 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:22:45.703 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:22:45.703 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:22:45.703 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:22:45.705 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2024-09-16T03:22:45.705 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/mon-handle-forward 2024-09-16T03:22:45.706 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:22:45.706 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:22:45.706 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.47139 2024-09-16T03:22:45.706 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.47139 2024-09-16T03:22:45.708 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:22:45.708 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:22:45.708 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2327: main: return 0 2024-09-16T03:22:45.709 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-16T03:22:45.709 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-16T03:22:45.766 INFO:tasks.workunit:Running workunit mon/mon-last-epoch-clean.sh... 2024-09-16T03:22:45.766 DEBUG:teuthology.orchestra.run.smithi096:workunit test mon/mon-last-epoch-clean.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7498493279982dfe87f00616198a5967475f6169 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh 2024-09-16T03:22:45.821 INFO:tasks.workunit.client.0.smithi096.stderr:stty: 'standard input': Inappropriate ioctl for device 2024-09-16T03:22:45.827 INFO:tasks.workunit.client.0.smithi096.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2024-09-16T03:22:45.827 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2315: main: export PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-16T03:22:45.827 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2315: main: PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-16T03:22:45.827 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2316: main: export PYTHONWARNINGS=ignore 2024-09-16T03:22:45.828 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2316: main: PYTHONWARNINGS=ignore 2024-09-16T03:22:45.828 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2317: main: export CEPH_CONF=/dev/null 2024-09-16T03:22:45.828 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2317: main: CEPH_CONF=/dev/null 2024-09-16T03:22:45.828 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2318: main: unset CEPH_ARGS 2024-09-16T03:22:45.828 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2320: main: local code 2024-09-16T03:22:45.828 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2321: main: run td/mon-last-clean-epoch 2024-09-16T03:22:45.829 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:7: run: local dir=td/mon-last-clean-epoch 2024-09-16T03:22:45.829 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:8: run: shift 2024-09-16T03:22:45.829 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:10: run: export CEPH_MON=127.0.0.1:7302 2024-09-16T03:22:45.829 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:10: run: CEPH_MON=127.0.0.1:7302 2024-09-16T03:22:45.829 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:11: run: export CEPH_ARGS 2024-09-16T03:22:45.829 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:12: run: uuidgen 2024-09-16T03:22:45.831 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:12: run: CEPH_ARGS+='--fsid=b3030d7e-4989-4f9f-a16f-63e0a549ceae --auth-supported=none ' 2024-09-16T03:22:45.831 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:13: run: CEPH_ARGS+='--mon-host=127.0.0.1:7302 ' 2024-09-16T03:22:45.831 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:15: run: set 2024-09-16T03:22:45.832 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:15: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2024-09-16T03:22:45.832 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:15: run: local funcs=TEST_mon_last_clean_epoch 2024-09-16T03:22:45.832 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:16: run: for func in $funcs 2024-09-16T03:22:45.832 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:17: run: setup td/mon-last-clean-epoch 2024-09-16T03:22:45.832 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/mon-last-clean-epoch 2024-09-16T03:22:45.832 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/mon-last-clean-epoch 2024-09-16T03:22:45.832 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/mon-last-clean-epoch 2024-09-16T03:22:45.832 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:22:45.832 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/mon-last-clean-epoch KILL 2024-09-16T03:22:45.832 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:22:45.832 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:22:45.832 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:22:45.833 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:22:45.833 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:22:45.833 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:22:45.834 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:22:45.834 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:22:45.835 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:22:45.836 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:22:45.837 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:22:45.837 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:22:45.838 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:22:45.838 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:22:45.838 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:22:45.838 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:22:45.839 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:22:45.840 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:22:45.840 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/mon-last-clean-epoch 2024-09-16T03:22:45.841 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:22:45.842 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:22:45.842 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.47455 2024-09-16T03:22:45.842 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.47455 2024-09-16T03:22:45.843 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:22:45.843 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:22:45.843 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/mon-last-clean-epoch 2024-09-16T03:22:45.844 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T03:22:45.844 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:22:45.845 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.47455 2024-09-16T03:22:45.845 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.47455 2024-09-16T03:22:45.848 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T03:22:45.848 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2024-09-16T03:22:45.848 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2024-09-16T03:22:45.848 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T03:22:45.848 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/mon-last-clean-epoch 1' TERM HUP INT 2024-09-16T03:22:45.848 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:18: run: TEST_mon_last_clean_epoch td/mon-last-clean-epoch 2024-09-16T03:22:45.848 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:173: TEST_mon_last_clean_epoch: local dir=td/mon-last-clean-epoch 2024-09-16T03:22:45.848 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:175: TEST_mon_last_clean_epoch: run_mon td/mon-last-clean-epoch a 2024-09-16T03:22:45.849 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/mon-last-clean-epoch 2024-09-16T03:22:45.849 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T03:22:45.849 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T03:22:45.849 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T03:22:45.849 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/mon-last-clean-epoch/a 2024-09-16T03:22:45.849 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/mon-last-clean-epoch/a --run-dir=td/mon-last-clean-epoch 2024-09-16T03:22:46.332 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T03:22:46.332 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:22:46.332 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:22:46.333 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:22:46.333 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:22:46.333 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.47455 2024-09-16T03:22:46.333 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.47455/$cluster-$name.asok' 2024-09-16T03:22:46.333 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/mon-last-clean-epoch/a '--log-file=td/mon-last-clean-epoch/$name.log' '--admin-socket=/tmp/ceph-asok.47455/$cluster-$name.asok' --mon-cluster-log-file=td/mon-last-clean-epoch/log --run-dir=td/mon-last-clean-epoch '--pid-file=td/mon-last-clean-epoch/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-09-16T03:22:46.552 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T03:22:46.553 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T03:22:46.553 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:22:46.553 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:22:46.553 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T03:22:46.554 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T03:22:46.554 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:22:46.554 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:22:46.555 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:22:46.555 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:22:46.555 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:22:46.555 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.47455 2024-09-16T03:22:46.555 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.47455/ceph-mon.a.asok 2024-09-16T03:22:46.555 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:22:46.555 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.47455/ceph-mon.a.asok config get fsid 2024-09-16T03:22:46.673 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T03:22:46.674 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:22:46.674 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:22:46.674 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T03:22:46.674 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T03:22:46.674 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:22:46.674 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:22:46.674 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:22:46.675 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:22:46.675 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:22:46.675 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.47455 2024-09-16T03:22:46.675 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.47455/ceph-mon.a.asok 2024-09-16T03:22:46.675 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:22:46.675 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.47455/ceph-mon.a.asok config get mon_host 2024-09-16T03:22:46.785 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:176: TEST_mon_last_clean_epoch: run_mgr td/mon-last-clean-epoch x --mon-warn-on-pool-no-app=false 2024-09-16T03:22:46.785 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/mon-last-clean-epoch 2024-09-16T03:22:46.786 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2024-09-16T03:22:46.786 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2024-09-16T03:22:46.786 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2024-09-16T03:22:46.786 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/mon-last-clean-epoch/x 2024-09-16T03:22:46.786 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2024-09-16T03:22:47.684 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2024-09-16T03:22:47.685 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:22:47.685 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:22:47.685 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:22:47.685 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:22:47.685 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.47455 2024-09-16T03:22:47.685 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.47455/$cluster-$name.asok' 2024-09-16T03:22:47.686 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T03:22:47.687 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/mon-last-clean-epoch/x '--log-file=td/mon-last-clean-epoch/$name.log' '--admin-socket=/tmp/ceph-asok.47455/$cluster-$name.asok' --run-dir=td/mon-last-clean-epoch '--pid-file=td/mon-last-clean-epoch/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr --mon-warn-on-pool-no-app=false 2024-09-16T03:22:47.721 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:177: TEST_mon_last_clean_epoch: run_osd td/mon-last-clean-epoch 0 2024-09-16T03:22:47.722 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/mon-last-clean-epoch 2024-09-16T03:22:47.722 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T03:22:47.722 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2024-09-16T03:22:47.722 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T03:22:47.722 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/mon-last-clean-epoch/0 2024-09-16T03:22:47.722 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=b3030d7e-4989-4f9f-a16f-63e0a549ceae --auth-supported=none --mon-host=127.0.0.1:7302 ' 2024-09-16T03:22:47.722 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T03:22:47.722 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T03:22:47.722 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T03:22:47.722 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/mon-last-clean-epoch/0' 2024-09-16T03:22:47.722 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/mon-last-clean-epoch/0/journal' 2024-09-16T03:22:47.722 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T03:22:47.723 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T03:22:47.723 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/mon-last-clean-epoch' 2024-09-16T03:22:47.723 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T03:22:47.723 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:22:47.723 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:22:47.723 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:22:47.723 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:22:47.723 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.47455 2024-09-16T03:22:47.723 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.47455/$cluster-$name.asok' 2024-09-16T03:22:47.723 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.47455/$cluster-$name.asok' 2024-09-16T03:22:47.723 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T03:22:47.723 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T03:22:47.723 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T03:22:47.723 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/mon-last-clean-epoch/$name.log' 2024-09-16T03:22:47.724 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/mon-last-clean-epoch/$name.pid' 2024-09-16T03:22:47.724 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T03:22:47.724 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T03:22:47.724 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T03:22:47.724 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T03:22:47.724 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T03:22:47.724 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T03:22:47.724 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/mon-last-clean-epoch/0 2024-09-16T03:22:47.725 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T03:22:47.725 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6 2024-09-16T03:22:47.725 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6' 2024-09-16T03:22:47.725 INFO:tasks.workunit.client.0.smithi096.stdout:add osd0 64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6 2024-09-16T03:22:47.725 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T03:22:47.740 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCHpOdmz+lKLBAAxL5RP+axayCX3h8QR97kPA== 2024-09-16T03:22:47.740 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCHpOdmz+lKLBAAxL5RP+axayCX3h8QR97kPA=="}' 2024-09-16T03:22:47.740 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6 -i td/mon-last-clean-epoch/0/new.json 2024-09-16T03:22:48.032 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T03:22:48.045 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/mon-last-clean-epoch/0/new.json 2024-09-16T03:22:48.046 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=b3030d7e-4989-4f9f-a16f-63e0a549ceae --auth-supported=none --mon-host=127.0.0.1:7302 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/mon-last-clean-epoch/0 --osd-journal=td/mon-last-clean-epoch/0/journal --chdir= --run-dir=td/mon-last-clean-epoch '--admin-socket=/tmp/ceph-asok.47455/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/mon-last-clean-epoch/$name.log' '--pid-file=td/mon-last-clean-epoch/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCHpOdmz+lKLBAAxL5RP+axayCX3h8QR97kPA== --osd-uuid 64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6 2024-09-16T03:22:48.071 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:22:48.071+0000 7f1f7e86b7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:22:48.099 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:22:48.099+0000 7f1f7e86b7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:22:48.100 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:22:48.099+0000 7f1f7e86b7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:22:48.100 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:22:48.099+0000 7f1f7e86b7c0 -1 bdev(0x55dbcd797c00 td/mon-last-clean-epoch/0/block) open stat got: (1) Operation not permitted 2024-09-16T03:22:48.101 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:22:48.099+0000 7f1f7e86b7c0 -1 bluestore(td/mon-last-clean-epoch/0) _read_fsid unparsable uuid 2024-09-16T03:22:54.324 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/mon-last-clean-epoch/0/keyring 2024-09-16T03:22:54.324 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T03:22:54.325 INFO:tasks.workunit.client.0.smithi096.stdout:adding osd0 key to auth repository 2024-09-16T03:22:54.326 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2024-09-16T03:22:54.326 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/mon-last-clean-epoch/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T03:22:54.888 INFO:tasks.workunit.client.0.smithi096.stdout:start osd.0 2024-09-16T03:22:54.889 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2024-09-16T03:22:54.889 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=b3030d7e-4989-4f9f-a16f-63e0a549ceae --auth-supported=none --mon-host=127.0.0.1:7302 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/mon-last-clean-epoch/0 --osd-journal=td/mon-last-clean-epoch/0/journal --chdir= --run-dir=td/mon-last-clean-epoch '--admin-socket=/tmp/ceph-asok.47455/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/mon-last-clean-epoch/$name.log' '--pid-file=td/mon-last-clean-epoch/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T03:22:54.889 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T03:22:54.889 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T03:22:54.889 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T03:22:54.917 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:22:54.915+0000 7f1b9ac827c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:22:54.953 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:22:54.951+0000 7f1b9ac827c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:22:54.955 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:22:54.955+0000 7f1b9ac827c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:22:55.388 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2024-09-16T03:22:55.388 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:22:55.388 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2024-09-16T03:22:55.389 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T03:22:55.389 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:22:55.389 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:22:55.389 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:22:55.389 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:22:55.390 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:22:55.390 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:22:55.890 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:22:56.253 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:22:56.251+0000 7f1b9ac827c0 -1 Falling back to public interface 2024-09-16T03:22:56.892 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:22:56.892 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:22:56.893 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T03:22:56.893 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T03:22:56.893 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:22:56.893 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:22:57.349 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:22:58.351 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:22:58.351 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:22:58.351 INFO:tasks.workunit.client.0.smithi096.stdout:2 2024-09-16T03:22:58.352 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T03:22:58.352 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:22:58.352 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:22:58.789 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:22:59.125 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:22:59.123+0000 7f1b9ac827c0 -1 osd.0 0 log_to_monitors true 2024-09-16T03:22:59.791 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:22:59.791 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:22:59.791 INFO:tasks.workunit.client.0.smithi096.stdout:3 2024-09-16T03:22:59.792 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T03:22:59.792 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:22:59.792 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:23:00.513 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:23:01.514 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:23:01.515 INFO:tasks.workunit.client.0.smithi096.stdout:4 2024-09-16T03:23:01.515 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:23:01.515 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T03:23:01.515 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:23:01.515 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:23:01.952 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:23:02.965 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:23:02.965 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:23:02.965 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T03:23:02.965 INFO:tasks.workunit.client.0.smithi096.stdout:5 2024-09-16T03:23:02.966 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:23:02.966 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:23:03.386 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:23:04.388 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:23:04.388 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:23:04.389 INFO:tasks.workunit.client.0.smithi096.stdout:6 2024-09-16T03:23:04.389 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T03:23:04.389 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:23:04.389 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:23:04.820 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:23:05.821 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:23:05.821 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:23:05.822 INFO:tasks.workunit.client.0.smithi096.stdout:7 2024-09-16T03:23:05.822 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T03:23:05.822 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:23:05.822 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:23:06.259 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:23:07.261 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:23:07.262 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:23:07.262 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T03:23:07.262 INFO:tasks.workunit.client.0.smithi096.stdout:8 2024-09-16T03:23:07.262 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:23:07.262 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:23:07.698 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:23:08.700 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:23:08.701 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:23:08.701 INFO:tasks.workunit.client.0.smithi096.stdout:9 2024-09-16T03:23:08.702 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T03:23:08.702 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:23:08.702 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:23:09.280 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:23:10.282 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:23:10.282 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:23:10.282 INFO:tasks.workunit.client.0.smithi096.stdout:10 2024-09-16T03:23:10.283 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T03:23:10.283 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:23:10.283 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:23:10.725 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:23:11.727 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:23:11.727 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:23:11.727 INFO:tasks.workunit.client.0.smithi096.stdout:11 2024-09-16T03:23:11.728 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T03:23:11.728 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:23:11.728 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:23:12.565 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:23:13.566 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:23:13.567 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:23:13.567 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T03:23:13.567 INFO:tasks.workunit.client.0.smithi096.stdout:12 2024-09-16T03:23:13.567 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:23:13.568 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:23:14.383 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:23:15.385 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:23:15.385 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:23:15.385 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T03:23:15.386 INFO:tasks.workunit.client.0.smithi096.stdout:13 2024-09-16T03:23:15.386 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:23:15.386 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:23:16.709 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:23:17.711 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:23:17.711 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:23:17.711 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T03:23:17.711 INFO:tasks.workunit.client.0.smithi096.stdout:14 2024-09-16T03:23:17.712 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:23:17.712 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:23:18.681 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:23:19.683 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:23:19.683 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:23:19.683 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T03:23:19.684 INFO:tasks.workunit.client.0.smithi096.stdout:15 2024-09-16T03:23:19.684 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:23:19.684 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:23:20.367 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:23:21.369 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:23:21.369 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:23:21.369 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T03:23:21.370 INFO:tasks.workunit.client.0.smithi096.stdout:16 2024-09-16T03:23:21.370 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:23:21.370 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:23:22.396 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:23:23.397 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:23:23.397 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:23:23.398 INFO:tasks.workunit.client.0.smithi096.stdout:17 2024-09-16T03:23:23.398 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T03:23:23.398 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:23:23.398 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:23:23.834 INFO:tasks.workunit.client.0.smithi096.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448] [v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448] exists,up 64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6 2024-09-16T03:23:23.837 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:23:23.837 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:23:23.837 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:23:23.838 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:178: TEST_mon_last_clean_epoch: run_osd td/mon-last-clean-epoch 1 2024-09-16T03:23:23.838 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/mon-last-clean-epoch 2024-09-16T03:23:23.838 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T03:23:23.838 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2024-09-16T03:23:23.838 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T03:23:23.838 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/mon-last-clean-epoch/1 2024-09-16T03:23:23.838 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=b3030d7e-4989-4f9f-a16f-63e0a549ceae --auth-supported=none --mon-host=127.0.0.1:7302 ' 2024-09-16T03:23:23.838 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T03:23:23.838 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T03:23:23.838 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T03:23:23.838 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/mon-last-clean-epoch/1' 2024-09-16T03:23:23.838 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/mon-last-clean-epoch/1/journal' 2024-09-16T03:23:23.839 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T03:23:23.839 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T03:23:23.839 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/mon-last-clean-epoch' 2024-09-16T03:23:23.839 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T03:23:23.839 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:23:23.839 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:23:23.839 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:23:23.839 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:23:23.839 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.47455 2024-09-16T03:23:23.839 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.47455/$cluster-$name.asok' 2024-09-16T03:23:23.839 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.47455/$cluster-$name.asok' 2024-09-16T03:23:23.839 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T03:23:23.840 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T03:23:23.840 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T03:23:23.840 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/mon-last-clean-epoch/$name.log' 2024-09-16T03:23:23.840 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/mon-last-clean-epoch/$name.pid' 2024-09-16T03:23:23.840 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T03:23:23.840 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T03:23:23.840 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T03:23:23.840 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T03:23:23.840 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T03:23:23.840 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T03:23:23.840 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/mon-last-clean-epoch/1 2024-09-16T03:23:23.841 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T03:23:23.841 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=74b26727-75c9-444d-8782-719e4197a382 2024-09-16T03:23:23.841 INFO:tasks.workunit.client.0.smithi096.stdout:add osd1 74b26727-75c9-444d-8782-719e4197a382 2024-09-16T03:23:23.842 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 74b26727-75c9-444d-8782-719e4197a382' 2024-09-16T03:23:23.842 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T03:23:23.854 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCrpOdmbuQaMxAAMTuMQalHpq0BthR6hWpQ/w== 2024-09-16T03:23:23.855 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCrpOdmbuQaMxAAMTuMQalHpq0BthR6hWpQ/w=="}' 2024-09-16T03:23:23.855 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 74b26727-75c9-444d-8782-719e4197a382 -i td/mon-last-clean-epoch/1/new.json 2024-09-16T03:23:24.320 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T03:23:24.335 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/mon-last-clean-epoch/1/new.json 2024-09-16T03:23:24.336 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=b3030d7e-4989-4f9f-a16f-63e0a549ceae --auth-supported=none --mon-host=127.0.0.1:7302 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/mon-last-clean-epoch/1 --osd-journal=td/mon-last-clean-epoch/1/journal --chdir= --run-dir=td/mon-last-clean-epoch '--admin-socket=/tmp/ceph-asok.47455/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/mon-last-clean-epoch/$name.log' '--pid-file=td/mon-last-clean-epoch/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCrpOdmbuQaMxAAMTuMQalHpq0BthR6hWpQ/w== --osd-uuid 74b26727-75c9-444d-8782-719e4197a382 2024-09-16T03:23:24.367 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:23:24.370+0000 7ffbbe44c7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:23:24.411 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:23:24.414+0000 7ffbbe44c7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:23:24.412 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:23:24.414+0000 7ffbbe44c7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:23:24.413 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:23:24.414+0000 7ffbbe44c7c0 -1 bdev(0x55d8c8f5bc00 td/mon-last-clean-epoch/1/block) open stat got: (1) Operation not permitted 2024-09-16T03:23:24.413 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:23:24.414+0000 7ffbbe44c7c0 -1 bluestore(td/mon-last-clean-epoch/1) _read_fsid unparsable uuid 2024-09-16T03:23:30.770 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/mon-last-clean-epoch/1/keyring 2024-09-16T03:23:30.770 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T03:23:30.771 INFO:tasks.workunit.client.0.smithi096.stdout:adding osd1 key to auth repository 2024-09-16T03:23:30.772 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2024-09-16T03:23:30.772 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/mon-last-clean-epoch/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T03:23:31.334 INFO:tasks.workunit.client.0.smithi096.stdout:start osd.1 2024-09-16T03:23:31.334 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2024-09-16T03:23:31.335 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=b3030d7e-4989-4f9f-a16f-63e0a549ceae --auth-supported=none --mon-host=127.0.0.1:7302 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/mon-last-clean-epoch/1 --osd-journal=td/mon-last-clean-epoch/1/journal --chdir= --run-dir=td/mon-last-clean-epoch '--admin-socket=/tmp/ceph-asok.47455/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/mon-last-clean-epoch/$name.log' '--pid-file=td/mon-last-clean-epoch/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T03:23:31.335 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T03:23:31.335 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T03:23:31.335 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T03:23:31.365 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:23:31.366+0000 7f168fad97c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:23:31.396 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:23:31.398+0000 7f168fad97c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:23:31.398 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:23:31.398+0000 7f168fad97c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:23:31.841 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2024-09-16T03:23:31.841 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:23:31.841 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2024-09-16T03:23:31.841 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T03:23:31.842 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:23:31.842 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:23:31.842 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:23:31.842 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:23:31.842 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:23:31.842 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:23:32.350 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:23:32.408 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:23:32.410+0000 7f168fad97c0 -1 Falling back to public interface 2024-09-16T03:23:33.352 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:23:33.352 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:23:33.352 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T03:23:33.352 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T03:23:33.353 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:23:33.353 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:23:33.810 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:23:34.811 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:23:34.811 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:23:34.811 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T03:23:34.812 INFO:tasks.workunit.client.0.smithi096.stdout:2 2024-09-16T03:23:34.812 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:23:34.812 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:23:35.311 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:23:35.341 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:23:35.341+0000 7f168fad97c0 -1 osd.1 0 log_to_monitors true 2024-09-16T03:23:36.312 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:23:36.313 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:23:36.313 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T03:23:36.313 INFO:tasks.workunit.client.0.smithi096.stdout:3 2024-09-16T03:23:36.313 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:23:36.313 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:23:36.775 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:23:37.777 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:23:37.777 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:23:37.777 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T03:23:37.777 INFO:tasks.workunit.client.0.smithi096.stdout:4 2024-09-16T03:23:37.778 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:23:37.778 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:23:38.291 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:23:39.292 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:23:39.293 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:23:39.293 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T03:23:39.293 INFO:tasks.workunit.client.0.smithi096.stdout:5 2024-09-16T03:23:39.293 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:23:39.293 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:23:39.757 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:23:40.759 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:23:40.759 INFO:tasks.workunit.client.0.smithi096.stdout:6 2024-09-16T03:23:40.759 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:23:40.760 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T03:23:40.760 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:23:40.760 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:23:41.230 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:23:42.231 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:23:42.231 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:23:42.232 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T03:23:42.232 INFO:tasks.workunit.client.0.smithi096.stdout:7 2024-09-16T03:23:42.232 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:23:42.232 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:23:42.696 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:23:43.698 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:23:43.698 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:23:43.698 INFO:tasks.workunit.client.0.smithi096.stdout:8 2024-09-16T03:23:43.699 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T03:23:43.699 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:23:43.699 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:23:44.283 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:23:45.285 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:23:45.286 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:23:45.286 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T03:23:45.286 INFO:tasks.workunit.client.0.smithi096.stdout:9 2024-09-16T03:23:45.287 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:23:45.287 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:23:45.733 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:23:46.734 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:23:46.735 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:23:46.735 INFO:tasks.workunit.client.0.smithi096.stdout:10 2024-09-16T03:23:46.735 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T03:23:46.735 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:23:46.736 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:23:47.162 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:23:48.163 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:23:48.164 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:23:48.164 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T03:23:48.164 INFO:tasks.workunit.client.0.smithi096.stdout:11 2024-09-16T03:23:48.164 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:23:48.164 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:23:48.942 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:23:49.943 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:23:49.943 INFO:tasks.workunit.client.0.smithi096.stdout:12 2024-09-16T03:23:49.944 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:23:49.944 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T03:23:49.944 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:23:49.944 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:23:50.725 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:23:51.726 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:23:51.726 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:23:51.727 INFO:tasks.workunit.client.0.smithi096.stdout:13 2024-09-16T03:23:51.727 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T03:23:51.727 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:23:51.727 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:23:52.415 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:23:53.417 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:23:53.417 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:23:53.417 INFO:tasks.workunit.client.0.smithi096.stdout:14 2024-09-16T03:23:53.418 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T03:23:53.418 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:23:53.418 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:23:53.963 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:23:54.965 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:23:54.965 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:23:54.965 INFO:tasks.workunit.client.0.smithi096.stdout:15 2024-09-16T03:23:54.966 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T03:23:54.966 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:23:54.966 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:23:56.105 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:23:57.106 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:23:57.106 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:23:57.107 INFO:tasks.workunit.client.0.smithi096.stdout:16 2024-09-16T03:23:57.107 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T03:23:57.107 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:23:57.107 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:23:58.051 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:23:59.052 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:23:59.053 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:23:59.053 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T03:23:59.053 INFO:tasks.workunit.client.0.smithi096.stdout:17 2024-09-16T03:23:59.054 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:23:59.054 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:23:59.951 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:24:00.953 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:24:00.953 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:24:00.953 INFO:tasks.workunit.client.0.smithi096.stdout:18 2024-09-16T03:24:00.954 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 18 2024-09-16T03:24:00.954 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:24:00.954 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:24:01.446 INFO:tasks.workunit.client.0.smithi096.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132] [v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132] exists,up 74b26727-75c9-444d-8782-719e4197a382 2024-09-16T03:24:01.449 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:24:01.449 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:24:01.449 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:24:01.449 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:179: TEST_mon_last_clean_epoch: run_osd td/mon-last-clean-epoch 2 2024-09-16T03:24:01.449 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/mon-last-clean-epoch 2024-09-16T03:24:01.449 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T03:24:01.449 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2024-09-16T03:24:01.449 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T03:24:01.449 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/mon-last-clean-epoch/2 2024-09-16T03:24:01.449 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=b3030d7e-4989-4f9f-a16f-63e0a549ceae --auth-supported=none --mon-host=127.0.0.1:7302 ' 2024-09-16T03:24:01.450 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T03:24:01.450 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T03:24:01.450 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T03:24:01.450 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/mon-last-clean-epoch/2' 2024-09-16T03:24:01.450 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/mon-last-clean-epoch/2/journal' 2024-09-16T03:24:01.450 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T03:24:01.450 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T03:24:01.450 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/mon-last-clean-epoch' 2024-09-16T03:24:01.450 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T03:24:01.450 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:24:01.450 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:24:01.450 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:24:01.450 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:24:01.450 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.47455 2024-09-16T03:24:01.452 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.47455/$cluster-$name.asok' 2024-09-16T03:24:01.452 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.47455/$cluster-$name.asok' 2024-09-16T03:24:01.452 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T03:24:01.452 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T03:24:01.453 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T03:24:01.453 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/mon-last-clean-epoch/$name.log' 2024-09-16T03:24:01.453 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/mon-last-clean-epoch/$name.pid' 2024-09-16T03:24:01.453 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T03:24:01.453 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T03:24:01.453 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T03:24:01.453 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T03:24:01.453 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T03:24:01.453 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T03:24:01.453 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/mon-last-clean-epoch/2 2024-09-16T03:24:01.453 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T03:24:01.453 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=143da3a7-dad9-4b1e-966b-76cf5bdd3c82 2024-09-16T03:24:01.453 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 143da3a7-dad9-4b1e-966b-76cf5bdd3c82' 2024-09-16T03:24:01.454 INFO:tasks.workunit.client.0.smithi096.stdout:add osd2 143da3a7-dad9-4b1e-966b-76cf5bdd3c82 2024-09-16T03:24:01.454 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T03:24:01.471 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDRpOdm91Q6HBAA2E0506dY1z6Oc/DRrp8O3A== 2024-09-16T03:24:01.471 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDRpOdm91Q6HBAA2E0506dY1z6Oc/DRrp8O3A=="}' 2024-09-16T03:24:01.471 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 143da3a7-dad9-4b1e-966b-76cf5bdd3c82 -i td/mon-last-clean-epoch/2/new.json 2024-09-16T03:24:01.996 INFO:tasks.workunit.client.0.smithi096.stdout:2 2024-09-16T03:24:02.013 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/mon-last-clean-epoch/2/new.json 2024-09-16T03:24:02.014 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=b3030d7e-4989-4f9f-a16f-63e0a549ceae --auth-supported=none --mon-host=127.0.0.1:7302 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/mon-last-clean-epoch/2 --osd-journal=td/mon-last-clean-epoch/2/journal --chdir= --run-dir=td/mon-last-clean-epoch '--admin-socket=/tmp/ceph-asok.47455/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/mon-last-clean-epoch/$name.log' '--pid-file=td/mon-last-clean-epoch/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDRpOdm91Q6HBAA2E0506dY1z6Oc/DRrp8O3A== --osd-uuid 143da3a7-dad9-4b1e-966b-76cf5bdd3c82 2024-09-16T03:24:02.051 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:24:02.053+0000 7eff8cc2d7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:24:02.054 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:24:02.053+0000 7eff8cc2d7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:24:02.055 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:24:02.057+0000 7eff8cc2d7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:24:02.055 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:24:02.057+0000 7eff8cc2d7c0 -1 bdev(0x56152eb01c00 td/mon-last-clean-epoch/2/block) open stat got: (1) Operation not permitted 2024-09-16T03:24:02.055 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:24:02.057+0000 7eff8cc2d7c0 -1 bluestore(td/mon-last-clean-epoch/2) _read_fsid unparsable uuid 2024-09-16T03:24:08.408 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/mon-last-clean-epoch/2/keyring 2024-09-16T03:24:08.408 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T03:24:08.410 INFO:tasks.workunit.client.0.smithi096.stdout:adding osd2 key to auth repository 2024-09-16T03:24:08.410 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2024-09-16T03:24:08.410 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/mon-last-clean-epoch/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T03:24:08.999 INFO:tasks.workunit.client.0.smithi096.stdout:start osd.2 2024-09-16T03:24:09.000 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2024-09-16T03:24:09.001 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=b3030d7e-4989-4f9f-a16f-63e0a549ceae --auth-supported=none --mon-host=127.0.0.1:7302 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/mon-last-clean-epoch/2 --osd-journal=td/mon-last-clean-epoch/2/journal --chdir= --run-dir=td/mon-last-clean-epoch '--admin-socket=/tmp/ceph-asok.47455/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/mon-last-clean-epoch/$name.log' '--pid-file=td/mon-last-clean-epoch/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T03:24:09.001 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T03:24:09.001 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T03:24:09.001 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T03:24:09.029 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:24:09.028+0000 7ff28ffd77c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:24:09.040 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:24:09.040+0000 7ff28ffd77c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:24:09.041 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:24:09.040+0000 7ff28ffd77c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:24:09.449 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2024-09-16T03:24:09.450 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:24:09.450 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2024-09-16T03:24:09.450 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:24:09.450 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:24:09.450 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:24:09.450 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T03:24:09.451 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:24:09.451 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:24:09.451 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:24:09.847 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:24:10.573 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:24:10.572+0000 7ff28ffd77c0 -1 Falling back to public interface 2024-09-16T03:24:10.848 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:24:10.848 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:24:10.849 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T03:24:10.849 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T03:24:10.849 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:24:10.849 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:24:11.339 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:24:12.341 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:24:12.341 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:24:12.341 INFO:tasks.workunit.client.0.smithi096.stdout:2 2024-09-16T03:24:12.342 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T03:24:12.342 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:24:12.342 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:24:12.800 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:24:13.390 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:24:13.388+0000 7ff28ffd77c0 -1 osd.2 0 log_to_monitors true 2024-09-16T03:24:13.802 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:24:13.802 INFO:tasks.workunit.client.0.smithi096.stdout:3 2024-09-16T03:24:13.802 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:24:13.802 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T03:24:13.803 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:24:13.803 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:24:14.237 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:24:15.239 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:24:15.239 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:24:15.239 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T03:24:15.239 INFO:tasks.workunit.client.0.smithi096.stdout:4 2024-09-16T03:24:15.240 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:24:15.240 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:24:15.834 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:24:16.835 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:24:16.836 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:24:16.836 INFO:tasks.workunit.client.0.smithi096.stdout:5 2024-09-16T03:24:16.836 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T03:24:16.837 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:24:16.837 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:24:17.516 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:24:18.518 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:24:18.518 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:24:18.518 INFO:tasks.workunit.client.0.smithi096.stdout:6 2024-09-16T03:24:18.519 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T03:24:18.519 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:24:18.519 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:24:19.101 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:24:20.103 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:24:20.103 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:24:20.103 INFO:tasks.workunit.client.0.smithi096.stdout:7 2024-09-16T03:24:20.103 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T03:24:20.104 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:24:20.104 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:24:20.547 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:24:21.548 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:24:21.549 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:24:21.549 INFO:tasks.workunit.client.0.smithi096.stdout:8 2024-09-16T03:24:21.549 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T03:24:21.550 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:24:21.550 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:24:21.988 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:24:22.989 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:24:22.989 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:24:22.990 INFO:tasks.workunit.client.0.smithi096.stdout:9 2024-09-16T03:24:22.990 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T03:24:22.990 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:24:22.990 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:24:23.444 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:24:24.445 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:24:24.446 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:24:24.446 INFO:tasks.workunit.client.0.smithi096.stdout:10 2024-09-16T03:24:24.446 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T03:24:24.447 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:24:24.447 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:24:24.886 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:24:25.887 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:24:25.888 INFO:tasks.workunit.client.0.smithi096.stdout:11 2024-09-16T03:24:25.888 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:24:25.888 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T03:24:25.889 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:24:25.889 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:24:26.358 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:24:27.360 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:24:27.360 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:24:27.361 INFO:tasks.workunit.client.0.smithi096.stdout:12 2024-09-16T03:24:27.361 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T03:24:27.361 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:24:27.361 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:24:28.175 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:24:29.176 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:24:29.176 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:24:29.176 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T03:24:29.177 INFO:tasks.workunit.client.0.smithi096.stdout:13 2024-09-16T03:24:29.177 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:24:29.177 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:24:30.221 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:24:31.223 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:24:31.223 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:24:31.223 INFO:tasks.workunit.client.0.smithi096.stdout:14 2024-09-16T03:24:31.223 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T03:24:31.224 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:24:31.224 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:24:31.742 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:24:32.744 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:24:32.744 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:24:32.744 INFO:tasks.workunit.client.0.smithi096.stdout:15 2024-09-16T03:24:32.745 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T03:24:32.745 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:24:32.745 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:24:33.616 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:24:34.617 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:24:34.618 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:24:34.618 INFO:tasks.workunit.client.0.smithi096.stdout:16 2024-09-16T03:24:34.618 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T03:24:34.618 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:24:34.619 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:24:35.449 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:24:36.450 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:24:36.451 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:24:36.451 INFO:tasks.workunit.client.0.smithi096.stdout:17 2024-09-16T03:24:36.451 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T03:24:36.451 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:24:36.451 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:24:37.409 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:24:38.411 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:24:38.411 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:24:38.411 INFO:tasks.workunit.client.0.smithi096.stdout:18 2024-09-16T03:24:38.412 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 18 2024-09-16T03:24:38.412 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:24:38.412 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:24:38.846 INFO:tasks.workunit.client.0.smithi096.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857] [v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857] exists,up 143da3a7-dad9-4b1e-966b-76cf5bdd3c82 2024-09-16T03:24:38.846 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:24:38.847 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:24:38.847 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:24:38.847 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:180: TEST_mon_last_clean_epoch: cat td/mon-last-clean-epoch/osd.2.pid 2024-09-16T03:24:38.848 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:180: TEST_mon_last_clean_epoch: osd_pid=52063 2024-09-16T03:24:38.848 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:182: TEST_mon_last_clean_epoch: sleep 5 2024-09-16T03:24:43.849 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:184: TEST_mon_last_clean_epoch: ceph tell 'osd.*' injectargs '--osd-beacon-report-interval 10' 2024-09-16T03:24:44.000 INFO:tasks.workunit.client.0.smithi096.stdout:osd.0: {} 2024-09-16T03:24:44.026 INFO:tasks.workunit.client.0.smithi096.stdout:osd.1: {} 2024-09-16T03:24:44.054 INFO:tasks.workunit.client.0.smithi096.stdout:osd.2: {} 2024-09-16T03:24:44.069 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:185: TEST_mon_last_clean_epoch: ceph tell 'mon.*' injectargs '--mon-min-osdmap-epochs 2 --paxos-service-trim-min 1' 2024-09-16T03:24:44.193 INFO:tasks.workunit.client.0.smithi096.stdout:{} 2024-09-16T03:24:44.207 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:188: TEST_mon_last_clean_epoch: create_pool foo 32 2024-09-16T03:24:44.207 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create foo 32 2024-09-16T03:24:44.858 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'foo' already exists 2024-09-16T03:24:44.874 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2024-09-16T03:24:45.877 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:189: TEST_mon_last_clean_epoch: create_pool bar 32 2024-09-16T03:24:45.877 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create bar 32 2024-09-16T03:24:46.994 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'bar' already exists 2024-09-16T03:24:47.016 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2024-09-16T03:24:48.019 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:191: TEST_mon_last_clean_epoch: get_pool_id foo 2024-09-16T03:24:48.019 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:141: get_pool_id: local pn=foo 2024-09-16T03:24:48.019 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:142: get_pool_id: [[ -z foo ]] 2024-09-16T03:24:48.020 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:144: get_pool_id: ceph report 2024-09-16T03:24:48.582 INFO:tasks.workunit.client.0.smithi096.stderr:report 993988843 2024-09-16T03:24:48.599 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:144: get_pool_id: report='{ 2024-09-16T03:24:48.599 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_fingerprint": "fda2fc64-07ed-4add-8224-2e527e11d427", 2024-09-16T03:24:48.600 INFO:tasks.workunit.client.0.smithi096.stderr: "version": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:24:48.600 INFO:tasks.workunit.client.0.smithi096.stderr: "commit": "fc3e0bff7468fd55478adbae7f75508b749124b6", 2024-09-16T03:24:48.600 INFO:tasks.workunit.client.0.smithi096.stderr: "timestamp": "2024-09-16T03:24:48.583852+0000", 2024-09-16T03:24:48.600 INFO:tasks.workunit.client.0.smithi096.stderr: "tag": "", 2024-09-16T03:24:48.600 INFO:tasks.workunit.client.0.smithi096.stderr: "health": { 2024-09-16T03:24:48.601 INFO:tasks.workunit.client.0.smithi096.stderr: "status": "HEALTH_OK", 2024-09-16T03:24:48.601 INFO:tasks.workunit.client.0.smithi096.stderr: "checks": {}, 2024-09-16T03:24:48.601 INFO:tasks.workunit.client.0.smithi096.stderr: "mutes": [] 2024-09-16T03:24:48.601 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.601 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap_first_committed": 1, 2024-09-16T03:24:48.601 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap_last_committed": 1, 2024-09-16T03:24:48.602 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap": { 2024-09-16T03:24:48.602 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 1, 2024-09-16T03:24:48.602 INFO:tasks.workunit.client.0.smithi096.stderr: "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", 2024-09-16T03:24:48.602 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:22:45.872880Z", 2024-09-16T03:24:48.602 INFO:tasks.workunit.client.0.smithi096.stderr: "created": "2024-09-16T03:22:45.872880Z", 2024-09-16T03:24:48.602 INFO:tasks.workunit.client.0.smithi096.stderr: "min_mon_release": 19, 2024-09-16T03:24:48.603 INFO:tasks.workunit.client.0.smithi096.stderr: "min_mon_release_name": "squid", 2024-09-16T03:24:48.603 INFO:tasks.workunit.client.0.smithi096.stderr: "election_strategy": 1, 2024-09-16T03:24:48.603 INFO:tasks.workunit.client.0.smithi096.stderr: "disallowed_leaders: ": "", 2024-09-16T03:24:48.603 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode": false, 2024-09-16T03:24:48.604 INFO:tasks.workunit.client.0.smithi096.stderr: "tiebreaker_mon": "", 2024-09-16T03:24:48.604 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_ranks: ": "", 2024-09-16T03:24:48.604 INFO:tasks.workunit.client.0.smithi096.stderr: "features": { 2024-09-16T03:24:48.604 INFO:tasks.workunit.client.0.smithi096.stderr: "persistent": [ 2024-09-16T03:24:48.604 INFO:tasks.workunit.client.0.smithi096.stderr: "kraken", 2024-09-16T03:24:48.605 INFO:tasks.workunit.client.0.smithi096.stderr: "luminous", 2024-09-16T03:24:48.605 INFO:tasks.workunit.client.0.smithi096.stderr: "mimic", 2024-09-16T03:24:48.605 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap-prune", 2024-09-16T03:24:48.605 INFO:tasks.workunit.client.0.smithi096.stderr: "nautilus", 2024-09-16T03:24:48.605 INFO:tasks.workunit.client.0.smithi096.stderr: "octopus", 2024-09-16T03:24:48.605 INFO:tasks.workunit.client.0.smithi096.stderr: "pacific", 2024-09-16T03:24:48.606 INFO:tasks.workunit.client.0.smithi096.stderr: "elector-pinging", 2024-09-16T03:24:48.606 INFO:tasks.workunit.client.0.smithi096.stderr: "quincy", 2024-09-16T03:24:48.606 INFO:tasks.workunit.client.0.smithi096.stderr: "reef", 2024-09-16T03:24:48.606 INFO:tasks.workunit.client.0.smithi096.stderr: "squid" 2024-09-16T03:24:48.606 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:48.606 INFO:tasks.workunit.client.0.smithi096.stderr: "optional": [] 2024-09-16T03:24:48.606 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.606 INFO:tasks.workunit.client.0.smithi096.stderr: "mons": [ 2024-09-16T03:24:48.607 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:48.607 INFO:tasks.workunit.client.0.smithi096.stderr: "rank": 0, 2024-09-16T03:24:48.607 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "a", 2024-09-16T03:24:48.608 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:24:48.608 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:48.608 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:48.608 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:48.608 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:7302", 2024-09-16T03:24:48.608 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 0 2024-09-16T03:24:48.609 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:48.609 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:48.609 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.609 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:7302/0", 2024-09-16T03:24:48.609 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:7302/0", 2024-09-16T03:24:48.609 INFO:tasks.workunit.client.0.smithi096.stderr: "priority": 0, 2024-09-16T03:24:48.609 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 0, 2024-09-16T03:24:48.610 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_location": "{}" 2024-09-16T03:24:48.610 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:48.610 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:48.610 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.610 INFO:tasks.workunit.client.0.smithi096.stderr: "quorum": [ 2024-09-16T03:24:48.610 INFO:tasks.workunit.client.0.smithi096.stderr: 0 2024-09-16T03:24:48.610 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:48.610 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap": { 2024-09-16T03:24:48.610 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 24, 2024-09-16T03:24:48.611 INFO:tasks.workunit.client.0.smithi096.stderr: "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", 2024-09-16T03:24:48.611 INFO:tasks.workunit.client.0.smithi096.stderr: "created": "2024-09-16T03:22:46.906117+0000", 2024-09-16T03:24:48.611 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:24:47.805467+0000", 2024-09-16T03:24:48.611 INFO:tasks.workunit.client.0.smithi096.stderr: "last_up_change": "2024-09-16T03:24:37.708512+0000", 2024-09-16T03:24:48.611 INFO:tasks.workunit.client.0.smithi096.stderr: "last_in_change": "2024-09-16T03:24:01.831039+0000", 2024-09-16T03:24:48.611 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-16T03:24:48.611 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_num": 5799936, 2024-09-16T03:24:48.611 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_set": [ 2024-09-16T03:24:48.612 INFO:tasks.workunit.client.0.smithi096.stderr: "pglog_hardlimit", 2024-09-16T03:24:48.612 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snapdirs", 2024-09-16T03:24:48.612 INFO:tasks.workunit.client.0.smithi096.stderr: "recovery_deletes", 2024-09-16T03:24:48.612 INFO:tasks.workunit.client.0.smithi096.stderr: "sortbitwise" 2024-09-16T03:24:48.613 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:48.613 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_version": 7, 2024-09-16T03:24:48.613 INFO:tasks.workunit.client.0.smithi096.stderr: "full_ratio": 0.99000000953674316, 2024-09-16T03:24:48.613 INFO:tasks.workunit.client.0.smithi096.stderr: "backfillfull_ratio": 0.99000000953674316, 2024-09-16T03:24:48.613 INFO:tasks.workunit.client.0.smithi096.stderr: "nearfull_ratio": 0.85000002384185791, 2024-09-16T03:24:48.613 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_snapshot": "", 2024-09-16T03:24:48.613 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_max": 2, 2024-09-16T03:24:48.614 INFO:tasks.workunit.client.0.smithi096.stderr: "max_osd": 3, 2024-09-16T03:24:48.614 INFO:tasks.workunit.client.0.smithi096.stderr: "require_min_compat_client": "luminous", 2024-09-16T03:24:48.614 INFO:tasks.workunit.client.0.smithi096.stderr: "min_compat_client": "jewel", 2024-09-16T03:24:48.614 INFO:tasks.workunit.client.0.smithi096.stderr: "require_osd_release": "squid", 2024-09-16T03:24:48.614 INFO:tasks.workunit.client.0.smithi096.stderr: "allow_crimson": false, 2024-09-16T03:24:48.614 INFO:tasks.workunit.client.0.smithi096.stderr: "pools": [ 2024-09-16T03:24:48.614 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:48.614 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 1, 2024-09-16T03:24:48.614 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_name": "foo", 2024-09-16T03:24:48.614 INFO:tasks.workunit.client.0.smithi096.stderr: "create_time": "2024-09-16T03:24:44.525189+0000", 2024-09-16T03:24:48.614 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": 1, 2024-09-16T03:24:48.614 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_names": "hashpspool", 2024-09-16T03:24:48.615 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:24:48.615 INFO:tasks.workunit.client.0.smithi096.stderr: "size": 3, 2024-09-16T03:24:48.615 INFO:tasks.workunit.client.0.smithi096.stderr: "min_size": 2, 2024-09-16T03:24:48.615 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_rule": 0, 2024-09-16T03:24:48.615 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_count": 0, 2024-09-16T03:24:48.615 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_target": 0, 2024-09-16T03:24:48.615 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_barrier": 0, 2024-09-16T03:24:48.615 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-16T03:24:48.615 INFO:tasks.workunit.client.0.smithi096.stderr: "is_stretch_pool": false, 2024-09-16T03:24:48.615 INFO:tasks.workunit.client.0.smithi096.stderr: "object_hash": 2, 2024-09-16T03:24:48.615 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_autoscale_mode": "off", 2024-09-16T03:24:48.616 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num": 32, 2024-09-16T03:24:48.616 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num": 32, 2024-09-16T03:24:48.616 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num_target": 32, 2024-09-16T03:24:48.616 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_target": 32, 2024-09-16T03:24:48.616 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_pending": 32, 2024-09-16T03:24:48.616 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pg_merge_meta": { 2024-09-16T03:24:48.617 INFO:tasks.workunit.client.0.smithi096.stderr: "source_pgid": "0.0", 2024-09-16T03:24:48.617 INFO:tasks.workunit.client.0.smithi096.stderr: "ready_epoch": 0, 2024-09-16T03:24:48.617 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_started": 0, 2024-09-16T03:24:48.617 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": 0, 2024-09-16T03:24:48.617 INFO:tasks.workunit.client.0.smithi096.stderr: "source_version": "0'\''0", 2024-09-16T03:24:48.617 INFO:tasks.workunit.client.0.smithi096.stderr: "target_version": "0'\''0" 2024-09-16T03:24:48.618 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.618 INFO:tasks.workunit.client.0.smithi096.stderr: "last_change": "21", 2024-09-16T03:24:48.618 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend": "0", 2024-09-16T03:24:48.618 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_prenautilus": "0", 2024-09-16T03:24:48.618 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_preluminous": "0", 2024-09-16T03:24:48.618 INFO:tasks.workunit.client.0.smithi096.stderr: "auid": 0, 2024-09-16T03:24:48.619 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_mode": "selfmanaged", 2024-09-16T03:24:48.619 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_seq": 0, 2024-09-16T03:24:48.619 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_epoch": 0, 2024-09-16T03:24:48.619 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_snaps": [], 2024-09-16T03:24:48.619 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps": "[]", 2024-09-16T03:24:48.619 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_bytes": 0, 2024-09-16T03:24:48.619 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_objects": 0, 2024-09-16T03:24:48.619 INFO:tasks.workunit.client.0.smithi096.stderr: "tiers": [], 2024-09-16T03:24:48.619 INFO:tasks.workunit.client.0.smithi096.stderr: "tier_of": -1, 2024-09-16T03:24:48.619 INFO:tasks.workunit.client.0.smithi096.stderr: "read_tier": -1, 2024-09-16T03:24:48.619 INFO:tasks.workunit.client.0.smithi096.stderr: "write_tier": -1, 2024-09-16T03:24:48.619 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_mode": "none", 2024-09-16T03:24:48.619 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_bytes": 0, 2024-09-16T03:24:48.620 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_objects": 0, 2024-09-16T03:24:48.620 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_ratio_micro": 400000, 2024-09-16T03:24:48.620 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-16T03:24:48.620 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_full_ratio_micro": 800000, 2024-09-16T03:24:48.620 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_flush_age": 0, 2024-09-16T03:24:48.620 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_evict_age": 0, 2024-09-16T03:24:48.621 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profile": "", 2024-09-16T03:24:48.621 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_params": { 2024-09-16T03:24:48.621 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "none" 2024-09-16T03:24:48.621 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.621 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_period": 0, 2024-09-16T03:24:48.621 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_count": 0, 2024-09-16T03:24:48.621 INFO:tasks.workunit.client.0.smithi096.stderr: "use_gmt_hitset": true, 2024-09-16T03:24:48.621 INFO:tasks.workunit.client.0.smithi096.stderr: "min_read_recency_for_promote": 0, 2024-09-16T03:24:48.621 INFO:tasks.workunit.client.0.smithi096.stderr: "min_write_recency_for_promote": 0, 2024-09-16T03:24:48.621 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_grade_decay_rate": 0, 2024-09-16T03:24:48.621 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_search_last_n": 0, 2024-09-16T03:24:48.621 INFO:tasks.workunit.client.0.smithi096.stderr: "grade_table": [], 2024-09-16T03:24:48.622 INFO:tasks.workunit.client.0.smithi096.stderr: "stripe_width": 0, 2024-09-16T03:24:48.622 INFO:tasks.workunit.client.0.smithi096.stderr: "expected_num_objects": 0, 2024-09-16T03:24:48.622 INFO:tasks.workunit.client.0.smithi096.stderr: "fast_read": false, 2024-09-16T03:24:48.622 INFO:tasks.workunit.client.0.smithi096.stderr: "options": {}, 2024-09-16T03:24:48.622 INFO:tasks.workunit.client.0.smithi096.stderr: "application_metadata": {}, 2024-09-16T03:24:48.622 INFO:tasks.workunit.client.0.smithi096.stderr: "read_balance": { 2024-09-16T03:24:48.622 INFO:tasks.workunit.client.0.smithi096.stderr: "score_type": "Fair distribution", 2024-09-16T03:24:48.622 INFO:tasks.workunit.client.0.smithi096.stderr: "score_acting": 1.690000057220459, 2024-09-16T03:24:48.622 INFO:tasks.workunit.client.0.smithi096.stderr: "score_stable": 1.690000057220459, 2024-09-16T03:24:48.623 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_score": 1, 2024-09-16T03:24:48.623 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_acting": 1.690000057220459, 2024-09-16T03:24:48.623 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_stable": 1.690000057220459, 2024-09-16T03:24:48.623 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity_weighted": 1, 2024-09-16T03:24:48.623 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity": 1, 2024-09-16T03:24:48.623 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity_weighted": 1 2024-09-16T03:24:48.624 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:48.624 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.624 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:48.624 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 2, 2024-09-16T03:24:48.624 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_name": "bar", 2024-09-16T03:24:48.625 INFO:tasks.workunit.client.0.smithi096.stderr: "create_time": "2024-09-16T03:24:46.226575+0000", 2024-09-16T03:24:48.625 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": 1, 2024-09-16T03:24:48.625 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_names": "hashpspool", 2024-09-16T03:24:48.626 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:24:48.626 INFO:tasks.workunit.client.0.smithi096.stderr: "size": 3, 2024-09-16T03:24:48.626 INFO:tasks.workunit.client.0.smithi096.stderr: "min_size": 2, 2024-09-16T03:24:48.626 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_rule": 0, 2024-09-16T03:24:48.626 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_count": 0, 2024-09-16T03:24:48.626 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_target": 0, 2024-09-16T03:24:48.626 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_barrier": 0, 2024-09-16T03:24:48.627 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-16T03:24:48.627 INFO:tasks.workunit.client.0.smithi096.stderr: "is_stretch_pool": false, 2024-09-16T03:24:48.627 INFO:tasks.workunit.client.0.smithi096.stderr: "object_hash": 2, 2024-09-16T03:24:48.627 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_autoscale_mode": "off", 2024-09-16T03:24:48.627 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num": 32, 2024-09-16T03:24:48.627 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num": 32, 2024-09-16T03:24:48.628 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num_target": 32, 2024-09-16T03:24:48.628 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_target": 32, 2024-09-16T03:24:48.628 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_pending": 32, 2024-09-16T03:24:48.628 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pg_merge_meta": { 2024-09-16T03:24:48.628 INFO:tasks.workunit.client.0.smithi096.stderr: "source_pgid": "0.0", 2024-09-16T03:24:48.628 INFO:tasks.workunit.client.0.smithi096.stderr: "ready_epoch": 0, 2024-09-16T03:24:48.629 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_started": 0, 2024-09-16T03:24:48.629 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": 0, 2024-09-16T03:24:48.629 INFO:tasks.workunit.client.0.smithi096.stderr: "source_version": "0'\''0", 2024-09-16T03:24:48.629 INFO:tasks.workunit.client.0.smithi096.stderr: "target_version": "0'\''0" 2024-09-16T03:24:48.629 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.629 INFO:tasks.workunit.client.0.smithi096.stderr: "last_change": "24", 2024-09-16T03:24:48.630 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend": "0", 2024-09-16T03:24:48.630 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_prenautilus": "0", 2024-09-16T03:24:48.630 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_preluminous": "0", 2024-09-16T03:24:48.630 INFO:tasks.workunit.client.0.smithi096.stderr: "auid": 0, 2024-09-16T03:24:48.630 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_mode": "selfmanaged", 2024-09-16T03:24:48.630 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_seq": 0, 2024-09-16T03:24:48.631 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_epoch": 0, 2024-09-16T03:24:48.631 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_snaps": [], 2024-09-16T03:24:48.631 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps": "[]", 2024-09-16T03:24:48.631 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_bytes": 0, 2024-09-16T03:24:48.631 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_objects": 0, 2024-09-16T03:24:48.631 INFO:tasks.workunit.client.0.smithi096.stderr: "tiers": [], 2024-09-16T03:24:48.632 INFO:tasks.workunit.client.0.smithi096.stderr: "tier_of": -1, 2024-09-16T03:24:48.632 INFO:tasks.workunit.client.0.smithi096.stderr: "read_tier": -1, 2024-09-16T03:24:48.632 INFO:tasks.workunit.client.0.smithi096.stderr: "write_tier": -1, 2024-09-16T03:24:48.632 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_mode": "none", 2024-09-16T03:24:48.632 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_bytes": 0, 2024-09-16T03:24:48.632 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_objects": 0, 2024-09-16T03:24:48.633 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_ratio_micro": 400000, 2024-09-16T03:24:48.633 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-16T03:24:48.633 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_full_ratio_micro": 800000, 2024-09-16T03:24:48.633 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_flush_age": 0, 2024-09-16T03:24:48.633 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_evict_age": 0, 2024-09-16T03:24:48.634 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profile": "", 2024-09-16T03:24:48.634 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_params": { 2024-09-16T03:24:48.634 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "none" 2024-09-16T03:24:48.634 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.634 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_period": 0, 2024-09-16T03:24:48.634 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_count": 0, 2024-09-16T03:24:48.635 INFO:tasks.workunit.client.0.smithi096.stderr: "use_gmt_hitset": true, 2024-09-16T03:24:48.635 INFO:tasks.workunit.client.0.smithi096.stderr: "min_read_recency_for_promote": 0, 2024-09-16T03:24:48.635 INFO:tasks.workunit.client.0.smithi096.stderr: "min_write_recency_for_promote": 0, 2024-09-16T03:24:48.635 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_grade_decay_rate": 0, 2024-09-16T03:24:48.635 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_search_last_n": 0, 2024-09-16T03:24:48.635 INFO:tasks.workunit.client.0.smithi096.stderr: "grade_table": [], 2024-09-16T03:24:48.636 INFO:tasks.workunit.client.0.smithi096.stderr: "stripe_width": 0, 2024-09-16T03:24:48.636 INFO:tasks.workunit.client.0.smithi096.stderr: "expected_num_objects": 0, 2024-09-16T03:24:48.636 INFO:tasks.workunit.client.0.smithi096.stderr: "fast_read": false, 2024-09-16T03:24:48.636 INFO:tasks.workunit.client.0.smithi096.stderr: "options": {}, 2024-09-16T03:24:48.637 INFO:tasks.workunit.client.0.smithi096.stderr: "application_metadata": {}, 2024-09-16T03:24:48.637 INFO:tasks.workunit.client.0.smithi096.stderr: "read_balance": { 2024-09-16T03:24:48.637 INFO:tasks.workunit.client.0.smithi096.stderr: "score_type": "Fair distribution", 2024-09-16T03:24:48.637 INFO:tasks.workunit.client.0.smithi096.stderr: "score_acting": 1.1299999952316284, 2024-09-16T03:24:48.637 INFO:tasks.workunit.client.0.smithi096.stderr: "score_stable": 1.1299999952316284, 2024-09-16T03:24:48.637 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_score": 1, 2024-09-16T03:24:48.638 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_acting": 1.1299999952316284, 2024-09-16T03:24:48.638 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_stable": 1.1299999952316284, 2024-09-16T03:24:48.638 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity_weighted": 1, 2024-09-16T03:24:48.639 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity": 1, 2024-09-16T03:24:48.639 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity_weighted": 1 2024-09-16T03:24:48.640 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:48.640 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:48.640 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:48.640 INFO:tasks.workunit.client.0.smithi096.stderr: "osds": [ 2024-09-16T03:24:48.640 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:48.640 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:24:48.641 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6", 2024-09-16T03:24:48.641 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:24:48.641 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:24:48.641 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:24:48.642 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:24:48.642 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:24:48.642 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:24:48.642 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 5, 2024-09-16T03:24:48.643 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 21, 2024-09-16T03:24:48.643 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:24:48.643 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:24:48.643 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:24:48.643 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:48.643 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:48.643 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:48.643 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6802", 2024-09-16T03:24:48.644 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:24:48.644 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.644 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:48.644 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:48.644 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6803", 2024-09-16T03:24:48.644 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:24:48.644 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:48.644 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:48.644 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.644 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:24:48.644 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:48.644 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:48.644 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:48.645 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6804", 2024-09-16T03:24:48.645 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:24:48.645 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.645 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:48.645 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:48.645 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6805", 2024-09-16T03:24:48.645 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:24:48.645 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:48.645 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:48.646 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.646 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:24:48.646 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:48.646 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:48.646 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:48.646 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6808", 2024-09-16T03:24:48.646 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:24:48.646 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.646 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:48.646 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:48.646 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6809", 2024-09-16T03:24:48.646 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:24:48.646 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:48.646 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:48.647 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.647 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:24:48.647 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:48.647 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:48.647 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:48.647 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6806", 2024-09-16T03:24:48.647 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:24:48.647 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.647 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:48.647 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:48.647 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6807", 2024-09-16T03:24:48.647 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:24:48.647 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:48.647 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:48.648 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.648 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6803/3375787448", 2024-09-16T03:24:48.648 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6805/3375787448", 2024-09-16T03:24:48.648 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6809/3375787448", 2024-09-16T03:24:48.648 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6807/3375787448", 2024-09-16T03:24:48.648 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:24:48.648 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:24:48.648 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:24:48.648 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:48.648 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.648 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:48.648 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:24:48.648 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "74b26727-75c9-444d-8782-719e4197a382", 2024-09-16T03:24:48.649 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:24:48.649 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:24:48.649 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:24:48.649 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:24:48.649 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:24:48.649 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:24:48.649 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 10, 2024-09-16T03:24:48.649 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 21, 2024-09-16T03:24:48.649 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:24:48.649 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:24:48.649 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:24:48.649 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:48.649 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:48.649 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:48.650 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6810", 2024-09-16T03:24:48.650 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:24:48.650 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.650 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:48.650 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:48.650 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6811", 2024-09-16T03:24:48.650 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:24:48.650 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:48.651 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:48.651 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.651 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:24:48.651 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:48.651 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:48.651 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:48.651 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6812", 2024-09-16T03:24:48.651 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:24:48.651 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.651 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:48.651 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:48.651 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6813", 2024-09-16T03:24:48.652 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:24:48.652 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:48.652 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:48.652 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.652 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:24:48.652 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:48.652 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:48.652 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:48.652 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6816", 2024-09-16T03:24:48.652 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:24:48.652 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.652 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:48.652 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:48.653 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6817", 2024-09-16T03:24:48.653 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:24:48.653 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:48.653 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:48.653 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.653 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:24:48.653 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:48.653 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:48.653 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:48.653 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6814", 2024-09-16T03:24:48.653 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:24:48.653 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.653 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:48.653 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:48.654 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6815", 2024-09-16T03:24:48.654 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:24:48.654 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:48.654 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:48.654 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.654 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6811/3733255132", 2024-09-16T03:24:48.654 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6813/3733255132", 2024-09-16T03:24:48.654 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6817/3733255132", 2024-09-16T03:24:48.654 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6815/3733255132", 2024-09-16T03:24:48.654 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:24:48.654 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:24:48.654 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:24:48.654 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:48.655 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.655 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:48.655 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:24:48.655 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "143da3a7-dad9-4b1e-966b-76cf5bdd3c82", 2024-09-16T03:24:48.655 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:24:48.655 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:24:48.655 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:24:48.655 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:24:48.655 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:24:48.655 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:24:48.655 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 15, 2024-09-16T03:24:48.655 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 21, 2024-09-16T03:24:48.655 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:24:48.655 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:24:48.656 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:24:48.656 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:48.656 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:48.656 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:48.656 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6818", 2024-09-16T03:24:48.656 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:24:48.657 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.657 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:48.657 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:48.657 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6819", 2024-09-16T03:24:48.657 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:24:48.657 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:48.658 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:48.658 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.658 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:24:48.658 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:48.658 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:48.658 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:48.658 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6820", 2024-09-16T03:24:48.658 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:24:48.659 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.659 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:48.659 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:48.659 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6821", 2024-09-16T03:24:48.659 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:24:48.659 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:48.659 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:48.660 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.660 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:24:48.660 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:48.660 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:48.660 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:48.660 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6824", 2024-09-16T03:24:48.660 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:24:48.660 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.660 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:48.660 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:48.661 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6825", 2024-09-16T03:24:48.661 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:24:48.661 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:48.661 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:48.661 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.661 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:24:48.661 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:48.661 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:48.661 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:48.661 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6822", 2024-09-16T03:24:48.661 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:24:48.661 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.661 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:48.662 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:48.662 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6823", 2024-09-16T03:24:48.662 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:24:48.662 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:48.662 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:48.662 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.662 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6819/963814857", 2024-09-16T03:24:48.662 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6821/963814857", 2024-09-16T03:24:48.662 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6825/963814857", 2024-09-16T03:24:48.662 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6823/963814857", 2024-09-16T03:24:48.662 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:24:48.662 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:24:48.662 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:24:48.662 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:48.663 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:48.663 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:48.663 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_xinfo": [ 2024-09-16T03:24:48.663 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:48.663 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:24:48.663 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:24:48.663 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:24:48.663 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:24:48.663 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:24:48.663 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:24:48.663 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:23:22.481942+0000", 2024-09-16T03:24:48.663 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:24:48.663 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.663 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:48.664 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:24:48.664 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:24:48.664 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:24:48.664 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:24:48.664 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:24:48.664 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:24:48.665 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:23:59.663703+0000", 2024-09-16T03:24:48.665 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:24:48.665 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.665 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:48.665 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:24:48.665 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:24:48.665 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:24:48.665 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:24:48.665 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:24:48.665 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:24:48.665 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:24:37.320822+0000", 2024-09-16T03:24:48.666 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:24:48.666 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:48.666 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:48.666 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap": [], 2024-09-16T03:24:48.666 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap_items": [], 2024-09-16T03:24:48.666 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap_primaries": [], 2024-09-16T03:24:48.666 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_temp": [], 2024-09-16T03:24:48.666 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_temp": [], 2024-09-16T03:24:48.666 INFO:tasks.workunit.client.0.smithi096.stderr: "blocklist": {}, 2024-09-16T03:24:48.666 INFO:tasks.workunit.client.0.smithi096.stderr: "range_blocklist": {}, 2024-09-16T03:24:48.666 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profiles": { 2024-09-16T03:24:48.666 INFO:tasks.workunit.client.0.smithi096.stderr: "default": { 2024-09-16T03:24:48.666 INFO:tasks.workunit.client.0.smithi096.stderr: "k": "2", 2024-09-16T03:24:48.666 INFO:tasks.workunit.client.0.smithi096.stderr: "m": "2", 2024-09-16T03:24:48.667 INFO:tasks.workunit.client.0.smithi096.stderr: "plugin": "jerasure", 2024-09-16T03:24:48.667 INFO:tasks.workunit.client.0.smithi096.stderr: "technique": "reed_sol_van" 2024-09-16T03:24:48.667 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:48.667 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.667 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps_queue": [], 2024-09-16T03:24:48.667 INFO:tasks.workunit.client.0.smithi096.stderr: "new_removed_snaps": [], 2024-09-16T03:24:48.667 INFO:tasks.workunit.client.0.smithi096.stderr: "new_purged_snaps": [], 2024-09-16T03:24:48.667 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_node_flags": {}, 2024-09-16T03:24:48.667 INFO:tasks.workunit.client.0.smithi096.stderr: "device_class_flags": {}, 2024-09-16T03:24:48.667 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode": { 2024-09-16T03:24:48.667 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode_enabled": false, 2024-09-16T03:24:48.668 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_bucket_count": 0, 2024-09-16T03:24:48.668 INFO:tasks.workunit.client.0.smithi096.stderr: "degraded_stretch_mode": 0, 2024-09-16T03:24:48.668 INFO:tasks.workunit.client.0.smithi096.stderr: "recovering_stretch_mode": 0, 2024-09-16T03:24:48.668 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode_bucket": 0 2024-09-16T03:24:48.668 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:48.668 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.668 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_metadata": [ 2024-09-16T03:24:48.668 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:48.668 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:24:48.668 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:24:48.668 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]", 2024-09-16T03:24:48.668 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:24:48.668 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:24:48.669 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:24:48.669 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:24:48.669 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:24:48.669 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:24:48.669 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:24:48.669 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:24:48.669 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:24:48.669 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:24:48.669 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:24:48.669 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/0/block", 2024-09-16T03:24:48.669 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:24:48.669 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:24:48.669 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:24:48.670 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:24:48.670 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:24:48.670 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:24:48.670 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:24:48.670 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:24:48.670 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:24:48.670 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:24:48.670 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:22:53.662571Z", 2024-09-16T03:24:48.670 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:24:48.670 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:24:48.670 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:24:48.670 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:24:48.670 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:24:48.670 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:24:48.671 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:24:48.671 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]", 2024-09-16T03:24:48.671 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:24:48.671 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]", 2024-09-16T03:24:48.671 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]", 2024-09-16T03:24:48.671 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:24:48.671 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:24:48.671 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:24:48.671 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:24:48.671 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:24:48.671 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:24:48.671 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:24:48.671 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:24:48.671 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:24:48.672 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/0", 2024-09-16T03:24:48.672 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:24:48.672 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:24:48.672 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:24:48.672 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.672 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:48.672 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:24:48.672 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:24:48.672 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]", 2024-09-16T03:24:48.672 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:24:48.672 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:24:48.672 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:24:48.673 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:24:48.673 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:24:48.673 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:24:48.673 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:24:48.673 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:24:48.673 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:24:48.673 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:24:48.673 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:24:48.673 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/1/block", 2024-09-16T03:24:48.673 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:24:48.673 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:24:48.673 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:24:48.673 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:24:48.674 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:24:48.674 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:24:48.674 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:24:48.674 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:24:48.674 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:24:48.674 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:24:48.674 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:23:30.129885Z", 2024-09-16T03:24:48.674 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:24:48.674 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:24:48.674 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:24:48.674 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:24:48.674 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:24:48.674 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:24:48.675 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:24:48.675 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]", 2024-09-16T03:24:48.675 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:24:48.675 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]", 2024-09-16T03:24:48.675 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]", 2024-09-16T03:24:48.675 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:24:48.675 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:24:48.675 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:24:48.675 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:24:48.675 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:24:48.675 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:24:48.675 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:24:48.675 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:24:48.676 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:24:48.676 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/1", 2024-09-16T03:24:48.676 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:24:48.676 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:24:48.676 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:24:48.676 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.676 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:48.676 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:24:48.676 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:24:48.676 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]", 2024-09-16T03:24:48.676 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:24:48.676 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:24:48.676 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:24:48.677 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:24:48.677 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:24:48.677 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:24:48.677 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:24:48.677 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:24:48.677 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:24:48.677 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:24:48.677 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:24:48.677 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/2/block", 2024-09-16T03:24:48.677 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:24:48.677 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:24:48.677 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:24:48.677 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:24:48.677 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:24:48.678 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:24:48.678 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:24:48.678 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:24:48.678 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:24:48.678 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:24:48.678 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:24:07.764502Z", 2024-09-16T03:24:48.678 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:24:48.678 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:24:48.678 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:24:48.678 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:24:48.678 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:24:48.678 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:24:48.678 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:24:48.678 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]", 2024-09-16T03:24:48.679 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:24:48.679 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]", 2024-09-16T03:24:48.679 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]", 2024-09-16T03:24:48.679 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:24:48.679 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:24:48.679 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:24:48.679 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:24:48.679 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:24:48.679 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:24:48.679 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:24:48.679 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:24:48.680 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:24:48.680 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/2", 2024-09-16T03:24:48.680 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:24:48.680 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:24:48.680 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:24:48.680 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:48.680 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:48.680 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_clean_epochs": { 2024-09-16T03:24:48.680 INFO:tasks.workunit.client.0.smithi096.stderr: "min_last_epoch_clean": 0, 2024-09-16T03:24:48.680 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": { 2024-09-16T03:24:48.680 INFO:tasks.workunit.client.0.smithi096.stderr: "per_pool": [] 2024-09-16T03:24:48.680 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.680 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_epochs": [ 2024-09-16T03:24:48.681 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:48.681 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:24:48.681 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 16 2024-09-16T03:24:48.681 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.681 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:48.681 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:24:48.681 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 16 2024-09-16T03:24:48.681 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.681 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:48.681 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:24:48.681 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 15 2024-09-16T03:24:48.681 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:48.681 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:48.681 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.682 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_first_committed": 1, 2024-09-16T03:24:48.682 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_last_committed": 24, 2024-09-16T03:24:48.682 INFO:tasks.workunit.client.0.smithi096.stderr: "crushmap": { 2024-09-16T03:24:48.682 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": [ 2024-09-16T03:24:48.682 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:48.682 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:24:48.682 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.0", 2024-09-16T03:24:48.682 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:24:48.682 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.682 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:48.682 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:24:48.682 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.1", 2024-09-16T03:24:48.682 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:24:48.683 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.683 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:48.683 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:24:48.683 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.2", 2024-09-16T03:24:48.683 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:24:48.683 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:48.683 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:48.683 INFO:tasks.workunit.client.0.smithi096.stderr: "types": [ 2024-09-16T03:24:48.683 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:48.683 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 0, 2024-09-16T03:24:48.683 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd" 2024-09-16T03:24:48.683 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.683 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:48.683 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:24:48.684 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "host" 2024-09-16T03:24:48.684 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.684 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:48.684 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 2, 2024-09-16T03:24:48.684 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "chassis" 2024-09-16T03:24:48.684 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.684 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:48.684 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 3, 2024-09-16T03:24:48.684 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "rack" 2024-09-16T03:24:48.684 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.684 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:48.684 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 4, 2024-09-16T03:24:48.684 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "row" 2024-09-16T03:24:48.685 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.685 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:48.685 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 5, 2024-09-16T03:24:48.685 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "pdu" 2024-09-16T03:24:48.685 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.685 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:48.685 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 6, 2024-09-16T03:24:48.685 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "pod" 2024-09-16T03:24:48.685 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.685 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:48.685 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 7, 2024-09-16T03:24:48.685 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "room" 2024-09-16T03:24:48.685 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.686 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:48.686 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 8, 2024-09-16T03:24:48.686 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "datacenter" 2024-09-16T03:24:48.686 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.686 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:48.686 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 9, 2024-09-16T03:24:48.686 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "zone" 2024-09-16T03:24:48.686 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.686 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:48.686 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 10, 2024-09-16T03:24:48.686 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "region" 2024-09-16T03:24:48.686 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.686 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:48.686 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:24:48.687 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "root" 2024-09-16T03:24:48.687 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:48.687 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:48.687 INFO:tasks.workunit.client.0.smithi096.stderr: "buckets": [ 2024-09-16T03:24:48.687 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:48.687 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -1, 2024-09-16T03:24:48.687 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "default", 2024-09-16T03:24:48.687 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:24:48.687 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "root", 2024-09-16T03:24:48.687 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:24:48.687 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:24:48.687 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:24:48.687 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:24:48.687 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:48.687 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -3, 2024-09-16T03:24:48.688 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:24:48.688 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:24:48.688 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:48.688 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:48.688 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.688 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:48.688 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -2, 2024-09-16T03:24:48.688 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "default~hdd", 2024-09-16T03:24:48.688 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:24:48.689 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "root", 2024-09-16T03:24:48.689 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:24:48.689 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:24:48.689 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:24:48.689 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:24:48.689 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:48.689 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -4, 2024-09-16T03:24:48.689 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:24:48.689 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:24:48.689 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:48.689 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:48.690 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.690 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:48.690 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -3, 2024-09-16T03:24:48.690 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "smithi096", 2024-09-16T03:24:48.690 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:24:48.690 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "host", 2024-09-16T03:24:48.690 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:24:48.690 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:24:48.690 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:24:48.690 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:24:48.690 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:48.690 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:24:48.690 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:24:48.691 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:24:48.691 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.691 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:48.691 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:24:48.691 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:24:48.691 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 1 2024-09-16T03:24:48.691 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.691 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:48.691 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:24:48.691 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:24:48.691 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 2 2024-09-16T03:24:48.691 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:48.691 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:48.692 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.692 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:48.692 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -4, 2024-09-16T03:24:48.692 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "smithi096~hdd", 2024-09-16T03:24:48.692 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:24:48.692 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "host", 2024-09-16T03:24:48.692 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:24:48.692 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:24:48.692 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:24:48.692 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:24:48.692 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:48.692 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:24:48.692 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:24:48.693 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:24:48.693 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.693 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:48.693 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:24:48.693 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:24:48.693 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 1 2024-09-16T03:24:48.693 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.693 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:48.693 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:24:48.693 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:24:48.693 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 2 2024-09-16T03:24:48.693 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:48.693 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:48.694 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:48.694 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:48.694 INFO:tasks.workunit.client.0.smithi096.stderr: "rules": [ 2024-09-16T03:24:48.694 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:48.694 INFO:tasks.workunit.client.0.smithi096.stderr: "rule_id": 0, 2024-09-16T03:24:48.694 INFO:tasks.workunit.client.0.smithi096.stderr: "rule_name": "replicated_rule", 2024-09-16T03:24:48.694 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:24:48.694 INFO:tasks.workunit.client.0.smithi096.stderr: "steps": [ 2024-09-16T03:24:48.694 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:48.694 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "take", 2024-09-16T03:24:48.694 INFO:tasks.workunit.client.0.smithi096.stderr: "item": -1, 2024-09-16T03:24:48.694 INFO:tasks.workunit.client.0.smithi096.stderr: "item_name": "default" 2024-09-16T03:24:48.694 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.694 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:48.695 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "choose_firstn", 2024-09-16T03:24:48.695 INFO:tasks.workunit.client.0.smithi096.stderr: "num": 0, 2024-09-16T03:24:48.695 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "osd" 2024-09-16T03:24:48.695 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.695 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:48.695 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "emit" 2024-09-16T03:24:48.695 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:48.695 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:48.695 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:48.695 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:48.695 INFO:tasks.workunit.client.0.smithi096.stderr: "tunables": { 2024-09-16T03:24:48.695 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_local_tries": 0, 2024-09-16T03:24:48.695 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_local_fallback_tries": 0, 2024-09-16T03:24:48.696 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_total_tries": 50, 2024-09-16T03:24:48.696 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_descend_once": 1, 2024-09-16T03:24:48.696 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_vary_r": 1, 2024-09-16T03:24:48.696 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_stable": 1, 2024-09-16T03:24:48.696 INFO:tasks.workunit.client.0.smithi096.stderr: "msr_descents": 100, 2024-09-16T03:24:48.696 INFO:tasks.workunit.client.0.smithi096.stderr: "msr_collision_tries": 100, 2024-09-16T03:24:48.696 INFO:tasks.workunit.client.0.smithi096.stderr: "straw_calc_version": 1, 2024-09-16T03:24:48.696 INFO:tasks.workunit.client.0.smithi096.stderr: "allowed_bucket_algs": 54, 2024-09-16T03:24:48.696 INFO:tasks.workunit.client.0.smithi096.stderr: "profile": "jewel", 2024-09-16T03:24:48.696 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_tunables": 1, 2024-09-16T03:24:48.696 INFO:tasks.workunit.client.0.smithi096.stderr: "legacy_tunables": 0, 2024-09-16T03:24:48.696 INFO:tasks.workunit.client.0.smithi096.stderr: "minimum_required_version": "jewel", 2024-09-16T03:24:48.696 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables": 1, 2024-09-16T03:24:48.697 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables2": 1, 2024-09-16T03:24:48.697 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v2_rules": 0, 2024-09-16T03:24:48.697 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables3": 1, 2024-09-16T03:24:48.697 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v3_rules": 0, 2024-09-16T03:24:48.697 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v4_buckets": 1, 2024-09-16T03:24:48.697 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables5": 1, 2024-09-16T03:24:48.697 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v5_rules": 0, 2024-09-16T03:24:48.697 INFO:tasks.workunit.client.0.smithi096.stderr: "has_msr_rules": 0 2024-09-16T03:24:48.697 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.697 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_args": {} 2024-09-16T03:24:48.697 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.697 INFO:tasks.workunit.client.0.smithi096.stderr: "fsmap": { 2024-09-16T03:24:48.697 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 1, 2024-09-16T03:24:48.698 INFO:tasks.workunit.client.0.smithi096.stderr: "btime": "2024-09-16T03:22:46:882186+0000", 2024-09-16T03:24:48.698 INFO:tasks.workunit.client.0.smithi096.stderr: "default_fscid": -1, 2024-09-16T03:24:48.698 INFO:tasks.workunit.client.0.smithi096.stderr: "compat": { 2024-09-16T03:24:48.698 INFO:tasks.workunit.client.0.smithi096.stderr: "compat": {}, 2024-09-16T03:24:48.698 INFO:tasks.workunit.client.0.smithi096.stderr: "ro_compat": {}, 2024-09-16T03:24:48.698 INFO:tasks.workunit.client.0.smithi096.stderr: "incompat": { 2024-09-16T03:24:48.698 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_1": "base v0.20", 2024-09-16T03:24:48.698 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_2": "client writeable ranges", 2024-09-16T03:24:48.698 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_3": "default file layouts on dirs", 2024-09-16T03:24:48.698 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_4": "dir inode in separate object", 2024-09-16T03:24:48.698 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_5": "mds uses versioned encoding", 2024-09-16T03:24:48.698 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_6": "dirfrag is stored in omap", 2024-09-16T03:24:48.698 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_8": "no anchor table", 2024-09-16T03:24:48.698 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_9": "file layout v2", 2024-09-16T03:24:48.699 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_10": "snaprealm v2", 2024-09-16T03:24:48.699 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_11": "minor log segments", 2024-09-16T03:24:48.699 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_12": "quiesce subvolumes" 2024-09-16T03:24:48.699 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:48.699 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.699 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_flags": { 2024-09-16T03:24:48.699 INFO:tasks.workunit.client.0.smithi096.stderr: "enable_multiple": true, 2024-09-16T03:24:48.699 INFO:tasks.workunit.client.0.smithi096.stderr: "ever_enabled_multiple": true 2024-09-16T03:24:48.699 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.699 INFO:tasks.workunit.client.0.smithi096.stderr: "standbys": [], 2024-09-16T03:24:48.699 INFO:tasks.workunit.client.0.smithi096.stderr: "filesystems": [] 2024-09-16T03:24:48.699 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.699 INFO:tasks.workunit.client.0.smithi096.stderr: "mdsmap_first_committed": 1, 2024-09-16T03:24:48.700 INFO:tasks.workunit.client.0.smithi096.stderr: "mdsmap_last_committed": 1, 2024-09-16T03:24:48.700 INFO:tasks.workunit.client.0.smithi096.stderr: "auth": { 2024-09-16T03:24:48.700 INFO:tasks.workunit.client.0.smithi096.stderr: "first_committed": 1, 2024-09-16T03:24:48.700 INFO:tasks.workunit.client.0.smithi096.stderr: "last_committed": 5, 2024-09-16T03:24:48.700 INFO:tasks.workunit.client.0.smithi096.stderr: "num_secrets": 3 2024-09-16T03:24:48.700 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.700 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 32, 2024-09-16T03:24:48.700 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_active": 0, 2024-09-16T03:24:48.700 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_unknown": 14, 2024-09-16T03:24:48.700 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osd": 3, 2024-09-16T03:24:48.700 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_sum": { 2024-09-16T03:24:48.700 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:24:48.700 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:24:48.701 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:24:48.701 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:24:48.701 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:24:48.701 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:24:48.701 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:24:48.701 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:24:48.701 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:24:48.701 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:24:48.701 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:24:48.701 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:24:48.701 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:24:48.701 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:24:48.701 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:24:48.701 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:24:48.702 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:24:48.702 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:24:48.702 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:24:48.702 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:24:48.702 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:24:48.702 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:24:48.702 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:24:48.702 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:24:48.702 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:24:48.702 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:24:48.702 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:24:48.702 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:24:48.702 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:24:48.702 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:24:48.703 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:24:48.703 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:24:48.703 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:24:48.703 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:24:48.703 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:24:48.703 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:24:48.703 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:24:48.703 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:24:48.703 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:24:48.703 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:24:48.703 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:24:48.703 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.703 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:24:48.703 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:24:48.704 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:24:48.704 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:24:48.704 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:24:48.704 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:24:48.704 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:24:48.704 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:24:48.704 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:24:48.704 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:24:48.704 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:24:48.704 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.704 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:24:48.704 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:24:48.704 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 54, 2024-09-16T03:24:48.705 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 54, 2024-09-16T03:24:48.705 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 0 2024-09-16T03:24:48.705 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.705 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_sum": { 2024-09-16T03:24:48.705 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 0, 2024-09-16T03:24:48.705 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 0, 2024-09-16T03:24:48.705 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pgs": 24, 2024-09-16T03:24:48.705 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osds": 3, 2024-09-16T03:24:48.705 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_osds": 3, 2024-09-16T03:24:48.705 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_omap_osds": 1, 2024-09-16T03:24:48.705 INFO:tasks.workunit.client.0.smithi096.stderr: "kb": 314572800, 2024-09-16T03:24:48.705 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used": 490536, 2024-09-16T03:24:48.705 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_data": 416, 2024-09-16T03:24:48.705 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_omap": 4, 2024-09-16T03:24:48.706 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_meta": 80443, 2024-09-16T03:24:48.706 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_avail": 314082264, 2024-09-16T03:24:48.706 INFO:tasks.workunit.client.0.smithi096.stderr: "statfs": { 2024-09-16T03:24:48.706 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 322122547200, 2024-09-16T03:24:48.706 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 321620238336, 2024-09-16T03:24:48.706 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:24:48.706 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 425984, 2024-09-16T03:24:48.706 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 102599, 2024-09-16T03:24:48.706 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:24:48.706 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:24:48.706 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:24:48.706 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 4785, 2024-09-16T03:24:48.706 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 82373967 2024-09-16T03:24:48.706 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.707 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_peers": [], 2024-09-16T03:24:48.707 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_trim_queue_len": 0, 2024-09-16T03:24:48.707 INFO:tasks.workunit.client.0.smithi096.stderr: "num_snap_trimming": 0, 2024-09-16T03:24:48.707 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shards_repaired": 0, 2024-09-16T03:24:48.707 INFO:tasks.workunit.client.0.smithi096.stderr: "op_queue_age_hist": { 2024-09-16T03:24:48.707 INFO:tasks.workunit.client.0.smithi096.stderr: "histogram": [], 2024-09-16T03:24:48.707 INFO:tasks.workunit.client.0.smithi096.stderr: "upper_bound": 1 2024-09-16T03:24:48.707 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.707 INFO:tasks.workunit.client.0.smithi096.stderr: "perf_stat": { 2024-09-16T03:24:48.707 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ms": 435, 2024-09-16T03:24:48.707 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ms": 435, 2024-09-16T03:24:48.707 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ns": 435000000, 2024-09-16T03:24:48.707 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ns": 435000000 2024-09-16T03:24:48.707 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.707 INFO:tasks.workunit.client.0.smithi096.stderr: "alerts": [], 2024-09-16T03:24:48.708 INFO:tasks.workunit.client.0.smithi096.stderr: "network_ping_times": [] 2024-09-16T03:24:48.708 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.708 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_sum_by_class": { 2024-09-16T03:24:48.708 INFO:tasks.workunit.client.0.smithi096.stderr: "hdd": { 2024-09-16T03:24:48.708 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 0, 2024-09-16T03:24:48.708 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 0, 2024-09-16T03:24:48.708 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pgs": 24, 2024-09-16T03:24:48.708 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osds": 3, 2024-09-16T03:24:48.708 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_osds": 3, 2024-09-16T03:24:48.708 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_omap_osds": 1, 2024-09-16T03:24:48.708 INFO:tasks.workunit.client.0.smithi096.stderr: "kb": 314572800, 2024-09-16T03:24:48.708 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used": 490536, 2024-09-16T03:24:48.708 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_data": 416, 2024-09-16T03:24:48.709 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_omap": 4, 2024-09-16T03:24:48.709 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_meta": 80443, 2024-09-16T03:24:48.709 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_avail": 314082264, 2024-09-16T03:24:48.709 INFO:tasks.workunit.client.0.smithi096.stderr: "statfs": { 2024-09-16T03:24:48.709 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 322122547200, 2024-09-16T03:24:48.709 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 321620238336, 2024-09-16T03:24:48.709 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:24:48.709 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 425984, 2024-09-16T03:24:48.709 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 102599, 2024-09-16T03:24:48.709 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:24:48.709 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:24:48.709 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:24:48.709 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 4785, 2024-09-16T03:24:48.709 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 82373967 2024-09-16T03:24:48.710 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.710 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_peers": [], 2024-09-16T03:24:48.710 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_trim_queue_len": 0, 2024-09-16T03:24:48.710 INFO:tasks.workunit.client.0.smithi096.stderr: "num_snap_trimming": 0, 2024-09-16T03:24:48.710 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shards_repaired": 0, 2024-09-16T03:24:48.710 INFO:tasks.workunit.client.0.smithi096.stderr: "op_queue_age_hist": { 2024-09-16T03:24:48.710 INFO:tasks.workunit.client.0.smithi096.stderr: "histogram": [], 2024-09-16T03:24:48.710 INFO:tasks.workunit.client.0.smithi096.stderr: "upper_bound": 1 2024-09-16T03:24:48.710 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.710 INFO:tasks.workunit.client.0.smithi096.stderr: "perf_stat": { 2024-09-16T03:24:48.710 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ms": 435, 2024-09-16T03:24:48.710 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ms": 435, 2024-09-16T03:24:48.710 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ns": 435000000, 2024-09-16T03:24:48.710 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ns": 435000000 2024-09-16T03:24:48.710 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.711 INFO:tasks.workunit.client.0.smithi096.stderr: "alerts": [], 2024-09-16T03:24:48.711 INFO:tasks.workunit.client.0.smithi096.stderr: "network_ping_times": [] 2024-09-16T03:24:48.711 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:48.711 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.711 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_stats": [ 2024-09-16T03:24:48.711 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:48.711 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 1, 2024-09-16T03:24:48.711 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 32, 2024-09-16T03:24:48.711 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:24:48.711 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:24:48.711 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:24:48.711 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:24:48.711 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:24:48.711 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:24:48.712 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:24:48.712 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:24:48.712 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:24:48.712 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:24:48.712 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:24:48.712 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:24:48.712 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:24:48.712 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:24:48.712 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:24:48.712 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:24:48.712 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:24:48.712 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:24:48.712 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:24:48.713 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:24:48.713 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:24:48.713 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:24:48.713 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:24:48.713 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:24:48.713 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:24:48.713 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:24:48.713 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:24:48.713 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:24:48.713 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:24:48.713 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:24:48.714 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:24:48.714 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:24:48.714 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:24:48.714 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:24:48.714 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:24:48.714 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:24:48.714 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:24:48.714 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:24:48.714 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:24:48.714 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:24:48.714 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:24:48.714 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.714 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:24:48.714 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:24:48.715 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:24:48.715 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:24:48.715 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:24:48.715 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:24:48.715 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:24:48.715 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:24:48.715 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:24:48.715 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:24:48.715 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:24:48.715 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.715 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:24:48.715 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:24:48.715 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 54, 2024-09-16T03:24:48.715 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 54, 2024-09-16T03:24:48.716 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 1 2024-09-16T03:24:48.716 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:48.716 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:48.716 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_stats": [ 2024-09-16T03:24:48.716 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:48.716 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:24:48.716 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 21474836503 2024-09-16T03:24:48.716 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.716 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:48.716 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:24:48.716 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 42949672975 2024-09-16T03:24:48.716 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.717 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:48.717 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:24:48.717 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 64424509447 2024-09-16T03:24:48.717 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:48.717 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:48.717 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_by_state": [ 2024-09-16T03:24:48.717 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:48.717 INFO:tasks.workunit.client.0.smithi096.stderr: "state": "creating+activating", 2024-09-16T03:24:48.717 INFO:tasks.workunit.client.0.smithi096.stderr: "num": 18 2024-09-16T03:24:48.717 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.717 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:48.717 INFO:tasks.workunit.client.0.smithi096.stderr: "state": "unknown", 2024-09-16T03:24:48.717 INFO:tasks.workunit.client.0.smithi096.stderr: "num": 14 2024-09-16T03:24:48.717 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:48.718 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:48.718 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_by_osd": [ 2024-09-16T03:24:48.718 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:48.718 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:24:48.718 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 0, 2024-09-16T03:24:48.718 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 18, 2024-09-16T03:24:48.718 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:24:48.718 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.718 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:48.718 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:24:48.718 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 0, 2024-09-16T03:24:48.718 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 18, 2024-09-16T03:24:48.718 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:24:48.718 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.719 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:48.719 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:24:48.719 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 18, 2024-09-16T03:24:48.719 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 18, 2024-09-16T03:24:48.719 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:24:48.719 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:48.719 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:48.719 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": [], 2024-09-16T03:24:48.719 INFO:tasks.workunit.client.0.smithi096.stderr: "servicemap": { 2024-09-16T03:24:48.719 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 3, 2024-09-16T03:24:48.719 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:24:24.403052+0000", 2024-09-16T03:24:48.719 INFO:tasks.workunit.client.0.smithi096.stderr: "services": { 2024-09-16T03:24:48.719 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": { 2024-09-16T03:24:48.719 INFO:tasks.workunit.client.0.smithi096.stderr: "daemons": { 2024-09-16T03:24:48.719 INFO:tasks.workunit.client.0.smithi096.stderr: "summary": "", 2024-09-16T03:24:48.720 INFO:tasks.workunit.client.0.smithi096.stderr: "1": { 2024-09-16T03:24:48.720 INFO:tasks.workunit.client.0.smithi096.stderr: "start_epoch": 0, 2024-09-16T03:24:48.720 INFO:tasks.workunit.client.0.smithi096.stderr: "start_stamp": "0.000000", 2024-09-16T03:24:48.720 INFO:tasks.workunit.client.0.smithi096.stderr: "gid": 0, 2024-09-16T03:24:48.720 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "(unrecognized address family 0)/0", 2024-09-16T03:24:48.720 INFO:tasks.workunit.client.0.smithi096.stderr: "metadata": {}, 2024-09-16T03:24:48.720 INFO:tasks.workunit.client.0.smithi096.stderr: "task_status": {} 2024-09-16T03:24:48.720 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:48.720 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:48.720 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:48.720 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:48.720 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:48.720 INFO:tasks.workunit.client.0.smithi096.stderr: "mgrstat_first_committed": 44, 2024-09-16T03:24:48.720 INFO:tasks.workunit.client.0.smithi096.stderr: "mgrstat_last_committed": 49, 2024-09-16T03:24:48.721 INFO:tasks.workunit.client.0.smithi096.stderr: "logm_first_committed": 1, 2024-09-16T03:24:48.721 INFO:tasks.workunit.client.0.smithi096.stderr: "logm_last_committed": 212, 2024-09-16T03:24:48.721 INFO:tasks.workunit.client.0.smithi096.stderr: "paxos": { 2024-09-16T03:24:48.721 INFO:tasks.workunit.client.0.smithi096.stderr: "first_committed": 1, 2024-09-16T03:24:48.721 INFO:tasks.workunit.client.0.smithi096.stderr: "last_committed": 293, 2024-09-16T03:24:48.721 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pn": 0, 2024-09-16T03:24:48.721 INFO:tasks.workunit.client.0.smithi096.stderr: "accepted_pn": 0 2024-09-16T03:24:48.721 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:48.721 INFO:tasks.workunit.client.0.smithi096.stderr:}' 2024-09-16T03:24:48.721 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:146: get_pool_id: jq '.osdmap.pools[] | select(.pool_name == "foo") | .pool' 2024-09-16T03:24:48.724 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:146: get_pool_id: echo '{' '"cluster_fingerprint":' '"fda2fc64-07ed-4add-8224-2e527e11d427",' '"version":' '"19.3.0-4930-gfc3e0bff",' '"commit":' '"fc3e0bff7468fd55478adbae7f75508b749124b6",' '"timestamp":' '"2024-09-16T03:24:48.583852+0000",' '"tag":' '"",' '"health":' '{' '"status":' '"HEALTH_OK",' '"checks":' '{},' '"mutes":' '[]' '},' '"monmap_first_committed":' 1, '"monmap_last_committed":' 1, '"monmap":' '{' '"epoch":' 1, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"modified":' '"2024-09-16T03:22:45.872880Z",' '"created":' '"2024-09-16T03:22:45.872880Z",' '"min_mon_release":' 19, '"min_mon_release_name":' '"squid",' '"election_strategy":' 1, '"disallowed_leaders:' '":' '"",' '"stretch_mode":' false, '"tiebreaker_mon":' '"",' '"removed_ranks:' '":' '"",' '"features":' '{' '"persistent":' '[' '"kraken",' '"luminous",' '"mimic",' '"osdmap-prune",' '"nautilus",' '"octopus",' '"pacific",' '"elector-pinging",' '"quincy",' '"reef",' '"squid"' '],' '"optional":' '[]' '},' '"mons":' '[' '{' '"rank":' 0, '"name":' '"a",' '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:7302",' '"nonce":' 0 '}' ']' '},' '"addr":' '"127.0.0.1:7302/0",' '"public_addr":' '"127.0.0.1:7302/0",' '"priority":' 0, '"weight":' 0, '"crush_location":' '"{}"' '}' ']' '},' '"quorum":' '[' 0 '],' '"osdmap":' '{' '"epoch":' 24, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"created":' '"2024-09-16T03:22:46.906117+0000",' '"modified":' '"2024-09-16T03:24:47.805467+0000",' '"last_up_change":' '"2024-09-16T03:24:37.708512+0000",' '"last_in_change":' '"2024-09-16T03:24:01.831039+0000",' '"flags":' '"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit",' '"flags_num":' 5799936, '"flags_set":' '[' '"pglog_hardlimit",' '"purged_snapdirs",' '"recovery_deletes",' '"sortbitwise"' '],' '"crush_version":' 7, '"full_ratio":' 0.99000000953674316, '"backfillfull_ratio":' 0.99000000953674316, '"nearfull_ratio":' 0.85000002384185791, '"cluster_snapshot":' '"",' '"pool_max":' 2, '"max_osd":' 3, '"require_min_compat_client":' '"luminous",' '"min_compat_client":' '"jewel",' '"require_osd_release":' '"squid",' '"allow_crimson":' false, '"pools":' '[' '{' '"pool":' 1, '"pool_name":' '"foo",' '"create_time":' '"2024-09-16T03:24:44.525189+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"21",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.690000057220459, '"score_stable":' 1.690000057220459, '"optimal_score":' 1, '"raw_score_acting":' 1.690000057220459, '"raw_score_stable":' 1.690000057220459, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '},' '{' '"pool":' 2, '"pool_name":' '"bar",' '"create_time":' '"2024-09-16T03:24:46.226575+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"24",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.1299999952316284, '"score_stable":' 1.1299999952316284, '"optimal_score":' 1, '"raw_score_acting":' 1.1299999952316284, '"raw_score_stable":' 1.1299999952316284, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '}' '],' '"osds":' '[' '{' '"osd":' 0, '"uuid":' '"64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 5, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6802",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6803",' '"nonce":' 3375787448 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6804",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6805",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6808",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6809",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6806",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6807",' '"nonce":' 3375787448 '}' ']' '},' '"public_addr":' '"127.0.0.1:6803/3375787448",' '"cluster_addr":' '"127.0.0.1:6805/3375787448",' '"heartbeat_back_addr":' '"127.0.0.1:6809/3375787448",' '"heartbeat_front_addr":' '"127.0.0.1:6807/3375787448",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 1, '"uuid":' '"74b26727-75c9-444d-8782-719e4197a382",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 10, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6810",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6811",' '"nonce":' 3733255132 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6812",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6813",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6816",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6817",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6814",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6815",' '"nonce":' 3733255132 '}' ']' '},' '"public_addr":' '"127.0.0.1:6811/3733255132",' '"cluster_addr":' '"127.0.0.1:6813/3733255132",' '"heartbeat_back_addr":' '"127.0.0.1:6817/3733255132",' '"heartbeat_front_addr":' '"127.0.0.1:6815/3733255132",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 2, '"uuid":' '"143da3a7-dad9-4b1e-966b-76cf5bdd3c82",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 15, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6818",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6819",' '"nonce":' 963814857 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6820",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6821",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6824",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6825",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6822",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6823",' '"nonce":' 963814857 '}' ']' '},' '"public_addr":' '"127.0.0.1:6819/963814857",' '"cluster_addr":' '"127.0.0.1:6821/963814857",' '"heartbeat_back_addr":' '"127.0.0.1:6825/963814857",' '"heartbeat_front_addr":' '"127.0.0.1:6823/963814857",' '"state":' '[' '"exists",' '"up"' ']' '}' '],' '"osd_xinfo":' '[' '{' '"osd":' 0, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:22.481942+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 1, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:59.663703+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 2, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:24:37.320822+0000",' '"dead_epoch":' 0 '}' '],' '"pg_upmap":' '[],' '"pg_upmap_items":' '[],' '"pg_upmap_primaries":' '[],' '"pg_temp":' '[],' '"primary_temp":' '[],' '"blocklist":' '{},' '"range_blocklist":' '{},' '"erasure_code_profiles":' '{' '"default":' '{' '"k":' '"2",' '"m":' '"2",' '"plugin":' '"jerasure",' '"technique":' '"reed_sol_van"' '}' '},' '"removed_snaps_queue":' '[],' '"new_removed_snaps":' '[],' '"new_purged_snaps":' '[],' '"crush_node_flags":' '{},' '"device_class_flags":' '{},' '"stretch_mode":' '{' '"stretch_mode_enabled":' false, '"stretch_bucket_count":' 0, '"degraded_stretch_mode":' 0, '"recovering_stretch_mode":' 0, '"stretch_mode_bucket":' 0 '}' '},' '"osd_metadata":' '[' '{' '"id":' 0, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/0/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:22:53.662571Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]",' '"hb_front_addr":' '"[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/0",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 1, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/1/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:23:30.129885Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]",' '"hb_front_addr":' '"[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/1",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 2, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/2/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:24:07.764502Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]",' '"hb_front_addr":' '"[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/2",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '}' '],' '"osdmap_clean_epochs":' '{' '"min_last_epoch_clean":' 0, '"last_epoch_clean":' '{' '"per_pool":' '[]' '},' '"osd_epochs":' '[' '{' '"id":' 0, '"epoch":' 16 '},' '{' '"id":' 1, '"epoch":' 16 '},' '{' '"id":' 2, '"epoch":' 15 '}' ']' '},' '"osdmap_first_committed":' 1, '"osdmap_last_committed":' 24, '"crushmap":' '{' '"devices":' '[' '{' '"id":' 0, '"name":' '"osd.0",' '"class":' '"hdd"' '},' '{' '"id":' 1, '"name":' '"osd.1",' '"class":' '"hdd"' '},' '{' '"id":' 2, '"name":' '"osd.2",' '"class":' '"hdd"' '}' '],' '"types":' '[' '{' '"type_id":' 0, '"name":' '"osd"' '},' '{' '"type_id":' 1, '"name":' '"host"' '},' '{' '"type_id":' 2, '"name":' '"chassis"' '},' '{' '"type_id":' 3, '"name":' '"rack"' '},' '{' '"type_id":' 4, '"name":' '"row"' '},' '{' '"type_id":' 5, '"name":' '"pdu"' '},' '{' '"type_id":' 6, '"name":' '"pod"' '},' '{' '"type_id":' 7, '"name":' '"room"' '},' '{' '"type_id":' 8, '"name":' '"datacenter"' '},' '{' '"type_id":' 9, '"name":' '"zone"' '},' '{' '"type_id":' 10, '"name":' '"region"' '},' '{' '"type_id":' 11, '"name":' '"root"' '}' '],' '"buckets":' '[' '{' '"id":' -1, '"name":' '"default",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -3, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -2, '"name":' '"default~hdd",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -4, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -3, '"name":' '"smithi096",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '},' '{' '"id":' -4, '"name":' '"smithi096~hdd",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '}' '],' '"rules":' '[' '{' '"rule_id":' 0, '"rule_name":' '"replicated_rule",' '"type":' 1, '"steps":' '[' '{' '"op":' '"take",' '"item":' -1, '"item_name":' '"default"' '},' '{' '"op":' '"choose_firstn",' '"num":' 0, '"type":' '"osd"' '},' '{' '"op":' '"emit"' '}' ']' '}' '],' '"tunables":' '{' '"choose_local_tries":' 0, '"choose_local_fallback_tries":' 0, '"choose_total_tries":' 50, '"chooseleaf_descend_once":' 1, '"chooseleaf_vary_r":' 1, '"chooseleaf_stable":' 1, '"msr_descents":' 100, '"msr_collision_tries":' 100, '"straw_calc_version":' 1, '"allowed_bucket_algs":' 54, '"profile":' '"jewel",' '"optimal_tunables":' 1, '"legacy_tunables":' 0, '"minimum_required_version":' '"jewel",' '"require_feature_tunables":' 1, '"require_feature_tunables2":' 1, '"has_v2_rules":' 0, '"require_feature_tunables3":' 1, '"has_v3_rules":' 0, '"has_v4_buckets":' 1, '"require_feature_tunables5":' 1, '"has_v5_rules":' 0, '"has_msr_rules":' 0 '},' '"choose_args":' '{}' '},' '"fsmap":' '{' '"epoch":' 1, '"btime":' '"2024-09-16T03:22:46:882186+0000",' '"default_fscid":' -1, '"compat":' '{' '"compat":' '{},' '"ro_compat":' '{},' '"incompat":' '{' '"feature_1":' '"base' 'v0.20",' '"feature_2":' '"client' writeable 'ranges",' '"feature_3":' '"default' file layouts on 'dirs",' '"feature_4":' '"dir' inode in separate 'object",' '"feature_5":' '"mds' uses versioned 'encoding",' '"feature_6":' '"dirfrag' is stored in 'omap",' '"feature_8":' '"no' anchor 'table",' '"feature_9":' '"file' layout 'v2",' '"feature_10":' '"snaprealm' 'v2",' '"feature_11":' '"minor' log 'segments",' '"feature_12":' '"quiesce' 'subvolumes"' '}' '},' '"feature_flags":' '{' '"enable_multiple":' true, '"ever_enabled_multiple":' true '},' '"standbys":' '[],' '"filesystems":' '[]' '},' '"mdsmap_first_committed":' 1, '"mdsmap_last_committed":' 1, '"auth":' '{' '"first_committed":' 1, '"last_committed":' 5, '"num_secrets":' 3 '},' '"num_pg":' 32, '"num_pg_active":' 0, '"num_pg_unknown":' 14, '"num_osd":' 3, '"pool_sum":' '{' '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 54, '"acting":' 54, '"num_store_stats":' 0 '},' '"osd_sum":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 24, '"num_osds":' 3, '"num_per_pool_osds":' 3, '"num_per_pool_omap_osds":' 1, '"kb":' 314572800, '"kb_used":' 490536, '"kb_used_data":' 416, '"kb_used_omap":' 4, '"kb_used_meta":' 80443, '"kb_avail":' 314082264, '"statfs":' '{' '"total":' 322122547200, '"available":' 321620238336, '"internally_reserved":' 0, '"allocated":' 425984, '"data_stored":' 102599, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 4785, '"internal_metadata":' 82373967 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 435, '"apply_latency_ms":' 435, '"commit_latency_ns":' 435000000, '"apply_latency_ns":' 435000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '},' '"osd_sum_by_class":' '{' '"hdd":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 24, '"num_osds":' 3, '"num_per_pool_osds":' 3, '"num_per_pool_omap_osds":' 1, '"kb":' 314572800, '"kb_used":' 490536, '"kb_used_data":' 416, '"kb_used_omap":' 4, '"kb_used_meta":' 80443, '"kb_avail":' 314082264, '"statfs":' '{' '"total":' 322122547200, '"available":' 321620238336, '"internally_reserved":' 0, '"allocated":' 425984, '"data_stored":' 102599, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 4785, '"internal_metadata":' 82373967 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 435, '"apply_latency_ms":' 435, '"commit_latency_ns":' 435000000, '"apply_latency_ns":' 435000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '}' '},' '"pool_stats":' '[' '{' '"poolid":' 1, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 54, '"acting":' 54, '"num_store_stats":' 1 '}' '],' '"osd_stats":' '[' '{' '"osd":' 0, '"seq":' 21474836503 '},' '{' '"osd":' 1, '"seq":' 42949672975 '},' '{' '"osd":' 2, '"seq":' 64424509447 '}' '],' '"num_pg_by_state":' '[' '{' '"state":' '"creating+activating",' '"num":' 18 '},' '{' '"state":' '"unknown",' '"num":' 14 '}' '],' '"num_pg_by_osd":' '[' '{' '"osd":' 2, '"num_primary_pg":' 0, '"num_acting_pg":' 18, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 0, '"num_primary_pg":' 0, '"num_acting_pg":' 18, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 1, '"num_primary_pg":' 18, '"num_acting_pg":' 18, '"num_up_not_acting_pg":' 0 '}' '],' '"purged_snaps":' '[],' '"servicemap":' '{' '"epoch":' 3, '"modified":' '"2024-09-16T03:24:24.403052+0000",' '"services":' '{' '"osd":' '{' '"daemons":' '{' '"summary":' '"",' '"1":' '{' '"start_epoch":' 0, '"start_stamp":' '"0.000000",' '"gid":' 0, '"addr":' '"(unrecognized' address family '0)/0",' '"metadata":' '{},' '"task_status":' '{}' '}' '}' '}' '}' '},' '"mgrstat_first_committed":' 44, '"mgrstat_last_committed":' 49, '"logm_first_committed":' 1, '"logm_last_committed":' 212, '"paxos":' '{' '"first_committed":' 1, '"last_committed":' 293, '"last_pn":' 0, '"accepted_pn":' 0 '}' '}' 2024-09-16T03:24:48.724 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:146: get_pool_id: pool_id=1 2024-09-16T03:24:48.724 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:148: get_pool_id: [[ 1 -ge 0 ]] 2024-09-16T03:24:48.724 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:151: get_pool_id: echo 1 2024-09-16T03:24:48.724 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:152: get_pool_id: return 0 2024-09-16T03:24:48.724 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:191: TEST_mon_last_clean_epoch: foo_id=1 2024-09-16T03:24:48.724 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:192: TEST_mon_last_clean_epoch: get_pool_id bar 2024-09-16T03:24:48.724 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:141: get_pool_id: local pn=bar 2024-09-16T03:24:48.725 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:142: get_pool_id: [[ -z bar ]] 2024-09-16T03:24:48.725 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:144: get_pool_id: ceph report 2024-09-16T03:24:49.165 INFO:tasks.workunit.client.0.smithi096.stderr:report 1079345788 2024-09-16T03:24:49.181 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:144: get_pool_id: report='{ 2024-09-16T03:24:49.181 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_fingerprint": "fda2fc64-07ed-4add-8224-2e527e11d427", 2024-09-16T03:24:49.182 INFO:tasks.workunit.client.0.smithi096.stderr: "version": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:24:49.182 INFO:tasks.workunit.client.0.smithi096.stderr: "commit": "fc3e0bff7468fd55478adbae7f75508b749124b6", 2024-09-16T03:24:49.182 INFO:tasks.workunit.client.0.smithi096.stderr: "timestamp": "2024-09-16T03:24:49.165672+0000", 2024-09-16T03:24:49.182 INFO:tasks.workunit.client.0.smithi096.stderr: "tag": "", 2024-09-16T03:24:49.182 INFO:tasks.workunit.client.0.smithi096.stderr: "health": { 2024-09-16T03:24:49.182 INFO:tasks.workunit.client.0.smithi096.stderr: "status": "HEALTH_OK", 2024-09-16T03:24:49.182 INFO:tasks.workunit.client.0.smithi096.stderr: "checks": {}, 2024-09-16T03:24:49.182 INFO:tasks.workunit.client.0.smithi096.stderr: "mutes": [] 2024-09-16T03:24:49.183 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.183 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap_first_committed": 1, 2024-09-16T03:24:49.183 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap_last_committed": 1, 2024-09-16T03:24:49.183 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap": { 2024-09-16T03:24:49.183 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 1, 2024-09-16T03:24:49.183 INFO:tasks.workunit.client.0.smithi096.stderr: "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", 2024-09-16T03:24:49.183 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:22:45.872880Z", 2024-09-16T03:24:49.183 INFO:tasks.workunit.client.0.smithi096.stderr: "created": "2024-09-16T03:22:45.872880Z", 2024-09-16T03:24:49.183 INFO:tasks.workunit.client.0.smithi096.stderr: "min_mon_release": 19, 2024-09-16T03:24:49.184 INFO:tasks.workunit.client.0.smithi096.stderr: "min_mon_release_name": "squid", 2024-09-16T03:24:49.184 INFO:tasks.workunit.client.0.smithi096.stderr: "election_strategy": 1, 2024-09-16T03:24:49.184 INFO:tasks.workunit.client.0.smithi096.stderr: "disallowed_leaders: ": "", 2024-09-16T03:24:49.184 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode": false, 2024-09-16T03:24:49.184 INFO:tasks.workunit.client.0.smithi096.stderr: "tiebreaker_mon": "", 2024-09-16T03:24:49.184 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_ranks: ": "", 2024-09-16T03:24:49.184 INFO:tasks.workunit.client.0.smithi096.stderr: "features": { 2024-09-16T03:24:49.184 INFO:tasks.workunit.client.0.smithi096.stderr: "persistent": [ 2024-09-16T03:24:49.185 INFO:tasks.workunit.client.0.smithi096.stderr: "kraken", 2024-09-16T03:24:49.185 INFO:tasks.workunit.client.0.smithi096.stderr: "luminous", 2024-09-16T03:24:49.185 INFO:tasks.workunit.client.0.smithi096.stderr: "mimic", 2024-09-16T03:24:49.185 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap-prune", 2024-09-16T03:24:49.185 INFO:tasks.workunit.client.0.smithi096.stderr: "nautilus", 2024-09-16T03:24:49.185 INFO:tasks.workunit.client.0.smithi096.stderr: "octopus", 2024-09-16T03:24:49.185 INFO:tasks.workunit.client.0.smithi096.stderr: "pacific", 2024-09-16T03:24:49.185 INFO:tasks.workunit.client.0.smithi096.stderr: "elector-pinging", 2024-09-16T03:24:49.185 INFO:tasks.workunit.client.0.smithi096.stderr: "quincy", 2024-09-16T03:24:49.186 INFO:tasks.workunit.client.0.smithi096.stderr: "reef", 2024-09-16T03:24:49.186 INFO:tasks.workunit.client.0.smithi096.stderr: "squid" 2024-09-16T03:24:49.186 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:49.186 INFO:tasks.workunit.client.0.smithi096.stderr: "optional": [] 2024-09-16T03:24:49.186 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.186 INFO:tasks.workunit.client.0.smithi096.stderr: "mons": [ 2024-09-16T03:24:49.186 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:49.186 INFO:tasks.workunit.client.0.smithi096.stderr: "rank": 0, 2024-09-16T03:24:49.186 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "a", 2024-09-16T03:24:49.186 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:24:49.187 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:49.187 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:49.187 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:49.187 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:7302", 2024-09-16T03:24:49.187 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 0 2024-09-16T03:24:49.187 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:49.187 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:49.187 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.187 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:7302/0", 2024-09-16T03:24:49.187 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:7302/0", 2024-09-16T03:24:49.187 INFO:tasks.workunit.client.0.smithi096.stderr: "priority": 0, 2024-09-16T03:24:49.187 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 0, 2024-09-16T03:24:49.187 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_location": "{}" 2024-09-16T03:24:49.187 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:49.188 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:49.188 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.188 INFO:tasks.workunit.client.0.smithi096.stderr: "quorum": [ 2024-09-16T03:24:49.188 INFO:tasks.workunit.client.0.smithi096.stderr: 0 2024-09-16T03:24:49.188 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:49.188 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap": { 2024-09-16T03:24:49.188 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 24, 2024-09-16T03:24:49.188 INFO:tasks.workunit.client.0.smithi096.stderr: "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", 2024-09-16T03:24:49.188 INFO:tasks.workunit.client.0.smithi096.stderr: "created": "2024-09-16T03:22:46.906117+0000", 2024-09-16T03:24:49.188 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:24:47.805467+0000", 2024-09-16T03:24:49.189 INFO:tasks.workunit.client.0.smithi096.stderr: "last_up_change": "2024-09-16T03:24:37.708512+0000", 2024-09-16T03:24:49.189 INFO:tasks.workunit.client.0.smithi096.stderr: "last_in_change": "2024-09-16T03:24:01.831039+0000", 2024-09-16T03:24:49.189 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-16T03:24:49.189 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_num": 5799936, 2024-09-16T03:24:49.189 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_set": [ 2024-09-16T03:24:49.189 INFO:tasks.workunit.client.0.smithi096.stderr: "pglog_hardlimit", 2024-09-16T03:24:49.189 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snapdirs", 2024-09-16T03:24:49.189 INFO:tasks.workunit.client.0.smithi096.stderr: "recovery_deletes", 2024-09-16T03:24:49.189 INFO:tasks.workunit.client.0.smithi096.stderr: "sortbitwise" 2024-09-16T03:24:49.190 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:49.190 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_version": 7, 2024-09-16T03:24:49.190 INFO:tasks.workunit.client.0.smithi096.stderr: "full_ratio": 0.99000000953674316, 2024-09-16T03:24:49.190 INFO:tasks.workunit.client.0.smithi096.stderr: "backfillfull_ratio": 0.99000000953674316, 2024-09-16T03:24:49.190 INFO:tasks.workunit.client.0.smithi096.stderr: "nearfull_ratio": 0.85000002384185791, 2024-09-16T03:24:49.190 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_snapshot": "", 2024-09-16T03:24:49.190 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_max": 2, 2024-09-16T03:24:49.190 INFO:tasks.workunit.client.0.smithi096.stderr: "max_osd": 3, 2024-09-16T03:24:49.190 INFO:tasks.workunit.client.0.smithi096.stderr: "require_min_compat_client": "luminous", 2024-09-16T03:24:49.191 INFO:tasks.workunit.client.0.smithi096.stderr: "min_compat_client": "jewel", 2024-09-16T03:24:49.191 INFO:tasks.workunit.client.0.smithi096.stderr: "require_osd_release": "squid", 2024-09-16T03:24:49.191 INFO:tasks.workunit.client.0.smithi096.stderr: "allow_crimson": false, 2024-09-16T03:24:49.191 INFO:tasks.workunit.client.0.smithi096.stderr: "pools": [ 2024-09-16T03:24:49.191 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:49.191 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 1, 2024-09-16T03:24:49.191 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_name": "foo", 2024-09-16T03:24:49.191 INFO:tasks.workunit.client.0.smithi096.stderr: "create_time": "2024-09-16T03:24:44.525189+0000", 2024-09-16T03:24:49.191 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": 1, 2024-09-16T03:24:49.191 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_names": "hashpspool", 2024-09-16T03:24:49.191 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:24:49.191 INFO:tasks.workunit.client.0.smithi096.stderr: "size": 3, 2024-09-16T03:24:49.191 INFO:tasks.workunit.client.0.smithi096.stderr: "min_size": 2, 2024-09-16T03:24:49.191 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_rule": 0, 2024-09-16T03:24:49.192 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_count": 0, 2024-09-16T03:24:49.192 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_target": 0, 2024-09-16T03:24:49.192 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_barrier": 0, 2024-09-16T03:24:49.192 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-16T03:24:49.192 INFO:tasks.workunit.client.0.smithi096.stderr: "is_stretch_pool": false, 2024-09-16T03:24:49.192 INFO:tasks.workunit.client.0.smithi096.stderr: "object_hash": 2, 2024-09-16T03:24:49.192 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_autoscale_mode": "off", 2024-09-16T03:24:49.192 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num": 32, 2024-09-16T03:24:49.192 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num": 32, 2024-09-16T03:24:49.192 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num_target": 32, 2024-09-16T03:24:49.192 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_target": 32, 2024-09-16T03:24:49.193 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_pending": 32, 2024-09-16T03:24:49.193 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pg_merge_meta": { 2024-09-16T03:24:49.193 INFO:tasks.workunit.client.0.smithi096.stderr: "source_pgid": "0.0", 2024-09-16T03:24:49.193 INFO:tasks.workunit.client.0.smithi096.stderr: "ready_epoch": 0, 2024-09-16T03:24:49.193 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_started": 0, 2024-09-16T03:24:49.193 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": 0, 2024-09-16T03:24:49.193 INFO:tasks.workunit.client.0.smithi096.stderr: "source_version": "0'\''0", 2024-09-16T03:24:49.193 INFO:tasks.workunit.client.0.smithi096.stderr: "target_version": "0'\''0" 2024-09-16T03:24:49.193 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.193 INFO:tasks.workunit.client.0.smithi096.stderr: "last_change": "21", 2024-09-16T03:24:49.193 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend": "0", 2024-09-16T03:24:49.193 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_prenautilus": "0", 2024-09-16T03:24:49.193 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_preluminous": "0", 2024-09-16T03:24:49.194 INFO:tasks.workunit.client.0.smithi096.stderr: "auid": 0, 2024-09-16T03:24:49.194 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_mode": "selfmanaged", 2024-09-16T03:24:49.194 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_seq": 0, 2024-09-16T03:24:49.194 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_epoch": 0, 2024-09-16T03:24:49.194 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_snaps": [], 2024-09-16T03:24:49.194 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps": "[]", 2024-09-16T03:24:49.194 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_bytes": 0, 2024-09-16T03:24:49.194 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_objects": 0, 2024-09-16T03:24:49.194 INFO:tasks.workunit.client.0.smithi096.stderr: "tiers": [], 2024-09-16T03:24:49.194 INFO:tasks.workunit.client.0.smithi096.stderr: "tier_of": -1, 2024-09-16T03:24:49.194 INFO:tasks.workunit.client.0.smithi096.stderr: "read_tier": -1, 2024-09-16T03:24:49.194 INFO:tasks.workunit.client.0.smithi096.stderr: "write_tier": -1, 2024-09-16T03:24:49.194 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_mode": "none", 2024-09-16T03:24:49.194 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_bytes": 0, 2024-09-16T03:24:49.194 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_objects": 0, 2024-09-16T03:24:49.195 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_ratio_micro": 400000, 2024-09-16T03:24:49.195 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-16T03:24:49.195 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_full_ratio_micro": 800000, 2024-09-16T03:24:49.195 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_flush_age": 0, 2024-09-16T03:24:49.195 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_evict_age": 0, 2024-09-16T03:24:49.195 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profile": "", 2024-09-16T03:24:49.195 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_params": { 2024-09-16T03:24:49.195 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "none" 2024-09-16T03:24:49.195 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.195 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_period": 0, 2024-09-16T03:24:49.195 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_count": 0, 2024-09-16T03:24:49.195 INFO:tasks.workunit.client.0.smithi096.stderr: "use_gmt_hitset": true, 2024-09-16T03:24:49.195 INFO:tasks.workunit.client.0.smithi096.stderr: "min_read_recency_for_promote": 0, 2024-09-16T03:24:49.195 INFO:tasks.workunit.client.0.smithi096.stderr: "min_write_recency_for_promote": 0, 2024-09-16T03:24:49.196 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_grade_decay_rate": 0, 2024-09-16T03:24:49.196 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_search_last_n": 0, 2024-09-16T03:24:49.196 INFO:tasks.workunit.client.0.smithi096.stderr: "grade_table": [], 2024-09-16T03:24:49.196 INFO:tasks.workunit.client.0.smithi096.stderr: "stripe_width": 0, 2024-09-16T03:24:49.196 INFO:tasks.workunit.client.0.smithi096.stderr: "expected_num_objects": 0, 2024-09-16T03:24:49.196 INFO:tasks.workunit.client.0.smithi096.stderr: "fast_read": false, 2024-09-16T03:24:49.196 INFO:tasks.workunit.client.0.smithi096.stderr: "options": {}, 2024-09-16T03:24:49.196 INFO:tasks.workunit.client.0.smithi096.stderr: "application_metadata": {}, 2024-09-16T03:24:49.196 INFO:tasks.workunit.client.0.smithi096.stderr: "read_balance": { 2024-09-16T03:24:49.196 INFO:tasks.workunit.client.0.smithi096.stderr: "score_type": "Fair distribution", 2024-09-16T03:24:49.196 INFO:tasks.workunit.client.0.smithi096.stderr: "score_acting": 1.690000057220459, 2024-09-16T03:24:49.196 INFO:tasks.workunit.client.0.smithi096.stderr: "score_stable": 1.690000057220459, 2024-09-16T03:24:49.196 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_score": 1, 2024-09-16T03:24:49.196 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_acting": 1.690000057220459, 2024-09-16T03:24:49.197 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_stable": 1.690000057220459, 2024-09-16T03:24:49.197 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity_weighted": 1, 2024-09-16T03:24:49.197 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity": 1, 2024-09-16T03:24:49.197 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity_weighted": 1 2024-09-16T03:24:49.197 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:49.197 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.197 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:49.197 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 2, 2024-09-16T03:24:49.197 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_name": "bar", 2024-09-16T03:24:49.197 INFO:tasks.workunit.client.0.smithi096.stderr: "create_time": "2024-09-16T03:24:46.226575+0000", 2024-09-16T03:24:49.197 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": 1, 2024-09-16T03:24:49.197 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_names": "hashpspool", 2024-09-16T03:24:49.197 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:24:49.198 INFO:tasks.workunit.client.0.smithi096.stderr: "size": 3, 2024-09-16T03:24:49.198 INFO:tasks.workunit.client.0.smithi096.stderr: "min_size": 2, 2024-09-16T03:24:49.198 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_rule": 0, 2024-09-16T03:24:49.198 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_count": 0, 2024-09-16T03:24:49.198 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_target": 0, 2024-09-16T03:24:49.198 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_barrier": 0, 2024-09-16T03:24:49.198 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-16T03:24:49.198 INFO:tasks.workunit.client.0.smithi096.stderr: "is_stretch_pool": false, 2024-09-16T03:24:49.198 INFO:tasks.workunit.client.0.smithi096.stderr: "object_hash": 2, 2024-09-16T03:24:49.198 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_autoscale_mode": "off", 2024-09-16T03:24:49.198 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num": 32, 2024-09-16T03:24:49.198 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num": 32, 2024-09-16T03:24:49.198 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num_target": 32, 2024-09-16T03:24:49.198 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_target": 32, 2024-09-16T03:24:49.199 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_pending": 32, 2024-09-16T03:24:49.199 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pg_merge_meta": { 2024-09-16T03:24:49.199 INFO:tasks.workunit.client.0.smithi096.stderr: "source_pgid": "0.0", 2024-09-16T03:24:49.199 INFO:tasks.workunit.client.0.smithi096.stderr: "ready_epoch": 0, 2024-09-16T03:24:49.199 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_started": 0, 2024-09-16T03:24:49.199 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": 0, 2024-09-16T03:24:49.199 INFO:tasks.workunit.client.0.smithi096.stderr: "source_version": "0'\''0", 2024-09-16T03:24:49.199 INFO:tasks.workunit.client.0.smithi096.stderr: "target_version": "0'\''0" 2024-09-16T03:24:49.199 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.199 INFO:tasks.workunit.client.0.smithi096.stderr: "last_change": "24", 2024-09-16T03:24:49.199 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend": "0", 2024-09-16T03:24:49.199 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_prenautilus": "0", 2024-09-16T03:24:49.199 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_preluminous": "0", 2024-09-16T03:24:49.199 INFO:tasks.workunit.client.0.smithi096.stderr: "auid": 0, 2024-09-16T03:24:49.200 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_mode": "selfmanaged", 2024-09-16T03:24:49.200 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_seq": 0, 2024-09-16T03:24:49.200 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_epoch": 0, 2024-09-16T03:24:49.200 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_snaps": [], 2024-09-16T03:24:49.200 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps": "[]", 2024-09-16T03:24:49.200 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_bytes": 0, 2024-09-16T03:24:49.200 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_objects": 0, 2024-09-16T03:24:49.200 INFO:tasks.workunit.client.0.smithi096.stderr: "tiers": [], 2024-09-16T03:24:49.200 INFO:tasks.workunit.client.0.smithi096.stderr: "tier_of": -1, 2024-09-16T03:24:49.200 INFO:tasks.workunit.client.0.smithi096.stderr: "read_tier": -1, 2024-09-16T03:24:49.200 INFO:tasks.workunit.client.0.smithi096.stderr: "write_tier": -1, 2024-09-16T03:24:49.200 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_mode": "none", 2024-09-16T03:24:49.200 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_bytes": 0, 2024-09-16T03:24:49.201 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_objects": 0, 2024-09-16T03:24:49.201 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_ratio_micro": 400000, 2024-09-16T03:24:49.201 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-16T03:24:49.201 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_full_ratio_micro": 800000, 2024-09-16T03:24:49.201 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_flush_age": 0, 2024-09-16T03:24:49.201 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_evict_age": 0, 2024-09-16T03:24:49.201 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profile": "", 2024-09-16T03:24:49.201 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_params": { 2024-09-16T03:24:49.201 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "none" 2024-09-16T03:24:49.201 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.201 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_period": 0, 2024-09-16T03:24:49.202 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_count": 0, 2024-09-16T03:24:49.202 INFO:tasks.workunit.client.0.smithi096.stderr: "use_gmt_hitset": true, 2024-09-16T03:24:49.202 INFO:tasks.workunit.client.0.smithi096.stderr: "min_read_recency_for_promote": 0, 2024-09-16T03:24:49.202 INFO:tasks.workunit.client.0.smithi096.stderr: "min_write_recency_for_promote": 0, 2024-09-16T03:24:49.202 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_grade_decay_rate": 0, 2024-09-16T03:24:49.202 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_search_last_n": 0, 2024-09-16T03:24:49.202 INFO:tasks.workunit.client.0.smithi096.stderr: "grade_table": [], 2024-09-16T03:24:49.202 INFO:tasks.workunit.client.0.smithi096.stderr: "stripe_width": 0, 2024-09-16T03:24:49.202 INFO:tasks.workunit.client.0.smithi096.stderr: "expected_num_objects": 0, 2024-09-16T03:24:49.202 INFO:tasks.workunit.client.0.smithi096.stderr: "fast_read": false, 2024-09-16T03:24:49.202 INFO:tasks.workunit.client.0.smithi096.stderr: "options": {}, 2024-09-16T03:24:49.202 INFO:tasks.workunit.client.0.smithi096.stderr: "application_metadata": {}, 2024-09-16T03:24:49.202 INFO:tasks.workunit.client.0.smithi096.stderr: "read_balance": { 2024-09-16T03:24:49.202 INFO:tasks.workunit.client.0.smithi096.stderr: "score_type": "Fair distribution", 2024-09-16T03:24:49.202 INFO:tasks.workunit.client.0.smithi096.stderr: "score_acting": 1.1299999952316284, 2024-09-16T03:24:49.203 INFO:tasks.workunit.client.0.smithi096.stderr: "score_stable": 1.1299999952316284, 2024-09-16T03:24:49.203 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_score": 1, 2024-09-16T03:24:49.203 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_acting": 1.1299999952316284, 2024-09-16T03:24:49.203 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_stable": 1.1299999952316284, 2024-09-16T03:24:49.203 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity_weighted": 1, 2024-09-16T03:24:49.203 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity": 1, 2024-09-16T03:24:49.203 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity_weighted": 1 2024-09-16T03:24:49.203 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:49.203 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:49.203 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:49.203 INFO:tasks.workunit.client.0.smithi096.stderr: "osds": [ 2024-09-16T03:24:49.203 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:49.203 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:24:49.203 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6", 2024-09-16T03:24:49.204 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:24:49.204 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:24:49.204 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:24:49.204 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:24:49.204 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:24:49.204 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:24:49.204 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 5, 2024-09-16T03:24:49.204 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 21, 2024-09-16T03:24:49.204 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:24:49.204 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:24:49.204 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:24:49.204 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:49.204 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:49.205 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:49.205 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6802", 2024-09-16T03:24:49.205 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:24:49.205 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.205 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:49.205 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:49.205 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6803", 2024-09-16T03:24:49.205 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:24:49.205 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:49.205 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:49.205 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.205 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:24:49.206 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:49.206 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:49.206 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:49.206 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6804", 2024-09-16T03:24:49.206 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:24:49.206 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.206 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:49.206 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:49.206 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6805", 2024-09-16T03:24:49.206 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:24:49.206 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:49.206 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:49.206 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.206 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:24:49.207 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:49.207 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:49.207 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:49.207 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6808", 2024-09-16T03:24:49.207 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:24:49.207 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.207 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:49.207 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:49.207 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6809", 2024-09-16T03:24:49.207 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:24:49.207 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:49.207 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:49.207 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.207 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:24:49.207 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:49.208 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:49.208 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:49.208 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6806", 2024-09-16T03:24:49.208 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:24:49.208 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.208 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:49.208 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:49.208 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6807", 2024-09-16T03:24:49.208 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:24:49.208 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:49.208 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:49.208 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.208 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6803/3375787448", 2024-09-16T03:24:49.208 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6805/3375787448", 2024-09-16T03:24:49.209 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6809/3375787448", 2024-09-16T03:24:49.209 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6807/3375787448", 2024-09-16T03:24:49.209 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:24:49.209 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:24:49.209 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:24:49.209 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:49.209 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.209 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:49.209 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:24:49.209 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "74b26727-75c9-444d-8782-719e4197a382", 2024-09-16T03:24:49.209 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:24:49.209 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:24:49.209 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:24:49.210 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:24:49.210 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:24:49.210 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:24:49.210 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 10, 2024-09-16T03:24:49.210 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 21, 2024-09-16T03:24:49.210 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:24:49.210 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:24:49.210 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:24:49.210 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:49.210 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:49.210 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:49.210 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6810", 2024-09-16T03:24:49.210 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:24:49.211 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.211 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:49.211 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:49.211 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6811", 2024-09-16T03:24:49.211 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:24:49.211 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:49.211 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:49.211 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.211 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:24:49.211 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:49.211 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:49.211 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:49.211 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6812", 2024-09-16T03:24:49.211 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:24:49.212 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.212 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:49.212 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:49.212 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6813", 2024-09-16T03:24:49.212 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:24:49.212 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:49.212 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:49.212 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.212 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:24:49.212 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:49.212 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:49.212 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:49.212 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6816", 2024-09-16T03:24:49.213 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:24:49.213 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.213 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:49.213 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:49.213 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6817", 2024-09-16T03:24:49.213 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:24:49.213 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:49.213 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:49.213 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.214 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:24:49.214 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:49.214 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:49.214 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:49.214 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6814", 2024-09-16T03:24:49.214 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:24:49.214 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.214 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:49.214 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:49.214 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6815", 2024-09-16T03:24:49.214 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:24:49.214 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:49.214 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:49.214 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.215 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6811/3733255132", 2024-09-16T03:24:49.215 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6813/3733255132", 2024-09-16T03:24:49.215 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6817/3733255132", 2024-09-16T03:24:49.215 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6815/3733255132", 2024-09-16T03:24:49.215 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:24:49.215 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:24:49.215 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:24:49.215 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:49.215 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.215 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:49.215 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:24:49.216 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "143da3a7-dad9-4b1e-966b-76cf5bdd3c82", 2024-09-16T03:24:49.216 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:24:49.216 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:24:49.216 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:24:49.216 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:24:49.216 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:24:49.216 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:24:49.216 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 15, 2024-09-16T03:24:49.216 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 21, 2024-09-16T03:24:49.216 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:24:49.216 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:24:49.216 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:24:49.216 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:49.217 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:49.217 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:49.217 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6818", 2024-09-16T03:24:49.217 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:24:49.217 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.217 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:49.217 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:49.217 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6819", 2024-09-16T03:24:49.217 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:24:49.217 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:49.217 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:49.217 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.218 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:24:49.218 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:49.218 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:49.218 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:49.218 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6820", 2024-09-16T03:24:49.218 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:24:49.218 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.218 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:49.218 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:49.218 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6821", 2024-09-16T03:24:49.218 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:24:49.218 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:49.218 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:49.218 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.218 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:24:49.219 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:49.219 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:49.219 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:49.219 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6824", 2024-09-16T03:24:49.219 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:24:49.219 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.219 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:49.219 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:49.219 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6825", 2024-09-16T03:24:49.219 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:24:49.220 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:49.220 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:49.220 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.220 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:24:49.220 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:49.220 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:49.221 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:49.221 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6822", 2024-09-16T03:24:49.221 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:24:49.221 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.221 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:49.221 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:49.222 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6823", 2024-09-16T03:24:49.222 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:24:49.222 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:49.222 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:49.222 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.222 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6819/963814857", 2024-09-16T03:24:49.223 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6821/963814857", 2024-09-16T03:24:49.223 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6825/963814857", 2024-09-16T03:24:49.223 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6823/963814857", 2024-09-16T03:24:49.223 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:24:49.223 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:24:49.223 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:24:49.224 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:49.224 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:49.224 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:49.224 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_xinfo": [ 2024-09-16T03:24:49.224 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:49.224 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:24:49.224 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:24:49.225 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:24:49.225 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:24:49.225 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:24:49.225 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:24:49.225 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:23:22.481942+0000", 2024-09-16T03:24:49.225 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:24:49.225 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.225 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:49.225 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:24:49.225 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:24:49.225 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:24:49.225 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:24:49.225 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:24:49.225 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:24:49.226 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:23:59.663703+0000", 2024-09-16T03:24:49.226 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:24:49.226 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.226 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:49.226 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:24:49.226 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:24:49.226 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:24:49.226 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:24:49.226 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:24:49.226 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:24:49.226 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:24:37.320822+0000", 2024-09-16T03:24:49.226 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:24:49.226 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:49.226 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:49.226 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap": [], 2024-09-16T03:24:49.227 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap_items": [], 2024-09-16T03:24:49.227 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap_primaries": [], 2024-09-16T03:24:49.227 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_temp": [], 2024-09-16T03:24:49.227 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_temp": [], 2024-09-16T03:24:49.227 INFO:tasks.workunit.client.0.smithi096.stderr: "blocklist": {}, 2024-09-16T03:24:49.227 INFO:tasks.workunit.client.0.smithi096.stderr: "range_blocklist": {}, 2024-09-16T03:24:49.227 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profiles": { 2024-09-16T03:24:49.227 INFO:tasks.workunit.client.0.smithi096.stderr: "default": { 2024-09-16T03:24:49.227 INFO:tasks.workunit.client.0.smithi096.stderr: "k": "2", 2024-09-16T03:24:49.227 INFO:tasks.workunit.client.0.smithi096.stderr: "m": "2", 2024-09-16T03:24:49.227 INFO:tasks.workunit.client.0.smithi096.stderr: "plugin": "jerasure", 2024-09-16T03:24:49.227 INFO:tasks.workunit.client.0.smithi096.stderr: "technique": "reed_sol_van" 2024-09-16T03:24:49.227 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:49.227 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.228 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps_queue": [], 2024-09-16T03:24:49.228 INFO:tasks.workunit.client.0.smithi096.stderr: "new_removed_snaps": [], 2024-09-16T03:24:49.228 INFO:tasks.workunit.client.0.smithi096.stderr: "new_purged_snaps": [], 2024-09-16T03:24:49.228 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_node_flags": {}, 2024-09-16T03:24:49.229 INFO:tasks.workunit.client.0.smithi096.stderr: "device_class_flags": {}, 2024-09-16T03:24:49.229 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode": { 2024-09-16T03:24:49.229 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode_enabled": false, 2024-09-16T03:24:49.229 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_bucket_count": 0, 2024-09-16T03:24:49.229 INFO:tasks.workunit.client.0.smithi096.stderr: "degraded_stretch_mode": 0, 2024-09-16T03:24:49.229 INFO:tasks.workunit.client.0.smithi096.stderr: "recovering_stretch_mode": 0, 2024-09-16T03:24:49.229 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode_bucket": 0 2024-09-16T03:24:49.229 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:49.229 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.229 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_metadata": [ 2024-09-16T03:24:49.230 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:49.230 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:24:49.230 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:24:49.230 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]", 2024-09-16T03:24:49.230 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:24:49.230 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:24:49.230 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:24:49.230 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:24:49.230 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:24:49.230 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:24:49.230 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:24:49.230 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:24:49.231 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:24:49.231 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:24:49.231 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:24:49.231 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/0/block", 2024-09-16T03:24:49.231 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:24:49.231 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:24:49.231 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:24:49.231 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:24:49.231 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:24:49.231 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:24:49.231 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:24:49.231 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:24:49.231 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:24:49.232 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:24:49.232 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:22:53.662571Z", 2024-09-16T03:24:49.232 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:24:49.232 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:24:49.232 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:24:49.232 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:24:49.232 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:24:49.232 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:24:49.232 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:24:49.232 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]", 2024-09-16T03:24:49.232 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:24:49.232 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]", 2024-09-16T03:24:49.232 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]", 2024-09-16T03:24:49.233 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:24:49.233 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:24:49.233 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:24:49.233 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:24:49.233 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:24:49.233 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:24:49.233 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:24:49.233 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:24:49.233 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:24:49.233 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/0", 2024-09-16T03:24:49.233 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:24:49.234 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:24:49.234 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:24:49.234 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.234 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:49.234 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:24:49.234 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:24:49.234 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]", 2024-09-16T03:24:49.234 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:24:49.234 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:24:49.234 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:24:49.234 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:24:49.234 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:24:49.234 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:24:49.234 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:24:49.234 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:24:49.235 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:24:49.235 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:24:49.235 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:24:49.235 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/1/block", 2024-09-16T03:24:49.235 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:24:49.235 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:24:49.235 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:24:49.235 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:24:49.235 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:24:49.235 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:24:49.235 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:24:49.235 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:24:49.235 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:24:49.235 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:24:49.236 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:23:30.129885Z", 2024-09-16T03:24:49.236 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:24:49.236 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:24:49.236 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:24:49.236 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:24:49.236 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:24:49.236 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:24:49.236 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:24:49.236 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]", 2024-09-16T03:24:49.236 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:24:49.237 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]", 2024-09-16T03:24:49.237 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]", 2024-09-16T03:24:49.237 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:24:49.237 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:24:49.237 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:24:49.237 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:24:49.237 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:24:49.237 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:24:49.237 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:24:49.237 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:24:49.237 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:24:49.237 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/1", 2024-09-16T03:24:49.237 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:24:49.237 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:24:49.238 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:24:49.238 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.238 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:49.238 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:24:49.238 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:24:49.238 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]", 2024-09-16T03:24:49.238 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:24:49.238 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:24:49.238 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:24:49.238 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:24:49.238 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:24:49.238 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:24:49.238 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:24:49.238 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:24:49.239 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:24:49.239 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:24:49.239 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:24:49.239 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/2/block", 2024-09-16T03:24:49.239 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:24:49.239 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:24:49.239 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:24:49.239 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:24:49.239 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:24:49.239 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:24:49.239 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:24:49.239 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:24:49.239 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:24:49.239 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:24:49.240 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:24:07.764502Z", 2024-09-16T03:24:49.240 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:24:49.240 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:24:49.240 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:24:49.240 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:24:49.240 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:24:49.240 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:24:49.240 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:24:49.240 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]", 2024-09-16T03:24:49.240 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:24:49.240 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]", 2024-09-16T03:24:49.240 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]", 2024-09-16T03:24:49.240 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:24:49.240 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:24:49.241 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:24:49.241 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:24:49.241 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:24:49.241 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:24:49.242 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:24:49.242 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:24:49.242 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:24:49.242 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/2", 2024-09-16T03:24:49.242 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:24:49.242 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:24:49.243 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:24:49.243 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:49.243 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:49.243 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_clean_epochs": { 2024-09-16T03:24:49.244 INFO:tasks.workunit.client.0.smithi096.stderr: "min_last_epoch_clean": 0, 2024-09-16T03:24:49.244 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": { 2024-09-16T03:24:49.244 INFO:tasks.workunit.client.0.smithi096.stderr: "per_pool": [] 2024-09-16T03:24:49.244 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.244 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_epochs": [ 2024-09-16T03:24:49.244 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:49.244 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:24:49.244 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 16 2024-09-16T03:24:49.245 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.245 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:49.245 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:24:49.245 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 16 2024-09-16T03:24:49.245 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.245 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:49.245 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:24:49.245 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 15 2024-09-16T03:24:49.245 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:49.245 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:49.245 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.245 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_first_committed": 1, 2024-09-16T03:24:49.245 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_last_committed": 24, 2024-09-16T03:24:49.245 INFO:tasks.workunit.client.0.smithi096.stderr: "crushmap": { 2024-09-16T03:24:49.246 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": [ 2024-09-16T03:24:49.246 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:49.246 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:24:49.246 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.0", 2024-09-16T03:24:49.246 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:24:49.246 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.246 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:49.246 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:24:49.246 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.1", 2024-09-16T03:24:49.246 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:24:49.246 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.246 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:49.246 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:24:49.246 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.2", 2024-09-16T03:24:49.246 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:24:49.247 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:49.247 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:49.247 INFO:tasks.workunit.client.0.smithi096.stderr: "types": [ 2024-09-16T03:24:49.247 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:49.247 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 0, 2024-09-16T03:24:49.247 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd" 2024-09-16T03:24:49.247 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.247 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:49.247 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:24:49.247 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "host" 2024-09-16T03:24:49.247 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.247 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:49.247 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 2, 2024-09-16T03:24:49.247 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "chassis" 2024-09-16T03:24:49.248 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.248 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:49.248 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 3, 2024-09-16T03:24:49.248 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "rack" 2024-09-16T03:24:49.248 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.248 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:49.248 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 4, 2024-09-16T03:24:49.248 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "row" 2024-09-16T03:24:49.248 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.248 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:49.248 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 5, 2024-09-16T03:24:49.248 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "pdu" 2024-09-16T03:24:49.248 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.248 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:49.249 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 6, 2024-09-16T03:24:49.249 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "pod" 2024-09-16T03:24:49.249 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.249 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:49.249 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 7, 2024-09-16T03:24:49.249 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "room" 2024-09-16T03:24:49.249 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.249 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:49.249 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 8, 2024-09-16T03:24:49.249 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "datacenter" 2024-09-16T03:24:49.249 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.249 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:49.249 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 9, 2024-09-16T03:24:49.249 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "zone" 2024-09-16T03:24:49.250 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.250 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:49.250 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 10, 2024-09-16T03:24:49.250 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "region" 2024-09-16T03:24:49.250 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.250 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:49.250 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:24:49.250 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "root" 2024-09-16T03:24:49.250 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:49.250 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:49.250 INFO:tasks.workunit.client.0.smithi096.stderr: "buckets": [ 2024-09-16T03:24:49.250 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:49.250 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -1, 2024-09-16T03:24:49.250 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "default", 2024-09-16T03:24:49.251 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:24:49.251 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "root", 2024-09-16T03:24:49.251 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:24:49.251 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:24:49.251 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:24:49.251 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:24:49.251 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:49.251 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -3, 2024-09-16T03:24:49.251 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:24:49.251 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:24:49.251 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:49.251 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:49.251 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.251 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:49.252 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -2, 2024-09-16T03:24:49.252 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "default~hdd", 2024-09-16T03:24:49.252 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:24:49.252 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "root", 2024-09-16T03:24:49.252 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:24:49.252 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:24:49.252 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:24:49.252 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:24:49.252 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:49.252 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -4, 2024-09-16T03:24:49.252 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:24:49.252 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:24:49.252 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:49.253 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:49.253 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.253 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:49.253 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -3, 2024-09-16T03:24:49.253 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "smithi096", 2024-09-16T03:24:49.253 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:24:49.253 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "host", 2024-09-16T03:24:49.253 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:24:49.253 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:24:49.253 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:24:49.253 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:24:49.253 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:49.253 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:24:49.253 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:24:49.254 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:24:49.254 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.254 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:49.254 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:24:49.254 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:24:49.254 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 1 2024-09-16T03:24:49.254 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.254 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:49.254 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:24:49.254 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:24:49.254 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 2 2024-09-16T03:24:49.254 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:49.254 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:49.254 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.254 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:49.255 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -4, 2024-09-16T03:24:49.255 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "smithi096~hdd", 2024-09-16T03:24:49.255 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:24:49.255 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "host", 2024-09-16T03:24:49.255 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:24:49.255 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:24:49.255 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:24:49.255 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:24:49.255 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:49.255 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:24:49.255 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:24:49.255 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:24:49.255 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.255 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:49.255 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:24:49.256 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:24:49.256 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 1 2024-09-16T03:24:49.256 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.256 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:49.256 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:24:49.256 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:24:49.256 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 2 2024-09-16T03:24:49.256 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:49.256 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:49.256 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:49.256 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:49.256 INFO:tasks.workunit.client.0.smithi096.stderr: "rules": [ 2024-09-16T03:24:49.256 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:49.257 INFO:tasks.workunit.client.0.smithi096.stderr: "rule_id": 0, 2024-09-16T03:24:49.257 INFO:tasks.workunit.client.0.smithi096.stderr: "rule_name": "replicated_rule", 2024-09-16T03:24:49.257 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:24:49.257 INFO:tasks.workunit.client.0.smithi096.stderr: "steps": [ 2024-09-16T03:24:49.257 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:49.257 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "take", 2024-09-16T03:24:49.257 INFO:tasks.workunit.client.0.smithi096.stderr: "item": -1, 2024-09-16T03:24:49.257 INFO:tasks.workunit.client.0.smithi096.stderr: "item_name": "default" 2024-09-16T03:24:49.257 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.257 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:49.257 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "choose_firstn", 2024-09-16T03:24:49.257 INFO:tasks.workunit.client.0.smithi096.stderr: "num": 0, 2024-09-16T03:24:49.257 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "osd" 2024-09-16T03:24:49.257 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.258 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:49.258 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "emit" 2024-09-16T03:24:49.258 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:49.258 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:49.258 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:49.258 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:49.258 INFO:tasks.workunit.client.0.smithi096.stderr: "tunables": { 2024-09-16T03:24:49.258 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_local_tries": 0, 2024-09-16T03:24:49.258 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_local_fallback_tries": 0, 2024-09-16T03:24:49.258 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_total_tries": 50, 2024-09-16T03:24:49.258 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_descend_once": 1, 2024-09-16T03:24:49.258 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_vary_r": 1, 2024-09-16T03:24:49.258 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_stable": 1, 2024-09-16T03:24:49.258 INFO:tasks.workunit.client.0.smithi096.stderr: "msr_descents": 100, 2024-09-16T03:24:49.259 INFO:tasks.workunit.client.0.smithi096.stderr: "msr_collision_tries": 100, 2024-09-16T03:24:49.259 INFO:tasks.workunit.client.0.smithi096.stderr: "straw_calc_version": 1, 2024-09-16T03:24:49.259 INFO:tasks.workunit.client.0.smithi096.stderr: "allowed_bucket_algs": 54, 2024-09-16T03:24:49.259 INFO:tasks.workunit.client.0.smithi096.stderr: "profile": "jewel", 2024-09-16T03:24:49.259 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_tunables": 1, 2024-09-16T03:24:49.259 INFO:tasks.workunit.client.0.smithi096.stderr: "legacy_tunables": 0, 2024-09-16T03:24:49.259 INFO:tasks.workunit.client.0.smithi096.stderr: "minimum_required_version": "jewel", 2024-09-16T03:24:49.259 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables": 1, 2024-09-16T03:24:49.259 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables2": 1, 2024-09-16T03:24:49.259 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v2_rules": 0, 2024-09-16T03:24:49.259 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables3": 1, 2024-09-16T03:24:49.259 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v3_rules": 0, 2024-09-16T03:24:49.259 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v4_buckets": 1, 2024-09-16T03:24:49.259 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables5": 1, 2024-09-16T03:24:49.260 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v5_rules": 0, 2024-09-16T03:24:49.260 INFO:tasks.workunit.client.0.smithi096.stderr: "has_msr_rules": 0 2024-09-16T03:24:49.260 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.260 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_args": {} 2024-09-16T03:24:49.260 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.260 INFO:tasks.workunit.client.0.smithi096.stderr: "fsmap": { 2024-09-16T03:24:49.260 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 1, 2024-09-16T03:24:49.260 INFO:tasks.workunit.client.0.smithi096.stderr: "btime": "2024-09-16T03:22:46:882186+0000", 2024-09-16T03:24:49.260 INFO:tasks.workunit.client.0.smithi096.stderr: "default_fscid": -1, 2024-09-16T03:24:49.260 INFO:tasks.workunit.client.0.smithi096.stderr: "compat": { 2024-09-16T03:24:49.260 INFO:tasks.workunit.client.0.smithi096.stderr: "compat": {}, 2024-09-16T03:24:49.260 INFO:tasks.workunit.client.0.smithi096.stderr: "ro_compat": {}, 2024-09-16T03:24:49.260 INFO:tasks.workunit.client.0.smithi096.stderr: "incompat": { 2024-09-16T03:24:49.260 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_1": "base v0.20", 2024-09-16T03:24:49.261 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_2": "client writeable ranges", 2024-09-16T03:24:49.261 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_3": "default file layouts on dirs", 2024-09-16T03:24:49.261 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_4": "dir inode in separate object", 2024-09-16T03:24:49.261 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_5": "mds uses versioned encoding", 2024-09-16T03:24:49.261 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_6": "dirfrag is stored in omap", 2024-09-16T03:24:49.261 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_8": "no anchor table", 2024-09-16T03:24:49.261 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_9": "file layout v2", 2024-09-16T03:24:49.261 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_10": "snaprealm v2", 2024-09-16T03:24:49.261 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_11": "minor log segments", 2024-09-16T03:24:49.261 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_12": "quiesce subvolumes" 2024-09-16T03:24:49.261 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:49.261 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.261 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_flags": { 2024-09-16T03:24:49.261 INFO:tasks.workunit.client.0.smithi096.stderr: "enable_multiple": true, 2024-09-16T03:24:49.261 INFO:tasks.workunit.client.0.smithi096.stderr: "ever_enabled_multiple": true 2024-09-16T03:24:49.262 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.262 INFO:tasks.workunit.client.0.smithi096.stderr: "standbys": [], 2024-09-16T03:24:49.262 INFO:tasks.workunit.client.0.smithi096.stderr: "filesystems": [] 2024-09-16T03:24:49.262 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.262 INFO:tasks.workunit.client.0.smithi096.stderr: "mdsmap_first_committed": 1, 2024-09-16T03:24:49.262 INFO:tasks.workunit.client.0.smithi096.stderr: "mdsmap_last_committed": 1, 2024-09-16T03:24:49.262 INFO:tasks.workunit.client.0.smithi096.stderr: "auth": { 2024-09-16T03:24:49.262 INFO:tasks.workunit.client.0.smithi096.stderr: "first_committed": 1, 2024-09-16T03:24:49.262 INFO:tasks.workunit.client.0.smithi096.stderr: "last_committed": 5, 2024-09-16T03:24:49.262 INFO:tasks.workunit.client.0.smithi096.stderr: "num_secrets": 3 2024-09-16T03:24:49.262 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.262 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 64, 2024-09-16T03:24:49.262 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_active": 15, 2024-09-16T03:24:49.263 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_unknown": 31, 2024-09-16T03:24:49.263 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osd": 3, 2024-09-16T03:24:49.263 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_sum": { 2024-09-16T03:24:49.263 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:24:49.263 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:24:49.263 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:24:49.263 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:24:49.263 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:24:49.263 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:24:49.263 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:24:49.263 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:24:49.263 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:24:49.263 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:24:49.263 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:24:49.263 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:24:49.264 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:24:49.264 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:24:49.264 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:24:49.264 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:24:49.264 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:24:49.264 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:24:49.264 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:24:49.264 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:24:49.264 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:24:49.264 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:24:49.264 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:24:49.264 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:24:49.264 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:24:49.264 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:24:49.265 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:24:49.265 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:24:49.265 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:24:49.265 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:24:49.265 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:24:49.265 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:24:49.265 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:24:49.265 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:24:49.265 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:24:49.265 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:24:49.265 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:24:49.265 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:24:49.265 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:24:49.265 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:24:49.266 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:24:49.266 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.266 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:24:49.266 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:24:49.266 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:24:49.266 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:24:49.266 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:24:49.266 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:24:49.266 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:24:49.266 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:24:49.266 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:24:49.266 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:24:49.266 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:24:49.266 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.266 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:24:49.267 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:24:49.267 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 99, 2024-09-16T03:24:49.267 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 99, 2024-09-16T03:24:49.267 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 0 2024-09-16T03:24:49.267 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.267 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_sum": { 2024-09-16T03:24:49.267 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 0, 2024-09-16T03:24:49.267 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 0, 2024-09-16T03:24:49.267 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pgs": 24, 2024-09-16T03:24:49.267 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osds": 3, 2024-09-16T03:24:49.267 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_osds": 3, 2024-09-16T03:24:49.267 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_omap_osds": 2, 2024-09-16T03:24:49.267 INFO:tasks.workunit.client.0.smithi096.stderr: "kb": 314572800, 2024-09-16T03:24:49.267 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used": 80992, 2024-09-16T03:24:49.268 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_data": 472, 2024-09-16T03:24:49.268 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_omap": 4, 2024-09-16T03:24:49.268 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_meta": 80443, 2024-09-16T03:24:49.268 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_avail": 314491808, 2024-09-16T03:24:49.268 INFO:tasks.workunit.client.0.smithi096.stderr: "statfs": { 2024-09-16T03:24:49.268 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 322122547200, 2024-09-16T03:24:49.268 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 322039611392, 2024-09-16T03:24:49.268 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:24:49.268 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 483328, 2024-09-16T03:24:49.268 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 123708, 2024-09-16T03:24:49.268 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:24:49.268 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:24:49.268 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:24:49.269 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 4785, 2024-09-16T03:24:49.269 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 82373967 2024-09-16T03:24:49.269 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.269 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_peers": [], 2024-09-16T03:24:49.269 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_trim_queue_len": 0, 2024-09-16T03:24:49.269 INFO:tasks.workunit.client.0.smithi096.stderr: "num_snap_trimming": 0, 2024-09-16T03:24:49.269 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shards_repaired": 0, 2024-09-16T03:24:49.269 INFO:tasks.workunit.client.0.smithi096.stderr: "op_queue_age_hist": { 2024-09-16T03:24:49.269 INFO:tasks.workunit.client.0.smithi096.stderr: "histogram": [], 2024-09-16T03:24:49.269 INFO:tasks.workunit.client.0.smithi096.stderr: "upper_bound": 1 2024-09-16T03:24:49.269 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.269 INFO:tasks.workunit.client.0.smithi096.stderr: "perf_stat": { 2024-09-16T03:24:49.269 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ms": 543, 2024-09-16T03:24:49.269 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ms": 543, 2024-09-16T03:24:49.269 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ns": 543000000, 2024-09-16T03:24:49.270 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ns": 543000000 2024-09-16T03:24:49.270 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.270 INFO:tasks.workunit.client.0.smithi096.stderr: "alerts": [], 2024-09-16T03:24:49.270 INFO:tasks.workunit.client.0.smithi096.stderr: "network_ping_times": [] 2024-09-16T03:24:49.270 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.270 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_sum_by_class": { 2024-09-16T03:24:49.270 INFO:tasks.workunit.client.0.smithi096.stderr: "hdd": { 2024-09-16T03:24:49.270 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 0, 2024-09-16T03:24:49.270 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 0, 2024-09-16T03:24:49.270 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pgs": 24, 2024-09-16T03:24:49.270 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osds": 3, 2024-09-16T03:24:49.270 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_osds": 3, 2024-09-16T03:24:49.270 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_omap_osds": 2, 2024-09-16T03:24:49.270 INFO:tasks.workunit.client.0.smithi096.stderr: "kb": 314572800, 2024-09-16T03:24:49.271 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used": 80992, 2024-09-16T03:24:49.271 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_data": 472, 2024-09-16T03:24:49.271 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_omap": 4, 2024-09-16T03:24:49.271 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_meta": 80443, 2024-09-16T03:24:49.271 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_avail": 314491808, 2024-09-16T03:24:49.271 INFO:tasks.workunit.client.0.smithi096.stderr: "statfs": { 2024-09-16T03:24:49.271 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 322122547200, 2024-09-16T03:24:49.271 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 322039611392, 2024-09-16T03:24:49.271 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:24:49.271 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 483328, 2024-09-16T03:24:49.271 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 123708, 2024-09-16T03:24:49.271 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:24:49.271 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:24:49.271 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:24:49.272 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 4785, 2024-09-16T03:24:49.272 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 82373967 2024-09-16T03:24:49.272 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.272 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_peers": [], 2024-09-16T03:24:49.272 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_trim_queue_len": 0, 2024-09-16T03:24:49.272 INFO:tasks.workunit.client.0.smithi096.stderr: "num_snap_trimming": 0, 2024-09-16T03:24:49.272 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shards_repaired": 0, 2024-09-16T03:24:49.272 INFO:tasks.workunit.client.0.smithi096.stderr: "op_queue_age_hist": { 2024-09-16T03:24:49.272 INFO:tasks.workunit.client.0.smithi096.stderr: "histogram": [], 2024-09-16T03:24:49.272 INFO:tasks.workunit.client.0.smithi096.stderr: "upper_bound": 1 2024-09-16T03:24:49.272 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.272 INFO:tasks.workunit.client.0.smithi096.stderr: "perf_stat": { 2024-09-16T03:24:49.272 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ms": 543, 2024-09-16T03:24:49.272 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ms": 543, 2024-09-16T03:24:49.273 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ns": 543000000, 2024-09-16T03:24:49.273 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ns": 543000000 2024-09-16T03:24:49.273 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.273 INFO:tasks.workunit.client.0.smithi096.stderr: "alerts": [], 2024-09-16T03:24:49.273 INFO:tasks.workunit.client.0.smithi096.stderr: "network_ping_times": [] 2024-09-16T03:24:49.273 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:49.273 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.273 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_stats": [ 2024-09-16T03:24:49.273 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:49.273 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 2, 2024-09-16T03:24:49.273 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 32, 2024-09-16T03:24:49.273 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:24:49.273 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:24:49.273 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:24:49.274 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:24:49.274 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:24:49.274 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:24:49.274 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:24:49.274 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:24:49.274 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:24:49.274 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:24:49.274 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:24:49.274 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:24:49.274 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:24:49.274 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:24:49.274 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:24:49.274 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:24:49.274 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:24:49.274 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:24:49.275 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:24:49.275 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:24:49.275 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:24:49.275 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:24:49.275 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:24:49.275 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:24:49.275 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:24:49.275 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:24:49.275 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:24:49.275 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:24:49.275 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:24:49.275 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:24:49.275 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:24:49.275 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:24:49.276 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:24:49.276 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:24:49.276 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:24:49.276 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:24:49.276 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:24:49.276 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:24:49.276 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:24:49.276 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:24:49.276 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:24:49.276 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.276 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:24:49.276 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:24:49.276 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:24:49.276 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:24:49.277 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:24:49.277 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:24:49.277 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:24:49.277 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:24:49.277 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:24:49.277 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:24:49.277 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:24:49.277 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.277 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:24:49.277 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:24:49.277 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 27, 2024-09-16T03:24:49.277 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 27, 2024-09-16T03:24:49.277 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 1 2024-09-16T03:24:49.278 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.278 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:49.278 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 1, 2024-09-16T03:24:49.278 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 32, 2024-09-16T03:24:49.278 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:24:49.278 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:24:49.278 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:24:49.278 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:24:49.278 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:24:49.278 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:24:49.278 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:24:49.278 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:24:49.278 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:24:49.278 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:24:49.279 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:24:49.279 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:24:49.279 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:24:49.279 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:24:49.279 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:24:49.279 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:24:49.279 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:24:49.279 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:24:49.279 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:24:49.279 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:24:49.279 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:24:49.279 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:24:49.279 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:24:49.279 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:24:49.279 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:24:49.280 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:24:49.280 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:24:49.280 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:24:49.280 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:24:49.280 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:24:49.280 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:24:49.280 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:24:49.280 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:24:49.280 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:24:49.280 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:24:49.280 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:24:49.280 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:24:49.280 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:24:49.281 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:24:49.281 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:24:49.281 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:24:49.281 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.281 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:24:49.281 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:24:49.281 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:24:49.281 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:24:49.281 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:24:49.281 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:24:49.281 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:24:49.281 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:24:49.281 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:24:49.281 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:24:49.282 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:24:49.282 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.282 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:24:49.282 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:24:49.282 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 72, 2024-09-16T03:24:49.282 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 72, 2024-09-16T03:24:49.282 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 2 2024-09-16T03:24:49.282 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:49.282 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:49.282 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_stats": [ 2024-09-16T03:24:49.282 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:49.282 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:24:49.282 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 21474836503 2024-09-16T03:24:49.282 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.282 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:49.283 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:24:49.283 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 42949672975 2024-09-16T03:24:49.283 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.283 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:49.283 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:24:49.283 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 64424509448 2024-09-16T03:24:49.283 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:49.283 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:49.283 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_by_state": [ 2024-09-16T03:24:49.283 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:49.283 INFO:tasks.workunit.client.0.smithi096.stderr: "state": "active+clean", 2024-09-16T03:24:49.283 INFO:tasks.workunit.client.0.smithi096.stderr: "num": 15 2024-09-16T03:24:49.283 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.283 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:49.284 INFO:tasks.workunit.client.0.smithi096.stderr: "state": "creating+activating", 2024-09-16T03:24:49.284 INFO:tasks.workunit.client.0.smithi096.stderr: "num": 18 2024-09-16T03:24:49.284 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.284 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:49.284 INFO:tasks.workunit.client.0.smithi096.stderr: "state": "unknown", 2024-09-16T03:24:49.284 INFO:tasks.workunit.client.0.smithi096.stderr: "num": 31 2024-09-16T03:24:49.284 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:49.284 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:49.284 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_by_osd": [ 2024-09-16T03:24:49.284 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:49.284 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:24:49.284 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 15, 2024-09-16T03:24:49.284 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 33, 2024-09-16T03:24:49.284 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:24:49.285 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.285 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:49.285 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:24:49.285 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 0, 2024-09-16T03:24:49.285 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 33, 2024-09-16T03:24:49.285 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:24:49.285 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.285 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:49.285 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:24:49.285 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 18, 2024-09-16T03:24:49.285 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 33, 2024-09-16T03:24:49.285 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:24:49.285 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:49.285 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:49.286 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": [], 2024-09-16T03:24:49.286 INFO:tasks.workunit.client.0.smithi096.stderr: "servicemap": { 2024-09-16T03:24:49.286 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 3, 2024-09-16T03:24:49.286 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:24:24.403052+0000", 2024-09-16T03:24:49.286 INFO:tasks.workunit.client.0.smithi096.stderr: "services": { 2024-09-16T03:24:49.286 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": { 2024-09-16T03:24:49.286 INFO:tasks.workunit.client.0.smithi096.stderr: "daemons": { 2024-09-16T03:24:49.286 INFO:tasks.workunit.client.0.smithi096.stderr: "summary": "", 2024-09-16T03:24:49.286 INFO:tasks.workunit.client.0.smithi096.stderr: "1": { 2024-09-16T03:24:49.286 INFO:tasks.workunit.client.0.smithi096.stderr: "start_epoch": 0, 2024-09-16T03:24:49.286 INFO:tasks.workunit.client.0.smithi096.stderr: "start_stamp": "0.000000", 2024-09-16T03:24:49.286 INFO:tasks.workunit.client.0.smithi096.stderr: "gid": 0, 2024-09-16T03:24:49.286 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "(unrecognized address family 0)/0", 2024-09-16T03:24:49.286 INFO:tasks.workunit.client.0.smithi096.stderr: "metadata": {}, 2024-09-16T03:24:49.287 INFO:tasks.workunit.client.0.smithi096.stderr: "task_status": {} 2024-09-16T03:24:49.287 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:49.287 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:49.287 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:49.287 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:49.287 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:49.287 INFO:tasks.workunit.client.0.smithi096.stderr: "mgrstat_first_committed": 44, 2024-09-16T03:24:49.287 INFO:tasks.workunit.client.0.smithi096.stderr: "mgrstat_last_committed": 50, 2024-09-16T03:24:49.287 INFO:tasks.workunit.client.0.smithi096.stderr: "logm_first_committed": 1, 2024-09-16T03:24:49.287 INFO:tasks.workunit.client.0.smithi096.stderr: "logm_last_committed": 215, 2024-09-16T03:24:49.287 INFO:tasks.workunit.client.0.smithi096.stderr: "paxos": { 2024-09-16T03:24:49.287 INFO:tasks.workunit.client.0.smithi096.stderr: "first_committed": 1, 2024-09-16T03:24:49.287 INFO:tasks.workunit.client.0.smithi096.stderr: "last_committed": 297, 2024-09-16T03:24:49.287 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pn": 0, 2024-09-16T03:24:49.287 INFO:tasks.workunit.client.0.smithi096.stderr: "accepted_pn": 0 2024-09-16T03:24:49.288 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:49.288 INFO:tasks.workunit.client.0.smithi096.stderr:}' 2024-09-16T03:24:49.288 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:146: get_pool_id: jq '.osdmap.pools[] | select(.pool_name == "bar") | .pool' 2024-09-16T03:24:49.290 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:146: get_pool_id: echo '{' '"cluster_fingerprint":' '"fda2fc64-07ed-4add-8224-2e527e11d427",' '"version":' '"19.3.0-4930-gfc3e0bff",' '"commit":' '"fc3e0bff7468fd55478adbae7f75508b749124b6",' '"timestamp":' '"2024-09-16T03:24:49.165672+0000",' '"tag":' '"",' '"health":' '{' '"status":' '"HEALTH_OK",' '"checks":' '{},' '"mutes":' '[]' '},' '"monmap_first_committed":' 1, '"monmap_last_committed":' 1, '"monmap":' '{' '"epoch":' 1, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"modified":' '"2024-09-16T03:22:45.872880Z",' '"created":' '"2024-09-16T03:22:45.872880Z",' '"min_mon_release":' 19, '"min_mon_release_name":' '"squid",' '"election_strategy":' 1, '"disallowed_leaders:' '":' '"",' '"stretch_mode":' false, '"tiebreaker_mon":' '"",' '"removed_ranks:' '":' '"",' '"features":' '{' '"persistent":' '[' '"kraken",' '"luminous",' '"mimic",' '"osdmap-prune",' '"nautilus",' '"octopus",' '"pacific",' '"elector-pinging",' '"quincy",' '"reef",' '"squid"' '],' '"optional":' '[]' '},' '"mons":' '[' '{' '"rank":' 0, '"name":' '"a",' '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:7302",' '"nonce":' 0 '}' ']' '},' '"addr":' '"127.0.0.1:7302/0",' '"public_addr":' '"127.0.0.1:7302/0",' '"priority":' 0, '"weight":' 0, '"crush_location":' '"{}"' '}' ']' '},' '"quorum":' '[' 0 '],' '"osdmap":' '{' '"epoch":' 24, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"created":' '"2024-09-16T03:22:46.906117+0000",' '"modified":' '"2024-09-16T03:24:47.805467+0000",' '"last_up_change":' '"2024-09-16T03:24:37.708512+0000",' '"last_in_change":' '"2024-09-16T03:24:01.831039+0000",' '"flags":' '"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit",' '"flags_num":' 5799936, '"flags_set":' '[' '"pglog_hardlimit",' '"purged_snapdirs",' '"recovery_deletes",' '"sortbitwise"' '],' '"crush_version":' 7, '"full_ratio":' 0.99000000953674316, '"backfillfull_ratio":' 0.99000000953674316, '"nearfull_ratio":' 0.85000002384185791, '"cluster_snapshot":' '"",' '"pool_max":' 2, '"max_osd":' 3, '"require_min_compat_client":' '"luminous",' '"min_compat_client":' '"jewel",' '"require_osd_release":' '"squid",' '"allow_crimson":' false, '"pools":' '[' '{' '"pool":' 1, '"pool_name":' '"foo",' '"create_time":' '"2024-09-16T03:24:44.525189+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"21",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.690000057220459, '"score_stable":' 1.690000057220459, '"optimal_score":' 1, '"raw_score_acting":' 1.690000057220459, '"raw_score_stable":' 1.690000057220459, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '},' '{' '"pool":' 2, '"pool_name":' '"bar",' '"create_time":' '"2024-09-16T03:24:46.226575+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"24",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.1299999952316284, '"score_stable":' 1.1299999952316284, '"optimal_score":' 1, '"raw_score_acting":' 1.1299999952316284, '"raw_score_stable":' 1.1299999952316284, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '}' '],' '"osds":' '[' '{' '"osd":' 0, '"uuid":' '"64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 5, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6802",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6803",' '"nonce":' 3375787448 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6804",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6805",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6808",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6809",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6806",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6807",' '"nonce":' 3375787448 '}' ']' '},' '"public_addr":' '"127.0.0.1:6803/3375787448",' '"cluster_addr":' '"127.0.0.1:6805/3375787448",' '"heartbeat_back_addr":' '"127.0.0.1:6809/3375787448",' '"heartbeat_front_addr":' '"127.0.0.1:6807/3375787448",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 1, '"uuid":' '"74b26727-75c9-444d-8782-719e4197a382",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 10, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6810",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6811",' '"nonce":' 3733255132 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6812",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6813",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6816",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6817",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6814",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6815",' '"nonce":' 3733255132 '}' ']' '},' '"public_addr":' '"127.0.0.1:6811/3733255132",' '"cluster_addr":' '"127.0.0.1:6813/3733255132",' '"heartbeat_back_addr":' '"127.0.0.1:6817/3733255132",' '"heartbeat_front_addr":' '"127.0.0.1:6815/3733255132",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 2, '"uuid":' '"143da3a7-dad9-4b1e-966b-76cf5bdd3c82",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 15, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6818",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6819",' '"nonce":' 963814857 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6820",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6821",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6824",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6825",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6822",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6823",' '"nonce":' 963814857 '}' ']' '},' '"public_addr":' '"127.0.0.1:6819/963814857",' '"cluster_addr":' '"127.0.0.1:6821/963814857",' '"heartbeat_back_addr":' '"127.0.0.1:6825/963814857",' '"heartbeat_front_addr":' '"127.0.0.1:6823/963814857",' '"state":' '[' '"exists",' '"up"' ']' '}' '],' '"osd_xinfo":' '[' '{' '"osd":' 0, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:22.481942+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 1, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:59.663703+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 2, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:24:37.320822+0000",' '"dead_epoch":' 0 '}' '],' '"pg_upmap":' '[],' '"pg_upmap_items":' '[],' '"pg_upmap_primaries":' '[],' '"pg_temp":' '[],' '"primary_temp":' '[],' '"blocklist":' '{},' '"range_blocklist":' '{},' '"erasure_code_profiles":' '{' '"default":' '{' '"k":' '"2",' '"m":' '"2",' '"plugin":' '"jerasure",' '"technique":' '"reed_sol_van"' '}' '},' '"removed_snaps_queue":' '[],' '"new_removed_snaps":' '[],' '"new_purged_snaps":' '[],' '"crush_node_flags":' '{},' '"device_class_flags":' '{},' '"stretch_mode":' '{' '"stretch_mode_enabled":' false, '"stretch_bucket_count":' 0, '"degraded_stretch_mode":' 0, '"recovering_stretch_mode":' 0, '"stretch_mode_bucket":' 0 '}' '},' '"osd_metadata":' '[' '{' '"id":' 0, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/0/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:22:53.662571Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]",' '"hb_front_addr":' '"[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/0",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 1, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/1/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:23:30.129885Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]",' '"hb_front_addr":' '"[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/1",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 2, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/2/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:24:07.764502Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]",' '"hb_front_addr":' '"[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/2",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '}' '],' '"osdmap_clean_epochs":' '{' '"min_last_epoch_clean":' 0, '"last_epoch_clean":' '{' '"per_pool":' '[]' '},' '"osd_epochs":' '[' '{' '"id":' 0, '"epoch":' 16 '},' '{' '"id":' 1, '"epoch":' 16 '},' '{' '"id":' 2, '"epoch":' 15 '}' ']' '},' '"osdmap_first_committed":' 1, '"osdmap_last_committed":' 24, '"crushmap":' '{' '"devices":' '[' '{' '"id":' 0, '"name":' '"osd.0",' '"class":' '"hdd"' '},' '{' '"id":' 1, '"name":' '"osd.1",' '"class":' '"hdd"' '},' '{' '"id":' 2, '"name":' '"osd.2",' '"class":' '"hdd"' '}' '],' '"types":' '[' '{' '"type_id":' 0, '"name":' '"osd"' '},' '{' '"type_id":' 1, '"name":' '"host"' '},' '{' '"type_id":' 2, '"name":' '"chassis"' '},' '{' '"type_id":' 3, '"name":' '"rack"' '},' '{' '"type_id":' 4, '"name":' '"row"' '},' '{' '"type_id":' 5, '"name":' '"pdu"' '},' '{' '"type_id":' 6, '"name":' '"pod"' '},' '{' '"type_id":' 7, '"name":' '"room"' '},' '{' '"type_id":' 8, '"name":' '"datacenter"' '},' '{' '"type_id":' 9, '"name":' '"zone"' '},' '{' '"type_id":' 10, '"name":' '"region"' '},' '{' '"type_id":' 11, '"name":' '"root"' '}' '],' '"buckets":' '[' '{' '"id":' -1, '"name":' '"default",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -3, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -2, '"name":' '"default~hdd",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -4, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -3, '"name":' '"smithi096",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '},' '{' '"id":' -4, '"name":' '"smithi096~hdd",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '}' '],' '"rules":' '[' '{' '"rule_id":' 0, '"rule_name":' '"replicated_rule",' '"type":' 1, '"steps":' '[' '{' '"op":' '"take",' '"item":' -1, '"item_name":' '"default"' '},' '{' '"op":' '"choose_firstn",' '"num":' 0, '"type":' '"osd"' '},' '{' '"op":' '"emit"' '}' ']' '}' '],' '"tunables":' '{' '"choose_local_tries":' 0, '"choose_local_fallback_tries":' 0, '"choose_total_tries":' 50, '"chooseleaf_descend_once":' 1, '"chooseleaf_vary_r":' 1, '"chooseleaf_stable":' 1, '"msr_descents":' 100, '"msr_collision_tries":' 100, '"straw_calc_version":' 1, '"allowed_bucket_algs":' 54, '"profile":' '"jewel",' '"optimal_tunables":' 1, '"legacy_tunables":' 0, '"minimum_required_version":' '"jewel",' '"require_feature_tunables":' 1, '"require_feature_tunables2":' 1, '"has_v2_rules":' 0, '"require_feature_tunables3":' 1, '"has_v3_rules":' 0, '"has_v4_buckets":' 1, '"require_feature_tunables5":' 1, '"has_v5_rules":' 0, '"has_msr_rules":' 0 '},' '"choose_args":' '{}' '},' '"fsmap":' '{' '"epoch":' 1, '"btime":' '"2024-09-16T03:22:46:882186+0000",' '"default_fscid":' -1, '"compat":' '{' '"compat":' '{},' '"ro_compat":' '{},' '"incompat":' '{' '"feature_1":' '"base' 'v0.20",' '"feature_2":' '"client' writeable 'ranges",' '"feature_3":' '"default' file layouts on 'dirs",' '"feature_4":' '"dir' inode in separate 'object",' '"feature_5":' '"mds' uses versioned 'encoding",' '"feature_6":' '"dirfrag' is stored in 'omap",' '"feature_8":' '"no' anchor 'table",' '"feature_9":' '"file' layout 'v2",' '"feature_10":' '"snaprealm' 'v2",' '"feature_11":' '"minor' log 'segments",' '"feature_12":' '"quiesce' 'subvolumes"' '}' '},' '"feature_flags":' '{' '"enable_multiple":' true, '"ever_enabled_multiple":' true '},' '"standbys":' '[],' '"filesystems":' '[]' '},' '"mdsmap_first_committed":' 1, '"mdsmap_last_committed":' 1, '"auth":' '{' '"first_committed":' 1, '"last_committed":' 5, '"num_secrets":' 3 '},' '"num_pg":' 64, '"num_pg_active":' 15, '"num_pg_unknown":' 31, '"num_osd":' 3, '"pool_sum":' '{' '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 99, '"acting":' 99, '"num_store_stats":' 0 '},' '"osd_sum":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 24, '"num_osds":' 3, '"num_per_pool_osds":' 3, '"num_per_pool_omap_osds":' 2, '"kb":' 314572800, '"kb_used":' 80992, '"kb_used_data":' 472, '"kb_used_omap":' 4, '"kb_used_meta":' 80443, '"kb_avail":' 314491808, '"statfs":' '{' '"total":' 322122547200, '"available":' 322039611392, '"internally_reserved":' 0, '"allocated":' 483328, '"data_stored":' 123708, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 4785, '"internal_metadata":' 82373967 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 543, '"apply_latency_ms":' 543, '"commit_latency_ns":' 543000000, '"apply_latency_ns":' 543000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '},' '"osd_sum_by_class":' '{' '"hdd":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 24, '"num_osds":' 3, '"num_per_pool_osds":' 3, '"num_per_pool_omap_osds":' 2, '"kb":' 314572800, '"kb_used":' 80992, '"kb_used_data":' 472, '"kb_used_omap":' 4, '"kb_used_meta":' 80443, '"kb_avail":' 314491808, '"statfs":' '{' '"total":' 322122547200, '"available":' 322039611392, '"internally_reserved":' 0, '"allocated":' 483328, '"data_stored":' 123708, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 4785, '"internal_metadata":' 82373967 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 543, '"apply_latency_ms":' 543, '"commit_latency_ns":' 543000000, '"apply_latency_ns":' 543000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '}' '},' '"pool_stats":' '[' '{' '"poolid":' 2, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 27, '"acting":' 27, '"num_store_stats":' 1 '},' '{' '"poolid":' 1, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 72, '"acting":' 72, '"num_store_stats":' 2 '}' '],' '"osd_stats":' '[' '{' '"osd":' 0, '"seq":' 21474836503 '},' '{' '"osd":' 1, '"seq":' 42949672975 '},' '{' '"osd":' 2, '"seq":' 64424509448 '}' '],' '"num_pg_by_state":' '[' '{' '"state":' '"active+clean",' '"num":' 15 '},' '{' '"state":' '"creating+activating",' '"num":' 18 '},' '{' '"state":' '"unknown",' '"num":' 31 '}' '],' '"num_pg_by_osd":' '[' '{' '"osd":' 2, '"num_primary_pg":' 15, '"num_acting_pg":' 33, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 0, '"num_primary_pg":' 0, '"num_acting_pg":' 33, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 1, '"num_primary_pg":' 18, '"num_acting_pg":' 33, '"num_up_not_acting_pg":' 0 '}' '],' '"purged_snaps":' '[],' '"servicemap":' '{' '"epoch":' 3, '"modified":' '"2024-09-16T03:24:24.403052+0000",' '"services":' '{' '"osd":' '{' '"daemons":' '{' '"summary":' '"",' '"1":' '{' '"start_epoch":' 0, '"start_stamp":' '"0.000000",' '"gid":' 0, '"addr":' '"(unrecognized' address family '0)/0",' '"metadata":' '{},' '"task_status":' '{}' '}' '}' '}' '}' '},' '"mgrstat_first_committed":' 44, '"mgrstat_last_committed":' 50, '"logm_first_committed":' 1, '"logm_last_committed":' 215, '"paxos":' '{' '"first_committed":' 1, '"last_committed":' 297, '"last_pn":' 0, '"accepted_pn":' 0 '}' '}' 2024-09-16T03:24:49.290 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:146: get_pool_id: pool_id=2 2024-09-16T03:24:49.290 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:148: get_pool_id: [[ 2 -ge 0 ]] 2024-09-16T03:24:49.291 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:151: get_pool_id: echo 2 2024-09-16T03:24:49.291 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:152: get_pool_id: return 0 2024-09-16T03:24:49.291 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:192: TEST_mon_last_clean_epoch: bar_id=2 2024-09-16T03:24:49.291 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:194: TEST_mon_last_clean_epoch: [[ 1 -lt 0 ]] 2024-09-16T03:24:49.291 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:195: TEST_mon_last_clean_epoch: [[ 2 -lt 0 ]] 2024-09-16T03:24:49.291 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:200: TEST_mon_last_clean_epoch: ceph osd set-full-ratio 0.97 2024-09-16T03:24:49.910 INFO:tasks.workunit.client.0.smithi096.stderr:osd set-full-ratio 0.97 2024-09-16T03:24:49.933 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:201: TEST_mon_last_clean_epoch: ceph osd set-backfillfull-ratio 0.97 2024-09-16T03:24:50.756 INFO:tasks.workunit.client.0.smithi096.stderr:osd set-backfillfull-ratio 0.97 2024-09-16T03:24:50.776 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:203: TEST_mon_last_clean_epoch: wait_for_health_ok 2024-09-16T03:24:50.776 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1809: wait_for_health_ok: wait_for_health HEALTH_OK 2024-09-16T03:24:50.776 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1788: wait_for_health: local grepstr=HEALTH_OK 2024-09-16T03:24:50.776 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1789: wait_for_health: get_timeout_delays 300 .1 2024-09-16T03:24:50.777 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: shopt -q -o xtrace 2024-09-16T03:24:50.777 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: echo true 2024-09-16T03:24:50.778 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: local trace=true 2024-09-16T03:24:50.778 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: true 2024-09-16T03:24:50.778 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: shopt -u -o xtrace 2024-09-16T03:24:50.980 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1789: wait_for_health: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '4.5') 2024-09-16T03:24:50.981 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1789: wait_for_health: local -a delays 2024-09-16T03:24:50.981 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1790: wait_for_health: local -i loop=0 2024-09-16T03:24:50.981 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1792: wait_for_health: ceph health detail 2024-09-16T03:24:50.981 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1792: wait_for_health: grep HEALTH_OK 2024-09-16T03:24:51.577 INFO:tasks.workunit.client.0.smithi096.stdout:HEALTH_OK 2024-09-16T03:24:51.578 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:205: TEST_mon_last_clean_epoch: get_fc_lc_diff 2024-09-16T03:24:51.579 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:130: get_fc_lc_diff: ceph report 2024-09-16T03:24:52.165 INFO:tasks.workunit.client.0.smithi096.stderr:report 1131745090 2024-09-16T03:24:52.182 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:130: get_fc_lc_diff: report='{ 2024-09-16T03:24:52.182 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_fingerprint": "fda2fc64-07ed-4add-8224-2e527e11d427", 2024-09-16T03:24:52.183 INFO:tasks.workunit.client.0.smithi096.stderr: "version": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:24:52.183 INFO:tasks.workunit.client.0.smithi096.stderr: "commit": "fc3e0bff7468fd55478adbae7f75508b749124b6", 2024-09-16T03:24:52.183 INFO:tasks.workunit.client.0.smithi096.stderr: "timestamp": "2024-09-16T03:24:52.165833+0000", 2024-09-16T03:24:52.183 INFO:tasks.workunit.client.0.smithi096.stderr: "tag": "", 2024-09-16T03:24:52.183 INFO:tasks.workunit.client.0.smithi096.stderr: "health": { 2024-09-16T03:24:52.183 INFO:tasks.workunit.client.0.smithi096.stderr: "status": "HEALTH_OK", 2024-09-16T03:24:52.183 INFO:tasks.workunit.client.0.smithi096.stderr: "checks": {}, 2024-09-16T03:24:52.183 INFO:tasks.workunit.client.0.smithi096.stderr: "mutes": [] 2024-09-16T03:24:52.183 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.183 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap_first_committed": 1, 2024-09-16T03:24:52.183 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap_last_committed": 1, 2024-09-16T03:24:52.183 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap": { 2024-09-16T03:24:52.183 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 1, 2024-09-16T03:24:52.184 INFO:tasks.workunit.client.0.smithi096.stderr: "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", 2024-09-16T03:24:52.184 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:22:45.872880Z", 2024-09-16T03:24:52.184 INFO:tasks.workunit.client.0.smithi096.stderr: "created": "2024-09-16T03:22:45.872880Z", 2024-09-16T03:24:52.184 INFO:tasks.workunit.client.0.smithi096.stderr: "min_mon_release": 19, 2024-09-16T03:24:52.184 INFO:tasks.workunit.client.0.smithi096.stderr: "min_mon_release_name": "squid", 2024-09-16T03:24:52.184 INFO:tasks.workunit.client.0.smithi096.stderr: "election_strategy": 1, 2024-09-16T03:24:52.184 INFO:tasks.workunit.client.0.smithi096.stderr: "disallowed_leaders: ": "", 2024-09-16T03:24:52.184 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode": false, 2024-09-16T03:24:52.184 INFO:tasks.workunit.client.0.smithi096.stderr: "tiebreaker_mon": "", 2024-09-16T03:24:52.184 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_ranks: ": "", 2024-09-16T03:24:52.184 INFO:tasks.workunit.client.0.smithi096.stderr: "features": { 2024-09-16T03:24:52.184 INFO:tasks.workunit.client.0.smithi096.stderr: "persistent": [ 2024-09-16T03:24:52.184 INFO:tasks.workunit.client.0.smithi096.stderr: "kraken", 2024-09-16T03:24:52.185 INFO:tasks.workunit.client.0.smithi096.stderr: "luminous", 2024-09-16T03:24:52.185 INFO:tasks.workunit.client.0.smithi096.stderr: "mimic", 2024-09-16T03:24:52.185 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap-prune", 2024-09-16T03:24:52.185 INFO:tasks.workunit.client.0.smithi096.stderr: "nautilus", 2024-09-16T03:24:52.185 INFO:tasks.workunit.client.0.smithi096.stderr: "octopus", 2024-09-16T03:24:52.185 INFO:tasks.workunit.client.0.smithi096.stderr: "pacific", 2024-09-16T03:24:52.185 INFO:tasks.workunit.client.0.smithi096.stderr: "elector-pinging", 2024-09-16T03:24:52.185 INFO:tasks.workunit.client.0.smithi096.stderr: "quincy", 2024-09-16T03:24:52.185 INFO:tasks.workunit.client.0.smithi096.stderr: "reef", 2024-09-16T03:24:52.185 INFO:tasks.workunit.client.0.smithi096.stderr: "squid" 2024-09-16T03:24:52.185 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:52.185 INFO:tasks.workunit.client.0.smithi096.stderr: "optional": [] 2024-09-16T03:24:52.185 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.186 INFO:tasks.workunit.client.0.smithi096.stderr: "mons": [ 2024-09-16T03:24:52.186 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.186 INFO:tasks.workunit.client.0.smithi096.stderr: "rank": 0, 2024-09-16T03:24:52.186 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "a", 2024-09-16T03:24:52.186 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:24:52.186 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:52.186 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.186 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:52.186 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:7302", 2024-09-16T03:24:52.186 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 0 2024-09-16T03:24:52.186 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:52.186 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:52.186 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.187 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:7302/0", 2024-09-16T03:24:52.187 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:7302/0", 2024-09-16T03:24:52.187 INFO:tasks.workunit.client.0.smithi096.stderr: "priority": 0, 2024-09-16T03:24:52.187 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 0, 2024-09-16T03:24:52.187 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_location": "{}" 2024-09-16T03:24:52.187 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:52.187 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:52.187 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.187 INFO:tasks.workunit.client.0.smithi096.stderr: "quorum": [ 2024-09-16T03:24:52.187 INFO:tasks.workunit.client.0.smithi096.stderr: 0 2024-09-16T03:24:52.187 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:52.187 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap": { 2024-09-16T03:24:52.187 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 28, 2024-09-16T03:24:52.188 INFO:tasks.workunit.client.0.smithi096.stderr: "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", 2024-09-16T03:24:52.188 INFO:tasks.workunit.client.0.smithi096.stderr: "created": "2024-09-16T03:22:46.906117+0000", 2024-09-16T03:24:52.188 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:24:50.642444+0000", 2024-09-16T03:24:52.188 INFO:tasks.workunit.client.0.smithi096.stderr: "last_up_change": "2024-09-16T03:24:37.708512+0000", 2024-09-16T03:24:52.188 INFO:tasks.workunit.client.0.smithi096.stderr: "last_in_change": "2024-09-16T03:24:01.831039+0000", 2024-09-16T03:24:52.188 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-16T03:24:52.188 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_num": 5799936, 2024-09-16T03:24:52.188 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_set": [ 2024-09-16T03:24:52.188 INFO:tasks.workunit.client.0.smithi096.stderr: "pglog_hardlimit", 2024-09-16T03:24:52.188 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snapdirs", 2024-09-16T03:24:52.188 INFO:tasks.workunit.client.0.smithi096.stderr: "recovery_deletes", 2024-09-16T03:24:52.188 INFO:tasks.workunit.client.0.smithi096.stderr: "sortbitwise" 2024-09-16T03:24:52.188 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:52.189 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_version": 7, 2024-09-16T03:24:52.189 INFO:tasks.workunit.client.0.smithi096.stderr: "full_ratio": 0.97000002861022949, 2024-09-16T03:24:52.189 INFO:tasks.workunit.client.0.smithi096.stderr: "backfillfull_ratio": 0.97000002861022949, 2024-09-16T03:24:52.192 INFO:tasks.workunit.client.0.smithi096.stderr: "nearfull_ratio": 0.85000002384185791, 2024-09-16T03:24:52.192 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_snapshot": "", 2024-09-16T03:24:52.192 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_max": 2, 2024-09-16T03:24:52.192 INFO:tasks.workunit.client.0.smithi096.stderr: "max_osd": 3, 2024-09-16T03:24:52.192 INFO:tasks.workunit.client.0.smithi096.stderr: "require_min_compat_client": "luminous", 2024-09-16T03:24:52.192 INFO:tasks.workunit.client.0.smithi096.stderr: "min_compat_client": "jewel", 2024-09-16T03:24:52.192 INFO:tasks.workunit.client.0.smithi096.stderr: "require_osd_release": "squid", 2024-09-16T03:24:52.192 INFO:tasks.workunit.client.0.smithi096.stderr: "allow_crimson": false, 2024-09-16T03:24:52.192 INFO:tasks.workunit.client.0.smithi096.stderr: "pools": [ 2024-09-16T03:24:52.192 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.192 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 1, 2024-09-16T03:24:52.193 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_name": "foo", 2024-09-16T03:24:52.193 INFO:tasks.workunit.client.0.smithi096.stderr: "create_time": "2024-09-16T03:24:44.525189+0000", 2024-09-16T03:24:52.193 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": 1, 2024-09-16T03:24:52.193 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_names": "hashpspool", 2024-09-16T03:24:52.193 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:24:52.193 INFO:tasks.workunit.client.0.smithi096.stderr: "size": 3, 2024-09-16T03:24:52.193 INFO:tasks.workunit.client.0.smithi096.stderr: "min_size": 2, 2024-09-16T03:24:52.193 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_rule": 0, 2024-09-16T03:24:52.193 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_count": 0, 2024-09-16T03:24:52.193 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_target": 0, 2024-09-16T03:24:52.193 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_barrier": 0, 2024-09-16T03:24:52.193 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-16T03:24:52.193 INFO:tasks.workunit.client.0.smithi096.stderr: "is_stretch_pool": false, 2024-09-16T03:24:52.193 INFO:tasks.workunit.client.0.smithi096.stderr: "object_hash": 2, 2024-09-16T03:24:52.194 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_autoscale_mode": "off", 2024-09-16T03:24:52.194 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num": 32, 2024-09-16T03:24:52.194 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num": 32, 2024-09-16T03:24:52.194 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num_target": 32, 2024-09-16T03:24:52.194 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_target": 32, 2024-09-16T03:24:52.194 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_pending": 32, 2024-09-16T03:24:52.194 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pg_merge_meta": { 2024-09-16T03:24:52.194 INFO:tasks.workunit.client.0.smithi096.stderr: "source_pgid": "0.0", 2024-09-16T03:24:52.194 INFO:tasks.workunit.client.0.smithi096.stderr: "ready_epoch": 0, 2024-09-16T03:24:52.194 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_started": 0, 2024-09-16T03:24:52.194 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": 0, 2024-09-16T03:24:52.194 INFO:tasks.workunit.client.0.smithi096.stderr: "source_version": "0'\''0", 2024-09-16T03:24:52.194 INFO:tasks.workunit.client.0.smithi096.stderr: "target_version": "0'\''0" 2024-09-16T03:24:52.194 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.195 INFO:tasks.workunit.client.0.smithi096.stderr: "last_change": "21", 2024-09-16T03:24:52.195 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend": "0", 2024-09-16T03:24:52.195 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_prenautilus": "0", 2024-09-16T03:24:52.195 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_preluminous": "0", 2024-09-16T03:24:52.195 INFO:tasks.workunit.client.0.smithi096.stderr: "auid": 0, 2024-09-16T03:24:52.195 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_mode": "selfmanaged", 2024-09-16T03:24:52.195 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_seq": 0, 2024-09-16T03:24:52.195 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_epoch": 0, 2024-09-16T03:24:52.195 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_snaps": [], 2024-09-16T03:24:52.195 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps": "[]", 2024-09-16T03:24:52.195 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_bytes": 0, 2024-09-16T03:24:52.195 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_objects": 0, 2024-09-16T03:24:52.195 INFO:tasks.workunit.client.0.smithi096.stderr: "tiers": [], 2024-09-16T03:24:52.195 INFO:tasks.workunit.client.0.smithi096.stderr: "tier_of": -1, 2024-09-16T03:24:52.196 INFO:tasks.workunit.client.0.smithi096.stderr: "read_tier": -1, 2024-09-16T03:24:52.196 INFO:tasks.workunit.client.0.smithi096.stderr: "write_tier": -1, 2024-09-16T03:24:52.196 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_mode": "none", 2024-09-16T03:24:52.196 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_bytes": 0, 2024-09-16T03:24:52.196 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_objects": 0, 2024-09-16T03:24:52.196 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_ratio_micro": 400000, 2024-09-16T03:24:52.196 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-16T03:24:52.196 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_full_ratio_micro": 800000, 2024-09-16T03:24:52.196 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_flush_age": 0, 2024-09-16T03:24:52.196 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_evict_age": 0, 2024-09-16T03:24:52.196 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profile": "", 2024-09-16T03:24:52.196 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_params": { 2024-09-16T03:24:52.196 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "none" 2024-09-16T03:24:52.197 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.197 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_period": 0, 2024-09-16T03:24:52.197 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_count": 0, 2024-09-16T03:24:52.197 INFO:tasks.workunit.client.0.smithi096.stderr: "use_gmt_hitset": true, 2024-09-16T03:24:52.197 INFO:tasks.workunit.client.0.smithi096.stderr: "min_read_recency_for_promote": 0, 2024-09-16T03:24:52.197 INFO:tasks.workunit.client.0.smithi096.stderr: "min_write_recency_for_promote": 0, 2024-09-16T03:24:52.197 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_grade_decay_rate": 0, 2024-09-16T03:24:52.197 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_search_last_n": 0, 2024-09-16T03:24:52.197 INFO:tasks.workunit.client.0.smithi096.stderr: "grade_table": [], 2024-09-16T03:24:52.197 INFO:tasks.workunit.client.0.smithi096.stderr: "stripe_width": 0, 2024-09-16T03:24:52.197 INFO:tasks.workunit.client.0.smithi096.stderr: "expected_num_objects": 0, 2024-09-16T03:24:52.197 INFO:tasks.workunit.client.0.smithi096.stderr: "fast_read": false, 2024-09-16T03:24:52.197 INFO:tasks.workunit.client.0.smithi096.stderr: "options": {}, 2024-09-16T03:24:52.198 INFO:tasks.workunit.client.0.smithi096.stderr: "application_metadata": {}, 2024-09-16T03:24:52.198 INFO:tasks.workunit.client.0.smithi096.stderr: "read_balance": { 2024-09-16T03:24:52.198 INFO:tasks.workunit.client.0.smithi096.stderr: "score_type": "Fair distribution", 2024-09-16T03:24:52.198 INFO:tasks.workunit.client.0.smithi096.stderr: "score_acting": 1.690000057220459, 2024-09-16T03:24:52.198 INFO:tasks.workunit.client.0.smithi096.stderr: "score_stable": 1.690000057220459, 2024-09-16T03:24:52.198 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_score": 1, 2024-09-16T03:24:52.198 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_acting": 1.690000057220459, 2024-09-16T03:24:52.198 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_stable": 1.690000057220459, 2024-09-16T03:24:52.198 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity_weighted": 1, 2024-09-16T03:24:52.198 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity": 1, 2024-09-16T03:24:52.198 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity_weighted": 1 2024-09-16T03:24:52.198 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:52.198 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.198 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.199 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 2, 2024-09-16T03:24:52.199 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_name": "bar", 2024-09-16T03:24:52.199 INFO:tasks.workunit.client.0.smithi096.stderr: "create_time": "2024-09-16T03:24:46.226575+0000", 2024-09-16T03:24:52.199 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": 1, 2024-09-16T03:24:52.199 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_names": "hashpspool", 2024-09-16T03:24:52.199 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:24:52.199 INFO:tasks.workunit.client.0.smithi096.stderr: "size": 3, 2024-09-16T03:24:52.199 INFO:tasks.workunit.client.0.smithi096.stderr: "min_size": 2, 2024-09-16T03:24:52.199 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_rule": 0, 2024-09-16T03:24:52.199 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_count": 0, 2024-09-16T03:24:52.199 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_target": 0, 2024-09-16T03:24:52.199 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_barrier": 0, 2024-09-16T03:24:52.199 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-16T03:24:52.199 INFO:tasks.workunit.client.0.smithi096.stderr: "is_stretch_pool": false, 2024-09-16T03:24:52.200 INFO:tasks.workunit.client.0.smithi096.stderr: "object_hash": 2, 2024-09-16T03:24:52.200 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_autoscale_mode": "off", 2024-09-16T03:24:52.200 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num": 32, 2024-09-16T03:24:52.200 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num": 32, 2024-09-16T03:24:52.200 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num_target": 32, 2024-09-16T03:24:52.200 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_target": 32, 2024-09-16T03:24:52.200 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_pending": 32, 2024-09-16T03:24:52.200 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pg_merge_meta": { 2024-09-16T03:24:52.200 INFO:tasks.workunit.client.0.smithi096.stderr: "source_pgid": "0.0", 2024-09-16T03:24:52.200 INFO:tasks.workunit.client.0.smithi096.stderr: "ready_epoch": 0, 2024-09-16T03:24:52.200 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_started": 0, 2024-09-16T03:24:52.200 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": 0, 2024-09-16T03:24:52.200 INFO:tasks.workunit.client.0.smithi096.stderr: "source_version": "0'\''0", 2024-09-16T03:24:52.200 INFO:tasks.workunit.client.0.smithi096.stderr: "target_version": "0'\''0" 2024-09-16T03:24:52.201 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.201 INFO:tasks.workunit.client.0.smithi096.stderr: "last_change": "24", 2024-09-16T03:24:52.201 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend": "0", 2024-09-16T03:24:52.201 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_prenautilus": "0", 2024-09-16T03:24:52.201 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_preluminous": "0", 2024-09-16T03:24:52.201 INFO:tasks.workunit.client.0.smithi096.stderr: "auid": 0, 2024-09-16T03:24:52.201 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_mode": "selfmanaged", 2024-09-16T03:24:52.201 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_seq": 0, 2024-09-16T03:24:52.201 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_epoch": 0, 2024-09-16T03:24:52.201 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_snaps": [], 2024-09-16T03:24:52.201 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps": "[]", 2024-09-16T03:24:52.201 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_bytes": 0, 2024-09-16T03:24:52.201 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_objects": 0, 2024-09-16T03:24:52.201 INFO:tasks.workunit.client.0.smithi096.stderr: "tiers": [], 2024-09-16T03:24:52.202 INFO:tasks.workunit.client.0.smithi096.stderr: "tier_of": -1, 2024-09-16T03:24:52.202 INFO:tasks.workunit.client.0.smithi096.stderr: "read_tier": -1, 2024-09-16T03:24:52.202 INFO:tasks.workunit.client.0.smithi096.stderr: "write_tier": -1, 2024-09-16T03:24:52.202 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_mode": "none", 2024-09-16T03:24:52.202 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_bytes": 0, 2024-09-16T03:24:52.202 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_objects": 0, 2024-09-16T03:24:52.202 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_ratio_micro": 400000, 2024-09-16T03:24:52.202 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-16T03:24:52.202 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_full_ratio_micro": 800000, 2024-09-16T03:24:52.202 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_flush_age": 0, 2024-09-16T03:24:52.202 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_evict_age": 0, 2024-09-16T03:24:52.202 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profile": "", 2024-09-16T03:24:52.202 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_params": { 2024-09-16T03:24:52.202 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "none" 2024-09-16T03:24:52.203 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.203 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_period": 0, 2024-09-16T03:24:52.203 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_count": 0, 2024-09-16T03:24:52.203 INFO:tasks.workunit.client.0.smithi096.stderr: "use_gmt_hitset": true, 2024-09-16T03:24:52.203 INFO:tasks.workunit.client.0.smithi096.stderr: "min_read_recency_for_promote": 0, 2024-09-16T03:24:52.203 INFO:tasks.workunit.client.0.smithi096.stderr: "min_write_recency_for_promote": 0, 2024-09-16T03:24:52.203 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_grade_decay_rate": 0, 2024-09-16T03:24:52.203 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_search_last_n": 0, 2024-09-16T03:24:52.203 INFO:tasks.workunit.client.0.smithi096.stderr: "grade_table": [], 2024-09-16T03:24:52.203 INFO:tasks.workunit.client.0.smithi096.stderr: "stripe_width": 0, 2024-09-16T03:24:52.203 INFO:tasks.workunit.client.0.smithi096.stderr: "expected_num_objects": 0, 2024-09-16T03:24:52.203 INFO:tasks.workunit.client.0.smithi096.stderr: "fast_read": false, 2024-09-16T03:24:52.203 INFO:tasks.workunit.client.0.smithi096.stderr: "options": {}, 2024-09-16T03:24:52.203 INFO:tasks.workunit.client.0.smithi096.stderr: "application_metadata": {}, 2024-09-16T03:24:52.204 INFO:tasks.workunit.client.0.smithi096.stderr: "read_balance": { 2024-09-16T03:24:52.204 INFO:tasks.workunit.client.0.smithi096.stderr: "score_type": "Fair distribution", 2024-09-16T03:24:52.204 INFO:tasks.workunit.client.0.smithi096.stderr: "score_acting": 1.1299999952316284, 2024-09-16T03:24:52.204 INFO:tasks.workunit.client.0.smithi096.stderr: "score_stable": 1.1299999952316284, 2024-09-16T03:24:52.204 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_score": 1, 2024-09-16T03:24:52.204 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_acting": 1.1299999952316284, 2024-09-16T03:24:52.204 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_stable": 1.1299999952316284, 2024-09-16T03:24:52.204 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity_weighted": 1, 2024-09-16T03:24:52.204 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity": 1, 2024-09-16T03:24:52.204 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity_weighted": 1 2024-09-16T03:24:52.204 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:52.204 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:52.204 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:52.204 INFO:tasks.workunit.client.0.smithi096.stderr: "osds": [ 2024-09-16T03:24:52.205 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.205 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:24:52.205 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6", 2024-09-16T03:24:52.205 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:24:52.205 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:24:52.205 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:24:52.205 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:24:52.205 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:24:52.205 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:24:52.205 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 5, 2024-09-16T03:24:52.205 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 21, 2024-09-16T03:24:52.205 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:24:52.205 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:24:52.205 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:24:52.206 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:52.206 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.206 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:52.206 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6802", 2024-09-16T03:24:52.206 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:24:52.206 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.206 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.206 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:52.206 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6803", 2024-09-16T03:24:52.206 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:24:52.206 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:52.206 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:52.206 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.206 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:24:52.207 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:52.207 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.207 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:52.207 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6804", 2024-09-16T03:24:52.207 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:24:52.207 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.207 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.207 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:52.207 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6805", 2024-09-16T03:24:52.207 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:24:52.207 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:52.208 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:52.208 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.208 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:24:52.208 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:52.208 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.208 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:52.208 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6808", 2024-09-16T03:24:52.208 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:24:52.208 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.208 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.208 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:52.208 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6809", 2024-09-16T03:24:52.209 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:24:52.209 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:52.209 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:52.209 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.209 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:24:52.209 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:52.209 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.209 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:52.209 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6806", 2024-09-16T03:24:52.209 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:24:52.209 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.209 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.209 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:52.209 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6807", 2024-09-16T03:24:52.210 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:24:52.210 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:52.210 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:52.210 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.210 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6803/3375787448", 2024-09-16T03:24:52.210 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6805/3375787448", 2024-09-16T03:24:52.210 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6809/3375787448", 2024-09-16T03:24:52.210 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6807/3375787448", 2024-09-16T03:24:52.210 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:24:52.210 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:24:52.210 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:24:52.210 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:52.210 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.210 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.211 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:24:52.211 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "74b26727-75c9-444d-8782-719e4197a382", 2024-09-16T03:24:52.211 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:24:52.211 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:24:52.211 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:24:52.211 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:24:52.211 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:24:52.211 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:24:52.211 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 10, 2024-09-16T03:24:52.211 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 21, 2024-09-16T03:24:52.211 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:24:52.211 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:24:52.211 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:24:52.211 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:52.212 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.212 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:52.212 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6810", 2024-09-16T03:24:52.212 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:24:52.212 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.212 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.212 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:52.212 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6811", 2024-09-16T03:24:52.212 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:24:52.212 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:52.212 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:52.212 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.212 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:24:52.213 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:52.213 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.213 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:52.213 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6812", 2024-09-16T03:24:52.213 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:24:52.213 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.213 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.213 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:52.213 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6813", 2024-09-16T03:24:52.213 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:24:52.213 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:52.213 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:52.213 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.214 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:24:52.214 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:52.214 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.214 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:52.214 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6816", 2024-09-16T03:24:52.214 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:24:52.214 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.214 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.214 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:52.214 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6817", 2024-09-16T03:24:52.214 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:24:52.214 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:52.214 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:52.215 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.215 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:24:52.215 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:52.215 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.215 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:52.215 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6814", 2024-09-16T03:24:52.215 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:24:52.215 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.215 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.215 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:52.215 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6815", 2024-09-16T03:24:52.215 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:24:52.215 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:52.215 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:52.216 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.216 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6811/3733255132", 2024-09-16T03:24:52.216 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6813/3733255132", 2024-09-16T03:24:52.216 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6817/3733255132", 2024-09-16T03:24:52.216 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6815/3733255132", 2024-09-16T03:24:52.216 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:24:52.216 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:24:52.216 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:24:52.216 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:52.216 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.216 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.216 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:24:52.216 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "143da3a7-dad9-4b1e-966b-76cf5bdd3c82", 2024-09-16T03:24:52.217 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:24:52.217 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:24:52.217 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:24:52.217 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:24:52.217 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:24:52.217 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:24:52.217 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 15, 2024-09-16T03:24:52.217 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 21, 2024-09-16T03:24:52.217 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:24:52.217 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:24:52.217 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:24:52.217 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:52.217 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.217 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:52.218 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6818", 2024-09-16T03:24:52.218 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:24:52.218 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.218 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.218 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:52.218 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6819", 2024-09-16T03:24:52.218 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:24:52.218 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:52.218 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:52.218 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.218 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:24:52.218 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:52.218 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.219 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:52.219 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6820", 2024-09-16T03:24:52.219 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:24:52.219 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.219 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.219 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:52.219 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6821", 2024-09-16T03:24:52.219 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:24:52.219 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:52.219 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:52.219 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.219 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:24:52.219 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:52.220 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.220 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:52.220 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6824", 2024-09-16T03:24:52.220 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:24:52.220 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.220 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.220 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:52.220 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6825", 2024-09-16T03:24:52.220 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:24:52.220 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:52.220 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:52.220 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.220 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:24:52.221 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:52.221 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.221 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:52.221 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6822", 2024-09-16T03:24:52.221 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:24:52.221 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.221 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.221 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:52.221 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6823", 2024-09-16T03:24:52.221 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:24:52.221 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:52.221 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:52.221 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.221 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6819/963814857", 2024-09-16T03:24:52.222 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6821/963814857", 2024-09-16T03:24:52.222 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6825/963814857", 2024-09-16T03:24:52.222 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6823/963814857", 2024-09-16T03:24:52.222 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:24:52.222 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:24:52.222 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:24:52.222 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:52.222 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:52.222 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:52.222 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_xinfo": [ 2024-09-16T03:24:52.222 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.222 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:24:52.222 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:24:52.222 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:24:52.223 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:24:52.223 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:24:52.223 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:24:52.223 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:23:22.481942+0000", 2024-09-16T03:24:52.223 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:24:52.223 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.223 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.223 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:24:52.223 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:24:52.223 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:24:52.223 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:24:52.223 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:24:52.223 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:24:52.223 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:23:59.663703+0000", 2024-09-16T03:24:52.224 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:24:52.224 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.224 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.224 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:24:52.224 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:24:52.224 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:24:52.224 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:24:52.224 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:24:52.224 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:24:52.224 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:24:37.320822+0000", 2024-09-16T03:24:52.224 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:24:52.225 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:52.225 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:52.225 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap": [], 2024-09-16T03:24:52.225 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap_items": [], 2024-09-16T03:24:52.225 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap_primaries": [], 2024-09-16T03:24:52.225 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_temp": [], 2024-09-16T03:24:52.225 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_temp": [], 2024-09-16T03:24:52.225 INFO:tasks.workunit.client.0.smithi096.stderr: "blocklist": {}, 2024-09-16T03:24:52.225 INFO:tasks.workunit.client.0.smithi096.stderr: "range_blocklist": {}, 2024-09-16T03:24:52.225 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profiles": { 2024-09-16T03:24:52.225 INFO:tasks.workunit.client.0.smithi096.stderr: "default": { 2024-09-16T03:24:52.225 INFO:tasks.workunit.client.0.smithi096.stderr: "k": "2", 2024-09-16T03:24:52.225 INFO:tasks.workunit.client.0.smithi096.stderr: "m": "2", 2024-09-16T03:24:52.225 INFO:tasks.workunit.client.0.smithi096.stderr: "plugin": "jerasure", 2024-09-16T03:24:52.225 INFO:tasks.workunit.client.0.smithi096.stderr: "technique": "reed_sol_van" 2024-09-16T03:24:52.226 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:52.226 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.226 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps_queue": [], 2024-09-16T03:24:52.226 INFO:tasks.workunit.client.0.smithi096.stderr: "new_removed_snaps": [], 2024-09-16T03:24:52.226 INFO:tasks.workunit.client.0.smithi096.stderr: "new_purged_snaps": [], 2024-09-16T03:24:52.226 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_node_flags": {}, 2024-09-16T03:24:52.226 INFO:tasks.workunit.client.0.smithi096.stderr: "device_class_flags": {}, 2024-09-16T03:24:52.226 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode": { 2024-09-16T03:24:52.226 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode_enabled": false, 2024-09-16T03:24:52.226 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_bucket_count": 0, 2024-09-16T03:24:52.226 INFO:tasks.workunit.client.0.smithi096.stderr: "degraded_stretch_mode": 0, 2024-09-16T03:24:52.226 INFO:tasks.workunit.client.0.smithi096.stderr: "recovering_stretch_mode": 0, 2024-09-16T03:24:52.226 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode_bucket": 0 2024-09-16T03:24:52.226 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:52.227 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.227 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_metadata": [ 2024-09-16T03:24:52.227 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.227 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:24:52.227 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:24:52.227 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]", 2024-09-16T03:24:52.227 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:24:52.227 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:24:52.227 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:24:52.227 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:24:52.227 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:24:52.227 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:24:52.227 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:24:52.227 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:24:52.228 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:24:52.228 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:24:52.228 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:24:52.228 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/0/block", 2024-09-16T03:24:52.228 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:24:52.228 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:24:52.228 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:24:52.228 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:24:52.228 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:24:52.228 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:24:52.228 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:24:52.228 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:24:52.228 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:24:52.228 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:24:52.229 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:22:53.662571Z", 2024-09-16T03:24:52.229 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:24:52.229 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:24:52.229 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:24:52.229 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:24:52.229 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:24:52.229 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:24:52.229 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:24:52.229 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]", 2024-09-16T03:24:52.229 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:24:52.229 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]", 2024-09-16T03:24:52.229 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]", 2024-09-16T03:24:52.229 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:24:52.229 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:24:52.230 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:24:52.230 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:24:52.230 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:24:52.230 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:24:52.230 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:24:52.230 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:24:52.230 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:24:52.230 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/0", 2024-09-16T03:24:52.230 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:24:52.230 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:24:52.230 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:24:52.230 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.230 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.230 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:24:52.231 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:24:52.231 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]", 2024-09-16T03:24:52.231 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:24:52.231 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:24:52.231 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:24:52.231 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:24:52.231 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:24:52.231 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:24:52.231 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:24:52.231 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:24:52.231 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:24:52.231 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:24:52.231 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:24:52.231 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/1/block", 2024-09-16T03:24:52.232 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:24:52.232 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:24:52.232 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:24:52.232 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:24:52.232 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:24:52.232 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:24:52.232 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:24:52.232 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:24:52.232 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:24:52.232 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:24:52.232 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:23:30.129885Z", 2024-09-16T03:24:52.232 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:24:52.232 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:24:52.232 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:24:52.232 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:24:52.233 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:24:52.233 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:24:52.233 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:24:52.233 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]", 2024-09-16T03:24:52.233 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:24:52.233 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]", 2024-09-16T03:24:52.233 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]", 2024-09-16T03:24:52.233 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:24:52.233 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:24:52.233 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:24:52.233 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:24:52.233 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:24:52.233 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:24:52.234 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:24:52.234 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:24:52.234 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:24:52.234 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/1", 2024-09-16T03:24:52.234 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:24:52.234 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:24:52.234 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:24:52.234 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.234 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.234 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:24:52.234 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:24:52.234 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]", 2024-09-16T03:24:52.234 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:24:52.234 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:24:52.235 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:24:52.235 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:24:52.235 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:24:52.235 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:24:52.235 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:24:52.235 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:24:52.235 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:24:52.235 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:24:52.235 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:24:52.235 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/2/block", 2024-09-16T03:24:52.235 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:24:52.235 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:24:52.235 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:24:52.235 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:24:52.235 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:24:52.236 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:24:52.236 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:24:52.236 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:24:52.236 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:24:52.236 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:24:52.236 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:24:07.764502Z", 2024-09-16T03:24:52.236 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:24:52.236 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:24:52.236 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:24:52.236 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:24:52.236 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:24:52.236 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:24:52.236 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:24:52.236 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]", 2024-09-16T03:24:52.237 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:24:52.237 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]", 2024-09-16T03:24:52.237 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]", 2024-09-16T03:24:52.237 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:24:52.237 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:24:52.237 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:24:52.237 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:24:52.237 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:24:52.237 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:24:52.237 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:24:52.237 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:24:52.237 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:24:52.237 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/2", 2024-09-16T03:24:52.237 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:24:52.238 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:24:52.238 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:24:52.238 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:52.238 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:52.238 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_clean_epochs": { 2024-09-16T03:24:52.238 INFO:tasks.workunit.client.0.smithi096.stderr: "min_last_epoch_clean": 0, 2024-09-16T03:24:52.238 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": { 2024-09-16T03:24:52.238 INFO:tasks.workunit.client.0.smithi096.stderr: "per_pool": [ 2024-09-16T03:24:52.238 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.238 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 1, 2024-09-16T03:24:52.238 INFO:tasks.workunit.client.0.smithi096.stderr: "floor": 23 2024-09-16T03:24:52.238 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.238 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.238 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 2, 2024-09-16T03:24:52.239 INFO:tasks.workunit.client.0.smithi096.stderr: "floor": 23 2024-09-16T03:24:52.239 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:52.239 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:52.239 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.239 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_epochs": [ 2024-09-16T03:24:52.239 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.239 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:24:52.239 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 16 2024-09-16T03:24:52.239 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.239 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.239 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:24:52.239 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 16 2024-09-16T03:24:52.239 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.239 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.239 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:24:52.240 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 23 2024-09-16T03:24:52.240 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:52.240 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:52.240 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.240 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_first_committed": 1, 2024-09-16T03:24:52.240 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_last_committed": 28, 2024-09-16T03:24:52.240 INFO:tasks.workunit.client.0.smithi096.stderr: "crushmap": { 2024-09-16T03:24:52.240 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": [ 2024-09-16T03:24:52.240 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.240 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:24:52.240 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.0", 2024-09-16T03:24:52.240 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:24:52.240 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.240 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.241 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:24:52.241 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.1", 2024-09-16T03:24:52.241 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:24:52.241 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.241 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.241 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:24:52.241 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.2", 2024-09-16T03:24:52.241 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:24:52.241 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:52.241 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:52.241 INFO:tasks.workunit.client.0.smithi096.stderr: "types": [ 2024-09-16T03:24:52.241 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.241 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 0, 2024-09-16T03:24:52.242 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd" 2024-09-16T03:24:52.242 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.242 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.242 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:24:52.242 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "host" 2024-09-16T03:24:52.242 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.242 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.242 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 2, 2024-09-16T03:24:52.242 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "chassis" 2024-09-16T03:24:52.242 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.242 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.242 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 3, 2024-09-16T03:24:52.242 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "rack" 2024-09-16T03:24:52.242 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.243 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.243 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 4, 2024-09-16T03:24:52.243 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "row" 2024-09-16T03:24:52.243 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.243 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.243 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 5, 2024-09-16T03:24:52.243 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "pdu" 2024-09-16T03:24:52.243 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.243 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.243 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 6, 2024-09-16T03:24:52.243 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "pod" 2024-09-16T03:24:52.243 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.243 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.243 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 7, 2024-09-16T03:24:52.243 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "room" 2024-09-16T03:24:52.244 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.244 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.244 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 8, 2024-09-16T03:24:52.244 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "datacenter" 2024-09-16T03:24:52.244 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.244 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.244 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 9, 2024-09-16T03:24:52.244 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "zone" 2024-09-16T03:24:52.244 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.244 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.244 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 10, 2024-09-16T03:24:52.244 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "region" 2024-09-16T03:24:52.244 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.245 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.245 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:24:52.245 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "root" 2024-09-16T03:24:52.245 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:52.245 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:52.245 INFO:tasks.workunit.client.0.smithi096.stderr: "buckets": [ 2024-09-16T03:24:52.245 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.245 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -1, 2024-09-16T03:24:52.245 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "default", 2024-09-16T03:24:52.245 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:24:52.245 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "root", 2024-09-16T03:24:52.245 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:24:52.245 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:24:52.245 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:24:52.246 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:24:52.246 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.246 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -3, 2024-09-16T03:24:52.246 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:24:52.246 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:24:52.246 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:52.246 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:52.246 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.246 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.246 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -2, 2024-09-16T03:24:52.246 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "default~hdd", 2024-09-16T03:24:52.246 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:24:52.246 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "root", 2024-09-16T03:24:52.246 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:24:52.246 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:24:52.247 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:24:52.247 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:24:52.247 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.247 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -4, 2024-09-16T03:24:52.247 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:24:52.247 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:24:52.247 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:52.247 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:52.247 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.247 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.247 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -3, 2024-09-16T03:24:52.247 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "smithi096", 2024-09-16T03:24:52.247 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:24:52.248 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "host", 2024-09-16T03:24:52.248 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:24:52.248 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:24:52.248 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:24:52.248 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:24:52.248 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.248 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:24:52.248 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:24:52.248 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:24:52.248 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.248 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.248 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:24:52.248 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:24:52.248 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 1 2024-09-16T03:24:52.248 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.249 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.249 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:24:52.249 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:24:52.249 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 2 2024-09-16T03:24:52.249 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:52.249 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:52.249 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.249 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.249 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -4, 2024-09-16T03:24:52.249 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "smithi096~hdd", 2024-09-16T03:24:52.249 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:24:52.249 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "host", 2024-09-16T03:24:52.249 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:24:52.249 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:24:52.250 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:24:52.250 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:24:52.250 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.250 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:24:52.250 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:24:52.250 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:24:52.250 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.250 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.250 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:24:52.250 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:24:52.250 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 1 2024-09-16T03:24:52.250 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.250 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.250 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:24:52.251 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:24:52.251 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 2 2024-09-16T03:24:52.251 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:52.251 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:52.251 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:52.251 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:52.251 INFO:tasks.workunit.client.0.smithi096.stderr: "rules": [ 2024-09-16T03:24:52.251 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.251 INFO:tasks.workunit.client.0.smithi096.stderr: "rule_id": 0, 2024-09-16T03:24:52.251 INFO:tasks.workunit.client.0.smithi096.stderr: "rule_name": "replicated_rule", 2024-09-16T03:24:52.251 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:24:52.251 INFO:tasks.workunit.client.0.smithi096.stderr: "steps": [ 2024-09-16T03:24:52.251 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.251 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "take", 2024-09-16T03:24:52.252 INFO:tasks.workunit.client.0.smithi096.stderr: "item": -1, 2024-09-16T03:24:52.252 INFO:tasks.workunit.client.0.smithi096.stderr: "item_name": "default" 2024-09-16T03:24:52.252 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.252 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.252 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "choose_firstn", 2024-09-16T03:24:52.252 INFO:tasks.workunit.client.0.smithi096.stderr: "num": 0, 2024-09-16T03:24:52.252 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "osd" 2024-09-16T03:24:52.252 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.252 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.252 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "emit" 2024-09-16T03:24:52.252 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:52.252 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:52.252 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:52.253 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:52.253 INFO:tasks.workunit.client.0.smithi096.stderr: "tunables": { 2024-09-16T03:24:52.253 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_local_tries": 0, 2024-09-16T03:24:52.253 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_local_fallback_tries": 0, 2024-09-16T03:24:52.253 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_total_tries": 50, 2024-09-16T03:24:52.253 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_descend_once": 1, 2024-09-16T03:24:52.253 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_vary_r": 1, 2024-09-16T03:24:52.253 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_stable": 1, 2024-09-16T03:24:52.253 INFO:tasks.workunit.client.0.smithi096.stderr: "msr_descents": 100, 2024-09-16T03:24:52.253 INFO:tasks.workunit.client.0.smithi096.stderr: "msr_collision_tries": 100, 2024-09-16T03:24:52.253 INFO:tasks.workunit.client.0.smithi096.stderr: "straw_calc_version": 1, 2024-09-16T03:24:52.253 INFO:tasks.workunit.client.0.smithi096.stderr: "allowed_bucket_algs": 54, 2024-09-16T03:24:52.253 INFO:tasks.workunit.client.0.smithi096.stderr: "profile": "jewel", 2024-09-16T03:24:52.253 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_tunables": 1, 2024-09-16T03:24:52.253 INFO:tasks.workunit.client.0.smithi096.stderr: "legacy_tunables": 0, 2024-09-16T03:24:52.254 INFO:tasks.workunit.client.0.smithi096.stderr: "minimum_required_version": "jewel", 2024-09-16T03:24:52.254 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables": 1, 2024-09-16T03:24:52.254 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables2": 1, 2024-09-16T03:24:52.254 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v2_rules": 0, 2024-09-16T03:24:52.254 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables3": 1, 2024-09-16T03:24:52.254 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v3_rules": 0, 2024-09-16T03:24:52.254 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v4_buckets": 1, 2024-09-16T03:24:52.254 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables5": 1, 2024-09-16T03:24:52.254 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v5_rules": 0, 2024-09-16T03:24:52.254 INFO:tasks.workunit.client.0.smithi096.stderr: "has_msr_rules": 0 2024-09-16T03:24:52.254 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.254 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_args": {} 2024-09-16T03:24:52.255 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.255 INFO:tasks.workunit.client.0.smithi096.stderr: "fsmap": { 2024-09-16T03:24:52.255 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 1, 2024-09-16T03:24:52.255 INFO:tasks.workunit.client.0.smithi096.stderr: "btime": "2024-09-16T03:22:46:882186+0000", 2024-09-16T03:24:52.255 INFO:tasks.workunit.client.0.smithi096.stderr: "default_fscid": -1, 2024-09-16T03:24:52.255 INFO:tasks.workunit.client.0.smithi096.stderr: "compat": { 2024-09-16T03:24:52.255 INFO:tasks.workunit.client.0.smithi096.stderr: "compat": {}, 2024-09-16T03:24:52.255 INFO:tasks.workunit.client.0.smithi096.stderr: "ro_compat": {}, 2024-09-16T03:24:52.255 INFO:tasks.workunit.client.0.smithi096.stderr: "incompat": { 2024-09-16T03:24:52.255 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_1": "base v0.20", 2024-09-16T03:24:52.255 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_2": "client writeable ranges", 2024-09-16T03:24:52.255 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_3": "default file layouts on dirs", 2024-09-16T03:24:52.255 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_4": "dir inode in separate object", 2024-09-16T03:24:52.255 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_5": "mds uses versioned encoding", 2024-09-16T03:24:52.256 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_6": "dirfrag is stored in omap", 2024-09-16T03:24:52.256 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_8": "no anchor table", 2024-09-16T03:24:52.256 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_9": "file layout v2", 2024-09-16T03:24:52.256 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_10": "snaprealm v2", 2024-09-16T03:24:52.256 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_11": "minor log segments", 2024-09-16T03:24:52.256 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_12": "quiesce subvolumes" 2024-09-16T03:24:52.256 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:52.256 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.256 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_flags": { 2024-09-16T03:24:52.256 INFO:tasks.workunit.client.0.smithi096.stderr: "enable_multiple": true, 2024-09-16T03:24:52.256 INFO:tasks.workunit.client.0.smithi096.stderr: "ever_enabled_multiple": true 2024-09-16T03:24:52.256 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.257 INFO:tasks.workunit.client.0.smithi096.stderr: "standbys": [], 2024-09-16T03:24:52.257 INFO:tasks.workunit.client.0.smithi096.stderr: "filesystems": [] 2024-09-16T03:24:52.257 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.257 INFO:tasks.workunit.client.0.smithi096.stderr: "mdsmap_first_committed": 1, 2024-09-16T03:24:52.257 INFO:tasks.workunit.client.0.smithi096.stderr: "mdsmap_last_committed": 1, 2024-09-16T03:24:52.257 INFO:tasks.workunit.client.0.smithi096.stderr: "auth": { 2024-09-16T03:24:52.257 INFO:tasks.workunit.client.0.smithi096.stderr: "first_committed": 1, 2024-09-16T03:24:52.257 INFO:tasks.workunit.client.0.smithi096.stderr: "last_committed": 5, 2024-09-16T03:24:52.257 INFO:tasks.workunit.client.0.smithi096.stderr: "num_secrets": 3 2024-09-16T03:24:52.257 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.257 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 64, 2024-09-16T03:24:52.257 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_active": 35, 2024-09-16T03:24:52.257 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_unknown": 11, 2024-09-16T03:24:52.257 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osd": 3, 2024-09-16T03:24:52.258 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_sum": { 2024-09-16T03:24:52.258 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:24:52.258 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:24:52.258 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:24:52.258 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:24:52.258 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:24:52.258 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:24:52.258 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:24:52.258 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:24:52.258 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:24:52.258 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:24:52.258 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:24:52.258 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:24:52.259 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:24:52.259 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:24:52.259 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:24:52.259 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:24:52.259 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:24:52.259 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:24:52.259 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:24:52.259 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:24:52.259 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:24:52.259 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:24:52.259 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:24:52.259 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:24:52.259 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:24:52.259 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:24:52.260 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:24:52.260 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:24:52.260 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:24:52.260 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:24:52.260 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:24:52.260 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:24:52.260 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:24:52.260 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:24:52.260 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:24:52.260 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:24:52.260 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:24:52.260 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:24:52.260 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:24:52.261 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:24:52.261 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:24:52.261 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.261 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:24:52.261 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:24:52.261 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:24:52.261 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:24:52.261 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:24:52.261 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:24:52.261 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:24:52.261 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:24:52.261 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:24:52.261 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:24:52.261 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:24:52.262 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.262 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:24:52.262 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:24:52.262 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 159, 2024-09-16T03:24:52.262 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 159, 2024-09-16T03:24:52.262 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 0 2024-09-16T03:24:52.262 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.262 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_sum": { 2024-09-16T03:24:52.262 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 0, 2024-09-16T03:24:52.262 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 0, 2024-09-16T03:24:52.262 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pgs": 24, 2024-09-16T03:24:52.262 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osds": 3, 2024-09-16T03:24:52.262 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_osds": 3, 2024-09-16T03:24:52.263 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_omap_osds": 3, 2024-09-16T03:24:52.263 INFO:tasks.workunit.client.0.smithi096.stderr: "kb": 314572800, 2024-09-16T03:24:52.263 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used": 81048, 2024-09-16T03:24:52.263 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_data": 528, 2024-09-16T03:24:52.263 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_omap": 4, 2024-09-16T03:24:52.263 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_meta": 80443, 2024-09-16T03:24:52.263 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_avail": 314491752, 2024-09-16T03:24:52.263 INFO:tasks.workunit.client.0.smithi096.stderr: "statfs": { 2024-09-16T03:24:52.263 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 322122547200, 2024-09-16T03:24:52.263 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 322039554048, 2024-09-16T03:24:52.263 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:24:52.263 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 540672, 2024-09-16T03:24:52.263 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 144817, 2024-09-16T03:24:52.263 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:24:52.264 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:24:52.264 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:24:52.264 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 4785, 2024-09-16T03:24:52.264 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 82373967 2024-09-16T03:24:52.264 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.264 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_peers": [], 2024-09-16T03:24:52.264 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_trim_queue_len": 0, 2024-09-16T03:24:52.264 INFO:tasks.workunit.client.0.smithi096.stderr: "num_snap_trimming": 0, 2024-09-16T03:24:52.264 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shards_repaired": 0, 2024-09-16T03:24:52.264 INFO:tasks.workunit.client.0.smithi096.stderr: "op_queue_age_hist": { 2024-09-16T03:24:52.264 INFO:tasks.workunit.client.0.smithi096.stderr: "histogram": [], 2024-09-16T03:24:52.264 INFO:tasks.workunit.client.0.smithi096.stderr: "upper_bound": 1 2024-09-16T03:24:52.264 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.264 INFO:tasks.workunit.client.0.smithi096.stderr: "perf_stat": { 2024-09-16T03:24:52.265 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ms": 686, 2024-09-16T03:24:52.265 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ms": 686, 2024-09-16T03:24:52.265 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ns": 686000000, 2024-09-16T03:24:52.265 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ns": 686000000 2024-09-16T03:24:52.265 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.265 INFO:tasks.workunit.client.0.smithi096.stderr: "alerts": [], 2024-09-16T03:24:52.265 INFO:tasks.workunit.client.0.smithi096.stderr: "network_ping_times": [] 2024-09-16T03:24:52.265 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.265 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_sum_by_class": { 2024-09-16T03:24:52.265 INFO:tasks.workunit.client.0.smithi096.stderr: "hdd": { 2024-09-16T03:24:52.265 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 0, 2024-09-16T03:24:52.265 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 0, 2024-09-16T03:24:52.265 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pgs": 24, 2024-09-16T03:24:52.265 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osds": 3, 2024-09-16T03:24:52.266 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_osds": 3, 2024-09-16T03:24:52.266 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_omap_osds": 3, 2024-09-16T03:24:52.266 INFO:tasks.workunit.client.0.smithi096.stderr: "kb": 314572800, 2024-09-16T03:24:52.266 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used": 81048, 2024-09-16T03:24:52.266 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_data": 528, 2024-09-16T03:24:52.266 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_omap": 4, 2024-09-16T03:24:52.266 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_meta": 80443, 2024-09-16T03:24:52.266 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_avail": 314491752, 2024-09-16T03:24:52.266 INFO:tasks.workunit.client.0.smithi096.stderr: "statfs": { 2024-09-16T03:24:52.266 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 322122547200, 2024-09-16T03:24:52.266 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 322039554048, 2024-09-16T03:24:52.266 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:24:52.266 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 540672, 2024-09-16T03:24:52.266 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 144817, 2024-09-16T03:24:52.267 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:24:52.267 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:24:52.267 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:24:52.267 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 4785, 2024-09-16T03:24:52.267 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 82373967 2024-09-16T03:24:52.267 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.267 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_peers": [], 2024-09-16T03:24:52.267 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_trim_queue_len": 0, 2024-09-16T03:24:52.267 INFO:tasks.workunit.client.0.smithi096.stderr: "num_snap_trimming": 0, 2024-09-16T03:24:52.267 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shards_repaired": 0, 2024-09-16T03:24:52.267 INFO:tasks.workunit.client.0.smithi096.stderr: "op_queue_age_hist": { 2024-09-16T03:24:52.267 INFO:tasks.workunit.client.0.smithi096.stderr: "histogram": [], 2024-09-16T03:24:52.267 INFO:tasks.workunit.client.0.smithi096.stderr: "upper_bound": 1 2024-09-16T03:24:52.267 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.268 INFO:tasks.workunit.client.0.smithi096.stderr: "perf_stat": { 2024-09-16T03:24:52.268 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ms": 686, 2024-09-16T03:24:52.268 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ms": 686, 2024-09-16T03:24:52.268 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ns": 686000000, 2024-09-16T03:24:52.268 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ns": 686000000 2024-09-16T03:24:52.268 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.268 INFO:tasks.workunit.client.0.smithi096.stderr: "alerts": [], 2024-09-16T03:24:52.268 INFO:tasks.workunit.client.0.smithi096.stderr: "network_ping_times": [] 2024-09-16T03:24:52.268 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:52.268 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.268 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_stats": [ 2024-09-16T03:24:52.268 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.268 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 2, 2024-09-16T03:24:52.268 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 32, 2024-09-16T03:24:52.269 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:24:52.269 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:24:52.269 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:24:52.269 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:24:52.269 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:24:52.269 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:24:52.269 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:24:52.269 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:24:52.269 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:24:52.269 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:24:52.269 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:24:52.269 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:24:52.269 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:24:52.269 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:24:52.270 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:24:52.270 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:24:52.270 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:24:52.270 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:24:52.270 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:24:52.270 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:24:52.270 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:24:52.270 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:24:52.270 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:24:52.270 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:24:52.270 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:24:52.270 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:24:52.270 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:24:52.270 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:24:52.271 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:24:52.271 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:24:52.271 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:24:52.271 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:24:52.271 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:24:52.271 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:24:52.271 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:24:52.271 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:24:52.271 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:24:52.271 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:24:52.271 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:24:52.271 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:24:52.271 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:24:52.271 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.272 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:24:52.272 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:24:52.272 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:24:52.272 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:24:52.272 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:24:52.272 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:24:52.272 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:24:52.272 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:24:52.272 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:24:52.272 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:24:52.272 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:24:52.272 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.272 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:24:52.272 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:24:52.273 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 63, 2024-09-16T03:24:52.273 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 63, 2024-09-16T03:24:52.273 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 2 2024-09-16T03:24:52.273 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.273 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.273 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 1, 2024-09-16T03:24:52.273 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 32, 2024-09-16T03:24:52.273 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:24:52.273 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:24:52.273 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:24:52.273 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:24:52.273 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:24:52.273 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:24:52.273 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:24:52.274 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:24:52.274 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:24:52.274 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:24:52.274 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:24:52.274 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:24:52.274 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:24:52.274 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:24:52.274 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:24:52.274 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:24:52.274 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:24:52.274 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:24:52.274 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:24:52.274 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:24:52.274 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:24:52.275 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:24:52.275 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:24:52.275 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:24:52.275 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:24:52.275 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:24:52.275 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:24:52.275 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:24:52.275 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:24:52.275 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:24:52.275 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:24:52.275 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:24:52.275 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:24:52.275 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:24:52.275 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:24:52.276 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:24:52.276 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:24:52.276 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:24:52.276 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:24:52.276 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:24:52.276 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:24:52.276 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.276 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:24:52.276 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:24:52.276 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:24:52.276 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:24:52.276 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:24:52.276 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:24:52.276 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:24:52.277 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:24:52.277 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:24:52.277 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:24:52.277 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:24:52.277 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.277 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:24:52.277 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:24:52.277 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 96, 2024-09-16T03:24:52.277 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 96, 2024-09-16T03:24:52.278 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 3 2024-09-16T03:24:52.278 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:52.278 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:52.278 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_stats": [ 2024-09-16T03:24:52.278 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.278 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:24:52.278 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 21474836504 2024-09-16T03:24:52.278 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.278 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.278 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:24:52.278 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 42949672975 2024-09-16T03:24:52.278 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.278 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.278 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:24:52.279 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 64424509448 2024-09-16T03:24:52.279 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:52.279 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:52.279 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_by_state": [ 2024-09-16T03:24:52.279 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.279 INFO:tasks.workunit.client.0.smithi096.stderr: "state": "active+clean", 2024-09-16T03:24:52.279 INFO:tasks.workunit.client.0.smithi096.stderr: "num": 35 2024-09-16T03:24:52.279 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.279 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.279 INFO:tasks.workunit.client.0.smithi096.stderr: "state": "creating+activating", 2024-09-16T03:24:52.279 INFO:tasks.workunit.client.0.smithi096.stderr: "num": 18 2024-09-16T03:24:52.279 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.279 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.279 INFO:tasks.workunit.client.0.smithi096.stderr: "state": "unknown", 2024-09-16T03:24:52.279 INFO:tasks.workunit.client.0.smithi096.stderr: "num": 11 2024-09-16T03:24:52.280 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:52.280 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:52.280 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_by_osd": [ 2024-09-16T03:24:52.280 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.280 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:24:52.280 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 15, 2024-09-16T03:24:52.280 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 53, 2024-09-16T03:24:52.280 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:24:52.280 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.280 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.280 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:24:52.280 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 20, 2024-09-16T03:24:52.280 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 53, 2024-09-16T03:24:52.281 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:24:52.281 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.281 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.281 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:24:52.281 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 18, 2024-09-16T03:24:52.281 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 53, 2024-09-16T03:24:52.281 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:24:52.281 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:52.281 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:52.281 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": [ 2024-09-16T03:24:52.281 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:52.281 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 1, 2024-09-16T03:24:52.281 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": {} 2024-09-16T03:24:52.281 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:52.282 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:52.282 INFO:tasks.workunit.client.0.smithi096.stderr: "servicemap": { 2024-09-16T03:24:52.282 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 3, 2024-09-16T03:24:52.282 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:24:24.403052+0000", 2024-09-16T03:24:52.282 INFO:tasks.workunit.client.0.smithi096.stderr: "services": { 2024-09-16T03:24:52.282 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": { 2024-09-16T03:24:52.282 INFO:tasks.workunit.client.0.smithi096.stderr: "daemons": { 2024-09-16T03:24:52.282 INFO:tasks.workunit.client.0.smithi096.stderr: "summary": "", 2024-09-16T03:24:52.282 INFO:tasks.workunit.client.0.smithi096.stderr: "1": { 2024-09-16T03:24:52.282 INFO:tasks.workunit.client.0.smithi096.stderr: "start_epoch": 0, 2024-09-16T03:24:52.282 INFO:tasks.workunit.client.0.smithi096.stderr: "start_stamp": "0.000000", 2024-09-16T03:24:52.282 INFO:tasks.workunit.client.0.smithi096.stderr: "gid": 0, 2024-09-16T03:24:52.282 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "(unrecognized address family 0)/0", 2024-09-16T03:24:52.282 INFO:tasks.workunit.client.0.smithi096.stderr: "metadata": {}, 2024-09-16T03:24:52.282 INFO:tasks.workunit.client.0.smithi096.stderr: "task_status": {} 2024-09-16T03:24:52.283 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:52.283 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:52.283 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:52.283 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:52.283 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:52.283 INFO:tasks.workunit.client.0.smithi096.stderr: "mgrstat_first_committed": 44, 2024-09-16T03:24:52.283 INFO:tasks.workunit.client.0.smithi096.stderr: "mgrstat_last_committed": 51, 2024-09-16T03:24:52.283 INFO:tasks.workunit.client.0.smithi096.stderr: "logm_first_committed": 1, 2024-09-16T03:24:52.283 INFO:tasks.workunit.client.0.smithi096.stderr: "logm_last_committed": 226, 2024-09-16T03:24:52.283 INFO:tasks.workunit.client.0.smithi096.stderr: "paxos": { 2024-09-16T03:24:52.283 INFO:tasks.workunit.client.0.smithi096.stderr: "first_committed": 1, 2024-09-16T03:24:52.283 INFO:tasks.workunit.client.0.smithi096.stderr: "last_committed": 312, 2024-09-16T03:24:52.283 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pn": 0, 2024-09-16T03:24:52.283 INFO:tasks.workunit.client.0.smithi096.stderr: "accepted_pn": 0 2024-09-16T03:24:52.284 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:52.284 INFO:tasks.workunit.client.0.smithi096.stderr:}' 2024-09-16T03:24:52.287 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:132: get_fc_lc_diff: jq .osdmap_first_committed 2024-09-16T03:24:52.287 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:132: get_fc_lc_diff: echo '{' '"cluster_fingerprint":' '"fda2fc64-07ed-4add-8224-2e527e11d427",' '"version":' '"19.3.0-4930-gfc3e0bff",' '"commit":' '"fc3e0bff7468fd55478adbae7f75508b749124b6",' '"timestamp":' '"2024-09-16T03:24:52.165833+0000",' '"tag":' '"",' '"health":' '{' '"status":' '"HEALTH_OK",' '"checks":' '{},' '"mutes":' '[]' '},' '"monmap_first_committed":' 1, '"monmap_last_committed":' 1, '"monmap":' '{' '"epoch":' 1, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"modified":' '"2024-09-16T03:22:45.872880Z",' '"created":' '"2024-09-16T03:22:45.872880Z",' '"min_mon_release":' 19, '"min_mon_release_name":' '"squid",' '"election_strategy":' 1, '"disallowed_leaders:' '":' '"",' '"stretch_mode":' false, '"tiebreaker_mon":' '"",' '"removed_ranks:' '":' '"",' '"features":' '{' '"persistent":' '[' '"kraken",' '"luminous",' '"mimic",' '"osdmap-prune",' '"nautilus",' '"octopus",' '"pacific",' '"elector-pinging",' '"quincy",' '"reef",' '"squid"' '],' '"optional":' '[]' '},' '"mons":' '[' '{' '"rank":' 0, '"name":' '"a",' '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:7302",' '"nonce":' 0 '}' ']' '},' '"addr":' '"127.0.0.1:7302/0",' '"public_addr":' '"127.0.0.1:7302/0",' '"priority":' 0, '"weight":' 0, '"crush_location":' '"{}"' '}' ']' '},' '"quorum":' '[' 0 '],' '"osdmap":' '{' '"epoch":' 28, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"created":' '"2024-09-16T03:22:46.906117+0000",' '"modified":' '"2024-09-16T03:24:50.642444+0000",' '"last_up_change":' '"2024-09-16T03:24:37.708512+0000",' '"last_in_change":' '"2024-09-16T03:24:01.831039+0000",' '"flags":' '"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit",' '"flags_num":' 5799936, '"flags_set":' '[' '"pglog_hardlimit",' '"purged_snapdirs",' '"recovery_deletes",' '"sortbitwise"' '],' '"crush_version":' 7, '"full_ratio":' 0.97000002861022949, '"backfillfull_ratio":' 0.97000002861022949, '"nearfull_ratio":' 0.85000002384185791, '"cluster_snapshot":' '"",' '"pool_max":' 2, '"max_osd":' 3, '"require_min_compat_client":' '"luminous",' '"min_compat_client":' '"jewel",' '"require_osd_release":' '"squid",' '"allow_crimson":' false, '"pools":' '[' '{' '"pool":' 1, '"pool_name":' '"foo",' '"create_time":' '"2024-09-16T03:24:44.525189+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"21",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.690000057220459, '"score_stable":' 1.690000057220459, '"optimal_score":' 1, '"raw_score_acting":' 1.690000057220459, '"raw_score_stable":' 1.690000057220459, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '},' '{' '"pool":' 2, '"pool_name":' '"bar",' '"create_time":' '"2024-09-16T03:24:46.226575+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"24",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.1299999952316284, '"score_stable":' 1.1299999952316284, '"optimal_score":' 1, '"raw_score_acting":' 1.1299999952316284, '"raw_score_stable":' 1.1299999952316284, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '}' '],' '"osds":' '[' '{' '"osd":' 0, '"uuid":' '"64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 5, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6802",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6803",' '"nonce":' 3375787448 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6804",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6805",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6808",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6809",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6806",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6807",' '"nonce":' 3375787448 '}' ']' '},' '"public_addr":' '"127.0.0.1:6803/3375787448",' '"cluster_addr":' '"127.0.0.1:6805/3375787448",' '"heartbeat_back_addr":' '"127.0.0.1:6809/3375787448",' '"heartbeat_front_addr":' '"127.0.0.1:6807/3375787448",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 1, '"uuid":' '"74b26727-75c9-444d-8782-719e4197a382",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 10, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6810",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6811",' '"nonce":' 3733255132 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6812",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6813",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6816",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6817",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6814",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6815",' '"nonce":' 3733255132 '}' ']' '},' '"public_addr":' '"127.0.0.1:6811/3733255132",' '"cluster_addr":' '"127.0.0.1:6813/3733255132",' '"heartbeat_back_addr":' '"127.0.0.1:6817/3733255132",' '"heartbeat_front_addr":' '"127.0.0.1:6815/3733255132",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 2, '"uuid":' '"143da3a7-dad9-4b1e-966b-76cf5bdd3c82",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 15, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6818",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6819",' '"nonce":' 963814857 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6820",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6821",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6824",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6825",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6822",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6823",' '"nonce":' 963814857 '}' ']' '},' '"public_addr":' '"127.0.0.1:6819/963814857",' '"cluster_addr":' '"127.0.0.1:6821/963814857",' '"heartbeat_back_addr":' '"127.0.0.1:6825/963814857",' '"heartbeat_front_addr":' '"127.0.0.1:6823/963814857",' '"state":' '[' '"exists",' '"up"' ']' '}' '],' '"osd_xinfo":' '[' '{' '"osd":' 0, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:22.481942+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 1, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:59.663703+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 2, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:24:37.320822+0000",' '"dead_epoch":' 0 '}' '],' '"pg_upmap":' '[],' '"pg_upmap_items":' '[],' '"pg_upmap_primaries":' '[],' '"pg_temp":' '[],' '"primary_temp":' '[],' '"blocklist":' '{},' '"range_blocklist":' '{},' '"erasure_code_profiles":' '{' '"default":' '{' '"k":' '"2",' '"m":' '"2",' '"plugin":' '"jerasure",' '"technique":' '"reed_sol_van"' '}' '},' '"removed_snaps_queue":' '[],' '"new_removed_snaps":' '[],' '"new_purged_snaps":' '[],' '"crush_node_flags":' '{},' '"device_class_flags":' '{},' '"stretch_mode":' '{' '"stretch_mode_enabled":' false, '"stretch_bucket_count":' 0, '"degraded_stretch_mode":' 0, '"recovering_stretch_mode":' 0, '"stretch_mode_bucket":' 0 '}' '},' '"osd_metadata":' '[' '{' '"id":' 0, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/0/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:22:53.662571Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]",' '"hb_front_addr":' '"[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/0",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 1, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/1/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:23:30.129885Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]",' '"hb_front_addr":' '"[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/1",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 2, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/2/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:24:07.764502Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]",' '"hb_front_addr":' '"[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/2",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '}' '],' '"osdmap_clean_epochs":' '{' '"min_last_epoch_clean":' 0, '"last_epoch_clean":' '{' '"per_pool":' '[' '{' '"poolid":' 1, '"floor":' 23 '},' '{' '"poolid":' 2, '"floor":' 23 '}' ']' '},' '"osd_epochs":' '[' '{' '"id":' 0, '"epoch":' 16 '},' '{' '"id":' 1, '"epoch":' 16 '},' '{' '"id":' 2, '"epoch":' 23 '}' ']' '},' '"osdmap_first_committed":' 1, '"osdmap_last_committed":' 28, '"crushmap":' '{' '"devices":' '[' '{' '"id":' 0, '"name":' '"osd.0",' '"class":' '"hdd"' '},' '{' '"id":' 1, '"name":' '"osd.1",' '"class":' '"hdd"' '},' '{' '"id":' 2, '"name":' '"osd.2",' '"class":' '"hdd"' '}' '],' '"types":' '[' '{' '"type_id":' 0, '"name":' '"osd"' '},' '{' '"type_id":' 1, '"name":' '"host"' '},' '{' '"type_id":' 2, '"name":' '"chassis"' '},' '{' '"type_id":' 3, '"name":' '"rack"' '},' '{' '"type_id":' 4, '"name":' '"row"' '},' '{' '"type_id":' 5, '"name":' '"pdu"' '},' '{' '"type_id":' 6, '"name":' '"pod"' '},' '{' '"type_id":' 7, '"name":' '"room"' '},' '{' '"type_id":' 8, '"name":' '"datacenter"' '},' '{' '"type_id":' 9, '"name":' '"zone"' '},' '{' '"type_id":' 10, '"name":' '"region"' '},' '{' '"type_id":' 11, '"name":' '"root"' '}' '],' '"buckets":' '[' '{' '"id":' -1, '"name":' '"default",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -3, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -2, '"name":' '"default~hdd",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -4, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -3, '"name":' '"smithi096",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '},' '{' '"id":' -4, '"name":' '"smithi096~hdd",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '}' '],' '"rules":' '[' '{' '"rule_id":' 0, '"rule_name":' '"replicated_rule",' '"type":' 1, '"steps":' '[' '{' '"op":' '"take",' '"item":' -1, '"item_name":' '"default"' '},' '{' '"op":' '"choose_firstn",' '"num":' 0, '"type":' '"osd"' '},' '{' '"op":' '"emit"' '}' ']' '}' '],' '"tunables":' '{' '"choose_local_tries":' 0, '"choose_local_fallback_tries":' 0, '"choose_total_tries":' 50, '"chooseleaf_descend_once":' 1, '"chooseleaf_vary_r":' 1, '"chooseleaf_stable":' 1, '"msr_descents":' 100, '"msr_collision_tries":' 100, '"straw_calc_version":' 1, '"allowed_bucket_algs":' 54, '"profile":' '"jewel",' '"optimal_tunables":' 1, '"legacy_tunables":' 0, '"minimum_required_version":' '"jewel",' '"require_feature_tunables":' 1, '"require_feature_tunables2":' 1, '"has_v2_rules":' 0, '"require_feature_tunables3":' 1, '"has_v3_rules":' 0, '"has_v4_buckets":' 1, '"require_feature_tunables5":' 1, '"has_v5_rules":' 0, '"has_msr_rules":' 0 '},' '"choose_args":' '{}' '},' '"fsmap":' '{' '"epoch":' 1, '"btime":' '"2024-09-16T03:22:46:882186+0000",' '"default_fscid":' -1, '"compat":' '{' '"compat":' '{},' '"ro_compat":' '{},' '"incompat":' '{' '"feature_1":' '"base' 'v0.20",' '"feature_2":' '"client' writeable 'ranges",' '"feature_3":' '"default' file layouts on 'dirs",' '"feature_4":' '"dir' inode in separate 'object",' '"feature_5":' '"mds' uses versioned 'encoding",' '"feature_6":' '"dirfrag' is stored in 'omap",' '"feature_8":' '"no' anchor 'table",' '"feature_9":' '"file' layout 'v2",' '"feature_10":' '"snaprealm' 'v2",' '"feature_11":' '"minor' log 'segments",' '"feature_12":' '"quiesce' 'subvolumes"' '}' '},' '"feature_flags":' '{' '"enable_multiple":' true, '"ever_enabled_multiple":' true '},' '"standbys":' '[],' '"filesystems":' '[]' '},' '"mdsmap_first_committed":' 1, '"mdsmap_last_committed":' 1, '"auth":' '{' '"first_committed":' 1, '"last_committed":' 5, '"num_secrets":' 3 '},' '"num_pg":' 64, '"num_pg_active":' 35, '"num_pg_unknown":' 11, '"num_osd":' 3, '"pool_sum":' '{' '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 159, '"acting":' 159, '"num_store_stats":' 0 '},' '"osd_sum":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 24, '"num_osds":' 3, '"num_per_pool_osds":' 3, '"num_per_pool_omap_osds":' 3, '"kb":' 314572800, '"kb_used":' 81048, '"kb_used_data":' 528, '"kb_used_omap":' 4, '"kb_used_meta":' 80443, '"kb_avail":' 314491752, '"statfs":' '{' '"total":' 322122547200, '"available":' 322039554048, '"internally_reserved":' 0, '"allocated":' 540672, '"data_stored":' 144817, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 4785, '"internal_metadata":' 82373967 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 686, '"apply_latency_ms":' 686, '"commit_latency_ns":' 686000000, '"apply_latency_ns":' 686000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '},' '"osd_sum_by_class":' '{' '"hdd":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 24, '"num_osds":' 3, '"num_per_pool_osds":' 3, '"num_per_pool_omap_osds":' 3, '"kb":' 314572800, '"kb_used":' 81048, '"kb_used_data":' 528, '"kb_used_omap":' 4, '"kb_used_meta":' 80443, '"kb_avail":' 314491752, '"statfs":' '{' '"total":' 322122547200, '"available":' 322039554048, '"internally_reserved":' 0, '"allocated":' 540672, '"data_stored":' 144817, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 4785, '"internal_metadata":' 82373967 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 686, '"apply_latency_ms":' 686, '"commit_latency_ns":' 686000000, '"apply_latency_ns":' 686000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '}' '},' '"pool_stats":' '[' '{' '"poolid":' 2, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 63, '"acting":' 63, '"num_store_stats":' 2 '},' '{' '"poolid":' 1, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 96, '"acting":' 96, '"num_store_stats":' 3 '}' '],' '"osd_stats":' '[' '{' '"osd":' 0, '"seq":' 21474836504 '},' '{' '"osd":' 1, '"seq":' 42949672975 '},' '{' '"osd":' 2, '"seq":' 64424509448 '}' '],' '"num_pg_by_state":' '[' '{' '"state":' '"active+clean",' '"num":' 35 '},' '{' '"state":' '"creating+activating",' '"num":' 18 '},' '{' '"state":' '"unknown",' '"num":' 11 '}' '],' '"num_pg_by_osd":' '[' '{' '"osd":' 2, '"num_primary_pg":' 15, '"num_acting_pg":' 53, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 0, '"num_primary_pg":' 20, '"num_acting_pg":' 53, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 1, '"num_primary_pg":' 18, '"num_acting_pg":' 53, '"num_up_not_acting_pg":' 0 '}' '],' '"purged_snaps":' '[' '{' '"pool":' 1, '"purged_snaps":' '{}' '}' '],' '"servicemap":' '{' '"epoch":' 3, '"modified":' '"2024-09-16T03:24:24.403052+0000",' '"services":' '{' '"osd":' '{' '"daemons":' '{' '"summary":' '"",' '"1":' '{' '"start_epoch":' 0, '"start_stamp":' '"0.000000",' '"gid":' 0, '"addr":' '"(unrecognized' address family '0)/0",' '"metadata":' '{},' '"task_status":' '{}' '}' '}' '}' '}' '},' '"mgrstat_first_committed":' 44, '"mgrstat_last_committed":' 51, '"logm_first_committed":' 1, '"logm_last_committed":' 226, '"paxos":' '{' '"first_committed":' 1, '"last_committed":' 312, '"last_pn":' 0, '"accepted_pn":' 0 '}' '}' 2024-09-16T03:24:52.287 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:132: get_fc_lc_diff: osdm_fc=1 2024-09-16T03:24:52.287 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:134: get_fc_lc_diff: jq .osdmap_last_committed 2024-09-16T03:24:52.287 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:134: get_fc_lc_diff: echo '{' '"cluster_fingerprint":' '"fda2fc64-07ed-4add-8224-2e527e11d427",' '"version":' '"19.3.0-4930-gfc3e0bff",' '"commit":' '"fc3e0bff7468fd55478adbae7f75508b749124b6",' '"timestamp":' '"2024-09-16T03:24:52.165833+0000",' '"tag":' '"",' '"health":' '{' '"status":' '"HEALTH_OK",' '"checks":' '{},' '"mutes":' '[]' '},' '"monmap_first_committed":' 1, '"monmap_last_committed":' 1, '"monmap":' '{' '"epoch":' 1, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"modified":' '"2024-09-16T03:22:45.872880Z",' '"created":' '"2024-09-16T03:22:45.872880Z",' '"min_mon_release":' 19, '"min_mon_release_name":' '"squid",' '"election_strategy":' 1, '"disallowed_leaders:' '":' '"",' '"stretch_mode":' false, '"tiebreaker_mon":' '"",' '"removed_ranks:' '":' '"",' '"features":' '{' '"persistent":' '[' '"kraken",' '"luminous",' '"mimic",' '"osdmap-prune",' '"nautilus",' '"octopus",' '"pacific",' '"elector-pinging",' '"quincy",' '"reef",' '"squid"' '],' '"optional":' '[]' '},' '"mons":' '[' '{' '"rank":' 0, '"name":' '"a",' '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:7302",' '"nonce":' 0 '}' ']' '},' '"addr":' '"127.0.0.1:7302/0",' '"public_addr":' '"127.0.0.1:7302/0",' '"priority":' 0, '"weight":' 0, '"crush_location":' '"{}"' '}' ']' '},' '"quorum":' '[' 0 '],' '"osdmap":' '{' '"epoch":' 28, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"created":' '"2024-09-16T03:22:46.906117+0000",' '"modified":' '"2024-09-16T03:24:50.642444+0000",' '"last_up_change":' '"2024-09-16T03:24:37.708512+0000",' '"last_in_change":' '"2024-09-16T03:24:01.831039+0000",' '"flags":' '"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit",' '"flags_num":' 5799936, '"flags_set":' '[' '"pglog_hardlimit",' '"purged_snapdirs",' '"recovery_deletes",' '"sortbitwise"' '],' '"crush_version":' 7, '"full_ratio":' 0.97000002861022949, '"backfillfull_ratio":' 0.97000002861022949, '"nearfull_ratio":' 0.85000002384185791, '"cluster_snapshot":' '"",' '"pool_max":' 2, '"max_osd":' 3, '"require_min_compat_client":' '"luminous",' '"min_compat_client":' '"jewel",' '"require_osd_release":' '"squid",' '"allow_crimson":' false, '"pools":' '[' '{' '"pool":' 1, '"pool_name":' '"foo",' '"create_time":' '"2024-09-16T03:24:44.525189+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"21",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.690000057220459, '"score_stable":' 1.690000057220459, '"optimal_score":' 1, '"raw_score_acting":' 1.690000057220459, '"raw_score_stable":' 1.690000057220459, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '},' '{' '"pool":' 2, '"pool_name":' '"bar",' '"create_time":' '"2024-09-16T03:24:46.226575+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"24",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.1299999952316284, '"score_stable":' 1.1299999952316284, '"optimal_score":' 1, '"raw_score_acting":' 1.1299999952316284, '"raw_score_stable":' 1.1299999952316284, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '}' '],' '"osds":' '[' '{' '"osd":' 0, '"uuid":' '"64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 5, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6802",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6803",' '"nonce":' 3375787448 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6804",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6805",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6808",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6809",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6806",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6807",' '"nonce":' 3375787448 '}' ']' '},' '"public_addr":' '"127.0.0.1:6803/3375787448",' '"cluster_addr":' '"127.0.0.1:6805/3375787448",' '"heartbeat_back_addr":' '"127.0.0.1:6809/3375787448",' '"heartbeat_front_addr":' '"127.0.0.1:6807/3375787448",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 1, '"uuid":' '"74b26727-75c9-444d-8782-719e4197a382",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 10, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6810",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6811",' '"nonce":' 3733255132 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6812",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6813",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6816",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6817",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6814",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6815",' '"nonce":' 3733255132 '}' ']' '},' '"public_addr":' '"127.0.0.1:6811/3733255132",' '"cluster_addr":' '"127.0.0.1:6813/3733255132",' '"heartbeat_back_addr":' '"127.0.0.1:6817/3733255132",' '"heartbeat_front_addr":' '"127.0.0.1:6815/3733255132",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 2, '"uuid":' '"143da3a7-dad9-4b1e-966b-76cf5bdd3c82",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 15, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6818",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6819",' '"nonce":' 963814857 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6820",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6821",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6824",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6825",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6822",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6823",' '"nonce":' 963814857 '}' ']' '},' '"public_addr":' '"127.0.0.1:6819/963814857",' '"cluster_addr":' '"127.0.0.1:6821/963814857",' '"heartbeat_back_addr":' '"127.0.0.1:6825/963814857",' '"heartbeat_front_addr":' '"127.0.0.1:6823/963814857",' '"state":' '[' '"exists",' '"up"' ']' '}' '],' '"osd_xinfo":' '[' '{' '"osd":' 0, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:22.481942+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 1, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:59.663703+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 2, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:24:37.320822+0000",' '"dead_epoch":' 0 '}' '],' '"pg_upmap":' '[],' '"pg_upmap_items":' '[],' '"pg_upmap_primaries":' '[],' '"pg_temp":' '[],' '"primary_temp":' '[],' '"blocklist":' '{},' '"range_blocklist":' '{},' '"erasure_code_profiles":' '{' '"default":' '{' '"k":' '"2",' '"m":' '"2",' '"plugin":' '"jerasure",' '"technique":' '"reed_sol_van"' '}' '},' '"removed_snaps_queue":' '[],' '"new_removed_snaps":' '[],' '"new_purged_snaps":' '[],' '"crush_node_flags":' '{},' '"device_class_flags":' '{},' '"stretch_mode":' '{' '"stretch_mode_enabled":' false, '"stretch_bucket_count":' 0, '"degraded_stretch_mode":' 0, '"recovering_stretch_mode":' 0, '"stretch_mode_bucket":' 0 '}' '},' '"osd_metadata":' '[' '{' '"id":' 0, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/0/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:22:53.662571Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]",' '"hb_front_addr":' '"[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/0",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 1, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/1/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:23:30.129885Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]",' '"hb_front_addr":' '"[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/1",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 2, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/2/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:24:07.764502Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]",' '"hb_front_addr":' '"[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/2",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '}' '],' '"osdmap_clean_epochs":' '{' '"min_last_epoch_clean":' 0, '"last_epoch_clean":' '{' '"per_pool":' '[' '{' '"poolid":' 1, '"floor":' 23 '},' '{' '"poolid":' 2, '"floor":' 23 '}' ']' '},' '"osd_epochs":' '[' '{' '"id":' 0, '"epoch":' 16 '},' '{' '"id":' 1, '"epoch":' 16 '},' '{' '"id":' 2, '"epoch":' 23 '}' ']' '},' '"osdmap_first_committed":' 1, '"osdmap_last_committed":' 28, '"crushmap":' '{' '"devices":' '[' '{' '"id":' 0, '"name":' '"osd.0",' '"class":' '"hdd"' '},' '{' '"id":' 1, '"name":' '"osd.1",' '"class":' '"hdd"' '},' '{' '"id":' 2, '"name":' '"osd.2",' '"class":' '"hdd"' '}' '],' '"types":' '[' '{' '"type_id":' 0, '"name":' '"osd"' '},' '{' '"type_id":' 1, '"name":' '"host"' '},' '{' '"type_id":' 2, '"name":' '"chassis"' '},' '{' '"type_id":' 3, '"name":' '"rack"' '},' '{' '"type_id":' 4, '"name":' '"row"' '},' '{' '"type_id":' 5, '"name":' '"pdu"' '},' '{' '"type_id":' 6, '"name":' '"pod"' '},' '{' '"type_id":' 7, '"name":' '"room"' '},' '{' '"type_id":' 8, '"name":' '"datacenter"' '},' '{' '"type_id":' 9, '"name":' '"zone"' '},' '{' '"type_id":' 10, '"name":' '"region"' '},' '{' '"type_id":' 11, '"name":' '"root"' '}' '],' '"buckets":' '[' '{' '"id":' -1, '"name":' '"default",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -3, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -2, '"name":' '"default~hdd",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -4, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -3, '"name":' '"smithi096",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '},' '{' '"id":' -4, '"name":' '"smithi096~hdd",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '}' '],' '"rules":' '[' '{' '"rule_id":' 0, '"rule_name":' '"replicated_rule",' '"type":' 1, '"steps":' '[' '{' '"op":' '"take",' '"item":' -1, '"item_name":' '"default"' '},' '{' '"op":' '"choose_firstn",' '"num":' 0, '"type":' '"osd"' '},' '{' '"op":' '"emit"' '}' ']' '}' '],' '"tunables":' '{' '"choose_local_tries":' 0, '"choose_local_fallback_tries":' 0, '"choose_total_tries":' 50, '"chooseleaf_descend_once":' 1, '"chooseleaf_vary_r":' 1, '"chooseleaf_stable":' 1, '"msr_descents":' 100, '"msr_collision_tries":' 100, '"straw_calc_version":' 1, '"allowed_bucket_algs":' 54, '"profile":' '"jewel",' '"optimal_tunables":' 1, '"legacy_tunables":' 0, '"minimum_required_version":' '"jewel",' '"require_feature_tunables":' 1, '"require_feature_tunables2":' 1, '"has_v2_rules":' 0, '"require_feature_tunables3":' 1, '"has_v3_rules":' 0, '"has_v4_buckets":' 1, '"require_feature_tunables5":' 1, '"has_v5_rules":' 0, '"has_msr_rules":' 0 '},' '"choose_args":' '{}' '},' '"fsmap":' '{' '"epoch":' 1, '"btime":' '"2024-09-16T03:22:46:882186+0000",' '"default_fscid":' -1, '"compat":' '{' '"compat":' '{},' '"ro_compat":' '{},' '"incompat":' '{' '"feature_1":' '"base' 'v0.20",' '"feature_2":' '"client' writeable 'ranges",' '"feature_3":' '"default' file layouts on 'dirs",' '"feature_4":' '"dir' inode in separate 'object",' '"feature_5":' '"mds' uses versioned 'encoding",' '"feature_6":' '"dirfrag' is stored in 'omap",' '"feature_8":' '"no' anchor 'table",' '"feature_9":' '"file' layout 'v2",' '"feature_10":' '"snaprealm' 'v2",' '"feature_11":' '"minor' log 'segments",' '"feature_12":' '"quiesce' 'subvolumes"' '}' '},' '"feature_flags":' '{' '"enable_multiple":' true, '"ever_enabled_multiple":' true '},' '"standbys":' '[],' '"filesystems":' '[]' '},' '"mdsmap_first_committed":' 1, '"mdsmap_last_committed":' 1, '"auth":' '{' '"first_committed":' 1, '"last_committed":' 5, '"num_secrets":' 3 '},' '"num_pg":' 64, '"num_pg_active":' 35, '"num_pg_unknown":' 11, '"num_osd":' 3, '"pool_sum":' '{' '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 159, '"acting":' 159, '"num_store_stats":' 0 '},' '"osd_sum":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 24, '"num_osds":' 3, '"num_per_pool_osds":' 3, '"num_per_pool_omap_osds":' 3, '"kb":' 314572800, '"kb_used":' 81048, '"kb_used_data":' 528, '"kb_used_omap":' 4, '"kb_used_meta":' 80443, '"kb_avail":' 314491752, '"statfs":' '{' '"total":' 322122547200, '"available":' 322039554048, '"internally_reserved":' 0, '"allocated":' 540672, '"data_stored":' 144817, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 4785, '"internal_metadata":' 82373967 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 686, '"apply_latency_ms":' 686, '"commit_latency_ns":' 686000000, '"apply_latency_ns":' 686000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '},' '"osd_sum_by_class":' '{' '"hdd":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 24, '"num_osds":' 3, '"num_per_pool_osds":' 3, '"num_per_pool_omap_osds":' 3, '"kb":' 314572800, '"kb_used":' 81048, '"kb_used_data":' 528, '"kb_used_omap":' 4, '"kb_used_meta":' 80443, '"kb_avail":' 314491752, '"statfs":' '{' '"total":' 322122547200, '"available":' 322039554048, '"internally_reserved":' 0, '"allocated":' 540672, '"data_stored":' 144817, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 4785, '"internal_metadata":' 82373967 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 686, '"apply_latency_ms":' 686, '"commit_latency_ns":' 686000000, '"apply_latency_ns":' 686000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '}' '},' '"pool_stats":' '[' '{' '"poolid":' 2, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 63, '"acting":' 63, '"num_store_stats":' 2 '},' '{' '"poolid":' 1, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 96, '"acting":' 96, '"num_store_stats":' 3 '}' '],' '"osd_stats":' '[' '{' '"osd":' 0, '"seq":' 21474836504 '},' '{' '"osd":' 1, '"seq":' 42949672975 '},' '{' '"osd":' 2, '"seq":' 64424509448 '}' '],' '"num_pg_by_state":' '[' '{' '"state":' '"active+clean",' '"num":' 35 '},' '{' '"state":' '"creating+activating",' '"num":' 18 '},' '{' '"state":' '"unknown",' '"num":' 11 '}' '],' '"num_pg_by_osd":' '[' '{' '"osd":' 2, '"num_primary_pg":' 15, '"num_acting_pg":' 53, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 0, '"num_primary_pg":' 20, '"num_acting_pg":' 53, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 1, '"num_primary_pg":' 18, '"num_acting_pg":' 53, '"num_up_not_acting_pg":' 0 '}' '],' '"purged_snaps":' '[' '{' '"pool":' 1, '"purged_snaps":' '{}' '}' '],' '"servicemap":' '{' '"epoch":' 3, '"modified":' '"2024-09-16T03:24:24.403052+0000",' '"services":' '{' '"osd":' '{' '"daemons":' '{' '"summary":' '"",' '"1":' '{' '"start_epoch":' 0, '"start_stamp":' '"0.000000",' '"gid":' 0, '"addr":' '"(unrecognized' address family '0)/0",' '"metadata":' '{},' '"task_status":' '{}' '}' '}' '}' '}' '},' '"mgrstat_first_committed":' 44, '"mgrstat_last_committed":' 51, '"logm_first_committed":' 1, '"logm_last_committed":' 226, '"paxos":' '{' '"first_committed":' 1, '"last_committed":' 312, '"last_pn":' 0, '"accepted_pn":' 0 '}' '}' 2024-09-16T03:24:52.287 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:134: get_fc_lc_diff: osdm_lc=28 2024-09-16T03:24:52.288 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:136: get_fc_lc_diff: echo 27 2024-09-16T03:24:52.288 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:205: TEST_mon_last_clean_epoch: pre_map_diff=27 2024-09-16T03:24:52.288 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:206: TEST_mon_last_clean_epoch: wait_for_total_num_maps 2 2024-09-16T03:24:52.288 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:157: wait_for_total_num_maps: get_timeout_delays 300 .1 2024-09-16T03:24:52.288 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: shopt -q -o xtrace 2024-09-16T03:24:52.288 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: echo true 2024-09-16T03:24:52.288 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: local trace=true 2024-09-16T03:24:52.288 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: true 2024-09-16T03:24:52.288 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: shopt -u -o xtrace 2024-09-16T03:24:52.457 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:157: wait_for_total_num_maps: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '4.5') 2024-09-16T03:24:52.457 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:157: wait_for_total_num_maps: local -a delays 2024-09-16T03:24:52.457 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:158: wait_for_total_num_maps: local -i loop=0 2024-09-16T03:24:52.457 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:159: wait_for_total_num_maps: local -i v_diff=2 2024-09-16T03:24:52.458 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:161: wait_for_total_num_maps: get_fc_lc_diff 2024-09-16T03:24:52.458 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:130: get_fc_lc_diff: ceph report 2024-09-16T03:24:53.012 INFO:tasks.workunit.client.0.smithi096.stderr:report 2534095223 2024-09-16T03:24:53.027 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:130: get_fc_lc_diff: report='{ 2024-09-16T03:24:53.027 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_fingerprint": "fda2fc64-07ed-4add-8224-2e527e11d427", 2024-09-16T03:24:53.027 INFO:tasks.workunit.client.0.smithi096.stderr: "version": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:24:53.027 INFO:tasks.workunit.client.0.smithi096.stderr: "commit": "fc3e0bff7468fd55478adbae7f75508b749124b6", 2024-09-16T03:24:53.027 INFO:tasks.workunit.client.0.smithi096.stderr: "timestamp": "2024-09-16T03:24:53.011837+0000", 2024-09-16T03:24:53.027 INFO:tasks.workunit.client.0.smithi096.stderr: "tag": "", 2024-09-16T03:24:53.027 INFO:tasks.workunit.client.0.smithi096.stderr: "health": { 2024-09-16T03:24:53.027 INFO:tasks.workunit.client.0.smithi096.stderr: "status": "HEALTH_OK", 2024-09-16T03:24:53.027 INFO:tasks.workunit.client.0.smithi096.stderr: "checks": {}, 2024-09-16T03:24:53.027 INFO:tasks.workunit.client.0.smithi096.stderr: "mutes": [] 2024-09-16T03:24:53.027 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.027 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap_first_committed": 1, 2024-09-16T03:24:53.028 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap_last_committed": 1, 2024-09-16T03:24:53.028 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap": { 2024-09-16T03:24:53.028 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 1, 2024-09-16T03:24:53.028 INFO:tasks.workunit.client.0.smithi096.stderr: "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", 2024-09-16T03:24:53.028 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:22:45.872880Z", 2024-09-16T03:24:53.028 INFO:tasks.workunit.client.0.smithi096.stderr: "created": "2024-09-16T03:22:45.872880Z", 2024-09-16T03:24:53.028 INFO:tasks.workunit.client.0.smithi096.stderr: "min_mon_release": 19, 2024-09-16T03:24:53.028 INFO:tasks.workunit.client.0.smithi096.stderr: "min_mon_release_name": "squid", 2024-09-16T03:24:53.028 INFO:tasks.workunit.client.0.smithi096.stderr: "election_strategy": 1, 2024-09-16T03:24:53.028 INFO:tasks.workunit.client.0.smithi096.stderr: "disallowed_leaders: ": "", 2024-09-16T03:24:53.028 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode": false, 2024-09-16T03:24:53.028 INFO:tasks.workunit.client.0.smithi096.stderr: "tiebreaker_mon": "", 2024-09-16T03:24:53.028 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_ranks: ": "", 2024-09-16T03:24:53.029 INFO:tasks.workunit.client.0.smithi096.stderr: "features": { 2024-09-16T03:24:53.029 INFO:tasks.workunit.client.0.smithi096.stderr: "persistent": [ 2024-09-16T03:24:53.029 INFO:tasks.workunit.client.0.smithi096.stderr: "kraken", 2024-09-16T03:24:53.029 INFO:tasks.workunit.client.0.smithi096.stderr: "luminous", 2024-09-16T03:24:53.029 INFO:tasks.workunit.client.0.smithi096.stderr: "mimic", 2024-09-16T03:24:53.029 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap-prune", 2024-09-16T03:24:53.029 INFO:tasks.workunit.client.0.smithi096.stderr: "nautilus", 2024-09-16T03:24:53.029 INFO:tasks.workunit.client.0.smithi096.stderr: "octopus", 2024-09-16T03:24:53.029 INFO:tasks.workunit.client.0.smithi096.stderr: "pacific", 2024-09-16T03:24:53.029 INFO:tasks.workunit.client.0.smithi096.stderr: "elector-pinging", 2024-09-16T03:24:53.029 INFO:tasks.workunit.client.0.smithi096.stderr: "quincy", 2024-09-16T03:24:53.029 INFO:tasks.workunit.client.0.smithi096.stderr: "reef", 2024-09-16T03:24:53.029 INFO:tasks.workunit.client.0.smithi096.stderr: "squid" 2024-09-16T03:24:53.029 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:53.030 INFO:tasks.workunit.client.0.smithi096.stderr: "optional": [] 2024-09-16T03:24:53.030 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.030 INFO:tasks.workunit.client.0.smithi096.stderr: "mons": [ 2024-09-16T03:24:53.030 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.030 INFO:tasks.workunit.client.0.smithi096.stderr: "rank": 0, 2024-09-16T03:24:53.030 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "a", 2024-09-16T03:24:53.030 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:24:53.030 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:53.030 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.030 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:53.030 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:7302", 2024-09-16T03:24:53.030 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 0 2024-09-16T03:24:53.030 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.030 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:53.031 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.031 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:7302/0", 2024-09-16T03:24:53.031 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:7302/0", 2024-09-16T03:24:53.031 INFO:tasks.workunit.client.0.smithi096.stderr: "priority": 0, 2024-09-16T03:24:53.031 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 0, 2024-09-16T03:24:53.031 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_location": "{}" 2024-09-16T03:24:53.031 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.031 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:53.031 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.031 INFO:tasks.workunit.client.0.smithi096.stderr: "quorum": [ 2024-09-16T03:24:53.031 INFO:tasks.workunit.client.0.smithi096.stderr: 0 2024-09-16T03:24:53.032 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:53.032 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap": { 2024-09-16T03:24:53.032 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 28, 2024-09-16T03:24:53.032 INFO:tasks.workunit.client.0.smithi096.stderr: "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", 2024-09-16T03:24:53.032 INFO:tasks.workunit.client.0.smithi096.stderr: "created": "2024-09-16T03:22:46.906117+0000", 2024-09-16T03:24:53.032 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:24:50.642444+0000", 2024-09-16T03:24:53.032 INFO:tasks.workunit.client.0.smithi096.stderr: "last_up_change": "2024-09-16T03:24:37.708512+0000", 2024-09-16T03:24:53.032 INFO:tasks.workunit.client.0.smithi096.stderr: "last_in_change": "2024-09-16T03:24:01.831039+0000", 2024-09-16T03:24:53.032 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-16T03:24:53.032 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_num": 5799936, 2024-09-16T03:24:53.032 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_set": [ 2024-09-16T03:24:53.033 INFO:tasks.workunit.client.0.smithi096.stderr: "pglog_hardlimit", 2024-09-16T03:24:53.033 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snapdirs", 2024-09-16T03:24:53.033 INFO:tasks.workunit.client.0.smithi096.stderr: "recovery_deletes", 2024-09-16T03:24:53.033 INFO:tasks.workunit.client.0.smithi096.stderr: "sortbitwise" 2024-09-16T03:24:53.033 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:53.033 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_version": 7, 2024-09-16T03:24:53.033 INFO:tasks.workunit.client.0.smithi096.stderr: "full_ratio": 0.97000002861022949, 2024-09-16T03:24:53.033 INFO:tasks.workunit.client.0.smithi096.stderr: "backfillfull_ratio": 0.97000002861022949, 2024-09-16T03:24:53.033 INFO:tasks.workunit.client.0.smithi096.stderr: "nearfull_ratio": 0.85000002384185791, 2024-09-16T03:24:53.033 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_snapshot": "", 2024-09-16T03:24:53.033 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_max": 2, 2024-09-16T03:24:53.033 INFO:tasks.workunit.client.0.smithi096.stderr: "max_osd": 3, 2024-09-16T03:24:53.033 INFO:tasks.workunit.client.0.smithi096.stderr: "require_min_compat_client": "luminous", 2024-09-16T03:24:53.033 INFO:tasks.workunit.client.0.smithi096.stderr: "min_compat_client": "jewel", 2024-09-16T03:24:53.034 INFO:tasks.workunit.client.0.smithi096.stderr: "require_osd_release": "squid", 2024-09-16T03:24:53.034 INFO:tasks.workunit.client.0.smithi096.stderr: "allow_crimson": false, 2024-09-16T03:24:53.034 INFO:tasks.workunit.client.0.smithi096.stderr: "pools": [ 2024-09-16T03:24:53.034 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.034 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 1, 2024-09-16T03:24:53.034 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_name": "foo", 2024-09-16T03:24:53.034 INFO:tasks.workunit.client.0.smithi096.stderr: "create_time": "2024-09-16T03:24:44.525189+0000", 2024-09-16T03:24:53.034 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": 1, 2024-09-16T03:24:53.034 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_names": "hashpspool", 2024-09-16T03:24:53.034 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:24:53.034 INFO:tasks.workunit.client.0.smithi096.stderr: "size": 3, 2024-09-16T03:24:53.034 INFO:tasks.workunit.client.0.smithi096.stderr: "min_size": 2, 2024-09-16T03:24:53.034 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_rule": 0, 2024-09-16T03:24:53.034 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_count": 0, 2024-09-16T03:24:53.034 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_target": 0, 2024-09-16T03:24:53.035 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_barrier": 0, 2024-09-16T03:24:53.035 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-16T03:24:53.035 INFO:tasks.workunit.client.0.smithi096.stderr: "is_stretch_pool": false, 2024-09-16T03:24:53.035 INFO:tasks.workunit.client.0.smithi096.stderr: "object_hash": 2, 2024-09-16T03:24:53.035 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_autoscale_mode": "off", 2024-09-16T03:24:53.035 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num": 32, 2024-09-16T03:24:53.035 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num": 32, 2024-09-16T03:24:53.035 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num_target": 32, 2024-09-16T03:24:53.035 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_target": 32, 2024-09-16T03:24:53.035 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_pending": 32, 2024-09-16T03:24:53.035 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pg_merge_meta": { 2024-09-16T03:24:53.035 INFO:tasks.workunit.client.0.smithi096.stderr: "source_pgid": "0.0", 2024-09-16T03:24:53.035 INFO:tasks.workunit.client.0.smithi096.stderr: "ready_epoch": 0, 2024-09-16T03:24:53.035 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_started": 0, 2024-09-16T03:24:53.036 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": 0, 2024-09-16T03:24:53.036 INFO:tasks.workunit.client.0.smithi096.stderr: "source_version": "0'\''0", 2024-09-16T03:24:53.036 INFO:tasks.workunit.client.0.smithi096.stderr: "target_version": "0'\''0" 2024-09-16T03:24:53.036 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.036 INFO:tasks.workunit.client.0.smithi096.stderr: "last_change": "21", 2024-09-16T03:24:53.036 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend": "0", 2024-09-16T03:24:53.036 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_prenautilus": "0", 2024-09-16T03:24:53.036 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_preluminous": "0", 2024-09-16T03:24:53.036 INFO:tasks.workunit.client.0.smithi096.stderr: "auid": 0, 2024-09-16T03:24:53.036 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_mode": "selfmanaged", 2024-09-16T03:24:53.036 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_seq": 0, 2024-09-16T03:24:53.036 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_epoch": 0, 2024-09-16T03:24:53.036 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_snaps": [], 2024-09-16T03:24:53.037 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps": "[]", 2024-09-16T03:24:53.037 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_bytes": 0, 2024-09-16T03:24:53.037 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_objects": 0, 2024-09-16T03:24:53.037 INFO:tasks.workunit.client.0.smithi096.stderr: "tiers": [], 2024-09-16T03:24:53.037 INFO:tasks.workunit.client.0.smithi096.stderr: "tier_of": -1, 2024-09-16T03:24:53.037 INFO:tasks.workunit.client.0.smithi096.stderr: "read_tier": -1, 2024-09-16T03:24:53.037 INFO:tasks.workunit.client.0.smithi096.stderr: "write_tier": -1, 2024-09-16T03:24:53.037 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_mode": "none", 2024-09-16T03:24:53.037 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_bytes": 0, 2024-09-16T03:24:53.037 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_objects": 0, 2024-09-16T03:24:53.037 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_ratio_micro": 400000, 2024-09-16T03:24:53.037 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-16T03:24:53.037 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_full_ratio_micro": 800000, 2024-09-16T03:24:53.038 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_flush_age": 0, 2024-09-16T03:24:53.038 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_evict_age": 0, 2024-09-16T03:24:53.038 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profile": "", 2024-09-16T03:24:53.038 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_params": { 2024-09-16T03:24:53.038 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "none" 2024-09-16T03:24:53.038 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.038 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_period": 0, 2024-09-16T03:24:53.038 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_count": 0, 2024-09-16T03:24:53.038 INFO:tasks.workunit.client.0.smithi096.stderr: "use_gmt_hitset": true, 2024-09-16T03:24:53.038 INFO:tasks.workunit.client.0.smithi096.stderr: "min_read_recency_for_promote": 0, 2024-09-16T03:24:53.038 INFO:tasks.workunit.client.0.smithi096.stderr: "min_write_recency_for_promote": 0, 2024-09-16T03:24:53.038 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_grade_decay_rate": 0, 2024-09-16T03:24:53.038 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_search_last_n": 0, 2024-09-16T03:24:53.038 INFO:tasks.workunit.client.0.smithi096.stderr: "grade_table": [], 2024-09-16T03:24:53.039 INFO:tasks.workunit.client.0.smithi096.stderr: "stripe_width": 0, 2024-09-16T03:24:53.039 INFO:tasks.workunit.client.0.smithi096.stderr: "expected_num_objects": 0, 2024-09-16T03:24:53.039 INFO:tasks.workunit.client.0.smithi096.stderr: "fast_read": false, 2024-09-16T03:24:53.039 INFO:tasks.workunit.client.0.smithi096.stderr: "options": {}, 2024-09-16T03:24:53.039 INFO:tasks.workunit.client.0.smithi096.stderr: "application_metadata": {}, 2024-09-16T03:24:53.039 INFO:tasks.workunit.client.0.smithi096.stderr: "read_balance": { 2024-09-16T03:24:53.039 INFO:tasks.workunit.client.0.smithi096.stderr: "score_type": "Fair distribution", 2024-09-16T03:24:53.039 INFO:tasks.workunit.client.0.smithi096.stderr: "score_acting": 1.690000057220459, 2024-09-16T03:24:53.039 INFO:tasks.workunit.client.0.smithi096.stderr: "score_stable": 1.690000057220459, 2024-09-16T03:24:53.039 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_score": 1, 2024-09-16T03:24:53.039 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_acting": 1.690000057220459, 2024-09-16T03:24:53.039 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_stable": 1.690000057220459, 2024-09-16T03:24:53.039 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity_weighted": 1, 2024-09-16T03:24:53.039 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity": 1, 2024-09-16T03:24:53.040 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity_weighted": 1 2024-09-16T03:24:53.040 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.040 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.040 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.040 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 2, 2024-09-16T03:24:53.040 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_name": "bar", 2024-09-16T03:24:53.040 INFO:tasks.workunit.client.0.smithi096.stderr: "create_time": "2024-09-16T03:24:46.226575+0000", 2024-09-16T03:24:53.040 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": 1, 2024-09-16T03:24:53.040 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_names": "hashpspool", 2024-09-16T03:24:53.040 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:24:53.040 INFO:tasks.workunit.client.0.smithi096.stderr: "size": 3, 2024-09-16T03:24:53.040 INFO:tasks.workunit.client.0.smithi096.stderr: "min_size": 2, 2024-09-16T03:24:53.040 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_rule": 0, 2024-09-16T03:24:53.041 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_count": 0, 2024-09-16T03:24:53.041 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_target": 0, 2024-09-16T03:24:53.041 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_barrier": 0, 2024-09-16T03:24:53.041 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-16T03:24:53.041 INFO:tasks.workunit.client.0.smithi096.stderr: "is_stretch_pool": false, 2024-09-16T03:24:53.041 INFO:tasks.workunit.client.0.smithi096.stderr: "object_hash": 2, 2024-09-16T03:24:53.041 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_autoscale_mode": "off", 2024-09-16T03:24:53.041 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num": 32, 2024-09-16T03:24:53.041 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num": 32, 2024-09-16T03:24:53.041 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num_target": 32, 2024-09-16T03:24:53.041 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_target": 32, 2024-09-16T03:24:53.041 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_pending": 32, 2024-09-16T03:24:53.041 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pg_merge_meta": { 2024-09-16T03:24:53.041 INFO:tasks.workunit.client.0.smithi096.stderr: "source_pgid": "0.0", 2024-09-16T03:24:53.042 INFO:tasks.workunit.client.0.smithi096.stderr: "ready_epoch": 0, 2024-09-16T03:24:53.042 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_started": 0, 2024-09-16T03:24:53.042 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": 0, 2024-09-16T03:24:53.042 INFO:tasks.workunit.client.0.smithi096.stderr: "source_version": "0'\''0", 2024-09-16T03:24:53.042 INFO:tasks.workunit.client.0.smithi096.stderr: "target_version": "0'\''0" 2024-09-16T03:24:53.042 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.042 INFO:tasks.workunit.client.0.smithi096.stderr: "last_change": "24", 2024-09-16T03:24:53.042 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend": "0", 2024-09-16T03:24:53.042 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_prenautilus": "0", 2024-09-16T03:24:53.042 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_preluminous": "0", 2024-09-16T03:24:53.042 INFO:tasks.workunit.client.0.smithi096.stderr: "auid": 0, 2024-09-16T03:24:53.042 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_mode": "selfmanaged", 2024-09-16T03:24:53.042 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_seq": 0, 2024-09-16T03:24:53.042 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_epoch": 0, 2024-09-16T03:24:53.043 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_snaps": [], 2024-09-16T03:24:53.043 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps": "[]", 2024-09-16T03:24:53.043 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_bytes": 0, 2024-09-16T03:24:53.043 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_objects": 0, 2024-09-16T03:24:53.043 INFO:tasks.workunit.client.0.smithi096.stderr: "tiers": [], 2024-09-16T03:24:53.043 INFO:tasks.workunit.client.0.smithi096.stderr: "tier_of": -1, 2024-09-16T03:24:53.043 INFO:tasks.workunit.client.0.smithi096.stderr: "read_tier": -1, 2024-09-16T03:24:53.043 INFO:tasks.workunit.client.0.smithi096.stderr: "write_tier": -1, 2024-09-16T03:24:53.043 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_mode": "none", 2024-09-16T03:24:53.043 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_bytes": 0, 2024-09-16T03:24:53.043 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_objects": 0, 2024-09-16T03:24:53.043 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_ratio_micro": 400000, 2024-09-16T03:24:53.043 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-16T03:24:53.044 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_full_ratio_micro": 800000, 2024-09-16T03:24:53.044 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_flush_age": 0, 2024-09-16T03:24:53.044 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_evict_age": 0, 2024-09-16T03:24:53.044 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profile": "", 2024-09-16T03:24:53.044 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_params": { 2024-09-16T03:24:53.044 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "none" 2024-09-16T03:24:53.044 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.044 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_period": 0, 2024-09-16T03:24:53.044 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_count": 0, 2024-09-16T03:24:53.044 INFO:tasks.workunit.client.0.smithi096.stderr: "use_gmt_hitset": true, 2024-09-16T03:24:53.044 INFO:tasks.workunit.client.0.smithi096.stderr: "min_read_recency_for_promote": 0, 2024-09-16T03:24:53.044 INFO:tasks.workunit.client.0.smithi096.stderr: "min_write_recency_for_promote": 0, 2024-09-16T03:24:53.044 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_grade_decay_rate": 0, 2024-09-16T03:24:53.044 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_search_last_n": 0, 2024-09-16T03:24:53.045 INFO:tasks.workunit.client.0.smithi096.stderr: "grade_table": [], 2024-09-16T03:24:53.045 INFO:tasks.workunit.client.0.smithi096.stderr: "stripe_width": 0, 2024-09-16T03:24:53.045 INFO:tasks.workunit.client.0.smithi096.stderr: "expected_num_objects": 0, 2024-09-16T03:24:53.045 INFO:tasks.workunit.client.0.smithi096.stderr: "fast_read": false, 2024-09-16T03:24:53.045 INFO:tasks.workunit.client.0.smithi096.stderr: "options": {}, 2024-09-16T03:24:53.045 INFO:tasks.workunit.client.0.smithi096.stderr: "application_metadata": {}, 2024-09-16T03:24:53.045 INFO:tasks.workunit.client.0.smithi096.stderr: "read_balance": { 2024-09-16T03:24:53.045 INFO:tasks.workunit.client.0.smithi096.stderr: "score_type": "Fair distribution", 2024-09-16T03:24:53.045 INFO:tasks.workunit.client.0.smithi096.stderr: "score_acting": 1.1299999952316284, 2024-09-16T03:24:53.045 INFO:tasks.workunit.client.0.smithi096.stderr: "score_stable": 1.1299999952316284, 2024-09-16T03:24:53.045 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_score": 1, 2024-09-16T03:24:53.045 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_acting": 1.1299999952316284, 2024-09-16T03:24:53.045 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_stable": 1.1299999952316284, 2024-09-16T03:24:53.046 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity_weighted": 1, 2024-09-16T03:24:53.046 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity": 1, 2024-09-16T03:24:53.046 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity_weighted": 1 2024-09-16T03:24:53.046 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.046 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.046 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:53.046 INFO:tasks.workunit.client.0.smithi096.stderr: "osds": [ 2024-09-16T03:24:53.046 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.046 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:24:53.046 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6", 2024-09-16T03:24:53.046 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:24:53.046 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:24:53.046 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:24:53.047 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:24:53.047 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:24:53.047 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:24:53.047 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 5, 2024-09-16T03:24:53.047 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 21, 2024-09-16T03:24:53.047 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:24:53.047 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:24:53.047 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:24:53.047 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:53.047 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.047 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:53.047 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6802", 2024-09-16T03:24:53.047 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:24:53.047 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.047 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.048 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:53.048 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6803", 2024-09-16T03:24:53.048 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:24:53.048 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.048 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:53.048 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.048 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:24:53.048 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:53.048 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.048 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:53.048 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6804", 2024-09-16T03:24:53.048 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:24:53.048 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.049 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.049 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:53.049 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6805", 2024-09-16T03:24:53.049 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:24:53.049 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.049 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:53.049 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.049 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:24:53.049 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:53.049 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.049 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:53.049 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6808", 2024-09-16T03:24:53.049 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:24:53.050 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.050 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.050 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:53.050 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6809", 2024-09-16T03:24:53.050 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:24:53.050 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.050 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:53.050 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.050 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:24:53.050 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:53.050 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.050 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:53.050 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6806", 2024-09-16T03:24:53.050 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:24:53.051 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.051 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.051 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:53.051 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6807", 2024-09-16T03:24:53.051 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:24:53.051 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.051 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:53.051 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.051 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6803/3375787448", 2024-09-16T03:24:53.051 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6805/3375787448", 2024-09-16T03:24:53.051 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6809/3375787448", 2024-09-16T03:24:53.051 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6807/3375787448", 2024-09-16T03:24:53.051 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:24:53.052 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:24:53.052 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:24:53.052 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:53.052 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.052 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.052 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:24:53.052 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "74b26727-75c9-444d-8782-719e4197a382", 2024-09-16T03:24:53.052 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:24:53.052 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:24:53.052 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:24:53.052 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:24:53.052 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:24:53.052 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:24:53.053 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 10, 2024-09-16T03:24:53.053 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 21, 2024-09-16T03:24:53.053 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:24:53.053 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:24:53.053 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:24:53.053 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:53.053 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.053 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:53.053 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6810", 2024-09-16T03:24:53.053 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:24:53.053 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.053 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.053 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:53.053 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6811", 2024-09-16T03:24:53.054 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:24:53.054 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.054 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:53.054 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.054 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:24:53.054 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:53.054 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.054 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:53.054 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6812", 2024-09-16T03:24:53.054 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:24:53.054 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.054 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.054 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:53.054 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6813", 2024-09-16T03:24:53.055 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:24:53.055 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.055 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:53.055 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.055 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:24:53.055 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:53.055 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.055 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:53.055 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6816", 2024-09-16T03:24:53.055 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:24:53.055 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.055 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.055 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:53.056 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6817", 2024-09-16T03:24:53.056 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:24:53.056 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.056 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:53.056 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.056 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:24:53.056 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:53.056 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.056 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:53.056 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6814", 2024-09-16T03:24:53.056 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:24:53.056 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.056 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.057 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:53.057 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6815", 2024-09-16T03:24:53.057 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:24:53.057 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.057 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:53.057 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.057 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6811/3733255132", 2024-09-16T03:24:53.057 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6813/3733255132", 2024-09-16T03:24:53.057 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6817/3733255132", 2024-09-16T03:24:53.057 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6815/3733255132", 2024-09-16T03:24:53.057 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:24:53.057 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:24:53.057 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:24:53.058 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:53.058 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.058 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.058 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:24:53.058 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "143da3a7-dad9-4b1e-966b-76cf5bdd3c82", 2024-09-16T03:24:53.058 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:24:53.058 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:24:53.058 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:24:53.058 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:24:53.058 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:24:53.058 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:24:53.058 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 15, 2024-09-16T03:24:53.058 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 21, 2024-09-16T03:24:53.058 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:24:53.059 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:24:53.059 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:24:53.059 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:53.059 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.059 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:53.059 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6818", 2024-09-16T03:24:53.059 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:24:53.059 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.059 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.059 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:53.059 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6819", 2024-09-16T03:24:53.059 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:24:53.059 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.059 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:53.060 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.060 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:24:53.060 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:53.060 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.060 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:53.060 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6820", 2024-09-16T03:24:53.060 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:24:53.060 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.060 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.060 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:53.060 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6821", 2024-09-16T03:24:53.060 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:24:53.061 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.061 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:53.061 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.061 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:24:53.061 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:53.061 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.061 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:53.061 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6824", 2024-09-16T03:24:53.061 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:24:53.061 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.061 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.061 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:53.061 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6825", 2024-09-16T03:24:53.062 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:24:53.062 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.062 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:53.062 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.062 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:24:53.062 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:53.062 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.062 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:53.062 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6822", 2024-09-16T03:24:53.062 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:24:53.062 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.062 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.062 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:53.062 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6823", 2024-09-16T03:24:53.063 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:24:53.063 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.063 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:53.063 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.063 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6819/963814857", 2024-09-16T03:24:53.063 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6821/963814857", 2024-09-16T03:24:53.063 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6825/963814857", 2024-09-16T03:24:53.063 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6823/963814857", 2024-09-16T03:24:53.063 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:24:53.063 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:24:53.063 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:24:53.063 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:53.063 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.063 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:53.064 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_xinfo": [ 2024-09-16T03:24:53.064 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.064 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:24:53.064 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:24:53.064 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:24:53.064 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:24:53.064 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:24:53.064 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:24:53.064 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:23:22.481942+0000", 2024-09-16T03:24:53.064 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:24:53.064 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.064 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.065 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:24:53.065 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:24:53.065 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:24:53.065 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:24:53.065 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:24:53.065 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:24:53.065 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:23:59.663703+0000", 2024-09-16T03:24:53.065 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:24:53.065 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.065 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.065 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:24:53.065 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:24:53.065 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:24:53.066 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:24:53.066 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:24:53.066 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:24:53.066 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:24:37.320822+0000", 2024-09-16T03:24:53.066 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:24:53.066 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.066 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:53.066 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap": [], 2024-09-16T03:24:53.066 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap_items": [], 2024-09-16T03:24:53.066 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap_primaries": [], 2024-09-16T03:24:53.066 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_temp": [], 2024-09-16T03:24:53.066 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_temp": [], 2024-09-16T03:24:53.066 INFO:tasks.workunit.client.0.smithi096.stderr: "blocklist": {}, 2024-09-16T03:24:53.066 INFO:tasks.workunit.client.0.smithi096.stderr: "range_blocklist": {}, 2024-09-16T03:24:53.067 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profiles": { 2024-09-16T03:24:53.067 INFO:tasks.workunit.client.0.smithi096.stderr: "default": { 2024-09-16T03:24:53.067 INFO:tasks.workunit.client.0.smithi096.stderr: "k": "2", 2024-09-16T03:24:53.067 INFO:tasks.workunit.client.0.smithi096.stderr: "m": "2", 2024-09-16T03:24:53.067 INFO:tasks.workunit.client.0.smithi096.stderr: "plugin": "jerasure", 2024-09-16T03:24:53.067 INFO:tasks.workunit.client.0.smithi096.stderr: "technique": "reed_sol_van" 2024-09-16T03:24:53.067 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.067 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.067 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps_queue": [], 2024-09-16T03:24:53.067 INFO:tasks.workunit.client.0.smithi096.stderr: "new_removed_snaps": [], 2024-09-16T03:24:53.067 INFO:tasks.workunit.client.0.smithi096.stderr: "new_purged_snaps": [], 2024-09-16T03:24:53.067 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_node_flags": {}, 2024-09-16T03:24:53.067 INFO:tasks.workunit.client.0.smithi096.stderr: "device_class_flags": {}, 2024-09-16T03:24:53.068 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode": { 2024-09-16T03:24:53.068 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode_enabled": false, 2024-09-16T03:24:53.068 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_bucket_count": 0, 2024-09-16T03:24:53.068 INFO:tasks.workunit.client.0.smithi096.stderr: "degraded_stretch_mode": 0, 2024-09-16T03:24:53.068 INFO:tasks.workunit.client.0.smithi096.stderr: "recovering_stretch_mode": 0, 2024-09-16T03:24:53.068 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode_bucket": 0 2024-09-16T03:24:53.068 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.068 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.068 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_metadata": [ 2024-09-16T03:24:53.069 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.069 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:24:53.069 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:24:53.069 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]", 2024-09-16T03:24:53.069 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:24:53.069 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:24:53.069 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:24:53.069 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:24:53.069 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:24:53.069 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:24:53.070 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:24:53.070 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:24:53.070 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:24:53.070 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:24:53.070 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:24:53.070 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/0/block", 2024-09-16T03:24:53.070 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:24:53.070 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:24:53.070 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:24:53.070 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:24:53.070 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:24:53.070 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:24:53.070 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:24:53.071 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:24:53.071 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:24:53.071 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:24:53.071 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:22:53.662571Z", 2024-09-16T03:24:53.071 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:24:53.071 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:24:53.071 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:24:53.071 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:24:53.071 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:24:53.071 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:24:53.071 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:24:53.071 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]", 2024-09-16T03:24:53.071 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:24:53.072 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]", 2024-09-16T03:24:53.072 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]", 2024-09-16T03:24:53.072 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:24:53.072 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:24:53.072 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:24:53.072 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:24:53.072 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:24:53.072 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:24:53.072 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:24:53.072 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:24:53.072 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:24:53.072 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/0", 2024-09-16T03:24:53.072 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:24:53.072 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:24:53.073 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:24:53.073 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.073 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.073 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:24:53.073 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:24:53.073 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]", 2024-09-16T03:24:53.073 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:24:53.073 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:24:53.073 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:24:53.073 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:24:53.073 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:24:53.073 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:24:53.073 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:24:53.073 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:24:53.074 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:24:53.074 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:24:53.074 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:24:53.074 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/1/block", 2024-09-16T03:24:53.074 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:24:53.074 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:24:53.074 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:24:53.074 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:24:53.074 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:24:53.074 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:24:53.074 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:24:53.074 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:24:53.074 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:24:53.074 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:24:53.075 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:23:30.129885Z", 2024-09-16T03:24:53.075 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:24:53.075 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:24:53.075 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:24:53.075 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:24:53.075 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:24:53.075 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:24:53.075 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:24:53.075 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]", 2024-09-16T03:24:53.075 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:24:53.075 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]", 2024-09-16T03:24:53.075 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]", 2024-09-16T03:24:53.075 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:24:53.076 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:24:53.076 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:24:53.076 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:24:53.076 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:24:53.076 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:24:53.076 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:24:53.076 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:24:53.076 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:24:53.076 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/1", 2024-09-16T03:24:53.076 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:24:53.076 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:24:53.076 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:24:53.076 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.076 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.077 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:24:53.077 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:24:53.077 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]", 2024-09-16T03:24:53.077 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:24:53.077 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:24:53.077 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:24:53.077 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:24:53.077 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:24:53.077 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:24:53.077 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:24:53.077 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:24:53.077 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:24:53.077 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:24:53.078 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:24:53.078 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/2/block", 2024-09-16T03:24:53.078 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:24:53.078 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:24:53.078 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:24:53.078 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:24:53.078 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:24:53.078 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:24:53.078 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:24:53.078 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:24:53.078 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:24:53.078 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:24:53.078 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:24:07.764502Z", 2024-09-16T03:24:53.079 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:24:53.079 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:24:53.079 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:24:53.079 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:24:53.079 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:24:53.079 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:24:53.079 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:24:53.079 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]", 2024-09-16T03:24:53.079 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:24:53.079 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]", 2024-09-16T03:24:53.079 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]", 2024-09-16T03:24:53.079 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:24:53.079 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:24:53.079 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:24:53.080 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:24:53.080 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:24:53.080 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:24:53.080 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:24:53.080 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:24:53.080 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:24:53.080 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/2", 2024-09-16T03:24:53.080 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:24:53.080 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:24:53.080 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:24:53.080 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.080 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:53.080 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_clean_epochs": { 2024-09-16T03:24:53.081 INFO:tasks.workunit.client.0.smithi096.stderr: "min_last_epoch_clean": 0, 2024-09-16T03:24:53.081 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": { 2024-09-16T03:24:53.081 INFO:tasks.workunit.client.0.smithi096.stderr: "per_pool": [ 2024-09-16T03:24:53.081 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.081 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 1, 2024-09-16T03:24:53.081 INFO:tasks.workunit.client.0.smithi096.stderr: "floor": 23 2024-09-16T03:24:53.081 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.081 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.081 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 2, 2024-09-16T03:24:53.081 INFO:tasks.workunit.client.0.smithi096.stderr: "floor": 23 2024-09-16T03:24:53.081 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.081 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:53.081 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.082 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_epochs": [ 2024-09-16T03:24:53.082 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.082 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:24:53.082 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 16 2024-09-16T03:24:53.082 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.082 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.082 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:24:53.082 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 16 2024-09-16T03:24:53.082 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.082 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.082 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:24:53.082 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 23 2024-09-16T03:24:53.082 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.083 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:53.083 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.083 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_first_committed": 1, 2024-09-16T03:24:53.083 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_last_committed": 28, 2024-09-16T03:24:53.083 INFO:tasks.workunit.client.0.smithi096.stderr: "crushmap": { 2024-09-16T03:24:53.083 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": [ 2024-09-16T03:24:53.083 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.083 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:24:53.083 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.0", 2024-09-16T03:24:53.083 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:24:53.083 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.083 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.083 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:24:53.083 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.1", 2024-09-16T03:24:53.084 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:24:53.084 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.084 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.084 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:24:53.084 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.2", 2024-09-16T03:24:53.084 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:24:53.084 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.084 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:53.084 INFO:tasks.workunit.client.0.smithi096.stderr: "types": [ 2024-09-16T03:24:53.084 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.084 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 0, 2024-09-16T03:24:53.084 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd" 2024-09-16T03:24:53.084 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.085 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.085 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:24:53.085 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "host" 2024-09-16T03:24:53.085 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.085 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.085 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 2, 2024-09-16T03:24:53.085 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "chassis" 2024-09-16T03:24:53.085 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.085 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.085 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 3, 2024-09-16T03:24:53.085 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "rack" 2024-09-16T03:24:53.085 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.085 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.085 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 4, 2024-09-16T03:24:53.086 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "row" 2024-09-16T03:24:53.086 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.086 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.086 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 5, 2024-09-16T03:24:53.086 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "pdu" 2024-09-16T03:24:53.086 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.086 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.086 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 6, 2024-09-16T03:24:53.086 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "pod" 2024-09-16T03:24:53.086 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.086 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.086 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 7, 2024-09-16T03:24:53.087 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "room" 2024-09-16T03:24:53.087 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.087 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.087 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 8, 2024-09-16T03:24:53.087 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "datacenter" 2024-09-16T03:24:53.087 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.087 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.087 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 9, 2024-09-16T03:24:53.087 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "zone" 2024-09-16T03:24:53.087 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.087 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.087 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 10, 2024-09-16T03:24:53.087 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "region" 2024-09-16T03:24:53.087 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.088 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.088 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:24:53.088 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "root" 2024-09-16T03:24:53.088 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.088 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:53.088 INFO:tasks.workunit.client.0.smithi096.stderr: "buckets": [ 2024-09-16T03:24:53.088 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.088 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -1, 2024-09-16T03:24:53.088 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "default", 2024-09-16T03:24:53.088 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:24:53.088 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "root", 2024-09-16T03:24:53.088 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:24:53.088 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:24:53.088 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:24:53.089 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:24:53.089 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.089 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -3, 2024-09-16T03:24:53.089 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:24:53.089 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:24:53.089 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.089 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:53.089 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.089 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.089 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -2, 2024-09-16T03:24:53.089 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "default~hdd", 2024-09-16T03:24:53.089 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:24:53.089 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "root", 2024-09-16T03:24:53.089 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:24:53.090 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:24:53.090 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:24:53.090 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:24:53.090 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.090 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -4, 2024-09-16T03:24:53.090 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:24:53.090 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:24:53.090 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.090 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:53.090 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.090 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.090 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -3, 2024-09-16T03:24:53.091 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "smithi096", 2024-09-16T03:24:53.091 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:24:53.091 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "host", 2024-09-16T03:24:53.091 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:24:53.091 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:24:53.091 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:24:53.091 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:24:53.091 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.091 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:24:53.091 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:24:53.091 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:24:53.091 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.091 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.091 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:24:53.092 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:24:53.092 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 1 2024-09-16T03:24:53.092 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.092 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.092 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:24:53.092 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:24:53.092 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 2 2024-09-16T03:24:53.092 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.092 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:53.092 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.092 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.092 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -4, 2024-09-16T03:24:53.092 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "smithi096~hdd", 2024-09-16T03:24:53.093 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:24:53.093 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "host", 2024-09-16T03:24:53.093 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:24:53.093 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:24:53.093 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:24:53.093 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:24:53.093 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.093 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:24:53.093 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:24:53.093 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:24:53.093 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.093 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.093 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:24:53.093 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:24:53.094 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 1 2024-09-16T03:24:53.094 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.094 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.094 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:24:53.094 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:24:53.094 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 2 2024-09-16T03:24:53.094 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.094 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:53.094 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.094 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:53.094 INFO:tasks.workunit.client.0.smithi096.stderr: "rules": [ 2024-09-16T03:24:53.094 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.094 INFO:tasks.workunit.client.0.smithi096.stderr: "rule_id": 0, 2024-09-16T03:24:53.095 INFO:tasks.workunit.client.0.smithi096.stderr: "rule_name": "replicated_rule", 2024-09-16T03:24:53.095 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:24:53.095 INFO:tasks.workunit.client.0.smithi096.stderr: "steps": [ 2024-09-16T03:24:53.095 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.095 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "take", 2024-09-16T03:24:53.095 INFO:tasks.workunit.client.0.smithi096.stderr: "item": -1, 2024-09-16T03:24:53.095 INFO:tasks.workunit.client.0.smithi096.stderr: "item_name": "default" 2024-09-16T03:24:53.095 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.095 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.095 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "choose_firstn", 2024-09-16T03:24:53.095 INFO:tasks.workunit.client.0.smithi096.stderr: "num": 0, 2024-09-16T03:24:53.095 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "osd" 2024-09-16T03:24:53.095 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.095 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.096 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "emit" 2024-09-16T03:24:53.096 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.096 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:53.096 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.096 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:53.096 INFO:tasks.workunit.client.0.smithi096.stderr: "tunables": { 2024-09-16T03:24:53.096 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_local_tries": 0, 2024-09-16T03:24:53.096 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_local_fallback_tries": 0, 2024-09-16T03:24:53.096 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_total_tries": 50, 2024-09-16T03:24:53.096 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_descend_once": 1, 2024-09-16T03:24:53.096 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_vary_r": 1, 2024-09-16T03:24:53.096 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_stable": 1, 2024-09-16T03:24:53.096 INFO:tasks.workunit.client.0.smithi096.stderr: "msr_descents": 100, 2024-09-16T03:24:53.097 INFO:tasks.workunit.client.0.smithi096.stderr: "msr_collision_tries": 100, 2024-09-16T03:24:53.097 INFO:tasks.workunit.client.0.smithi096.stderr: "straw_calc_version": 1, 2024-09-16T03:24:53.097 INFO:tasks.workunit.client.0.smithi096.stderr: "allowed_bucket_algs": 54, 2024-09-16T03:24:53.097 INFO:tasks.workunit.client.0.smithi096.stderr: "profile": "jewel", 2024-09-16T03:24:53.097 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_tunables": 1, 2024-09-16T03:24:53.097 INFO:tasks.workunit.client.0.smithi096.stderr: "legacy_tunables": 0, 2024-09-16T03:24:53.097 INFO:tasks.workunit.client.0.smithi096.stderr: "minimum_required_version": "jewel", 2024-09-16T03:24:53.097 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables": 1, 2024-09-16T03:24:53.097 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables2": 1, 2024-09-16T03:24:53.097 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v2_rules": 0, 2024-09-16T03:24:53.097 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables3": 1, 2024-09-16T03:24:53.097 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v3_rules": 0, 2024-09-16T03:24:53.097 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v4_buckets": 1, 2024-09-16T03:24:53.098 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables5": 1, 2024-09-16T03:24:53.098 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v5_rules": 0, 2024-09-16T03:24:53.098 INFO:tasks.workunit.client.0.smithi096.stderr: "has_msr_rules": 0 2024-09-16T03:24:53.098 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.098 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_args": {} 2024-09-16T03:24:53.098 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.098 INFO:tasks.workunit.client.0.smithi096.stderr: "fsmap": { 2024-09-16T03:24:53.098 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 1, 2024-09-16T03:24:53.098 INFO:tasks.workunit.client.0.smithi096.stderr: "btime": "2024-09-16T03:22:46:882186+0000", 2024-09-16T03:24:53.098 INFO:tasks.workunit.client.0.smithi096.stderr: "default_fscid": -1, 2024-09-16T03:24:53.098 INFO:tasks.workunit.client.0.smithi096.stderr: "compat": { 2024-09-16T03:24:53.098 INFO:tasks.workunit.client.0.smithi096.stderr: "compat": {}, 2024-09-16T03:24:53.098 INFO:tasks.workunit.client.0.smithi096.stderr: "ro_compat": {}, 2024-09-16T03:24:53.099 INFO:tasks.workunit.client.0.smithi096.stderr: "incompat": { 2024-09-16T03:24:53.099 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_1": "base v0.20", 2024-09-16T03:24:53.099 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_2": "client writeable ranges", 2024-09-16T03:24:53.099 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_3": "default file layouts on dirs", 2024-09-16T03:24:53.099 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_4": "dir inode in separate object", 2024-09-16T03:24:53.099 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_5": "mds uses versioned encoding", 2024-09-16T03:24:53.099 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_6": "dirfrag is stored in omap", 2024-09-16T03:24:53.099 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_8": "no anchor table", 2024-09-16T03:24:53.099 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_9": "file layout v2", 2024-09-16T03:24:53.099 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_10": "snaprealm v2", 2024-09-16T03:24:53.099 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_11": "minor log segments", 2024-09-16T03:24:53.099 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_12": "quiesce subvolumes" 2024-09-16T03:24:53.099 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.100 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.100 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_flags": { 2024-09-16T03:24:53.100 INFO:tasks.workunit.client.0.smithi096.stderr: "enable_multiple": true, 2024-09-16T03:24:53.100 INFO:tasks.workunit.client.0.smithi096.stderr: "ever_enabled_multiple": true 2024-09-16T03:24:53.100 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.100 INFO:tasks.workunit.client.0.smithi096.stderr: "standbys": [], 2024-09-16T03:24:53.100 INFO:tasks.workunit.client.0.smithi096.stderr: "filesystems": [] 2024-09-16T03:24:53.100 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.100 INFO:tasks.workunit.client.0.smithi096.stderr: "mdsmap_first_committed": 1, 2024-09-16T03:24:53.100 INFO:tasks.workunit.client.0.smithi096.stderr: "mdsmap_last_committed": 1, 2024-09-16T03:24:53.100 INFO:tasks.workunit.client.0.smithi096.stderr: "auth": { 2024-09-16T03:24:53.100 INFO:tasks.workunit.client.0.smithi096.stderr: "first_committed": 1, 2024-09-16T03:24:53.100 INFO:tasks.workunit.client.0.smithi096.stderr: "last_committed": 5, 2024-09-16T03:24:53.101 INFO:tasks.workunit.client.0.smithi096.stderr: "num_secrets": 3 2024-09-16T03:24:53.101 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.101 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 64, 2024-09-16T03:24:53.101 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_active": 64, 2024-09-16T03:24:53.101 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_unknown": 0, 2024-09-16T03:24:53.101 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osd": 3, 2024-09-16T03:24:53.101 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_sum": { 2024-09-16T03:24:53.101 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:24:53.101 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:24:53.101 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:24:53.101 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:24:53.101 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:24:53.101 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:24:53.101 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:24:53.102 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:24:53.102 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:24:53.102 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:24:53.102 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:24:53.102 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:24:53.102 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:24:53.102 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:24:53.102 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:24:53.102 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:24:53.102 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:24:53.102 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:24:53.102 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:24:53.102 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:24:53.103 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:24:53.103 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:24:53.103 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:24:53.103 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:24:53.103 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:24:53.103 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:24:53.103 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:24:53.103 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:24:53.103 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:24:53.103 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:24:53.103 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:24:53.103 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:24:53.103 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:24:53.103 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:24:53.104 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:24:53.104 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:24:53.104 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:24:53.104 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:24:53.104 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:24:53.104 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:24:53.104 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:24:53.104 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.104 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:24:53.104 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:24:53.104 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:24:53.104 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:24:53.104 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:24:53.105 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:24:53.105 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:24:53.105 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:24:53.105 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:24:53.105 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:24:53.105 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:24:53.105 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.105 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:24:53.105 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:24:53.105 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 192, 2024-09-16T03:24:53.105 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 192, 2024-09-16T03:24:53.105 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 0 2024-09-16T03:24:53.105 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.105 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_sum": { 2024-09-16T03:24:53.106 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 0, 2024-09-16T03:24:53.106 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 0, 2024-09-16T03:24:53.106 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pgs": 64, 2024-09-16T03:24:53.106 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osds": 3, 2024-09-16T03:24:53.106 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_osds": 3, 2024-09-16T03:24:53.106 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_omap_osds": 3, 2024-09-16T03:24:53.106 INFO:tasks.workunit.client.0.smithi096.stderr: "kb": 314572800, 2024-09-16T03:24:53.106 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used": 81116, 2024-09-16T03:24:53.106 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_data": 592, 2024-09-16T03:24:53.106 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_omap": 4, 2024-09-16T03:24:53.106 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_meta": 80443, 2024-09-16T03:24:53.106 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_avail": 314491684, 2024-09-16T03:24:53.106 INFO:tasks.workunit.client.0.smithi096.stderr: "statfs": { 2024-09-16T03:24:53.106 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 322122547200, 2024-09-16T03:24:53.107 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 322039484416, 2024-09-16T03:24:53.107 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:24:53.107 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 606208, 2024-09-16T03:24:53.107 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 169287, 2024-09-16T03:24:53.107 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:24:53.107 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:24:53.107 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:24:53.107 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 4785, 2024-09-16T03:24:53.107 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 82373967 2024-09-16T03:24:53.107 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.107 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_peers": [], 2024-09-16T03:24:53.107 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_trim_queue_len": 0, 2024-09-16T03:24:53.107 INFO:tasks.workunit.client.0.smithi096.stderr: "num_snap_trimming": 0, 2024-09-16T03:24:53.107 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shards_repaired": 0, 2024-09-16T03:24:53.108 INFO:tasks.workunit.client.0.smithi096.stderr: "op_queue_age_hist": { 2024-09-16T03:24:53.108 INFO:tasks.workunit.client.0.smithi096.stderr: "histogram": [], 2024-09-16T03:24:53.108 INFO:tasks.workunit.client.0.smithi096.stderr: "upper_bound": 1 2024-09-16T03:24:53.108 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.108 INFO:tasks.workunit.client.0.smithi096.stderr: "perf_stat": { 2024-09-16T03:24:53.108 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ms": 718, 2024-09-16T03:24:53.108 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ms": 718, 2024-09-16T03:24:53.108 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ns": 718000000, 2024-09-16T03:24:53.108 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ns": 718000000 2024-09-16T03:24:53.108 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.108 INFO:tasks.workunit.client.0.smithi096.stderr: "alerts": [], 2024-09-16T03:24:53.108 INFO:tasks.workunit.client.0.smithi096.stderr: "network_ping_times": [] 2024-09-16T03:24:53.108 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.109 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_sum_by_class": { 2024-09-16T03:24:53.109 INFO:tasks.workunit.client.0.smithi096.stderr: "hdd": { 2024-09-16T03:24:53.109 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 0, 2024-09-16T03:24:53.109 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 0, 2024-09-16T03:24:53.109 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pgs": 64, 2024-09-16T03:24:53.109 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osds": 3, 2024-09-16T03:24:53.109 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_osds": 3, 2024-09-16T03:24:53.109 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_omap_osds": 3, 2024-09-16T03:24:53.109 INFO:tasks.workunit.client.0.smithi096.stderr: "kb": 314572800, 2024-09-16T03:24:53.109 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used": 81116, 2024-09-16T03:24:53.109 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_data": 592, 2024-09-16T03:24:53.109 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_omap": 4, 2024-09-16T03:24:53.109 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_meta": 80443, 2024-09-16T03:24:53.109 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_avail": 314491684, 2024-09-16T03:24:53.110 INFO:tasks.workunit.client.0.smithi096.stderr: "statfs": { 2024-09-16T03:24:53.110 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 322122547200, 2024-09-16T03:24:53.110 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 322039484416, 2024-09-16T03:24:53.110 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:24:53.110 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 606208, 2024-09-16T03:24:53.110 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 169287, 2024-09-16T03:24:53.110 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:24:53.110 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:24:53.110 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:24:53.110 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 4785, 2024-09-16T03:24:53.110 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 82373967 2024-09-16T03:24:53.110 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.110 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_peers": [], 2024-09-16T03:24:53.110 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_trim_queue_len": 0, 2024-09-16T03:24:53.111 INFO:tasks.workunit.client.0.smithi096.stderr: "num_snap_trimming": 0, 2024-09-16T03:24:53.111 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shards_repaired": 0, 2024-09-16T03:24:53.111 INFO:tasks.workunit.client.0.smithi096.stderr: "op_queue_age_hist": { 2024-09-16T03:24:53.111 INFO:tasks.workunit.client.0.smithi096.stderr: "histogram": [], 2024-09-16T03:24:53.111 INFO:tasks.workunit.client.0.smithi096.stderr: "upper_bound": 1 2024-09-16T03:24:53.111 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.111 INFO:tasks.workunit.client.0.smithi096.stderr: "perf_stat": { 2024-09-16T03:24:53.111 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ms": 718, 2024-09-16T03:24:53.111 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ms": 718, 2024-09-16T03:24:53.111 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ns": 718000000, 2024-09-16T03:24:53.111 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ns": 718000000 2024-09-16T03:24:53.111 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.111 INFO:tasks.workunit.client.0.smithi096.stderr: "alerts": [], 2024-09-16T03:24:53.111 INFO:tasks.workunit.client.0.smithi096.stderr: "network_ping_times": [] 2024-09-16T03:24:53.112 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.112 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.112 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_stats": [ 2024-09-16T03:24:53.112 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.112 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 2, 2024-09-16T03:24:53.112 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 32, 2024-09-16T03:24:53.112 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:24:53.112 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:24:53.112 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:24:53.112 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:24:53.112 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:24:53.112 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:24:53.112 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:24:53.112 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:24:53.113 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:24:53.113 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:24:53.113 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:24:53.113 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:24:53.113 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:24:53.113 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:24:53.113 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:24:53.113 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:24:53.113 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:24:53.113 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:24:53.113 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:24:53.113 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:24:53.113 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:24:53.114 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:24:53.114 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:24:53.114 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:24:53.114 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:24:53.114 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:24:53.114 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:24:53.114 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:24:53.114 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:24:53.114 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:24:53.114 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:24:53.114 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:24:53.114 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:24:53.114 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:24:53.114 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:24:53.115 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:24:53.115 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:24:53.115 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:24:53.115 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:24:53.115 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:24:53.115 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:24:53.115 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.115 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:24:53.115 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:24:53.115 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:24:53.115 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:24:53.115 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:24:53.115 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:24:53.115 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:24:53.116 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:24:53.116 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:24:53.116 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:24:53.116 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:24:53.116 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.116 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:24:53.116 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:24:53.116 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 96, 2024-09-16T03:24:53.116 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 96, 2024-09-16T03:24:53.116 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 3 2024-09-16T03:24:53.116 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.116 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.116 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 1, 2024-09-16T03:24:53.116 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 32, 2024-09-16T03:24:53.117 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:24:53.117 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:24:53.117 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:24:53.117 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:24:53.117 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:24:53.117 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:24:53.117 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:24:53.117 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:24:53.117 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:24:53.117 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:24:53.117 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:24:53.117 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:24:53.117 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:24:53.118 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:24:53.118 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:24:53.118 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:24:53.118 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:24:53.118 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:24:53.118 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:24:53.118 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:24:53.118 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:24:53.118 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:24:53.118 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:24:53.118 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:24:53.118 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:24:53.118 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:24:53.118 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:24:53.118 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:24:53.119 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:24:53.119 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:24:53.119 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:24:53.119 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:24:53.119 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:24:53.119 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:24:53.119 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:24:53.119 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:24:53.119 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:24:53.119 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:24:53.119 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:24:53.119 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:24:53.119 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:24:53.120 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.120 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:24:53.120 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:24:53.120 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:24:53.120 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:24:53.120 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:24:53.120 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:24:53.120 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:24:53.120 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:24:53.120 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:24:53.120 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:24:53.120 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:24:53.120 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.120 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:24:53.121 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:24:53.121 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 96, 2024-09-16T03:24:53.121 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 96, 2024-09-16T03:24:53.121 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 3 2024-09-16T03:24:53.121 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.121 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:53.121 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_stats": [ 2024-09-16T03:24:53.121 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.121 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:24:53.121 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 21474836504 2024-09-16T03:24:53.121 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.121 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.121 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:24:53.121 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 42949672976 2024-09-16T03:24:53.122 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.122 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.122 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:24:53.122 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 64424509448 2024-09-16T03:24:53.122 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.122 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:53.122 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_by_state": [ 2024-09-16T03:24:53.122 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.122 INFO:tasks.workunit.client.0.smithi096.stderr: "state": "active+clean", 2024-09-16T03:24:53.122 INFO:tasks.workunit.client.0.smithi096.stderr: "num": 64 2024-09-16T03:24:53.122 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.122 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:53.122 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_by_osd": [ 2024-09-16T03:24:53.122 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.123 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:24:53.123 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 15, 2024-09-16T03:24:53.123 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 64, 2024-09-16T03:24:53.123 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:24:53.123 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.123 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.123 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:24:53.123 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 20, 2024-09-16T03:24:53.123 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 64, 2024-09-16T03:24:53.123 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:24:53.123 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.123 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.123 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:24:53.123 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 29, 2024-09-16T03:24:53.124 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 64, 2024-09-16T03:24:53.124 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:24:53.124 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.124 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:53.124 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": [ 2024-09-16T03:24:53.124 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.124 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 1, 2024-09-16T03:24:53.124 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": {} 2024-09-16T03:24:53.124 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.124 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.124 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 2, 2024-09-16T03:24:53.124 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": {} 2024-09-16T03:24:53.125 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.125 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:53.125 INFO:tasks.workunit.client.0.smithi096.stderr: "servicemap": { 2024-09-16T03:24:53.125 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 3, 2024-09-16T03:24:53.125 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:24:24.403052+0000", 2024-09-16T03:24:53.125 INFO:tasks.workunit.client.0.smithi096.stderr: "services": { 2024-09-16T03:24:53.125 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": { 2024-09-16T03:24:53.125 INFO:tasks.workunit.client.0.smithi096.stderr: "daemons": { 2024-09-16T03:24:53.125 INFO:tasks.workunit.client.0.smithi096.stderr: "summary": "", 2024-09-16T03:24:53.125 INFO:tasks.workunit.client.0.smithi096.stderr: "1": { 2024-09-16T03:24:53.126 INFO:tasks.workunit.client.0.smithi096.stderr: "start_epoch": 0, 2024-09-16T03:24:53.126 INFO:tasks.workunit.client.0.smithi096.stderr: "start_stamp": "0.000000", 2024-09-16T03:24:53.126 INFO:tasks.workunit.client.0.smithi096.stderr: "gid": 0, 2024-09-16T03:24:53.126 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "(unrecognized address family 0)/0", 2024-09-16T03:24:53.126 INFO:tasks.workunit.client.0.smithi096.stderr: "metadata": {}, 2024-09-16T03:24:53.126 INFO:tasks.workunit.client.0.smithi096.stderr: "task_status": {} 2024-09-16T03:24:53.126 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.126 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.126 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.126 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.126 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.126 INFO:tasks.workunit.client.0.smithi096.stderr: "mgrstat_first_committed": 47, 2024-09-16T03:24:53.126 INFO:tasks.workunit.client.0.smithi096.stderr: "mgrstat_last_committed": 52, 2024-09-16T03:24:53.126 INFO:tasks.workunit.client.0.smithi096.stderr: "logm_first_committed": 1, 2024-09-16T03:24:53.126 INFO:tasks.workunit.client.0.smithi096.stderr: "logm_last_committed": 228, 2024-09-16T03:24:53.127 INFO:tasks.workunit.client.0.smithi096.stderr: "paxos": { 2024-09-16T03:24:53.127 INFO:tasks.workunit.client.0.smithi096.stderr: "first_committed": 1, 2024-09-16T03:24:53.127 INFO:tasks.workunit.client.0.smithi096.stderr: "last_committed": 316, 2024-09-16T03:24:53.127 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pn": 0, 2024-09-16T03:24:53.127 INFO:tasks.workunit.client.0.smithi096.stderr: "accepted_pn": 0 2024-09-16T03:24:53.127 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.127 INFO:tasks.workunit.client.0.smithi096.stderr:}' 2024-09-16T03:24:53.130 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:132: get_fc_lc_diff: jq .osdmap_first_committed 2024-09-16T03:24:53.130 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:132: get_fc_lc_diff: echo '{' '"cluster_fingerprint":' '"fda2fc64-07ed-4add-8224-2e527e11d427",' '"version":' '"19.3.0-4930-gfc3e0bff",' '"commit":' '"fc3e0bff7468fd55478adbae7f75508b749124b6",' '"timestamp":' '"2024-09-16T03:24:53.011837+0000",' '"tag":' '"",' '"health":' '{' '"status":' '"HEALTH_OK",' '"checks":' '{},' '"mutes":' '[]' '},' '"monmap_first_committed":' 1, '"monmap_last_committed":' 1, '"monmap":' '{' '"epoch":' 1, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"modified":' '"2024-09-16T03:22:45.872880Z",' '"created":' '"2024-09-16T03:22:45.872880Z",' '"min_mon_release":' 19, '"min_mon_release_name":' '"squid",' '"election_strategy":' 1, '"disallowed_leaders:' '":' '"",' '"stretch_mode":' false, '"tiebreaker_mon":' '"",' '"removed_ranks:' '":' '"",' '"features":' '{' '"persistent":' '[' '"kraken",' '"luminous",' '"mimic",' '"osdmap-prune",' '"nautilus",' '"octopus",' '"pacific",' '"elector-pinging",' '"quincy",' '"reef",' '"squid"' '],' '"optional":' '[]' '},' '"mons":' '[' '{' '"rank":' 0, '"name":' '"a",' '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:7302",' '"nonce":' 0 '}' ']' '},' '"addr":' '"127.0.0.1:7302/0",' '"public_addr":' '"127.0.0.1:7302/0",' '"priority":' 0, '"weight":' 0, '"crush_location":' '"{}"' '}' ']' '},' '"quorum":' '[' 0 '],' '"osdmap":' '{' '"epoch":' 28, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"created":' '"2024-09-16T03:22:46.906117+0000",' '"modified":' '"2024-09-16T03:24:50.642444+0000",' '"last_up_change":' '"2024-09-16T03:24:37.708512+0000",' '"last_in_change":' '"2024-09-16T03:24:01.831039+0000",' '"flags":' '"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit",' '"flags_num":' 5799936, '"flags_set":' '[' '"pglog_hardlimit",' '"purged_snapdirs",' '"recovery_deletes",' '"sortbitwise"' '],' '"crush_version":' 7, '"full_ratio":' 0.97000002861022949, '"backfillfull_ratio":' 0.97000002861022949, '"nearfull_ratio":' 0.85000002384185791, '"cluster_snapshot":' '"",' '"pool_max":' 2, '"max_osd":' 3, '"require_min_compat_client":' '"luminous",' '"min_compat_client":' '"jewel",' '"require_osd_release":' '"squid",' '"allow_crimson":' false, '"pools":' '[' '{' '"pool":' 1, '"pool_name":' '"foo",' '"create_time":' '"2024-09-16T03:24:44.525189+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"21",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.690000057220459, '"score_stable":' 1.690000057220459, '"optimal_score":' 1, '"raw_score_acting":' 1.690000057220459, '"raw_score_stable":' 1.690000057220459, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '},' '{' '"pool":' 2, '"pool_name":' '"bar",' '"create_time":' '"2024-09-16T03:24:46.226575+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"24",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.1299999952316284, '"score_stable":' 1.1299999952316284, '"optimal_score":' 1, '"raw_score_acting":' 1.1299999952316284, '"raw_score_stable":' 1.1299999952316284, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '}' '],' '"osds":' '[' '{' '"osd":' 0, '"uuid":' '"64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 5, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6802",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6803",' '"nonce":' 3375787448 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6804",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6805",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6808",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6809",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6806",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6807",' '"nonce":' 3375787448 '}' ']' '},' '"public_addr":' '"127.0.0.1:6803/3375787448",' '"cluster_addr":' '"127.0.0.1:6805/3375787448",' '"heartbeat_back_addr":' '"127.0.0.1:6809/3375787448",' '"heartbeat_front_addr":' '"127.0.0.1:6807/3375787448",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 1, '"uuid":' '"74b26727-75c9-444d-8782-719e4197a382",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 10, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6810",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6811",' '"nonce":' 3733255132 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6812",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6813",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6816",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6817",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6814",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6815",' '"nonce":' 3733255132 '}' ']' '},' '"public_addr":' '"127.0.0.1:6811/3733255132",' '"cluster_addr":' '"127.0.0.1:6813/3733255132",' '"heartbeat_back_addr":' '"127.0.0.1:6817/3733255132",' '"heartbeat_front_addr":' '"127.0.0.1:6815/3733255132",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 2, '"uuid":' '"143da3a7-dad9-4b1e-966b-76cf5bdd3c82",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 15, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6818",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6819",' '"nonce":' 963814857 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6820",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6821",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6824",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6825",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6822",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6823",' '"nonce":' 963814857 '}' ']' '},' '"public_addr":' '"127.0.0.1:6819/963814857",' '"cluster_addr":' '"127.0.0.1:6821/963814857",' '"heartbeat_back_addr":' '"127.0.0.1:6825/963814857",' '"heartbeat_front_addr":' '"127.0.0.1:6823/963814857",' '"state":' '[' '"exists",' '"up"' ']' '}' '],' '"osd_xinfo":' '[' '{' '"osd":' 0, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:22.481942+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 1, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:59.663703+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 2, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:24:37.320822+0000",' '"dead_epoch":' 0 '}' '],' '"pg_upmap":' '[],' '"pg_upmap_items":' '[],' '"pg_upmap_primaries":' '[],' '"pg_temp":' '[],' '"primary_temp":' '[],' '"blocklist":' '{},' '"range_blocklist":' '{},' '"erasure_code_profiles":' '{' '"default":' '{' '"k":' '"2",' '"m":' '"2",' '"plugin":' '"jerasure",' '"technique":' '"reed_sol_van"' '}' '},' '"removed_snaps_queue":' '[],' '"new_removed_snaps":' '[],' '"new_purged_snaps":' '[],' '"crush_node_flags":' '{},' '"device_class_flags":' '{},' '"stretch_mode":' '{' '"stretch_mode_enabled":' false, '"stretch_bucket_count":' 0, '"degraded_stretch_mode":' 0, '"recovering_stretch_mode":' 0, '"stretch_mode_bucket":' 0 '}' '},' '"osd_metadata":' '[' '{' '"id":' 0, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/0/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:22:53.662571Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]",' '"hb_front_addr":' '"[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/0",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 1, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/1/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:23:30.129885Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]",' '"hb_front_addr":' '"[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/1",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 2, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/2/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:24:07.764502Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]",' '"hb_front_addr":' '"[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/2",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '}' '],' '"osdmap_clean_epochs":' '{' '"min_last_epoch_clean":' 0, '"last_epoch_clean":' '{' '"per_pool":' '[' '{' '"poolid":' 1, '"floor":' 23 '},' '{' '"poolid":' 2, '"floor":' 23 '}' ']' '},' '"osd_epochs":' '[' '{' '"id":' 0, '"epoch":' 16 '},' '{' '"id":' 1, '"epoch":' 16 '},' '{' '"id":' 2, '"epoch":' 23 '}' ']' '},' '"osdmap_first_committed":' 1, '"osdmap_last_committed":' 28, '"crushmap":' '{' '"devices":' '[' '{' '"id":' 0, '"name":' '"osd.0",' '"class":' '"hdd"' '},' '{' '"id":' 1, '"name":' '"osd.1",' '"class":' '"hdd"' '},' '{' '"id":' 2, '"name":' '"osd.2",' '"class":' '"hdd"' '}' '],' '"types":' '[' '{' '"type_id":' 0, '"name":' '"osd"' '},' '{' '"type_id":' 1, '"name":' '"host"' '},' '{' '"type_id":' 2, '"name":' '"chassis"' '},' '{' '"type_id":' 3, '"name":' '"rack"' '},' '{' '"type_id":' 4, '"name":' '"row"' '},' '{' '"type_id":' 5, '"name":' '"pdu"' '},' '{' '"type_id":' 6, '"name":' '"pod"' '},' '{' '"type_id":' 7, '"name":' '"room"' '},' '{' '"type_id":' 8, '"name":' '"datacenter"' '},' '{' '"type_id":' 9, '"name":' '"zone"' '},' '{' '"type_id":' 10, '"name":' '"region"' '},' '{' '"type_id":' 11, '"name":' '"root"' '}' '],' '"buckets":' '[' '{' '"id":' -1, '"name":' '"default",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -3, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -2, '"name":' '"default~hdd",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -4, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -3, '"name":' '"smithi096",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '},' '{' '"id":' -4, '"name":' '"smithi096~hdd",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '}' '],' '"rules":' '[' '{' '"rule_id":' 0, '"rule_name":' '"replicated_rule",' '"type":' 1, '"steps":' '[' '{' '"op":' '"take",' '"item":' -1, '"item_name":' '"default"' '},' '{' '"op":' '"choose_firstn",' '"num":' 0, '"type":' '"osd"' '},' '{' '"op":' '"emit"' '}' ']' '}' '],' '"tunables":' '{' '"choose_local_tries":' 0, '"choose_local_fallback_tries":' 0, '"choose_total_tries":' 50, '"chooseleaf_descend_once":' 1, '"chooseleaf_vary_r":' 1, '"chooseleaf_stable":' 1, '"msr_descents":' 100, '"msr_collision_tries":' 100, '"straw_calc_version":' 1, '"allowed_bucket_algs":' 54, '"profile":' '"jewel",' '"optimal_tunables":' 1, '"legacy_tunables":' 0, '"minimum_required_version":' '"jewel",' '"require_feature_tunables":' 1, '"require_feature_tunables2":' 1, '"has_v2_rules":' 0, '"require_feature_tunables3":' 1, '"has_v3_rules":' 0, '"has_v4_buckets":' 1, '"require_feature_tunables5":' 1, '"has_v5_rules":' 0, '"has_msr_rules":' 0 '},' '"choose_args":' '{}' '},' '"fsmap":' '{' '"epoch":' 1, '"btime":' '"2024-09-16T03:22:46:882186+0000",' '"default_fscid":' -1, '"compat":' '{' '"compat":' '{},' '"ro_compat":' '{},' '"incompat":' '{' '"feature_1":' '"base' 'v0.20",' '"feature_2":' '"client' writeable 'ranges",' '"feature_3":' '"default' file layouts on 'dirs",' '"feature_4":' '"dir' inode in separate 'object",' '"feature_5":' '"mds' uses versioned 'encoding",' '"feature_6":' '"dirfrag' is stored in 'omap",' '"feature_8":' '"no' anchor 'table",' '"feature_9":' '"file' layout 'v2",' '"feature_10":' '"snaprealm' 'v2",' '"feature_11":' '"minor' log 'segments",' '"feature_12":' '"quiesce' 'subvolumes"' '}' '},' '"feature_flags":' '{' '"enable_multiple":' true, '"ever_enabled_multiple":' true '},' '"standbys":' '[],' '"filesystems":' '[]' '},' '"mdsmap_first_committed":' 1, '"mdsmap_last_committed":' 1, '"auth":' '{' '"first_committed":' 1, '"last_committed":' 5, '"num_secrets":' 3 '},' '"num_pg":' 64, '"num_pg_active":' 64, '"num_pg_unknown":' 0, '"num_osd":' 3, '"pool_sum":' '{' '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 192, '"acting":' 192, '"num_store_stats":' 0 '},' '"osd_sum":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 64, '"num_osds":' 3, '"num_per_pool_osds":' 3, '"num_per_pool_omap_osds":' 3, '"kb":' 314572800, '"kb_used":' 81116, '"kb_used_data":' 592, '"kb_used_omap":' 4, '"kb_used_meta":' 80443, '"kb_avail":' 314491684, '"statfs":' '{' '"total":' 322122547200, '"available":' 322039484416, '"internally_reserved":' 0, '"allocated":' 606208, '"data_stored":' 169287, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 4785, '"internal_metadata":' 82373967 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 718, '"apply_latency_ms":' 718, '"commit_latency_ns":' 718000000, '"apply_latency_ns":' 718000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '},' '"osd_sum_by_class":' '{' '"hdd":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 64, '"num_osds":' 3, '"num_per_pool_osds":' 3, '"num_per_pool_omap_osds":' 3, '"kb":' 314572800, '"kb_used":' 81116, '"kb_used_data":' 592, '"kb_used_omap":' 4, '"kb_used_meta":' 80443, '"kb_avail":' 314491684, '"statfs":' '{' '"total":' 322122547200, '"available":' 322039484416, '"internally_reserved":' 0, '"allocated":' 606208, '"data_stored":' 169287, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 4785, '"internal_metadata":' 82373967 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 718, '"apply_latency_ms":' 718, '"commit_latency_ns":' 718000000, '"apply_latency_ns":' 718000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '}' '},' '"pool_stats":' '[' '{' '"poolid":' 2, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 96, '"acting":' 96, '"num_store_stats":' 3 '},' '{' '"poolid":' 1, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 96, '"acting":' 96, '"num_store_stats":' 3 '}' '],' '"osd_stats":' '[' '{' '"osd":' 0, '"seq":' 21474836504 '},' '{' '"osd":' 1, '"seq":' 42949672976 '},' '{' '"osd":' 2, '"seq":' 64424509448 '}' '],' '"num_pg_by_state":' '[' '{' '"state":' '"active+clean",' '"num":' 64 '}' '],' '"num_pg_by_osd":' '[' '{' '"osd":' 2, '"num_primary_pg":' 15, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 0, '"num_primary_pg":' 20, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 1, '"num_primary_pg":' 29, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '}' '],' '"purged_snaps":' '[' '{' '"pool":' 1, '"purged_snaps":' '{}' '},' '{' '"pool":' 2, '"purged_snaps":' '{}' '}' '],' '"servicemap":' '{' '"epoch":' 3, '"modified":' '"2024-09-16T03:24:24.403052+0000",' '"services":' '{' '"osd":' '{' '"daemons":' '{' '"summary":' '"",' '"1":' '{' '"start_epoch":' 0, '"start_stamp":' '"0.000000",' '"gid":' 0, '"addr":' '"(unrecognized' address family '0)/0",' '"metadata":' '{},' '"task_status":' '{}' '}' '}' '}' '}' '},' '"mgrstat_first_committed":' 47, '"mgrstat_last_committed":' 52, '"logm_first_committed":' 1, '"logm_last_committed":' 228, '"paxos":' '{' '"first_committed":' 1, '"last_committed":' 316, '"last_pn":' 0, '"accepted_pn":' 0 '}' '}' 2024-09-16T03:24:53.130 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:132: get_fc_lc_diff: osdm_fc=1 2024-09-16T03:24:53.130 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:134: get_fc_lc_diff: jq .osdmap_last_committed 2024-09-16T03:24:53.130 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:134: get_fc_lc_diff: echo '{' '"cluster_fingerprint":' '"fda2fc64-07ed-4add-8224-2e527e11d427",' '"version":' '"19.3.0-4930-gfc3e0bff",' '"commit":' '"fc3e0bff7468fd55478adbae7f75508b749124b6",' '"timestamp":' '"2024-09-16T03:24:53.011837+0000",' '"tag":' '"",' '"health":' '{' '"status":' '"HEALTH_OK",' '"checks":' '{},' '"mutes":' '[]' '},' '"monmap_first_committed":' 1, '"monmap_last_committed":' 1, '"monmap":' '{' '"epoch":' 1, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"modified":' '"2024-09-16T03:22:45.872880Z",' '"created":' '"2024-09-16T03:22:45.872880Z",' '"min_mon_release":' 19, '"min_mon_release_name":' '"squid",' '"election_strategy":' 1, '"disallowed_leaders:' '":' '"",' '"stretch_mode":' false, '"tiebreaker_mon":' '"",' '"removed_ranks:' '":' '"",' '"features":' '{' '"persistent":' '[' '"kraken",' '"luminous",' '"mimic",' '"osdmap-prune",' '"nautilus",' '"octopus",' '"pacific",' '"elector-pinging",' '"quincy",' '"reef",' '"squid"' '],' '"optional":' '[]' '},' '"mons":' '[' '{' '"rank":' 0, '"name":' '"a",' '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:7302",' '"nonce":' 0 '}' ']' '},' '"addr":' '"127.0.0.1:7302/0",' '"public_addr":' '"127.0.0.1:7302/0",' '"priority":' 0, '"weight":' 0, '"crush_location":' '"{}"' '}' ']' '},' '"quorum":' '[' 0 '],' '"osdmap":' '{' '"epoch":' 28, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"created":' '"2024-09-16T03:22:46.906117+0000",' '"modified":' '"2024-09-16T03:24:50.642444+0000",' '"last_up_change":' '"2024-09-16T03:24:37.708512+0000",' '"last_in_change":' '"2024-09-16T03:24:01.831039+0000",' '"flags":' '"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit",' '"flags_num":' 5799936, '"flags_set":' '[' '"pglog_hardlimit",' '"purged_snapdirs",' '"recovery_deletes",' '"sortbitwise"' '],' '"crush_version":' 7, '"full_ratio":' 0.97000002861022949, '"backfillfull_ratio":' 0.97000002861022949, '"nearfull_ratio":' 0.85000002384185791, '"cluster_snapshot":' '"",' '"pool_max":' 2, '"max_osd":' 3, '"require_min_compat_client":' '"luminous",' '"min_compat_client":' '"jewel",' '"require_osd_release":' '"squid",' '"allow_crimson":' false, '"pools":' '[' '{' '"pool":' 1, '"pool_name":' '"foo",' '"create_time":' '"2024-09-16T03:24:44.525189+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"21",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.690000057220459, '"score_stable":' 1.690000057220459, '"optimal_score":' 1, '"raw_score_acting":' 1.690000057220459, '"raw_score_stable":' 1.690000057220459, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '},' '{' '"pool":' 2, '"pool_name":' '"bar",' '"create_time":' '"2024-09-16T03:24:46.226575+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"24",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.1299999952316284, '"score_stable":' 1.1299999952316284, '"optimal_score":' 1, '"raw_score_acting":' 1.1299999952316284, '"raw_score_stable":' 1.1299999952316284, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '}' '],' '"osds":' '[' '{' '"osd":' 0, '"uuid":' '"64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 5, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6802",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6803",' '"nonce":' 3375787448 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6804",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6805",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6808",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6809",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6806",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6807",' '"nonce":' 3375787448 '}' ']' '},' '"public_addr":' '"127.0.0.1:6803/3375787448",' '"cluster_addr":' '"127.0.0.1:6805/3375787448",' '"heartbeat_back_addr":' '"127.0.0.1:6809/3375787448",' '"heartbeat_front_addr":' '"127.0.0.1:6807/3375787448",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 1, '"uuid":' '"74b26727-75c9-444d-8782-719e4197a382",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 10, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6810",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6811",' '"nonce":' 3733255132 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6812",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6813",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6816",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6817",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6814",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6815",' '"nonce":' 3733255132 '}' ']' '},' '"public_addr":' '"127.0.0.1:6811/3733255132",' '"cluster_addr":' '"127.0.0.1:6813/3733255132",' '"heartbeat_back_addr":' '"127.0.0.1:6817/3733255132",' '"heartbeat_front_addr":' '"127.0.0.1:6815/3733255132",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 2, '"uuid":' '"143da3a7-dad9-4b1e-966b-76cf5bdd3c82",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 15, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6818",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6819",' '"nonce":' 963814857 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6820",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6821",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6824",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6825",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6822",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6823",' '"nonce":' 963814857 '}' ']' '},' '"public_addr":' '"127.0.0.1:6819/963814857",' '"cluster_addr":' '"127.0.0.1:6821/963814857",' '"heartbeat_back_addr":' '"127.0.0.1:6825/963814857",' '"heartbeat_front_addr":' '"127.0.0.1:6823/963814857",' '"state":' '[' '"exists",' '"up"' ']' '}' '],' '"osd_xinfo":' '[' '{' '"osd":' 0, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:22.481942+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 1, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:59.663703+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 2, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:24:37.320822+0000",' '"dead_epoch":' 0 '}' '],' '"pg_upmap":' '[],' '"pg_upmap_items":' '[],' '"pg_upmap_primaries":' '[],' '"pg_temp":' '[],' '"primary_temp":' '[],' '"blocklist":' '{},' '"range_blocklist":' '{},' '"erasure_code_profiles":' '{' '"default":' '{' '"k":' '"2",' '"m":' '"2",' '"plugin":' '"jerasure",' '"technique":' '"reed_sol_van"' '}' '},' '"removed_snaps_queue":' '[],' '"new_removed_snaps":' '[],' '"new_purged_snaps":' '[],' '"crush_node_flags":' '{},' '"device_class_flags":' '{},' '"stretch_mode":' '{' '"stretch_mode_enabled":' false, '"stretch_bucket_count":' 0, '"degraded_stretch_mode":' 0, '"recovering_stretch_mode":' 0, '"stretch_mode_bucket":' 0 '}' '},' '"osd_metadata":' '[' '{' '"id":' 0, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/0/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:22:53.662571Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]",' '"hb_front_addr":' '"[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/0",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 1, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/1/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:23:30.129885Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]",' '"hb_front_addr":' '"[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/1",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 2, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/2/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:24:07.764502Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]",' '"hb_front_addr":' '"[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/2",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '}' '],' '"osdmap_clean_epochs":' '{' '"min_last_epoch_clean":' 0, '"last_epoch_clean":' '{' '"per_pool":' '[' '{' '"poolid":' 1, '"floor":' 23 '},' '{' '"poolid":' 2, '"floor":' 23 '}' ']' '},' '"osd_epochs":' '[' '{' '"id":' 0, '"epoch":' 16 '},' '{' '"id":' 1, '"epoch":' 16 '},' '{' '"id":' 2, '"epoch":' 23 '}' ']' '},' '"osdmap_first_committed":' 1, '"osdmap_last_committed":' 28, '"crushmap":' '{' '"devices":' '[' '{' '"id":' 0, '"name":' '"osd.0",' '"class":' '"hdd"' '},' '{' '"id":' 1, '"name":' '"osd.1",' '"class":' '"hdd"' '},' '{' '"id":' 2, '"name":' '"osd.2",' '"class":' '"hdd"' '}' '],' '"types":' '[' '{' '"type_id":' 0, '"name":' '"osd"' '},' '{' '"type_id":' 1, '"name":' '"host"' '},' '{' '"type_id":' 2, '"name":' '"chassis"' '},' '{' '"type_id":' 3, '"name":' '"rack"' '},' '{' '"type_id":' 4, '"name":' '"row"' '},' '{' '"type_id":' 5, '"name":' '"pdu"' '},' '{' '"type_id":' 6, '"name":' '"pod"' '},' '{' '"type_id":' 7, '"name":' '"room"' '},' '{' '"type_id":' 8, '"name":' '"datacenter"' '},' '{' '"type_id":' 9, '"name":' '"zone"' '},' '{' '"type_id":' 10, '"name":' '"region"' '},' '{' '"type_id":' 11, '"name":' '"root"' '}' '],' '"buckets":' '[' '{' '"id":' -1, '"name":' '"default",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -3, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -2, '"name":' '"default~hdd",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -4, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -3, '"name":' '"smithi096",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '},' '{' '"id":' -4, '"name":' '"smithi096~hdd",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '}' '],' '"rules":' '[' '{' '"rule_id":' 0, '"rule_name":' '"replicated_rule",' '"type":' 1, '"steps":' '[' '{' '"op":' '"take",' '"item":' -1, '"item_name":' '"default"' '},' '{' '"op":' '"choose_firstn",' '"num":' 0, '"type":' '"osd"' '},' '{' '"op":' '"emit"' '}' ']' '}' '],' '"tunables":' '{' '"choose_local_tries":' 0, '"choose_local_fallback_tries":' 0, '"choose_total_tries":' 50, '"chooseleaf_descend_once":' 1, '"chooseleaf_vary_r":' 1, '"chooseleaf_stable":' 1, '"msr_descents":' 100, '"msr_collision_tries":' 100, '"straw_calc_version":' 1, '"allowed_bucket_algs":' 54, '"profile":' '"jewel",' '"optimal_tunables":' 1, '"legacy_tunables":' 0, '"minimum_required_version":' '"jewel",' '"require_feature_tunables":' 1, '"require_feature_tunables2":' 1, '"has_v2_rules":' 0, '"require_feature_tunables3":' 1, '"has_v3_rules":' 0, '"has_v4_buckets":' 1, '"require_feature_tunables5":' 1, '"has_v5_rules":' 0, '"has_msr_rules":' 0 '},' '"choose_args":' '{}' '},' '"fsmap":' '{' '"epoch":' 1, '"btime":' '"2024-09-16T03:22:46:882186+0000",' '"default_fscid":' -1, '"compat":' '{' '"compat":' '{},' '"ro_compat":' '{},' '"incompat":' '{' '"feature_1":' '"base' 'v0.20",' '"feature_2":' '"client' writeable 'ranges",' '"feature_3":' '"default' file layouts on 'dirs",' '"feature_4":' '"dir' inode in separate 'object",' '"feature_5":' '"mds' uses versioned 'encoding",' '"feature_6":' '"dirfrag' is stored in 'omap",' '"feature_8":' '"no' anchor 'table",' '"feature_9":' '"file' layout 'v2",' '"feature_10":' '"snaprealm' 'v2",' '"feature_11":' '"minor' log 'segments",' '"feature_12":' '"quiesce' 'subvolumes"' '}' '},' '"feature_flags":' '{' '"enable_multiple":' true, '"ever_enabled_multiple":' true '},' '"standbys":' '[],' '"filesystems":' '[]' '},' '"mdsmap_first_committed":' 1, '"mdsmap_last_committed":' 1, '"auth":' '{' '"first_committed":' 1, '"last_committed":' 5, '"num_secrets":' 3 '},' '"num_pg":' 64, '"num_pg_active":' 64, '"num_pg_unknown":' 0, '"num_osd":' 3, '"pool_sum":' '{' '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 192, '"acting":' 192, '"num_store_stats":' 0 '},' '"osd_sum":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 64, '"num_osds":' 3, '"num_per_pool_osds":' 3, '"num_per_pool_omap_osds":' 3, '"kb":' 314572800, '"kb_used":' 81116, '"kb_used_data":' 592, '"kb_used_omap":' 4, '"kb_used_meta":' 80443, '"kb_avail":' 314491684, '"statfs":' '{' '"total":' 322122547200, '"available":' 322039484416, '"internally_reserved":' 0, '"allocated":' 606208, '"data_stored":' 169287, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 4785, '"internal_metadata":' 82373967 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 718, '"apply_latency_ms":' 718, '"commit_latency_ns":' 718000000, '"apply_latency_ns":' 718000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '},' '"osd_sum_by_class":' '{' '"hdd":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 64, '"num_osds":' 3, '"num_per_pool_osds":' 3, '"num_per_pool_omap_osds":' 3, '"kb":' 314572800, '"kb_used":' 81116, '"kb_used_data":' 592, '"kb_used_omap":' 4, '"kb_used_meta":' 80443, '"kb_avail":' 314491684, '"statfs":' '{' '"total":' 322122547200, '"available":' 322039484416, '"internally_reserved":' 0, '"allocated":' 606208, '"data_stored":' 169287, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 4785, '"internal_metadata":' 82373967 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 718, '"apply_latency_ms":' 718, '"commit_latency_ns":' 718000000, '"apply_latency_ns":' 718000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '}' '},' '"pool_stats":' '[' '{' '"poolid":' 2, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 96, '"acting":' 96, '"num_store_stats":' 3 '},' '{' '"poolid":' 1, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 96, '"acting":' 96, '"num_store_stats":' 3 '}' '],' '"osd_stats":' '[' '{' '"osd":' 0, '"seq":' 21474836504 '},' '{' '"osd":' 1, '"seq":' 42949672976 '},' '{' '"osd":' 2, '"seq":' 64424509448 '}' '],' '"num_pg_by_state":' '[' '{' '"state":' '"active+clean",' '"num":' 64 '}' '],' '"num_pg_by_osd":' '[' '{' '"osd":' 2, '"num_primary_pg":' 15, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 0, '"num_primary_pg":' 20, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 1, '"num_primary_pg":' 29, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '}' '],' '"purged_snaps":' '[' '{' '"pool":' 1, '"purged_snaps":' '{}' '},' '{' '"pool":' 2, '"purged_snaps":' '{}' '}' '],' '"servicemap":' '{' '"epoch":' 3, '"modified":' '"2024-09-16T03:24:24.403052+0000",' '"services":' '{' '"osd":' '{' '"daemons":' '{' '"summary":' '"",' '"1":' '{' '"start_epoch":' 0, '"start_stamp":' '"0.000000",' '"gid":' 0, '"addr":' '"(unrecognized' address family '0)/0",' '"metadata":' '{},' '"task_status":' '{}' '}' '}' '}' '}' '},' '"mgrstat_first_committed":' 47, '"mgrstat_last_committed":' 52, '"logm_first_committed":' 1, '"logm_last_committed":' 228, '"paxos":' '{' '"first_committed":' 1, '"last_committed":' 316, '"last_pn":' 0, '"accepted_pn":' 0 '}' '}' 2024-09-16T03:24:53.131 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:134: get_fc_lc_diff: osdm_lc=28 2024-09-16T03:24:53.131 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:136: get_fc_lc_diff: echo 27 2024-09-16T03:24:53.131 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:161: wait_for_total_num_maps: [[ 27 -gt 2 ]] 2024-09-16T03:24:53.131 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:162: wait_for_total_num_maps: (( 0 >= 27 )) 2024-09-16T03:24:53.131 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:166: wait_for_total_num_maps: sleep 0.1 2024-09-16T03:24:53.196 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:167: wait_for_total_num_maps: loop+=1 2024-09-16T03:24:53.197 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:161: wait_for_total_num_maps: get_fc_lc_diff 2024-09-16T03:24:53.198 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:130: get_fc_lc_diff: ceph report 2024-09-16T03:24:53.752 INFO:tasks.workunit.client.0.smithi096.stderr:report 1408498601 2024-09-16T03:24:53.768 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:130: get_fc_lc_diff: report='{ 2024-09-16T03:24:53.768 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_fingerprint": "fda2fc64-07ed-4add-8224-2e527e11d427", 2024-09-16T03:24:53.768 INFO:tasks.workunit.client.0.smithi096.stderr: "version": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:24:53.768 INFO:tasks.workunit.client.0.smithi096.stderr: "commit": "fc3e0bff7468fd55478adbae7f75508b749124b6", 2024-09-16T03:24:53.768 INFO:tasks.workunit.client.0.smithi096.stderr: "timestamp": "2024-09-16T03:24:53.753721+0000", 2024-09-16T03:24:53.768 INFO:tasks.workunit.client.0.smithi096.stderr: "tag": "", 2024-09-16T03:24:53.768 INFO:tasks.workunit.client.0.smithi096.stderr: "health": { 2024-09-16T03:24:53.769 INFO:tasks.workunit.client.0.smithi096.stderr: "status": "HEALTH_OK", 2024-09-16T03:24:53.769 INFO:tasks.workunit.client.0.smithi096.stderr: "checks": {}, 2024-09-16T03:24:53.769 INFO:tasks.workunit.client.0.smithi096.stderr: "mutes": [] 2024-09-16T03:24:53.769 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.769 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap_first_committed": 1, 2024-09-16T03:24:53.769 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap_last_committed": 1, 2024-09-16T03:24:53.769 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap": { 2024-09-16T03:24:53.769 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 1, 2024-09-16T03:24:53.769 INFO:tasks.workunit.client.0.smithi096.stderr: "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", 2024-09-16T03:24:53.769 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:22:45.872880Z", 2024-09-16T03:24:53.769 INFO:tasks.workunit.client.0.smithi096.stderr: "created": "2024-09-16T03:22:45.872880Z", 2024-09-16T03:24:53.769 INFO:tasks.workunit.client.0.smithi096.stderr: "min_mon_release": 19, 2024-09-16T03:24:53.769 INFO:tasks.workunit.client.0.smithi096.stderr: "min_mon_release_name": "squid", 2024-09-16T03:24:53.769 INFO:tasks.workunit.client.0.smithi096.stderr: "election_strategy": 1, 2024-09-16T03:24:53.770 INFO:tasks.workunit.client.0.smithi096.stderr: "disallowed_leaders: ": "", 2024-09-16T03:24:53.770 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode": false, 2024-09-16T03:24:53.770 INFO:tasks.workunit.client.0.smithi096.stderr: "tiebreaker_mon": "", 2024-09-16T03:24:53.770 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_ranks: ": "", 2024-09-16T03:24:53.770 INFO:tasks.workunit.client.0.smithi096.stderr: "features": { 2024-09-16T03:24:53.770 INFO:tasks.workunit.client.0.smithi096.stderr: "persistent": [ 2024-09-16T03:24:53.770 INFO:tasks.workunit.client.0.smithi096.stderr: "kraken", 2024-09-16T03:24:53.770 INFO:tasks.workunit.client.0.smithi096.stderr: "luminous", 2024-09-16T03:24:53.770 INFO:tasks.workunit.client.0.smithi096.stderr: "mimic", 2024-09-16T03:24:53.770 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap-prune", 2024-09-16T03:24:53.770 INFO:tasks.workunit.client.0.smithi096.stderr: "nautilus", 2024-09-16T03:24:53.770 INFO:tasks.workunit.client.0.smithi096.stderr: "octopus", 2024-09-16T03:24:53.770 INFO:tasks.workunit.client.0.smithi096.stderr: "pacific", 2024-09-16T03:24:53.771 INFO:tasks.workunit.client.0.smithi096.stderr: "elector-pinging", 2024-09-16T03:24:53.771 INFO:tasks.workunit.client.0.smithi096.stderr: "quincy", 2024-09-16T03:24:53.771 INFO:tasks.workunit.client.0.smithi096.stderr: "reef", 2024-09-16T03:24:53.771 INFO:tasks.workunit.client.0.smithi096.stderr: "squid" 2024-09-16T03:24:53.771 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:53.771 INFO:tasks.workunit.client.0.smithi096.stderr: "optional": [] 2024-09-16T03:24:53.771 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.771 INFO:tasks.workunit.client.0.smithi096.stderr: "mons": [ 2024-09-16T03:24:53.771 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.771 INFO:tasks.workunit.client.0.smithi096.stderr: "rank": 0, 2024-09-16T03:24:53.771 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "a", 2024-09-16T03:24:53.771 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:24:53.771 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:53.771 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.772 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:53.772 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:7302", 2024-09-16T03:24:53.772 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 0 2024-09-16T03:24:53.772 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.772 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:53.772 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.772 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:7302/0", 2024-09-16T03:24:53.772 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:7302/0", 2024-09-16T03:24:53.772 INFO:tasks.workunit.client.0.smithi096.stderr: "priority": 0, 2024-09-16T03:24:53.772 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 0, 2024-09-16T03:24:53.772 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_location": "{}" 2024-09-16T03:24:53.772 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.773 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:53.773 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.773 INFO:tasks.workunit.client.0.smithi096.stderr: "quorum": [ 2024-09-16T03:24:53.773 INFO:tasks.workunit.client.0.smithi096.stderr: 0 2024-09-16T03:24:53.773 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:53.773 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap": { 2024-09-16T03:24:53.773 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 28, 2024-09-16T03:24:53.773 INFO:tasks.workunit.client.0.smithi096.stderr: "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", 2024-09-16T03:24:53.773 INFO:tasks.workunit.client.0.smithi096.stderr: "created": "2024-09-16T03:22:46.906117+0000", 2024-09-16T03:24:53.773 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:24:50.642444+0000", 2024-09-16T03:24:53.773 INFO:tasks.workunit.client.0.smithi096.stderr: "last_up_change": "2024-09-16T03:24:37.708512+0000", 2024-09-16T03:24:53.773 INFO:tasks.workunit.client.0.smithi096.stderr: "last_in_change": "2024-09-16T03:24:01.831039+0000", 2024-09-16T03:24:53.773 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-16T03:24:53.773 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_num": 5799936, 2024-09-16T03:24:53.774 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_set": [ 2024-09-16T03:24:53.774 INFO:tasks.workunit.client.0.smithi096.stderr: "pglog_hardlimit", 2024-09-16T03:24:53.774 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snapdirs", 2024-09-16T03:24:53.774 INFO:tasks.workunit.client.0.smithi096.stderr: "recovery_deletes", 2024-09-16T03:24:53.774 INFO:tasks.workunit.client.0.smithi096.stderr: "sortbitwise" 2024-09-16T03:24:53.774 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:53.774 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_version": 7, 2024-09-16T03:24:53.775 INFO:tasks.workunit.client.0.smithi096.stderr: "full_ratio": 0.97000002861022949, 2024-09-16T03:24:53.775 INFO:tasks.workunit.client.0.smithi096.stderr: "backfillfull_ratio": 0.97000002861022949, 2024-09-16T03:24:53.775 INFO:tasks.workunit.client.0.smithi096.stderr: "nearfull_ratio": 0.85000002384185791, 2024-09-16T03:24:53.775 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_snapshot": "", 2024-09-16T03:24:53.775 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_max": 2, 2024-09-16T03:24:53.775 INFO:tasks.workunit.client.0.smithi096.stderr: "max_osd": 3, 2024-09-16T03:24:53.776 INFO:tasks.workunit.client.0.smithi096.stderr: "require_min_compat_client": "luminous", 2024-09-16T03:24:53.776 INFO:tasks.workunit.client.0.smithi096.stderr: "min_compat_client": "jewel", 2024-09-16T03:24:53.776 INFO:tasks.workunit.client.0.smithi096.stderr: "require_osd_release": "squid", 2024-09-16T03:24:53.776 INFO:tasks.workunit.client.0.smithi096.stderr: "allow_crimson": false, 2024-09-16T03:24:53.776 INFO:tasks.workunit.client.0.smithi096.stderr: "pools": [ 2024-09-16T03:24:53.776 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.776 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 1, 2024-09-16T03:24:53.776 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_name": "foo", 2024-09-16T03:24:53.776 INFO:tasks.workunit.client.0.smithi096.stderr: "create_time": "2024-09-16T03:24:44.525189+0000", 2024-09-16T03:24:53.776 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": 1, 2024-09-16T03:24:53.776 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_names": "hashpspool", 2024-09-16T03:24:53.776 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:24:53.777 INFO:tasks.workunit.client.0.smithi096.stderr: "size": 3, 2024-09-16T03:24:53.777 INFO:tasks.workunit.client.0.smithi096.stderr: "min_size": 2, 2024-09-16T03:24:53.777 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_rule": 0, 2024-09-16T03:24:53.777 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_count": 0, 2024-09-16T03:24:53.777 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_target": 0, 2024-09-16T03:24:53.777 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_barrier": 0, 2024-09-16T03:24:53.777 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-16T03:24:53.777 INFO:tasks.workunit.client.0.smithi096.stderr: "is_stretch_pool": false, 2024-09-16T03:24:53.777 INFO:tasks.workunit.client.0.smithi096.stderr: "object_hash": 2, 2024-09-16T03:24:53.777 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_autoscale_mode": "off", 2024-09-16T03:24:53.777 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num": 32, 2024-09-16T03:24:53.778 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num": 32, 2024-09-16T03:24:53.778 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num_target": 32, 2024-09-16T03:24:53.778 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_target": 32, 2024-09-16T03:24:53.778 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_pending": 32, 2024-09-16T03:24:53.778 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pg_merge_meta": { 2024-09-16T03:24:53.778 INFO:tasks.workunit.client.0.smithi096.stderr: "source_pgid": "0.0", 2024-09-16T03:24:53.778 INFO:tasks.workunit.client.0.smithi096.stderr: "ready_epoch": 0, 2024-09-16T03:24:53.778 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_started": 0, 2024-09-16T03:24:53.778 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": 0, 2024-09-16T03:24:53.778 INFO:tasks.workunit.client.0.smithi096.stderr: "source_version": "0'\''0", 2024-09-16T03:24:53.778 INFO:tasks.workunit.client.0.smithi096.stderr: "target_version": "0'\''0" 2024-09-16T03:24:53.779 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.779 INFO:tasks.workunit.client.0.smithi096.stderr: "last_change": "21", 2024-09-16T03:24:53.779 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend": "0", 2024-09-16T03:24:53.779 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_prenautilus": "0", 2024-09-16T03:24:53.779 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_preluminous": "0", 2024-09-16T03:24:53.779 INFO:tasks.workunit.client.0.smithi096.stderr: "auid": 0, 2024-09-16T03:24:53.779 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_mode": "selfmanaged", 2024-09-16T03:24:53.779 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_seq": 0, 2024-09-16T03:24:53.779 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_epoch": 0, 2024-09-16T03:24:53.779 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_snaps": [], 2024-09-16T03:24:53.779 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps": "[]", 2024-09-16T03:24:53.779 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_bytes": 0, 2024-09-16T03:24:53.779 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_objects": 0, 2024-09-16T03:24:53.779 INFO:tasks.workunit.client.0.smithi096.stderr: "tiers": [], 2024-09-16T03:24:53.780 INFO:tasks.workunit.client.0.smithi096.stderr: "tier_of": -1, 2024-09-16T03:24:53.780 INFO:tasks.workunit.client.0.smithi096.stderr: "read_tier": -1, 2024-09-16T03:24:53.780 INFO:tasks.workunit.client.0.smithi096.stderr: "write_tier": -1, 2024-09-16T03:24:53.780 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_mode": "none", 2024-09-16T03:24:53.780 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_bytes": 0, 2024-09-16T03:24:53.780 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_objects": 0, 2024-09-16T03:24:53.780 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_ratio_micro": 400000, 2024-09-16T03:24:53.780 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-16T03:24:53.780 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_full_ratio_micro": 800000, 2024-09-16T03:24:53.780 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_flush_age": 0, 2024-09-16T03:24:53.780 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_evict_age": 0, 2024-09-16T03:24:53.780 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profile": "", 2024-09-16T03:24:53.780 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_params": { 2024-09-16T03:24:53.780 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "none" 2024-09-16T03:24:53.781 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.781 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_period": 0, 2024-09-16T03:24:53.781 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_count": 0, 2024-09-16T03:24:53.781 INFO:tasks.workunit.client.0.smithi096.stderr: "use_gmt_hitset": true, 2024-09-16T03:24:53.781 INFO:tasks.workunit.client.0.smithi096.stderr: "min_read_recency_for_promote": 0, 2024-09-16T03:24:53.781 INFO:tasks.workunit.client.0.smithi096.stderr: "min_write_recency_for_promote": 0, 2024-09-16T03:24:53.781 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_grade_decay_rate": 0, 2024-09-16T03:24:53.781 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_search_last_n": 0, 2024-09-16T03:24:53.781 INFO:tasks.workunit.client.0.smithi096.stderr: "grade_table": [], 2024-09-16T03:24:53.781 INFO:tasks.workunit.client.0.smithi096.stderr: "stripe_width": 0, 2024-09-16T03:24:53.781 INFO:tasks.workunit.client.0.smithi096.stderr: "expected_num_objects": 0, 2024-09-16T03:24:53.781 INFO:tasks.workunit.client.0.smithi096.stderr: "fast_read": false, 2024-09-16T03:24:53.781 INFO:tasks.workunit.client.0.smithi096.stderr: "options": {}, 2024-09-16T03:24:53.781 INFO:tasks.workunit.client.0.smithi096.stderr: "application_metadata": {}, 2024-09-16T03:24:53.782 INFO:tasks.workunit.client.0.smithi096.stderr: "read_balance": { 2024-09-16T03:24:53.782 INFO:tasks.workunit.client.0.smithi096.stderr: "score_type": "Fair distribution", 2024-09-16T03:24:53.782 INFO:tasks.workunit.client.0.smithi096.stderr: "score_acting": 1.690000057220459, 2024-09-16T03:24:53.782 INFO:tasks.workunit.client.0.smithi096.stderr: "score_stable": 1.690000057220459, 2024-09-16T03:24:53.782 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_score": 1, 2024-09-16T03:24:53.782 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_acting": 1.690000057220459, 2024-09-16T03:24:53.782 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_stable": 1.690000057220459, 2024-09-16T03:24:53.782 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity_weighted": 1, 2024-09-16T03:24:53.782 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity": 1, 2024-09-16T03:24:53.782 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity_weighted": 1 2024-09-16T03:24:53.782 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.782 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.782 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.782 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 2, 2024-09-16T03:24:53.783 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_name": "bar", 2024-09-16T03:24:53.783 INFO:tasks.workunit.client.0.smithi096.stderr: "create_time": "2024-09-16T03:24:46.226575+0000", 2024-09-16T03:24:53.783 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": 1, 2024-09-16T03:24:53.783 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_names": "hashpspool", 2024-09-16T03:24:53.783 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:24:53.783 INFO:tasks.workunit.client.0.smithi096.stderr: "size": 3, 2024-09-16T03:24:53.783 INFO:tasks.workunit.client.0.smithi096.stderr: "min_size": 2, 2024-09-16T03:24:53.783 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_rule": 0, 2024-09-16T03:24:53.783 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_count": 0, 2024-09-16T03:24:53.783 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_target": 0, 2024-09-16T03:24:53.783 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_barrier": 0, 2024-09-16T03:24:53.784 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-16T03:24:53.784 INFO:tasks.workunit.client.0.smithi096.stderr: "is_stretch_pool": false, 2024-09-16T03:24:53.784 INFO:tasks.workunit.client.0.smithi096.stderr: "object_hash": 2, 2024-09-16T03:24:53.784 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_autoscale_mode": "off", 2024-09-16T03:24:53.784 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num": 32, 2024-09-16T03:24:53.784 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num": 32, 2024-09-16T03:24:53.784 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num_target": 32, 2024-09-16T03:24:53.784 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_target": 32, 2024-09-16T03:24:53.784 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_pending": 32, 2024-09-16T03:24:53.784 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pg_merge_meta": { 2024-09-16T03:24:53.784 INFO:tasks.workunit.client.0.smithi096.stderr: "source_pgid": "0.0", 2024-09-16T03:24:53.784 INFO:tasks.workunit.client.0.smithi096.stderr: "ready_epoch": 0, 2024-09-16T03:24:53.784 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_started": 0, 2024-09-16T03:24:53.785 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": 0, 2024-09-16T03:24:53.785 INFO:tasks.workunit.client.0.smithi096.stderr: "source_version": "0'\''0", 2024-09-16T03:24:53.785 INFO:tasks.workunit.client.0.smithi096.stderr: "target_version": "0'\''0" 2024-09-16T03:24:53.785 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.785 INFO:tasks.workunit.client.0.smithi096.stderr: "last_change": "24", 2024-09-16T03:24:53.785 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend": "0", 2024-09-16T03:24:53.785 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_prenautilus": "0", 2024-09-16T03:24:53.785 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_preluminous": "0", 2024-09-16T03:24:53.785 INFO:tasks.workunit.client.0.smithi096.stderr: "auid": 0, 2024-09-16T03:24:53.785 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_mode": "selfmanaged", 2024-09-16T03:24:53.785 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_seq": 0, 2024-09-16T03:24:53.785 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_epoch": 0, 2024-09-16T03:24:53.785 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_snaps": [], 2024-09-16T03:24:53.785 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps": "[]", 2024-09-16T03:24:53.786 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_bytes": 0, 2024-09-16T03:24:53.786 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_objects": 0, 2024-09-16T03:24:53.786 INFO:tasks.workunit.client.0.smithi096.stderr: "tiers": [], 2024-09-16T03:24:53.786 INFO:tasks.workunit.client.0.smithi096.stderr: "tier_of": -1, 2024-09-16T03:24:53.786 INFO:tasks.workunit.client.0.smithi096.stderr: "read_tier": -1, 2024-09-16T03:24:53.786 INFO:tasks.workunit.client.0.smithi096.stderr: "write_tier": -1, 2024-09-16T03:24:53.786 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_mode": "none", 2024-09-16T03:24:53.786 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_bytes": 0, 2024-09-16T03:24:53.786 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_objects": 0, 2024-09-16T03:24:53.786 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_ratio_micro": 400000, 2024-09-16T03:24:53.786 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-16T03:24:53.786 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_full_ratio_micro": 800000, 2024-09-16T03:24:53.786 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_flush_age": 0, 2024-09-16T03:24:53.786 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_evict_age": 0, 2024-09-16T03:24:53.787 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profile": "", 2024-09-16T03:24:53.787 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_params": { 2024-09-16T03:24:53.787 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "none" 2024-09-16T03:24:53.787 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.787 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_period": 0, 2024-09-16T03:24:53.787 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_count": 0, 2024-09-16T03:24:53.787 INFO:tasks.workunit.client.0.smithi096.stderr: "use_gmt_hitset": true, 2024-09-16T03:24:53.787 INFO:tasks.workunit.client.0.smithi096.stderr: "min_read_recency_for_promote": 0, 2024-09-16T03:24:53.787 INFO:tasks.workunit.client.0.smithi096.stderr: "min_write_recency_for_promote": 0, 2024-09-16T03:24:53.787 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_grade_decay_rate": 0, 2024-09-16T03:24:53.787 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_search_last_n": 0, 2024-09-16T03:24:53.788 INFO:tasks.workunit.client.0.smithi096.stderr: "grade_table": [], 2024-09-16T03:24:53.788 INFO:tasks.workunit.client.0.smithi096.stderr: "stripe_width": 0, 2024-09-16T03:24:53.788 INFO:tasks.workunit.client.0.smithi096.stderr: "expected_num_objects": 0, 2024-09-16T03:24:53.788 INFO:tasks.workunit.client.0.smithi096.stderr: "fast_read": false, 2024-09-16T03:24:53.788 INFO:tasks.workunit.client.0.smithi096.stderr: "options": {}, 2024-09-16T03:24:53.788 INFO:tasks.workunit.client.0.smithi096.stderr: "application_metadata": {}, 2024-09-16T03:24:53.788 INFO:tasks.workunit.client.0.smithi096.stderr: "read_balance": { 2024-09-16T03:24:53.788 INFO:tasks.workunit.client.0.smithi096.stderr: "score_type": "Fair distribution", 2024-09-16T03:24:53.788 INFO:tasks.workunit.client.0.smithi096.stderr: "score_acting": 1.1299999952316284, 2024-09-16T03:24:53.788 INFO:tasks.workunit.client.0.smithi096.stderr: "score_stable": 1.1299999952316284, 2024-09-16T03:24:53.788 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_score": 1, 2024-09-16T03:24:53.788 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_acting": 1.1299999952316284, 2024-09-16T03:24:53.789 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_stable": 1.1299999952316284, 2024-09-16T03:24:53.789 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity_weighted": 1, 2024-09-16T03:24:53.789 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity": 1, 2024-09-16T03:24:53.789 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity_weighted": 1 2024-09-16T03:24:53.789 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.789 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.789 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:53.789 INFO:tasks.workunit.client.0.smithi096.stderr: "osds": [ 2024-09-16T03:24:53.789 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.789 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:24:53.789 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6", 2024-09-16T03:24:53.789 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:24:53.789 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:24:53.789 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:24:53.790 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:24:53.790 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:24:53.790 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:24:53.790 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 5, 2024-09-16T03:24:53.790 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 21, 2024-09-16T03:24:53.790 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:24:53.790 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:24:53.790 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:24:53.790 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:53.790 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.790 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:53.790 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6802", 2024-09-16T03:24:53.790 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:24:53.790 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.791 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.791 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:53.791 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6803", 2024-09-16T03:24:53.791 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:24:53.791 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.791 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:53.791 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.791 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:24:53.791 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:53.791 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.791 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:53.791 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6804", 2024-09-16T03:24:53.791 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:24:53.792 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.792 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.792 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:53.792 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6805", 2024-09-16T03:24:53.792 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:24:53.792 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.792 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:53.792 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.792 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:24:53.792 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:53.792 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.792 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:53.792 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6808", 2024-09-16T03:24:53.793 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:24:53.793 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.793 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.793 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:53.793 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6809", 2024-09-16T03:24:53.793 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:24:53.793 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.793 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:53.793 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.793 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:24:53.793 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:53.793 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.793 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:53.794 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6806", 2024-09-16T03:24:53.794 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:24:53.794 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.794 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.794 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:53.794 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6807", 2024-09-16T03:24:53.794 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:24:53.794 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.794 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:53.794 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.794 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6803/3375787448", 2024-09-16T03:24:53.794 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6805/3375787448", 2024-09-16T03:24:53.794 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6809/3375787448", 2024-09-16T03:24:53.794 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6807/3375787448", 2024-09-16T03:24:53.795 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:24:53.795 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:24:53.795 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:24:53.795 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:53.795 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.795 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.795 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:24:53.795 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "74b26727-75c9-444d-8782-719e4197a382", 2024-09-16T03:24:53.795 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:24:53.796 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:24:53.796 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:24:53.796 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:24:53.796 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:24:53.796 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:24:53.796 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 10, 2024-09-16T03:24:53.796 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 21, 2024-09-16T03:24:53.796 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:24:53.796 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:24:53.797 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:24:53.797 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:53.797 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.797 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:53.797 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6810", 2024-09-16T03:24:53.797 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:24:53.797 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.797 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.797 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:53.797 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6811", 2024-09-16T03:24:53.797 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:24:53.797 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.797 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:53.797 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.798 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:24:53.798 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:53.798 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.798 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:53.798 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6812", 2024-09-16T03:24:53.798 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:24:53.798 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.798 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.798 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:53.798 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6813", 2024-09-16T03:24:53.798 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:24:53.798 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.798 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:53.799 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.799 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:24:53.799 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:53.799 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.799 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:53.799 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6816", 2024-09-16T03:24:53.799 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:24:53.799 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.799 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.799 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:53.799 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6817", 2024-09-16T03:24:53.799 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:24:53.799 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.799 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:53.800 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.800 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:24:53.800 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:53.800 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.800 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:53.800 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6814", 2024-09-16T03:24:53.800 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:24:53.800 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.800 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.800 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:53.800 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6815", 2024-09-16T03:24:53.800 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:24:53.800 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.800 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:53.801 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.801 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6811/3733255132", 2024-09-16T03:24:53.801 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6813/3733255132", 2024-09-16T03:24:53.801 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6817/3733255132", 2024-09-16T03:24:53.801 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6815/3733255132", 2024-09-16T03:24:53.801 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:24:53.801 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:24:53.801 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:24:53.801 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:53.801 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.801 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.801 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:24:53.802 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "143da3a7-dad9-4b1e-966b-76cf5bdd3c82", 2024-09-16T03:24:53.802 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:24:53.802 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:24:53.802 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:24:53.802 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:24:53.802 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:24:53.802 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:24:53.802 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 15, 2024-09-16T03:24:53.802 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 21, 2024-09-16T03:24:53.802 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:24:53.802 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:24:53.802 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:24:53.802 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:53.802 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.802 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:53.803 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6818", 2024-09-16T03:24:53.803 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:24:53.803 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.803 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.803 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:53.803 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6819", 2024-09-16T03:24:53.803 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:24:53.803 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.803 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:53.803 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.803 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:24:53.803 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:53.803 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.803 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:53.804 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6820", 2024-09-16T03:24:53.804 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:24:53.804 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.804 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.804 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:53.804 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6821", 2024-09-16T03:24:53.804 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:24:53.804 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.804 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:53.804 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.804 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:24:53.804 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:53.804 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.804 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:53.805 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6824", 2024-09-16T03:24:53.805 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:24:53.805 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.805 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.805 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:53.805 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6825", 2024-09-16T03:24:53.805 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:24:53.805 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.805 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:53.805 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.805 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:24:53.806 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:53.806 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.806 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:53.806 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6822", 2024-09-16T03:24:53.806 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:24:53.806 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.806 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.806 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:53.806 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6823", 2024-09-16T03:24:53.807 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:24:53.807 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.807 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:53.807 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.807 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6819/963814857", 2024-09-16T03:24:53.807 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6821/963814857", 2024-09-16T03:24:53.807 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6825/963814857", 2024-09-16T03:24:53.807 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6823/963814857", 2024-09-16T03:24:53.807 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:24:53.807 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:24:53.807 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:24:53.808 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:53.808 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.808 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:53.808 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_xinfo": [ 2024-09-16T03:24:53.808 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.808 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:24:53.808 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:24:53.808 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:24:53.808 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:24:53.808 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:24:53.808 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:24:53.808 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:23:22.481942+0000", 2024-09-16T03:24:53.809 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:24:53.809 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.809 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.809 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:24:53.809 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:24:53.809 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:24:53.809 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:24:53.809 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:24:53.809 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:24:53.809 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:23:59.663703+0000", 2024-09-16T03:24:53.809 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:24:53.809 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.809 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.809 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:24:53.810 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:24:53.810 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:24:53.810 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:24:53.810 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:24:53.810 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:24:53.810 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:24:37.320822+0000", 2024-09-16T03:24:53.810 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:24:53.810 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.810 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:53.810 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap": [], 2024-09-16T03:24:53.810 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap_items": [], 2024-09-16T03:24:53.810 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap_primaries": [], 2024-09-16T03:24:53.810 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_temp": [], 2024-09-16T03:24:53.810 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_temp": [], 2024-09-16T03:24:53.811 INFO:tasks.workunit.client.0.smithi096.stderr: "blocklist": {}, 2024-09-16T03:24:53.811 INFO:tasks.workunit.client.0.smithi096.stderr: "range_blocklist": {}, 2024-09-16T03:24:53.811 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profiles": { 2024-09-16T03:24:53.811 INFO:tasks.workunit.client.0.smithi096.stderr: "default": { 2024-09-16T03:24:53.811 INFO:tasks.workunit.client.0.smithi096.stderr: "k": "2", 2024-09-16T03:24:53.811 INFO:tasks.workunit.client.0.smithi096.stderr: "m": "2", 2024-09-16T03:24:53.811 INFO:tasks.workunit.client.0.smithi096.stderr: "plugin": "jerasure", 2024-09-16T03:24:53.811 INFO:tasks.workunit.client.0.smithi096.stderr: "technique": "reed_sol_van" 2024-09-16T03:24:53.811 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.811 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.811 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps_queue": [], 2024-09-16T03:24:53.811 INFO:tasks.workunit.client.0.smithi096.stderr: "new_removed_snaps": [], 2024-09-16T03:24:53.811 INFO:tasks.workunit.client.0.smithi096.stderr: "new_purged_snaps": [], 2024-09-16T03:24:53.812 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_node_flags": {}, 2024-09-16T03:24:53.812 INFO:tasks.workunit.client.0.smithi096.stderr: "device_class_flags": {}, 2024-09-16T03:24:53.812 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode": { 2024-09-16T03:24:53.812 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode_enabled": false, 2024-09-16T03:24:53.812 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_bucket_count": 0, 2024-09-16T03:24:53.812 INFO:tasks.workunit.client.0.smithi096.stderr: "degraded_stretch_mode": 0, 2024-09-16T03:24:53.812 INFO:tasks.workunit.client.0.smithi096.stderr: "recovering_stretch_mode": 0, 2024-09-16T03:24:53.812 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode_bucket": 0 2024-09-16T03:24:53.812 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.812 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.812 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_metadata": [ 2024-09-16T03:24:53.812 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.812 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:24:53.813 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:24:53.813 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]", 2024-09-16T03:24:53.813 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:24:53.813 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:24:53.813 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:24:53.813 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:24:53.813 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:24:53.813 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:24:53.813 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:24:53.813 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:24:53.813 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:24:53.813 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:24:53.813 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:24:53.813 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/0/block", 2024-09-16T03:24:53.814 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:24:53.814 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:24:53.814 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:24:53.814 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:24:53.814 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:24:53.814 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:24:53.814 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:24:53.814 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:24:53.814 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:24:53.814 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:24:53.814 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:22:53.662571Z", 2024-09-16T03:24:53.814 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:24:53.814 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:24:53.814 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:24:53.815 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:24:53.815 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:24:53.815 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:24:53.815 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:24:53.815 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]", 2024-09-16T03:24:53.815 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:24:53.815 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]", 2024-09-16T03:24:53.815 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]", 2024-09-16T03:24:53.815 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:24:53.815 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:24:53.815 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:24:53.815 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:24:53.815 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:24:53.816 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:24:53.816 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:24:53.816 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:24:53.816 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:24:53.816 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/0", 2024-09-16T03:24:53.816 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:24:53.816 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:24:53.816 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:24:53.816 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.816 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.817 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:24:53.817 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:24:53.817 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]", 2024-09-16T03:24:53.817 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:24:53.817 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:24:53.817 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:24:53.818 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:24:53.818 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:24:53.818 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:24:53.818 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:24:53.818 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:24:53.818 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:24:53.819 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:24:53.819 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:24:53.819 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/1/block", 2024-09-16T03:24:53.819 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:24:53.819 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:24:53.819 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:24:53.819 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:24:53.820 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:24:53.820 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:24:53.820 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:24:53.820 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:24:53.820 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:24:53.820 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:24:53.820 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:23:30.129885Z", 2024-09-16T03:24:53.821 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:24:53.821 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:24:53.821 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:24:53.821 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:24:53.821 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:24:53.821 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:24:53.821 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:24:53.822 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]", 2024-09-16T03:24:53.822 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:24:53.822 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]", 2024-09-16T03:24:53.822 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]", 2024-09-16T03:24:53.822 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:24:53.822 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:24:53.822 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:24:53.823 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:24:53.823 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:24:53.823 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:24:53.823 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:24:53.823 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:24:53.823 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:24:53.823 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/1", 2024-09-16T03:24:53.824 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:24:53.824 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:24:53.824 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:24:53.824 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.824 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.824 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:24:53.825 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:24:53.825 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]", 2024-09-16T03:24:53.825 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:24:53.825 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:24:53.825 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:24:53.825 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:24:53.825 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:24:53.826 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:24:53.826 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:24:53.826 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:24:53.826 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:24:53.826 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:24:53.826 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:24:53.826 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/2/block", 2024-09-16T03:24:53.826 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:24:53.826 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:24:53.826 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:24:53.826 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:24:53.826 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:24:53.826 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:24:53.827 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:24:53.827 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:24:53.827 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:24:53.827 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:24:53.827 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:24:07.764502Z", 2024-09-16T03:24:53.827 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:24:53.827 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:24:53.827 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:24:53.827 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:24:53.828 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:24:53.828 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:24:53.828 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:24:53.828 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]", 2024-09-16T03:24:53.828 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:24:53.828 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]", 2024-09-16T03:24:53.828 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]", 2024-09-16T03:24:53.828 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:24:53.828 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:24:53.828 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:24:53.828 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:24:53.828 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:24:53.829 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:24:53.829 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:24:53.829 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:24:53.829 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:24:53.829 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/2", 2024-09-16T03:24:53.829 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:24:53.829 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:24:53.829 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:24:53.829 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.829 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:53.829 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_clean_epochs": { 2024-09-16T03:24:53.829 INFO:tasks.workunit.client.0.smithi096.stderr: "min_last_epoch_clean": 0, 2024-09-16T03:24:53.829 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": { 2024-09-16T03:24:53.830 INFO:tasks.workunit.client.0.smithi096.stderr: "per_pool": [ 2024-09-16T03:24:53.830 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.830 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 1, 2024-09-16T03:24:53.830 INFO:tasks.workunit.client.0.smithi096.stderr: "floor": 23 2024-09-16T03:24:53.830 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.830 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.830 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 2, 2024-09-16T03:24:53.830 INFO:tasks.workunit.client.0.smithi096.stderr: "floor": 23 2024-09-16T03:24:53.830 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.830 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:53.830 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.830 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_epochs": [ 2024-09-16T03:24:53.830 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.830 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:24:53.830 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 16 2024-09-16T03:24:53.831 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.831 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.831 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:24:53.831 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 16 2024-09-16T03:24:53.831 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.831 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.831 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:24:53.831 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 23 2024-09-16T03:24:53.831 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.831 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:53.831 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.832 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_first_committed": 1, 2024-09-16T03:24:53.832 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_last_committed": 28, 2024-09-16T03:24:53.832 INFO:tasks.workunit.client.0.smithi096.stderr: "crushmap": { 2024-09-16T03:24:53.832 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": [ 2024-09-16T03:24:53.832 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.832 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:24:53.832 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.0", 2024-09-16T03:24:53.832 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:24:53.833 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.833 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.833 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:24:53.833 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.1", 2024-09-16T03:24:53.833 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:24:53.833 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.833 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.833 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:24:53.833 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.2", 2024-09-16T03:24:53.833 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:24:53.833 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.833 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:53.833 INFO:tasks.workunit.client.0.smithi096.stderr: "types": [ 2024-09-16T03:24:53.833 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.834 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 0, 2024-09-16T03:24:53.834 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd" 2024-09-16T03:24:53.834 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.834 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.834 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:24:53.834 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "host" 2024-09-16T03:24:53.834 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.834 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.834 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 2, 2024-09-16T03:24:53.834 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "chassis" 2024-09-16T03:24:53.834 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.834 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.834 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 3, 2024-09-16T03:24:53.834 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "rack" 2024-09-16T03:24:53.835 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.835 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.835 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 4, 2024-09-16T03:24:53.835 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "row" 2024-09-16T03:24:53.835 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.835 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.835 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 5, 2024-09-16T03:24:53.835 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "pdu" 2024-09-16T03:24:53.835 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.835 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.835 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 6, 2024-09-16T03:24:53.835 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "pod" 2024-09-16T03:24:53.835 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.835 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.836 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 7, 2024-09-16T03:24:53.836 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "room" 2024-09-16T03:24:53.836 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.836 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.836 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 8, 2024-09-16T03:24:53.836 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "datacenter" 2024-09-16T03:24:53.836 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.836 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.836 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 9, 2024-09-16T03:24:53.836 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "zone" 2024-09-16T03:24:53.836 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.836 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.836 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 10, 2024-09-16T03:24:53.836 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "region" 2024-09-16T03:24:53.837 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.837 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.837 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:24:53.837 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "root" 2024-09-16T03:24:53.837 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.837 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:53.837 INFO:tasks.workunit.client.0.smithi096.stderr: "buckets": [ 2024-09-16T03:24:53.837 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.837 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -1, 2024-09-16T03:24:53.837 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "default", 2024-09-16T03:24:53.837 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:24:53.837 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "root", 2024-09-16T03:24:53.837 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:24:53.838 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:24:53.838 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:24:53.838 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:24:53.838 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.838 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -3, 2024-09-16T03:24:53.838 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:24:53.838 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:24:53.838 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.838 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:53.839 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.839 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.839 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -2, 2024-09-16T03:24:53.839 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "default~hdd", 2024-09-16T03:24:53.839 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:24:53.839 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "root", 2024-09-16T03:24:53.839 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:24:53.839 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:24:53.839 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:24:53.839 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:24:53.839 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.839 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -4, 2024-09-16T03:24:53.839 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:24:53.839 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:24:53.840 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.840 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:53.840 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.840 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.840 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -3, 2024-09-16T03:24:53.840 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "smithi096", 2024-09-16T03:24:53.840 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:24:53.840 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "host", 2024-09-16T03:24:53.840 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:24:53.840 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:24:53.840 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:24:53.840 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:24:53.840 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.841 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:24:53.841 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:24:53.841 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:24:53.841 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.841 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.841 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:24:53.841 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:24:53.841 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 1 2024-09-16T03:24:53.841 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.841 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.841 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:24:53.841 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:24:53.841 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 2 2024-09-16T03:24:53.841 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.842 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:53.842 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.842 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.842 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -4, 2024-09-16T03:24:53.842 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "smithi096~hdd", 2024-09-16T03:24:53.842 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:24:53.842 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "host", 2024-09-16T03:24:53.842 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:24:53.842 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:24:53.842 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:24:53.842 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:24:53.842 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.842 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:24:53.842 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:24:53.842 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:24:53.843 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.843 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.843 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:24:53.843 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:24:53.843 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 1 2024-09-16T03:24:53.843 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.843 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.843 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:24:53.843 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:24:53.843 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 2 2024-09-16T03:24:53.843 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.843 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:53.843 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.844 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:53.844 INFO:tasks.workunit.client.0.smithi096.stderr: "rules": [ 2024-09-16T03:24:53.844 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.844 INFO:tasks.workunit.client.0.smithi096.stderr: "rule_id": 0, 2024-09-16T03:24:53.844 INFO:tasks.workunit.client.0.smithi096.stderr: "rule_name": "replicated_rule", 2024-09-16T03:24:53.844 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:24:53.844 INFO:tasks.workunit.client.0.smithi096.stderr: "steps": [ 2024-09-16T03:24:53.844 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.844 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "take", 2024-09-16T03:24:53.844 INFO:tasks.workunit.client.0.smithi096.stderr: "item": -1, 2024-09-16T03:24:53.844 INFO:tasks.workunit.client.0.smithi096.stderr: "item_name": "default" 2024-09-16T03:24:53.844 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.845 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.845 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "choose_firstn", 2024-09-16T03:24:53.845 INFO:tasks.workunit.client.0.smithi096.stderr: "num": 0, 2024-09-16T03:24:53.845 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "osd" 2024-09-16T03:24:53.845 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.845 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.845 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "emit" 2024-09-16T03:24:53.845 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.845 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:53.845 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.845 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:53.845 INFO:tasks.workunit.client.0.smithi096.stderr: "tunables": { 2024-09-16T03:24:53.845 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_local_tries": 0, 2024-09-16T03:24:53.846 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_local_fallback_tries": 0, 2024-09-16T03:24:53.846 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_total_tries": 50, 2024-09-16T03:24:53.846 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_descend_once": 1, 2024-09-16T03:24:53.846 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_vary_r": 1, 2024-09-16T03:24:53.846 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_stable": 1, 2024-09-16T03:24:53.846 INFO:tasks.workunit.client.0.smithi096.stderr: "msr_descents": 100, 2024-09-16T03:24:53.846 INFO:tasks.workunit.client.0.smithi096.stderr: "msr_collision_tries": 100, 2024-09-16T03:24:53.846 INFO:tasks.workunit.client.0.smithi096.stderr: "straw_calc_version": 1, 2024-09-16T03:24:53.846 INFO:tasks.workunit.client.0.smithi096.stderr: "allowed_bucket_algs": 54, 2024-09-16T03:24:53.846 INFO:tasks.workunit.client.0.smithi096.stderr: "profile": "jewel", 2024-09-16T03:24:53.846 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_tunables": 1, 2024-09-16T03:24:53.846 INFO:tasks.workunit.client.0.smithi096.stderr: "legacy_tunables": 0, 2024-09-16T03:24:53.846 INFO:tasks.workunit.client.0.smithi096.stderr: "minimum_required_version": "jewel", 2024-09-16T03:24:53.846 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables": 1, 2024-09-16T03:24:53.846 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables2": 1, 2024-09-16T03:24:53.847 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v2_rules": 0, 2024-09-16T03:24:53.847 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables3": 1, 2024-09-16T03:24:53.847 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v3_rules": 0, 2024-09-16T03:24:53.847 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v4_buckets": 1, 2024-09-16T03:24:53.847 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables5": 1, 2024-09-16T03:24:53.847 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v5_rules": 0, 2024-09-16T03:24:53.847 INFO:tasks.workunit.client.0.smithi096.stderr: "has_msr_rules": 0 2024-09-16T03:24:53.847 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.847 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_args": {} 2024-09-16T03:24:53.847 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.847 INFO:tasks.workunit.client.0.smithi096.stderr: "fsmap": { 2024-09-16T03:24:53.847 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 1, 2024-09-16T03:24:53.847 INFO:tasks.workunit.client.0.smithi096.stderr: "btime": "2024-09-16T03:22:46:882186+0000", 2024-09-16T03:24:53.847 INFO:tasks.workunit.client.0.smithi096.stderr: "default_fscid": -1, 2024-09-16T03:24:53.848 INFO:tasks.workunit.client.0.smithi096.stderr: "compat": { 2024-09-16T03:24:53.848 INFO:tasks.workunit.client.0.smithi096.stderr: "compat": {}, 2024-09-16T03:24:53.848 INFO:tasks.workunit.client.0.smithi096.stderr: "ro_compat": {}, 2024-09-16T03:24:53.848 INFO:tasks.workunit.client.0.smithi096.stderr: "incompat": { 2024-09-16T03:24:53.848 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_1": "base v0.20", 2024-09-16T03:24:53.848 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_2": "client writeable ranges", 2024-09-16T03:24:53.848 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_3": "default file layouts on dirs", 2024-09-16T03:24:53.848 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_4": "dir inode in separate object", 2024-09-16T03:24:53.848 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_5": "mds uses versioned encoding", 2024-09-16T03:24:53.848 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_6": "dirfrag is stored in omap", 2024-09-16T03:24:53.848 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_8": "no anchor table", 2024-09-16T03:24:53.849 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_9": "file layout v2", 2024-09-16T03:24:53.849 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_10": "snaprealm v2", 2024-09-16T03:24:53.849 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_11": "minor log segments", 2024-09-16T03:24:53.849 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_12": "quiesce subvolumes" 2024-09-16T03:24:53.849 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.849 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.849 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_flags": { 2024-09-16T03:24:53.849 INFO:tasks.workunit.client.0.smithi096.stderr: "enable_multiple": true, 2024-09-16T03:24:53.849 INFO:tasks.workunit.client.0.smithi096.stderr: "ever_enabled_multiple": true 2024-09-16T03:24:53.849 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.850 INFO:tasks.workunit.client.0.smithi096.stderr: "standbys": [], 2024-09-16T03:24:53.850 INFO:tasks.workunit.client.0.smithi096.stderr: "filesystems": [] 2024-09-16T03:24:53.850 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.850 INFO:tasks.workunit.client.0.smithi096.stderr: "mdsmap_first_committed": 1, 2024-09-16T03:24:53.850 INFO:tasks.workunit.client.0.smithi096.stderr: "mdsmap_last_committed": 1, 2024-09-16T03:24:53.850 INFO:tasks.workunit.client.0.smithi096.stderr: "auth": { 2024-09-16T03:24:53.850 INFO:tasks.workunit.client.0.smithi096.stderr: "first_committed": 1, 2024-09-16T03:24:53.850 INFO:tasks.workunit.client.0.smithi096.stderr: "last_committed": 5, 2024-09-16T03:24:53.850 INFO:tasks.workunit.client.0.smithi096.stderr: "num_secrets": 3 2024-09-16T03:24:53.850 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.850 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 64, 2024-09-16T03:24:53.850 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_active": 64, 2024-09-16T03:24:53.850 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_unknown": 0, 2024-09-16T03:24:53.850 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osd": 3, 2024-09-16T03:24:53.850 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_sum": { 2024-09-16T03:24:53.851 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:24:53.851 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:24:53.851 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:24:53.851 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:24:53.851 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:24:53.851 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:24:53.851 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:24:53.851 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:24:53.851 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:24:53.851 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:24:53.851 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:24:53.851 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:24:53.851 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:24:53.851 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:24:53.852 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:24:53.852 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:24:53.852 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:24:53.852 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:24:53.852 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:24:53.852 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:24:53.852 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:24:53.852 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:24:53.852 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:24:53.852 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:24:53.852 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:24:53.852 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:24:53.852 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:24:53.853 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:24:53.853 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:24:53.853 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:24:53.853 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:24:53.853 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:24:53.853 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:24:53.853 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:24:53.853 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:24:53.853 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:24:53.853 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:24:53.853 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:24:53.853 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:24:53.853 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:24:53.854 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:24:53.854 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.854 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:24:53.854 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:24:53.854 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:24:53.854 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:24:53.854 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:24:53.854 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:24:53.854 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:24:53.854 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:24:53.854 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:24:53.854 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:24:53.854 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:24:53.854 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.855 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:24:53.855 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:24:53.855 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 192, 2024-09-16T03:24:53.855 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 192, 2024-09-16T03:24:53.855 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 0 2024-09-16T03:24:53.855 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.855 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_sum": { 2024-09-16T03:24:53.855 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 0, 2024-09-16T03:24:53.855 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 0, 2024-09-16T03:24:53.855 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pgs": 64, 2024-09-16T03:24:53.855 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osds": 3, 2024-09-16T03:24:53.856 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_osds": 3, 2024-09-16T03:24:53.856 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_omap_osds": 3, 2024-09-16T03:24:53.856 INFO:tasks.workunit.client.0.smithi096.stderr: "kb": 314572800, 2024-09-16T03:24:53.856 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used": 81116, 2024-09-16T03:24:53.856 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_data": 592, 2024-09-16T03:24:53.856 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_omap": 4, 2024-09-16T03:24:53.856 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_meta": 80443, 2024-09-16T03:24:53.856 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_avail": 314491684, 2024-09-16T03:24:53.856 INFO:tasks.workunit.client.0.smithi096.stderr: "statfs": { 2024-09-16T03:24:53.856 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 322122547200, 2024-09-16T03:24:53.856 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 322039484416, 2024-09-16T03:24:53.856 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:24:53.856 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 606208, 2024-09-16T03:24:53.857 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 169287, 2024-09-16T03:24:53.857 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:24:53.857 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:24:53.857 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:24:53.857 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 4785, 2024-09-16T03:24:53.857 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 82373967 2024-09-16T03:24:53.857 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.857 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_peers": [], 2024-09-16T03:24:53.857 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_trim_queue_len": 0, 2024-09-16T03:24:53.857 INFO:tasks.workunit.client.0.smithi096.stderr: "num_snap_trimming": 0, 2024-09-16T03:24:53.857 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shards_repaired": 0, 2024-09-16T03:24:53.857 INFO:tasks.workunit.client.0.smithi096.stderr: "op_queue_age_hist": { 2024-09-16T03:24:53.857 INFO:tasks.workunit.client.0.smithi096.stderr: "histogram": [], 2024-09-16T03:24:53.857 INFO:tasks.workunit.client.0.smithi096.stderr: "upper_bound": 1 2024-09-16T03:24:53.858 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.858 INFO:tasks.workunit.client.0.smithi096.stderr: "perf_stat": { 2024-09-16T03:24:53.858 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ms": 718, 2024-09-16T03:24:53.858 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ms": 718, 2024-09-16T03:24:53.858 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ns": 718000000, 2024-09-16T03:24:53.858 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ns": 718000000 2024-09-16T03:24:53.858 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.858 INFO:tasks.workunit.client.0.smithi096.stderr: "alerts": [], 2024-09-16T03:24:53.858 INFO:tasks.workunit.client.0.smithi096.stderr: "network_ping_times": [] 2024-09-16T03:24:53.859 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.859 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_sum_by_class": { 2024-09-16T03:24:53.859 INFO:tasks.workunit.client.0.smithi096.stderr: "hdd": { 2024-09-16T03:24:53.859 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 0, 2024-09-16T03:24:53.859 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 0, 2024-09-16T03:24:53.859 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pgs": 64, 2024-09-16T03:24:53.859 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osds": 3, 2024-09-16T03:24:53.859 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_osds": 3, 2024-09-16T03:24:53.859 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_omap_osds": 3, 2024-09-16T03:24:53.860 INFO:tasks.workunit.client.0.smithi096.stderr: "kb": 314572800, 2024-09-16T03:24:53.860 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used": 81116, 2024-09-16T03:24:53.860 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_data": 592, 2024-09-16T03:24:53.860 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_omap": 4, 2024-09-16T03:24:53.860 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_meta": 80443, 2024-09-16T03:24:53.860 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_avail": 314491684, 2024-09-16T03:24:53.860 INFO:tasks.workunit.client.0.smithi096.stderr: "statfs": { 2024-09-16T03:24:53.860 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 322122547200, 2024-09-16T03:24:53.860 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 322039484416, 2024-09-16T03:24:53.860 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:24:53.860 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 606208, 2024-09-16T03:24:53.860 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 169287, 2024-09-16T03:24:53.860 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:24:53.861 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:24:53.861 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:24:53.861 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 4785, 2024-09-16T03:24:53.861 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 82373967 2024-09-16T03:24:53.861 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.861 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_peers": [], 2024-09-16T03:24:53.861 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_trim_queue_len": 0, 2024-09-16T03:24:53.861 INFO:tasks.workunit.client.0.smithi096.stderr: "num_snap_trimming": 0, 2024-09-16T03:24:53.861 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shards_repaired": 0, 2024-09-16T03:24:53.861 INFO:tasks.workunit.client.0.smithi096.stderr: "op_queue_age_hist": { 2024-09-16T03:24:53.861 INFO:tasks.workunit.client.0.smithi096.stderr: "histogram": [], 2024-09-16T03:24:53.861 INFO:tasks.workunit.client.0.smithi096.stderr: "upper_bound": 1 2024-09-16T03:24:53.862 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.862 INFO:tasks.workunit.client.0.smithi096.stderr: "perf_stat": { 2024-09-16T03:24:53.862 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ms": 718, 2024-09-16T03:24:53.862 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ms": 718, 2024-09-16T03:24:53.862 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ns": 718000000, 2024-09-16T03:24:53.862 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ns": 718000000 2024-09-16T03:24:53.862 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.862 INFO:tasks.workunit.client.0.smithi096.stderr: "alerts": [], 2024-09-16T03:24:53.862 INFO:tasks.workunit.client.0.smithi096.stderr: "network_ping_times": [] 2024-09-16T03:24:53.862 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.862 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.862 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_stats": [ 2024-09-16T03:24:53.862 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.863 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 2, 2024-09-16T03:24:53.863 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 32, 2024-09-16T03:24:53.863 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:24:53.863 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:24:53.863 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:24:53.863 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:24:53.863 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:24:53.863 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:24:53.863 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:24:53.863 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:24:53.863 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:24:53.863 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:24:53.863 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:24:53.863 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:24:53.864 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:24:53.864 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:24:53.864 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:24:53.864 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:24:53.864 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:24:53.864 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:24:53.864 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:24:53.864 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:24:53.864 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:24:53.864 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:24:53.864 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:24:53.864 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:24:53.865 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:24:53.865 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:24:53.865 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:24:53.865 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:24:53.865 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:24:53.865 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:24:53.865 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:24:53.865 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:24:53.865 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:24:53.865 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:24:53.865 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:24:53.865 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:24:53.865 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:24:53.866 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:24:53.866 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:24:53.866 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:24:53.866 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:24:53.866 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.866 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:24:53.866 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:24:53.866 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:24:53.866 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:24:53.866 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:24:53.866 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:24:53.866 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:24:53.866 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:24:53.866 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:24:53.867 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:24:53.867 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:24:53.867 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.867 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:24:53.867 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:24:53.867 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 96, 2024-09-16T03:24:53.867 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 96, 2024-09-16T03:24:53.867 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 3 2024-09-16T03:24:53.867 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.867 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.867 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 1, 2024-09-16T03:24:53.867 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 32, 2024-09-16T03:24:53.868 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:24:53.868 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:24:53.868 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:24:53.868 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:24:53.868 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:24:53.868 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:24:53.868 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:24:53.868 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:24:53.868 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:24:53.868 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:24:53.868 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:24:53.869 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:24:53.869 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:24:53.869 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:24:53.869 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:24:53.869 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:24:53.869 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:24:53.869 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:24:53.869 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:24:53.869 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:24:53.869 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:24:53.869 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:24:53.869 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:24:53.869 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:24:53.869 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:24:53.870 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:24:53.870 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:24:53.870 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:24:53.870 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:24:53.870 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:24:53.870 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:24:53.870 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:24:53.870 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:24:53.870 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:24:53.871 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:24:53.871 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:24:53.871 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:24:53.871 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:24:53.871 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:24:53.871 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:24:53.871 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:24:53.871 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.871 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:24:53.871 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:24:53.871 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:24:53.871 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:24:53.872 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:24:53.872 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:24:53.872 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:24:53.872 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:24:53.872 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:24:53.872 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:24:53.872 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:24:53.872 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.872 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:24:53.872 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:24:53.872 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 96, 2024-09-16T03:24:53.872 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 96, 2024-09-16T03:24:53.872 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 3 2024-09-16T03:24:53.872 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.873 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:53.873 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_stats": [ 2024-09-16T03:24:53.873 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.873 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:24:53.873 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 21474836504 2024-09-16T03:24:53.873 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.873 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.873 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:24:53.873 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 42949672976 2024-09-16T03:24:53.873 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.873 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.873 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:24:53.873 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 64424509448 2024-09-16T03:24:53.873 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.873 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:53.874 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_by_state": [ 2024-09-16T03:24:53.874 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.874 INFO:tasks.workunit.client.0.smithi096.stderr: "state": "active+clean", 2024-09-16T03:24:53.874 INFO:tasks.workunit.client.0.smithi096.stderr: "num": 64 2024-09-16T03:24:53.874 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.874 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:53.874 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_by_osd": [ 2024-09-16T03:24:53.874 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.874 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:24:53.874 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 15, 2024-09-16T03:24:53.874 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 64, 2024-09-16T03:24:53.874 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:24:53.874 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.874 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.875 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:24:53.875 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 20, 2024-09-16T03:24:53.875 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 64, 2024-09-16T03:24:53.875 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:24:53.875 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.875 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.875 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:24:53.875 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 29, 2024-09-16T03:24:53.876 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 64, 2024-09-16T03:24:53.876 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:24:53.876 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.876 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:53.876 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": [ 2024-09-16T03:24:53.877 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.877 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 1, 2024-09-16T03:24:53.877 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": {} 2024-09-16T03:24:53.877 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.877 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:53.877 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 2, 2024-09-16T03:24:53.877 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": {} 2024-09-16T03:24:53.877 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.877 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:53.877 INFO:tasks.workunit.client.0.smithi096.stderr: "servicemap": { 2024-09-16T03:24:53.877 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 3, 2024-09-16T03:24:53.877 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:24:24.403052+0000", 2024-09-16T03:24:53.878 INFO:tasks.workunit.client.0.smithi096.stderr: "services": { 2024-09-16T03:24:53.878 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": { 2024-09-16T03:24:53.878 INFO:tasks.workunit.client.0.smithi096.stderr: "daemons": { 2024-09-16T03:24:53.878 INFO:tasks.workunit.client.0.smithi096.stderr: "summary": "", 2024-09-16T03:24:53.878 INFO:tasks.workunit.client.0.smithi096.stderr: "1": { 2024-09-16T03:24:53.878 INFO:tasks.workunit.client.0.smithi096.stderr: "start_epoch": 0, 2024-09-16T03:24:53.878 INFO:tasks.workunit.client.0.smithi096.stderr: "start_stamp": "0.000000", 2024-09-16T03:24:53.878 INFO:tasks.workunit.client.0.smithi096.stderr: "gid": 0, 2024-09-16T03:24:53.878 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "(unrecognized address family 0)/0", 2024-09-16T03:24:53.879 INFO:tasks.workunit.client.0.smithi096.stderr: "metadata": {}, 2024-09-16T03:24:53.879 INFO:tasks.workunit.client.0.smithi096.stderr: "task_status": {} 2024-09-16T03:24:53.879 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.879 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.879 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.879 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.879 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:53.879 INFO:tasks.workunit.client.0.smithi096.stderr: "mgrstat_first_committed": 47, 2024-09-16T03:24:53.879 INFO:tasks.workunit.client.0.smithi096.stderr: "mgrstat_last_committed": 52, 2024-09-16T03:24:53.879 INFO:tasks.workunit.client.0.smithi096.stderr: "logm_first_committed": 1, 2024-09-16T03:24:53.879 INFO:tasks.workunit.client.0.smithi096.stderr: "logm_last_committed": 231, 2024-09-16T03:24:53.879 INFO:tasks.workunit.client.0.smithi096.stderr: "paxos": { 2024-09-16T03:24:53.880 INFO:tasks.workunit.client.0.smithi096.stderr: "first_committed": 1, 2024-09-16T03:24:53.880 INFO:tasks.workunit.client.0.smithi096.stderr: "last_committed": 319, 2024-09-16T03:24:53.880 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pn": 0, 2024-09-16T03:24:53.880 INFO:tasks.workunit.client.0.smithi096.stderr: "accepted_pn": 0 2024-09-16T03:24:53.880 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:53.880 INFO:tasks.workunit.client.0.smithi096.stderr:}' 2024-09-16T03:24:53.882 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:132: get_fc_lc_diff: jq .osdmap_first_committed 2024-09-16T03:24:53.882 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:132: get_fc_lc_diff: echo '{' '"cluster_fingerprint":' '"fda2fc64-07ed-4add-8224-2e527e11d427",' '"version":' '"19.3.0-4930-gfc3e0bff",' '"commit":' '"fc3e0bff7468fd55478adbae7f75508b749124b6",' '"timestamp":' '"2024-09-16T03:24:53.753721+0000",' '"tag":' '"",' '"health":' '{' '"status":' '"HEALTH_OK",' '"checks":' '{},' '"mutes":' '[]' '},' '"monmap_first_committed":' 1, '"monmap_last_committed":' 1, '"monmap":' '{' '"epoch":' 1, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"modified":' '"2024-09-16T03:22:45.872880Z",' '"created":' '"2024-09-16T03:22:45.872880Z",' '"min_mon_release":' 19, '"min_mon_release_name":' '"squid",' '"election_strategy":' 1, '"disallowed_leaders:' '":' '"",' '"stretch_mode":' false, '"tiebreaker_mon":' '"",' '"removed_ranks:' '":' '"",' '"features":' '{' '"persistent":' '[' '"kraken",' '"luminous",' '"mimic",' '"osdmap-prune",' '"nautilus",' '"octopus",' '"pacific",' '"elector-pinging",' '"quincy",' '"reef",' '"squid"' '],' '"optional":' '[]' '},' '"mons":' '[' '{' '"rank":' 0, '"name":' '"a",' '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:7302",' '"nonce":' 0 '}' ']' '},' '"addr":' '"127.0.0.1:7302/0",' '"public_addr":' '"127.0.0.1:7302/0",' '"priority":' 0, '"weight":' 0, '"crush_location":' '"{}"' '}' ']' '},' '"quorum":' '[' 0 '],' '"osdmap":' '{' '"epoch":' 28, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"created":' '"2024-09-16T03:22:46.906117+0000",' '"modified":' '"2024-09-16T03:24:50.642444+0000",' '"last_up_change":' '"2024-09-16T03:24:37.708512+0000",' '"last_in_change":' '"2024-09-16T03:24:01.831039+0000",' '"flags":' '"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit",' '"flags_num":' 5799936, '"flags_set":' '[' '"pglog_hardlimit",' '"purged_snapdirs",' '"recovery_deletes",' '"sortbitwise"' '],' '"crush_version":' 7, '"full_ratio":' 0.97000002861022949, '"backfillfull_ratio":' 0.97000002861022949, '"nearfull_ratio":' 0.85000002384185791, '"cluster_snapshot":' '"",' '"pool_max":' 2, '"max_osd":' 3, '"require_min_compat_client":' '"luminous",' '"min_compat_client":' '"jewel",' '"require_osd_release":' '"squid",' '"allow_crimson":' false, '"pools":' '[' '{' '"pool":' 1, '"pool_name":' '"foo",' '"create_time":' '"2024-09-16T03:24:44.525189+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"21",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.690000057220459, '"score_stable":' 1.690000057220459, '"optimal_score":' 1, '"raw_score_acting":' 1.690000057220459, '"raw_score_stable":' 1.690000057220459, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '},' '{' '"pool":' 2, '"pool_name":' '"bar",' '"create_time":' '"2024-09-16T03:24:46.226575+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"24",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.1299999952316284, '"score_stable":' 1.1299999952316284, '"optimal_score":' 1, '"raw_score_acting":' 1.1299999952316284, '"raw_score_stable":' 1.1299999952316284, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '}' '],' '"osds":' '[' '{' '"osd":' 0, '"uuid":' '"64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 5, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6802",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6803",' '"nonce":' 3375787448 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6804",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6805",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6808",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6809",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6806",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6807",' '"nonce":' 3375787448 '}' ']' '},' '"public_addr":' '"127.0.0.1:6803/3375787448",' '"cluster_addr":' '"127.0.0.1:6805/3375787448",' '"heartbeat_back_addr":' '"127.0.0.1:6809/3375787448",' '"heartbeat_front_addr":' '"127.0.0.1:6807/3375787448",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 1, '"uuid":' '"74b26727-75c9-444d-8782-719e4197a382",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 10, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6810",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6811",' '"nonce":' 3733255132 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6812",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6813",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6816",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6817",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6814",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6815",' '"nonce":' 3733255132 '}' ']' '},' '"public_addr":' '"127.0.0.1:6811/3733255132",' '"cluster_addr":' '"127.0.0.1:6813/3733255132",' '"heartbeat_back_addr":' '"127.0.0.1:6817/3733255132",' '"heartbeat_front_addr":' '"127.0.0.1:6815/3733255132",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 2, '"uuid":' '"143da3a7-dad9-4b1e-966b-76cf5bdd3c82",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 15, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6818",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6819",' '"nonce":' 963814857 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6820",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6821",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6824",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6825",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6822",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6823",' '"nonce":' 963814857 '}' ']' '},' '"public_addr":' '"127.0.0.1:6819/963814857",' '"cluster_addr":' '"127.0.0.1:6821/963814857",' '"heartbeat_back_addr":' '"127.0.0.1:6825/963814857",' '"heartbeat_front_addr":' '"127.0.0.1:6823/963814857",' '"state":' '[' '"exists",' '"up"' ']' '}' '],' '"osd_xinfo":' '[' '{' '"osd":' 0, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:22.481942+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 1, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:59.663703+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 2, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:24:37.320822+0000",' '"dead_epoch":' 0 '}' '],' '"pg_upmap":' '[],' '"pg_upmap_items":' '[],' '"pg_upmap_primaries":' '[],' '"pg_temp":' '[],' '"primary_temp":' '[],' '"blocklist":' '{},' '"range_blocklist":' '{},' '"erasure_code_profiles":' '{' '"default":' '{' '"k":' '"2",' '"m":' '"2",' '"plugin":' '"jerasure",' '"technique":' '"reed_sol_van"' '}' '},' '"removed_snaps_queue":' '[],' '"new_removed_snaps":' '[],' '"new_purged_snaps":' '[],' '"crush_node_flags":' '{},' '"device_class_flags":' '{},' '"stretch_mode":' '{' '"stretch_mode_enabled":' false, '"stretch_bucket_count":' 0, '"degraded_stretch_mode":' 0, '"recovering_stretch_mode":' 0, '"stretch_mode_bucket":' 0 '}' '},' '"osd_metadata":' '[' '{' '"id":' 0, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/0/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:22:53.662571Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]",' '"hb_front_addr":' '"[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/0",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 1, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/1/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:23:30.129885Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]",' '"hb_front_addr":' '"[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/1",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 2, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/2/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:24:07.764502Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]",' '"hb_front_addr":' '"[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/2",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '}' '],' '"osdmap_clean_epochs":' '{' '"min_last_epoch_clean":' 0, '"last_epoch_clean":' '{' '"per_pool":' '[' '{' '"poolid":' 1, '"floor":' 23 '},' '{' '"poolid":' 2, '"floor":' 23 '}' ']' '},' '"osd_epochs":' '[' '{' '"id":' 0, '"epoch":' 16 '},' '{' '"id":' 1, '"epoch":' 16 '},' '{' '"id":' 2, '"epoch":' 23 '}' ']' '},' '"osdmap_first_committed":' 1, '"osdmap_last_committed":' 28, '"crushmap":' '{' '"devices":' '[' '{' '"id":' 0, '"name":' '"osd.0",' '"class":' '"hdd"' '},' '{' '"id":' 1, '"name":' '"osd.1",' '"class":' '"hdd"' '},' '{' '"id":' 2, '"name":' '"osd.2",' '"class":' '"hdd"' '}' '],' '"types":' '[' '{' '"type_id":' 0, '"name":' '"osd"' '},' '{' '"type_id":' 1, '"name":' '"host"' '},' '{' '"type_id":' 2, '"name":' '"chassis"' '},' '{' '"type_id":' 3, '"name":' '"rack"' '},' '{' '"type_id":' 4, '"name":' '"row"' '},' '{' '"type_id":' 5, '"name":' '"pdu"' '},' '{' '"type_id":' 6, '"name":' '"pod"' '},' '{' '"type_id":' 7, '"name":' '"room"' '},' '{' '"type_id":' 8, '"name":' '"datacenter"' '},' '{' '"type_id":' 9, '"name":' '"zone"' '},' '{' '"type_id":' 10, '"name":' '"region"' '},' '{' '"type_id":' 11, '"name":' '"root"' '}' '],' '"buckets":' '[' '{' '"id":' -1, '"name":' '"default",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -3, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -2, '"name":' '"default~hdd",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -4, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -3, '"name":' '"smithi096",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '},' '{' '"id":' -4, '"name":' '"smithi096~hdd",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '}' '],' '"rules":' '[' '{' '"rule_id":' 0, '"rule_name":' '"replicated_rule",' '"type":' 1, '"steps":' '[' '{' '"op":' '"take",' '"item":' -1, '"item_name":' '"default"' '},' '{' '"op":' '"choose_firstn",' '"num":' 0, '"type":' '"osd"' '},' '{' '"op":' '"emit"' '}' ']' '}' '],' '"tunables":' '{' '"choose_local_tries":' 0, '"choose_local_fallback_tries":' 0, '"choose_total_tries":' 50, '"chooseleaf_descend_once":' 1, '"chooseleaf_vary_r":' 1, '"chooseleaf_stable":' 1, '"msr_descents":' 100, '"msr_collision_tries":' 100, '"straw_calc_version":' 1, '"allowed_bucket_algs":' 54, '"profile":' '"jewel",' '"optimal_tunables":' 1, '"legacy_tunables":' 0, '"minimum_required_version":' '"jewel",' '"require_feature_tunables":' 1, '"require_feature_tunables2":' 1, '"has_v2_rules":' 0, '"require_feature_tunables3":' 1, '"has_v3_rules":' 0, '"has_v4_buckets":' 1, '"require_feature_tunables5":' 1, '"has_v5_rules":' 0, '"has_msr_rules":' 0 '},' '"choose_args":' '{}' '},' '"fsmap":' '{' '"epoch":' 1, '"btime":' '"2024-09-16T03:22:46:882186+0000",' '"default_fscid":' -1, '"compat":' '{' '"compat":' '{},' '"ro_compat":' '{},' '"incompat":' '{' '"feature_1":' '"base' 'v0.20",' '"feature_2":' '"client' writeable 'ranges",' '"feature_3":' '"default' file layouts on 'dirs",' '"feature_4":' '"dir' inode in separate 'object",' '"feature_5":' '"mds' uses versioned 'encoding",' '"feature_6":' '"dirfrag' is stored in 'omap",' '"feature_8":' '"no' anchor 'table",' '"feature_9":' '"file' layout 'v2",' '"feature_10":' '"snaprealm' 'v2",' '"feature_11":' '"minor' log 'segments",' '"feature_12":' '"quiesce' 'subvolumes"' '}' '},' '"feature_flags":' '{' '"enable_multiple":' true, '"ever_enabled_multiple":' true '},' '"standbys":' '[],' '"filesystems":' '[]' '},' '"mdsmap_first_committed":' 1, '"mdsmap_last_committed":' 1, '"auth":' '{' '"first_committed":' 1, '"last_committed":' 5, '"num_secrets":' 3 '},' '"num_pg":' 64, '"num_pg_active":' 64, '"num_pg_unknown":' 0, '"num_osd":' 3, '"pool_sum":' '{' '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 192, '"acting":' 192, '"num_store_stats":' 0 '},' '"osd_sum":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 64, '"num_osds":' 3, '"num_per_pool_osds":' 3, '"num_per_pool_omap_osds":' 3, '"kb":' 314572800, '"kb_used":' 81116, '"kb_used_data":' 592, '"kb_used_omap":' 4, '"kb_used_meta":' 80443, '"kb_avail":' 314491684, '"statfs":' '{' '"total":' 322122547200, '"available":' 322039484416, '"internally_reserved":' 0, '"allocated":' 606208, '"data_stored":' 169287, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 4785, '"internal_metadata":' 82373967 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 718, '"apply_latency_ms":' 718, '"commit_latency_ns":' 718000000, '"apply_latency_ns":' 718000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '},' '"osd_sum_by_class":' '{' '"hdd":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 64, '"num_osds":' 3, '"num_per_pool_osds":' 3, '"num_per_pool_omap_osds":' 3, '"kb":' 314572800, '"kb_used":' 81116, '"kb_used_data":' 592, '"kb_used_omap":' 4, '"kb_used_meta":' 80443, '"kb_avail":' 314491684, '"statfs":' '{' '"total":' 322122547200, '"available":' 322039484416, '"internally_reserved":' 0, '"allocated":' 606208, '"data_stored":' 169287, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 4785, '"internal_metadata":' 82373967 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 718, '"apply_latency_ms":' 718, '"commit_latency_ns":' 718000000, '"apply_latency_ns":' 718000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '}' '},' '"pool_stats":' '[' '{' '"poolid":' 2, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 96, '"acting":' 96, '"num_store_stats":' 3 '},' '{' '"poolid":' 1, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 96, '"acting":' 96, '"num_store_stats":' 3 '}' '],' '"osd_stats":' '[' '{' '"osd":' 0, '"seq":' 21474836504 '},' '{' '"osd":' 1, '"seq":' 42949672976 '},' '{' '"osd":' 2, '"seq":' 64424509448 '}' '],' '"num_pg_by_state":' '[' '{' '"state":' '"active+clean",' '"num":' 64 '}' '],' '"num_pg_by_osd":' '[' '{' '"osd":' 2, '"num_primary_pg":' 15, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 0, '"num_primary_pg":' 20, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 1, '"num_primary_pg":' 29, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '}' '],' '"purged_snaps":' '[' '{' '"pool":' 1, '"purged_snaps":' '{}' '},' '{' '"pool":' 2, '"purged_snaps":' '{}' '}' '],' '"servicemap":' '{' '"epoch":' 3, '"modified":' '"2024-09-16T03:24:24.403052+0000",' '"services":' '{' '"osd":' '{' '"daemons":' '{' '"summary":' '"",' '"1":' '{' '"start_epoch":' 0, '"start_stamp":' '"0.000000",' '"gid":' 0, '"addr":' '"(unrecognized' address family '0)/0",' '"metadata":' '{},' '"task_status":' '{}' '}' '}' '}' '}' '},' '"mgrstat_first_committed":' 47, '"mgrstat_last_committed":' 52, '"logm_first_committed":' 1, '"logm_last_committed":' 231, '"paxos":' '{' '"first_committed":' 1, '"last_committed":' 319, '"last_pn":' 0, '"accepted_pn":' 0 '}' '}' 2024-09-16T03:24:53.883 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:132: get_fc_lc_diff: osdm_fc=1 2024-09-16T03:24:53.883 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:134: get_fc_lc_diff: jq .osdmap_last_committed 2024-09-16T03:24:53.883 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:134: get_fc_lc_diff: echo '{' '"cluster_fingerprint":' '"fda2fc64-07ed-4add-8224-2e527e11d427",' '"version":' '"19.3.0-4930-gfc3e0bff",' '"commit":' '"fc3e0bff7468fd55478adbae7f75508b749124b6",' '"timestamp":' '"2024-09-16T03:24:53.753721+0000",' '"tag":' '"",' '"health":' '{' '"status":' '"HEALTH_OK",' '"checks":' '{},' '"mutes":' '[]' '},' '"monmap_first_committed":' 1, '"monmap_last_committed":' 1, '"monmap":' '{' '"epoch":' 1, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"modified":' '"2024-09-16T03:22:45.872880Z",' '"created":' '"2024-09-16T03:22:45.872880Z",' '"min_mon_release":' 19, '"min_mon_release_name":' '"squid",' '"election_strategy":' 1, '"disallowed_leaders:' '":' '"",' '"stretch_mode":' false, '"tiebreaker_mon":' '"",' '"removed_ranks:' '":' '"",' '"features":' '{' '"persistent":' '[' '"kraken",' '"luminous",' '"mimic",' '"osdmap-prune",' '"nautilus",' '"octopus",' '"pacific",' '"elector-pinging",' '"quincy",' '"reef",' '"squid"' '],' '"optional":' '[]' '},' '"mons":' '[' '{' '"rank":' 0, '"name":' '"a",' '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:7302",' '"nonce":' 0 '}' ']' '},' '"addr":' '"127.0.0.1:7302/0",' '"public_addr":' '"127.0.0.1:7302/0",' '"priority":' 0, '"weight":' 0, '"crush_location":' '"{}"' '}' ']' '},' '"quorum":' '[' 0 '],' '"osdmap":' '{' '"epoch":' 28, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"created":' '"2024-09-16T03:22:46.906117+0000",' '"modified":' '"2024-09-16T03:24:50.642444+0000",' '"last_up_change":' '"2024-09-16T03:24:37.708512+0000",' '"last_in_change":' '"2024-09-16T03:24:01.831039+0000",' '"flags":' '"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit",' '"flags_num":' 5799936, '"flags_set":' '[' '"pglog_hardlimit",' '"purged_snapdirs",' '"recovery_deletes",' '"sortbitwise"' '],' '"crush_version":' 7, '"full_ratio":' 0.97000002861022949, '"backfillfull_ratio":' 0.97000002861022949, '"nearfull_ratio":' 0.85000002384185791, '"cluster_snapshot":' '"",' '"pool_max":' 2, '"max_osd":' 3, '"require_min_compat_client":' '"luminous",' '"min_compat_client":' '"jewel",' '"require_osd_release":' '"squid",' '"allow_crimson":' false, '"pools":' '[' '{' '"pool":' 1, '"pool_name":' '"foo",' '"create_time":' '"2024-09-16T03:24:44.525189+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"21",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.690000057220459, '"score_stable":' 1.690000057220459, '"optimal_score":' 1, '"raw_score_acting":' 1.690000057220459, '"raw_score_stable":' 1.690000057220459, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '},' '{' '"pool":' 2, '"pool_name":' '"bar",' '"create_time":' '"2024-09-16T03:24:46.226575+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"24",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.1299999952316284, '"score_stable":' 1.1299999952316284, '"optimal_score":' 1, '"raw_score_acting":' 1.1299999952316284, '"raw_score_stable":' 1.1299999952316284, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '}' '],' '"osds":' '[' '{' '"osd":' 0, '"uuid":' '"64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 5, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6802",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6803",' '"nonce":' 3375787448 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6804",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6805",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6808",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6809",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6806",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6807",' '"nonce":' 3375787448 '}' ']' '},' '"public_addr":' '"127.0.0.1:6803/3375787448",' '"cluster_addr":' '"127.0.0.1:6805/3375787448",' '"heartbeat_back_addr":' '"127.0.0.1:6809/3375787448",' '"heartbeat_front_addr":' '"127.0.0.1:6807/3375787448",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 1, '"uuid":' '"74b26727-75c9-444d-8782-719e4197a382",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 10, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6810",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6811",' '"nonce":' 3733255132 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6812",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6813",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6816",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6817",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6814",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6815",' '"nonce":' 3733255132 '}' ']' '},' '"public_addr":' '"127.0.0.1:6811/3733255132",' '"cluster_addr":' '"127.0.0.1:6813/3733255132",' '"heartbeat_back_addr":' '"127.0.0.1:6817/3733255132",' '"heartbeat_front_addr":' '"127.0.0.1:6815/3733255132",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 2, '"uuid":' '"143da3a7-dad9-4b1e-966b-76cf5bdd3c82",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 15, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6818",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6819",' '"nonce":' 963814857 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6820",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6821",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6824",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6825",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6822",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6823",' '"nonce":' 963814857 '}' ']' '},' '"public_addr":' '"127.0.0.1:6819/963814857",' '"cluster_addr":' '"127.0.0.1:6821/963814857",' '"heartbeat_back_addr":' '"127.0.0.1:6825/963814857",' '"heartbeat_front_addr":' '"127.0.0.1:6823/963814857",' '"state":' '[' '"exists",' '"up"' ']' '}' '],' '"osd_xinfo":' '[' '{' '"osd":' 0, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:22.481942+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 1, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:59.663703+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 2, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:24:37.320822+0000",' '"dead_epoch":' 0 '}' '],' '"pg_upmap":' '[],' '"pg_upmap_items":' '[],' '"pg_upmap_primaries":' '[],' '"pg_temp":' '[],' '"primary_temp":' '[],' '"blocklist":' '{},' '"range_blocklist":' '{},' '"erasure_code_profiles":' '{' '"default":' '{' '"k":' '"2",' '"m":' '"2",' '"plugin":' '"jerasure",' '"technique":' '"reed_sol_van"' '}' '},' '"removed_snaps_queue":' '[],' '"new_removed_snaps":' '[],' '"new_purged_snaps":' '[],' '"crush_node_flags":' '{},' '"device_class_flags":' '{},' '"stretch_mode":' '{' '"stretch_mode_enabled":' false, '"stretch_bucket_count":' 0, '"degraded_stretch_mode":' 0, '"recovering_stretch_mode":' 0, '"stretch_mode_bucket":' 0 '}' '},' '"osd_metadata":' '[' '{' '"id":' 0, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/0/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:22:53.662571Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]",' '"hb_front_addr":' '"[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/0",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 1, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/1/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:23:30.129885Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]",' '"hb_front_addr":' '"[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/1",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 2, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/2/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:24:07.764502Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]",' '"hb_front_addr":' '"[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/2",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '}' '],' '"osdmap_clean_epochs":' '{' '"min_last_epoch_clean":' 0, '"last_epoch_clean":' '{' '"per_pool":' '[' '{' '"poolid":' 1, '"floor":' 23 '},' '{' '"poolid":' 2, '"floor":' 23 '}' ']' '},' '"osd_epochs":' '[' '{' '"id":' 0, '"epoch":' 16 '},' '{' '"id":' 1, '"epoch":' 16 '},' '{' '"id":' 2, '"epoch":' 23 '}' ']' '},' '"osdmap_first_committed":' 1, '"osdmap_last_committed":' 28, '"crushmap":' '{' '"devices":' '[' '{' '"id":' 0, '"name":' '"osd.0",' '"class":' '"hdd"' '},' '{' '"id":' 1, '"name":' '"osd.1",' '"class":' '"hdd"' '},' '{' '"id":' 2, '"name":' '"osd.2",' '"class":' '"hdd"' '}' '],' '"types":' '[' '{' '"type_id":' 0, '"name":' '"osd"' '},' '{' '"type_id":' 1, '"name":' '"host"' '},' '{' '"type_id":' 2, '"name":' '"chassis"' '},' '{' '"type_id":' 3, '"name":' '"rack"' '},' '{' '"type_id":' 4, '"name":' '"row"' '},' '{' '"type_id":' 5, '"name":' '"pdu"' '},' '{' '"type_id":' 6, '"name":' '"pod"' '},' '{' '"type_id":' 7, '"name":' '"room"' '},' '{' '"type_id":' 8, '"name":' '"datacenter"' '},' '{' '"type_id":' 9, '"name":' '"zone"' '},' '{' '"type_id":' 10, '"name":' '"region"' '},' '{' '"type_id":' 11, '"name":' '"root"' '}' '],' '"buckets":' '[' '{' '"id":' -1, '"name":' '"default",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -3, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -2, '"name":' '"default~hdd",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -4, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -3, '"name":' '"smithi096",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '},' '{' '"id":' -4, '"name":' '"smithi096~hdd",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '}' '],' '"rules":' '[' '{' '"rule_id":' 0, '"rule_name":' '"replicated_rule",' '"type":' 1, '"steps":' '[' '{' '"op":' '"take",' '"item":' -1, '"item_name":' '"default"' '},' '{' '"op":' '"choose_firstn",' '"num":' 0, '"type":' '"osd"' '},' '{' '"op":' '"emit"' '}' ']' '}' '],' '"tunables":' '{' '"choose_local_tries":' 0, '"choose_local_fallback_tries":' 0, '"choose_total_tries":' 50, '"chooseleaf_descend_once":' 1, '"chooseleaf_vary_r":' 1, '"chooseleaf_stable":' 1, '"msr_descents":' 100, '"msr_collision_tries":' 100, '"straw_calc_version":' 1, '"allowed_bucket_algs":' 54, '"profile":' '"jewel",' '"optimal_tunables":' 1, '"legacy_tunables":' 0, '"minimum_required_version":' '"jewel",' '"require_feature_tunables":' 1, '"require_feature_tunables2":' 1, '"has_v2_rules":' 0, '"require_feature_tunables3":' 1, '"has_v3_rules":' 0, '"has_v4_buckets":' 1, '"require_feature_tunables5":' 1, '"has_v5_rules":' 0, '"has_msr_rules":' 0 '},' '"choose_args":' '{}' '},' '"fsmap":' '{' '"epoch":' 1, '"btime":' '"2024-09-16T03:22:46:882186+0000",' '"default_fscid":' -1, '"compat":' '{' '"compat":' '{},' '"ro_compat":' '{},' '"incompat":' '{' '"feature_1":' '"base' 'v0.20",' '"feature_2":' '"client' writeable 'ranges",' '"feature_3":' '"default' file layouts on 'dirs",' '"feature_4":' '"dir' inode in separate 'object",' '"feature_5":' '"mds' uses versioned 'encoding",' '"feature_6":' '"dirfrag' is stored in 'omap",' '"feature_8":' '"no' anchor 'table",' '"feature_9":' '"file' layout 'v2",' '"feature_10":' '"snaprealm' 'v2",' '"feature_11":' '"minor' log 'segments",' '"feature_12":' '"quiesce' 'subvolumes"' '}' '},' '"feature_flags":' '{' '"enable_multiple":' true, '"ever_enabled_multiple":' true '},' '"standbys":' '[],' '"filesystems":' '[]' '},' '"mdsmap_first_committed":' 1, '"mdsmap_last_committed":' 1, '"auth":' '{' '"first_committed":' 1, '"last_committed":' 5, '"num_secrets":' 3 '},' '"num_pg":' 64, '"num_pg_active":' 64, '"num_pg_unknown":' 0, '"num_osd":' 3, '"pool_sum":' '{' '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 192, '"acting":' 192, '"num_store_stats":' 0 '},' '"osd_sum":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 64, '"num_osds":' 3, '"num_per_pool_osds":' 3, '"num_per_pool_omap_osds":' 3, '"kb":' 314572800, '"kb_used":' 81116, '"kb_used_data":' 592, '"kb_used_omap":' 4, '"kb_used_meta":' 80443, '"kb_avail":' 314491684, '"statfs":' '{' '"total":' 322122547200, '"available":' 322039484416, '"internally_reserved":' 0, '"allocated":' 606208, '"data_stored":' 169287, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 4785, '"internal_metadata":' 82373967 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 718, '"apply_latency_ms":' 718, '"commit_latency_ns":' 718000000, '"apply_latency_ns":' 718000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '},' '"osd_sum_by_class":' '{' '"hdd":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 64, '"num_osds":' 3, '"num_per_pool_osds":' 3, '"num_per_pool_omap_osds":' 3, '"kb":' 314572800, '"kb_used":' 81116, '"kb_used_data":' 592, '"kb_used_omap":' 4, '"kb_used_meta":' 80443, '"kb_avail":' 314491684, '"statfs":' '{' '"total":' 322122547200, '"available":' 322039484416, '"internally_reserved":' 0, '"allocated":' 606208, '"data_stored":' 169287, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 4785, '"internal_metadata":' 82373967 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 718, '"apply_latency_ms":' 718, '"commit_latency_ns":' 718000000, '"apply_latency_ns":' 718000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '}' '},' '"pool_stats":' '[' '{' '"poolid":' 2, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 96, '"acting":' 96, '"num_store_stats":' 3 '},' '{' '"poolid":' 1, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 96, '"acting":' 96, '"num_store_stats":' 3 '}' '],' '"osd_stats":' '[' '{' '"osd":' 0, '"seq":' 21474836504 '},' '{' '"osd":' 1, '"seq":' 42949672976 '},' '{' '"osd":' 2, '"seq":' 64424509448 '}' '],' '"num_pg_by_state":' '[' '{' '"state":' '"active+clean",' '"num":' 64 '}' '],' '"num_pg_by_osd":' '[' '{' '"osd":' 2, '"num_primary_pg":' 15, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 0, '"num_primary_pg":' 20, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 1, '"num_primary_pg":' 29, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '}' '],' '"purged_snaps":' '[' '{' '"pool":' 1, '"purged_snaps":' '{}' '},' '{' '"pool":' 2, '"purged_snaps":' '{}' '}' '],' '"servicemap":' '{' '"epoch":' 3, '"modified":' '"2024-09-16T03:24:24.403052+0000",' '"services":' '{' '"osd":' '{' '"daemons":' '{' '"summary":' '"",' '"1":' '{' '"start_epoch":' 0, '"start_stamp":' '"0.000000",' '"gid":' 0, '"addr":' '"(unrecognized' address family '0)/0",' '"metadata":' '{},' '"task_status":' '{}' '}' '}' '}' '}' '},' '"mgrstat_first_committed":' 47, '"mgrstat_last_committed":' 52, '"logm_first_committed":' 1, '"logm_last_committed":' 231, '"paxos":' '{' '"first_committed":' 1, '"last_committed":' 319, '"last_pn":' 0, '"accepted_pn":' 0 '}' '}' 2024-09-16T03:24:53.883 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:134: get_fc_lc_diff: osdm_lc=28 2024-09-16T03:24:53.883 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:136: get_fc_lc_diff: echo 27 2024-09-16T03:24:53.883 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:161: wait_for_total_num_maps: [[ 27 -gt 2 ]] 2024-09-16T03:24:53.883 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:162: wait_for_total_num_maps: (( 1 >= 27 )) 2024-09-16T03:24:53.883 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:166: wait_for_total_num_maps: sleep 0.2 2024-09-16T03:24:54.043 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:167: wait_for_total_num_maps: loop+=1 2024-09-16T03:24:54.045 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:161: wait_for_total_num_maps: get_fc_lc_diff 2024-09-16T03:24:54.045 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:130: get_fc_lc_diff: ceph report 2024-09-16T03:24:54.602 INFO:tasks.workunit.client.0.smithi096.stderr:report 3123430684 2024-09-16T03:24:54.618 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:130: get_fc_lc_diff: report='{ 2024-09-16T03:24:54.618 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_fingerprint": "fda2fc64-07ed-4add-8224-2e527e11d427", 2024-09-16T03:24:54.618 INFO:tasks.workunit.client.0.smithi096.stderr: "version": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:24:54.619 INFO:tasks.workunit.client.0.smithi096.stderr: "commit": "fc3e0bff7468fd55478adbae7f75508b749124b6", 2024-09-16T03:24:54.619 INFO:tasks.workunit.client.0.smithi096.stderr: "timestamp": "2024-09-16T03:24:54.604102+0000", 2024-09-16T03:24:54.619 INFO:tasks.workunit.client.0.smithi096.stderr: "tag": "", 2024-09-16T03:24:54.619 INFO:tasks.workunit.client.0.smithi096.stderr: "health": { 2024-09-16T03:24:54.619 INFO:tasks.workunit.client.0.smithi096.stderr: "status": "HEALTH_OK", 2024-09-16T03:24:54.619 INFO:tasks.workunit.client.0.smithi096.stderr: "checks": {}, 2024-09-16T03:24:54.619 INFO:tasks.workunit.client.0.smithi096.stderr: "mutes": [] 2024-09-16T03:24:54.619 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.619 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap_first_committed": 1, 2024-09-16T03:24:54.619 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap_last_committed": 1, 2024-09-16T03:24:54.619 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap": { 2024-09-16T03:24:54.619 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 1, 2024-09-16T03:24:54.619 INFO:tasks.workunit.client.0.smithi096.stderr: "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", 2024-09-16T03:24:54.619 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:22:45.872880Z", 2024-09-16T03:24:54.620 INFO:tasks.workunit.client.0.smithi096.stderr: "created": "2024-09-16T03:22:45.872880Z", 2024-09-16T03:24:54.620 INFO:tasks.workunit.client.0.smithi096.stderr: "min_mon_release": 19, 2024-09-16T03:24:54.620 INFO:tasks.workunit.client.0.smithi096.stderr: "min_mon_release_name": "squid", 2024-09-16T03:24:54.620 INFO:tasks.workunit.client.0.smithi096.stderr: "election_strategy": 1, 2024-09-16T03:24:54.620 INFO:tasks.workunit.client.0.smithi096.stderr: "disallowed_leaders: ": "", 2024-09-16T03:24:54.620 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode": false, 2024-09-16T03:24:54.620 INFO:tasks.workunit.client.0.smithi096.stderr: "tiebreaker_mon": "", 2024-09-16T03:24:54.620 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_ranks: ": "", 2024-09-16T03:24:54.620 INFO:tasks.workunit.client.0.smithi096.stderr: "features": { 2024-09-16T03:24:54.620 INFO:tasks.workunit.client.0.smithi096.stderr: "persistent": [ 2024-09-16T03:24:54.620 INFO:tasks.workunit.client.0.smithi096.stderr: "kraken", 2024-09-16T03:24:54.620 INFO:tasks.workunit.client.0.smithi096.stderr: "luminous", 2024-09-16T03:24:54.620 INFO:tasks.workunit.client.0.smithi096.stderr: "mimic", 2024-09-16T03:24:54.621 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap-prune", 2024-09-16T03:24:54.621 INFO:tasks.workunit.client.0.smithi096.stderr: "nautilus", 2024-09-16T03:24:54.621 INFO:tasks.workunit.client.0.smithi096.stderr: "octopus", 2024-09-16T03:24:54.621 INFO:tasks.workunit.client.0.smithi096.stderr: "pacific", 2024-09-16T03:24:54.621 INFO:tasks.workunit.client.0.smithi096.stderr: "elector-pinging", 2024-09-16T03:24:54.621 INFO:tasks.workunit.client.0.smithi096.stderr: "quincy", 2024-09-16T03:24:54.621 INFO:tasks.workunit.client.0.smithi096.stderr: "reef", 2024-09-16T03:24:54.621 INFO:tasks.workunit.client.0.smithi096.stderr: "squid" 2024-09-16T03:24:54.621 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:54.621 INFO:tasks.workunit.client.0.smithi096.stderr: "optional": [] 2024-09-16T03:24:54.621 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.621 INFO:tasks.workunit.client.0.smithi096.stderr: "mons": [ 2024-09-16T03:24:54.621 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.622 INFO:tasks.workunit.client.0.smithi096.stderr: "rank": 0, 2024-09-16T03:24:54.622 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "a", 2024-09-16T03:24:54.622 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:24:54.622 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:54.622 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.622 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:54.622 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:7302", 2024-09-16T03:24:54.622 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 0 2024-09-16T03:24:54.622 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:54.622 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:54.622 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.622 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:7302/0", 2024-09-16T03:24:54.622 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:7302/0", 2024-09-16T03:24:54.623 INFO:tasks.workunit.client.0.smithi096.stderr: "priority": 0, 2024-09-16T03:24:54.623 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 0, 2024-09-16T03:24:54.623 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_location": "{}" 2024-09-16T03:24:54.623 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:54.623 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:54.623 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.623 INFO:tasks.workunit.client.0.smithi096.stderr: "quorum": [ 2024-09-16T03:24:54.623 INFO:tasks.workunit.client.0.smithi096.stderr: 0 2024-09-16T03:24:54.623 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:54.623 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap": { 2024-09-16T03:24:54.623 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 28, 2024-09-16T03:24:54.623 INFO:tasks.workunit.client.0.smithi096.stderr: "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", 2024-09-16T03:24:54.623 INFO:tasks.workunit.client.0.smithi096.stderr: "created": "2024-09-16T03:22:46.906117+0000", 2024-09-16T03:24:54.623 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:24:50.642444+0000", 2024-09-16T03:24:54.624 INFO:tasks.workunit.client.0.smithi096.stderr: "last_up_change": "2024-09-16T03:24:37.708512+0000", 2024-09-16T03:24:54.624 INFO:tasks.workunit.client.0.smithi096.stderr: "last_in_change": "2024-09-16T03:24:01.831039+0000", 2024-09-16T03:24:54.624 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-16T03:24:54.624 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_num": 5799936, 2024-09-16T03:24:54.624 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_set": [ 2024-09-16T03:24:54.624 INFO:tasks.workunit.client.0.smithi096.stderr: "pglog_hardlimit", 2024-09-16T03:24:54.624 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snapdirs", 2024-09-16T03:24:54.624 INFO:tasks.workunit.client.0.smithi096.stderr: "recovery_deletes", 2024-09-16T03:24:54.624 INFO:tasks.workunit.client.0.smithi096.stderr: "sortbitwise" 2024-09-16T03:24:54.624 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:54.624 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_version": 7, 2024-09-16T03:24:54.624 INFO:tasks.workunit.client.0.smithi096.stderr: "full_ratio": 0.97000002861022949, 2024-09-16T03:24:54.624 INFO:tasks.workunit.client.0.smithi096.stderr: "backfillfull_ratio": 0.97000002861022949, 2024-09-16T03:24:54.625 INFO:tasks.workunit.client.0.smithi096.stderr: "nearfull_ratio": 0.85000002384185791, 2024-09-16T03:24:54.625 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_snapshot": "", 2024-09-16T03:24:54.625 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_max": 2, 2024-09-16T03:24:54.625 INFO:tasks.workunit.client.0.smithi096.stderr: "max_osd": 3, 2024-09-16T03:24:54.625 INFO:tasks.workunit.client.0.smithi096.stderr: "require_min_compat_client": "luminous", 2024-09-16T03:24:54.625 INFO:tasks.workunit.client.0.smithi096.stderr: "min_compat_client": "jewel", 2024-09-16T03:24:54.625 INFO:tasks.workunit.client.0.smithi096.stderr: "require_osd_release": "squid", 2024-09-16T03:24:54.625 INFO:tasks.workunit.client.0.smithi096.stderr: "allow_crimson": false, 2024-09-16T03:24:54.625 INFO:tasks.workunit.client.0.smithi096.stderr: "pools": [ 2024-09-16T03:24:54.625 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.625 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 1, 2024-09-16T03:24:54.625 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_name": "foo", 2024-09-16T03:24:54.625 INFO:tasks.workunit.client.0.smithi096.stderr: "create_time": "2024-09-16T03:24:44.525189+0000", 2024-09-16T03:24:54.625 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": 1, 2024-09-16T03:24:54.626 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_names": "hashpspool", 2024-09-16T03:24:54.626 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:24:54.626 INFO:tasks.workunit.client.0.smithi096.stderr: "size": 3, 2024-09-16T03:24:54.626 INFO:tasks.workunit.client.0.smithi096.stderr: "min_size": 2, 2024-09-16T03:24:54.626 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_rule": 0, 2024-09-16T03:24:54.626 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_count": 0, 2024-09-16T03:24:54.626 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_target": 0, 2024-09-16T03:24:54.626 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_barrier": 0, 2024-09-16T03:24:54.626 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-16T03:24:54.626 INFO:tasks.workunit.client.0.smithi096.stderr: "is_stretch_pool": false, 2024-09-16T03:24:54.626 INFO:tasks.workunit.client.0.smithi096.stderr: "object_hash": 2, 2024-09-16T03:24:54.626 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_autoscale_mode": "off", 2024-09-16T03:24:54.626 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num": 32, 2024-09-16T03:24:54.627 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num": 32, 2024-09-16T03:24:54.627 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num_target": 32, 2024-09-16T03:24:54.627 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_target": 32, 2024-09-16T03:24:54.627 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_pending": 32, 2024-09-16T03:24:54.627 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pg_merge_meta": { 2024-09-16T03:24:54.627 INFO:tasks.workunit.client.0.smithi096.stderr: "source_pgid": "0.0", 2024-09-16T03:24:54.627 INFO:tasks.workunit.client.0.smithi096.stderr: "ready_epoch": 0, 2024-09-16T03:24:54.627 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_started": 0, 2024-09-16T03:24:54.627 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": 0, 2024-09-16T03:24:54.627 INFO:tasks.workunit.client.0.smithi096.stderr: "source_version": "0'\''0", 2024-09-16T03:24:54.627 INFO:tasks.workunit.client.0.smithi096.stderr: "target_version": "0'\''0" 2024-09-16T03:24:54.627 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.627 INFO:tasks.workunit.client.0.smithi096.stderr: "last_change": "21", 2024-09-16T03:24:54.628 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend": "0", 2024-09-16T03:24:54.628 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_prenautilus": "0", 2024-09-16T03:24:54.628 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_preluminous": "0", 2024-09-16T03:24:54.628 INFO:tasks.workunit.client.0.smithi096.stderr: "auid": 0, 2024-09-16T03:24:54.628 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_mode": "selfmanaged", 2024-09-16T03:24:54.628 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_seq": 0, 2024-09-16T03:24:54.628 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_epoch": 0, 2024-09-16T03:24:54.628 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_snaps": [], 2024-09-16T03:24:54.628 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps": "[]", 2024-09-16T03:24:54.628 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_bytes": 0, 2024-09-16T03:24:54.628 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_objects": 0, 2024-09-16T03:24:54.628 INFO:tasks.workunit.client.0.smithi096.stderr: "tiers": [], 2024-09-16T03:24:54.628 INFO:tasks.workunit.client.0.smithi096.stderr: "tier_of": -1, 2024-09-16T03:24:54.629 INFO:tasks.workunit.client.0.smithi096.stderr: "read_tier": -1, 2024-09-16T03:24:54.629 INFO:tasks.workunit.client.0.smithi096.stderr: "write_tier": -1, 2024-09-16T03:24:54.629 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_mode": "none", 2024-09-16T03:24:54.629 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_bytes": 0, 2024-09-16T03:24:54.629 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_objects": 0, 2024-09-16T03:24:54.629 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_ratio_micro": 400000, 2024-09-16T03:24:54.629 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-16T03:24:54.629 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_full_ratio_micro": 800000, 2024-09-16T03:24:54.629 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_flush_age": 0, 2024-09-16T03:24:54.629 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_evict_age": 0, 2024-09-16T03:24:54.629 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profile": "", 2024-09-16T03:24:54.629 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_params": { 2024-09-16T03:24:54.629 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "none" 2024-09-16T03:24:54.629 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.630 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_period": 0, 2024-09-16T03:24:54.630 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_count": 0, 2024-09-16T03:24:54.630 INFO:tasks.workunit.client.0.smithi096.stderr: "use_gmt_hitset": true, 2024-09-16T03:24:54.630 INFO:tasks.workunit.client.0.smithi096.stderr: "min_read_recency_for_promote": 0, 2024-09-16T03:24:54.630 INFO:tasks.workunit.client.0.smithi096.stderr: "min_write_recency_for_promote": 0, 2024-09-16T03:24:54.630 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_grade_decay_rate": 0, 2024-09-16T03:24:54.630 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_search_last_n": 0, 2024-09-16T03:24:54.630 INFO:tasks.workunit.client.0.smithi096.stderr: "grade_table": [], 2024-09-16T03:24:54.630 INFO:tasks.workunit.client.0.smithi096.stderr: "stripe_width": 0, 2024-09-16T03:24:54.630 INFO:tasks.workunit.client.0.smithi096.stderr: "expected_num_objects": 0, 2024-09-16T03:24:54.630 INFO:tasks.workunit.client.0.smithi096.stderr: "fast_read": false, 2024-09-16T03:24:54.630 INFO:tasks.workunit.client.0.smithi096.stderr: "options": {}, 2024-09-16T03:24:54.630 INFO:tasks.workunit.client.0.smithi096.stderr: "application_metadata": {}, 2024-09-16T03:24:54.630 INFO:tasks.workunit.client.0.smithi096.stderr: "read_balance": { 2024-09-16T03:24:54.631 INFO:tasks.workunit.client.0.smithi096.stderr: "score_type": "Fair distribution", 2024-09-16T03:24:54.631 INFO:tasks.workunit.client.0.smithi096.stderr: "score_acting": 1.690000057220459, 2024-09-16T03:24:54.631 INFO:tasks.workunit.client.0.smithi096.stderr: "score_stable": 1.690000057220459, 2024-09-16T03:24:54.631 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_score": 1, 2024-09-16T03:24:54.631 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_acting": 1.690000057220459, 2024-09-16T03:24:54.631 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_stable": 1.690000057220459, 2024-09-16T03:24:54.631 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity_weighted": 1, 2024-09-16T03:24:54.631 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity": 1, 2024-09-16T03:24:54.631 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity_weighted": 1 2024-09-16T03:24:54.631 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:54.631 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.631 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.631 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 2, 2024-09-16T03:24:54.631 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_name": "bar", 2024-09-16T03:24:54.632 INFO:tasks.workunit.client.0.smithi096.stderr: "create_time": "2024-09-16T03:24:46.226575+0000", 2024-09-16T03:24:54.632 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": 1, 2024-09-16T03:24:54.632 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_names": "hashpspool", 2024-09-16T03:24:54.632 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:24:54.632 INFO:tasks.workunit.client.0.smithi096.stderr: "size": 3, 2024-09-16T03:24:54.632 INFO:tasks.workunit.client.0.smithi096.stderr: "min_size": 2, 2024-09-16T03:24:54.632 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_rule": 0, 2024-09-16T03:24:54.632 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_count": 0, 2024-09-16T03:24:54.632 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_target": 0, 2024-09-16T03:24:54.632 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_barrier": 0, 2024-09-16T03:24:54.632 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-16T03:24:54.632 INFO:tasks.workunit.client.0.smithi096.stderr: "is_stretch_pool": false, 2024-09-16T03:24:54.632 INFO:tasks.workunit.client.0.smithi096.stderr: "object_hash": 2, 2024-09-16T03:24:54.632 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_autoscale_mode": "off", 2024-09-16T03:24:54.633 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num": 32, 2024-09-16T03:24:54.633 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num": 32, 2024-09-16T03:24:54.633 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num_target": 32, 2024-09-16T03:24:54.633 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_target": 32, 2024-09-16T03:24:54.633 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_pending": 32, 2024-09-16T03:24:54.633 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pg_merge_meta": { 2024-09-16T03:24:54.633 INFO:tasks.workunit.client.0.smithi096.stderr: "source_pgid": "0.0", 2024-09-16T03:24:54.633 INFO:tasks.workunit.client.0.smithi096.stderr: "ready_epoch": 0, 2024-09-16T03:24:54.633 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_started": 0, 2024-09-16T03:24:54.633 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": 0, 2024-09-16T03:24:54.633 INFO:tasks.workunit.client.0.smithi096.stderr: "source_version": "0'\''0", 2024-09-16T03:24:54.633 INFO:tasks.workunit.client.0.smithi096.stderr: "target_version": "0'\''0" 2024-09-16T03:24:54.633 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.633 INFO:tasks.workunit.client.0.smithi096.stderr: "last_change": "24", 2024-09-16T03:24:54.634 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend": "0", 2024-09-16T03:24:54.634 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_prenautilus": "0", 2024-09-16T03:24:54.634 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_preluminous": "0", 2024-09-16T03:24:54.634 INFO:tasks.workunit.client.0.smithi096.stderr: "auid": 0, 2024-09-16T03:24:54.634 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_mode": "selfmanaged", 2024-09-16T03:24:54.634 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_seq": 0, 2024-09-16T03:24:54.634 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_epoch": 0, 2024-09-16T03:24:54.634 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_snaps": [], 2024-09-16T03:24:54.634 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps": "[]", 2024-09-16T03:24:54.634 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_bytes": 0, 2024-09-16T03:24:54.634 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_objects": 0, 2024-09-16T03:24:54.634 INFO:tasks.workunit.client.0.smithi096.stderr: "tiers": [], 2024-09-16T03:24:54.634 INFO:tasks.workunit.client.0.smithi096.stderr: "tier_of": -1, 2024-09-16T03:24:54.634 INFO:tasks.workunit.client.0.smithi096.stderr: "read_tier": -1, 2024-09-16T03:24:54.635 INFO:tasks.workunit.client.0.smithi096.stderr: "write_tier": -1, 2024-09-16T03:24:54.635 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_mode": "none", 2024-09-16T03:24:54.635 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_bytes": 0, 2024-09-16T03:24:54.635 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_objects": 0, 2024-09-16T03:24:54.635 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_ratio_micro": 400000, 2024-09-16T03:24:54.635 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-16T03:24:54.635 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_full_ratio_micro": 800000, 2024-09-16T03:24:54.635 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_flush_age": 0, 2024-09-16T03:24:54.635 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_evict_age": 0, 2024-09-16T03:24:54.635 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profile": "", 2024-09-16T03:24:54.635 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_params": { 2024-09-16T03:24:54.635 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "none" 2024-09-16T03:24:54.635 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.636 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_period": 0, 2024-09-16T03:24:54.636 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_count": 0, 2024-09-16T03:24:54.636 INFO:tasks.workunit.client.0.smithi096.stderr: "use_gmt_hitset": true, 2024-09-16T03:24:54.636 INFO:tasks.workunit.client.0.smithi096.stderr: "min_read_recency_for_promote": 0, 2024-09-16T03:24:54.636 INFO:tasks.workunit.client.0.smithi096.stderr: "min_write_recency_for_promote": 0, 2024-09-16T03:24:54.636 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_grade_decay_rate": 0, 2024-09-16T03:24:54.636 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_search_last_n": 0, 2024-09-16T03:24:54.636 INFO:tasks.workunit.client.0.smithi096.stderr: "grade_table": [], 2024-09-16T03:24:54.636 INFO:tasks.workunit.client.0.smithi096.stderr: "stripe_width": 0, 2024-09-16T03:24:54.636 INFO:tasks.workunit.client.0.smithi096.stderr: "expected_num_objects": 0, 2024-09-16T03:24:54.636 INFO:tasks.workunit.client.0.smithi096.stderr: "fast_read": false, 2024-09-16T03:24:54.636 INFO:tasks.workunit.client.0.smithi096.stderr: "options": {}, 2024-09-16T03:24:54.636 INFO:tasks.workunit.client.0.smithi096.stderr: "application_metadata": {}, 2024-09-16T03:24:54.636 INFO:tasks.workunit.client.0.smithi096.stderr: "read_balance": { 2024-09-16T03:24:54.637 INFO:tasks.workunit.client.0.smithi096.stderr: "score_type": "Fair distribution", 2024-09-16T03:24:54.637 INFO:tasks.workunit.client.0.smithi096.stderr: "score_acting": 1.1299999952316284, 2024-09-16T03:24:54.637 INFO:tasks.workunit.client.0.smithi096.stderr: "score_stable": 1.1299999952316284, 2024-09-16T03:24:54.637 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_score": 1, 2024-09-16T03:24:54.637 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_acting": 1.1299999952316284, 2024-09-16T03:24:54.637 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_stable": 1.1299999952316284, 2024-09-16T03:24:54.637 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity_weighted": 1, 2024-09-16T03:24:54.637 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity": 1, 2024-09-16T03:24:54.637 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity_weighted": 1 2024-09-16T03:24:54.637 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:54.637 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:54.637 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:54.637 INFO:tasks.workunit.client.0.smithi096.stderr: "osds": [ 2024-09-16T03:24:54.637 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.638 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:24:54.638 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6", 2024-09-16T03:24:54.638 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:24:54.638 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:24:54.638 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:24:54.638 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:24:54.638 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:24:54.638 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:24:54.638 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 5, 2024-09-16T03:24:54.638 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 21, 2024-09-16T03:24:54.638 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:24:54.638 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:24:54.638 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:24:54.638 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:54.639 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.639 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:54.639 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6802", 2024-09-16T03:24:54.639 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:24:54.639 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.639 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.639 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:54.639 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6803", 2024-09-16T03:24:54.639 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:24:54.639 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:54.639 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:54.639 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.639 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:24:54.639 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:54.640 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.640 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:54.640 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6804", 2024-09-16T03:24:54.640 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:24:54.640 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.640 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.640 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:54.640 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6805", 2024-09-16T03:24:54.640 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:24:54.640 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:54.640 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:54.640 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.640 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:24:54.640 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:54.641 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.641 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:54.641 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6808", 2024-09-16T03:24:54.641 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:24:54.641 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.641 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.641 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:54.641 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6809", 2024-09-16T03:24:54.641 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:24:54.641 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:54.641 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:54.641 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.641 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:24:54.641 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:54.642 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.642 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:54.642 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6806", 2024-09-16T03:24:54.642 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:24:54.642 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.642 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.642 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:54.642 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6807", 2024-09-16T03:24:54.642 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:24:54.642 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:54.642 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:54.642 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.642 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6803/3375787448", 2024-09-16T03:24:54.642 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6805/3375787448", 2024-09-16T03:24:54.643 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6809/3375787448", 2024-09-16T03:24:54.643 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6807/3375787448", 2024-09-16T03:24:54.643 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:24:54.643 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:24:54.643 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:24:54.643 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:54.643 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.643 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.643 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:24:54.643 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "74b26727-75c9-444d-8782-719e4197a382", 2024-09-16T03:24:54.643 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:24:54.643 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:24:54.643 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:24:54.643 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:24:54.644 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:24:54.644 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:24:54.644 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 10, 2024-09-16T03:24:54.644 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 21, 2024-09-16T03:24:54.644 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:24:54.644 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:24:54.644 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:24:54.644 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:54.644 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.644 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:54.644 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6810", 2024-09-16T03:24:54.644 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:24:54.644 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.645 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.645 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:54.645 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6811", 2024-09-16T03:24:54.645 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:24:54.645 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:54.645 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:54.645 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.645 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:24:54.645 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:54.645 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.645 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:54.645 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6812", 2024-09-16T03:24:54.645 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:24:54.645 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.646 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.646 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:54.646 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6813", 2024-09-16T03:24:54.646 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:24:54.646 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:54.646 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:54.646 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.646 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:24:54.646 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:54.646 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.646 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:54.646 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6816", 2024-09-16T03:24:54.646 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:24:54.646 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.647 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.647 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:54.647 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6817", 2024-09-16T03:24:54.647 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:24:54.647 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:54.647 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:54.647 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.647 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:24:54.647 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:54.647 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.647 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:54.647 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6814", 2024-09-16T03:24:54.647 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:24:54.647 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.648 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.648 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:54.648 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6815", 2024-09-16T03:24:54.648 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:24:54.648 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:54.648 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:54.648 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.648 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6811/3733255132", 2024-09-16T03:24:54.648 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6813/3733255132", 2024-09-16T03:24:54.648 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6817/3733255132", 2024-09-16T03:24:54.648 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6815/3733255132", 2024-09-16T03:24:54.648 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:24:54.648 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:24:54.649 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:24:54.649 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:54.649 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.649 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.649 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:24:54.649 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "143da3a7-dad9-4b1e-966b-76cf5bdd3c82", 2024-09-16T03:24:54.649 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:24:54.649 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:24:54.649 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:24:54.649 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:24:54.649 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:24:54.649 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:24:54.649 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 15, 2024-09-16T03:24:54.649 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 21, 2024-09-16T03:24:54.652 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:24:54.652 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:24:54.652 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:24:54.652 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:54.652 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.652 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:54.652 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6818", 2024-09-16T03:24:54.652 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:24:54.652 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.653 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.653 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:54.653 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6819", 2024-09-16T03:24:54.653 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:24:54.653 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:54.653 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:54.653 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.653 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:24:54.653 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:54.653 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.653 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:54.653 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6820", 2024-09-16T03:24:54.653 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:24:54.654 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.654 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.654 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:54.654 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6821", 2024-09-16T03:24:54.654 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:24:54.654 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:54.654 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:54.654 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.654 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:24:54.654 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:54.654 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.654 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:54.654 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6824", 2024-09-16T03:24:54.655 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:24:54.655 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.655 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.655 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:54.655 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6825", 2024-09-16T03:24:54.655 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:24:54.655 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:54.655 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:54.655 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.655 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:24:54.655 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:54.655 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.655 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:54.655 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6822", 2024-09-16T03:24:54.656 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:24:54.656 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.656 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.656 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:54.656 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6823", 2024-09-16T03:24:54.656 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:24:54.656 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:54.656 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:54.656 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.656 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6819/963814857", 2024-09-16T03:24:54.656 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6821/963814857", 2024-09-16T03:24:54.656 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6825/963814857", 2024-09-16T03:24:54.656 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6823/963814857", 2024-09-16T03:24:54.657 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:24:54.657 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:24:54.657 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:24:54.657 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:54.657 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:54.657 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:54.657 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_xinfo": [ 2024-09-16T03:24:54.657 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.657 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:24:54.657 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:24:54.657 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:24:54.657 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:24:54.658 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:24:54.658 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:24:54.658 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:23:22.481942+0000", 2024-09-16T03:24:54.658 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:24:54.658 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.658 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.658 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:24:54.658 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:24:54.658 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:24:54.658 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:24:54.658 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:24:54.658 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:24:54.658 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:23:59.663703+0000", 2024-09-16T03:24:54.658 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:24:54.659 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.659 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.659 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:24:54.659 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:24:54.659 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:24:54.659 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:24:54.659 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:24:54.659 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:24:54.659 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:24:37.320822+0000", 2024-09-16T03:24:54.659 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:24:54.659 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:54.659 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:54.659 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap": [], 2024-09-16T03:24:54.659 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap_items": [], 2024-09-16T03:24:54.660 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap_primaries": [], 2024-09-16T03:24:54.660 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_temp": [], 2024-09-16T03:24:54.660 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_temp": [], 2024-09-16T03:24:54.660 INFO:tasks.workunit.client.0.smithi096.stderr: "blocklist": {}, 2024-09-16T03:24:54.660 INFO:tasks.workunit.client.0.smithi096.stderr: "range_blocklist": {}, 2024-09-16T03:24:54.660 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profiles": { 2024-09-16T03:24:54.660 INFO:tasks.workunit.client.0.smithi096.stderr: "default": { 2024-09-16T03:24:54.660 INFO:tasks.workunit.client.0.smithi096.stderr: "k": "2", 2024-09-16T03:24:54.660 INFO:tasks.workunit.client.0.smithi096.stderr: "m": "2", 2024-09-16T03:24:54.660 INFO:tasks.workunit.client.0.smithi096.stderr: "plugin": "jerasure", 2024-09-16T03:24:54.660 INFO:tasks.workunit.client.0.smithi096.stderr: "technique": "reed_sol_van" 2024-09-16T03:24:54.660 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:54.660 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.661 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps_queue": [], 2024-09-16T03:24:54.661 INFO:tasks.workunit.client.0.smithi096.stderr: "new_removed_snaps": [], 2024-09-16T03:24:54.661 INFO:tasks.workunit.client.0.smithi096.stderr: "new_purged_snaps": [], 2024-09-16T03:24:54.661 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_node_flags": {}, 2024-09-16T03:24:54.661 INFO:tasks.workunit.client.0.smithi096.stderr: "device_class_flags": {}, 2024-09-16T03:24:54.661 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode": { 2024-09-16T03:24:54.661 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode_enabled": false, 2024-09-16T03:24:54.661 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_bucket_count": 0, 2024-09-16T03:24:54.661 INFO:tasks.workunit.client.0.smithi096.stderr: "degraded_stretch_mode": 0, 2024-09-16T03:24:54.661 INFO:tasks.workunit.client.0.smithi096.stderr: "recovering_stretch_mode": 0, 2024-09-16T03:24:54.661 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode_bucket": 0 2024-09-16T03:24:54.661 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:54.661 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.661 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_metadata": [ 2024-09-16T03:24:54.662 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.662 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:24:54.662 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:24:54.662 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]", 2024-09-16T03:24:54.662 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:24:54.662 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:24:54.662 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:24:54.662 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:24:54.662 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:24:54.662 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:24:54.662 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:24:54.662 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:24:54.662 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:24:54.663 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:24:54.663 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:24:54.663 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/0/block", 2024-09-16T03:24:54.663 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:24:54.663 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:24:54.663 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:24:54.663 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:24:54.663 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:24:54.663 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:24:54.663 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:24:54.663 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:24:54.663 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:24:54.663 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:24:54.664 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:22:53.662571Z", 2024-09-16T03:24:54.664 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:24:54.664 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:24:54.664 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:24:54.664 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:24:54.664 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:24:54.664 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:24:54.664 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:24:54.664 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]", 2024-09-16T03:24:54.664 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:24:54.664 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]", 2024-09-16T03:24:54.664 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]", 2024-09-16T03:24:54.664 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:24:54.665 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:24:54.665 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:24:54.665 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:24:54.665 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:24:54.665 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:24:54.665 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:24:54.665 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:24:54.665 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:24:54.665 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/0", 2024-09-16T03:24:54.665 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:24:54.665 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:24:54.665 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:24:54.665 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.665 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.666 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:24:54.666 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:24:54.666 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]", 2024-09-16T03:24:54.666 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:24:54.666 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:24:54.666 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:24:54.666 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:24:54.666 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:24:54.666 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:24:54.666 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:24:54.666 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:24:54.666 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:24:54.666 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:24:54.667 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:24:54.667 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/1/block", 2024-09-16T03:24:54.667 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:24:54.667 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:24:54.667 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:24:54.667 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:24:54.667 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:24:54.667 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:24:54.667 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:24:54.667 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:24:54.667 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:24:54.667 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:24:54.667 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:23:30.129885Z", 2024-09-16T03:24:54.667 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:24:54.667 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:24:54.668 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:24:54.668 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:24:54.668 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:24:54.668 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:24:54.668 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:24:54.668 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]", 2024-09-16T03:24:54.668 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:24:54.668 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]", 2024-09-16T03:24:54.668 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]", 2024-09-16T03:24:54.668 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:24:54.668 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:24:54.668 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:24:54.669 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:24:54.669 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:24:54.669 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:24:54.669 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:24:54.669 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:24:54.669 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:24:54.669 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/1", 2024-09-16T03:24:54.669 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:24:54.669 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:24:54.669 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:24:54.669 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.669 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.669 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:24:54.669 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:24:54.670 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]", 2024-09-16T03:24:54.670 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:24:54.670 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:24:54.670 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:24:54.670 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:24:54.670 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:24:54.670 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:24:54.670 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:24:54.670 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:24:54.670 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:24:54.670 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:24:54.670 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:24:54.670 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/2/block", 2024-09-16T03:24:54.670 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:24:54.671 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:24:54.671 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:24:54.671 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:24:54.671 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:24:54.671 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:24:54.671 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:24:54.671 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:24:54.671 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:24:54.671 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:24:54.671 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:24:07.764502Z", 2024-09-16T03:24:54.671 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:24:54.671 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:24:54.671 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:24:54.671 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:24:54.672 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:24:54.672 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:24:54.672 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:24:54.672 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]", 2024-09-16T03:24:54.672 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:24:54.672 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]", 2024-09-16T03:24:54.672 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]", 2024-09-16T03:24:54.672 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:24:54.672 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:24:54.672 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:24:54.672 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:24:54.672 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:24:54.673 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:24:54.673 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:24:54.673 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:24:54.673 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:24:54.673 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/2", 2024-09-16T03:24:54.673 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:24:54.673 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:24:54.673 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:24:54.673 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:54.673 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:54.673 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_clean_epochs": { 2024-09-16T03:24:54.673 INFO:tasks.workunit.client.0.smithi096.stderr: "min_last_epoch_clean": 0, 2024-09-16T03:24:54.673 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": { 2024-09-16T03:24:54.673 INFO:tasks.workunit.client.0.smithi096.stderr: "per_pool": [ 2024-09-16T03:24:54.674 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.674 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 1, 2024-09-16T03:24:54.674 INFO:tasks.workunit.client.0.smithi096.stderr: "floor": 23 2024-09-16T03:24:54.674 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.674 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.674 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 2, 2024-09-16T03:24:54.674 INFO:tasks.workunit.client.0.smithi096.stderr: "floor": 23 2024-09-16T03:24:54.674 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:54.674 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:54.674 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.674 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_epochs": [ 2024-09-16T03:24:54.674 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.674 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:24:54.674 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 16 2024-09-16T03:24:54.675 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.675 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.675 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:24:54.675 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 16 2024-09-16T03:24:54.675 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.675 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.675 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:24:54.675 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 23 2024-09-16T03:24:54.675 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:54.675 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:54.675 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.675 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_first_committed": 1, 2024-09-16T03:24:54.675 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_last_committed": 28, 2024-09-16T03:24:54.675 INFO:tasks.workunit.client.0.smithi096.stderr: "crushmap": { 2024-09-16T03:24:54.676 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": [ 2024-09-16T03:24:54.676 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.676 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:24:54.676 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.0", 2024-09-16T03:24:54.676 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:24:54.676 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.676 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.676 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:24:54.676 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.1", 2024-09-16T03:24:54.676 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:24:54.676 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.676 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.676 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:24:54.677 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.2", 2024-09-16T03:24:54.677 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:24:54.677 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:54.677 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:54.677 INFO:tasks.workunit.client.0.smithi096.stderr: "types": [ 2024-09-16T03:24:54.677 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.677 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 0, 2024-09-16T03:24:54.677 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd" 2024-09-16T03:24:54.677 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.677 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.677 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:24:54.677 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "host" 2024-09-16T03:24:54.677 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.678 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.678 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 2, 2024-09-16T03:24:54.678 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "chassis" 2024-09-16T03:24:54.678 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.678 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.678 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 3, 2024-09-16T03:24:54.678 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "rack" 2024-09-16T03:24:54.678 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.678 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.678 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 4, 2024-09-16T03:24:54.678 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "row" 2024-09-16T03:24:54.678 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.678 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.679 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 5, 2024-09-16T03:24:54.679 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "pdu" 2024-09-16T03:24:54.679 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.679 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.679 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 6, 2024-09-16T03:24:54.679 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "pod" 2024-09-16T03:24:54.679 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.679 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.679 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 7, 2024-09-16T03:24:54.679 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "room" 2024-09-16T03:24:54.679 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.679 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.679 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 8, 2024-09-16T03:24:54.679 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "datacenter" 2024-09-16T03:24:54.679 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.680 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.680 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 9, 2024-09-16T03:24:54.680 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "zone" 2024-09-16T03:24:54.680 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.680 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.680 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 10, 2024-09-16T03:24:54.680 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "region" 2024-09-16T03:24:54.680 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.680 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.680 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:24:54.680 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "root" 2024-09-16T03:24:54.680 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:54.680 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:54.681 INFO:tasks.workunit.client.0.smithi096.stderr: "buckets": [ 2024-09-16T03:24:54.681 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.681 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -1, 2024-09-16T03:24:54.681 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "default", 2024-09-16T03:24:54.681 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:24:54.681 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "root", 2024-09-16T03:24:54.681 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:24:54.681 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:24:54.681 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:24:54.681 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:24:54.681 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.681 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -3, 2024-09-16T03:24:54.681 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:24:54.681 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:24:54.682 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:54.682 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:54.682 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.682 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.682 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -2, 2024-09-16T03:24:54.682 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "default~hdd", 2024-09-16T03:24:54.682 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:24:54.682 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "root", 2024-09-16T03:24:54.682 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:24:54.682 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:24:54.682 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:24:54.682 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:24:54.682 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.682 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -4, 2024-09-16T03:24:54.682 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:24:54.683 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:24:54.683 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:54.683 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:54.683 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.683 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.683 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -3, 2024-09-16T03:24:54.683 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "smithi096", 2024-09-16T03:24:54.683 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:24:54.683 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "host", 2024-09-16T03:24:54.683 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:24:54.683 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:24:54.683 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:24:54.683 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:24:54.683 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.684 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:24:54.684 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:24:54.684 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:24:54.684 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.684 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.684 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:24:54.684 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:24:54.684 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 1 2024-09-16T03:24:54.684 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.684 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.684 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:24:54.684 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:24:54.684 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 2 2024-09-16T03:24:54.684 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:54.685 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:54.685 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.685 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.685 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -4, 2024-09-16T03:24:54.685 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "smithi096~hdd", 2024-09-16T03:24:54.685 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:24:54.686 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "host", 2024-09-16T03:24:54.686 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:24:54.686 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:24:54.686 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:24:54.686 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:24:54.686 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.687 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:24:54.687 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:24:54.687 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:24:54.687 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.687 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.687 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:24:54.687 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:24:54.687 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 1 2024-09-16T03:24:54.687 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.687 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.687 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:24:54.688 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:24:54.688 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 2 2024-09-16T03:24:54.688 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:54.688 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:54.688 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:54.688 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:54.688 INFO:tasks.workunit.client.0.smithi096.stderr: "rules": [ 2024-09-16T03:24:54.688 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.688 INFO:tasks.workunit.client.0.smithi096.stderr: "rule_id": 0, 2024-09-16T03:24:54.688 INFO:tasks.workunit.client.0.smithi096.stderr: "rule_name": "replicated_rule", 2024-09-16T03:24:54.688 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:24:54.688 INFO:tasks.workunit.client.0.smithi096.stderr: "steps": [ 2024-09-16T03:24:54.689 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.689 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "take", 2024-09-16T03:24:54.689 INFO:tasks.workunit.client.0.smithi096.stderr: "item": -1, 2024-09-16T03:24:54.689 INFO:tasks.workunit.client.0.smithi096.stderr: "item_name": "default" 2024-09-16T03:24:54.689 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.689 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.689 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "choose_firstn", 2024-09-16T03:24:54.689 INFO:tasks.workunit.client.0.smithi096.stderr: "num": 0, 2024-09-16T03:24:54.689 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "osd" 2024-09-16T03:24:54.689 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.689 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.690 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "emit" 2024-09-16T03:24:54.690 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:54.690 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:54.690 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:54.690 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:54.690 INFO:tasks.workunit.client.0.smithi096.stderr: "tunables": { 2024-09-16T03:24:54.690 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_local_tries": 0, 2024-09-16T03:24:54.690 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_local_fallback_tries": 0, 2024-09-16T03:24:54.690 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_total_tries": 50, 2024-09-16T03:24:54.690 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_descend_once": 1, 2024-09-16T03:24:54.690 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_vary_r": 1, 2024-09-16T03:24:54.690 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_stable": 1, 2024-09-16T03:24:54.691 INFO:tasks.workunit.client.0.smithi096.stderr: "msr_descents": 100, 2024-09-16T03:24:54.691 INFO:tasks.workunit.client.0.smithi096.stderr: "msr_collision_tries": 100, 2024-09-16T03:24:54.691 INFO:tasks.workunit.client.0.smithi096.stderr: "straw_calc_version": 1, 2024-09-16T03:24:54.691 INFO:tasks.workunit.client.0.smithi096.stderr: "allowed_bucket_algs": 54, 2024-09-16T03:24:54.691 INFO:tasks.workunit.client.0.smithi096.stderr: "profile": "jewel", 2024-09-16T03:24:54.691 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_tunables": 1, 2024-09-16T03:24:54.691 INFO:tasks.workunit.client.0.smithi096.stderr: "legacy_tunables": 0, 2024-09-16T03:24:54.692 INFO:tasks.workunit.client.0.smithi096.stderr: "minimum_required_version": "jewel", 2024-09-16T03:24:54.692 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables": 1, 2024-09-16T03:24:54.692 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables2": 1, 2024-09-16T03:24:54.692 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v2_rules": 0, 2024-09-16T03:24:54.692 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables3": 1, 2024-09-16T03:24:54.692 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v3_rules": 0, 2024-09-16T03:24:54.692 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v4_buckets": 1, 2024-09-16T03:24:54.692 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables5": 1, 2024-09-16T03:24:54.692 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v5_rules": 0, 2024-09-16T03:24:54.692 INFO:tasks.workunit.client.0.smithi096.stderr: "has_msr_rules": 0 2024-09-16T03:24:54.693 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.693 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_args": {} 2024-09-16T03:24:54.693 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.693 INFO:tasks.workunit.client.0.smithi096.stderr: "fsmap": { 2024-09-16T03:24:54.693 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 1, 2024-09-16T03:24:54.693 INFO:tasks.workunit.client.0.smithi096.stderr: "btime": "2024-09-16T03:22:46:882186+0000", 2024-09-16T03:24:54.693 INFO:tasks.workunit.client.0.smithi096.stderr: "default_fscid": -1, 2024-09-16T03:24:54.693 INFO:tasks.workunit.client.0.smithi096.stderr: "compat": { 2024-09-16T03:24:54.693 INFO:tasks.workunit.client.0.smithi096.stderr: "compat": {}, 2024-09-16T03:24:54.693 INFO:tasks.workunit.client.0.smithi096.stderr: "ro_compat": {}, 2024-09-16T03:24:54.694 INFO:tasks.workunit.client.0.smithi096.stderr: "incompat": { 2024-09-16T03:24:54.694 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_1": "base v0.20", 2024-09-16T03:24:54.694 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_2": "client writeable ranges", 2024-09-16T03:24:54.694 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_3": "default file layouts on dirs", 2024-09-16T03:24:54.694 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_4": "dir inode in separate object", 2024-09-16T03:24:54.694 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_5": "mds uses versioned encoding", 2024-09-16T03:24:54.694 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_6": "dirfrag is stored in omap", 2024-09-16T03:24:54.694 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_8": "no anchor table", 2024-09-16T03:24:54.694 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_9": "file layout v2", 2024-09-16T03:24:54.694 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_10": "snaprealm v2", 2024-09-16T03:24:54.694 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_11": "minor log segments", 2024-09-16T03:24:54.695 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_12": "quiesce subvolumes" 2024-09-16T03:24:54.695 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:54.695 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.695 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_flags": { 2024-09-16T03:24:54.695 INFO:tasks.workunit.client.0.smithi096.stderr: "enable_multiple": true, 2024-09-16T03:24:54.695 INFO:tasks.workunit.client.0.smithi096.stderr: "ever_enabled_multiple": true 2024-09-16T03:24:54.695 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.695 INFO:tasks.workunit.client.0.smithi096.stderr: "standbys": [], 2024-09-16T03:24:54.695 INFO:tasks.workunit.client.0.smithi096.stderr: "filesystems": [] 2024-09-16T03:24:54.695 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.695 INFO:tasks.workunit.client.0.smithi096.stderr: "mdsmap_first_committed": 1, 2024-09-16T03:24:54.695 INFO:tasks.workunit.client.0.smithi096.stderr: "mdsmap_last_committed": 1, 2024-09-16T03:24:54.696 INFO:tasks.workunit.client.0.smithi096.stderr: "auth": { 2024-09-16T03:24:54.696 INFO:tasks.workunit.client.0.smithi096.stderr: "first_committed": 1, 2024-09-16T03:24:54.696 INFO:tasks.workunit.client.0.smithi096.stderr: "last_committed": 5, 2024-09-16T03:24:54.696 INFO:tasks.workunit.client.0.smithi096.stderr: "num_secrets": 3 2024-09-16T03:24:54.696 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.696 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 64, 2024-09-16T03:24:54.696 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_active": 64, 2024-09-16T03:24:54.696 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_unknown": 0, 2024-09-16T03:24:54.696 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osd": 3, 2024-09-16T03:24:54.696 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_sum": { 2024-09-16T03:24:54.696 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:24:54.697 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:24:54.697 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:24:54.697 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:24:54.697 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:24:54.697 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:24:54.697 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:24:54.697 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:24:54.697 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:24:54.697 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:24:54.697 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:24:54.697 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:24:54.697 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:24:54.698 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:24:54.698 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:24:54.698 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:24:54.698 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:24:54.698 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:24:54.698 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:24:54.698 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:24:54.698 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:24:54.698 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:24:54.698 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:24:54.698 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:24:54.699 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:24:54.699 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:24:54.699 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:24:54.699 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:24:54.699 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:24:54.699 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:24:54.699 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:24:54.699 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:24:54.699 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:24:54.699 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:24:54.699 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:24:54.700 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:24:54.700 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:24:54.700 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:24:54.700 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:24:54.700 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:24:54.700 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:24:54.700 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.700 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:24:54.700 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:24:54.700 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:24:54.700 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:24:54.701 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:24:54.701 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:24:54.701 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:24:54.701 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:24:54.701 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:24:54.701 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:24:54.701 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:24:54.701 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.701 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:24:54.701 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:24:54.701 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 192, 2024-09-16T03:24:54.701 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 192, 2024-09-16T03:24:54.702 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 0 2024-09-16T03:24:54.702 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.702 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_sum": { 2024-09-16T03:24:54.702 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 0, 2024-09-16T03:24:54.702 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 0, 2024-09-16T03:24:54.702 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pgs": 192, 2024-09-16T03:24:54.702 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osds": 3, 2024-09-16T03:24:54.702 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_osds": 3, 2024-09-16T03:24:54.702 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_omap_osds": 3, 2024-09-16T03:24:54.702 INFO:tasks.workunit.client.0.smithi096.stderr: "kb": 314572800, 2024-09-16T03:24:54.702 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used": 81204, 2024-09-16T03:24:54.703 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_data": 672, 2024-09-16T03:24:54.703 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_omap": 4, 2024-09-16T03:24:54.703 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_meta": 80443, 2024-09-16T03:24:54.703 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_avail": 314491596, 2024-09-16T03:24:54.703 INFO:tasks.workunit.client.0.smithi096.stderr: "statfs": { 2024-09-16T03:24:54.703 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 322122547200, 2024-09-16T03:24:54.703 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 322039394304, 2024-09-16T03:24:54.703 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:24:54.703 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 688128, 2024-09-16T03:24:54.703 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 200481, 2024-09-16T03:24:54.703 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:24:54.704 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:24:54.704 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:24:54.704 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 4785, 2024-09-16T03:24:54.704 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 82373967 2024-09-16T03:24:54.704 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.704 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_peers": [], 2024-09-16T03:24:54.704 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_trim_queue_len": 0, 2024-09-16T03:24:54.704 INFO:tasks.workunit.client.0.smithi096.stderr: "num_snap_trimming": 0, 2024-09-16T03:24:54.704 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shards_repaired": 0, 2024-09-16T03:24:54.704 INFO:tasks.workunit.client.0.smithi096.stderr: "op_queue_age_hist": { 2024-09-16T03:24:54.704 INFO:tasks.workunit.client.0.smithi096.stderr: "histogram": [], 2024-09-16T03:24:54.704 INFO:tasks.workunit.client.0.smithi096.stderr: "upper_bound": 1 2024-09-16T03:24:54.705 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.705 INFO:tasks.workunit.client.0.smithi096.stderr: "perf_stat": { 2024-09-16T03:24:54.705 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ms": 624, 2024-09-16T03:24:54.705 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ms": 624, 2024-09-16T03:24:54.705 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ns": 624000000, 2024-09-16T03:24:54.705 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ns": 624000000 2024-09-16T03:24:54.705 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.705 INFO:tasks.workunit.client.0.smithi096.stderr: "alerts": [], 2024-09-16T03:24:54.705 INFO:tasks.workunit.client.0.smithi096.stderr: "network_ping_times": [] 2024-09-16T03:24:54.705 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.705 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_sum_by_class": { 2024-09-16T03:24:54.706 INFO:tasks.workunit.client.0.smithi096.stderr: "hdd": { 2024-09-16T03:24:54.706 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 0, 2024-09-16T03:24:54.706 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 0, 2024-09-16T03:24:54.706 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pgs": 192, 2024-09-16T03:24:54.706 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osds": 3, 2024-09-16T03:24:54.706 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_osds": 3, 2024-09-16T03:24:54.706 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_omap_osds": 3, 2024-09-16T03:24:54.706 INFO:tasks.workunit.client.0.smithi096.stderr: "kb": 314572800, 2024-09-16T03:24:54.706 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used": 81204, 2024-09-16T03:24:54.706 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_data": 672, 2024-09-16T03:24:54.706 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_omap": 4, 2024-09-16T03:24:54.707 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_meta": 80443, 2024-09-16T03:24:54.707 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_avail": 314491596, 2024-09-16T03:24:54.707 INFO:tasks.workunit.client.0.smithi096.stderr: "statfs": { 2024-09-16T03:24:54.707 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 322122547200, 2024-09-16T03:24:54.707 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 322039394304, 2024-09-16T03:24:54.707 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:24:54.707 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 688128, 2024-09-16T03:24:54.707 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 200481, 2024-09-16T03:24:54.707 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:24:54.707 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:24:54.707 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:24:54.708 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 4785, 2024-09-16T03:24:54.708 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 82373967 2024-09-16T03:24:54.708 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.708 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_peers": [], 2024-09-16T03:24:54.708 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_trim_queue_len": 0, 2024-09-16T03:24:54.708 INFO:tasks.workunit.client.0.smithi096.stderr: "num_snap_trimming": 0, 2024-09-16T03:24:54.708 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shards_repaired": 0, 2024-09-16T03:24:54.708 INFO:tasks.workunit.client.0.smithi096.stderr: "op_queue_age_hist": { 2024-09-16T03:24:54.708 INFO:tasks.workunit.client.0.smithi096.stderr: "histogram": [], 2024-09-16T03:24:54.708 INFO:tasks.workunit.client.0.smithi096.stderr: "upper_bound": 1 2024-09-16T03:24:54.708 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.708 INFO:tasks.workunit.client.0.smithi096.stderr: "perf_stat": { 2024-09-16T03:24:54.709 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ms": 624, 2024-09-16T03:24:54.709 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ms": 624, 2024-09-16T03:24:54.709 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ns": 624000000, 2024-09-16T03:24:54.709 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ns": 624000000 2024-09-16T03:24:54.709 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.709 INFO:tasks.workunit.client.0.smithi096.stderr: "alerts": [], 2024-09-16T03:24:54.709 INFO:tasks.workunit.client.0.smithi096.stderr: "network_ping_times": [] 2024-09-16T03:24:54.709 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:54.709 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.709 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_stats": [ 2024-09-16T03:24:54.709 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.710 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 2, 2024-09-16T03:24:54.710 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 32, 2024-09-16T03:24:54.710 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:24:54.710 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:24:54.710 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:24:54.710 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:24:54.710 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:24:54.710 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:24:54.710 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:24:54.710 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:24:54.710 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:24:54.710 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:24:54.711 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:24:54.711 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:24:54.711 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:24:54.711 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:24:54.711 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:24:54.711 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:24:54.711 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:24:54.711 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:24:54.711 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:24:54.711 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:24:54.712 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:24:54.712 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:24:54.712 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:24:54.712 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:24:54.712 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:24:54.712 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:24:54.712 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:24:54.712 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:24:54.712 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:24:54.712 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:24:54.712 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:24:54.712 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:24:54.712 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:24:54.713 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:24:54.713 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:24:54.713 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:24:54.713 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:24:54.713 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:24:54.713 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:24:54.713 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:24:54.713 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:24:54.713 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.713 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:24:54.713 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:24:54.714 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:24:54.714 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:24:54.714 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:24:54.714 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:24:54.714 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:24:54.714 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:24:54.714 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:24:54.714 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:24:54.714 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:24:54.714 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.714 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:24:54.714 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:24:54.715 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 96, 2024-09-16T03:24:54.715 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 96, 2024-09-16T03:24:54.715 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 3 2024-09-16T03:24:54.715 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.715 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.715 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 1, 2024-09-16T03:24:54.715 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 32, 2024-09-16T03:24:54.715 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:24:54.715 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:24:54.715 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:24:54.715 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:24:54.716 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:24:54.716 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:24:54.716 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:24:54.716 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:24:54.716 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:24:54.716 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:24:54.716 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:24:54.716 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:24:54.716 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:24:54.716 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:24:54.716 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:24:54.716 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:24:54.717 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:24:54.717 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:24:54.717 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:24:54.717 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:24:54.717 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:24:54.717 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:24:54.717 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:24:54.717 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:24:54.717 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:24:54.717 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:24:54.717 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:24:54.717 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:24:54.718 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:24:54.718 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:24:54.718 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:24:54.718 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:24:54.718 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:24:54.718 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:24:54.718 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:24:54.718 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:24:54.718 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:24:54.718 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:24:54.718 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:24:54.718 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:24:54.719 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:24:54.719 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.719 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:24:54.719 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:24:54.719 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:24:54.719 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:24:54.719 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:24:54.719 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:24:54.719 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:24:54.719 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:24:54.719 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:24:54.720 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:24:54.720 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:24:54.720 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.720 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:24:54.720 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:24:54.720 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 96, 2024-09-16T03:24:54.720 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 96, 2024-09-16T03:24:54.720 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 3 2024-09-16T03:24:54.720 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:54.720 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:54.720 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_stats": [ 2024-09-16T03:24:54.720 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.721 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:24:54.721 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 21474836505 2024-09-16T03:24:54.721 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.721 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.721 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:24:54.721 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 42949672976 2024-09-16T03:24:54.721 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.721 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.721 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:24:54.721 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 64424509449 2024-09-16T03:24:54.721 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:54.721 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:54.722 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_by_state": [ 2024-09-16T03:24:54.722 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.722 INFO:tasks.workunit.client.0.smithi096.stderr: "state": "active+clean", 2024-09-16T03:24:54.722 INFO:tasks.workunit.client.0.smithi096.stderr: "num": 64 2024-09-16T03:24:54.722 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:54.722 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:54.722 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_by_osd": [ 2024-09-16T03:24:54.722 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.722 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:24:54.722 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 15, 2024-09-16T03:24:54.722 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 64, 2024-09-16T03:24:54.722 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:24:54.723 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.723 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.723 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:24:54.723 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 20, 2024-09-16T03:24:54.723 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 64, 2024-09-16T03:24:54.723 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:24:54.723 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.723 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.723 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:24:54.723 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 29, 2024-09-16T03:24:54.723 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 64, 2024-09-16T03:24:54.723 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:24:54.724 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:54.724 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:54.724 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": [ 2024-09-16T03:24:54.724 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.724 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 1, 2024-09-16T03:24:54.724 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": {} 2024-09-16T03:24:54.724 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.724 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:54.724 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 2, 2024-09-16T03:24:54.724 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": {} 2024-09-16T03:24:54.724 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:54.724 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:54.725 INFO:tasks.workunit.client.0.smithi096.stderr: "servicemap": { 2024-09-16T03:24:54.725 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 3, 2024-09-16T03:24:54.725 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:24:24.403052+0000", 2024-09-16T03:24:54.725 INFO:tasks.workunit.client.0.smithi096.stderr: "services": { 2024-09-16T03:24:54.725 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": { 2024-09-16T03:24:54.725 INFO:tasks.workunit.client.0.smithi096.stderr: "daemons": { 2024-09-16T03:24:54.725 INFO:tasks.workunit.client.0.smithi096.stderr: "summary": "", 2024-09-16T03:24:54.725 INFO:tasks.workunit.client.0.smithi096.stderr: "1": { 2024-09-16T03:24:54.725 INFO:tasks.workunit.client.0.smithi096.stderr: "start_epoch": 0, 2024-09-16T03:24:54.725 INFO:tasks.workunit.client.0.smithi096.stderr: "start_stamp": "0.000000", 2024-09-16T03:24:54.725 INFO:tasks.workunit.client.0.smithi096.stderr: "gid": 0, 2024-09-16T03:24:54.725 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "(unrecognized address family 0)/0", 2024-09-16T03:24:54.725 INFO:tasks.workunit.client.0.smithi096.stderr: "metadata": {}, 2024-09-16T03:24:54.726 INFO:tasks.workunit.client.0.smithi096.stderr: "task_status": {} 2024-09-16T03:24:54.726 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:54.726 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:54.726 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:54.726 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:54.726 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:54.726 INFO:tasks.workunit.client.0.smithi096.stderr: "mgrstat_first_committed": 47, 2024-09-16T03:24:54.726 INFO:tasks.workunit.client.0.smithi096.stderr: "mgrstat_last_committed": 53, 2024-09-16T03:24:54.726 INFO:tasks.workunit.client.0.smithi096.stderr: "logm_first_committed": 1, 2024-09-16T03:24:54.726 INFO:tasks.workunit.client.0.smithi096.stderr: "logm_last_committed": 233, 2024-09-16T03:24:54.726 INFO:tasks.workunit.client.0.smithi096.stderr: "paxos": { 2024-09-16T03:24:54.727 INFO:tasks.workunit.client.0.smithi096.stderr: "first_committed": 1, 2024-09-16T03:24:54.727 INFO:tasks.workunit.client.0.smithi096.stderr: "last_committed": 322, 2024-09-16T03:24:54.727 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pn": 0, 2024-09-16T03:24:54.727 INFO:tasks.workunit.client.0.smithi096.stderr: "accepted_pn": 0 2024-09-16T03:24:54.727 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:54.727 INFO:tasks.workunit.client.0.smithi096.stderr:}' 2024-09-16T03:24:54.730 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:132: get_fc_lc_diff: jq .osdmap_first_committed 2024-09-16T03:24:54.730 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:132: get_fc_lc_diff: echo '{' '"cluster_fingerprint":' '"fda2fc64-07ed-4add-8224-2e527e11d427",' '"version":' '"19.3.0-4930-gfc3e0bff",' '"commit":' '"fc3e0bff7468fd55478adbae7f75508b749124b6",' '"timestamp":' '"2024-09-16T03:24:54.604102+0000",' '"tag":' '"",' '"health":' '{' '"status":' '"HEALTH_OK",' '"checks":' '{},' '"mutes":' '[]' '},' '"monmap_first_committed":' 1, '"monmap_last_committed":' 1, '"monmap":' '{' '"epoch":' 1, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"modified":' '"2024-09-16T03:22:45.872880Z",' '"created":' '"2024-09-16T03:22:45.872880Z",' '"min_mon_release":' 19, '"min_mon_release_name":' '"squid",' '"election_strategy":' 1, '"disallowed_leaders:' '":' '"",' '"stretch_mode":' false, '"tiebreaker_mon":' '"",' '"removed_ranks:' '":' '"",' '"features":' '{' '"persistent":' '[' '"kraken",' '"luminous",' '"mimic",' '"osdmap-prune",' '"nautilus",' '"octopus",' '"pacific",' '"elector-pinging",' '"quincy",' '"reef",' '"squid"' '],' '"optional":' '[]' '},' '"mons":' '[' '{' '"rank":' 0, '"name":' '"a",' '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:7302",' '"nonce":' 0 '}' ']' '},' '"addr":' '"127.0.0.1:7302/0",' '"public_addr":' '"127.0.0.1:7302/0",' '"priority":' 0, '"weight":' 0, '"crush_location":' '"{}"' '}' ']' '},' '"quorum":' '[' 0 '],' '"osdmap":' '{' '"epoch":' 28, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"created":' '"2024-09-16T03:22:46.906117+0000",' '"modified":' '"2024-09-16T03:24:50.642444+0000",' '"last_up_change":' '"2024-09-16T03:24:37.708512+0000",' '"last_in_change":' '"2024-09-16T03:24:01.831039+0000",' '"flags":' '"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit",' '"flags_num":' 5799936, '"flags_set":' '[' '"pglog_hardlimit",' '"purged_snapdirs",' '"recovery_deletes",' '"sortbitwise"' '],' '"crush_version":' 7, '"full_ratio":' 0.97000002861022949, '"backfillfull_ratio":' 0.97000002861022949, '"nearfull_ratio":' 0.85000002384185791, '"cluster_snapshot":' '"",' '"pool_max":' 2, '"max_osd":' 3, '"require_min_compat_client":' '"luminous",' '"min_compat_client":' '"jewel",' '"require_osd_release":' '"squid",' '"allow_crimson":' false, '"pools":' '[' '{' '"pool":' 1, '"pool_name":' '"foo",' '"create_time":' '"2024-09-16T03:24:44.525189+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"21",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.690000057220459, '"score_stable":' 1.690000057220459, '"optimal_score":' 1, '"raw_score_acting":' 1.690000057220459, '"raw_score_stable":' 1.690000057220459, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '},' '{' '"pool":' 2, '"pool_name":' '"bar",' '"create_time":' '"2024-09-16T03:24:46.226575+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"24",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.1299999952316284, '"score_stable":' 1.1299999952316284, '"optimal_score":' 1, '"raw_score_acting":' 1.1299999952316284, '"raw_score_stable":' 1.1299999952316284, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '}' '],' '"osds":' '[' '{' '"osd":' 0, '"uuid":' '"64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 5, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6802",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6803",' '"nonce":' 3375787448 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6804",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6805",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6808",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6809",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6806",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6807",' '"nonce":' 3375787448 '}' ']' '},' '"public_addr":' '"127.0.0.1:6803/3375787448",' '"cluster_addr":' '"127.0.0.1:6805/3375787448",' '"heartbeat_back_addr":' '"127.0.0.1:6809/3375787448",' '"heartbeat_front_addr":' '"127.0.0.1:6807/3375787448",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 1, '"uuid":' '"74b26727-75c9-444d-8782-719e4197a382",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 10, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6810",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6811",' '"nonce":' 3733255132 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6812",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6813",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6816",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6817",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6814",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6815",' '"nonce":' 3733255132 '}' ']' '},' '"public_addr":' '"127.0.0.1:6811/3733255132",' '"cluster_addr":' '"127.0.0.1:6813/3733255132",' '"heartbeat_back_addr":' '"127.0.0.1:6817/3733255132",' '"heartbeat_front_addr":' '"127.0.0.1:6815/3733255132",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 2, '"uuid":' '"143da3a7-dad9-4b1e-966b-76cf5bdd3c82",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 15, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6818",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6819",' '"nonce":' 963814857 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6820",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6821",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6824",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6825",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6822",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6823",' '"nonce":' 963814857 '}' ']' '},' '"public_addr":' '"127.0.0.1:6819/963814857",' '"cluster_addr":' '"127.0.0.1:6821/963814857",' '"heartbeat_back_addr":' '"127.0.0.1:6825/963814857",' '"heartbeat_front_addr":' '"127.0.0.1:6823/963814857",' '"state":' '[' '"exists",' '"up"' ']' '}' '],' '"osd_xinfo":' '[' '{' '"osd":' 0, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:22.481942+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 1, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:59.663703+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 2, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:24:37.320822+0000",' '"dead_epoch":' 0 '}' '],' '"pg_upmap":' '[],' '"pg_upmap_items":' '[],' '"pg_upmap_primaries":' '[],' '"pg_temp":' '[],' '"primary_temp":' '[],' '"blocklist":' '{},' '"range_blocklist":' '{},' '"erasure_code_profiles":' '{' '"default":' '{' '"k":' '"2",' '"m":' '"2",' '"plugin":' '"jerasure",' '"technique":' '"reed_sol_van"' '}' '},' '"removed_snaps_queue":' '[],' '"new_removed_snaps":' '[],' '"new_purged_snaps":' '[],' '"crush_node_flags":' '{},' '"device_class_flags":' '{},' '"stretch_mode":' '{' '"stretch_mode_enabled":' false, '"stretch_bucket_count":' 0, '"degraded_stretch_mode":' 0, '"recovering_stretch_mode":' 0, '"stretch_mode_bucket":' 0 '}' '},' '"osd_metadata":' '[' '{' '"id":' 0, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/0/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:22:53.662571Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]",' '"hb_front_addr":' '"[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/0",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 1, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/1/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:23:30.129885Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]",' '"hb_front_addr":' '"[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/1",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 2, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/2/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:24:07.764502Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]",' '"hb_front_addr":' '"[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/2",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '}' '],' '"osdmap_clean_epochs":' '{' '"min_last_epoch_clean":' 0, '"last_epoch_clean":' '{' '"per_pool":' '[' '{' '"poolid":' 1, '"floor":' 23 '},' '{' '"poolid":' 2, '"floor":' 23 '}' ']' '},' '"osd_epochs":' '[' '{' '"id":' 0, '"epoch":' 16 '},' '{' '"id":' 1, '"epoch":' 16 '},' '{' '"id":' 2, '"epoch":' 23 '}' ']' '},' '"osdmap_first_committed":' 1, '"osdmap_last_committed":' 28, '"crushmap":' '{' '"devices":' '[' '{' '"id":' 0, '"name":' '"osd.0",' '"class":' '"hdd"' '},' '{' '"id":' 1, '"name":' '"osd.1",' '"class":' '"hdd"' '},' '{' '"id":' 2, '"name":' '"osd.2",' '"class":' '"hdd"' '}' '],' '"types":' '[' '{' '"type_id":' 0, '"name":' '"osd"' '},' '{' '"type_id":' 1, '"name":' '"host"' '},' '{' '"type_id":' 2, '"name":' '"chassis"' '},' '{' '"type_id":' 3, '"name":' '"rack"' '},' '{' '"type_id":' 4, '"name":' '"row"' '},' '{' '"type_id":' 5, '"name":' '"pdu"' '},' '{' '"type_id":' 6, '"name":' '"pod"' '},' '{' '"type_id":' 7, '"name":' '"room"' '},' '{' '"type_id":' 8, '"name":' '"datacenter"' '},' '{' '"type_id":' 9, '"name":' '"zone"' '},' '{' '"type_id":' 10, '"name":' '"region"' '},' '{' '"type_id":' 11, '"name":' '"root"' '}' '],' '"buckets":' '[' '{' '"id":' -1, '"name":' '"default",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -3, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -2, '"name":' '"default~hdd",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -4, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -3, '"name":' '"smithi096",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '},' '{' '"id":' -4, '"name":' '"smithi096~hdd",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '}' '],' '"rules":' '[' '{' '"rule_id":' 0, '"rule_name":' '"replicated_rule",' '"type":' 1, '"steps":' '[' '{' '"op":' '"take",' '"item":' -1, '"item_name":' '"default"' '},' '{' '"op":' '"choose_firstn",' '"num":' 0, '"type":' '"osd"' '},' '{' '"op":' '"emit"' '}' ']' '}' '],' '"tunables":' '{' '"choose_local_tries":' 0, '"choose_local_fallback_tries":' 0, '"choose_total_tries":' 50, '"chooseleaf_descend_once":' 1, '"chooseleaf_vary_r":' 1, '"chooseleaf_stable":' 1, '"msr_descents":' 100, '"msr_collision_tries":' 100, '"straw_calc_version":' 1, '"allowed_bucket_algs":' 54, '"profile":' '"jewel",' '"optimal_tunables":' 1, '"legacy_tunables":' 0, '"minimum_required_version":' '"jewel",' '"require_feature_tunables":' 1, '"require_feature_tunables2":' 1, '"has_v2_rules":' 0, '"require_feature_tunables3":' 1, '"has_v3_rules":' 0, '"has_v4_buckets":' 1, '"require_feature_tunables5":' 1, '"has_v5_rules":' 0, '"has_msr_rules":' 0 '},' '"choose_args":' '{}' '},' '"fsmap":' '{' '"epoch":' 1, '"btime":' '"2024-09-16T03:22:46:882186+0000",' '"default_fscid":' -1, '"compat":' '{' '"compat":' '{},' '"ro_compat":' '{},' '"incompat":' '{' '"feature_1":' '"base' 'v0.20",' '"feature_2":' '"client' writeable 'ranges",' '"feature_3":' '"default' file layouts on 'dirs",' '"feature_4":' '"dir' inode in separate 'object",' '"feature_5":' '"mds' uses versioned 'encoding",' '"feature_6":' '"dirfrag' is stored in 'omap",' '"feature_8":' '"no' anchor 'table",' '"feature_9":' '"file' layout 'v2",' '"feature_10":' '"snaprealm' 'v2",' '"feature_11":' '"minor' log 'segments",' '"feature_12":' '"quiesce' 'subvolumes"' '}' '},' '"feature_flags":' '{' '"enable_multiple":' true, '"ever_enabled_multiple":' true '},' '"standbys":' '[],' '"filesystems":' '[]' '},' '"mdsmap_first_committed":' 1, '"mdsmap_last_committed":' 1, '"auth":' '{' '"first_committed":' 1, '"last_committed":' 5, '"num_secrets":' 3 '},' '"num_pg":' 64, '"num_pg_active":' 64, '"num_pg_unknown":' 0, '"num_osd":' 3, '"pool_sum":' '{' '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 192, '"acting":' 192, '"num_store_stats":' 0 '},' '"osd_sum":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 192, '"num_osds":' 3, '"num_per_pool_osds":' 3, '"num_per_pool_omap_osds":' 3, '"kb":' 314572800, '"kb_used":' 81204, '"kb_used_data":' 672, '"kb_used_omap":' 4, '"kb_used_meta":' 80443, '"kb_avail":' 314491596, '"statfs":' '{' '"total":' 322122547200, '"available":' 322039394304, '"internally_reserved":' 0, '"allocated":' 688128, '"data_stored":' 200481, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 4785, '"internal_metadata":' 82373967 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 624, '"apply_latency_ms":' 624, '"commit_latency_ns":' 624000000, '"apply_latency_ns":' 624000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '},' '"osd_sum_by_class":' '{' '"hdd":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 192, '"num_osds":' 3, '"num_per_pool_osds":' 3, '"num_per_pool_omap_osds":' 3, '"kb":' 314572800, '"kb_used":' 81204, '"kb_used_data":' 672, '"kb_used_omap":' 4, '"kb_used_meta":' 80443, '"kb_avail":' 314491596, '"statfs":' '{' '"total":' 322122547200, '"available":' 322039394304, '"internally_reserved":' 0, '"allocated":' 688128, '"data_stored":' 200481, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 4785, '"internal_metadata":' 82373967 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 624, '"apply_latency_ms":' 624, '"commit_latency_ns":' 624000000, '"apply_latency_ns":' 624000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '}' '},' '"pool_stats":' '[' '{' '"poolid":' 2, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 96, '"acting":' 96, '"num_store_stats":' 3 '},' '{' '"poolid":' 1, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 96, '"acting":' 96, '"num_store_stats":' 3 '}' '],' '"osd_stats":' '[' '{' '"osd":' 0, '"seq":' 21474836505 '},' '{' '"osd":' 1, '"seq":' 42949672976 '},' '{' '"osd":' 2, '"seq":' 64424509449 '}' '],' '"num_pg_by_state":' '[' '{' '"state":' '"active+clean",' '"num":' 64 '}' '],' '"num_pg_by_osd":' '[' '{' '"osd":' 2, '"num_primary_pg":' 15, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 0, '"num_primary_pg":' 20, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 1, '"num_primary_pg":' 29, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '}' '],' '"purged_snaps":' '[' '{' '"pool":' 1, '"purged_snaps":' '{}' '},' '{' '"pool":' 2, '"purged_snaps":' '{}' '}' '],' '"servicemap":' '{' '"epoch":' 3, '"modified":' '"2024-09-16T03:24:24.403052+0000",' '"services":' '{' '"osd":' '{' '"daemons":' '{' '"summary":' '"",' '"1":' '{' '"start_epoch":' 0, '"start_stamp":' '"0.000000",' '"gid":' 0, '"addr":' '"(unrecognized' address family '0)/0",' '"metadata":' '{},' '"task_status":' '{}' '}' '}' '}' '}' '},' '"mgrstat_first_committed":' 47, '"mgrstat_last_committed":' 53, '"logm_first_committed":' 1, '"logm_last_committed":' 233, '"paxos":' '{' '"first_committed":' 1, '"last_committed":' 322, '"last_pn":' 0, '"accepted_pn":' 0 '}' '}' 2024-09-16T03:24:54.731 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:132: get_fc_lc_diff: osdm_fc=1 2024-09-16T03:24:54.731 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:134: get_fc_lc_diff: jq .osdmap_last_committed 2024-09-16T03:24:54.731 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:134: get_fc_lc_diff: echo '{' '"cluster_fingerprint":' '"fda2fc64-07ed-4add-8224-2e527e11d427",' '"version":' '"19.3.0-4930-gfc3e0bff",' '"commit":' '"fc3e0bff7468fd55478adbae7f75508b749124b6",' '"timestamp":' '"2024-09-16T03:24:54.604102+0000",' '"tag":' '"",' '"health":' '{' '"status":' '"HEALTH_OK",' '"checks":' '{},' '"mutes":' '[]' '},' '"monmap_first_committed":' 1, '"monmap_last_committed":' 1, '"monmap":' '{' '"epoch":' 1, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"modified":' '"2024-09-16T03:22:45.872880Z",' '"created":' '"2024-09-16T03:22:45.872880Z",' '"min_mon_release":' 19, '"min_mon_release_name":' '"squid",' '"election_strategy":' 1, '"disallowed_leaders:' '":' '"",' '"stretch_mode":' false, '"tiebreaker_mon":' '"",' '"removed_ranks:' '":' '"",' '"features":' '{' '"persistent":' '[' '"kraken",' '"luminous",' '"mimic",' '"osdmap-prune",' '"nautilus",' '"octopus",' '"pacific",' '"elector-pinging",' '"quincy",' '"reef",' '"squid"' '],' '"optional":' '[]' '},' '"mons":' '[' '{' '"rank":' 0, '"name":' '"a",' '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:7302",' '"nonce":' 0 '}' ']' '},' '"addr":' '"127.0.0.1:7302/0",' '"public_addr":' '"127.0.0.1:7302/0",' '"priority":' 0, '"weight":' 0, '"crush_location":' '"{}"' '}' ']' '},' '"quorum":' '[' 0 '],' '"osdmap":' '{' '"epoch":' 28, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"created":' '"2024-09-16T03:22:46.906117+0000",' '"modified":' '"2024-09-16T03:24:50.642444+0000",' '"last_up_change":' '"2024-09-16T03:24:37.708512+0000",' '"last_in_change":' '"2024-09-16T03:24:01.831039+0000",' '"flags":' '"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit",' '"flags_num":' 5799936, '"flags_set":' '[' '"pglog_hardlimit",' '"purged_snapdirs",' '"recovery_deletes",' '"sortbitwise"' '],' '"crush_version":' 7, '"full_ratio":' 0.97000002861022949, '"backfillfull_ratio":' 0.97000002861022949, '"nearfull_ratio":' 0.85000002384185791, '"cluster_snapshot":' '"",' '"pool_max":' 2, '"max_osd":' 3, '"require_min_compat_client":' '"luminous",' '"min_compat_client":' '"jewel",' '"require_osd_release":' '"squid",' '"allow_crimson":' false, '"pools":' '[' '{' '"pool":' 1, '"pool_name":' '"foo",' '"create_time":' '"2024-09-16T03:24:44.525189+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"21",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.690000057220459, '"score_stable":' 1.690000057220459, '"optimal_score":' 1, '"raw_score_acting":' 1.690000057220459, '"raw_score_stable":' 1.690000057220459, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '},' '{' '"pool":' 2, '"pool_name":' '"bar",' '"create_time":' '"2024-09-16T03:24:46.226575+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"24",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.1299999952316284, '"score_stable":' 1.1299999952316284, '"optimal_score":' 1, '"raw_score_acting":' 1.1299999952316284, '"raw_score_stable":' 1.1299999952316284, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '}' '],' '"osds":' '[' '{' '"osd":' 0, '"uuid":' '"64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 5, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6802",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6803",' '"nonce":' 3375787448 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6804",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6805",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6808",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6809",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6806",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6807",' '"nonce":' 3375787448 '}' ']' '},' '"public_addr":' '"127.0.0.1:6803/3375787448",' '"cluster_addr":' '"127.0.0.1:6805/3375787448",' '"heartbeat_back_addr":' '"127.0.0.1:6809/3375787448",' '"heartbeat_front_addr":' '"127.0.0.1:6807/3375787448",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 1, '"uuid":' '"74b26727-75c9-444d-8782-719e4197a382",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 10, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6810",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6811",' '"nonce":' 3733255132 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6812",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6813",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6816",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6817",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6814",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6815",' '"nonce":' 3733255132 '}' ']' '},' '"public_addr":' '"127.0.0.1:6811/3733255132",' '"cluster_addr":' '"127.0.0.1:6813/3733255132",' '"heartbeat_back_addr":' '"127.0.0.1:6817/3733255132",' '"heartbeat_front_addr":' '"127.0.0.1:6815/3733255132",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 2, '"uuid":' '"143da3a7-dad9-4b1e-966b-76cf5bdd3c82",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 15, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6818",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6819",' '"nonce":' 963814857 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6820",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6821",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6824",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6825",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6822",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6823",' '"nonce":' 963814857 '}' ']' '},' '"public_addr":' '"127.0.0.1:6819/963814857",' '"cluster_addr":' '"127.0.0.1:6821/963814857",' '"heartbeat_back_addr":' '"127.0.0.1:6825/963814857",' '"heartbeat_front_addr":' '"127.0.0.1:6823/963814857",' '"state":' '[' '"exists",' '"up"' ']' '}' '],' '"osd_xinfo":' '[' '{' '"osd":' 0, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:22.481942+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 1, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:59.663703+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 2, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:24:37.320822+0000",' '"dead_epoch":' 0 '}' '],' '"pg_upmap":' '[],' '"pg_upmap_items":' '[],' '"pg_upmap_primaries":' '[],' '"pg_temp":' '[],' '"primary_temp":' '[],' '"blocklist":' '{},' '"range_blocklist":' '{},' '"erasure_code_profiles":' '{' '"default":' '{' '"k":' '"2",' '"m":' '"2",' '"plugin":' '"jerasure",' '"technique":' '"reed_sol_van"' '}' '},' '"removed_snaps_queue":' '[],' '"new_removed_snaps":' '[],' '"new_purged_snaps":' '[],' '"crush_node_flags":' '{},' '"device_class_flags":' '{},' '"stretch_mode":' '{' '"stretch_mode_enabled":' false, '"stretch_bucket_count":' 0, '"degraded_stretch_mode":' 0, '"recovering_stretch_mode":' 0, '"stretch_mode_bucket":' 0 '}' '},' '"osd_metadata":' '[' '{' '"id":' 0, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/0/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:22:53.662571Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]",' '"hb_front_addr":' '"[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/0",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 1, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/1/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:23:30.129885Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]",' '"hb_front_addr":' '"[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/1",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 2, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/2/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:24:07.764502Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]",' '"hb_front_addr":' '"[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/2",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '}' '],' '"osdmap_clean_epochs":' '{' '"min_last_epoch_clean":' 0, '"last_epoch_clean":' '{' '"per_pool":' '[' '{' '"poolid":' 1, '"floor":' 23 '},' '{' '"poolid":' 2, '"floor":' 23 '}' ']' '},' '"osd_epochs":' '[' '{' '"id":' 0, '"epoch":' 16 '},' '{' '"id":' 1, '"epoch":' 16 '},' '{' '"id":' 2, '"epoch":' 23 '}' ']' '},' '"osdmap_first_committed":' 1, '"osdmap_last_committed":' 28, '"crushmap":' '{' '"devices":' '[' '{' '"id":' 0, '"name":' '"osd.0",' '"class":' '"hdd"' '},' '{' '"id":' 1, '"name":' '"osd.1",' '"class":' '"hdd"' '},' '{' '"id":' 2, '"name":' '"osd.2",' '"class":' '"hdd"' '}' '],' '"types":' '[' '{' '"type_id":' 0, '"name":' '"osd"' '},' '{' '"type_id":' 1, '"name":' '"host"' '},' '{' '"type_id":' 2, '"name":' '"chassis"' '},' '{' '"type_id":' 3, '"name":' '"rack"' '},' '{' '"type_id":' 4, '"name":' '"row"' '},' '{' '"type_id":' 5, '"name":' '"pdu"' '},' '{' '"type_id":' 6, '"name":' '"pod"' '},' '{' '"type_id":' 7, '"name":' '"room"' '},' '{' '"type_id":' 8, '"name":' '"datacenter"' '},' '{' '"type_id":' 9, '"name":' '"zone"' '},' '{' '"type_id":' 10, '"name":' '"region"' '},' '{' '"type_id":' 11, '"name":' '"root"' '}' '],' '"buckets":' '[' '{' '"id":' -1, '"name":' '"default",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -3, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -2, '"name":' '"default~hdd",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -4, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -3, '"name":' '"smithi096",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '},' '{' '"id":' -4, '"name":' '"smithi096~hdd",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '}' '],' '"rules":' '[' '{' '"rule_id":' 0, '"rule_name":' '"replicated_rule",' '"type":' 1, '"steps":' '[' '{' '"op":' '"take",' '"item":' -1, '"item_name":' '"default"' '},' '{' '"op":' '"choose_firstn",' '"num":' 0, '"type":' '"osd"' '},' '{' '"op":' '"emit"' '}' ']' '}' '],' '"tunables":' '{' '"choose_local_tries":' 0, '"choose_local_fallback_tries":' 0, '"choose_total_tries":' 50, '"chooseleaf_descend_once":' 1, '"chooseleaf_vary_r":' 1, '"chooseleaf_stable":' 1, '"msr_descents":' 100, '"msr_collision_tries":' 100, '"straw_calc_version":' 1, '"allowed_bucket_algs":' 54, '"profile":' '"jewel",' '"optimal_tunables":' 1, '"legacy_tunables":' 0, '"minimum_required_version":' '"jewel",' '"require_feature_tunables":' 1, '"require_feature_tunables2":' 1, '"has_v2_rules":' 0, '"require_feature_tunables3":' 1, '"has_v3_rules":' 0, '"has_v4_buckets":' 1, '"require_feature_tunables5":' 1, '"has_v5_rules":' 0, '"has_msr_rules":' 0 '},' '"choose_args":' '{}' '},' '"fsmap":' '{' '"epoch":' 1, '"btime":' '"2024-09-16T03:22:46:882186+0000",' '"default_fscid":' -1, '"compat":' '{' '"compat":' '{},' '"ro_compat":' '{},' '"incompat":' '{' '"feature_1":' '"base' 'v0.20",' '"feature_2":' '"client' writeable 'ranges",' '"feature_3":' '"default' file layouts on 'dirs",' '"feature_4":' '"dir' inode in separate 'object",' '"feature_5":' '"mds' uses versioned 'encoding",' '"feature_6":' '"dirfrag' is stored in 'omap",' '"feature_8":' '"no' anchor 'table",' '"feature_9":' '"file' layout 'v2",' '"feature_10":' '"snaprealm' 'v2",' '"feature_11":' '"minor' log 'segments",' '"feature_12":' '"quiesce' 'subvolumes"' '}' '},' '"feature_flags":' '{' '"enable_multiple":' true, '"ever_enabled_multiple":' true '},' '"standbys":' '[],' '"filesystems":' '[]' '},' '"mdsmap_first_committed":' 1, '"mdsmap_last_committed":' 1, '"auth":' '{' '"first_committed":' 1, '"last_committed":' 5, '"num_secrets":' 3 '},' '"num_pg":' 64, '"num_pg_active":' 64, '"num_pg_unknown":' 0, '"num_osd":' 3, '"pool_sum":' '{' '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 192, '"acting":' 192, '"num_store_stats":' 0 '},' '"osd_sum":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 192, '"num_osds":' 3, '"num_per_pool_osds":' 3, '"num_per_pool_omap_osds":' 3, '"kb":' 314572800, '"kb_used":' 81204, '"kb_used_data":' 672, '"kb_used_omap":' 4, '"kb_used_meta":' 80443, '"kb_avail":' 314491596, '"statfs":' '{' '"total":' 322122547200, '"available":' 322039394304, '"internally_reserved":' 0, '"allocated":' 688128, '"data_stored":' 200481, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 4785, '"internal_metadata":' 82373967 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 624, '"apply_latency_ms":' 624, '"commit_latency_ns":' 624000000, '"apply_latency_ns":' 624000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '},' '"osd_sum_by_class":' '{' '"hdd":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 192, '"num_osds":' 3, '"num_per_pool_osds":' 3, '"num_per_pool_omap_osds":' 3, '"kb":' 314572800, '"kb_used":' 81204, '"kb_used_data":' 672, '"kb_used_omap":' 4, '"kb_used_meta":' 80443, '"kb_avail":' 314491596, '"statfs":' '{' '"total":' 322122547200, '"available":' 322039394304, '"internally_reserved":' 0, '"allocated":' 688128, '"data_stored":' 200481, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 4785, '"internal_metadata":' 82373967 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 624, '"apply_latency_ms":' 624, '"commit_latency_ns":' 624000000, '"apply_latency_ns":' 624000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '}' '},' '"pool_stats":' '[' '{' '"poolid":' 2, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 96, '"acting":' 96, '"num_store_stats":' 3 '},' '{' '"poolid":' 1, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 96, '"acting":' 96, '"num_store_stats":' 3 '}' '],' '"osd_stats":' '[' '{' '"osd":' 0, '"seq":' 21474836505 '},' '{' '"osd":' 1, '"seq":' 42949672976 '},' '{' '"osd":' 2, '"seq":' 64424509449 '}' '],' '"num_pg_by_state":' '[' '{' '"state":' '"active+clean",' '"num":' 64 '}' '],' '"num_pg_by_osd":' '[' '{' '"osd":' 2, '"num_primary_pg":' 15, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 0, '"num_primary_pg":' 20, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 1, '"num_primary_pg":' 29, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '}' '],' '"purged_snaps":' '[' '{' '"pool":' 1, '"purged_snaps":' '{}' '},' '{' '"pool":' 2, '"purged_snaps":' '{}' '}' '],' '"servicemap":' '{' '"epoch":' 3, '"modified":' '"2024-09-16T03:24:24.403052+0000",' '"services":' '{' '"osd":' '{' '"daemons":' '{' '"summary":' '"",' '"1":' '{' '"start_epoch":' 0, '"start_stamp":' '"0.000000",' '"gid":' 0, '"addr":' '"(unrecognized' address family '0)/0",' '"metadata":' '{},' '"task_status":' '{}' '}' '}' '}' '}' '},' '"mgrstat_first_committed":' 47, '"mgrstat_last_committed":' 53, '"logm_first_committed":' 1, '"logm_last_committed":' 233, '"paxos":' '{' '"first_committed":' 1, '"last_committed":' 322, '"last_pn":' 0, '"accepted_pn":' 0 '}' '}' 2024-09-16T03:24:54.731 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:134: get_fc_lc_diff: osdm_lc=28 2024-09-16T03:24:54.731 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:136: get_fc_lc_diff: echo 27 2024-09-16T03:24:54.731 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:161: wait_for_total_num_maps: [[ 27 -gt 2 ]] 2024-09-16T03:24:54.731 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:162: wait_for_total_num_maps: (( 2 >= 27 )) 2024-09-16T03:24:54.731 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:166: wait_for_total_num_maps: sleep 0.4 2024-09-16T03:24:55.087 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:167: wait_for_total_num_maps: loop+=1 2024-09-16T03:24:55.088 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:161: wait_for_total_num_maps: get_fc_lc_diff 2024-09-16T03:24:55.089 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:130: get_fc_lc_diff: ceph report 2024-09-16T03:24:55.622 INFO:tasks.workunit.client.0.smithi096.stderr:report 3559414892 2024-09-16T03:24:55.887 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:130: get_fc_lc_diff: report='{ 2024-09-16T03:24:55.887 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_fingerprint": "fda2fc64-07ed-4add-8224-2e527e11d427", 2024-09-16T03:24:55.887 INFO:tasks.workunit.client.0.smithi096.stderr: "version": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:24:55.887 INFO:tasks.workunit.client.0.smithi096.stderr: "commit": "fc3e0bff7468fd55478adbae7f75508b749124b6", 2024-09-16T03:24:55.887 INFO:tasks.workunit.client.0.smithi096.stderr: "timestamp": "2024-09-16T03:24:55.623612+0000", 2024-09-16T03:24:55.888 INFO:tasks.workunit.client.0.smithi096.stderr: "tag": "", 2024-09-16T03:24:55.888 INFO:tasks.workunit.client.0.smithi096.stderr: "health": { 2024-09-16T03:24:55.888 INFO:tasks.workunit.client.0.smithi096.stderr: "status": "HEALTH_OK", 2024-09-16T03:24:55.888 INFO:tasks.workunit.client.0.smithi096.stderr: "checks": {}, 2024-09-16T03:24:55.888 INFO:tasks.workunit.client.0.smithi096.stderr: "mutes": [] 2024-09-16T03:24:55.888 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:55.888 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap_first_committed": 1, 2024-09-16T03:24:55.889 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap_last_committed": 1, 2024-09-16T03:24:55.889 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap": { 2024-09-16T03:24:55.889 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 1, 2024-09-16T03:24:55.889 INFO:tasks.workunit.client.0.smithi096.stderr: "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", 2024-09-16T03:24:55.889 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:22:45.872880Z", 2024-09-16T03:24:55.889 INFO:tasks.workunit.client.0.smithi096.stderr: "created": "2024-09-16T03:22:45.872880Z", 2024-09-16T03:24:55.889 INFO:tasks.workunit.client.0.smithi096.stderr: "min_mon_release": 19, 2024-09-16T03:24:55.890 INFO:tasks.workunit.client.0.smithi096.stderr: "min_mon_release_name": "squid", 2024-09-16T03:24:55.890 INFO:tasks.workunit.client.0.smithi096.stderr: "election_strategy": 1, 2024-09-16T03:24:55.890 INFO:tasks.workunit.client.0.smithi096.stderr: "disallowed_leaders: ": "", 2024-09-16T03:24:55.890 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode": false, 2024-09-16T03:24:55.890 INFO:tasks.workunit.client.0.smithi096.stderr: "tiebreaker_mon": "", 2024-09-16T03:24:55.890 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_ranks: ": "", 2024-09-16T03:24:55.890 INFO:tasks.workunit.client.0.smithi096.stderr: "features": { 2024-09-16T03:24:55.891 INFO:tasks.workunit.client.0.smithi096.stderr: "persistent": [ 2024-09-16T03:24:55.891 INFO:tasks.workunit.client.0.smithi096.stderr: "kraken", 2024-09-16T03:24:55.891 INFO:tasks.workunit.client.0.smithi096.stderr: "luminous", 2024-09-16T03:24:55.891 INFO:tasks.workunit.client.0.smithi096.stderr: "mimic", 2024-09-16T03:24:55.891 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap-prune", 2024-09-16T03:24:55.891 INFO:tasks.workunit.client.0.smithi096.stderr: "nautilus", 2024-09-16T03:24:55.891 INFO:tasks.workunit.client.0.smithi096.stderr: "octopus", 2024-09-16T03:24:55.891 INFO:tasks.workunit.client.0.smithi096.stderr: "pacific", 2024-09-16T03:24:55.892 INFO:tasks.workunit.client.0.smithi096.stderr: "elector-pinging", 2024-09-16T03:24:55.892 INFO:tasks.workunit.client.0.smithi096.stderr: "quincy", 2024-09-16T03:24:55.892 INFO:tasks.workunit.client.0.smithi096.stderr: "reef", 2024-09-16T03:24:55.892 INFO:tasks.workunit.client.0.smithi096.stderr: "squid" 2024-09-16T03:24:55.892 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:55.892 INFO:tasks.workunit.client.0.smithi096.stderr: "optional": [] 2024-09-16T03:24:55.892 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:55.893 INFO:tasks.workunit.client.0.smithi096.stderr: "mons": [ 2024-09-16T03:24:55.893 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:55.893 INFO:tasks.workunit.client.0.smithi096.stderr: "rank": 0, 2024-09-16T03:24:55.893 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "a", 2024-09-16T03:24:55.893 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:24:55.893 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:55.893 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:55.894 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:55.894 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:7302", 2024-09-16T03:24:55.894 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 0 2024-09-16T03:24:55.894 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:55.894 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:55.894 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:55.894 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:7302/0", 2024-09-16T03:24:55.895 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:7302/0", 2024-09-16T03:24:55.895 INFO:tasks.workunit.client.0.smithi096.stderr: "priority": 0, 2024-09-16T03:24:55.895 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 0, 2024-09-16T03:24:55.895 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_location": "{}" 2024-09-16T03:24:55.895 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:55.895 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:55.895 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:55.896 INFO:tasks.workunit.client.0.smithi096.stderr: "quorum": [ 2024-09-16T03:24:55.896 INFO:tasks.workunit.client.0.smithi096.stderr: 0 2024-09-16T03:24:55.896 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:55.896 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap": { 2024-09-16T03:24:55.896 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 28, 2024-09-16T03:24:55.896 INFO:tasks.workunit.client.0.smithi096.stderr: "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", 2024-09-16T03:24:55.896 INFO:tasks.workunit.client.0.smithi096.stderr: "created": "2024-09-16T03:22:46.906117+0000", 2024-09-16T03:24:55.897 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:24:50.642444+0000", 2024-09-16T03:24:55.897 INFO:tasks.workunit.client.0.smithi096.stderr: "last_up_change": "2024-09-16T03:24:37.708512+0000", 2024-09-16T03:24:55.897 INFO:tasks.workunit.client.0.smithi096.stderr: "last_in_change": "2024-09-16T03:24:01.831039+0000", 2024-09-16T03:24:55.897 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-16T03:24:55.897 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_num": 5799936, 2024-09-16T03:24:55.897 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_set": [ 2024-09-16T03:24:55.897 INFO:tasks.workunit.client.0.smithi096.stderr: "pglog_hardlimit", 2024-09-16T03:24:55.897 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snapdirs", 2024-09-16T03:24:55.897 INFO:tasks.workunit.client.0.smithi096.stderr: "recovery_deletes", 2024-09-16T03:24:55.897 INFO:tasks.workunit.client.0.smithi096.stderr: "sortbitwise" 2024-09-16T03:24:55.898 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:55.898 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_version": 7, 2024-09-16T03:24:55.898 INFO:tasks.workunit.client.0.smithi096.stderr: "full_ratio": 0.97000002861022949, 2024-09-16T03:24:55.898 INFO:tasks.workunit.client.0.smithi096.stderr: "backfillfull_ratio": 0.97000002861022949, 2024-09-16T03:24:55.898 INFO:tasks.workunit.client.0.smithi096.stderr: "nearfull_ratio": 0.85000002384185791, 2024-09-16T03:24:55.898 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_snapshot": "", 2024-09-16T03:24:55.898 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_max": 2, 2024-09-16T03:24:55.898 INFO:tasks.workunit.client.0.smithi096.stderr: "max_osd": 3, 2024-09-16T03:24:55.898 INFO:tasks.workunit.client.0.smithi096.stderr: "require_min_compat_client": "luminous", 2024-09-16T03:24:55.898 INFO:tasks.workunit.client.0.smithi096.stderr: "min_compat_client": "jewel", 2024-09-16T03:24:55.898 INFO:tasks.workunit.client.0.smithi096.stderr: "require_osd_release": "squid", 2024-09-16T03:24:55.899 INFO:tasks.workunit.client.0.smithi096.stderr: "allow_crimson": false, 2024-09-16T03:24:55.899 INFO:tasks.workunit.client.0.smithi096.stderr: "pools": [ 2024-09-16T03:24:55.899 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:55.899 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 1, 2024-09-16T03:24:55.899 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_name": "foo", 2024-09-16T03:24:55.899 INFO:tasks.workunit.client.0.smithi096.stderr: "create_time": "2024-09-16T03:24:44.525189+0000", 2024-09-16T03:24:55.899 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": 1, 2024-09-16T03:24:55.899 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_names": "hashpspool", 2024-09-16T03:24:55.899 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:24:55.899 INFO:tasks.workunit.client.0.smithi096.stderr: "size": 3, 2024-09-16T03:24:55.899 INFO:tasks.workunit.client.0.smithi096.stderr: "min_size": 2, 2024-09-16T03:24:55.900 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_rule": 0, 2024-09-16T03:24:55.900 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_count": 0, 2024-09-16T03:24:55.900 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_target": 0, 2024-09-16T03:24:55.900 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_barrier": 0, 2024-09-16T03:24:55.900 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-16T03:24:55.900 INFO:tasks.workunit.client.0.smithi096.stderr: "is_stretch_pool": false, 2024-09-16T03:24:55.900 INFO:tasks.workunit.client.0.smithi096.stderr: "object_hash": 2, 2024-09-16T03:24:55.900 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_autoscale_mode": "off", 2024-09-16T03:24:55.900 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num": 32, 2024-09-16T03:24:55.900 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num": 32, 2024-09-16T03:24:55.900 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num_target": 32, 2024-09-16T03:24:55.901 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_target": 32, 2024-09-16T03:24:55.901 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_pending": 32, 2024-09-16T03:24:55.901 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pg_merge_meta": { 2024-09-16T03:24:55.901 INFO:tasks.workunit.client.0.smithi096.stderr: "source_pgid": "0.0", 2024-09-16T03:24:55.901 INFO:tasks.workunit.client.0.smithi096.stderr: "ready_epoch": 0, 2024-09-16T03:24:55.901 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_started": 0, 2024-09-16T03:24:55.901 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": 0, 2024-09-16T03:24:55.901 INFO:tasks.workunit.client.0.smithi096.stderr: "source_version": "0'\''0", 2024-09-16T03:24:55.901 INFO:tasks.workunit.client.0.smithi096.stderr: "target_version": "0'\''0" 2024-09-16T03:24:55.901 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:55.902 INFO:tasks.workunit.client.0.smithi096.stderr: "last_change": "21", 2024-09-16T03:24:55.902 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend": "0", 2024-09-16T03:24:55.902 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_prenautilus": "0", 2024-09-16T03:24:55.902 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_preluminous": "0", 2024-09-16T03:24:55.902 INFO:tasks.workunit.client.0.smithi096.stderr: "auid": 0, 2024-09-16T03:24:55.902 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_mode": "selfmanaged", 2024-09-16T03:24:55.902 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_seq": 0, 2024-09-16T03:24:55.902 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_epoch": 0, 2024-09-16T03:24:55.902 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_snaps": [], 2024-09-16T03:24:55.902 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps": "[]", 2024-09-16T03:24:55.903 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_bytes": 0, 2024-09-16T03:24:55.903 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_objects": 0, 2024-09-16T03:24:55.903 INFO:tasks.workunit.client.0.smithi096.stderr: "tiers": [], 2024-09-16T03:24:55.903 INFO:tasks.workunit.client.0.smithi096.stderr: "tier_of": -1, 2024-09-16T03:24:55.903 INFO:tasks.workunit.client.0.smithi096.stderr: "read_tier": -1, 2024-09-16T03:24:55.903 INFO:tasks.workunit.client.0.smithi096.stderr: "write_tier": -1, 2024-09-16T03:24:55.903 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_mode": "none", 2024-09-16T03:24:55.903 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_bytes": 0, 2024-09-16T03:24:55.903 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_objects": 0, 2024-09-16T03:24:55.903 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_ratio_micro": 400000, 2024-09-16T03:24:55.904 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-16T03:24:55.904 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_full_ratio_micro": 800000, 2024-09-16T03:24:55.904 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_flush_age": 0, 2024-09-16T03:24:55.904 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_evict_age": 0, 2024-09-16T03:24:55.904 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profile": "", 2024-09-16T03:24:55.904 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_params": { 2024-09-16T03:24:55.904 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "none" 2024-09-16T03:24:55.904 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:55.904 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_period": 0, 2024-09-16T03:24:55.904 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_count": 0, 2024-09-16T03:24:55.905 INFO:tasks.workunit.client.0.smithi096.stderr: "use_gmt_hitset": true, 2024-09-16T03:24:55.905 INFO:tasks.workunit.client.0.smithi096.stderr: "min_read_recency_for_promote": 0, 2024-09-16T03:24:55.905 INFO:tasks.workunit.client.0.smithi096.stderr: "min_write_recency_for_promote": 0, 2024-09-16T03:24:55.905 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_grade_decay_rate": 0, 2024-09-16T03:24:55.905 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_search_last_n": 0, 2024-09-16T03:24:55.905 INFO:tasks.workunit.client.0.smithi096.stderr: "grade_table": [], 2024-09-16T03:24:55.905 INFO:tasks.workunit.client.0.smithi096.stderr: "stripe_width": 0, 2024-09-16T03:24:55.905 INFO:tasks.workunit.client.0.smithi096.stderr: "expected_num_objects": 0, 2024-09-16T03:24:55.905 INFO:tasks.workunit.client.0.smithi096.stderr: "fast_read": false, 2024-09-16T03:24:55.905 INFO:tasks.workunit.client.0.smithi096.stderr: "options": {}, 2024-09-16T03:24:55.905 INFO:tasks.workunit.client.0.smithi096.stderr: "application_metadata": {}, 2024-09-16T03:24:55.906 INFO:tasks.workunit.client.0.smithi096.stderr: "read_balance": { 2024-09-16T03:24:55.906 INFO:tasks.workunit.client.0.smithi096.stderr: "score_type": "Fair distribution", 2024-09-16T03:24:55.906 INFO:tasks.workunit.client.0.smithi096.stderr: "score_acting": 1.690000057220459, 2024-09-16T03:24:55.906 INFO:tasks.workunit.client.0.smithi096.stderr: "score_stable": 1.690000057220459, 2024-09-16T03:24:55.906 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_score": 1, 2024-09-16T03:24:55.906 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_acting": 1.690000057220459, 2024-09-16T03:24:55.906 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_stable": 1.690000057220459, 2024-09-16T03:24:55.906 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity_weighted": 1, 2024-09-16T03:24:55.906 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity": 1, 2024-09-16T03:24:55.907 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity_weighted": 1 2024-09-16T03:24:55.907 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:55.907 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:55.907 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:55.907 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 2, 2024-09-16T03:24:55.907 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_name": "bar", 2024-09-16T03:24:55.907 INFO:tasks.workunit.client.0.smithi096.stderr: "create_time": "2024-09-16T03:24:46.226575+0000", 2024-09-16T03:24:55.907 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": 1, 2024-09-16T03:24:55.908 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_names": "hashpspool", 2024-09-16T03:24:55.908 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:24:55.908 INFO:tasks.workunit.client.0.smithi096.stderr: "size": 3, 2024-09-16T03:24:55.908 INFO:tasks.workunit.client.0.smithi096.stderr: "min_size": 2, 2024-09-16T03:24:55.908 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_rule": 0, 2024-09-16T03:24:55.908 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_count": 0, 2024-09-16T03:24:55.908 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_target": 0, 2024-09-16T03:24:55.908 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_barrier": 0, 2024-09-16T03:24:55.908 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-16T03:24:55.909 INFO:tasks.workunit.client.0.smithi096.stderr: "is_stretch_pool": false, 2024-09-16T03:24:55.909 INFO:tasks.workunit.client.0.smithi096.stderr: "object_hash": 2, 2024-09-16T03:24:55.909 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_autoscale_mode": "off", 2024-09-16T03:24:55.909 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num": 32, 2024-09-16T03:24:55.909 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num": 32, 2024-09-16T03:24:55.909 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num_target": 32, 2024-09-16T03:24:55.909 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_target": 32, 2024-09-16T03:24:55.910 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_pending": 32, 2024-09-16T03:24:55.910 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pg_merge_meta": { 2024-09-16T03:24:55.910 INFO:tasks.workunit.client.0.smithi096.stderr: "source_pgid": "0.0", 2024-09-16T03:24:55.910 INFO:tasks.workunit.client.0.smithi096.stderr: "ready_epoch": 0, 2024-09-16T03:24:55.910 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_started": 0, 2024-09-16T03:24:55.910 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": 0, 2024-09-16T03:24:55.910 INFO:tasks.workunit.client.0.smithi096.stderr: "source_version": "0'\''0", 2024-09-16T03:24:55.911 INFO:tasks.workunit.client.0.smithi096.stderr: "target_version": "0'\''0" 2024-09-16T03:24:55.911 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:55.911 INFO:tasks.workunit.client.0.smithi096.stderr: "last_change": "24", 2024-09-16T03:24:55.911 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend": "0", 2024-09-16T03:24:55.911 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_prenautilus": "0", 2024-09-16T03:24:55.911 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_preluminous": "0", 2024-09-16T03:24:55.911 INFO:tasks.workunit.client.0.smithi096.stderr: "auid": 0, 2024-09-16T03:24:55.912 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_mode": "selfmanaged", 2024-09-16T03:24:55.912 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_seq": 0, 2024-09-16T03:24:55.912 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_epoch": 0, 2024-09-16T03:24:55.912 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_snaps": [], 2024-09-16T03:24:55.912 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps": "[]", 2024-09-16T03:24:55.912 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_bytes": 0, 2024-09-16T03:24:55.912 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_objects": 0, 2024-09-16T03:24:55.913 INFO:tasks.workunit.client.0.smithi096.stderr: "tiers": [], 2024-09-16T03:24:55.913 INFO:tasks.workunit.client.0.smithi096.stderr: "tier_of": -1, 2024-09-16T03:24:55.913 INFO:tasks.workunit.client.0.smithi096.stderr: "read_tier": -1, 2024-09-16T03:24:55.913 INFO:tasks.workunit.client.0.smithi096.stderr: "write_tier": -1, 2024-09-16T03:24:55.913 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_mode": "none", 2024-09-16T03:24:55.913 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_bytes": 0, 2024-09-16T03:24:55.913 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_objects": 0, 2024-09-16T03:24:55.913 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_ratio_micro": 400000, 2024-09-16T03:24:55.913 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-16T03:24:55.914 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_full_ratio_micro": 800000, 2024-09-16T03:24:55.914 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_flush_age": 0, 2024-09-16T03:24:55.914 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_evict_age": 0, 2024-09-16T03:24:55.914 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profile": "", 2024-09-16T03:24:55.914 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_params": { 2024-09-16T03:24:55.914 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "none" 2024-09-16T03:24:55.914 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:55.914 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_period": 0, 2024-09-16T03:24:55.914 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_count": 0, 2024-09-16T03:24:55.915 INFO:tasks.workunit.client.0.smithi096.stderr: "use_gmt_hitset": true, 2024-09-16T03:24:55.915 INFO:tasks.workunit.client.0.smithi096.stderr: "min_read_recency_for_promote": 0, 2024-09-16T03:24:55.915 INFO:tasks.workunit.client.0.smithi096.stderr: "min_write_recency_for_promote": 0, 2024-09-16T03:24:55.915 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_grade_decay_rate": 0, 2024-09-16T03:24:55.915 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_search_last_n": 0, 2024-09-16T03:24:55.915 INFO:tasks.workunit.client.0.smithi096.stderr: "grade_table": [], 2024-09-16T03:24:55.915 INFO:tasks.workunit.client.0.smithi096.stderr: "stripe_width": 0, 2024-09-16T03:24:55.915 INFO:tasks.workunit.client.0.smithi096.stderr: "expected_num_objects": 0, 2024-09-16T03:24:55.915 INFO:tasks.workunit.client.0.smithi096.stderr: "fast_read": false, 2024-09-16T03:24:55.915 INFO:tasks.workunit.client.0.smithi096.stderr: "options": {}, 2024-09-16T03:24:55.916 INFO:tasks.workunit.client.0.smithi096.stderr: "application_metadata": {}, 2024-09-16T03:24:55.916 INFO:tasks.workunit.client.0.smithi096.stderr: "read_balance": { 2024-09-16T03:24:55.916 INFO:tasks.workunit.client.0.smithi096.stderr: "score_type": "Fair distribution", 2024-09-16T03:24:55.916 INFO:tasks.workunit.client.0.smithi096.stderr: "score_acting": 1.1299999952316284, 2024-09-16T03:24:55.916 INFO:tasks.workunit.client.0.smithi096.stderr: "score_stable": 1.1299999952316284, 2024-09-16T03:24:55.916 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_score": 1, 2024-09-16T03:24:55.916 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_acting": 1.1299999952316284, 2024-09-16T03:24:55.917 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_stable": 1.1299999952316284, 2024-09-16T03:24:55.917 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity_weighted": 1, 2024-09-16T03:24:55.917 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity": 1, 2024-09-16T03:24:55.917 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity_weighted": 1 2024-09-16T03:24:55.917 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:55.917 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:55.917 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:55.917 INFO:tasks.workunit.client.0.smithi096.stderr: "osds": [ 2024-09-16T03:24:55.917 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:55.918 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:24:55.918 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6", 2024-09-16T03:24:55.918 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:24:55.918 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:24:55.918 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:24:55.918 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:24:55.918 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:24:55.918 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:24:55.918 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 5, 2024-09-16T03:24:55.918 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 21, 2024-09-16T03:24:55.918 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:24:55.919 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:24:55.919 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:24:55.919 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:55.919 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:55.919 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:55.919 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6802", 2024-09-16T03:24:55.919 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:24:55.919 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:55.919 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:55.919 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:55.920 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6803", 2024-09-16T03:24:55.920 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:24:55.920 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:55.920 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:55.920 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:55.920 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:24:55.920 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:55.920 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:55.920 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:55.920 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6804", 2024-09-16T03:24:55.920 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:24:55.921 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:55.921 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:55.921 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:55.921 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6805", 2024-09-16T03:24:55.921 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:24:55.921 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:55.921 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:55.921 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:55.921 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:24:55.922 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:55.922 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:55.922 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:55.922 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6808", 2024-09-16T03:24:55.922 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:24:55.922 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:55.922 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:55.922 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:55.922 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6809", 2024-09-16T03:24:55.922 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:24:55.922 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:55.923 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:55.923 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:55.923 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:24:55.923 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:55.923 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:55.923 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:55.923 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6806", 2024-09-16T03:24:55.923 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:24:55.923 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:55.923 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:55.924 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:55.924 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6807", 2024-09-16T03:24:55.924 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:24:55.924 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:55.924 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:55.924 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:55.924 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6803/3375787448", 2024-09-16T03:24:55.924 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6805/3375787448", 2024-09-16T03:24:55.924 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6809/3375787448", 2024-09-16T03:24:55.924 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6807/3375787448", 2024-09-16T03:24:55.925 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:24:55.925 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:24:55.925 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:24:55.925 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:55.925 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:55.925 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:55.925 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:24:55.925 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "74b26727-75c9-444d-8782-719e4197a382", 2024-09-16T03:24:55.925 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:24:55.925 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:24:55.925 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:24:55.926 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:24:55.926 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:24:55.926 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:24:55.926 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 10, 2024-09-16T03:24:55.926 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 21, 2024-09-16T03:24:55.926 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:24:55.926 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:24:55.926 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:24:55.926 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:55.927 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:55.927 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:55.927 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6810", 2024-09-16T03:24:55.927 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:24:55.927 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:55.927 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:55.927 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:55.927 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6811", 2024-09-16T03:24:55.927 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:24:55.927 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:55.928 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:55.928 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:55.928 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:24:55.928 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:55.928 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:55.928 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:55.928 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6812", 2024-09-16T03:24:55.928 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:24:55.928 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:55.929 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:55.929 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:55.929 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6813", 2024-09-16T03:24:55.929 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:24:55.929 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:55.929 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:55.929 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:55.930 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:24:55.930 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:55.930 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:55.930 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:55.930 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6816", 2024-09-16T03:24:55.930 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:24:55.930 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:55.931 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:55.931 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:55.931 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6817", 2024-09-16T03:24:55.931 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:24:55.931 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:55.931 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:55.931 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:55.932 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:24:55.932 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:55.932 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:55.932 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:55.932 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6814", 2024-09-16T03:24:55.932 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:24:55.932 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:55.933 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:55.933 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:55.933 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6815", 2024-09-16T03:24:55.933 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:24:55.933 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:55.933 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:55.933 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:55.934 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6811/3733255132", 2024-09-16T03:24:55.934 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6813/3733255132", 2024-09-16T03:24:55.934 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6817/3733255132", 2024-09-16T03:24:55.934 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6815/3733255132", 2024-09-16T03:24:55.934 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:24:55.934 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:24:55.934 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:24:55.935 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:55.935 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:55.935 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:55.935 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:24:55.935 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "143da3a7-dad9-4b1e-966b-76cf5bdd3c82", 2024-09-16T03:24:55.935 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:24:55.935 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:24:55.936 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:24:55.936 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:24:55.936 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:24:55.936 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:24:55.936 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 15, 2024-09-16T03:24:55.936 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 21, 2024-09-16T03:24:55.936 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:24:55.937 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:24:55.937 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:24:55.937 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:55.937 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:55.937 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:55.937 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6818", 2024-09-16T03:24:55.937 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:24:55.937 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:55.937 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:55.937 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:55.938 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6819", 2024-09-16T03:24:55.938 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:24:55.938 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:55.938 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:55.938 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:55.938 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:24:55.938 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:55.938 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:55.938 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:55.938 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6820", 2024-09-16T03:24:55.938 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:24:55.939 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:55.939 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:55.939 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:55.939 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6821", 2024-09-16T03:24:55.939 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:24:55.939 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:55.939 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:55.939 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:55.940 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:24:55.940 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:55.940 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:55.940 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:55.940 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6824", 2024-09-16T03:24:55.940 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:24:55.940 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:55.940 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:55.940 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:55.941 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6825", 2024-09-16T03:24:55.941 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:24:55.941 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:55.941 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:55.941 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:55.941 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:24:55.941 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:55.941 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:55.941 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:55.941 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6822", 2024-09-16T03:24:55.942 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:24:55.942 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:55.942 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:55.942 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:55.942 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6823", 2024-09-16T03:24:55.942 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:24:55.942 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:55.942 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:55.942 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:55.943 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6819/963814857", 2024-09-16T03:24:55.943 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6821/963814857", 2024-09-16T03:24:55.943 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6825/963814857", 2024-09-16T03:24:55.943 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6823/963814857", 2024-09-16T03:24:55.943 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:24:55.944 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:24:55.944 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:24:55.944 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:55.944 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:55.944 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:55.944 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_xinfo": [ 2024-09-16T03:24:55.944 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:55.945 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:24:55.945 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:24:55.945 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:24:55.945 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:24:55.945 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:24:55.945 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:24:55.945 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:23:22.481942+0000", 2024-09-16T03:24:55.946 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:24:55.946 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:55.946 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:55.946 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:24:55.946 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:24:55.946 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:24:55.946 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:24:55.946 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:24:55.946 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:24:55.946 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:23:59.663703+0000", 2024-09-16T03:24:55.947 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:24:55.947 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:55.947 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:55.947 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:24:55.947 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:24:55.947 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:24:55.947 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:24:55.947 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:24:55.947 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:24:55.947 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:24:37.320822+0000", 2024-09-16T03:24:55.947 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:24:55.947 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:55.947 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:55.948 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap": [], 2024-09-16T03:24:55.948 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap_items": [], 2024-09-16T03:24:55.948 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap_primaries": [], 2024-09-16T03:24:55.948 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_temp": [], 2024-09-16T03:24:55.948 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_temp": [], 2024-09-16T03:24:55.948 INFO:tasks.workunit.client.0.smithi096.stderr: "blocklist": {}, 2024-09-16T03:24:55.948 INFO:tasks.workunit.client.0.smithi096.stderr: "range_blocklist": {}, 2024-09-16T03:24:55.948 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profiles": { 2024-09-16T03:24:55.948 INFO:tasks.workunit.client.0.smithi096.stderr: "default": { 2024-09-16T03:24:55.948 INFO:tasks.workunit.client.0.smithi096.stderr: "k": "2", 2024-09-16T03:24:55.949 INFO:tasks.workunit.client.0.smithi096.stderr: "m": "2", 2024-09-16T03:24:55.949 INFO:tasks.workunit.client.0.smithi096.stderr: "plugin": "jerasure", 2024-09-16T03:24:55.949 INFO:tasks.workunit.client.0.smithi096.stderr: "technique": "reed_sol_van" 2024-09-16T03:24:55.949 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:55.949 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:55.949 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps_queue": [], 2024-09-16T03:24:55.949 INFO:tasks.workunit.client.0.smithi096.stderr: "new_removed_snaps": [], 2024-09-16T03:24:55.949 INFO:tasks.workunit.client.0.smithi096.stderr: "new_purged_snaps": [], 2024-09-16T03:24:55.949 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_node_flags": {}, 2024-09-16T03:24:55.949 INFO:tasks.workunit.client.0.smithi096.stderr: "device_class_flags": {}, 2024-09-16T03:24:55.949 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode": { 2024-09-16T03:24:55.950 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode_enabled": false, 2024-09-16T03:24:55.950 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_bucket_count": 0, 2024-09-16T03:24:55.950 INFO:tasks.workunit.client.0.smithi096.stderr: "degraded_stretch_mode": 0, 2024-09-16T03:24:55.950 INFO:tasks.workunit.client.0.smithi096.stderr: "recovering_stretch_mode": 0, 2024-09-16T03:24:55.950 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode_bucket": 0 2024-09-16T03:24:55.950 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:55.950 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:55.950 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_metadata": [ 2024-09-16T03:24:55.950 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:55.950 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:24:55.950 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:24:55.951 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]", 2024-09-16T03:24:55.951 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:24:55.951 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:24:55.951 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:24:55.951 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:24:55.951 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:24:55.951 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:24:55.951 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:24:55.951 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:24:55.951 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:24:55.951 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:24:55.952 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:24:55.952 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/0/block", 2024-09-16T03:24:55.952 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:24:55.952 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:24:55.952 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:24:55.952 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:24:55.952 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:24:55.952 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:24:55.952 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:24:55.952 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:24:55.953 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:24:55.953 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:24:55.953 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:22:53.662571Z", 2024-09-16T03:24:55.953 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:24:55.953 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:24:55.953 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:24:55.953 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:24:55.953 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:24:55.953 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:24:55.954 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:24:55.954 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]", 2024-09-16T03:24:55.954 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:24:55.954 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]", 2024-09-16T03:24:55.954 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]", 2024-09-16T03:24:55.954 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:24:55.954 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:24:55.954 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:24:55.954 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:24:55.954 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:24:55.954 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:24:55.954 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:24:55.955 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:24:55.955 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:24:55.955 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/0", 2024-09-16T03:24:55.955 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:24:55.955 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:24:55.955 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:24:55.955 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:55.955 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:55.956 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:24:55.956 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:24:55.956 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]", 2024-09-16T03:24:55.956 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:24:55.956 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:24:55.956 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:24:55.956 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:24:55.956 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:24:55.956 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:24:55.956 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:24:55.956 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:24:55.956 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:24:55.957 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:24:55.957 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:24:55.957 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/1/block", 2024-09-16T03:24:55.957 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:24:55.957 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:24:55.957 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:24:55.957 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:24:55.957 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:24:55.957 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:24:55.958 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:24:55.958 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:24:55.958 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:24:55.958 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:24:55.958 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:23:30.129885Z", 2024-09-16T03:24:55.958 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:24:55.958 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:24:55.959 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:24:55.959 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:24:55.959 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:24:55.959 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:24:55.959 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:24:55.959 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]", 2024-09-16T03:24:55.959 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:24:55.960 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]", 2024-09-16T03:24:55.960 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]", 2024-09-16T03:24:55.960 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:24:55.960 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:24:55.960 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:24:55.960 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:24:55.960 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:24:55.961 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:24:55.961 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:24:55.961 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:24:55.961 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:24:55.961 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/1", 2024-09-16T03:24:55.961 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:24:55.961 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:24:55.962 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:24:55.962 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:55.962 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:55.962 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:24:55.962 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:24:55.962 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]", 2024-09-16T03:24:55.962 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:24:55.963 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:24:55.963 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:24:55.963 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:24:55.963 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:24:55.963 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:24:55.963 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:24:55.963 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:24:55.964 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:24:55.964 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:24:55.964 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:24:55.964 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/2/block", 2024-09-16T03:24:55.964 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:24:55.964 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:24:55.964 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:24:55.965 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:24:55.965 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:24:55.965 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:24:55.965 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:24:55.965 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:24:55.965 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:24:55.966 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:24:55.966 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:24:07.764502Z", 2024-09-16T03:24:55.966 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:24:55.966 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:24:55.966 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:24:55.966 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:24:55.966 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:24:55.966 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:24:55.967 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:24:55.967 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]", 2024-09-16T03:24:55.967 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:24:55.967 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]", 2024-09-16T03:24:55.967 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]", 2024-09-16T03:24:55.967 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:24:55.968 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:24:55.968 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:24:55.968 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:24:55.968 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:24:55.968 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:24:55.968 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:24:55.968 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:24:55.968 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:24:55.968 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/2", 2024-09-16T03:24:55.968 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:24:55.968 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:24:55.969 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:24:55.969 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:55.969 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:55.969 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_clean_epochs": { 2024-09-16T03:24:55.969 INFO:tasks.workunit.client.0.smithi096.stderr: "min_last_epoch_clean": 0, 2024-09-16T03:24:55.969 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": { 2024-09-16T03:24:55.969 INFO:tasks.workunit.client.0.smithi096.stderr: "per_pool": [ 2024-09-16T03:24:55.969 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:55.969 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 1, 2024-09-16T03:24:55.969 INFO:tasks.workunit.client.0.smithi096.stderr: "floor": 23 2024-09-16T03:24:55.969 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:55.970 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:55.970 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 2, 2024-09-16T03:24:55.970 INFO:tasks.workunit.client.0.smithi096.stderr: "floor": 23 2024-09-16T03:24:55.970 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:55.971 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:55.971 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:55.971 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_epochs": [ 2024-09-16T03:24:55.971 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:55.971 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:24:55.972 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 16 2024-09-16T03:24:55.972 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:55.972 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:55.972 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:24:55.973 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 16 2024-09-16T03:24:55.973 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:55.973 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:55.973 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:24:55.973 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 23 2024-09-16T03:24:55.973 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:55.973 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:55.974 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:55.974 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_first_committed": 1, 2024-09-16T03:24:55.974 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_last_committed": 28, 2024-09-16T03:24:55.974 INFO:tasks.workunit.client.0.smithi096.stderr: "crushmap": { 2024-09-16T03:24:55.974 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": [ 2024-09-16T03:24:55.974 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:55.974 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:24:55.975 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.0", 2024-09-16T03:24:55.975 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:24:55.975 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:55.975 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:55.975 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:24:55.975 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.1", 2024-09-16T03:24:55.975 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:24:55.976 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:55.976 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:55.976 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:24:55.976 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.2", 2024-09-16T03:24:55.976 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:24:55.976 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:55.976 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:55.976 INFO:tasks.workunit.client.0.smithi096.stderr: "types": [ 2024-09-16T03:24:55.976 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:55.976 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 0, 2024-09-16T03:24:55.976 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd" 2024-09-16T03:24:55.976 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:55.977 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:55.977 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:24:55.977 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "host" 2024-09-16T03:24:55.977 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:55.977 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:55.977 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 2, 2024-09-16T03:24:55.977 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "chassis" 2024-09-16T03:24:55.977 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:55.977 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:55.977 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 3, 2024-09-16T03:24:55.977 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "rack" 2024-09-16T03:24:55.977 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:55.977 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:55.978 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 4, 2024-09-16T03:24:55.978 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "row" 2024-09-16T03:24:55.978 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:55.978 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:55.978 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 5, 2024-09-16T03:24:55.978 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "pdu" 2024-09-16T03:24:55.978 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:55.978 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:55.978 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 6, 2024-09-16T03:24:55.979 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "pod" 2024-09-16T03:24:55.979 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:55.979 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:55.979 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 7, 2024-09-16T03:24:55.979 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "room" 2024-09-16T03:24:55.979 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:55.979 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:55.979 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 8, 2024-09-16T03:24:55.979 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "datacenter" 2024-09-16T03:24:55.979 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:55.979 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:55.980 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 9, 2024-09-16T03:24:55.980 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "zone" 2024-09-16T03:24:55.980 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:55.980 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:55.980 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 10, 2024-09-16T03:24:55.980 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "region" 2024-09-16T03:24:55.980 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:55.980 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:55.980 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:24:55.980 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "root" 2024-09-16T03:24:55.980 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:55.980 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:55.981 INFO:tasks.workunit.client.0.smithi096.stderr: "buckets": [ 2024-09-16T03:24:55.981 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:55.981 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -1, 2024-09-16T03:24:55.981 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "default", 2024-09-16T03:24:55.981 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:24:55.981 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "root", 2024-09-16T03:24:55.981 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:24:55.981 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:24:55.981 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:24:55.981 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:24:55.981 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:55.981 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -3, 2024-09-16T03:24:55.982 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:24:55.982 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:24:55.982 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:55.982 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:55.982 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:55.982 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:55.982 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -2, 2024-09-16T03:24:55.982 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "default~hdd", 2024-09-16T03:24:55.982 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:24:55.982 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "root", 2024-09-16T03:24:55.982 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:24:55.982 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:24:55.982 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:24:55.983 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:24:55.983 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:55.983 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -4, 2024-09-16T03:24:55.983 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:24:55.983 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:24:55.983 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:55.983 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:55.983 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:55.983 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:55.983 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -3, 2024-09-16T03:24:55.983 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "smithi096", 2024-09-16T03:24:55.983 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:24:55.983 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "host", 2024-09-16T03:24:55.984 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:24:55.984 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:24:55.984 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:24:55.984 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:24:55.984 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:55.984 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:24:55.984 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:24:55.984 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:24:55.984 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:55.984 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:55.984 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:24:55.984 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:24:55.984 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 1 2024-09-16T03:24:55.985 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:55.985 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:55.985 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:24:55.985 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:24:55.985 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 2 2024-09-16T03:24:55.985 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:55.985 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:55.985 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:55.985 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:55.985 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -4, 2024-09-16T03:24:55.985 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "smithi096~hdd", 2024-09-16T03:24:55.985 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:24:55.985 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "host", 2024-09-16T03:24:55.986 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:24:55.986 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:24:55.986 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:24:55.986 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:24:55.986 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:55.986 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:24:55.986 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:24:55.986 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:24:55.986 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:55.986 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:55.986 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:24:55.986 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:24:55.986 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 1 2024-09-16T03:24:55.987 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:55.987 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:55.987 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:24:55.987 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:24:55.987 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 2 2024-09-16T03:24:55.987 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:55.987 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:55.987 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:55.987 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:55.987 INFO:tasks.workunit.client.0.smithi096.stderr: "rules": [ 2024-09-16T03:24:55.987 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:55.987 INFO:tasks.workunit.client.0.smithi096.stderr: "rule_id": 0, 2024-09-16T03:24:55.988 INFO:tasks.workunit.client.0.smithi096.stderr: "rule_name": "replicated_rule", 2024-09-16T03:24:55.988 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:24:55.988 INFO:tasks.workunit.client.0.smithi096.stderr: "steps": [ 2024-09-16T03:24:55.988 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:55.988 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "take", 2024-09-16T03:24:55.988 INFO:tasks.workunit.client.0.smithi096.stderr: "item": -1, 2024-09-16T03:24:55.988 INFO:tasks.workunit.client.0.smithi096.stderr: "item_name": "default" 2024-09-16T03:24:55.988 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:55.988 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:55.988 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "choose_firstn", 2024-09-16T03:24:55.988 INFO:tasks.workunit.client.0.smithi096.stderr: "num": 0, 2024-09-16T03:24:55.988 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "osd" 2024-09-16T03:24:55.988 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:55.989 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:55.989 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "emit" 2024-09-16T03:24:55.989 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:55.989 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:55.989 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:55.989 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:55.989 INFO:tasks.workunit.client.0.smithi096.stderr: "tunables": { 2024-09-16T03:24:55.989 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_local_tries": 0, 2024-09-16T03:24:55.989 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_local_fallback_tries": 0, 2024-09-16T03:24:55.989 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_total_tries": 50, 2024-09-16T03:24:55.989 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_descend_once": 1, 2024-09-16T03:24:55.990 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_vary_r": 1, 2024-09-16T03:24:55.990 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_stable": 1, 2024-09-16T03:24:55.990 INFO:tasks.workunit.client.0.smithi096.stderr: "msr_descents": 100, 2024-09-16T03:24:55.990 INFO:tasks.workunit.client.0.smithi096.stderr: "msr_collision_tries": 100, 2024-09-16T03:24:55.990 INFO:tasks.workunit.client.0.smithi096.stderr: "straw_calc_version": 1, 2024-09-16T03:24:55.990 INFO:tasks.workunit.client.0.smithi096.stderr: "allowed_bucket_algs": 54, 2024-09-16T03:24:55.990 INFO:tasks.workunit.client.0.smithi096.stderr: "profile": "jewel", 2024-09-16T03:24:55.990 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_tunables": 1, 2024-09-16T03:24:55.990 INFO:tasks.workunit.client.0.smithi096.stderr: "legacy_tunables": 0, 2024-09-16T03:24:55.991 INFO:tasks.workunit.client.0.smithi096.stderr: "minimum_required_version": "jewel", 2024-09-16T03:24:55.991 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables": 1, 2024-09-16T03:24:55.991 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables2": 1, 2024-09-16T03:24:55.991 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v2_rules": 0, 2024-09-16T03:24:55.991 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables3": 1, 2024-09-16T03:24:55.991 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v3_rules": 0, 2024-09-16T03:24:55.991 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v4_buckets": 1, 2024-09-16T03:24:55.992 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables5": 1, 2024-09-16T03:24:55.992 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v5_rules": 0, 2024-09-16T03:24:55.992 INFO:tasks.workunit.client.0.smithi096.stderr: "has_msr_rules": 0 2024-09-16T03:24:55.992 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:55.992 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_args": {} 2024-09-16T03:24:55.992 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:55.992 INFO:tasks.workunit.client.0.smithi096.stderr: "fsmap": { 2024-09-16T03:24:55.993 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 1, 2024-09-16T03:24:55.993 INFO:tasks.workunit.client.0.smithi096.stderr: "btime": "2024-09-16T03:22:46:882186+0000", 2024-09-16T03:24:55.993 INFO:tasks.workunit.client.0.smithi096.stderr: "default_fscid": -1, 2024-09-16T03:24:55.993 INFO:tasks.workunit.client.0.smithi096.stderr: "compat": { 2024-09-16T03:24:55.993 INFO:tasks.workunit.client.0.smithi096.stderr: "compat": {}, 2024-09-16T03:24:55.993 INFO:tasks.workunit.client.0.smithi096.stderr: "ro_compat": {}, 2024-09-16T03:24:55.993 INFO:tasks.workunit.client.0.smithi096.stderr: "incompat": { 2024-09-16T03:24:55.994 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_1": "base v0.20", 2024-09-16T03:24:55.994 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_2": "client writeable ranges", 2024-09-16T03:24:55.994 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_3": "default file layouts on dirs", 2024-09-16T03:24:55.994 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_4": "dir inode in separate object", 2024-09-16T03:24:55.994 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_5": "mds uses versioned encoding", 2024-09-16T03:24:55.994 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_6": "dirfrag is stored in omap", 2024-09-16T03:24:55.994 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_8": "no anchor table", 2024-09-16T03:24:55.994 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_9": "file layout v2", 2024-09-16T03:24:55.994 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_10": "snaprealm v2", 2024-09-16T03:24:55.994 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_11": "minor log segments", 2024-09-16T03:24:55.994 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_12": "quiesce subvolumes" 2024-09-16T03:24:55.995 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:55.995 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:55.995 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_flags": { 2024-09-16T03:24:55.995 INFO:tasks.workunit.client.0.smithi096.stderr: "enable_multiple": true, 2024-09-16T03:24:55.995 INFO:tasks.workunit.client.0.smithi096.stderr: "ever_enabled_multiple": true 2024-09-16T03:24:55.995 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:55.995 INFO:tasks.workunit.client.0.smithi096.stderr: "standbys": [], 2024-09-16T03:24:55.995 INFO:tasks.workunit.client.0.smithi096.stderr: "filesystems": [] 2024-09-16T03:24:55.995 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:55.995 INFO:tasks.workunit.client.0.smithi096.stderr: "mdsmap_first_committed": 1, 2024-09-16T03:24:55.995 INFO:tasks.workunit.client.0.smithi096.stderr: "mdsmap_last_committed": 1, 2024-09-16T03:24:55.995 INFO:tasks.workunit.client.0.smithi096.stderr: "auth": { 2024-09-16T03:24:55.995 INFO:tasks.workunit.client.0.smithi096.stderr: "first_committed": 1, 2024-09-16T03:24:55.996 INFO:tasks.workunit.client.0.smithi096.stderr: "last_committed": 5, 2024-09-16T03:24:55.996 INFO:tasks.workunit.client.0.smithi096.stderr: "num_secrets": 3 2024-09-16T03:24:55.996 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:55.996 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 64, 2024-09-16T03:24:55.996 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_active": 64, 2024-09-16T03:24:55.996 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_unknown": 0, 2024-09-16T03:24:55.996 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osd": 3, 2024-09-16T03:24:55.996 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_sum": { 2024-09-16T03:24:55.996 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:24:55.996 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:24:55.996 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:24:55.997 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:24:55.997 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:24:55.997 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:24:55.997 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:24:55.997 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:24:55.997 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:24:55.997 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:24:55.997 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:24:55.997 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:24:55.997 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:24:55.997 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:24:55.997 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:24:55.998 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:24:55.998 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:24:55.998 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:24:55.998 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:24:55.998 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:24:55.998 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:24:55.998 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:24:55.998 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:24:55.998 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:24:55.998 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:24:55.998 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:24:55.998 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:24:55.999 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:24:55.999 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:24:55.999 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:24:55.999 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:24:55.999 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:24:55.999 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:24:55.999 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:24:55.999 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:24:55.999 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:24:55.999 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:24:55.999 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:24:55.999 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:24:56.000 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:24:56.000 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:24:56.000 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:56.000 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:24:56.000 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:24:56.000 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:24:56.000 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:24:56.000 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:24:56.001 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:24:56.001 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:24:56.001 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:24:56.001 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:24:56.001 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:24:56.001 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:24:56.001 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:56.001 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:24:56.002 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:24:56.002 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 192, 2024-09-16T03:24:56.002 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 192, 2024-09-16T03:24:56.002 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 0 2024-09-16T03:24:56.002 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:56.002 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_sum": { 2024-09-16T03:24:56.002 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 0, 2024-09-16T03:24:56.002 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 0, 2024-09-16T03:24:56.002 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pgs": 192, 2024-09-16T03:24:56.002 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osds": 3, 2024-09-16T03:24:56.002 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_osds": 3, 2024-09-16T03:24:56.003 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_omap_osds": 3, 2024-09-16T03:24:56.003 INFO:tasks.workunit.client.0.smithi096.stderr: "kb": 314572800, 2024-09-16T03:24:56.003 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used": 81204, 2024-09-16T03:24:56.003 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_data": 672, 2024-09-16T03:24:56.003 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_omap": 4, 2024-09-16T03:24:56.003 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_meta": 80443, 2024-09-16T03:24:56.003 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_avail": 314491596, 2024-09-16T03:24:56.003 INFO:tasks.workunit.client.0.smithi096.stderr: "statfs": { 2024-09-16T03:24:56.003 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 322122547200, 2024-09-16T03:24:56.003 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 322039394304, 2024-09-16T03:24:56.003 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:24:56.003 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 688128, 2024-09-16T03:24:56.003 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 200481, 2024-09-16T03:24:56.004 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:24:56.004 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:24:56.004 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:24:56.004 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 4785, 2024-09-16T03:24:56.004 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 82373967 2024-09-16T03:24:56.004 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:56.004 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_peers": [], 2024-09-16T03:24:56.004 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_trim_queue_len": 0, 2024-09-16T03:24:56.004 INFO:tasks.workunit.client.0.smithi096.stderr: "num_snap_trimming": 0, 2024-09-16T03:24:56.004 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shards_repaired": 0, 2024-09-16T03:24:56.005 INFO:tasks.workunit.client.0.smithi096.stderr: "op_queue_age_hist": { 2024-09-16T03:24:56.005 INFO:tasks.workunit.client.0.smithi096.stderr: "histogram": [], 2024-09-16T03:24:56.005 INFO:tasks.workunit.client.0.smithi096.stderr: "upper_bound": 1 2024-09-16T03:24:56.005 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:56.005 INFO:tasks.workunit.client.0.smithi096.stderr: "perf_stat": { 2024-09-16T03:24:56.005 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ms": 624, 2024-09-16T03:24:56.005 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ms": 624, 2024-09-16T03:24:56.005 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ns": 624000000, 2024-09-16T03:24:56.005 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ns": 624000000 2024-09-16T03:24:56.005 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:56.005 INFO:tasks.workunit.client.0.smithi096.stderr: "alerts": [], 2024-09-16T03:24:56.005 INFO:tasks.workunit.client.0.smithi096.stderr: "network_ping_times": [] 2024-09-16T03:24:56.006 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:56.006 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_sum_by_class": { 2024-09-16T03:24:56.006 INFO:tasks.workunit.client.0.smithi096.stderr: "hdd": { 2024-09-16T03:24:56.006 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 0, 2024-09-16T03:24:56.006 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 0, 2024-09-16T03:24:56.006 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pgs": 192, 2024-09-16T03:24:56.006 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osds": 3, 2024-09-16T03:24:56.006 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_osds": 3, 2024-09-16T03:24:56.006 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_omap_osds": 3, 2024-09-16T03:24:56.006 INFO:tasks.workunit.client.0.smithi096.stderr: "kb": 314572800, 2024-09-16T03:24:56.007 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used": 81204, 2024-09-16T03:24:56.007 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_data": 672, 2024-09-16T03:24:56.007 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_omap": 4, 2024-09-16T03:24:56.007 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_meta": 80443, 2024-09-16T03:24:56.007 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_avail": 314491596, 2024-09-16T03:24:56.007 INFO:tasks.workunit.client.0.smithi096.stderr: "statfs": { 2024-09-16T03:24:56.007 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 322122547200, 2024-09-16T03:24:56.008 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 322039394304, 2024-09-16T03:24:56.008 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:24:56.008 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 688128, 2024-09-16T03:24:56.008 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 200481, 2024-09-16T03:24:56.008 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:24:56.008 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:24:56.008 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:24:56.009 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 4785, 2024-09-16T03:24:56.009 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 82373967 2024-09-16T03:24:56.009 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:56.009 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_peers": [], 2024-09-16T03:24:56.009 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_trim_queue_len": 0, 2024-09-16T03:24:56.009 INFO:tasks.workunit.client.0.smithi096.stderr: "num_snap_trimming": 0, 2024-09-16T03:24:56.009 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shards_repaired": 0, 2024-09-16T03:24:56.009 INFO:tasks.workunit.client.0.smithi096.stderr: "op_queue_age_hist": { 2024-09-16T03:24:56.009 INFO:tasks.workunit.client.0.smithi096.stderr: "histogram": [], 2024-09-16T03:24:56.009 INFO:tasks.workunit.client.0.smithi096.stderr: "upper_bound": 1 2024-09-16T03:24:56.010 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:56.010 INFO:tasks.workunit.client.0.smithi096.stderr: "perf_stat": { 2024-09-16T03:24:56.010 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ms": 624, 2024-09-16T03:24:56.010 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ms": 624, 2024-09-16T03:24:56.010 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ns": 624000000, 2024-09-16T03:24:56.010 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ns": 624000000 2024-09-16T03:24:56.010 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:56.010 INFO:tasks.workunit.client.0.smithi096.stderr: "alerts": [], 2024-09-16T03:24:56.010 INFO:tasks.workunit.client.0.smithi096.stderr: "network_ping_times": [] 2024-09-16T03:24:56.010 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:56.011 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:56.011 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_stats": [ 2024-09-16T03:24:56.011 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:56.011 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 2, 2024-09-16T03:24:56.011 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 32, 2024-09-16T03:24:56.011 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:24:56.011 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:24:56.011 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:24:56.011 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:24:56.012 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:24:56.012 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:24:56.012 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:24:56.012 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:24:56.012 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:24:56.012 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:24:56.012 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:24:56.012 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:24:56.012 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:24:56.012 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:24:56.012 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:24:56.012 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:24:56.013 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:24:56.013 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:24:56.013 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:24:56.013 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:24:56.013 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:24:56.013 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:24:56.013 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:24:56.013 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:24:56.013 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:24:56.013 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:24:56.013 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:24:56.014 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:24:56.014 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:24:56.014 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:24:56.014 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:24:56.014 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:24:56.014 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:24:56.014 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:24:56.014 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:24:56.014 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:24:56.014 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:24:56.014 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:24:56.015 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:24:56.015 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:24:56.015 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:24:56.015 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:56.015 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:24:56.015 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:24:56.015 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:24:56.015 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:24:56.015 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:24:56.015 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:24:56.016 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:24:56.016 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:24:56.016 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:24:56.016 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:24:56.016 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:24:56.016 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:56.016 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:24:56.016 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:24:56.016 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 96, 2024-09-16T03:24:56.017 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 96, 2024-09-16T03:24:56.017 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 3 2024-09-16T03:24:56.017 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:56.017 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:56.017 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 1, 2024-09-16T03:24:56.017 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 32, 2024-09-16T03:24:56.017 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:24:56.017 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:24:56.017 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:24:56.017 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:24:56.017 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:24:56.018 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:24:56.018 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:24:56.018 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:24:56.018 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:24:56.018 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:24:56.018 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:24:56.018 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:24:56.018 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:24:56.018 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:24:56.018 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:24:56.019 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:24:56.019 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:24:56.019 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:24:56.019 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:24:56.019 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:24:56.019 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:24:56.019 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:24:56.019 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:24:56.019 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:24:56.019 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:24:56.019 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:24:56.020 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:24:56.020 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:24:56.020 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:24:56.020 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:24:56.020 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:24:56.020 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:24:56.020 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:24:56.020 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:24:56.020 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:24:56.020 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:24:56.021 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:24:56.021 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:24:56.021 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:24:56.021 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:24:56.021 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:24:56.021 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:56.021 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:24:56.022 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:24:56.022 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:24:56.022 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:24:56.022 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:24:56.022 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:24:56.022 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:24:56.022 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:24:56.023 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:24:56.023 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:24:56.023 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:24:56.023 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:56.023 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:24:56.023 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:24:56.023 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 96, 2024-09-16T03:24:56.023 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 96, 2024-09-16T03:24:56.024 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 3 2024-09-16T03:24:56.024 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:56.024 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:56.024 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_stats": [ 2024-09-16T03:24:56.024 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:56.024 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:24:56.024 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 21474836505 2024-09-16T03:24:56.025 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:56.025 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:56.025 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:24:56.025 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 42949672976 2024-09-16T03:24:56.025 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:56.025 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:56.025 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:24:56.026 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 64424509449 2024-09-16T03:24:56.026 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:56.026 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:56.026 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_by_state": [ 2024-09-16T03:24:56.026 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:56.026 INFO:tasks.workunit.client.0.smithi096.stderr: "state": "active+clean", 2024-09-16T03:24:56.026 INFO:tasks.workunit.client.0.smithi096.stderr: "num": 64 2024-09-16T03:24:56.027 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:56.027 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:56.027 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_by_osd": [ 2024-09-16T03:24:56.027 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:56.027 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:24:56.027 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 15, 2024-09-16T03:24:56.027 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 64, 2024-09-16T03:24:56.028 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:24:56.028 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:56.028 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:56.028 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:24:56.028 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 20, 2024-09-16T03:24:56.028 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 64, 2024-09-16T03:24:56.028 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:24:56.029 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:56.029 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:56.029 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:24:56.029 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 29, 2024-09-16T03:24:56.029 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 64, 2024-09-16T03:24:56.029 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:24:56.029 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:56.029 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:56.030 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": [ 2024-09-16T03:24:56.030 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:56.030 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 1, 2024-09-16T03:24:56.030 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": {} 2024-09-16T03:24:56.030 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:56.030 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:56.030 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 2, 2024-09-16T03:24:56.031 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": {} 2024-09-16T03:24:56.031 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:56.031 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:56.031 INFO:tasks.workunit.client.0.smithi096.stderr: "servicemap": { 2024-09-16T03:24:56.031 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 3, 2024-09-16T03:24:56.031 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:24:24.403052+0000", 2024-09-16T03:24:56.031 INFO:tasks.workunit.client.0.smithi096.stderr: "services": { 2024-09-16T03:24:56.032 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": { 2024-09-16T03:24:56.032 INFO:tasks.workunit.client.0.smithi096.stderr: "daemons": { 2024-09-16T03:24:56.032 INFO:tasks.workunit.client.0.smithi096.stderr: "summary": "", 2024-09-16T03:24:56.032 INFO:tasks.workunit.client.0.smithi096.stderr: "1": { 2024-09-16T03:24:56.032 INFO:tasks.workunit.client.0.smithi096.stderr: "start_epoch": 0, 2024-09-16T03:24:56.032 INFO:tasks.workunit.client.0.smithi096.stderr: "start_stamp": "0.000000", 2024-09-16T03:24:56.032 INFO:tasks.workunit.client.0.smithi096.stderr: "gid": 0, 2024-09-16T03:24:56.032 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "(unrecognized address family 0)/0", 2024-09-16T03:24:56.033 INFO:tasks.workunit.client.0.smithi096.stderr: "metadata": {}, 2024-09-16T03:24:56.033 INFO:tasks.workunit.client.0.smithi096.stderr: "task_status": {} 2024-09-16T03:24:56.033 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:56.033 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:56.033 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:56.033 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:56.033 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:56.033 INFO:tasks.workunit.client.0.smithi096.stderr: "mgrstat_first_committed": 47, 2024-09-16T03:24:56.033 INFO:tasks.workunit.client.0.smithi096.stderr: "mgrstat_last_committed": 53, 2024-09-16T03:24:56.033 INFO:tasks.workunit.client.0.smithi096.stderr: "logm_first_committed": 1, 2024-09-16T03:24:56.033 INFO:tasks.workunit.client.0.smithi096.stderr: "logm_last_committed": 236, 2024-09-16T03:24:56.033 INFO:tasks.workunit.client.0.smithi096.stderr: "paxos": { 2024-09-16T03:24:56.034 INFO:tasks.workunit.client.0.smithi096.stderr: "first_committed": 1, 2024-09-16T03:24:56.034 INFO:tasks.workunit.client.0.smithi096.stderr: "last_committed": 325, 2024-09-16T03:24:56.034 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pn": 0, 2024-09-16T03:24:56.034 INFO:tasks.workunit.client.0.smithi096.stderr: "accepted_pn": 0 2024-09-16T03:24:56.034 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:56.034 INFO:tasks.workunit.client.0.smithi096.stderr:}' 2024-09-16T03:24:56.034 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:132: get_fc_lc_diff: jq .osdmap_first_committed 2024-09-16T03:24:56.034 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:132: get_fc_lc_diff: echo '{' '"cluster_fingerprint":' '"fda2fc64-07ed-4add-8224-2e527e11d427",' '"version":' '"19.3.0-4930-gfc3e0bff",' '"commit":' '"fc3e0bff7468fd55478adbae7f75508b749124b6",' '"timestamp":' '"2024-09-16T03:24:55.623612+0000",' '"tag":' '"",' '"health":' '{' '"status":' '"HEALTH_OK",' '"checks":' '{},' '"mutes":' '[]' '},' '"monmap_first_committed":' 1, '"monmap_last_committed":' 1, '"monmap":' '{' '"epoch":' 1, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"modified":' '"2024-09-16T03:22:45.872880Z",' '"created":' '"2024-09-16T03:22:45.872880Z",' '"min_mon_release":' 19, '"min_mon_release_name":' '"squid",' '"election_strategy":' 1, '"disallowed_leaders:' '":' '"",' '"stretch_mode":' false, '"tiebreaker_mon":' '"",' '"removed_ranks:' '":' '"",' '"features":' '{' '"persistent":' '[' '"kraken",' '"luminous",' '"mimic",' '"osdmap-prune",' '"nautilus",' '"octopus",' '"pacific",' '"elector-pinging",' '"quincy",' '"reef",' '"squid"' '],' '"optional":' '[]' '},' '"mons":' '[' '{' '"rank":' 0, '"name":' '"a",' '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:7302",' '"nonce":' 0 '}' ']' '},' '"addr":' '"127.0.0.1:7302/0",' '"public_addr":' '"127.0.0.1:7302/0",' '"priority":' 0, '"weight":' 0, '"crush_location":' '"{}"' '}' ']' '},' '"quorum":' '[' 0 '],' '"osdmap":' '{' '"epoch":' 28, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"created":' '"2024-09-16T03:22:46.906117+0000",' '"modified":' '"2024-09-16T03:24:50.642444+0000",' '"last_up_change":' '"2024-09-16T03:24:37.708512+0000",' '"last_in_change":' '"2024-09-16T03:24:01.831039+0000",' '"flags":' '"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit",' '"flags_num":' 5799936, '"flags_set":' '[' '"pglog_hardlimit",' '"purged_snapdirs",' '"recovery_deletes",' '"sortbitwise"' '],' '"crush_version":' 7, '"full_ratio":' 0.97000002861022949, '"backfillfull_ratio":' 0.97000002861022949, '"nearfull_ratio":' 0.85000002384185791, '"cluster_snapshot":' '"",' '"pool_max":' 2, '"max_osd":' 3, '"require_min_compat_client":' '"luminous",' '"min_compat_client":' '"jewel",' '"require_osd_release":' '"squid",' '"allow_crimson":' false, '"pools":' '[' '{' '"pool":' 1, '"pool_name":' '"foo",' '"create_time":' '"2024-09-16T03:24:44.525189+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"21",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.690000057220459, '"score_stable":' 1.690000057220459, '"optimal_score":' 1, '"raw_score_acting":' 1.690000057220459, '"raw_score_stable":' 1.690000057220459, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '},' '{' '"pool":' 2, '"pool_name":' '"bar",' '"create_time":' '"2024-09-16T03:24:46.226575+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"24",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.1299999952316284, '"score_stable":' 1.1299999952316284, '"optimal_score":' 1, '"raw_score_acting":' 1.1299999952316284, '"raw_score_stable":' 1.1299999952316284, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '}' '],' '"osds":' '[' '{' '"osd":' 0, '"uuid":' '"64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 5, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6802",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6803",' '"nonce":' 3375787448 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6804",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6805",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6808",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6809",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6806",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6807",' '"nonce":' 3375787448 '}' ']' '},' '"public_addr":' '"127.0.0.1:6803/3375787448",' '"cluster_addr":' '"127.0.0.1:6805/3375787448",' '"heartbeat_back_addr":' '"127.0.0.1:6809/3375787448",' '"heartbeat_front_addr":' '"127.0.0.1:6807/3375787448",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 1, '"uuid":' '"74b26727-75c9-444d-8782-719e4197a382",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 10, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6810",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6811",' '"nonce":' 3733255132 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6812",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6813",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6816",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6817",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6814",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6815",' '"nonce":' 3733255132 '}' ']' '},' '"public_addr":' '"127.0.0.1:6811/3733255132",' '"cluster_addr":' '"127.0.0.1:6813/3733255132",' '"heartbeat_back_addr":' '"127.0.0.1:6817/3733255132",' '"heartbeat_front_addr":' '"127.0.0.1:6815/3733255132",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 2, '"uuid":' '"143da3a7-dad9-4b1e-966b-76cf5bdd3c82",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 15, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6818",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6819",' '"nonce":' 963814857 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6820",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6821",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6824",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6825",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6822",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6823",' '"nonce":' 963814857 '}' ']' '},' '"public_addr":' '"127.0.0.1:6819/963814857",' '"cluster_addr":' '"127.0.0.1:6821/963814857",' '"heartbeat_back_addr":' '"127.0.0.1:6825/963814857",' '"heartbeat_front_addr":' '"127.0.0.1:6823/963814857",' '"state":' '[' '"exists",' '"up"' ']' '}' '],' '"osd_xinfo":' '[' '{' '"osd":' 0, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:22.481942+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 1, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:59.663703+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 2, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:24:37.320822+0000",' '"dead_epoch":' 0 '}' '],' '"pg_upmap":' '[],' '"pg_upmap_items":' '[],' '"pg_upmap_primaries":' '[],' '"pg_temp":' '[],' '"primary_temp":' '[],' '"blocklist":' '{},' '"range_blocklist":' '{},' '"erasure_code_profiles":' '{' '"default":' '{' '"k":' '"2",' '"m":' '"2",' '"plugin":' '"jerasure",' '"technique":' '"reed_sol_van"' '}' '},' '"removed_snaps_queue":' '[],' '"new_removed_snaps":' '[],' '"new_purged_snaps":' '[],' '"crush_node_flags":' '{},' '"device_class_flags":' '{},' '"stretch_mode":' '{' '"stretch_mode_enabled":' false, '"stretch_bucket_count":' 0, '"degraded_stretch_mode":' 0, '"recovering_stretch_mode":' 0, '"stretch_mode_bucket":' 0 '}' '},' '"osd_metadata":' '[' '{' '"id":' 0, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/0/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:22:53.662571Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]",' '"hb_front_addr":' '"[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/0",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 1, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/1/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:23:30.129885Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]",' '"hb_front_addr":' '"[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/1",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 2, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/2/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:24:07.764502Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]",' '"hb_front_addr":' '"[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/2",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '}' '],' '"osdmap_clean_epochs":' '{' '"min_last_epoch_clean":' 0, '"last_epoch_clean":' '{' '"per_pool":' '[' '{' '"poolid":' 1, '"floor":' 23 '},' '{' '"poolid":' 2, '"floor":' 23 '}' ']' '},' '"osd_epochs":' '[' '{' '"id":' 0, '"epoch":' 16 '},' '{' '"id":' 1, '"epoch":' 16 '},' '{' '"id":' 2, '"epoch":' 23 '}' ']' '},' '"osdmap_first_committed":' 1, '"osdmap_last_committed":' 28, '"crushmap":' '{' '"devices":' '[' '{' '"id":' 0, '"name":' '"osd.0",' '"class":' '"hdd"' '},' '{' '"id":' 1, '"name":' '"osd.1",' '"class":' '"hdd"' '},' '{' '"id":' 2, '"name":' '"osd.2",' '"class":' '"hdd"' '}' '],' '"types":' '[' '{' '"type_id":' 0, '"name":' '"osd"' '},' '{' '"type_id":' 1, '"name":' '"host"' '},' '{' '"type_id":' 2, '"name":' '"chassis"' '},' '{' '"type_id":' 3, '"name":' '"rack"' '},' '{' '"type_id":' 4, '"name":' '"row"' '},' '{' '"type_id":' 5, '"name":' '"pdu"' '},' '{' '"type_id":' 6, '"name":' '"pod"' '},' '{' '"type_id":' 7, '"name":' '"room"' '},' '{' '"type_id":' 8, '"name":' '"datacenter"' '},' '{' '"type_id":' 9, '"name":' '"zone"' '},' '{' '"type_id":' 10, '"name":' '"region"' '},' '{' '"type_id":' 11, '"name":' '"root"' '}' '],' '"buckets":' '[' '{' '"id":' -1, '"name":' '"default",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -3, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -2, '"name":' '"default~hdd",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -4, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -3, '"name":' '"smithi096",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '},' '{' '"id":' -4, '"name":' '"smithi096~hdd",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '}' '],' '"rules":' '[' '{' '"rule_id":' 0, '"rule_name":' '"replicated_rule",' '"type":' 1, '"steps":' '[' '{' '"op":' '"take",' '"item":' -1, '"item_name":' '"default"' '},' '{' '"op":' '"choose_firstn",' '"num":' 0, '"type":' '"osd"' '},' '{' '"op":' '"emit"' '}' ']' '}' '],' '"tunables":' '{' '"choose_local_tries":' 0, '"choose_local_fallback_tries":' 0, '"choose_total_tries":' 50, '"chooseleaf_descend_once":' 1, '"chooseleaf_vary_r":' 1, '"chooseleaf_stable":' 1, '"msr_descents":' 100, '"msr_collision_tries":' 100, '"straw_calc_version":' 1, '"allowed_bucket_algs":' 54, '"profile":' '"jewel",' '"optimal_tunables":' 1, '"legacy_tunables":' 0, '"minimum_required_version":' '"jewel",' '"require_feature_tunables":' 1, '"require_feature_tunables2":' 1, '"has_v2_rules":' 0, '"require_feature_tunables3":' 1, '"has_v3_rules":' 0, '"has_v4_buckets":' 1, '"require_feature_tunables5":' 1, '"has_v5_rules":' 0, '"has_msr_rules":' 0 '},' '"choose_args":' '{}' '},' '"fsmap":' '{' '"epoch":' 1, '"btime":' '"2024-09-16T03:22:46:882186+0000",' '"default_fscid":' -1, '"compat":' '{' '"compat":' '{},' '"ro_compat":' '{},' '"incompat":' '{' '"feature_1":' '"base' 'v0.20",' '"feature_2":' '"client' writeable 'ranges",' '"feature_3":' '"default' file layouts on 'dirs",' '"feature_4":' '"dir' inode in separate 'object",' '"feature_5":' '"mds' uses versioned 'encoding",' '"feature_6":' '"dirfrag' is stored in 'omap",' '"feature_8":' '"no' anchor 'table",' '"feature_9":' '"file' layout 'v2",' '"feature_10":' '"snaprealm' 'v2",' '"feature_11":' '"minor' log 'segments",' '"feature_12":' '"quiesce' 'subvolumes"' '}' '},' '"feature_flags":' '{' '"enable_multiple":' true, '"ever_enabled_multiple":' true '},' '"standbys":' '[],' '"filesystems":' '[]' '},' '"mdsmap_first_committed":' 1, '"mdsmap_last_committed":' 1, '"auth":' '{' '"first_committed":' 1, '"last_committed":' 5, '"num_secrets":' 3 '},' '"num_pg":' 64, '"num_pg_active":' 64, '"num_pg_unknown":' 0, '"num_osd":' 3, '"pool_sum":' '{' '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 192, '"acting":' 192, '"num_store_stats":' 0 '},' '"osd_sum":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 192, '"num_osds":' 3, '"num_per_pool_osds":' 3, '"num_per_pool_omap_osds":' 3, '"kb":' 314572800, '"kb_used":' 81204, '"kb_used_data":' 672, '"kb_used_omap":' 4, '"kb_used_meta":' 80443, '"kb_avail":' 314491596, '"statfs":' '{' '"total":' 322122547200, '"available":' 322039394304, '"internally_reserved":' 0, '"allocated":' 688128, '"data_stored":' 200481, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 4785, '"internal_metadata":' 82373967 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 624, '"apply_latency_ms":' 624, '"commit_latency_ns":' 624000000, '"apply_latency_ns":' 624000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '},' '"osd_sum_by_class":' '{' '"hdd":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 192, '"num_osds":' 3, '"num_per_pool_osds":' 3, '"num_per_pool_omap_osds":' 3, '"kb":' 314572800, '"kb_used":' 81204, '"kb_used_data":' 672, '"kb_used_omap":' 4, '"kb_used_meta":' 80443, '"kb_avail":' 314491596, '"statfs":' '{' '"total":' 322122547200, '"available":' 322039394304, '"internally_reserved":' 0, '"allocated":' 688128, '"data_stored":' 200481, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 4785, '"internal_metadata":' 82373967 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 624, '"apply_latency_ms":' 624, '"commit_latency_ns":' 624000000, '"apply_latency_ns":' 624000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '}' '},' '"pool_stats":' '[' '{' '"poolid":' 2, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 96, '"acting":' 96, '"num_store_stats":' 3 '},' '{' '"poolid":' 1, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 96, '"acting":' 96, '"num_store_stats":' 3 '}' '],' '"osd_stats":' '[' '{' '"osd":' 0, '"seq":' 21474836505 '},' '{' '"osd":' 1, '"seq":' 42949672976 '},' '{' '"osd":' 2, '"seq":' 64424509449 '}' '],' '"num_pg_by_state":' '[' '{' '"state":' '"active+clean",' '"num":' 64 '}' '],' '"num_pg_by_osd":' '[' '{' '"osd":' 2, '"num_primary_pg":' 15, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 0, '"num_primary_pg":' 20, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 1, '"num_primary_pg":' 29, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '}' '],' '"purged_snaps":' '[' '{' '"pool":' 1, '"purged_snaps":' '{}' '},' '{' '"pool":' 2, '"purged_snaps":' '{}' '}' '],' '"servicemap":' '{' '"epoch":' 3, '"modified":' '"2024-09-16T03:24:24.403052+0000",' '"services":' '{' '"osd":' '{' '"daemons":' '{' '"summary":' '"",' '"1":' '{' '"start_epoch":' 0, '"start_stamp":' '"0.000000",' '"gid":' 0, '"addr":' '"(unrecognized' address family '0)/0",' '"metadata":' '{},' '"task_status":' '{}' '}' '}' '}' '}' '},' '"mgrstat_first_committed":' 47, '"mgrstat_last_committed":' 53, '"logm_first_committed":' 1, '"logm_last_committed":' 236, '"paxos":' '{' '"first_committed":' 1, '"last_committed":' 325, '"last_pn":' 0, '"accepted_pn":' 0 '}' '}' 2024-09-16T03:24:56.035 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:132: get_fc_lc_diff: osdm_fc=1 2024-09-16T03:24:56.035 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:134: get_fc_lc_diff: jq .osdmap_last_committed 2024-09-16T03:24:56.035 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:134: get_fc_lc_diff: echo '{' '"cluster_fingerprint":' '"fda2fc64-07ed-4add-8224-2e527e11d427",' '"version":' '"19.3.0-4930-gfc3e0bff",' '"commit":' '"fc3e0bff7468fd55478adbae7f75508b749124b6",' '"timestamp":' '"2024-09-16T03:24:55.623612+0000",' '"tag":' '"",' '"health":' '{' '"status":' '"HEALTH_OK",' '"checks":' '{},' '"mutes":' '[]' '},' '"monmap_first_committed":' 1, '"monmap_last_committed":' 1, '"monmap":' '{' '"epoch":' 1, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"modified":' '"2024-09-16T03:22:45.872880Z",' '"created":' '"2024-09-16T03:22:45.872880Z",' '"min_mon_release":' 19, '"min_mon_release_name":' '"squid",' '"election_strategy":' 1, '"disallowed_leaders:' '":' '"",' '"stretch_mode":' false, '"tiebreaker_mon":' '"",' '"removed_ranks:' '":' '"",' '"features":' '{' '"persistent":' '[' '"kraken",' '"luminous",' '"mimic",' '"osdmap-prune",' '"nautilus",' '"octopus",' '"pacific",' '"elector-pinging",' '"quincy",' '"reef",' '"squid"' '],' '"optional":' '[]' '},' '"mons":' '[' '{' '"rank":' 0, '"name":' '"a",' '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:7302",' '"nonce":' 0 '}' ']' '},' '"addr":' '"127.0.0.1:7302/0",' '"public_addr":' '"127.0.0.1:7302/0",' '"priority":' 0, '"weight":' 0, '"crush_location":' '"{}"' '}' ']' '},' '"quorum":' '[' 0 '],' '"osdmap":' '{' '"epoch":' 28, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"created":' '"2024-09-16T03:22:46.906117+0000",' '"modified":' '"2024-09-16T03:24:50.642444+0000",' '"last_up_change":' '"2024-09-16T03:24:37.708512+0000",' '"last_in_change":' '"2024-09-16T03:24:01.831039+0000",' '"flags":' '"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit",' '"flags_num":' 5799936, '"flags_set":' '[' '"pglog_hardlimit",' '"purged_snapdirs",' '"recovery_deletes",' '"sortbitwise"' '],' '"crush_version":' 7, '"full_ratio":' 0.97000002861022949, '"backfillfull_ratio":' 0.97000002861022949, '"nearfull_ratio":' 0.85000002384185791, '"cluster_snapshot":' '"",' '"pool_max":' 2, '"max_osd":' 3, '"require_min_compat_client":' '"luminous",' '"min_compat_client":' '"jewel",' '"require_osd_release":' '"squid",' '"allow_crimson":' false, '"pools":' '[' '{' '"pool":' 1, '"pool_name":' '"foo",' '"create_time":' '"2024-09-16T03:24:44.525189+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"21",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.690000057220459, '"score_stable":' 1.690000057220459, '"optimal_score":' 1, '"raw_score_acting":' 1.690000057220459, '"raw_score_stable":' 1.690000057220459, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '},' '{' '"pool":' 2, '"pool_name":' '"bar",' '"create_time":' '"2024-09-16T03:24:46.226575+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"24",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.1299999952316284, '"score_stable":' 1.1299999952316284, '"optimal_score":' 1, '"raw_score_acting":' 1.1299999952316284, '"raw_score_stable":' 1.1299999952316284, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '}' '],' '"osds":' '[' '{' '"osd":' 0, '"uuid":' '"64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 5, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6802",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6803",' '"nonce":' 3375787448 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6804",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6805",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6808",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6809",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6806",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6807",' '"nonce":' 3375787448 '}' ']' '},' '"public_addr":' '"127.0.0.1:6803/3375787448",' '"cluster_addr":' '"127.0.0.1:6805/3375787448",' '"heartbeat_back_addr":' '"127.0.0.1:6809/3375787448",' '"heartbeat_front_addr":' '"127.0.0.1:6807/3375787448",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 1, '"uuid":' '"74b26727-75c9-444d-8782-719e4197a382",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 10, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6810",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6811",' '"nonce":' 3733255132 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6812",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6813",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6816",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6817",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6814",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6815",' '"nonce":' 3733255132 '}' ']' '},' '"public_addr":' '"127.0.0.1:6811/3733255132",' '"cluster_addr":' '"127.0.0.1:6813/3733255132",' '"heartbeat_back_addr":' '"127.0.0.1:6817/3733255132",' '"heartbeat_front_addr":' '"127.0.0.1:6815/3733255132",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 2, '"uuid":' '"143da3a7-dad9-4b1e-966b-76cf5bdd3c82",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 15, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6818",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6819",' '"nonce":' 963814857 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6820",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6821",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6824",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6825",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6822",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6823",' '"nonce":' 963814857 '}' ']' '},' '"public_addr":' '"127.0.0.1:6819/963814857",' '"cluster_addr":' '"127.0.0.1:6821/963814857",' '"heartbeat_back_addr":' '"127.0.0.1:6825/963814857",' '"heartbeat_front_addr":' '"127.0.0.1:6823/963814857",' '"state":' '[' '"exists",' '"up"' ']' '}' '],' '"osd_xinfo":' '[' '{' '"osd":' 0, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:22.481942+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 1, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:59.663703+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 2, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:24:37.320822+0000",' '"dead_epoch":' 0 '}' '],' '"pg_upmap":' '[],' '"pg_upmap_items":' '[],' '"pg_upmap_primaries":' '[],' '"pg_temp":' '[],' '"primary_temp":' '[],' '"blocklist":' '{},' '"range_blocklist":' '{},' '"erasure_code_profiles":' '{' '"default":' '{' '"k":' '"2",' '"m":' '"2",' '"plugin":' '"jerasure",' '"technique":' '"reed_sol_van"' '}' '},' '"removed_snaps_queue":' '[],' '"new_removed_snaps":' '[],' '"new_purged_snaps":' '[],' '"crush_node_flags":' '{},' '"device_class_flags":' '{},' '"stretch_mode":' '{' '"stretch_mode_enabled":' false, '"stretch_bucket_count":' 0, '"degraded_stretch_mode":' 0, '"recovering_stretch_mode":' 0, '"stretch_mode_bucket":' 0 '}' '},' '"osd_metadata":' '[' '{' '"id":' 0, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/0/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:22:53.662571Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]",' '"hb_front_addr":' '"[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/0",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 1, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/1/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:23:30.129885Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]",' '"hb_front_addr":' '"[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/1",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 2, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/2/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:24:07.764502Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]",' '"hb_front_addr":' '"[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/2",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '}' '],' '"osdmap_clean_epochs":' '{' '"min_last_epoch_clean":' 0, '"last_epoch_clean":' '{' '"per_pool":' '[' '{' '"poolid":' 1, '"floor":' 23 '},' '{' '"poolid":' 2, '"floor":' 23 '}' ']' '},' '"osd_epochs":' '[' '{' '"id":' 0, '"epoch":' 16 '},' '{' '"id":' 1, '"epoch":' 16 '},' '{' '"id":' 2, '"epoch":' 23 '}' ']' '},' '"osdmap_first_committed":' 1, '"osdmap_last_committed":' 28, '"crushmap":' '{' '"devices":' '[' '{' '"id":' 0, '"name":' '"osd.0",' '"class":' '"hdd"' '},' '{' '"id":' 1, '"name":' '"osd.1",' '"class":' '"hdd"' '},' '{' '"id":' 2, '"name":' '"osd.2",' '"class":' '"hdd"' '}' '],' '"types":' '[' '{' '"type_id":' 0, '"name":' '"osd"' '},' '{' '"type_id":' 1, '"name":' '"host"' '},' '{' '"type_id":' 2, '"name":' '"chassis"' '},' '{' '"type_id":' 3, '"name":' '"rack"' '},' '{' '"type_id":' 4, '"name":' '"row"' '},' '{' '"type_id":' 5, '"name":' '"pdu"' '},' '{' '"type_id":' 6, '"name":' '"pod"' '},' '{' '"type_id":' 7, '"name":' '"room"' '},' '{' '"type_id":' 8, '"name":' '"datacenter"' '},' '{' '"type_id":' 9, '"name":' '"zone"' '},' '{' '"type_id":' 10, '"name":' '"region"' '},' '{' '"type_id":' 11, '"name":' '"root"' '}' '],' '"buckets":' '[' '{' '"id":' -1, '"name":' '"default",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -3, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -2, '"name":' '"default~hdd",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -4, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -3, '"name":' '"smithi096",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '},' '{' '"id":' -4, '"name":' '"smithi096~hdd",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '}' '],' '"rules":' '[' '{' '"rule_id":' 0, '"rule_name":' '"replicated_rule",' '"type":' 1, '"steps":' '[' '{' '"op":' '"take",' '"item":' -1, '"item_name":' '"default"' '},' '{' '"op":' '"choose_firstn",' '"num":' 0, '"type":' '"osd"' '},' '{' '"op":' '"emit"' '}' ']' '}' '],' '"tunables":' '{' '"choose_local_tries":' 0, '"choose_local_fallback_tries":' 0, '"choose_total_tries":' 50, '"chooseleaf_descend_once":' 1, '"chooseleaf_vary_r":' 1, '"chooseleaf_stable":' 1, '"msr_descents":' 100, '"msr_collision_tries":' 100, '"straw_calc_version":' 1, '"allowed_bucket_algs":' 54, '"profile":' '"jewel",' '"optimal_tunables":' 1, '"legacy_tunables":' 0, '"minimum_required_version":' '"jewel",' '"require_feature_tunables":' 1, '"require_feature_tunables2":' 1, '"has_v2_rules":' 0, '"require_feature_tunables3":' 1, '"has_v3_rules":' 0, '"has_v4_buckets":' 1, '"require_feature_tunables5":' 1, '"has_v5_rules":' 0, '"has_msr_rules":' 0 '},' '"choose_args":' '{}' '},' '"fsmap":' '{' '"epoch":' 1, '"btime":' '"2024-09-16T03:22:46:882186+0000",' '"default_fscid":' -1, '"compat":' '{' '"compat":' '{},' '"ro_compat":' '{},' '"incompat":' '{' '"feature_1":' '"base' 'v0.20",' '"feature_2":' '"client' writeable 'ranges",' '"feature_3":' '"default' file layouts on 'dirs",' '"feature_4":' '"dir' inode in separate 'object",' '"feature_5":' '"mds' uses versioned 'encoding",' '"feature_6":' '"dirfrag' is stored in 'omap",' '"feature_8":' '"no' anchor 'table",' '"feature_9":' '"file' layout 'v2",' '"feature_10":' '"snaprealm' 'v2",' '"feature_11":' '"minor' log 'segments",' '"feature_12":' '"quiesce' 'subvolumes"' '}' '},' '"feature_flags":' '{' '"enable_multiple":' true, '"ever_enabled_multiple":' true '},' '"standbys":' '[],' '"filesystems":' '[]' '},' '"mdsmap_first_committed":' 1, '"mdsmap_last_committed":' 1, '"auth":' '{' '"first_committed":' 1, '"last_committed":' 5, '"num_secrets":' 3 '},' '"num_pg":' 64, '"num_pg_active":' 64, '"num_pg_unknown":' 0, '"num_osd":' 3, '"pool_sum":' '{' '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 192, '"acting":' 192, '"num_store_stats":' 0 '},' '"osd_sum":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 192, '"num_osds":' 3, '"num_per_pool_osds":' 3, '"num_per_pool_omap_osds":' 3, '"kb":' 314572800, '"kb_used":' 81204, '"kb_used_data":' 672, '"kb_used_omap":' 4, '"kb_used_meta":' 80443, '"kb_avail":' 314491596, '"statfs":' '{' '"total":' 322122547200, '"available":' 322039394304, '"internally_reserved":' 0, '"allocated":' 688128, '"data_stored":' 200481, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 4785, '"internal_metadata":' 82373967 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 624, '"apply_latency_ms":' 624, '"commit_latency_ns":' 624000000, '"apply_latency_ns":' 624000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '},' '"osd_sum_by_class":' '{' '"hdd":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 192, '"num_osds":' 3, '"num_per_pool_osds":' 3, '"num_per_pool_omap_osds":' 3, '"kb":' 314572800, '"kb_used":' 81204, '"kb_used_data":' 672, '"kb_used_omap":' 4, '"kb_used_meta":' 80443, '"kb_avail":' 314491596, '"statfs":' '{' '"total":' 322122547200, '"available":' 322039394304, '"internally_reserved":' 0, '"allocated":' 688128, '"data_stored":' 200481, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 4785, '"internal_metadata":' 82373967 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 624, '"apply_latency_ms":' 624, '"commit_latency_ns":' 624000000, '"apply_latency_ns":' 624000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '}' '},' '"pool_stats":' '[' '{' '"poolid":' 2, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 96, '"acting":' 96, '"num_store_stats":' 3 '},' '{' '"poolid":' 1, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 96, '"acting":' 96, '"num_store_stats":' 3 '}' '],' '"osd_stats":' '[' '{' '"osd":' 0, '"seq":' 21474836505 '},' '{' '"osd":' 1, '"seq":' 42949672976 '},' '{' '"osd":' 2, '"seq":' 64424509449 '}' '],' '"num_pg_by_state":' '[' '{' '"state":' '"active+clean",' '"num":' 64 '}' '],' '"num_pg_by_osd":' '[' '{' '"osd":' 2, '"num_primary_pg":' 15, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 0, '"num_primary_pg":' 20, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 1, '"num_primary_pg":' 29, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '}' '],' '"purged_snaps":' '[' '{' '"pool":' 1, '"purged_snaps":' '{}' '},' '{' '"pool":' 2, '"purged_snaps":' '{}' '}' '],' '"servicemap":' '{' '"epoch":' 3, '"modified":' '"2024-09-16T03:24:24.403052+0000",' '"services":' '{' '"osd":' '{' '"daemons":' '{' '"summary":' '"",' '"1":' '{' '"start_epoch":' 0, '"start_stamp":' '"0.000000",' '"gid":' 0, '"addr":' '"(unrecognized' address family '0)/0",' '"metadata":' '{},' '"task_status":' '{}' '}' '}' '}' '}' '},' '"mgrstat_first_committed":' 47, '"mgrstat_last_committed":' 53, '"logm_first_committed":' 1, '"logm_last_committed":' 236, '"paxos":' '{' '"first_committed":' 1, '"last_committed":' 325, '"last_pn":' 0, '"accepted_pn":' 0 '}' '}' 2024-09-16T03:24:56.035 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:134: get_fc_lc_diff: osdm_lc=28 2024-09-16T03:24:56.035 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:136: get_fc_lc_diff: echo 27 2024-09-16T03:24:56.035 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:161: wait_for_total_num_maps: [[ 27 -gt 2 ]] 2024-09-16T03:24:56.036 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:162: wait_for_total_num_maps: (( 3 >= 27 )) 2024-09-16T03:24:56.036 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:166: wait_for_total_num_maps: sleep 0.8 2024-09-16T03:24:56.503 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:167: wait_for_total_num_maps: loop+=1 2024-09-16T03:24:56.504 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:161: wait_for_total_num_maps: get_fc_lc_diff 2024-09-16T03:24:56.505 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:130: get_fc_lc_diff: ceph report 2024-09-16T03:24:57.069 INFO:tasks.workunit.client.0.smithi096.stderr:report 1569574089 2024-09-16T03:24:57.085 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:130: get_fc_lc_diff: report='{ 2024-09-16T03:24:57.086 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_fingerprint": "fda2fc64-07ed-4add-8224-2e527e11d427", 2024-09-16T03:24:57.086 INFO:tasks.workunit.client.0.smithi096.stderr: "version": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:24:57.086 INFO:tasks.workunit.client.0.smithi096.stderr: "commit": "fc3e0bff7468fd55478adbae7f75508b749124b6", 2024-09-16T03:24:57.086 INFO:tasks.workunit.client.0.smithi096.stderr: "timestamp": "2024-09-16T03:24:57.070295+0000", 2024-09-16T03:24:57.086 INFO:tasks.workunit.client.0.smithi096.stderr: "tag": "", 2024-09-16T03:24:57.086 INFO:tasks.workunit.client.0.smithi096.stderr: "health": { 2024-09-16T03:24:57.086 INFO:tasks.workunit.client.0.smithi096.stderr: "status": "HEALTH_OK", 2024-09-16T03:24:57.086 INFO:tasks.workunit.client.0.smithi096.stderr: "checks": {}, 2024-09-16T03:24:57.086 INFO:tasks.workunit.client.0.smithi096.stderr: "mutes": [] 2024-09-16T03:24:57.086 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.086 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap_first_committed": 1, 2024-09-16T03:24:57.086 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap_last_committed": 1, 2024-09-16T03:24:57.086 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap": { 2024-09-16T03:24:57.087 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 1, 2024-09-16T03:24:57.087 INFO:tasks.workunit.client.0.smithi096.stderr: "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", 2024-09-16T03:24:57.087 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:22:45.872880Z", 2024-09-16T03:24:57.087 INFO:tasks.workunit.client.0.smithi096.stderr: "created": "2024-09-16T03:22:45.872880Z", 2024-09-16T03:24:57.087 INFO:tasks.workunit.client.0.smithi096.stderr: "min_mon_release": 19, 2024-09-16T03:24:57.087 INFO:tasks.workunit.client.0.smithi096.stderr: "min_mon_release_name": "squid", 2024-09-16T03:24:57.087 INFO:tasks.workunit.client.0.smithi096.stderr: "election_strategy": 1, 2024-09-16T03:24:57.087 INFO:tasks.workunit.client.0.smithi096.stderr: "disallowed_leaders: ": "", 2024-09-16T03:24:57.087 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode": false, 2024-09-16T03:24:57.087 INFO:tasks.workunit.client.0.smithi096.stderr: "tiebreaker_mon": "", 2024-09-16T03:24:57.087 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_ranks: ": "", 2024-09-16T03:24:57.087 INFO:tasks.workunit.client.0.smithi096.stderr: "features": { 2024-09-16T03:24:57.087 INFO:tasks.workunit.client.0.smithi096.stderr: "persistent": [ 2024-09-16T03:24:57.087 INFO:tasks.workunit.client.0.smithi096.stderr: "kraken", 2024-09-16T03:24:57.088 INFO:tasks.workunit.client.0.smithi096.stderr: "luminous", 2024-09-16T03:24:57.088 INFO:tasks.workunit.client.0.smithi096.stderr: "mimic", 2024-09-16T03:24:57.088 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap-prune", 2024-09-16T03:24:57.088 INFO:tasks.workunit.client.0.smithi096.stderr: "nautilus", 2024-09-16T03:24:57.088 INFO:tasks.workunit.client.0.smithi096.stderr: "octopus", 2024-09-16T03:24:57.088 INFO:tasks.workunit.client.0.smithi096.stderr: "pacific", 2024-09-16T03:24:57.088 INFO:tasks.workunit.client.0.smithi096.stderr: "elector-pinging", 2024-09-16T03:24:57.088 INFO:tasks.workunit.client.0.smithi096.stderr: "quincy", 2024-09-16T03:24:57.088 INFO:tasks.workunit.client.0.smithi096.stderr: "reef", 2024-09-16T03:24:57.088 INFO:tasks.workunit.client.0.smithi096.stderr: "squid" 2024-09-16T03:24:57.088 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:57.088 INFO:tasks.workunit.client.0.smithi096.stderr: "optional": [] 2024-09-16T03:24:57.088 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.089 INFO:tasks.workunit.client.0.smithi096.stderr: "mons": [ 2024-09-16T03:24:57.089 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.089 INFO:tasks.workunit.client.0.smithi096.stderr: "rank": 0, 2024-09-16T03:24:57.089 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "a", 2024-09-16T03:24:57.089 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:24:57.089 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:57.089 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.089 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:57.089 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:7302", 2024-09-16T03:24:57.089 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 0 2024-09-16T03:24:57.089 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:57.089 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:57.089 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.090 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:7302/0", 2024-09-16T03:24:57.090 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:7302/0", 2024-09-16T03:24:57.090 INFO:tasks.workunit.client.0.smithi096.stderr: "priority": 0, 2024-09-16T03:24:57.090 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 0, 2024-09-16T03:24:57.090 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_location": "{}" 2024-09-16T03:24:57.090 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:57.090 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:57.090 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.090 INFO:tasks.workunit.client.0.smithi096.stderr: "quorum": [ 2024-09-16T03:24:57.090 INFO:tasks.workunit.client.0.smithi096.stderr: 0 2024-09-16T03:24:57.090 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:57.090 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap": { 2024-09-16T03:24:57.090 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 28, 2024-09-16T03:24:57.091 INFO:tasks.workunit.client.0.smithi096.stderr: "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", 2024-09-16T03:24:57.091 INFO:tasks.workunit.client.0.smithi096.stderr: "created": "2024-09-16T03:22:46.906117+0000", 2024-09-16T03:24:57.091 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:24:50.642444+0000", 2024-09-16T03:24:57.091 INFO:tasks.workunit.client.0.smithi096.stderr: "last_up_change": "2024-09-16T03:24:37.708512+0000", 2024-09-16T03:24:57.091 INFO:tasks.workunit.client.0.smithi096.stderr: "last_in_change": "2024-09-16T03:24:01.831039+0000", 2024-09-16T03:24:57.091 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-16T03:24:57.091 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_num": 5799936, 2024-09-16T03:24:57.091 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_set": [ 2024-09-16T03:24:57.091 INFO:tasks.workunit.client.0.smithi096.stderr: "pglog_hardlimit", 2024-09-16T03:24:57.091 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snapdirs", 2024-09-16T03:24:57.091 INFO:tasks.workunit.client.0.smithi096.stderr: "recovery_deletes", 2024-09-16T03:24:57.091 INFO:tasks.workunit.client.0.smithi096.stderr: "sortbitwise" 2024-09-16T03:24:57.091 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:57.091 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_version": 7, 2024-09-16T03:24:57.091 INFO:tasks.workunit.client.0.smithi096.stderr: "full_ratio": 0.97000002861022949, 2024-09-16T03:24:57.092 INFO:tasks.workunit.client.0.smithi096.stderr: "backfillfull_ratio": 0.97000002861022949, 2024-09-16T03:24:57.092 INFO:tasks.workunit.client.0.smithi096.stderr: "nearfull_ratio": 0.85000002384185791, 2024-09-16T03:24:57.092 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_snapshot": "", 2024-09-16T03:24:57.092 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_max": 2, 2024-09-16T03:24:57.092 INFO:tasks.workunit.client.0.smithi096.stderr: "max_osd": 3, 2024-09-16T03:24:57.092 INFO:tasks.workunit.client.0.smithi096.stderr: "require_min_compat_client": "luminous", 2024-09-16T03:24:57.092 INFO:tasks.workunit.client.0.smithi096.stderr: "min_compat_client": "jewel", 2024-09-16T03:24:57.092 INFO:tasks.workunit.client.0.smithi096.stderr: "require_osd_release": "squid", 2024-09-16T03:24:57.092 INFO:tasks.workunit.client.0.smithi096.stderr: "allow_crimson": false, 2024-09-16T03:24:57.092 INFO:tasks.workunit.client.0.smithi096.stderr: "pools": [ 2024-09-16T03:24:57.092 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.092 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 1, 2024-09-16T03:24:57.092 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_name": "foo", 2024-09-16T03:24:57.093 INFO:tasks.workunit.client.0.smithi096.stderr: "create_time": "2024-09-16T03:24:44.525189+0000", 2024-09-16T03:24:57.093 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": 1, 2024-09-16T03:24:57.093 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_names": "hashpspool", 2024-09-16T03:24:57.093 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:24:57.093 INFO:tasks.workunit.client.0.smithi096.stderr: "size": 3, 2024-09-16T03:24:57.093 INFO:tasks.workunit.client.0.smithi096.stderr: "min_size": 2, 2024-09-16T03:24:57.093 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_rule": 0, 2024-09-16T03:24:57.093 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_count": 0, 2024-09-16T03:24:57.093 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_target": 0, 2024-09-16T03:24:57.093 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_barrier": 0, 2024-09-16T03:24:57.093 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-16T03:24:57.093 INFO:tasks.workunit.client.0.smithi096.stderr: "is_stretch_pool": false, 2024-09-16T03:24:57.093 INFO:tasks.workunit.client.0.smithi096.stderr: "object_hash": 2, 2024-09-16T03:24:57.093 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_autoscale_mode": "off", 2024-09-16T03:24:57.094 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num": 32, 2024-09-16T03:24:57.094 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num": 32, 2024-09-16T03:24:57.094 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num_target": 32, 2024-09-16T03:24:57.094 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_target": 32, 2024-09-16T03:24:57.094 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_pending": 32, 2024-09-16T03:24:57.094 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pg_merge_meta": { 2024-09-16T03:24:57.094 INFO:tasks.workunit.client.0.smithi096.stderr: "source_pgid": "0.0", 2024-09-16T03:24:57.094 INFO:tasks.workunit.client.0.smithi096.stderr: "ready_epoch": 0, 2024-09-16T03:24:57.094 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_started": 0, 2024-09-16T03:24:57.094 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": 0, 2024-09-16T03:24:57.094 INFO:tasks.workunit.client.0.smithi096.stderr: "source_version": "0'\''0", 2024-09-16T03:24:57.094 INFO:tasks.workunit.client.0.smithi096.stderr: "target_version": "0'\''0" 2024-09-16T03:24:57.094 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.094 INFO:tasks.workunit.client.0.smithi096.stderr: "last_change": "21", 2024-09-16T03:24:57.095 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend": "0", 2024-09-16T03:24:57.095 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_prenautilus": "0", 2024-09-16T03:24:57.095 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_preluminous": "0", 2024-09-16T03:24:57.095 INFO:tasks.workunit.client.0.smithi096.stderr: "auid": 0, 2024-09-16T03:24:57.095 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_mode": "selfmanaged", 2024-09-16T03:24:57.095 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_seq": 0, 2024-09-16T03:24:57.095 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_epoch": 0, 2024-09-16T03:24:57.095 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_snaps": [], 2024-09-16T03:24:57.095 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps": "[]", 2024-09-16T03:24:57.095 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_bytes": 0, 2024-09-16T03:24:57.095 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_objects": 0, 2024-09-16T03:24:57.095 INFO:tasks.workunit.client.0.smithi096.stderr: "tiers": [], 2024-09-16T03:24:57.095 INFO:tasks.workunit.client.0.smithi096.stderr: "tier_of": -1, 2024-09-16T03:24:57.095 INFO:tasks.workunit.client.0.smithi096.stderr: "read_tier": -1, 2024-09-16T03:24:57.095 INFO:tasks.workunit.client.0.smithi096.stderr: "write_tier": -1, 2024-09-16T03:24:57.095 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_mode": "none", 2024-09-16T03:24:57.096 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_bytes": 0, 2024-09-16T03:24:57.096 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_objects": 0, 2024-09-16T03:24:57.096 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_ratio_micro": 400000, 2024-09-16T03:24:57.096 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-16T03:24:57.096 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_full_ratio_micro": 800000, 2024-09-16T03:24:57.096 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_flush_age": 0, 2024-09-16T03:24:57.096 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_evict_age": 0, 2024-09-16T03:24:57.096 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profile": "", 2024-09-16T03:24:57.096 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_params": { 2024-09-16T03:24:57.096 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "none" 2024-09-16T03:24:57.096 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.096 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_period": 0, 2024-09-16T03:24:57.096 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_count": 0, 2024-09-16T03:24:57.096 INFO:tasks.workunit.client.0.smithi096.stderr: "use_gmt_hitset": true, 2024-09-16T03:24:57.097 INFO:tasks.workunit.client.0.smithi096.stderr: "min_read_recency_for_promote": 0, 2024-09-16T03:24:57.097 INFO:tasks.workunit.client.0.smithi096.stderr: "min_write_recency_for_promote": 0, 2024-09-16T03:24:57.097 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_grade_decay_rate": 0, 2024-09-16T03:24:57.097 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_search_last_n": 0, 2024-09-16T03:24:57.097 INFO:tasks.workunit.client.0.smithi096.stderr: "grade_table": [], 2024-09-16T03:24:57.097 INFO:tasks.workunit.client.0.smithi096.stderr: "stripe_width": 0, 2024-09-16T03:24:57.097 INFO:tasks.workunit.client.0.smithi096.stderr: "expected_num_objects": 0, 2024-09-16T03:24:57.097 INFO:tasks.workunit.client.0.smithi096.stderr: "fast_read": false, 2024-09-16T03:24:57.097 INFO:tasks.workunit.client.0.smithi096.stderr: "options": {}, 2024-09-16T03:24:57.097 INFO:tasks.workunit.client.0.smithi096.stderr: "application_metadata": {}, 2024-09-16T03:24:57.097 INFO:tasks.workunit.client.0.smithi096.stderr: "read_balance": { 2024-09-16T03:24:57.097 INFO:tasks.workunit.client.0.smithi096.stderr: "score_type": "Fair distribution", 2024-09-16T03:24:57.097 INFO:tasks.workunit.client.0.smithi096.stderr: "score_acting": 1.690000057220459, 2024-09-16T03:24:57.097 INFO:tasks.workunit.client.0.smithi096.stderr: "score_stable": 1.690000057220459, 2024-09-16T03:24:57.097 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_score": 1, 2024-09-16T03:24:57.098 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_acting": 1.690000057220459, 2024-09-16T03:24:57.098 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_stable": 1.690000057220459, 2024-09-16T03:24:57.098 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity_weighted": 1, 2024-09-16T03:24:57.098 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity": 1, 2024-09-16T03:24:57.098 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity_weighted": 1 2024-09-16T03:24:57.098 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:57.098 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.098 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.098 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 2, 2024-09-16T03:24:57.098 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_name": "bar", 2024-09-16T03:24:57.098 INFO:tasks.workunit.client.0.smithi096.stderr: "create_time": "2024-09-16T03:24:46.226575+0000", 2024-09-16T03:24:57.098 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": 1, 2024-09-16T03:24:57.098 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_names": "hashpspool", 2024-09-16T03:24:57.098 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:24:57.098 INFO:tasks.workunit.client.0.smithi096.stderr: "size": 3, 2024-09-16T03:24:57.099 INFO:tasks.workunit.client.0.smithi096.stderr: "min_size": 2, 2024-09-16T03:24:57.099 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_rule": 0, 2024-09-16T03:24:57.099 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_count": 0, 2024-09-16T03:24:57.099 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_target": 0, 2024-09-16T03:24:57.099 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_barrier": 0, 2024-09-16T03:24:57.099 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-16T03:24:57.099 INFO:tasks.workunit.client.0.smithi096.stderr: "is_stretch_pool": false, 2024-09-16T03:24:57.099 INFO:tasks.workunit.client.0.smithi096.stderr: "object_hash": 2, 2024-09-16T03:24:57.099 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_autoscale_mode": "off", 2024-09-16T03:24:57.099 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num": 32, 2024-09-16T03:24:57.099 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num": 32, 2024-09-16T03:24:57.099 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num_target": 32, 2024-09-16T03:24:57.099 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_target": 32, 2024-09-16T03:24:57.099 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_pending": 32, 2024-09-16T03:24:57.099 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pg_merge_meta": { 2024-09-16T03:24:57.100 INFO:tasks.workunit.client.0.smithi096.stderr: "source_pgid": "0.0", 2024-09-16T03:24:57.100 INFO:tasks.workunit.client.0.smithi096.stderr: "ready_epoch": 0, 2024-09-16T03:24:57.100 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_started": 0, 2024-09-16T03:24:57.100 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": 0, 2024-09-16T03:24:57.100 INFO:tasks.workunit.client.0.smithi096.stderr: "source_version": "0'\''0", 2024-09-16T03:24:57.100 INFO:tasks.workunit.client.0.smithi096.stderr: "target_version": "0'\''0" 2024-09-16T03:24:57.100 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.100 INFO:tasks.workunit.client.0.smithi096.stderr: "last_change": "24", 2024-09-16T03:24:57.100 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend": "0", 2024-09-16T03:24:57.100 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_prenautilus": "0", 2024-09-16T03:24:57.100 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_preluminous": "0", 2024-09-16T03:24:57.100 INFO:tasks.workunit.client.0.smithi096.stderr: "auid": 0, 2024-09-16T03:24:57.101 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_mode": "selfmanaged", 2024-09-16T03:24:57.101 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_seq": 0, 2024-09-16T03:24:57.101 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_epoch": 0, 2024-09-16T03:24:57.101 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_snaps": [], 2024-09-16T03:24:57.101 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps": "[]", 2024-09-16T03:24:57.102 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_bytes": 0, 2024-09-16T03:24:57.102 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_objects": 0, 2024-09-16T03:24:57.102 INFO:tasks.workunit.client.0.smithi096.stderr: "tiers": [], 2024-09-16T03:24:57.102 INFO:tasks.workunit.client.0.smithi096.stderr: "tier_of": -1, 2024-09-16T03:24:57.102 INFO:tasks.workunit.client.0.smithi096.stderr: "read_tier": -1, 2024-09-16T03:24:57.102 INFO:tasks.workunit.client.0.smithi096.stderr: "write_tier": -1, 2024-09-16T03:24:57.102 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_mode": "none", 2024-09-16T03:24:57.102 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_bytes": 0, 2024-09-16T03:24:57.102 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_objects": 0, 2024-09-16T03:24:57.102 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_ratio_micro": 400000, 2024-09-16T03:24:57.102 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-16T03:24:57.103 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_full_ratio_micro": 800000, 2024-09-16T03:24:57.103 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_flush_age": 0, 2024-09-16T03:24:57.103 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_evict_age": 0, 2024-09-16T03:24:57.103 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profile": "", 2024-09-16T03:24:57.103 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_params": { 2024-09-16T03:24:57.103 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "none" 2024-09-16T03:24:57.103 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.103 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_period": 0, 2024-09-16T03:24:57.103 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_count": 0, 2024-09-16T03:24:57.103 INFO:tasks.workunit.client.0.smithi096.stderr: "use_gmt_hitset": true, 2024-09-16T03:24:57.103 INFO:tasks.workunit.client.0.smithi096.stderr: "min_read_recency_for_promote": 0, 2024-09-16T03:24:57.103 INFO:tasks.workunit.client.0.smithi096.stderr: "min_write_recency_for_promote": 0, 2024-09-16T03:24:57.103 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_grade_decay_rate": 0, 2024-09-16T03:24:57.103 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_search_last_n": 0, 2024-09-16T03:24:57.104 INFO:tasks.workunit.client.0.smithi096.stderr: "grade_table": [], 2024-09-16T03:24:57.104 INFO:tasks.workunit.client.0.smithi096.stderr: "stripe_width": 0, 2024-09-16T03:24:57.104 INFO:tasks.workunit.client.0.smithi096.stderr: "expected_num_objects": 0, 2024-09-16T03:24:57.104 INFO:tasks.workunit.client.0.smithi096.stderr: "fast_read": false, 2024-09-16T03:24:57.104 INFO:tasks.workunit.client.0.smithi096.stderr: "options": {}, 2024-09-16T03:24:57.104 INFO:tasks.workunit.client.0.smithi096.stderr: "application_metadata": {}, 2024-09-16T03:24:57.104 INFO:tasks.workunit.client.0.smithi096.stderr: "read_balance": { 2024-09-16T03:24:57.104 INFO:tasks.workunit.client.0.smithi096.stderr: "score_type": "Fair distribution", 2024-09-16T03:24:57.104 INFO:tasks.workunit.client.0.smithi096.stderr: "score_acting": 1.1299999952316284, 2024-09-16T03:24:57.104 INFO:tasks.workunit.client.0.smithi096.stderr: "score_stable": 1.1299999952316284, 2024-09-16T03:24:57.104 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_score": 1, 2024-09-16T03:24:57.104 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_acting": 1.1299999952316284, 2024-09-16T03:24:57.104 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_stable": 1.1299999952316284, 2024-09-16T03:24:57.104 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity_weighted": 1, 2024-09-16T03:24:57.105 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity": 1, 2024-09-16T03:24:57.105 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity_weighted": 1 2024-09-16T03:24:57.105 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:57.105 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:57.105 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:57.105 INFO:tasks.workunit.client.0.smithi096.stderr: "osds": [ 2024-09-16T03:24:57.105 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.105 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:24:57.105 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6", 2024-09-16T03:24:57.105 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:24:57.105 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:24:57.105 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:24:57.105 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:24:57.106 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:24:57.106 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:24:57.106 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 5, 2024-09-16T03:24:57.106 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 21, 2024-09-16T03:24:57.106 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:24:57.106 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:24:57.107 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:24:57.107 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:57.107 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.107 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:57.107 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6802", 2024-09-16T03:24:57.107 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:24:57.107 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.107 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.107 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:57.107 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6803", 2024-09-16T03:24:57.107 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:24:57.107 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:57.108 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:57.108 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.108 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:24:57.108 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:57.108 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.108 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:57.108 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6804", 2024-09-16T03:24:57.108 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:24:57.108 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.108 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.108 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:57.108 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6805", 2024-09-16T03:24:57.108 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:24:57.108 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:57.109 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:57.109 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.109 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:24:57.109 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:57.109 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.109 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:57.109 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6808", 2024-09-16T03:24:57.109 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:24:57.109 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.109 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.109 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:57.109 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6809", 2024-09-16T03:24:57.109 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:24:57.109 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:57.110 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:57.111 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.112 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:24:57.112 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:57.112 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.112 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:57.112 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6806", 2024-09-16T03:24:57.112 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:24:57.112 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.112 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.112 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:57.113 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6807", 2024-09-16T03:24:57.113 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:24:57.113 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:57.113 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:57.113 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.113 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6803/3375787448", 2024-09-16T03:24:57.113 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6805/3375787448", 2024-09-16T03:24:57.113 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6809/3375787448", 2024-09-16T03:24:57.113 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6807/3375787448", 2024-09-16T03:24:57.113 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:24:57.113 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:24:57.113 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:24:57.113 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:57.113 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.114 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.114 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:24:57.114 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "74b26727-75c9-444d-8782-719e4197a382", 2024-09-16T03:24:57.114 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:24:57.114 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:24:57.114 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:24:57.114 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:24:57.114 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:24:57.114 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:24:57.114 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 10, 2024-09-16T03:24:57.114 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 21, 2024-09-16T03:24:57.114 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:24:57.114 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:24:57.114 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:24:57.115 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:57.115 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.115 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:57.115 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6810", 2024-09-16T03:24:57.115 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:24:57.115 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.115 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.115 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:57.115 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6811", 2024-09-16T03:24:57.115 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:24:57.115 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:57.116 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:57.116 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.116 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:24:57.116 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:57.116 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.116 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:57.116 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6812", 2024-09-16T03:24:57.116 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:24:57.116 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.116 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.116 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:57.116 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6813", 2024-09-16T03:24:57.116 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:24:57.116 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:57.117 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:57.117 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.117 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:24:57.117 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:57.117 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.117 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:57.117 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6816", 2024-09-16T03:24:57.117 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:24:57.117 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.117 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.117 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:57.117 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6817", 2024-09-16T03:24:57.117 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:24:57.117 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:57.118 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:57.118 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.118 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:24:57.118 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:57.118 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.118 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:57.118 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6814", 2024-09-16T03:24:57.118 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:24:57.118 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.118 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.118 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:57.118 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6815", 2024-09-16T03:24:57.118 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:24:57.119 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:57.119 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:57.119 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.119 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6811/3733255132", 2024-09-16T03:24:57.119 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6813/3733255132", 2024-09-16T03:24:57.119 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6817/3733255132", 2024-09-16T03:24:57.119 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6815/3733255132", 2024-09-16T03:24:57.119 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:24:57.119 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:24:57.119 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:24:57.119 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:57.119 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.120 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.120 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:24:57.120 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "143da3a7-dad9-4b1e-966b-76cf5bdd3c82", 2024-09-16T03:24:57.120 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:24:57.120 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:24:57.120 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:24:57.120 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:24:57.120 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:24:57.120 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:24:57.120 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 15, 2024-09-16T03:24:57.120 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 21, 2024-09-16T03:24:57.120 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:24:57.120 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:24:57.120 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:24:57.121 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:57.121 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.121 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:57.121 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6818", 2024-09-16T03:24:57.121 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:24:57.121 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.121 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.121 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:57.121 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6819", 2024-09-16T03:24:57.121 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:24:57.121 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:57.121 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:57.121 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.121 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:24:57.122 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:57.122 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.122 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:57.122 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6820", 2024-09-16T03:24:57.122 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:24:57.122 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.122 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.122 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:57.122 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6821", 2024-09-16T03:24:57.123 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:24:57.123 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:57.123 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:57.123 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.123 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:24:57.123 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:57.123 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.123 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:57.123 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6824", 2024-09-16T03:24:57.123 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:24:57.123 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.123 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.123 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:57.124 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6825", 2024-09-16T03:24:57.124 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:24:57.124 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:57.124 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:57.124 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.124 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:24:57.124 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:57.124 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.124 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:57.124 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6822", 2024-09-16T03:24:57.124 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:24:57.124 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.124 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.125 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:57.125 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6823", 2024-09-16T03:24:57.125 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:24:57.126 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:57.126 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:57.126 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.126 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6819/963814857", 2024-09-16T03:24:57.126 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6821/963814857", 2024-09-16T03:24:57.126 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6825/963814857", 2024-09-16T03:24:57.126 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6823/963814857", 2024-09-16T03:24:57.126 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:24:57.126 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:24:57.127 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:24:57.127 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:57.127 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:57.127 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:57.127 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_xinfo": [ 2024-09-16T03:24:57.127 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.127 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:24:57.127 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:24:57.127 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:24:57.127 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:24:57.127 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:24:57.127 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:24:57.127 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:23:22.481942+0000", 2024-09-16T03:24:57.128 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:24:57.128 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.128 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.128 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:24:57.128 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:24:57.128 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:24:57.128 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:24:57.128 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:24:57.128 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:24:57.128 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:23:59.663703+0000", 2024-09-16T03:24:57.128 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:24:57.128 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.128 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.129 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:24:57.129 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:24:57.129 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:24:57.129 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:24:57.129 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:24:57.129 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:24:57.129 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:24:37.320822+0000", 2024-09-16T03:24:57.129 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:24:57.129 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:57.129 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:57.129 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap": [], 2024-09-16T03:24:57.129 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap_items": [], 2024-09-16T03:24:57.129 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap_primaries": [], 2024-09-16T03:24:57.130 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_temp": [], 2024-09-16T03:24:57.130 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_temp": [], 2024-09-16T03:24:57.130 INFO:tasks.workunit.client.0.smithi096.stderr: "blocklist": {}, 2024-09-16T03:24:57.130 INFO:tasks.workunit.client.0.smithi096.stderr: "range_blocklist": {}, 2024-09-16T03:24:57.130 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profiles": { 2024-09-16T03:24:57.130 INFO:tasks.workunit.client.0.smithi096.stderr: "default": { 2024-09-16T03:24:57.130 INFO:tasks.workunit.client.0.smithi096.stderr: "k": "2", 2024-09-16T03:24:57.130 INFO:tasks.workunit.client.0.smithi096.stderr: "m": "2", 2024-09-16T03:24:57.130 INFO:tasks.workunit.client.0.smithi096.stderr: "plugin": "jerasure", 2024-09-16T03:24:57.130 INFO:tasks.workunit.client.0.smithi096.stderr: "technique": "reed_sol_van" 2024-09-16T03:24:57.130 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:57.130 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.130 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps_queue": [], 2024-09-16T03:24:57.130 INFO:tasks.workunit.client.0.smithi096.stderr: "new_removed_snaps": [], 2024-09-16T03:24:57.131 INFO:tasks.workunit.client.0.smithi096.stderr: "new_purged_snaps": [], 2024-09-16T03:24:57.131 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_node_flags": {}, 2024-09-16T03:24:57.131 INFO:tasks.workunit.client.0.smithi096.stderr: "device_class_flags": {}, 2024-09-16T03:24:57.131 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode": { 2024-09-16T03:24:57.131 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode_enabled": false, 2024-09-16T03:24:57.131 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_bucket_count": 0, 2024-09-16T03:24:57.131 INFO:tasks.workunit.client.0.smithi096.stderr: "degraded_stretch_mode": 0, 2024-09-16T03:24:57.131 INFO:tasks.workunit.client.0.smithi096.stderr: "recovering_stretch_mode": 0, 2024-09-16T03:24:57.131 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode_bucket": 0 2024-09-16T03:24:57.131 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:57.131 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.131 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_metadata": [ 2024-09-16T03:24:57.131 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.131 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:24:57.132 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:24:57.132 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]", 2024-09-16T03:24:57.132 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:24:57.132 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:24:57.132 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:24:57.132 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:24:57.132 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:24:57.132 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:24:57.132 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:24:57.132 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:24:57.132 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:24:57.132 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:24:57.132 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:24:57.132 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/0/block", 2024-09-16T03:24:57.133 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:24:57.133 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:24:57.133 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:24:57.133 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:24:57.133 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:24:57.133 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:24:57.133 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:24:57.133 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:24:57.133 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:24:57.133 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:24:57.133 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:22:53.662571Z", 2024-09-16T03:24:57.133 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:24:57.133 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:24:57.133 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:24:57.134 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:24:57.134 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:24:57.134 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:24:57.134 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:24:57.134 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]", 2024-09-16T03:24:57.134 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:24:57.134 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]", 2024-09-16T03:24:57.134 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]", 2024-09-16T03:24:57.134 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:24:57.134 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:24:57.134 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:24:57.134 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:24:57.134 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:24:57.134 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:24:57.134 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:24:57.135 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:24:57.135 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:24:57.135 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/0", 2024-09-16T03:24:57.135 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:24:57.135 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:24:57.135 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:24:57.135 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.135 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.135 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:24:57.135 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:24:57.135 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]", 2024-09-16T03:24:57.135 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:24:57.135 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:24:57.135 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:24:57.135 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:24:57.136 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:24:57.136 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:24:57.136 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:24:57.136 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:24:57.136 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:24:57.136 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:24:57.136 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:24:57.136 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/1/block", 2024-09-16T03:24:57.136 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:24:57.136 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:24:57.136 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:24:57.136 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:24:57.136 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:24:57.136 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:24:57.137 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:24:57.137 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:24:57.137 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:24:57.137 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:24:57.137 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:23:30.129885Z", 2024-09-16T03:24:57.137 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:24:57.137 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:24:57.137 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:24:57.137 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:24:57.137 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:24:57.137 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:24:57.137 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:24:57.137 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]", 2024-09-16T03:24:57.137 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:24:57.138 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]", 2024-09-16T03:24:57.138 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]", 2024-09-16T03:24:57.138 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:24:57.138 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:24:57.138 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:24:57.138 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:24:57.138 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:24:57.138 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:24:57.138 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:24:57.138 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:24:57.138 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:24:57.138 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/1", 2024-09-16T03:24:57.138 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:24:57.138 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:24:57.139 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:24:57.139 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.139 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.139 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:24:57.139 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:24:57.139 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]", 2024-09-16T03:24:57.139 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:24:57.139 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:24:57.139 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:24:57.139 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:24:57.139 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:24:57.139 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:24:57.139 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:24:57.139 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:24:57.140 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:24:57.140 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:24:57.140 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:24:57.140 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/2/block", 2024-09-16T03:24:57.140 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:24:57.140 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:24:57.140 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:24:57.140 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:24:57.140 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:24:57.140 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:24:57.140 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:24:57.140 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:24:57.140 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:24:57.140 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:24:57.141 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:24:07.764502Z", 2024-09-16T03:24:57.141 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:24:57.141 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:24:57.141 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:24:57.141 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:24:57.141 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:24:57.141 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:24:57.141 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:24:57.141 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]", 2024-09-16T03:24:57.141 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:24:57.141 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]", 2024-09-16T03:24:57.141 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]", 2024-09-16T03:24:57.141 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:24:57.141 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:24:57.141 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:24:57.142 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:24:57.142 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:24:57.142 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:24:57.142 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:24:57.142 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:24:57.142 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:24:57.142 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/2", 2024-09-16T03:24:57.142 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:24:57.142 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:24:57.142 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:24:57.142 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:57.142 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:57.142 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_clean_epochs": { 2024-09-16T03:24:57.142 INFO:tasks.workunit.client.0.smithi096.stderr: "min_last_epoch_clean": 23, 2024-09-16T03:24:57.143 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": { 2024-09-16T03:24:57.143 INFO:tasks.workunit.client.0.smithi096.stderr: "per_pool": [ 2024-09-16T03:24:57.143 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.143 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 1, 2024-09-16T03:24:57.143 INFO:tasks.workunit.client.0.smithi096.stderr: "floor": 23 2024-09-16T03:24:57.143 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.143 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.143 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 2, 2024-09-16T03:24:57.143 INFO:tasks.workunit.client.0.smithi096.stderr: "floor": 23 2024-09-16T03:24:57.143 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:57.143 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:57.143 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.143 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_epochs": [ 2024-09-16T03:24:57.143 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.143 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:24:57.144 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 28 2024-09-16T03:24:57.144 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.144 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.144 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:24:57.144 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 28 2024-09-16T03:24:57.144 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.144 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.144 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:24:57.144 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 23 2024-09-16T03:24:57.144 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:57.144 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:57.144 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.144 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_first_committed": 1, 2024-09-16T03:24:57.144 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_last_committed": 28, 2024-09-16T03:24:57.145 INFO:tasks.workunit.client.0.smithi096.stderr: "crushmap": { 2024-09-16T03:24:57.145 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": [ 2024-09-16T03:24:57.145 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.145 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:24:57.145 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.0", 2024-09-16T03:24:57.145 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:24:57.145 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.145 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.145 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:24:57.145 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.1", 2024-09-16T03:24:57.145 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:24:57.145 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.145 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.145 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:24:57.146 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.2", 2024-09-16T03:24:57.146 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:24:57.146 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:57.146 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:57.146 INFO:tasks.workunit.client.0.smithi096.stderr: "types": [ 2024-09-16T03:24:57.146 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.146 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 0, 2024-09-16T03:24:57.146 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd" 2024-09-16T03:24:57.146 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.146 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.146 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:24:57.146 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "host" 2024-09-16T03:24:57.146 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.146 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.147 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 2, 2024-09-16T03:24:57.147 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "chassis" 2024-09-16T03:24:57.147 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.147 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.147 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 3, 2024-09-16T03:24:57.147 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "rack" 2024-09-16T03:24:57.147 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.147 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.147 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 4, 2024-09-16T03:24:57.147 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "row" 2024-09-16T03:24:57.147 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.147 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.147 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 5, 2024-09-16T03:24:57.147 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "pdu" 2024-09-16T03:24:57.147 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.148 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.148 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 6, 2024-09-16T03:24:57.148 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "pod" 2024-09-16T03:24:57.148 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.148 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.148 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 7, 2024-09-16T03:24:57.148 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "room" 2024-09-16T03:24:57.148 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.148 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.148 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 8, 2024-09-16T03:24:57.148 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "datacenter" 2024-09-16T03:24:57.148 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.148 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.148 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 9, 2024-09-16T03:24:57.149 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "zone" 2024-09-16T03:24:57.149 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.149 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.149 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 10, 2024-09-16T03:24:57.149 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "region" 2024-09-16T03:24:57.149 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.149 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.149 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:24:57.149 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "root" 2024-09-16T03:24:57.149 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:57.149 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:57.149 INFO:tasks.workunit.client.0.smithi096.stderr: "buckets": [ 2024-09-16T03:24:57.149 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.149 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -1, 2024-09-16T03:24:57.150 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "default", 2024-09-16T03:24:57.150 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:24:57.150 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "root", 2024-09-16T03:24:57.150 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:24:57.150 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:24:57.150 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:24:57.150 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:24:57.150 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.150 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -3, 2024-09-16T03:24:57.150 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:24:57.150 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:24:57.150 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:57.150 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:57.150 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.150 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.151 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -2, 2024-09-16T03:24:57.151 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "default~hdd", 2024-09-16T03:24:57.151 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:24:57.151 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "root", 2024-09-16T03:24:57.151 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:24:57.151 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:24:57.151 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:24:57.151 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:24:57.151 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.151 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -4, 2024-09-16T03:24:57.151 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:24:57.151 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:24:57.151 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:57.151 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:57.152 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.152 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.152 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -3, 2024-09-16T03:24:57.152 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "smithi096", 2024-09-16T03:24:57.152 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:24:57.152 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "host", 2024-09-16T03:24:57.152 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:24:57.152 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:24:57.152 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:24:57.152 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:24:57.152 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.152 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:24:57.152 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:24:57.153 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:24:57.153 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.153 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.153 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:24:57.153 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:24:57.153 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 1 2024-09-16T03:24:57.153 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.153 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.153 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:24:57.153 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:24:57.153 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 2 2024-09-16T03:24:57.153 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:57.153 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:57.153 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.154 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.154 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -4, 2024-09-16T03:24:57.154 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "smithi096~hdd", 2024-09-16T03:24:57.154 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:24:57.154 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "host", 2024-09-16T03:24:57.154 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:24:57.154 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:24:57.154 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:24:57.154 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:24:57.155 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.155 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:24:57.155 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:24:57.155 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:24:57.155 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.155 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.155 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:24:57.155 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:24:57.155 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 1 2024-09-16T03:24:57.155 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.155 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.155 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:24:57.156 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:24:57.156 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 2 2024-09-16T03:24:57.156 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:57.156 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:57.156 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:57.156 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:57.156 INFO:tasks.workunit.client.0.smithi096.stderr: "rules": [ 2024-09-16T03:24:57.156 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.156 INFO:tasks.workunit.client.0.smithi096.stderr: "rule_id": 0, 2024-09-16T03:24:57.156 INFO:tasks.workunit.client.0.smithi096.stderr: "rule_name": "replicated_rule", 2024-09-16T03:24:57.156 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:24:57.157 INFO:tasks.workunit.client.0.smithi096.stderr: "steps": [ 2024-09-16T03:24:57.157 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.157 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "take", 2024-09-16T03:24:57.157 INFO:tasks.workunit.client.0.smithi096.stderr: "item": -1, 2024-09-16T03:24:57.157 INFO:tasks.workunit.client.0.smithi096.stderr: "item_name": "default" 2024-09-16T03:24:57.157 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.157 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.157 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "choose_firstn", 2024-09-16T03:24:57.157 INFO:tasks.workunit.client.0.smithi096.stderr: "num": 0, 2024-09-16T03:24:57.157 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "osd" 2024-09-16T03:24:57.157 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.158 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.158 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "emit" 2024-09-16T03:24:57.158 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:57.158 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:57.158 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:57.158 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:57.158 INFO:tasks.workunit.client.0.smithi096.stderr: "tunables": { 2024-09-16T03:24:57.158 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_local_tries": 0, 2024-09-16T03:24:57.158 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_local_fallback_tries": 0, 2024-09-16T03:24:57.158 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_total_tries": 50, 2024-09-16T03:24:57.159 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_descend_once": 1, 2024-09-16T03:24:57.159 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_vary_r": 1, 2024-09-16T03:24:57.159 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_stable": 1, 2024-09-16T03:24:57.159 INFO:tasks.workunit.client.0.smithi096.stderr: "msr_descents": 100, 2024-09-16T03:24:57.159 INFO:tasks.workunit.client.0.smithi096.stderr: "msr_collision_tries": 100, 2024-09-16T03:24:57.159 INFO:tasks.workunit.client.0.smithi096.stderr: "straw_calc_version": 1, 2024-09-16T03:24:57.159 INFO:tasks.workunit.client.0.smithi096.stderr: "allowed_bucket_algs": 54, 2024-09-16T03:24:57.159 INFO:tasks.workunit.client.0.smithi096.stderr: "profile": "jewel", 2024-09-16T03:24:57.159 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_tunables": 1, 2024-09-16T03:24:57.159 INFO:tasks.workunit.client.0.smithi096.stderr: "legacy_tunables": 0, 2024-09-16T03:24:57.160 INFO:tasks.workunit.client.0.smithi096.stderr: "minimum_required_version": "jewel", 2024-09-16T03:24:57.160 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables": 1, 2024-09-16T03:24:57.160 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables2": 1, 2024-09-16T03:24:57.160 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v2_rules": 0, 2024-09-16T03:24:57.160 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables3": 1, 2024-09-16T03:24:57.160 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v3_rules": 0, 2024-09-16T03:24:57.160 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v4_buckets": 1, 2024-09-16T03:24:57.160 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables5": 1, 2024-09-16T03:24:57.160 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v5_rules": 0, 2024-09-16T03:24:57.160 INFO:tasks.workunit.client.0.smithi096.stderr: "has_msr_rules": 0 2024-09-16T03:24:57.160 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.160 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_args": {} 2024-09-16T03:24:57.160 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.160 INFO:tasks.workunit.client.0.smithi096.stderr: "fsmap": { 2024-09-16T03:24:57.161 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 1, 2024-09-16T03:24:57.161 INFO:tasks.workunit.client.0.smithi096.stderr: "btime": "2024-09-16T03:22:46:882186+0000", 2024-09-16T03:24:57.161 INFO:tasks.workunit.client.0.smithi096.stderr: "default_fscid": -1, 2024-09-16T03:24:57.161 INFO:tasks.workunit.client.0.smithi096.stderr: "compat": { 2024-09-16T03:24:57.161 INFO:tasks.workunit.client.0.smithi096.stderr: "compat": {}, 2024-09-16T03:24:57.161 INFO:tasks.workunit.client.0.smithi096.stderr: "ro_compat": {}, 2024-09-16T03:24:57.161 INFO:tasks.workunit.client.0.smithi096.stderr: "incompat": { 2024-09-16T03:24:57.161 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_1": "base v0.20", 2024-09-16T03:24:57.161 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_2": "client writeable ranges", 2024-09-16T03:24:57.161 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_3": "default file layouts on dirs", 2024-09-16T03:24:57.162 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_4": "dir inode in separate object", 2024-09-16T03:24:57.162 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_5": "mds uses versioned encoding", 2024-09-16T03:24:57.162 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_6": "dirfrag is stored in omap", 2024-09-16T03:24:57.162 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_8": "no anchor table", 2024-09-16T03:24:57.162 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_9": "file layout v2", 2024-09-16T03:24:57.162 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_10": "snaprealm v2", 2024-09-16T03:24:57.162 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_11": "minor log segments", 2024-09-16T03:24:57.162 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_12": "quiesce subvolumes" 2024-09-16T03:24:57.162 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:57.162 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.162 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_flags": { 2024-09-16T03:24:57.162 INFO:tasks.workunit.client.0.smithi096.stderr: "enable_multiple": true, 2024-09-16T03:24:57.162 INFO:tasks.workunit.client.0.smithi096.stderr: "ever_enabled_multiple": true 2024-09-16T03:24:57.163 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.163 INFO:tasks.workunit.client.0.smithi096.stderr: "standbys": [], 2024-09-16T03:24:57.163 INFO:tasks.workunit.client.0.smithi096.stderr: "filesystems": [] 2024-09-16T03:24:57.163 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.163 INFO:tasks.workunit.client.0.smithi096.stderr: "mdsmap_first_committed": 1, 2024-09-16T03:24:57.163 INFO:tasks.workunit.client.0.smithi096.stderr: "mdsmap_last_committed": 1, 2024-09-16T03:24:57.163 INFO:tasks.workunit.client.0.smithi096.stderr: "auth": { 2024-09-16T03:24:57.163 INFO:tasks.workunit.client.0.smithi096.stderr: "first_committed": 1, 2024-09-16T03:24:57.163 INFO:tasks.workunit.client.0.smithi096.stderr: "last_committed": 5, 2024-09-16T03:24:57.163 INFO:tasks.workunit.client.0.smithi096.stderr: "num_secrets": 3 2024-09-16T03:24:57.163 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.164 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 64, 2024-09-16T03:24:57.164 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_active": 64, 2024-09-16T03:24:57.164 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_unknown": 0, 2024-09-16T03:24:57.165 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osd": 3, 2024-09-16T03:24:57.165 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_sum": { 2024-09-16T03:24:57.165 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:24:57.165 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:24:57.165 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:24:57.165 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:24:57.165 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:24:57.165 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:24:57.166 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:24:57.166 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:24:57.166 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:24:57.166 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:24:57.166 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:24:57.166 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:24:57.166 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:24:57.166 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:24:57.166 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:24:57.166 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:24:57.166 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:24:57.166 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:24:57.166 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:24:57.166 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:24:57.167 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:24:57.167 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:24:57.167 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:24:57.167 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:24:57.167 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:24:57.167 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:24:57.167 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:24:57.167 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:24:57.167 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:24:57.167 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:24:57.167 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:24:57.167 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:24:57.167 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:24:57.167 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:24:57.168 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:24:57.168 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:24:57.168 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:24:57.168 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:24:57.168 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:24:57.168 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:24:57.168 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:24:57.168 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.168 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:24:57.168 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:24:57.168 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:24:57.168 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:24:57.168 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:24:57.168 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:24:57.169 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:24:57.169 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:24:57.169 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:24:57.169 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:24:57.169 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:24:57.169 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.169 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:24:57.169 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:24:57.169 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 192, 2024-09-16T03:24:57.169 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 192, 2024-09-16T03:24:57.169 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 0 2024-09-16T03:24:57.169 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.169 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_sum": { 2024-09-16T03:24:57.169 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 0, 2024-09-16T03:24:57.169 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 0, 2024-09-16T03:24:57.170 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pgs": 192, 2024-09-16T03:24:57.170 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osds": 3, 2024-09-16T03:24:57.170 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_osds": 3, 2024-09-16T03:24:57.170 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_omap_osds": 3, 2024-09-16T03:24:57.170 INFO:tasks.workunit.client.0.smithi096.stderr: "kb": 314572800, 2024-09-16T03:24:57.170 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used": 81232, 2024-09-16T03:24:57.170 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_data": 696, 2024-09-16T03:24:57.170 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_omap": 4, 2024-09-16T03:24:57.170 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_meta": 80443, 2024-09-16T03:24:57.170 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_avail": 314491568, 2024-09-16T03:24:57.170 INFO:tasks.workunit.client.0.smithi096.stderr: "statfs": { 2024-09-16T03:24:57.170 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 322122547200, 2024-09-16T03:24:57.170 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 322039365632, 2024-09-16T03:24:57.170 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:24:57.171 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 712704, 2024-09-16T03:24:57.171 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 209643, 2024-09-16T03:24:57.171 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:24:57.171 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:24:57.171 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:24:57.171 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 4785, 2024-09-16T03:24:57.171 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 82373967 2024-09-16T03:24:57.171 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.171 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_peers": [], 2024-09-16T03:24:57.171 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_trim_queue_len": 0, 2024-09-16T03:24:57.171 INFO:tasks.workunit.client.0.smithi096.stderr: "num_snap_trimming": 0, 2024-09-16T03:24:57.172 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shards_repaired": 0, 2024-09-16T03:24:57.172 INFO:tasks.workunit.client.0.smithi096.stderr: "op_queue_age_hist": { 2024-09-16T03:24:57.172 INFO:tasks.workunit.client.0.smithi096.stderr: "histogram": [], 2024-09-16T03:24:57.172 INFO:tasks.workunit.client.0.smithi096.stderr: "upper_bound": 1 2024-09-16T03:24:57.172 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.172 INFO:tasks.workunit.client.0.smithi096.stderr: "perf_stat": { 2024-09-16T03:24:57.172 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ms": 501, 2024-09-16T03:24:57.173 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ms": 501, 2024-09-16T03:24:57.173 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ns": 501000000, 2024-09-16T03:24:57.173 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ns": 501000000 2024-09-16T03:24:57.173 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.173 INFO:tasks.workunit.client.0.smithi096.stderr: "alerts": [], 2024-09-16T03:24:57.173 INFO:tasks.workunit.client.0.smithi096.stderr: "network_ping_times": [] 2024-09-16T03:24:57.173 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.173 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_sum_by_class": { 2024-09-16T03:24:57.173 INFO:tasks.workunit.client.0.smithi096.stderr: "hdd": { 2024-09-16T03:24:57.173 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 0, 2024-09-16T03:24:57.173 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 0, 2024-09-16T03:24:57.173 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pgs": 192, 2024-09-16T03:24:57.173 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osds": 3, 2024-09-16T03:24:57.173 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_osds": 3, 2024-09-16T03:24:57.174 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_omap_osds": 3, 2024-09-16T03:24:57.174 INFO:tasks.workunit.client.0.smithi096.stderr: "kb": 314572800, 2024-09-16T03:24:57.174 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used": 81232, 2024-09-16T03:24:57.174 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_data": 696, 2024-09-16T03:24:57.174 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_omap": 4, 2024-09-16T03:24:57.174 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_meta": 80443, 2024-09-16T03:24:57.174 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_avail": 314491568, 2024-09-16T03:24:57.174 INFO:tasks.workunit.client.0.smithi096.stderr: "statfs": { 2024-09-16T03:24:57.174 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 322122547200, 2024-09-16T03:24:57.174 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 322039365632, 2024-09-16T03:24:57.174 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:24:57.174 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 712704, 2024-09-16T03:24:57.174 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 209643, 2024-09-16T03:24:57.174 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:24:57.175 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:24:57.175 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:24:57.175 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 4785, 2024-09-16T03:24:57.175 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 82373967 2024-09-16T03:24:57.175 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.175 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_peers": [], 2024-09-16T03:24:57.175 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_trim_queue_len": 0, 2024-09-16T03:24:57.175 INFO:tasks.workunit.client.0.smithi096.stderr: "num_snap_trimming": 0, 2024-09-16T03:24:57.175 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shards_repaired": 0, 2024-09-16T03:24:57.175 INFO:tasks.workunit.client.0.smithi096.stderr: "op_queue_age_hist": { 2024-09-16T03:24:57.175 INFO:tasks.workunit.client.0.smithi096.stderr: "histogram": [], 2024-09-16T03:24:57.175 INFO:tasks.workunit.client.0.smithi096.stderr: "upper_bound": 1 2024-09-16T03:24:57.175 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.175 INFO:tasks.workunit.client.0.smithi096.stderr: "perf_stat": { 2024-09-16T03:24:57.176 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ms": 501, 2024-09-16T03:24:57.176 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ms": 501, 2024-09-16T03:24:57.176 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ns": 501000000, 2024-09-16T03:24:57.176 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ns": 501000000 2024-09-16T03:24:57.176 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.176 INFO:tasks.workunit.client.0.smithi096.stderr: "alerts": [], 2024-09-16T03:24:57.176 INFO:tasks.workunit.client.0.smithi096.stderr: "network_ping_times": [] 2024-09-16T03:24:57.176 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:57.176 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.176 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_stats": [ 2024-09-16T03:24:57.176 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.176 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 2, 2024-09-16T03:24:57.176 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 32, 2024-09-16T03:24:57.177 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:24:57.177 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:24:57.177 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:24:57.177 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:24:57.177 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:24:57.177 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:24:57.177 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:24:57.177 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:24:57.177 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:24:57.177 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:24:57.177 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:24:57.177 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:24:57.177 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:24:57.177 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:24:57.178 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:24:57.178 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:24:57.178 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:24:57.178 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:24:57.178 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:24:57.178 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:24:57.178 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:24:57.178 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:24:57.178 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:24:57.178 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:24:57.178 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:24:57.178 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:24:57.178 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:24:57.178 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:24:57.178 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:24:57.179 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:24:57.179 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:24:57.179 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:24:57.179 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:24:57.179 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:24:57.179 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:24:57.179 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:24:57.179 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:24:57.179 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:24:57.179 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:24:57.179 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:24:57.179 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:24:57.179 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.179 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:24:57.180 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:24:57.180 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:24:57.180 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:24:57.180 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:24:57.180 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:24:57.180 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:24:57.180 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:24:57.180 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:24:57.180 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:24:57.180 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:24:57.180 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.180 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:24:57.180 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:24:57.180 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 96, 2024-09-16T03:24:57.181 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 96, 2024-09-16T03:24:57.181 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 3 2024-09-16T03:24:57.181 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.181 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.181 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 1, 2024-09-16T03:24:57.181 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 32, 2024-09-16T03:24:57.181 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:24:57.181 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:24:57.181 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:24:57.181 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:24:57.181 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:24:57.181 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:24:57.181 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:24:57.181 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:24:57.181 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:24:57.182 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:24:57.182 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:24:57.182 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:24:57.182 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:24:57.182 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:24:57.182 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:24:57.182 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:24:57.182 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:24:57.182 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:24:57.182 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:24:57.182 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:24:57.182 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:24:57.182 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:24:57.182 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:24:57.182 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:24:57.183 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:24:57.183 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:24:57.183 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:24:57.183 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:24:57.183 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:24:57.183 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:24:57.183 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:24:57.183 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:24:57.183 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:24:57.183 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:24:57.183 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:24:57.183 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:24:57.183 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:24:57.183 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:24:57.184 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:24:57.184 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:24:57.184 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:24:57.184 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.184 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:24:57.184 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:24:57.184 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:24:57.184 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:24:57.184 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:24:57.184 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:24:57.184 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:24:57.184 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:24:57.184 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:24:57.184 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:24:57.184 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:24:57.185 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.185 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:24:57.185 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:24:57.185 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 96, 2024-09-16T03:24:57.185 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 96, 2024-09-16T03:24:57.185 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 3 2024-09-16T03:24:57.185 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:57.185 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:57.185 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_stats": [ 2024-09-16T03:24:57.185 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.185 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:24:57.185 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 21474836505 2024-09-16T03:24:57.185 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.185 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.186 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:24:57.186 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 42949672977 2024-09-16T03:24:57.186 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.186 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.186 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:24:57.186 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 64424509449 2024-09-16T03:24:57.186 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:57.186 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:57.186 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_by_state": [ 2024-09-16T03:24:57.186 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.186 INFO:tasks.workunit.client.0.smithi096.stderr: "state": "active+clean", 2024-09-16T03:24:57.186 INFO:tasks.workunit.client.0.smithi096.stderr: "num": 64 2024-09-16T03:24:57.186 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:57.186 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:57.186 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_by_osd": [ 2024-09-16T03:24:57.187 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.187 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:24:57.187 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 15, 2024-09-16T03:24:57.187 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 64, 2024-09-16T03:24:57.187 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:24:57.187 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.187 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.187 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:24:57.187 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 20, 2024-09-16T03:24:57.187 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 64, 2024-09-16T03:24:57.187 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:24:57.187 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.187 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.187 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:24:57.187 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 29, 2024-09-16T03:24:57.188 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 64, 2024-09-16T03:24:57.188 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:24:57.188 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:57.188 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:57.188 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": [ 2024-09-16T03:24:57.188 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.188 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 1, 2024-09-16T03:24:57.188 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": {} 2024-09-16T03:24:57.188 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.188 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:57.188 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 2, 2024-09-16T03:24:57.188 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": {} 2024-09-16T03:24:57.188 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:57.188 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:57.189 INFO:tasks.workunit.client.0.smithi096.stderr: "servicemap": { 2024-09-16T03:24:57.189 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 3, 2024-09-16T03:24:57.189 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:24:24.403052+0000", 2024-09-16T03:24:57.189 INFO:tasks.workunit.client.0.smithi096.stderr: "services": { 2024-09-16T03:24:57.189 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": { 2024-09-16T03:24:57.189 INFO:tasks.workunit.client.0.smithi096.stderr: "daemons": { 2024-09-16T03:24:57.189 INFO:tasks.workunit.client.0.smithi096.stderr: "summary": "", 2024-09-16T03:24:57.189 INFO:tasks.workunit.client.0.smithi096.stderr: "1": { 2024-09-16T03:24:57.189 INFO:tasks.workunit.client.0.smithi096.stderr: "start_epoch": 0, 2024-09-16T03:24:57.189 INFO:tasks.workunit.client.0.smithi096.stderr: "start_stamp": "0.000000", 2024-09-16T03:24:57.189 INFO:tasks.workunit.client.0.smithi096.stderr: "gid": 0, 2024-09-16T03:24:57.189 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "(unrecognized address family 0)/0", 2024-09-16T03:24:57.189 INFO:tasks.workunit.client.0.smithi096.stderr: "metadata": {}, 2024-09-16T03:24:57.189 INFO:tasks.workunit.client.0.smithi096.stderr: "task_status": {} 2024-09-16T03:24:57.189 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:57.190 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:57.190 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:57.190 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:57.190 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:57.190 INFO:tasks.workunit.client.0.smithi096.stderr: "mgrstat_first_committed": 47, 2024-09-16T03:24:57.190 INFO:tasks.workunit.client.0.smithi096.stderr: "mgrstat_last_committed": 54, 2024-09-16T03:24:57.190 INFO:tasks.workunit.client.0.smithi096.stderr: "logm_first_committed": 1, 2024-09-16T03:24:57.190 INFO:tasks.workunit.client.0.smithi096.stderr: "logm_last_committed": 239, 2024-09-16T03:24:57.190 INFO:tasks.workunit.client.0.smithi096.stderr: "paxos": { 2024-09-16T03:24:57.190 INFO:tasks.workunit.client.0.smithi096.stderr: "first_committed": 1, 2024-09-16T03:24:57.190 INFO:tasks.workunit.client.0.smithi096.stderr: "last_committed": 329, 2024-09-16T03:24:57.190 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pn": 0, 2024-09-16T03:24:57.190 INFO:tasks.workunit.client.0.smithi096.stderr: "accepted_pn": 0 2024-09-16T03:24:57.190 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:57.191 INFO:tasks.workunit.client.0.smithi096.stderr:}' 2024-09-16T03:24:57.191 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:132: get_fc_lc_diff: jq .osdmap_first_committed 2024-09-16T03:24:57.193 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:132: get_fc_lc_diff: echo '{' '"cluster_fingerprint":' '"fda2fc64-07ed-4add-8224-2e527e11d427",' '"version":' '"19.3.0-4930-gfc3e0bff",' '"commit":' '"fc3e0bff7468fd55478adbae7f75508b749124b6",' '"timestamp":' '"2024-09-16T03:24:57.070295+0000",' '"tag":' '"",' '"health":' '{' '"status":' '"HEALTH_OK",' '"checks":' '{},' '"mutes":' '[]' '},' '"monmap_first_committed":' 1, '"monmap_last_committed":' 1, '"monmap":' '{' '"epoch":' 1, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"modified":' '"2024-09-16T03:22:45.872880Z",' '"created":' '"2024-09-16T03:22:45.872880Z",' '"min_mon_release":' 19, '"min_mon_release_name":' '"squid",' '"election_strategy":' 1, '"disallowed_leaders:' '":' '"",' '"stretch_mode":' false, '"tiebreaker_mon":' '"",' '"removed_ranks:' '":' '"",' '"features":' '{' '"persistent":' '[' '"kraken",' '"luminous",' '"mimic",' '"osdmap-prune",' '"nautilus",' '"octopus",' '"pacific",' '"elector-pinging",' '"quincy",' '"reef",' '"squid"' '],' '"optional":' '[]' '},' '"mons":' '[' '{' '"rank":' 0, '"name":' '"a",' '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:7302",' '"nonce":' 0 '}' ']' '},' '"addr":' '"127.0.0.1:7302/0",' '"public_addr":' '"127.0.0.1:7302/0",' '"priority":' 0, '"weight":' 0, '"crush_location":' '"{}"' '}' ']' '},' '"quorum":' '[' 0 '],' '"osdmap":' '{' '"epoch":' 28, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"created":' '"2024-09-16T03:22:46.906117+0000",' '"modified":' '"2024-09-16T03:24:50.642444+0000",' '"last_up_change":' '"2024-09-16T03:24:37.708512+0000",' '"last_in_change":' '"2024-09-16T03:24:01.831039+0000",' '"flags":' '"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit",' '"flags_num":' 5799936, '"flags_set":' '[' '"pglog_hardlimit",' '"purged_snapdirs",' '"recovery_deletes",' '"sortbitwise"' '],' '"crush_version":' 7, '"full_ratio":' 0.97000002861022949, '"backfillfull_ratio":' 0.97000002861022949, '"nearfull_ratio":' 0.85000002384185791, '"cluster_snapshot":' '"",' '"pool_max":' 2, '"max_osd":' 3, '"require_min_compat_client":' '"luminous",' '"min_compat_client":' '"jewel",' '"require_osd_release":' '"squid",' '"allow_crimson":' false, '"pools":' '[' '{' '"pool":' 1, '"pool_name":' '"foo",' '"create_time":' '"2024-09-16T03:24:44.525189+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"21",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.690000057220459, '"score_stable":' 1.690000057220459, '"optimal_score":' 1, '"raw_score_acting":' 1.690000057220459, '"raw_score_stable":' 1.690000057220459, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '},' '{' '"pool":' 2, '"pool_name":' '"bar",' '"create_time":' '"2024-09-16T03:24:46.226575+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"24",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.1299999952316284, '"score_stable":' 1.1299999952316284, '"optimal_score":' 1, '"raw_score_acting":' 1.1299999952316284, '"raw_score_stable":' 1.1299999952316284, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '}' '],' '"osds":' '[' '{' '"osd":' 0, '"uuid":' '"64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 5, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6802",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6803",' '"nonce":' 3375787448 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6804",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6805",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6808",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6809",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6806",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6807",' '"nonce":' 3375787448 '}' ']' '},' '"public_addr":' '"127.0.0.1:6803/3375787448",' '"cluster_addr":' '"127.0.0.1:6805/3375787448",' '"heartbeat_back_addr":' '"127.0.0.1:6809/3375787448",' '"heartbeat_front_addr":' '"127.0.0.1:6807/3375787448",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 1, '"uuid":' '"74b26727-75c9-444d-8782-719e4197a382",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 10, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6810",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6811",' '"nonce":' 3733255132 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6812",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6813",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6816",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6817",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6814",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6815",' '"nonce":' 3733255132 '}' ']' '},' '"public_addr":' '"127.0.0.1:6811/3733255132",' '"cluster_addr":' '"127.0.0.1:6813/3733255132",' '"heartbeat_back_addr":' '"127.0.0.1:6817/3733255132",' '"heartbeat_front_addr":' '"127.0.0.1:6815/3733255132",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 2, '"uuid":' '"143da3a7-dad9-4b1e-966b-76cf5bdd3c82",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 15, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6818",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6819",' '"nonce":' 963814857 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6820",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6821",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6824",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6825",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6822",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6823",' '"nonce":' 963814857 '}' ']' '},' '"public_addr":' '"127.0.0.1:6819/963814857",' '"cluster_addr":' '"127.0.0.1:6821/963814857",' '"heartbeat_back_addr":' '"127.0.0.1:6825/963814857",' '"heartbeat_front_addr":' '"127.0.0.1:6823/963814857",' '"state":' '[' '"exists",' '"up"' ']' '}' '],' '"osd_xinfo":' '[' '{' '"osd":' 0, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:22.481942+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 1, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:59.663703+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 2, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:24:37.320822+0000",' '"dead_epoch":' 0 '}' '],' '"pg_upmap":' '[],' '"pg_upmap_items":' '[],' '"pg_upmap_primaries":' '[],' '"pg_temp":' '[],' '"primary_temp":' '[],' '"blocklist":' '{},' '"range_blocklist":' '{},' '"erasure_code_profiles":' '{' '"default":' '{' '"k":' '"2",' '"m":' '"2",' '"plugin":' '"jerasure",' '"technique":' '"reed_sol_van"' '}' '},' '"removed_snaps_queue":' '[],' '"new_removed_snaps":' '[],' '"new_purged_snaps":' '[],' '"crush_node_flags":' '{},' '"device_class_flags":' '{},' '"stretch_mode":' '{' '"stretch_mode_enabled":' false, '"stretch_bucket_count":' 0, '"degraded_stretch_mode":' 0, '"recovering_stretch_mode":' 0, '"stretch_mode_bucket":' 0 '}' '},' '"osd_metadata":' '[' '{' '"id":' 0, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/0/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:22:53.662571Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]",' '"hb_front_addr":' '"[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/0",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 1, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/1/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:23:30.129885Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]",' '"hb_front_addr":' '"[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/1",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 2, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/2/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:24:07.764502Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]",' '"hb_front_addr":' '"[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/2",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '}' '],' '"osdmap_clean_epochs":' '{' '"min_last_epoch_clean":' 23, '"last_epoch_clean":' '{' '"per_pool":' '[' '{' '"poolid":' 1, '"floor":' 23 '},' '{' '"poolid":' 2, '"floor":' 23 '}' ']' '},' '"osd_epochs":' '[' '{' '"id":' 0, '"epoch":' 28 '},' '{' '"id":' 1, '"epoch":' 28 '},' '{' '"id":' 2, '"epoch":' 23 '}' ']' '},' '"osdmap_first_committed":' 1, '"osdmap_last_committed":' 28, '"crushmap":' '{' '"devices":' '[' '{' '"id":' 0, '"name":' '"osd.0",' '"class":' '"hdd"' '},' '{' '"id":' 1, '"name":' '"osd.1",' '"class":' '"hdd"' '},' '{' '"id":' 2, '"name":' '"osd.2",' '"class":' '"hdd"' '}' '],' '"types":' '[' '{' '"type_id":' 0, '"name":' '"osd"' '},' '{' '"type_id":' 1, '"name":' '"host"' '},' '{' '"type_id":' 2, '"name":' '"chassis"' '},' '{' '"type_id":' 3, '"name":' '"rack"' '},' '{' '"type_id":' 4, '"name":' '"row"' '},' '{' '"type_id":' 5, '"name":' '"pdu"' '},' '{' '"type_id":' 6, '"name":' '"pod"' '},' '{' '"type_id":' 7, '"name":' '"room"' '},' '{' '"type_id":' 8, '"name":' '"datacenter"' '},' '{' '"type_id":' 9, '"name":' '"zone"' '},' '{' '"type_id":' 10, '"name":' '"region"' '},' '{' '"type_id":' 11, '"name":' '"root"' '}' '],' '"buckets":' '[' '{' '"id":' -1, '"name":' '"default",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -3, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -2, '"name":' '"default~hdd",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -4, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -3, '"name":' '"smithi096",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '},' '{' '"id":' -4, '"name":' '"smithi096~hdd",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '}' '],' '"rules":' '[' '{' '"rule_id":' 0, '"rule_name":' '"replicated_rule",' '"type":' 1, '"steps":' '[' '{' '"op":' '"take",' '"item":' -1, '"item_name":' '"default"' '},' '{' '"op":' '"choose_firstn",' '"num":' 0, '"type":' '"osd"' '},' '{' '"op":' '"emit"' '}' ']' '}' '],' '"tunables":' '{' '"choose_local_tries":' 0, '"choose_local_fallback_tries":' 0, '"choose_total_tries":' 50, '"chooseleaf_descend_once":' 1, '"chooseleaf_vary_r":' 1, '"chooseleaf_stable":' 1, '"msr_descents":' 100, '"msr_collision_tries":' 100, '"straw_calc_version":' 1, '"allowed_bucket_algs":' 54, '"profile":' '"jewel",' '"optimal_tunables":' 1, '"legacy_tunables":' 0, '"minimum_required_version":' '"jewel",' '"require_feature_tunables":' 1, '"require_feature_tunables2":' 1, '"has_v2_rules":' 0, '"require_feature_tunables3":' 1, '"has_v3_rules":' 0, '"has_v4_buckets":' 1, '"require_feature_tunables5":' 1, '"has_v5_rules":' 0, '"has_msr_rules":' 0 '},' '"choose_args":' '{}' '},' '"fsmap":' '{' '"epoch":' 1, '"btime":' '"2024-09-16T03:22:46:882186+0000",' '"default_fscid":' -1, '"compat":' '{' '"compat":' '{},' '"ro_compat":' '{},' '"incompat":' '{' '"feature_1":' '"base' 'v0.20",' '"feature_2":' '"client' writeable 'ranges",' '"feature_3":' '"default' file layouts on 'dirs",' '"feature_4":' '"dir' inode in separate 'object",' '"feature_5":' '"mds' uses versioned 'encoding",' '"feature_6":' '"dirfrag' is stored in 'omap",' '"feature_8":' '"no' anchor 'table",' '"feature_9":' '"file' layout 'v2",' '"feature_10":' '"snaprealm' 'v2",' '"feature_11":' '"minor' log 'segments",' '"feature_12":' '"quiesce' 'subvolumes"' '}' '},' '"feature_flags":' '{' '"enable_multiple":' true, '"ever_enabled_multiple":' true '},' '"standbys":' '[],' '"filesystems":' '[]' '},' '"mdsmap_first_committed":' 1, '"mdsmap_last_committed":' 1, '"auth":' '{' '"first_committed":' 1, '"last_committed":' 5, '"num_secrets":' 3 '},' '"num_pg":' 64, '"num_pg_active":' 64, '"num_pg_unknown":' 0, '"num_osd":' 3, '"pool_sum":' '{' '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 192, '"acting":' 192, '"num_store_stats":' 0 '},' '"osd_sum":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 192, '"num_osds":' 3, '"num_per_pool_osds":' 3, '"num_per_pool_omap_osds":' 3, '"kb":' 314572800, '"kb_used":' 81232, '"kb_used_data":' 696, '"kb_used_omap":' 4, '"kb_used_meta":' 80443, '"kb_avail":' 314491568, '"statfs":' '{' '"total":' 322122547200, '"available":' 322039365632, '"internally_reserved":' 0, '"allocated":' 712704, '"data_stored":' 209643, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 4785, '"internal_metadata":' 82373967 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 501, '"apply_latency_ms":' 501, '"commit_latency_ns":' 501000000, '"apply_latency_ns":' 501000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '},' '"osd_sum_by_class":' '{' '"hdd":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 192, '"num_osds":' 3, '"num_per_pool_osds":' 3, '"num_per_pool_omap_osds":' 3, '"kb":' 314572800, '"kb_used":' 81232, '"kb_used_data":' 696, '"kb_used_omap":' 4, '"kb_used_meta":' 80443, '"kb_avail":' 314491568, '"statfs":' '{' '"total":' 322122547200, '"available":' 322039365632, '"internally_reserved":' 0, '"allocated":' 712704, '"data_stored":' 209643, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 4785, '"internal_metadata":' 82373967 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 501, '"apply_latency_ms":' 501, '"commit_latency_ns":' 501000000, '"apply_latency_ns":' 501000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '}' '},' '"pool_stats":' '[' '{' '"poolid":' 2, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 96, '"acting":' 96, '"num_store_stats":' 3 '},' '{' '"poolid":' 1, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 96, '"acting":' 96, '"num_store_stats":' 3 '}' '],' '"osd_stats":' '[' '{' '"osd":' 0, '"seq":' 21474836505 '},' '{' '"osd":' 1, '"seq":' 42949672977 '},' '{' '"osd":' 2, '"seq":' 64424509449 '}' '],' '"num_pg_by_state":' '[' '{' '"state":' '"active+clean",' '"num":' 64 '}' '],' '"num_pg_by_osd":' '[' '{' '"osd":' 2, '"num_primary_pg":' 15, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 0, '"num_primary_pg":' 20, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 1, '"num_primary_pg":' 29, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '}' '],' '"purged_snaps":' '[' '{' '"pool":' 1, '"purged_snaps":' '{}' '},' '{' '"pool":' 2, '"purged_snaps":' '{}' '}' '],' '"servicemap":' '{' '"epoch":' 3, '"modified":' '"2024-09-16T03:24:24.403052+0000",' '"services":' '{' '"osd":' '{' '"daemons":' '{' '"summary":' '"",' '"1":' '{' '"start_epoch":' 0, '"start_stamp":' '"0.000000",' '"gid":' 0, '"addr":' '"(unrecognized' address family '0)/0",' '"metadata":' '{},' '"task_status":' '{}' '}' '}' '}' '}' '},' '"mgrstat_first_committed":' 47, '"mgrstat_last_committed":' 54, '"logm_first_committed":' 1, '"logm_last_committed":' 239, '"paxos":' '{' '"first_committed":' 1, '"last_committed":' 329, '"last_pn":' 0, '"accepted_pn":' 0 '}' '}' 2024-09-16T03:24:57.194 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:132: get_fc_lc_diff: osdm_fc=1 2024-09-16T03:24:57.194 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:134: get_fc_lc_diff: jq .osdmap_last_committed 2024-09-16T03:24:57.194 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:134: get_fc_lc_diff: echo '{' '"cluster_fingerprint":' '"fda2fc64-07ed-4add-8224-2e527e11d427",' '"version":' '"19.3.0-4930-gfc3e0bff",' '"commit":' '"fc3e0bff7468fd55478adbae7f75508b749124b6",' '"timestamp":' '"2024-09-16T03:24:57.070295+0000",' '"tag":' '"",' '"health":' '{' '"status":' '"HEALTH_OK",' '"checks":' '{},' '"mutes":' '[]' '},' '"monmap_first_committed":' 1, '"monmap_last_committed":' 1, '"monmap":' '{' '"epoch":' 1, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"modified":' '"2024-09-16T03:22:45.872880Z",' '"created":' '"2024-09-16T03:22:45.872880Z",' '"min_mon_release":' 19, '"min_mon_release_name":' '"squid",' '"election_strategy":' 1, '"disallowed_leaders:' '":' '"",' '"stretch_mode":' false, '"tiebreaker_mon":' '"",' '"removed_ranks:' '":' '"",' '"features":' '{' '"persistent":' '[' '"kraken",' '"luminous",' '"mimic",' '"osdmap-prune",' '"nautilus",' '"octopus",' '"pacific",' '"elector-pinging",' '"quincy",' '"reef",' '"squid"' '],' '"optional":' '[]' '},' '"mons":' '[' '{' '"rank":' 0, '"name":' '"a",' '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:7302",' '"nonce":' 0 '}' ']' '},' '"addr":' '"127.0.0.1:7302/0",' '"public_addr":' '"127.0.0.1:7302/0",' '"priority":' 0, '"weight":' 0, '"crush_location":' '"{}"' '}' ']' '},' '"quorum":' '[' 0 '],' '"osdmap":' '{' '"epoch":' 28, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"created":' '"2024-09-16T03:22:46.906117+0000",' '"modified":' '"2024-09-16T03:24:50.642444+0000",' '"last_up_change":' '"2024-09-16T03:24:37.708512+0000",' '"last_in_change":' '"2024-09-16T03:24:01.831039+0000",' '"flags":' '"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit",' '"flags_num":' 5799936, '"flags_set":' '[' '"pglog_hardlimit",' '"purged_snapdirs",' '"recovery_deletes",' '"sortbitwise"' '],' '"crush_version":' 7, '"full_ratio":' 0.97000002861022949, '"backfillfull_ratio":' 0.97000002861022949, '"nearfull_ratio":' 0.85000002384185791, '"cluster_snapshot":' '"",' '"pool_max":' 2, '"max_osd":' 3, '"require_min_compat_client":' '"luminous",' '"min_compat_client":' '"jewel",' '"require_osd_release":' '"squid",' '"allow_crimson":' false, '"pools":' '[' '{' '"pool":' 1, '"pool_name":' '"foo",' '"create_time":' '"2024-09-16T03:24:44.525189+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"21",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.690000057220459, '"score_stable":' 1.690000057220459, '"optimal_score":' 1, '"raw_score_acting":' 1.690000057220459, '"raw_score_stable":' 1.690000057220459, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '},' '{' '"pool":' 2, '"pool_name":' '"bar",' '"create_time":' '"2024-09-16T03:24:46.226575+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"24",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.1299999952316284, '"score_stable":' 1.1299999952316284, '"optimal_score":' 1, '"raw_score_acting":' 1.1299999952316284, '"raw_score_stable":' 1.1299999952316284, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '}' '],' '"osds":' '[' '{' '"osd":' 0, '"uuid":' '"64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 5, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6802",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6803",' '"nonce":' 3375787448 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6804",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6805",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6808",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6809",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6806",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6807",' '"nonce":' 3375787448 '}' ']' '},' '"public_addr":' '"127.0.0.1:6803/3375787448",' '"cluster_addr":' '"127.0.0.1:6805/3375787448",' '"heartbeat_back_addr":' '"127.0.0.1:6809/3375787448",' '"heartbeat_front_addr":' '"127.0.0.1:6807/3375787448",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 1, '"uuid":' '"74b26727-75c9-444d-8782-719e4197a382",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 10, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6810",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6811",' '"nonce":' 3733255132 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6812",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6813",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6816",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6817",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6814",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6815",' '"nonce":' 3733255132 '}' ']' '},' '"public_addr":' '"127.0.0.1:6811/3733255132",' '"cluster_addr":' '"127.0.0.1:6813/3733255132",' '"heartbeat_back_addr":' '"127.0.0.1:6817/3733255132",' '"heartbeat_front_addr":' '"127.0.0.1:6815/3733255132",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 2, '"uuid":' '"143da3a7-dad9-4b1e-966b-76cf5bdd3c82",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 15, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6818",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6819",' '"nonce":' 963814857 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6820",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6821",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6824",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6825",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6822",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6823",' '"nonce":' 963814857 '}' ']' '},' '"public_addr":' '"127.0.0.1:6819/963814857",' '"cluster_addr":' '"127.0.0.1:6821/963814857",' '"heartbeat_back_addr":' '"127.0.0.1:6825/963814857",' '"heartbeat_front_addr":' '"127.0.0.1:6823/963814857",' '"state":' '[' '"exists",' '"up"' ']' '}' '],' '"osd_xinfo":' '[' '{' '"osd":' 0, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:22.481942+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 1, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:59.663703+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 2, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:24:37.320822+0000",' '"dead_epoch":' 0 '}' '],' '"pg_upmap":' '[],' '"pg_upmap_items":' '[],' '"pg_upmap_primaries":' '[],' '"pg_temp":' '[],' '"primary_temp":' '[],' '"blocklist":' '{},' '"range_blocklist":' '{},' '"erasure_code_profiles":' '{' '"default":' '{' '"k":' '"2",' '"m":' '"2",' '"plugin":' '"jerasure",' '"technique":' '"reed_sol_van"' '}' '},' '"removed_snaps_queue":' '[],' '"new_removed_snaps":' '[],' '"new_purged_snaps":' '[],' '"crush_node_flags":' '{},' '"device_class_flags":' '{},' '"stretch_mode":' '{' '"stretch_mode_enabled":' false, '"stretch_bucket_count":' 0, '"degraded_stretch_mode":' 0, '"recovering_stretch_mode":' 0, '"stretch_mode_bucket":' 0 '}' '},' '"osd_metadata":' '[' '{' '"id":' 0, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/0/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:22:53.662571Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]",' '"hb_front_addr":' '"[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/0",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 1, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/1/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:23:30.129885Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]",' '"hb_front_addr":' '"[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/1",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 2, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/2/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:24:07.764502Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]",' '"hb_front_addr":' '"[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/2",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '}' '],' '"osdmap_clean_epochs":' '{' '"min_last_epoch_clean":' 23, '"last_epoch_clean":' '{' '"per_pool":' '[' '{' '"poolid":' 1, '"floor":' 23 '},' '{' '"poolid":' 2, '"floor":' 23 '}' ']' '},' '"osd_epochs":' '[' '{' '"id":' 0, '"epoch":' 28 '},' '{' '"id":' 1, '"epoch":' 28 '},' '{' '"id":' 2, '"epoch":' 23 '}' ']' '},' '"osdmap_first_committed":' 1, '"osdmap_last_committed":' 28, '"crushmap":' '{' '"devices":' '[' '{' '"id":' 0, '"name":' '"osd.0",' '"class":' '"hdd"' '},' '{' '"id":' 1, '"name":' '"osd.1",' '"class":' '"hdd"' '},' '{' '"id":' 2, '"name":' '"osd.2",' '"class":' '"hdd"' '}' '],' '"types":' '[' '{' '"type_id":' 0, '"name":' '"osd"' '},' '{' '"type_id":' 1, '"name":' '"host"' '},' '{' '"type_id":' 2, '"name":' '"chassis"' '},' '{' '"type_id":' 3, '"name":' '"rack"' '},' '{' '"type_id":' 4, '"name":' '"row"' '},' '{' '"type_id":' 5, '"name":' '"pdu"' '},' '{' '"type_id":' 6, '"name":' '"pod"' '},' '{' '"type_id":' 7, '"name":' '"room"' '},' '{' '"type_id":' 8, '"name":' '"datacenter"' '},' '{' '"type_id":' 9, '"name":' '"zone"' '},' '{' '"type_id":' 10, '"name":' '"region"' '},' '{' '"type_id":' 11, '"name":' '"root"' '}' '],' '"buckets":' '[' '{' '"id":' -1, '"name":' '"default",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -3, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -2, '"name":' '"default~hdd",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -4, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -3, '"name":' '"smithi096",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '},' '{' '"id":' -4, '"name":' '"smithi096~hdd",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '}' '],' '"rules":' '[' '{' '"rule_id":' 0, '"rule_name":' '"replicated_rule",' '"type":' 1, '"steps":' '[' '{' '"op":' '"take",' '"item":' -1, '"item_name":' '"default"' '},' '{' '"op":' '"choose_firstn",' '"num":' 0, '"type":' '"osd"' '},' '{' '"op":' '"emit"' '}' ']' '}' '],' '"tunables":' '{' '"choose_local_tries":' 0, '"choose_local_fallback_tries":' 0, '"choose_total_tries":' 50, '"chooseleaf_descend_once":' 1, '"chooseleaf_vary_r":' 1, '"chooseleaf_stable":' 1, '"msr_descents":' 100, '"msr_collision_tries":' 100, '"straw_calc_version":' 1, '"allowed_bucket_algs":' 54, '"profile":' '"jewel",' '"optimal_tunables":' 1, '"legacy_tunables":' 0, '"minimum_required_version":' '"jewel",' '"require_feature_tunables":' 1, '"require_feature_tunables2":' 1, '"has_v2_rules":' 0, '"require_feature_tunables3":' 1, '"has_v3_rules":' 0, '"has_v4_buckets":' 1, '"require_feature_tunables5":' 1, '"has_v5_rules":' 0, '"has_msr_rules":' 0 '},' '"choose_args":' '{}' '},' '"fsmap":' '{' '"epoch":' 1, '"btime":' '"2024-09-16T03:22:46:882186+0000",' '"default_fscid":' -1, '"compat":' '{' '"compat":' '{},' '"ro_compat":' '{},' '"incompat":' '{' '"feature_1":' '"base' 'v0.20",' '"feature_2":' '"client' writeable 'ranges",' '"feature_3":' '"default' file layouts on 'dirs",' '"feature_4":' '"dir' inode in separate 'object",' '"feature_5":' '"mds' uses versioned 'encoding",' '"feature_6":' '"dirfrag' is stored in 'omap",' '"feature_8":' '"no' anchor 'table",' '"feature_9":' '"file' layout 'v2",' '"feature_10":' '"snaprealm' 'v2",' '"feature_11":' '"minor' log 'segments",' '"feature_12":' '"quiesce' 'subvolumes"' '}' '},' '"feature_flags":' '{' '"enable_multiple":' true, '"ever_enabled_multiple":' true '},' '"standbys":' '[],' '"filesystems":' '[]' '},' '"mdsmap_first_committed":' 1, '"mdsmap_last_committed":' 1, '"auth":' '{' '"first_committed":' 1, '"last_committed":' 5, '"num_secrets":' 3 '},' '"num_pg":' 64, '"num_pg_active":' 64, '"num_pg_unknown":' 0, '"num_osd":' 3, '"pool_sum":' '{' '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 192, '"acting":' 192, '"num_store_stats":' 0 '},' '"osd_sum":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 192, '"num_osds":' 3, '"num_per_pool_osds":' 3, '"num_per_pool_omap_osds":' 3, '"kb":' 314572800, '"kb_used":' 81232, '"kb_used_data":' 696, '"kb_used_omap":' 4, '"kb_used_meta":' 80443, '"kb_avail":' 314491568, '"statfs":' '{' '"total":' 322122547200, '"available":' 322039365632, '"internally_reserved":' 0, '"allocated":' 712704, '"data_stored":' 209643, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 4785, '"internal_metadata":' 82373967 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 501, '"apply_latency_ms":' 501, '"commit_latency_ns":' 501000000, '"apply_latency_ns":' 501000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '},' '"osd_sum_by_class":' '{' '"hdd":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 192, '"num_osds":' 3, '"num_per_pool_osds":' 3, '"num_per_pool_omap_osds":' 3, '"kb":' 314572800, '"kb_used":' 81232, '"kb_used_data":' 696, '"kb_used_omap":' 4, '"kb_used_meta":' 80443, '"kb_avail":' 314491568, '"statfs":' '{' '"total":' 322122547200, '"available":' 322039365632, '"internally_reserved":' 0, '"allocated":' 712704, '"data_stored":' 209643, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 4785, '"internal_metadata":' 82373967 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 501, '"apply_latency_ms":' 501, '"commit_latency_ns":' 501000000, '"apply_latency_ns":' 501000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '}' '},' '"pool_stats":' '[' '{' '"poolid":' 2, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 96, '"acting":' 96, '"num_store_stats":' 3 '},' '{' '"poolid":' 1, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 96, '"acting":' 96, '"num_store_stats":' 3 '}' '],' '"osd_stats":' '[' '{' '"osd":' 0, '"seq":' 21474836505 '},' '{' '"osd":' 1, '"seq":' 42949672977 '},' '{' '"osd":' 2, '"seq":' 64424509449 '}' '],' '"num_pg_by_state":' '[' '{' '"state":' '"active+clean",' '"num":' 64 '}' '],' '"num_pg_by_osd":' '[' '{' '"osd":' 2, '"num_primary_pg":' 15, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 0, '"num_primary_pg":' 20, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 1, '"num_primary_pg":' 29, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '}' '],' '"purged_snaps":' '[' '{' '"pool":' 1, '"purged_snaps":' '{}' '},' '{' '"pool":' 2, '"purged_snaps":' '{}' '}' '],' '"servicemap":' '{' '"epoch":' 3, '"modified":' '"2024-09-16T03:24:24.403052+0000",' '"services":' '{' '"osd":' '{' '"daemons":' '{' '"summary":' '"",' '"1":' '{' '"start_epoch":' 0, '"start_stamp":' '"0.000000",' '"gid":' 0, '"addr":' '"(unrecognized' address family '0)/0",' '"metadata":' '{},' '"task_status":' '{}' '}' '}' '}' '}' '},' '"mgrstat_first_committed":' 47, '"mgrstat_last_committed":' 54, '"logm_first_committed":' 1, '"logm_last_committed":' 239, '"paxos":' '{' '"first_committed":' 1, '"last_committed":' 329, '"last_pn":' 0, '"accepted_pn":' 0 '}' '}' 2024-09-16T03:24:57.194 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:134: get_fc_lc_diff: osdm_lc=28 2024-09-16T03:24:57.194 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:136: get_fc_lc_diff: echo 27 2024-09-16T03:24:57.194 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:161: wait_for_total_num_maps: [[ 27 -gt 2 ]] 2024-09-16T03:24:57.194 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:162: wait_for_total_num_maps: (( 4 >= 27 )) 2024-09-16T03:24:57.194 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:166: wait_for_total_num_maps: sleep 1.6 2024-09-16T03:24:58.756 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:167: wait_for_total_num_maps: loop+=1 2024-09-16T03:24:58.757 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:161: wait_for_total_num_maps: get_fc_lc_diff 2024-09-16T03:24:58.758 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:130: get_fc_lc_diff: ceph report 2024-09-16T03:24:59.364 INFO:tasks.workunit.client.0.smithi096.stderr:report 1954688418 2024-09-16T03:24:59.380 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:130: get_fc_lc_diff: report='{ 2024-09-16T03:24:59.380 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_fingerprint": "fda2fc64-07ed-4add-8224-2e527e11d427", 2024-09-16T03:24:59.380 INFO:tasks.workunit.client.0.smithi096.stderr: "version": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:24:59.380 INFO:tasks.workunit.client.0.smithi096.stderr: "commit": "fc3e0bff7468fd55478adbae7f75508b749124b6", 2024-09-16T03:24:59.380 INFO:tasks.workunit.client.0.smithi096.stderr: "timestamp": "2024-09-16T03:24:59.364956+0000", 2024-09-16T03:24:59.380 INFO:tasks.workunit.client.0.smithi096.stderr: "tag": "", 2024-09-16T03:24:59.380 INFO:tasks.workunit.client.0.smithi096.stderr: "health": { 2024-09-16T03:24:59.380 INFO:tasks.workunit.client.0.smithi096.stderr: "status": "HEALTH_OK", 2024-09-16T03:24:59.380 INFO:tasks.workunit.client.0.smithi096.stderr: "checks": {}, 2024-09-16T03:24:59.380 INFO:tasks.workunit.client.0.smithi096.stderr: "mutes": [] 2024-09-16T03:24:59.381 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.381 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap_first_committed": 1, 2024-09-16T03:24:59.381 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap_last_committed": 1, 2024-09-16T03:24:59.381 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap": { 2024-09-16T03:24:59.381 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 1, 2024-09-16T03:24:59.381 INFO:tasks.workunit.client.0.smithi096.stderr: "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", 2024-09-16T03:24:59.381 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:22:45.872880Z", 2024-09-16T03:24:59.381 INFO:tasks.workunit.client.0.smithi096.stderr: "created": "2024-09-16T03:22:45.872880Z", 2024-09-16T03:24:59.381 INFO:tasks.workunit.client.0.smithi096.stderr: "min_mon_release": 19, 2024-09-16T03:24:59.381 INFO:tasks.workunit.client.0.smithi096.stderr: "min_mon_release_name": "squid", 2024-09-16T03:24:59.381 INFO:tasks.workunit.client.0.smithi096.stderr: "election_strategy": 1, 2024-09-16T03:24:59.381 INFO:tasks.workunit.client.0.smithi096.stderr: "disallowed_leaders: ": "", 2024-09-16T03:24:59.382 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode": false, 2024-09-16T03:24:59.382 INFO:tasks.workunit.client.0.smithi096.stderr: "tiebreaker_mon": "", 2024-09-16T03:24:59.382 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_ranks: ": "", 2024-09-16T03:24:59.382 INFO:tasks.workunit.client.0.smithi096.stderr: "features": { 2024-09-16T03:24:59.382 INFO:tasks.workunit.client.0.smithi096.stderr: "persistent": [ 2024-09-16T03:24:59.382 INFO:tasks.workunit.client.0.smithi096.stderr: "kraken", 2024-09-16T03:24:59.382 INFO:tasks.workunit.client.0.smithi096.stderr: "luminous", 2024-09-16T03:24:59.382 INFO:tasks.workunit.client.0.smithi096.stderr: "mimic", 2024-09-16T03:24:59.382 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap-prune", 2024-09-16T03:24:59.382 INFO:tasks.workunit.client.0.smithi096.stderr: "nautilus", 2024-09-16T03:24:59.382 INFO:tasks.workunit.client.0.smithi096.stderr: "octopus", 2024-09-16T03:24:59.382 INFO:tasks.workunit.client.0.smithi096.stderr: "pacific", 2024-09-16T03:24:59.382 INFO:tasks.workunit.client.0.smithi096.stderr: "elector-pinging", 2024-09-16T03:24:59.382 INFO:tasks.workunit.client.0.smithi096.stderr: "quincy", 2024-09-16T03:24:59.383 INFO:tasks.workunit.client.0.smithi096.stderr: "reef", 2024-09-16T03:24:59.383 INFO:tasks.workunit.client.0.smithi096.stderr: "squid" 2024-09-16T03:24:59.383 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:59.383 INFO:tasks.workunit.client.0.smithi096.stderr: "optional": [] 2024-09-16T03:24:59.383 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.383 INFO:tasks.workunit.client.0.smithi096.stderr: "mons": [ 2024-09-16T03:24:59.383 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.383 INFO:tasks.workunit.client.0.smithi096.stderr: "rank": 0, 2024-09-16T03:24:59.383 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "a", 2024-09-16T03:24:59.383 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:24:59.383 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:59.383 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.383 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:59.383 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:7302", 2024-09-16T03:24:59.384 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 0 2024-09-16T03:24:59.384 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:59.384 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:59.384 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.384 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:7302/0", 2024-09-16T03:24:59.384 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:7302/0", 2024-09-16T03:24:59.384 INFO:tasks.workunit.client.0.smithi096.stderr: "priority": 0, 2024-09-16T03:24:59.384 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 0, 2024-09-16T03:24:59.384 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_location": "{}" 2024-09-16T03:24:59.384 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:59.384 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:59.384 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.385 INFO:tasks.workunit.client.0.smithi096.stderr: "quorum": [ 2024-09-16T03:24:59.385 INFO:tasks.workunit.client.0.smithi096.stderr: 0 2024-09-16T03:24:59.385 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:59.385 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap": { 2024-09-16T03:24:59.385 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 28, 2024-09-16T03:24:59.385 INFO:tasks.workunit.client.0.smithi096.stderr: "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", 2024-09-16T03:24:59.385 INFO:tasks.workunit.client.0.smithi096.stderr: "created": "2024-09-16T03:22:46.906117+0000", 2024-09-16T03:24:59.385 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:24:50.642444+0000", 2024-09-16T03:24:59.385 INFO:tasks.workunit.client.0.smithi096.stderr: "last_up_change": "2024-09-16T03:24:37.708512+0000", 2024-09-16T03:24:59.385 INFO:tasks.workunit.client.0.smithi096.stderr: "last_in_change": "2024-09-16T03:24:01.831039+0000", 2024-09-16T03:24:59.385 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-16T03:24:59.385 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_num": 5799936, 2024-09-16T03:24:59.385 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_set": [ 2024-09-16T03:24:59.385 INFO:tasks.workunit.client.0.smithi096.stderr: "pglog_hardlimit", 2024-09-16T03:24:59.386 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snapdirs", 2024-09-16T03:24:59.386 INFO:tasks.workunit.client.0.smithi096.stderr: "recovery_deletes", 2024-09-16T03:24:59.386 INFO:tasks.workunit.client.0.smithi096.stderr: "sortbitwise" 2024-09-16T03:24:59.386 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:59.386 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_version": 7, 2024-09-16T03:24:59.386 INFO:tasks.workunit.client.0.smithi096.stderr: "full_ratio": 0.97000002861022949, 2024-09-16T03:24:59.386 INFO:tasks.workunit.client.0.smithi096.stderr: "backfillfull_ratio": 0.97000002861022949, 2024-09-16T03:24:59.386 INFO:tasks.workunit.client.0.smithi096.stderr: "nearfull_ratio": 0.85000002384185791, 2024-09-16T03:24:59.386 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_snapshot": "", 2024-09-16T03:24:59.386 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_max": 2, 2024-09-16T03:24:59.386 INFO:tasks.workunit.client.0.smithi096.stderr: "max_osd": 3, 2024-09-16T03:24:59.386 INFO:tasks.workunit.client.0.smithi096.stderr: "require_min_compat_client": "luminous", 2024-09-16T03:24:59.386 INFO:tasks.workunit.client.0.smithi096.stderr: "min_compat_client": "jewel", 2024-09-16T03:24:59.386 INFO:tasks.workunit.client.0.smithi096.stderr: "require_osd_release": "squid", 2024-09-16T03:24:59.387 INFO:tasks.workunit.client.0.smithi096.stderr: "allow_crimson": false, 2024-09-16T03:24:59.387 INFO:tasks.workunit.client.0.smithi096.stderr: "pools": [ 2024-09-16T03:24:59.387 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.387 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 1, 2024-09-16T03:24:59.387 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_name": "foo", 2024-09-16T03:24:59.387 INFO:tasks.workunit.client.0.smithi096.stderr: "create_time": "2024-09-16T03:24:44.525189+0000", 2024-09-16T03:24:59.387 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": 1, 2024-09-16T03:24:59.387 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_names": "hashpspool", 2024-09-16T03:24:59.387 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:24:59.387 INFO:tasks.workunit.client.0.smithi096.stderr: "size": 3, 2024-09-16T03:24:59.387 INFO:tasks.workunit.client.0.smithi096.stderr: "min_size": 2, 2024-09-16T03:24:59.387 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_rule": 0, 2024-09-16T03:24:59.387 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_count": 0, 2024-09-16T03:24:59.387 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_target": 0, 2024-09-16T03:24:59.388 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_barrier": 0, 2024-09-16T03:24:59.388 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-16T03:24:59.388 INFO:tasks.workunit.client.0.smithi096.stderr: "is_stretch_pool": false, 2024-09-16T03:24:59.388 INFO:tasks.workunit.client.0.smithi096.stderr: "object_hash": 2, 2024-09-16T03:24:59.388 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_autoscale_mode": "off", 2024-09-16T03:24:59.388 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num": 32, 2024-09-16T03:24:59.388 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num": 32, 2024-09-16T03:24:59.388 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num_target": 32, 2024-09-16T03:24:59.388 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_target": 32, 2024-09-16T03:24:59.388 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_pending": 32, 2024-09-16T03:24:59.388 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pg_merge_meta": { 2024-09-16T03:24:59.389 INFO:tasks.workunit.client.0.smithi096.stderr: "source_pgid": "0.0", 2024-09-16T03:24:59.389 INFO:tasks.workunit.client.0.smithi096.stderr: "ready_epoch": 0, 2024-09-16T03:24:59.389 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_started": 0, 2024-09-16T03:24:59.389 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": 0, 2024-09-16T03:24:59.389 INFO:tasks.workunit.client.0.smithi096.stderr: "source_version": "0'\''0", 2024-09-16T03:24:59.389 INFO:tasks.workunit.client.0.smithi096.stderr: "target_version": "0'\''0" 2024-09-16T03:24:59.389 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.389 INFO:tasks.workunit.client.0.smithi096.stderr: "last_change": "21", 2024-09-16T03:24:59.389 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend": "0", 2024-09-16T03:24:59.389 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_prenautilus": "0", 2024-09-16T03:24:59.390 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_preluminous": "0", 2024-09-16T03:24:59.390 INFO:tasks.workunit.client.0.smithi096.stderr: "auid": 0, 2024-09-16T03:24:59.390 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_mode": "selfmanaged", 2024-09-16T03:24:59.390 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_seq": 0, 2024-09-16T03:24:59.390 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_epoch": 0, 2024-09-16T03:24:59.390 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_snaps": [], 2024-09-16T03:24:59.390 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps": "[]", 2024-09-16T03:24:59.390 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_bytes": 0, 2024-09-16T03:24:59.390 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_objects": 0, 2024-09-16T03:24:59.390 INFO:tasks.workunit.client.0.smithi096.stderr: "tiers": [], 2024-09-16T03:24:59.390 INFO:tasks.workunit.client.0.smithi096.stderr: "tier_of": -1, 2024-09-16T03:24:59.390 INFO:tasks.workunit.client.0.smithi096.stderr: "read_tier": -1, 2024-09-16T03:24:59.390 INFO:tasks.workunit.client.0.smithi096.stderr: "write_tier": -1, 2024-09-16T03:24:59.390 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_mode": "none", 2024-09-16T03:24:59.391 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_bytes": 0, 2024-09-16T03:24:59.391 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_objects": 0, 2024-09-16T03:24:59.391 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_ratio_micro": 400000, 2024-09-16T03:24:59.391 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-16T03:24:59.391 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_full_ratio_micro": 800000, 2024-09-16T03:24:59.391 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_flush_age": 0, 2024-09-16T03:24:59.391 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_evict_age": 0, 2024-09-16T03:24:59.391 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profile": "", 2024-09-16T03:24:59.391 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_params": { 2024-09-16T03:24:59.391 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "none" 2024-09-16T03:24:59.391 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.391 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_period": 0, 2024-09-16T03:24:59.391 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_count": 0, 2024-09-16T03:24:59.391 INFO:tasks.workunit.client.0.smithi096.stderr: "use_gmt_hitset": true, 2024-09-16T03:24:59.392 INFO:tasks.workunit.client.0.smithi096.stderr: "min_read_recency_for_promote": 0, 2024-09-16T03:24:59.392 INFO:tasks.workunit.client.0.smithi096.stderr: "min_write_recency_for_promote": 0, 2024-09-16T03:24:59.392 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_grade_decay_rate": 0, 2024-09-16T03:24:59.392 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_search_last_n": 0, 2024-09-16T03:24:59.392 INFO:tasks.workunit.client.0.smithi096.stderr: "grade_table": [], 2024-09-16T03:24:59.392 INFO:tasks.workunit.client.0.smithi096.stderr: "stripe_width": 0, 2024-09-16T03:24:59.392 INFO:tasks.workunit.client.0.smithi096.stderr: "expected_num_objects": 0, 2024-09-16T03:24:59.392 INFO:tasks.workunit.client.0.smithi096.stderr: "fast_read": false, 2024-09-16T03:24:59.392 INFO:tasks.workunit.client.0.smithi096.stderr: "options": {}, 2024-09-16T03:24:59.392 INFO:tasks.workunit.client.0.smithi096.stderr: "application_metadata": {}, 2024-09-16T03:24:59.392 INFO:tasks.workunit.client.0.smithi096.stderr: "read_balance": { 2024-09-16T03:24:59.393 INFO:tasks.workunit.client.0.smithi096.stderr: "score_type": "Fair distribution", 2024-09-16T03:24:59.393 INFO:tasks.workunit.client.0.smithi096.stderr: "score_acting": 1.690000057220459, 2024-09-16T03:24:59.393 INFO:tasks.workunit.client.0.smithi096.stderr: "score_stable": 1.690000057220459, 2024-09-16T03:24:59.393 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_score": 1, 2024-09-16T03:24:59.393 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_acting": 1.690000057220459, 2024-09-16T03:24:59.393 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_stable": 1.690000057220459, 2024-09-16T03:24:59.393 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity_weighted": 1, 2024-09-16T03:24:59.393 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity": 1, 2024-09-16T03:24:59.393 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity_weighted": 1 2024-09-16T03:24:59.393 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:59.393 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.393 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.393 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 2, 2024-09-16T03:24:59.393 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_name": "bar", 2024-09-16T03:24:59.394 INFO:tasks.workunit.client.0.smithi096.stderr: "create_time": "2024-09-16T03:24:46.226575+0000", 2024-09-16T03:24:59.394 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": 1, 2024-09-16T03:24:59.394 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_names": "hashpspool", 2024-09-16T03:24:59.394 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:24:59.394 INFO:tasks.workunit.client.0.smithi096.stderr: "size": 3, 2024-09-16T03:24:59.394 INFO:tasks.workunit.client.0.smithi096.stderr: "min_size": 2, 2024-09-16T03:24:59.394 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_rule": 0, 2024-09-16T03:24:59.394 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_count": 0, 2024-09-16T03:24:59.394 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_target": 0, 2024-09-16T03:24:59.394 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_barrier": 0, 2024-09-16T03:24:59.394 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-16T03:24:59.394 INFO:tasks.workunit.client.0.smithi096.stderr: "is_stretch_pool": false, 2024-09-16T03:24:59.394 INFO:tasks.workunit.client.0.smithi096.stderr: "object_hash": 2, 2024-09-16T03:24:59.394 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_autoscale_mode": "off", 2024-09-16T03:24:59.395 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num": 32, 2024-09-16T03:24:59.395 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num": 32, 2024-09-16T03:24:59.395 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num_target": 32, 2024-09-16T03:24:59.395 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_target": 32, 2024-09-16T03:24:59.395 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_pending": 32, 2024-09-16T03:24:59.395 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pg_merge_meta": { 2024-09-16T03:24:59.395 INFO:tasks.workunit.client.0.smithi096.stderr: "source_pgid": "0.0", 2024-09-16T03:24:59.395 INFO:tasks.workunit.client.0.smithi096.stderr: "ready_epoch": 0, 2024-09-16T03:24:59.395 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_started": 0, 2024-09-16T03:24:59.395 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": 0, 2024-09-16T03:24:59.395 INFO:tasks.workunit.client.0.smithi096.stderr: "source_version": "0'\''0", 2024-09-16T03:24:59.395 INFO:tasks.workunit.client.0.smithi096.stderr: "target_version": "0'\''0" 2024-09-16T03:24:59.395 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.395 INFO:tasks.workunit.client.0.smithi096.stderr: "last_change": "24", 2024-09-16T03:24:59.396 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend": "0", 2024-09-16T03:24:59.396 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_prenautilus": "0", 2024-09-16T03:24:59.396 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_preluminous": "0", 2024-09-16T03:24:59.396 INFO:tasks.workunit.client.0.smithi096.stderr: "auid": 0, 2024-09-16T03:24:59.396 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_mode": "selfmanaged", 2024-09-16T03:24:59.396 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_seq": 0, 2024-09-16T03:24:59.396 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_epoch": 0, 2024-09-16T03:24:59.396 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_snaps": [], 2024-09-16T03:24:59.396 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps": "[]", 2024-09-16T03:24:59.396 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_bytes": 0, 2024-09-16T03:24:59.396 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_objects": 0, 2024-09-16T03:24:59.396 INFO:tasks.workunit.client.0.smithi096.stderr: "tiers": [], 2024-09-16T03:24:59.396 INFO:tasks.workunit.client.0.smithi096.stderr: "tier_of": -1, 2024-09-16T03:24:59.396 INFO:tasks.workunit.client.0.smithi096.stderr: "read_tier": -1, 2024-09-16T03:24:59.397 INFO:tasks.workunit.client.0.smithi096.stderr: "write_tier": -1, 2024-09-16T03:24:59.397 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_mode": "none", 2024-09-16T03:24:59.397 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_bytes": 0, 2024-09-16T03:24:59.397 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_objects": 0, 2024-09-16T03:24:59.397 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_ratio_micro": 400000, 2024-09-16T03:24:59.397 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-16T03:24:59.397 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_full_ratio_micro": 800000, 2024-09-16T03:24:59.397 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_flush_age": 0, 2024-09-16T03:24:59.397 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_evict_age": 0, 2024-09-16T03:24:59.397 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profile": "", 2024-09-16T03:24:59.397 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_params": { 2024-09-16T03:24:59.397 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "none" 2024-09-16T03:24:59.397 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.398 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_period": 0, 2024-09-16T03:24:59.398 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_count": 0, 2024-09-16T03:24:59.398 INFO:tasks.workunit.client.0.smithi096.stderr: "use_gmt_hitset": true, 2024-09-16T03:24:59.398 INFO:tasks.workunit.client.0.smithi096.stderr: "min_read_recency_for_promote": 0, 2024-09-16T03:24:59.398 INFO:tasks.workunit.client.0.smithi096.stderr: "min_write_recency_for_promote": 0, 2024-09-16T03:24:59.398 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_grade_decay_rate": 0, 2024-09-16T03:24:59.398 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_search_last_n": 0, 2024-09-16T03:24:59.398 INFO:tasks.workunit.client.0.smithi096.stderr: "grade_table": [], 2024-09-16T03:24:59.398 INFO:tasks.workunit.client.0.smithi096.stderr: "stripe_width": 0, 2024-09-16T03:24:59.398 INFO:tasks.workunit.client.0.smithi096.stderr: "expected_num_objects": 0, 2024-09-16T03:24:59.398 INFO:tasks.workunit.client.0.smithi096.stderr: "fast_read": false, 2024-09-16T03:24:59.398 INFO:tasks.workunit.client.0.smithi096.stderr: "options": {}, 2024-09-16T03:24:59.398 INFO:tasks.workunit.client.0.smithi096.stderr: "application_metadata": {}, 2024-09-16T03:24:59.399 INFO:tasks.workunit.client.0.smithi096.stderr: "read_balance": { 2024-09-16T03:24:59.399 INFO:tasks.workunit.client.0.smithi096.stderr: "score_type": "Fair distribution", 2024-09-16T03:24:59.399 INFO:tasks.workunit.client.0.smithi096.stderr: "score_acting": 1.1299999952316284, 2024-09-16T03:24:59.399 INFO:tasks.workunit.client.0.smithi096.stderr: "score_stable": 1.1299999952316284, 2024-09-16T03:24:59.399 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_score": 1, 2024-09-16T03:24:59.399 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_acting": 1.1299999952316284, 2024-09-16T03:24:59.399 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_stable": 1.1299999952316284, 2024-09-16T03:24:59.399 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity_weighted": 1, 2024-09-16T03:24:59.399 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity": 1, 2024-09-16T03:24:59.399 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity_weighted": 1 2024-09-16T03:24:59.399 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:59.399 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:59.399 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:59.399 INFO:tasks.workunit.client.0.smithi096.stderr: "osds": [ 2024-09-16T03:24:59.400 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.400 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:24:59.400 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6", 2024-09-16T03:24:59.400 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:24:59.400 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:24:59.400 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:24:59.400 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:24:59.400 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:24:59.400 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:24:59.400 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 5, 2024-09-16T03:24:59.400 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 21, 2024-09-16T03:24:59.400 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:24:59.400 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:24:59.401 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:24:59.401 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:59.401 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.401 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:59.401 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6802", 2024-09-16T03:24:59.401 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:24:59.401 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.401 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.401 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:59.401 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6803", 2024-09-16T03:24:59.401 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:24:59.401 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:59.401 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:59.402 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.402 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:24:59.402 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:59.402 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.402 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:59.402 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6804", 2024-09-16T03:24:59.402 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:24:59.402 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.402 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.402 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:59.402 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6805", 2024-09-16T03:24:59.402 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:24:59.402 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:59.403 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:59.403 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.403 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:24:59.403 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:59.403 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.403 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:59.403 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6808", 2024-09-16T03:24:59.403 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:24:59.403 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.403 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.404 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:59.404 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6809", 2024-09-16T03:24:59.404 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:24:59.404 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:59.404 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:59.404 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.404 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:24:59.404 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:59.404 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.404 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:59.404 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6806", 2024-09-16T03:24:59.404 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:24:59.404 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.405 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.405 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:59.405 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6807", 2024-09-16T03:24:59.405 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:24:59.405 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:59.405 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:59.405 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.405 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6803/3375787448", 2024-09-16T03:24:59.405 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6805/3375787448", 2024-09-16T03:24:59.405 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6809/3375787448", 2024-09-16T03:24:59.405 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6807/3375787448", 2024-09-16T03:24:59.405 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:24:59.405 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:24:59.405 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:24:59.406 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:59.406 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.406 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.406 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:24:59.406 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "74b26727-75c9-444d-8782-719e4197a382", 2024-09-16T03:24:59.406 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:24:59.406 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:24:59.406 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:24:59.406 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:24:59.406 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:24:59.406 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:24:59.406 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 10, 2024-09-16T03:24:59.406 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 21, 2024-09-16T03:24:59.406 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:24:59.406 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:24:59.407 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:24:59.407 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:59.407 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.407 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:59.407 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6810", 2024-09-16T03:24:59.407 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:24:59.407 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.407 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.407 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:59.407 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6811", 2024-09-16T03:24:59.407 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:24:59.407 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:59.407 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:59.407 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.408 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:24:59.408 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:59.408 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.408 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:59.408 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6812", 2024-09-16T03:24:59.408 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:24:59.408 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.408 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.408 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:59.408 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6813", 2024-09-16T03:24:59.408 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:24:59.408 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:59.408 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:59.409 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.409 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:24:59.409 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:59.409 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.409 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:59.409 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6816", 2024-09-16T03:24:59.409 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:24:59.409 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.409 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.409 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:59.409 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6817", 2024-09-16T03:24:59.409 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:24:59.409 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:59.409 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:59.410 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.410 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:24:59.410 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:59.410 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.410 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:59.410 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6814", 2024-09-16T03:24:59.410 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:24:59.410 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.410 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.410 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:59.410 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6815", 2024-09-16T03:24:59.410 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:24:59.410 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:59.411 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:59.411 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.411 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6811/3733255132", 2024-09-16T03:24:59.411 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6813/3733255132", 2024-09-16T03:24:59.411 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6817/3733255132", 2024-09-16T03:24:59.411 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6815/3733255132", 2024-09-16T03:24:59.411 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:24:59.411 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:24:59.411 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:24:59.411 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:59.411 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.411 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.411 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:24:59.411 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "143da3a7-dad9-4b1e-966b-76cf5bdd3c82", 2024-09-16T03:24:59.412 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:24:59.412 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:24:59.412 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:24:59.412 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:24:59.412 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:24:59.412 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:24:59.412 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 15, 2024-09-16T03:24:59.412 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 21, 2024-09-16T03:24:59.412 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:24:59.412 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:24:59.412 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:24:59.412 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:59.413 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.413 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:59.413 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6818", 2024-09-16T03:24:59.413 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:24:59.413 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.413 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.413 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:59.413 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6819", 2024-09-16T03:24:59.413 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:24:59.413 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:59.413 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:59.413 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.414 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:24:59.414 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:59.414 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.414 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:59.414 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6820", 2024-09-16T03:24:59.414 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:24:59.414 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.414 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.414 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:59.414 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6821", 2024-09-16T03:24:59.414 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:24:59.414 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:59.414 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:59.414 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.415 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:24:59.415 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:59.415 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.415 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:59.415 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6824", 2024-09-16T03:24:59.415 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:24:59.415 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.415 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.415 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:59.415 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6825", 2024-09-16T03:24:59.415 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:24:59.415 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:59.415 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:59.416 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.416 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:24:59.416 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:24:59.416 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.416 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:24:59.416 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6822", 2024-09-16T03:24:59.416 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:24:59.416 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.416 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.416 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:24:59.416 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6823", 2024-09-16T03:24:59.416 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:24:59.416 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:59.416 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:59.417 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.417 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6819/963814857", 2024-09-16T03:24:59.417 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6821/963814857", 2024-09-16T03:24:59.417 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6825/963814857", 2024-09-16T03:24:59.417 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6823/963814857", 2024-09-16T03:24:59.417 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:24:59.417 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:24:59.417 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:24:59.417 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:59.417 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:59.417 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:59.417 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_xinfo": [ 2024-09-16T03:24:59.418 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.418 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:24:59.418 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:24:59.418 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:24:59.418 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:24:59.418 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:24:59.418 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:24:59.418 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:23:22.481942+0000", 2024-09-16T03:24:59.418 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:24:59.418 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.418 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.418 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:24:59.418 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:24:59.419 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:24:59.419 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:24:59.419 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:24:59.419 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:24:59.419 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:23:59.663703+0000", 2024-09-16T03:24:59.419 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:24:59.419 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.419 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.419 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:24:59.419 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:24:59.419 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:24:59.419 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:24:59.419 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:24:59.419 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:24:59.420 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:24:37.320822+0000", 2024-09-16T03:24:59.420 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:24:59.420 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:59.420 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:59.420 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap": [], 2024-09-16T03:24:59.420 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap_items": [], 2024-09-16T03:24:59.420 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap_primaries": [], 2024-09-16T03:24:59.420 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_temp": [], 2024-09-16T03:24:59.420 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_temp": [], 2024-09-16T03:24:59.420 INFO:tasks.workunit.client.0.smithi096.stderr: "blocklist": {}, 2024-09-16T03:24:59.420 INFO:tasks.workunit.client.0.smithi096.stderr: "range_blocklist": {}, 2024-09-16T03:24:59.420 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profiles": { 2024-09-16T03:24:59.420 INFO:tasks.workunit.client.0.smithi096.stderr: "default": { 2024-09-16T03:24:59.421 INFO:tasks.workunit.client.0.smithi096.stderr: "k": "2", 2024-09-16T03:24:59.421 INFO:tasks.workunit.client.0.smithi096.stderr: "m": "2", 2024-09-16T03:24:59.421 INFO:tasks.workunit.client.0.smithi096.stderr: "plugin": "jerasure", 2024-09-16T03:24:59.421 INFO:tasks.workunit.client.0.smithi096.stderr: "technique": "reed_sol_van" 2024-09-16T03:24:59.421 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:59.421 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.421 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps_queue": [], 2024-09-16T03:24:59.421 INFO:tasks.workunit.client.0.smithi096.stderr: "new_removed_snaps": [], 2024-09-16T03:24:59.421 INFO:tasks.workunit.client.0.smithi096.stderr: "new_purged_snaps": [], 2024-09-16T03:24:59.421 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_node_flags": {}, 2024-09-16T03:24:59.421 INFO:tasks.workunit.client.0.smithi096.stderr: "device_class_flags": {}, 2024-09-16T03:24:59.421 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode": { 2024-09-16T03:24:59.421 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode_enabled": false, 2024-09-16T03:24:59.421 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_bucket_count": 0, 2024-09-16T03:24:59.422 INFO:tasks.workunit.client.0.smithi096.stderr: "degraded_stretch_mode": 0, 2024-09-16T03:24:59.422 INFO:tasks.workunit.client.0.smithi096.stderr: "recovering_stretch_mode": 0, 2024-09-16T03:24:59.422 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode_bucket": 0 2024-09-16T03:24:59.422 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:59.422 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.422 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_metadata": [ 2024-09-16T03:24:59.422 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.422 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:24:59.422 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:24:59.422 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]", 2024-09-16T03:24:59.422 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:24:59.422 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:24:59.422 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:24:59.422 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:24:59.423 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:24:59.423 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:24:59.423 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:24:59.423 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:24:59.423 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:24:59.423 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:24:59.423 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:24:59.423 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/0/block", 2024-09-16T03:24:59.423 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:24:59.423 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:24:59.423 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:24:59.423 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:24:59.423 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:24:59.423 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:24:59.424 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:24:59.424 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:24:59.424 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:24:59.424 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:24:59.424 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:22:53.662571Z", 2024-09-16T03:24:59.424 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:24:59.424 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:24:59.424 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:24:59.424 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:24:59.424 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:24:59.424 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:24:59.424 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:24:59.424 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]", 2024-09-16T03:24:59.424 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:24:59.425 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]", 2024-09-16T03:24:59.425 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]", 2024-09-16T03:24:59.425 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:24:59.425 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:24:59.425 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:24:59.425 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:24:59.425 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:24:59.425 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:24:59.425 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:24:59.425 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:24:59.425 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:24:59.425 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/0", 2024-09-16T03:24:59.425 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:24:59.426 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:24:59.426 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:24:59.426 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.426 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.426 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:24:59.426 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:24:59.426 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]", 2024-09-16T03:24:59.426 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:24:59.426 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:24:59.426 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:24:59.426 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:24:59.426 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:24:59.426 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:24:59.426 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:24:59.426 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:24:59.427 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:24:59.427 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:24:59.427 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:24:59.427 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/1/block", 2024-09-16T03:24:59.427 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:24:59.427 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:24:59.427 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:24:59.427 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:24:59.427 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:24:59.427 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:24:59.427 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:24:59.427 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:24:59.427 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:24:59.427 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:24:59.428 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:23:30.129885Z", 2024-09-16T03:24:59.428 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:24:59.428 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:24:59.428 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:24:59.428 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:24:59.428 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:24:59.428 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:24:59.428 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:24:59.428 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]", 2024-09-16T03:24:59.428 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:24:59.428 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]", 2024-09-16T03:24:59.428 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]", 2024-09-16T03:24:59.428 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:24:59.429 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:24:59.429 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:24:59.429 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:24:59.429 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:24:59.429 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:24:59.429 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:24:59.429 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:24:59.429 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:24:59.429 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/1", 2024-09-16T03:24:59.429 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:24:59.429 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:24:59.429 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:24:59.429 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.429 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.430 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:24:59.430 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:24:59.430 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]", 2024-09-16T03:24:59.430 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:24:59.430 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:24:59.430 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:24:59.430 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:24:59.430 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:24:59.430 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:24:59.430 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:24:59.430 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:24:59.430 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:24:59.430 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:24:59.430 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:24:59.431 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/2/block", 2024-09-16T03:24:59.431 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:24:59.431 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:24:59.431 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:24:59.431 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:24:59.431 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:24:59.431 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:24:59.431 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:24:59.431 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:24:59.431 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:24:59.431 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:24:59.431 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:24:07.764502Z", 2024-09-16T03:24:59.431 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:24:59.431 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:24:59.432 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:24:59.432 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:24:59.432 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:24:59.432 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:24:59.432 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:24:59.432 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]", 2024-09-16T03:24:59.432 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:24:59.432 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]", 2024-09-16T03:24:59.432 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]", 2024-09-16T03:24:59.432 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:24:59.432 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:24:59.432 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:24:59.432 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:24:59.432 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:24:59.433 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:24:59.433 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:24:59.433 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:24:59.433 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:24:59.433 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/2", 2024-09-16T03:24:59.433 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:24:59.433 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:24:59.433 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:24:59.433 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:59.433 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:59.433 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_clean_epochs": { 2024-09-16T03:24:59.433 INFO:tasks.workunit.client.0.smithi096.stderr: "min_last_epoch_clean": 23, 2024-09-16T03:24:59.433 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": { 2024-09-16T03:24:59.433 INFO:tasks.workunit.client.0.smithi096.stderr: "per_pool": [ 2024-09-16T03:24:59.434 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.434 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 1, 2024-09-16T03:24:59.434 INFO:tasks.workunit.client.0.smithi096.stderr: "floor": 23 2024-09-16T03:24:59.434 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.434 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.434 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 2, 2024-09-16T03:24:59.434 INFO:tasks.workunit.client.0.smithi096.stderr: "floor": 23 2024-09-16T03:24:59.434 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:59.434 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:59.434 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.434 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_epochs": [ 2024-09-16T03:24:59.434 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.434 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:24:59.435 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 28 2024-09-16T03:24:59.435 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.435 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.435 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:24:59.435 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 28 2024-09-16T03:24:59.435 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.435 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.435 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:24:59.435 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 23 2024-09-16T03:24:59.435 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:59.435 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:59.435 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.436 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_first_committed": 23, 2024-09-16T03:24:59.436 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_last_committed": 28, 2024-09-16T03:24:59.436 INFO:tasks.workunit.client.0.smithi096.stderr: "crushmap": { 2024-09-16T03:24:59.436 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": [ 2024-09-16T03:24:59.436 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.436 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:24:59.436 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.0", 2024-09-16T03:24:59.436 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:24:59.436 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.436 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.436 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:24:59.436 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.1", 2024-09-16T03:24:59.436 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:24:59.437 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.437 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.437 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:24:59.437 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.2", 2024-09-16T03:24:59.437 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:24:59.437 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:59.437 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:59.437 INFO:tasks.workunit.client.0.smithi096.stderr: "types": [ 2024-09-16T03:24:59.437 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.437 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 0, 2024-09-16T03:24:59.437 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd" 2024-09-16T03:24:59.437 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.437 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.437 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:24:59.438 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "host" 2024-09-16T03:24:59.438 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.438 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.438 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 2, 2024-09-16T03:24:59.438 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "chassis" 2024-09-16T03:24:59.438 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.438 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.438 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 3, 2024-09-16T03:24:59.438 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "rack" 2024-09-16T03:24:59.438 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.438 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.438 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 4, 2024-09-16T03:24:59.438 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "row" 2024-09-16T03:24:59.438 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.439 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.439 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 5, 2024-09-16T03:24:59.439 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "pdu" 2024-09-16T03:24:59.439 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.439 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.439 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 6, 2024-09-16T03:24:59.439 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "pod" 2024-09-16T03:24:59.439 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.439 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.439 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 7, 2024-09-16T03:24:59.439 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "room" 2024-09-16T03:24:59.439 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.439 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.439 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 8, 2024-09-16T03:24:59.439 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "datacenter" 2024-09-16T03:24:59.440 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.440 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.440 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 9, 2024-09-16T03:24:59.440 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "zone" 2024-09-16T03:24:59.440 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.440 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.440 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 10, 2024-09-16T03:24:59.440 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "region" 2024-09-16T03:24:59.440 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.440 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.440 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:24:59.440 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "root" 2024-09-16T03:24:59.440 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:59.441 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:59.441 INFO:tasks.workunit.client.0.smithi096.stderr: "buckets": [ 2024-09-16T03:24:59.441 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.441 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -1, 2024-09-16T03:24:59.441 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "default", 2024-09-16T03:24:59.441 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:24:59.441 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "root", 2024-09-16T03:24:59.441 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:24:59.441 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:24:59.441 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:24:59.441 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:24:59.441 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.441 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -3, 2024-09-16T03:24:59.441 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:24:59.442 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:24:59.442 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:59.442 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:59.442 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.442 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.442 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -2, 2024-09-16T03:24:59.442 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "default~hdd", 2024-09-16T03:24:59.442 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:24:59.442 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "root", 2024-09-16T03:24:59.442 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:24:59.442 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:24:59.442 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:24:59.442 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:24:59.443 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.443 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -4, 2024-09-16T03:24:59.443 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:24:59.443 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:24:59.443 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:59.443 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:59.443 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.443 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.443 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -3, 2024-09-16T03:24:59.443 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "smithi096", 2024-09-16T03:24:59.443 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:24:59.443 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "host", 2024-09-16T03:24:59.443 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:24:59.444 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:24:59.444 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:24:59.444 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:24:59.444 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.444 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:24:59.444 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:24:59.444 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:24:59.444 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.444 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.444 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:24:59.444 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:24:59.444 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 1 2024-09-16T03:24:59.444 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.444 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.445 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:24:59.445 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:24:59.445 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 2 2024-09-16T03:24:59.445 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:59.445 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:59.445 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.445 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.445 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -4, 2024-09-16T03:24:59.445 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "smithi096~hdd", 2024-09-16T03:24:59.445 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:24:59.445 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "host", 2024-09-16T03:24:59.445 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:24:59.445 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:24:59.445 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:24:59.445 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:24:59.446 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.446 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:24:59.446 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:24:59.446 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:24:59.446 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.446 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.446 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:24:59.446 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:24:59.446 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 1 2024-09-16T03:24:59.446 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.446 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.446 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:24:59.446 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:24:59.447 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 2 2024-09-16T03:24:59.447 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:59.447 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:59.447 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:59.447 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:59.447 INFO:tasks.workunit.client.0.smithi096.stderr: "rules": [ 2024-09-16T03:24:59.447 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.447 INFO:tasks.workunit.client.0.smithi096.stderr: "rule_id": 0, 2024-09-16T03:24:59.447 INFO:tasks.workunit.client.0.smithi096.stderr: "rule_name": "replicated_rule", 2024-09-16T03:24:59.447 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:24:59.447 INFO:tasks.workunit.client.0.smithi096.stderr: "steps": [ 2024-09-16T03:24:59.447 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.447 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "take", 2024-09-16T03:24:59.447 INFO:tasks.workunit.client.0.smithi096.stderr: "item": -1, 2024-09-16T03:24:59.448 INFO:tasks.workunit.client.0.smithi096.stderr: "item_name": "default" 2024-09-16T03:24:59.448 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.448 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.448 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "choose_firstn", 2024-09-16T03:24:59.448 INFO:tasks.workunit.client.0.smithi096.stderr: "num": 0, 2024-09-16T03:24:59.448 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "osd" 2024-09-16T03:24:59.448 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.448 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.448 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "emit" 2024-09-16T03:24:59.448 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:59.448 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:24:59.448 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:59.448 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:59.448 INFO:tasks.workunit.client.0.smithi096.stderr: "tunables": { 2024-09-16T03:24:59.449 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_local_tries": 0, 2024-09-16T03:24:59.449 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_local_fallback_tries": 0, 2024-09-16T03:24:59.449 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_total_tries": 50, 2024-09-16T03:24:59.449 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_descend_once": 1, 2024-09-16T03:24:59.449 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_vary_r": 1, 2024-09-16T03:24:59.449 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_stable": 1, 2024-09-16T03:24:59.449 INFO:tasks.workunit.client.0.smithi096.stderr: "msr_descents": 100, 2024-09-16T03:24:59.449 INFO:tasks.workunit.client.0.smithi096.stderr: "msr_collision_tries": 100, 2024-09-16T03:24:59.449 INFO:tasks.workunit.client.0.smithi096.stderr: "straw_calc_version": 1, 2024-09-16T03:24:59.449 INFO:tasks.workunit.client.0.smithi096.stderr: "allowed_bucket_algs": 54, 2024-09-16T03:24:59.449 INFO:tasks.workunit.client.0.smithi096.stderr: "profile": "jewel", 2024-09-16T03:24:59.449 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_tunables": 1, 2024-09-16T03:24:59.449 INFO:tasks.workunit.client.0.smithi096.stderr: "legacy_tunables": 0, 2024-09-16T03:24:59.449 INFO:tasks.workunit.client.0.smithi096.stderr: "minimum_required_version": "jewel", 2024-09-16T03:24:59.450 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables": 1, 2024-09-16T03:24:59.450 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables2": 1, 2024-09-16T03:24:59.450 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v2_rules": 0, 2024-09-16T03:24:59.450 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables3": 1, 2024-09-16T03:24:59.450 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v3_rules": 0, 2024-09-16T03:24:59.450 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v4_buckets": 1, 2024-09-16T03:24:59.450 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables5": 1, 2024-09-16T03:24:59.450 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v5_rules": 0, 2024-09-16T03:24:59.450 INFO:tasks.workunit.client.0.smithi096.stderr: "has_msr_rules": 0 2024-09-16T03:24:59.450 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.450 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_args": {} 2024-09-16T03:24:59.450 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.450 INFO:tasks.workunit.client.0.smithi096.stderr: "fsmap": { 2024-09-16T03:24:59.451 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 1, 2024-09-16T03:24:59.451 INFO:tasks.workunit.client.0.smithi096.stderr: "btime": "2024-09-16T03:22:46:882186+0000", 2024-09-16T03:24:59.451 INFO:tasks.workunit.client.0.smithi096.stderr: "default_fscid": -1, 2024-09-16T03:24:59.451 INFO:tasks.workunit.client.0.smithi096.stderr: "compat": { 2024-09-16T03:24:59.451 INFO:tasks.workunit.client.0.smithi096.stderr: "compat": {}, 2024-09-16T03:24:59.451 INFO:tasks.workunit.client.0.smithi096.stderr: "ro_compat": {}, 2024-09-16T03:24:59.451 INFO:tasks.workunit.client.0.smithi096.stderr: "incompat": { 2024-09-16T03:24:59.451 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_1": "base v0.20", 2024-09-16T03:24:59.451 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_2": "client writeable ranges", 2024-09-16T03:24:59.451 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_3": "default file layouts on dirs", 2024-09-16T03:24:59.451 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_4": "dir inode in separate object", 2024-09-16T03:24:59.451 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_5": "mds uses versioned encoding", 2024-09-16T03:24:59.451 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_6": "dirfrag is stored in omap", 2024-09-16T03:24:59.451 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_8": "no anchor table", 2024-09-16T03:24:59.452 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_9": "file layout v2", 2024-09-16T03:24:59.452 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_10": "snaprealm v2", 2024-09-16T03:24:59.452 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_11": "minor log segments", 2024-09-16T03:24:59.452 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_12": "quiesce subvolumes" 2024-09-16T03:24:59.452 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:59.452 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.452 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_flags": { 2024-09-16T03:24:59.452 INFO:tasks.workunit.client.0.smithi096.stderr: "enable_multiple": true, 2024-09-16T03:24:59.452 INFO:tasks.workunit.client.0.smithi096.stderr: "ever_enabled_multiple": true 2024-09-16T03:24:59.452 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.452 INFO:tasks.workunit.client.0.smithi096.stderr: "standbys": [], 2024-09-16T03:24:59.452 INFO:tasks.workunit.client.0.smithi096.stderr: "filesystems": [] 2024-09-16T03:24:59.452 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.453 INFO:tasks.workunit.client.0.smithi096.stderr: "mdsmap_first_committed": 1, 2024-09-16T03:24:59.453 INFO:tasks.workunit.client.0.smithi096.stderr: "mdsmap_last_committed": 1, 2024-09-16T03:24:59.453 INFO:tasks.workunit.client.0.smithi096.stderr: "auth": { 2024-09-16T03:24:59.453 INFO:tasks.workunit.client.0.smithi096.stderr: "first_committed": 1, 2024-09-16T03:24:59.453 INFO:tasks.workunit.client.0.smithi096.stderr: "last_committed": 5, 2024-09-16T03:24:59.453 INFO:tasks.workunit.client.0.smithi096.stderr: "num_secrets": 3 2024-09-16T03:24:59.453 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.453 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 64, 2024-09-16T03:24:59.453 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_active": 64, 2024-09-16T03:24:59.453 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_unknown": 0, 2024-09-16T03:24:59.453 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osd": 3, 2024-09-16T03:24:59.453 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_sum": { 2024-09-16T03:24:59.453 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:24:59.454 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:24:59.454 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:24:59.454 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:24:59.454 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:24:59.454 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:24:59.454 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:24:59.454 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:24:59.454 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:24:59.454 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:24:59.454 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:24:59.454 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:24:59.454 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:24:59.454 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:24:59.455 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:24:59.455 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:24:59.455 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:24:59.455 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:24:59.455 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:24:59.455 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:24:59.455 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:24:59.455 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:24:59.455 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:24:59.455 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:24:59.455 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:24:59.455 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:24:59.455 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:24:59.455 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:24:59.456 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:24:59.456 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:24:59.456 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:24:59.456 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:24:59.456 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:24:59.456 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:24:59.456 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:24:59.456 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:24:59.456 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:24:59.456 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:24:59.456 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:24:59.456 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:24:59.456 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:24:59.457 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.457 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:24:59.457 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:24:59.457 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:24:59.457 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:24:59.457 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:24:59.457 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:24:59.457 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:24:59.457 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:24:59.457 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:24:59.457 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:24:59.457 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:24:59.458 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.458 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:24:59.458 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:24:59.458 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 192, 2024-09-16T03:24:59.458 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 192, 2024-09-16T03:24:59.458 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 0 2024-09-16T03:24:59.458 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.458 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_sum": { 2024-09-16T03:24:59.458 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 0, 2024-09-16T03:24:59.458 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 0, 2024-09-16T03:24:59.458 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pgs": 192, 2024-09-16T03:24:59.458 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osds": 3, 2024-09-16T03:24:59.458 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_osds": 3, 2024-09-16T03:24:59.459 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_omap_osds": 3, 2024-09-16T03:24:59.459 INFO:tasks.workunit.client.0.smithi096.stderr: "kb": 314572800, 2024-09-16T03:24:59.459 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used": 81232, 2024-09-16T03:24:59.459 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_data": 696, 2024-09-16T03:24:59.459 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_omap": 4, 2024-09-16T03:24:59.459 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_meta": 80443, 2024-09-16T03:24:59.459 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_avail": 314491568, 2024-09-16T03:24:59.459 INFO:tasks.workunit.client.0.smithi096.stderr: "statfs": { 2024-09-16T03:24:59.459 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 322122547200, 2024-09-16T03:24:59.459 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 322039365632, 2024-09-16T03:24:59.459 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:24:59.459 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 712704, 2024-09-16T03:24:59.459 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 209643, 2024-09-16T03:24:59.460 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:24:59.460 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:24:59.460 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:24:59.460 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 4785, 2024-09-16T03:24:59.460 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 82373967 2024-09-16T03:24:59.460 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.460 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_peers": [], 2024-09-16T03:24:59.460 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_trim_queue_len": 0, 2024-09-16T03:24:59.460 INFO:tasks.workunit.client.0.smithi096.stderr: "num_snap_trimming": 0, 2024-09-16T03:24:59.460 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shards_repaired": 0, 2024-09-16T03:24:59.460 INFO:tasks.workunit.client.0.smithi096.stderr: "op_queue_age_hist": { 2024-09-16T03:24:59.461 INFO:tasks.workunit.client.0.smithi096.stderr: "histogram": [], 2024-09-16T03:24:59.461 INFO:tasks.workunit.client.0.smithi096.stderr: "upper_bound": 1 2024-09-16T03:24:59.461 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.461 INFO:tasks.workunit.client.0.smithi096.stderr: "perf_stat": { 2024-09-16T03:24:59.461 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ms": 235, 2024-09-16T03:24:59.461 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ms": 235, 2024-09-16T03:24:59.461 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ns": 235000000, 2024-09-16T03:24:59.461 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ns": 235000000 2024-09-16T03:24:59.461 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.461 INFO:tasks.workunit.client.0.smithi096.stderr: "alerts": [], 2024-09-16T03:24:59.461 INFO:tasks.workunit.client.0.smithi096.stderr: "network_ping_times": [] 2024-09-16T03:24:59.461 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.461 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_sum_by_class": { 2024-09-16T03:24:59.461 INFO:tasks.workunit.client.0.smithi096.stderr: "hdd": { 2024-09-16T03:24:59.462 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 0, 2024-09-16T03:24:59.462 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 0, 2024-09-16T03:24:59.462 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pgs": 192, 2024-09-16T03:24:59.462 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osds": 3, 2024-09-16T03:24:59.462 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_osds": 3, 2024-09-16T03:24:59.462 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_omap_osds": 3, 2024-09-16T03:24:59.462 INFO:tasks.workunit.client.0.smithi096.stderr: "kb": 314572800, 2024-09-16T03:24:59.462 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used": 81232, 2024-09-16T03:24:59.462 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_data": 696, 2024-09-16T03:24:59.462 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_omap": 4, 2024-09-16T03:24:59.462 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_meta": 80443, 2024-09-16T03:24:59.462 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_avail": 314491568, 2024-09-16T03:24:59.463 INFO:tasks.workunit.client.0.smithi096.stderr: "statfs": { 2024-09-16T03:24:59.463 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 322122547200, 2024-09-16T03:24:59.463 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 322039365632, 2024-09-16T03:24:59.463 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:24:59.463 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 712704, 2024-09-16T03:24:59.463 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 209643, 2024-09-16T03:24:59.463 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:24:59.463 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:24:59.463 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:24:59.463 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 4785, 2024-09-16T03:24:59.463 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 82373967 2024-09-16T03:24:59.463 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.463 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_peers": [], 2024-09-16T03:24:59.463 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_trim_queue_len": 0, 2024-09-16T03:24:59.464 INFO:tasks.workunit.client.0.smithi096.stderr: "num_snap_trimming": 0, 2024-09-16T03:24:59.464 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shards_repaired": 0, 2024-09-16T03:24:59.464 INFO:tasks.workunit.client.0.smithi096.stderr: "op_queue_age_hist": { 2024-09-16T03:24:59.464 INFO:tasks.workunit.client.0.smithi096.stderr: "histogram": [], 2024-09-16T03:24:59.464 INFO:tasks.workunit.client.0.smithi096.stderr: "upper_bound": 1 2024-09-16T03:24:59.464 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.464 INFO:tasks.workunit.client.0.smithi096.stderr: "perf_stat": { 2024-09-16T03:24:59.464 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ms": 235, 2024-09-16T03:24:59.464 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ms": 235, 2024-09-16T03:24:59.464 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ns": 235000000, 2024-09-16T03:24:59.464 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ns": 235000000 2024-09-16T03:24:59.464 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.464 INFO:tasks.workunit.client.0.smithi096.stderr: "alerts": [], 2024-09-16T03:24:59.464 INFO:tasks.workunit.client.0.smithi096.stderr: "network_ping_times": [] 2024-09-16T03:24:59.465 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:59.465 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.465 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_stats": [ 2024-09-16T03:24:59.465 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.465 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 2, 2024-09-16T03:24:59.465 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 32, 2024-09-16T03:24:59.465 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:24:59.465 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:24:59.465 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:24:59.465 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:24:59.465 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:24:59.465 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:24:59.465 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:24:59.466 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:24:59.466 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:24:59.466 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:24:59.466 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:24:59.466 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:24:59.466 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:24:59.466 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:24:59.466 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:24:59.466 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:24:59.466 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:24:59.466 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:24:59.466 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:24:59.466 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:24:59.466 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:24:59.467 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:24:59.467 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:24:59.467 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:24:59.467 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:24:59.467 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:24:59.467 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:24:59.467 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:24:59.467 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:24:59.467 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:24:59.467 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:24:59.467 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:24:59.467 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:24:59.467 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:24:59.468 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:24:59.468 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:24:59.468 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:24:59.468 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:24:59.468 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:24:59.468 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:24:59.468 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:24:59.468 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.468 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:24:59.468 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:24:59.468 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:24:59.468 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:24:59.468 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:24:59.469 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:24:59.469 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:24:59.469 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:24:59.469 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:24:59.469 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:24:59.469 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:24:59.469 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.469 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:24:59.469 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:24:59.469 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 96, 2024-09-16T03:24:59.469 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 96, 2024-09-16T03:24:59.469 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 3 2024-09-16T03:24:59.469 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.470 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.470 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 1, 2024-09-16T03:24:59.470 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 32, 2024-09-16T03:24:59.470 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:24:59.470 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:24:59.470 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:24:59.470 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:24:59.470 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:24:59.470 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:24:59.470 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:24:59.470 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:24:59.470 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:24:59.470 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:24:59.470 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:24:59.471 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:24:59.471 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:24:59.471 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:24:59.471 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:24:59.471 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:24:59.471 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:24:59.471 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:24:59.471 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:24:59.471 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:24:59.471 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:24:59.471 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:24:59.471 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:24:59.471 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:24:59.471 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:24:59.472 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:24:59.472 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:24:59.472 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:24:59.472 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:24:59.472 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:24:59.472 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:24:59.472 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:24:59.472 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:24:59.472 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:24:59.472 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:24:59.472 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:24:59.472 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:24:59.472 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:24:59.473 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:24:59.473 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:24:59.473 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:24:59.473 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.473 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:24:59.473 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:24:59.473 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:24:59.473 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:24:59.473 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:24:59.473 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:24:59.473 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:24:59.473 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:24:59.473 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:24:59.473 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:24:59.474 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:24:59.474 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.474 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:24:59.474 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:24:59.474 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 96, 2024-09-16T03:24:59.474 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 96, 2024-09-16T03:24:59.474 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 3 2024-09-16T03:24:59.474 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:59.474 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:59.474 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_stats": [ 2024-09-16T03:24:59.474 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.474 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:24:59.474 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 21474836505 2024-09-16T03:24:59.474 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.475 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.475 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:24:59.475 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 42949672977 2024-09-16T03:24:59.475 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.475 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.475 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:24:59.475 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 64424509450 2024-09-16T03:24:59.475 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:59.475 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:59.475 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_by_state": [ 2024-09-16T03:24:59.475 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.475 INFO:tasks.workunit.client.0.smithi096.stderr: "state": "active+clean", 2024-09-16T03:24:59.476 INFO:tasks.workunit.client.0.smithi096.stderr: "num": 64 2024-09-16T03:24:59.476 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:59.476 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:59.476 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_by_osd": [ 2024-09-16T03:24:59.476 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.476 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:24:59.476 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 15, 2024-09-16T03:24:59.476 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 64, 2024-09-16T03:24:59.477 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:24:59.477 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.477 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.477 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:24:59.477 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 20, 2024-09-16T03:24:59.477 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 64, 2024-09-16T03:24:59.477 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:24:59.477 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.477 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.477 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:24:59.477 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 29, 2024-09-16T03:24:59.477 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 64, 2024-09-16T03:24:59.477 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:24:59.477 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:59.478 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:59.478 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": [ 2024-09-16T03:24:59.478 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.478 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 1, 2024-09-16T03:24:59.478 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": {} 2024-09-16T03:24:59.478 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.478 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:24:59.478 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 2, 2024-09-16T03:24:59.478 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": {} 2024-09-16T03:24:59.478 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:59.478 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:24:59.478 INFO:tasks.workunit.client.0.smithi096.stderr: "servicemap": { 2024-09-16T03:24:59.478 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 3, 2024-09-16T03:24:59.478 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:24:24.403052+0000", 2024-09-16T03:24:59.479 INFO:tasks.workunit.client.0.smithi096.stderr: "services": { 2024-09-16T03:24:59.479 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": { 2024-09-16T03:24:59.479 INFO:tasks.workunit.client.0.smithi096.stderr: "daemons": { 2024-09-16T03:24:59.479 INFO:tasks.workunit.client.0.smithi096.stderr: "summary": "", 2024-09-16T03:24:59.479 INFO:tasks.workunit.client.0.smithi096.stderr: "1": { 2024-09-16T03:24:59.479 INFO:tasks.workunit.client.0.smithi096.stderr: "start_epoch": 0, 2024-09-16T03:24:59.479 INFO:tasks.workunit.client.0.smithi096.stderr: "start_stamp": "0.000000", 2024-09-16T03:24:59.479 INFO:tasks.workunit.client.0.smithi096.stderr: "gid": 0, 2024-09-16T03:24:59.479 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "(unrecognized address family 0)/0", 2024-09-16T03:24:59.479 INFO:tasks.workunit.client.0.smithi096.stderr: "metadata": {}, 2024-09-16T03:24:59.479 INFO:tasks.workunit.client.0.smithi096.stderr: "task_status": {} 2024-09-16T03:24:59.479 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:59.480 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:59.480 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:59.480 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:59.480 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:24:59.480 INFO:tasks.workunit.client.0.smithi096.stderr: "mgrstat_first_committed": 49, 2024-09-16T03:24:59.480 INFO:tasks.workunit.client.0.smithi096.stderr: "mgrstat_last_committed": 55, 2024-09-16T03:24:59.480 INFO:tasks.workunit.client.0.smithi096.stderr: "logm_first_committed": 1, 2024-09-16T03:24:59.480 INFO:tasks.workunit.client.0.smithi096.stderr: "logm_last_committed": 242, 2024-09-16T03:24:59.480 INFO:tasks.workunit.client.0.smithi096.stderr: "paxos": { 2024-09-16T03:24:59.480 INFO:tasks.workunit.client.0.smithi096.stderr: "first_committed": 1, 2024-09-16T03:24:59.480 INFO:tasks.workunit.client.0.smithi096.stderr: "last_committed": 335, 2024-09-16T03:24:59.480 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pn": 0, 2024-09-16T03:24:59.480 INFO:tasks.workunit.client.0.smithi096.stderr: "accepted_pn": 0 2024-09-16T03:24:59.480 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:24:59.481 INFO:tasks.workunit.client.0.smithi096.stderr:}' 2024-09-16T03:24:59.484 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:132: get_fc_lc_diff: jq .osdmap_first_committed 2024-09-16T03:24:59.484 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:132: get_fc_lc_diff: echo '{' '"cluster_fingerprint":' '"fda2fc64-07ed-4add-8224-2e527e11d427",' '"version":' '"19.3.0-4930-gfc3e0bff",' '"commit":' '"fc3e0bff7468fd55478adbae7f75508b749124b6",' '"timestamp":' '"2024-09-16T03:24:59.364956+0000",' '"tag":' '"",' '"health":' '{' '"status":' '"HEALTH_OK",' '"checks":' '{},' '"mutes":' '[]' '},' '"monmap_first_committed":' 1, '"monmap_last_committed":' 1, '"monmap":' '{' '"epoch":' 1, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"modified":' '"2024-09-16T03:22:45.872880Z",' '"created":' '"2024-09-16T03:22:45.872880Z",' '"min_mon_release":' 19, '"min_mon_release_name":' '"squid",' '"election_strategy":' 1, '"disallowed_leaders:' '":' '"",' '"stretch_mode":' false, '"tiebreaker_mon":' '"",' '"removed_ranks:' '":' '"",' '"features":' '{' '"persistent":' '[' '"kraken",' '"luminous",' '"mimic",' '"osdmap-prune",' '"nautilus",' '"octopus",' '"pacific",' '"elector-pinging",' '"quincy",' '"reef",' '"squid"' '],' '"optional":' '[]' '},' '"mons":' '[' '{' '"rank":' 0, '"name":' '"a",' '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:7302",' '"nonce":' 0 '}' ']' '},' '"addr":' '"127.0.0.1:7302/0",' '"public_addr":' '"127.0.0.1:7302/0",' '"priority":' 0, '"weight":' 0, '"crush_location":' '"{}"' '}' ']' '},' '"quorum":' '[' 0 '],' '"osdmap":' '{' '"epoch":' 28, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"created":' '"2024-09-16T03:22:46.906117+0000",' '"modified":' '"2024-09-16T03:24:50.642444+0000",' '"last_up_change":' '"2024-09-16T03:24:37.708512+0000",' '"last_in_change":' '"2024-09-16T03:24:01.831039+0000",' '"flags":' '"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit",' '"flags_num":' 5799936, '"flags_set":' '[' '"pglog_hardlimit",' '"purged_snapdirs",' '"recovery_deletes",' '"sortbitwise"' '],' '"crush_version":' 7, '"full_ratio":' 0.97000002861022949, '"backfillfull_ratio":' 0.97000002861022949, '"nearfull_ratio":' 0.85000002384185791, '"cluster_snapshot":' '"",' '"pool_max":' 2, '"max_osd":' 3, '"require_min_compat_client":' '"luminous",' '"min_compat_client":' '"jewel",' '"require_osd_release":' '"squid",' '"allow_crimson":' false, '"pools":' '[' '{' '"pool":' 1, '"pool_name":' '"foo",' '"create_time":' '"2024-09-16T03:24:44.525189+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"21",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.690000057220459, '"score_stable":' 1.690000057220459, '"optimal_score":' 1, '"raw_score_acting":' 1.690000057220459, '"raw_score_stable":' 1.690000057220459, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '},' '{' '"pool":' 2, '"pool_name":' '"bar",' '"create_time":' '"2024-09-16T03:24:46.226575+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"24",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.1299999952316284, '"score_stable":' 1.1299999952316284, '"optimal_score":' 1, '"raw_score_acting":' 1.1299999952316284, '"raw_score_stable":' 1.1299999952316284, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '}' '],' '"osds":' '[' '{' '"osd":' 0, '"uuid":' '"64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 5, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6802",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6803",' '"nonce":' 3375787448 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6804",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6805",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6808",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6809",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6806",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6807",' '"nonce":' 3375787448 '}' ']' '},' '"public_addr":' '"127.0.0.1:6803/3375787448",' '"cluster_addr":' '"127.0.0.1:6805/3375787448",' '"heartbeat_back_addr":' '"127.0.0.1:6809/3375787448",' '"heartbeat_front_addr":' '"127.0.0.1:6807/3375787448",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 1, '"uuid":' '"74b26727-75c9-444d-8782-719e4197a382",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 10, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6810",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6811",' '"nonce":' 3733255132 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6812",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6813",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6816",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6817",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6814",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6815",' '"nonce":' 3733255132 '}' ']' '},' '"public_addr":' '"127.0.0.1:6811/3733255132",' '"cluster_addr":' '"127.0.0.1:6813/3733255132",' '"heartbeat_back_addr":' '"127.0.0.1:6817/3733255132",' '"heartbeat_front_addr":' '"127.0.0.1:6815/3733255132",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 2, '"uuid":' '"143da3a7-dad9-4b1e-966b-76cf5bdd3c82",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 15, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6818",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6819",' '"nonce":' 963814857 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6820",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6821",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6824",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6825",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6822",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6823",' '"nonce":' 963814857 '}' ']' '},' '"public_addr":' '"127.0.0.1:6819/963814857",' '"cluster_addr":' '"127.0.0.1:6821/963814857",' '"heartbeat_back_addr":' '"127.0.0.1:6825/963814857",' '"heartbeat_front_addr":' '"127.0.0.1:6823/963814857",' '"state":' '[' '"exists",' '"up"' ']' '}' '],' '"osd_xinfo":' '[' '{' '"osd":' 0, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:22.481942+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 1, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:59.663703+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 2, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:24:37.320822+0000",' '"dead_epoch":' 0 '}' '],' '"pg_upmap":' '[],' '"pg_upmap_items":' '[],' '"pg_upmap_primaries":' '[],' '"pg_temp":' '[],' '"primary_temp":' '[],' '"blocklist":' '{},' '"range_blocklist":' '{},' '"erasure_code_profiles":' '{' '"default":' '{' '"k":' '"2",' '"m":' '"2",' '"plugin":' '"jerasure",' '"technique":' '"reed_sol_van"' '}' '},' '"removed_snaps_queue":' '[],' '"new_removed_snaps":' '[],' '"new_purged_snaps":' '[],' '"crush_node_flags":' '{},' '"device_class_flags":' '{},' '"stretch_mode":' '{' '"stretch_mode_enabled":' false, '"stretch_bucket_count":' 0, '"degraded_stretch_mode":' 0, '"recovering_stretch_mode":' 0, '"stretch_mode_bucket":' 0 '}' '},' '"osd_metadata":' '[' '{' '"id":' 0, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/0/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:22:53.662571Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]",' '"hb_front_addr":' '"[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/0",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 1, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/1/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:23:30.129885Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]",' '"hb_front_addr":' '"[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/1",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 2, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/2/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:24:07.764502Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]",' '"hb_front_addr":' '"[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/2",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '}' '],' '"osdmap_clean_epochs":' '{' '"min_last_epoch_clean":' 23, '"last_epoch_clean":' '{' '"per_pool":' '[' '{' '"poolid":' 1, '"floor":' 23 '},' '{' '"poolid":' 2, '"floor":' 23 '}' ']' '},' '"osd_epochs":' '[' '{' '"id":' 0, '"epoch":' 28 '},' '{' '"id":' 1, '"epoch":' 28 '},' '{' '"id":' 2, '"epoch":' 23 '}' ']' '},' '"osdmap_first_committed":' 23, '"osdmap_last_committed":' 28, '"crushmap":' '{' '"devices":' '[' '{' '"id":' 0, '"name":' '"osd.0",' '"class":' '"hdd"' '},' '{' '"id":' 1, '"name":' '"osd.1",' '"class":' '"hdd"' '},' '{' '"id":' 2, '"name":' '"osd.2",' '"class":' '"hdd"' '}' '],' '"types":' '[' '{' '"type_id":' 0, '"name":' '"osd"' '},' '{' '"type_id":' 1, '"name":' '"host"' '},' '{' '"type_id":' 2, '"name":' '"chassis"' '},' '{' '"type_id":' 3, '"name":' '"rack"' '},' '{' '"type_id":' 4, '"name":' '"row"' '},' '{' '"type_id":' 5, '"name":' '"pdu"' '},' '{' '"type_id":' 6, '"name":' '"pod"' '},' '{' '"type_id":' 7, '"name":' '"room"' '},' '{' '"type_id":' 8, '"name":' '"datacenter"' '},' '{' '"type_id":' 9, '"name":' '"zone"' '},' '{' '"type_id":' 10, '"name":' '"region"' '},' '{' '"type_id":' 11, '"name":' '"root"' '}' '],' '"buckets":' '[' '{' '"id":' -1, '"name":' '"default",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -3, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -2, '"name":' '"default~hdd",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -4, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -3, '"name":' '"smithi096",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '},' '{' '"id":' -4, '"name":' '"smithi096~hdd",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '}' '],' '"rules":' '[' '{' '"rule_id":' 0, '"rule_name":' '"replicated_rule",' '"type":' 1, '"steps":' '[' '{' '"op":' '"take",' '"item":' -1, '"item_name":' '"default"' '},' '{' '"op":' '"choose_firstn",' '"num":' 0, '"type":' '"osd"' '},' '{' '"op":' '"emit"' '}' ']' '}' '],' '"tunables":' '{' '"choose_local_tries":' 0, '"choose_local_fallback_tries":' 0, '"choose_total_tries":' 50, '"chooseleaf_descend_once":' 1, '"chooseleaf_vary_r":' 1, '"chooseleaf_stable":' 1, '"msr_descents":' 100, '"msr_collision_tries":' 100, '"straw_calc_version":' 1, '"allowed_bucket_algs":' 54, '"profile":' '"jewel",' '"optimal_tunables":' 1, '"legacy_tunables":' 0, '"minimum_required_version":' '"jewel",' '"require_feature_tunables":' 1, '"require_feature_tunables2":' 1, '"has_v2_rules":' 0, '"require_feature_tunables3":' 1, '"has_v3_rules":' 0, '"has_v4_buckets":' 1, '"require_feature_tunables5":' 1, '"has_v5_rules":' 0, '"has_msr_rules":' 0 '},' '"choose_args":' '{}' '},' '"fsmap":' '{' '"epoch":' 1, '"btime":' '"2024-09-16T03:22:46:882186+0000",' '"default_fscid":' -1, '"compat":' '{' '"compat":' '{},' '"ro_compat":' '{},' '"incompat":' '{' '"feature_1":' '"base' 'v0.20",' '"feature_2":' '"client' writeable 'ranges",' '"feature_3":' '"default' file layouts on 'dirs",' '"feature_4":' '"dir' inode in separate 'object",' '"feature_5":' '"mds' uses versioned 'encoding",' '"feature_6":' '"dirfrag' is stored in 'omap",' '"feature_8":' '"no' anchor 'table",' '"feature_9":' '"file' layout 'v2",' '"feature_10":' '"snaprealm' 'v2",' '"feature_11":' '"minor' log 'segments",' '"feature_12":' '"quiesce' 'subvolumes"' '}' '},' '"feature_flags":' '{' '"enable_multiple":' true, '"ever_enabled_multiple":' true '},' '"standbys":' '[],' '"filesystems":' '[]' '},' '"mdsmap_first_committed":' 1, '"mdsmap_last_committed":' 1, '"auth":' '{' '"first_committed":' 1, '"last_committed":' 5, '"num_secrets":' 3 '},' '"num_pg":' 64, '"num_pg_active":' 64, '"num_pg_unknown":' 0, '"num_osd":' 3, '"pool_sum":' '{' '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 192, '"acting":' 192, '"num_store_stats":' 0 '},' '"osd_sum":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 192, '"num_osds":' 3, '"num_per_pool_osds":' 3, '"num_per_pool_omap_osds":' 3, '"kb":' 314572800, '"kb_used":' 81232, '"kb_used_data":' 696, '"kb_used_omap":' 4, '"kb_used_meta":' 80443, '"kb_avail":' 314491568, '"statfs":' '{' '"total":' 322122547200, '"available":' 322039365632, '"internally_reserved":' 0, '"allocated":' 712704, '"data_stored":' 209643, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 4785, '"internal_metadata":' 82373967 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 235, '"apply_latency_ms":' 235, '"commit_latency_ns":' 235000000, '"apply_latency_ns":' 235000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '},' '"osd_sum_by_class":' '{' '"hdd":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 192, '"num_osds":' 3, '"num_per_pool_osds":' 3, '"num_per_pool_omap_osds":' 3, '"kb":' 314572800, '"kb_used":' 81232, '"kb_used_data":' 696, '"kb_used_omap":' 4, '"kb_used_meta":' 80443, '"kb_avail":' 314491568, '"statfs":' '{' '"total":' 322122547200, '"available":' 322039365632, '"internally_reserved":' 0, '"allocated":' 712704, '"data_stored":' 209643, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 4785, '"internal_metadata":' 82373967 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 235, '"apply_latency_ms":' 235, '"commit_latency_ns":' 235000000, '"apply_latency_ns":' 235000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '}' '},' '"pool_stats":' '[' '{' '"poolid":' 2, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 96, '"acting":' 96, '"num_store_stats":' 3 '},' '{' '"poolid":' 1, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 96, '"acting":' 96, '"num_store_stats":' 3 '}' '],' '"osd_stats":' '[' '{' '"osd":' 0, '"seq":' 21474836505 '},' '{' '"osd":' 1, '"seq":' 42949672977 '},' '{' '"osd":' 2, '"seq":' 64424509450 '}' '],' '"num_pg_by_state":' '[' '{' '"state":' '"active+clean",' '"num":' 64 '}' '],' '"num_pg_by_osd":' '[' '{' '"osd":' 2, '"num_primary_pg":' 15, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 0, '"num_primary_pg":' 20, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 1, '"num_primary_pg":' 29, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '}' '],' '"purged_snaps":' '[' '{' '"pool":' 1, '"purged_snaps":' '{}' '},' '{' '"pool":' 2, '"purged_snaps":' '{}' '}' '],' '"servicemap":' '{' '"epoch":' 3, '"modified":' '"2024-09-16T03:24:24.403052+0000",' '"services":' '{' '"osd":' '{' '"daemons":' '{' '"summary":' '"",' '"1":' '{' '"start_epoch":' 0, '"start_stamp":' '"0.000000",' '"gid":' 0, '"addr":' '"(unrecognized' address family '0)/0",' '"metadata":' '{},' '"task_status":' '{}' '}' '}' '}' '}' '},' '"mgrstat_first_committed":' 49, '"mgrstat_last_committed":' 55, '"logm_first_committed":' 1, '"logm_last_committed":' 242, '"paxos":' '{' '"first_committed":' 1, '"last_committed":' 335, '"last_pn":' 0, '"accepted_pn":' 0 '}' '}' 2024-09-16T03:24:59.484 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:132: get_fc_lc_diff: osdm_fc=23 2024-09-16T03:24:59.484 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:134: get_fc_lc_diff: jq .osdmap_last_committed 2024-09-16T03:24:59.484 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:134: get_fc_lc_diff: echo '{' '"cluster_fingerprint":' '"fda2fc64-07ed-4add-8224-2e527e11d427",' '"version":' '"19.3.0-4930-gfc3e0bff",' '"commit":' '"fc3e0bff7468fd55478adbae7f75508b749124b6",' '"timestamp":' '"2024-09-16T03:24:59.364956+0000",' '"tag":' '"",' '"health":' '{' '"status":' '"HEALTH_OK",' '"checks":' '{},' '"mutes":' '[]' '},' '"monmap_first_committed":' 1, '"monmap_last_committed":' 1, '"monmap":' '{' '"epoch":' 1, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"modified":' '"2024-09-16T03:22:45.872880Z",' '"created":' '"2024-09-16T03:22:45.872880Z",' '"min_mon_release":' 19, '"min_mon_release_name":' '"squid",' '"election_strategy":' 1, '"disallowed_leaders:' '":' '"",' '"stretch_mode":' false, '"tiebreaker_mon":' '"",' '"removed_ranks:' '":' '"",' '"features":' '{' '"persistent":' '[' '"kraken",' '"luminous",' '"mimic",' '"osdmap-prune",' '"nautilus",' '"octopus",' '"pacific",' '"elector-pinging",' '"quincy",' '"reef",' '"squid"' '],' '"optional":' '[]' '},' '"mons":' '[' '{' '"rank":' 0, '"name":' '"a",' '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:7302",' '"nonce":' 0 '}' ']' '},' '"addr":' '"127.0.0.1:7302/0",' '"public_addr":' '"127.0.0.1:7302/0",' '"priority":' 0, '"weight":' 0, '"crush_location":' '"{}"' '}' ']' '},' '"quorum":' '[' 0 '],' '"osdmap":' '{' '"epoch":' 28, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"created":' '"2024-09-16T03:22:46.906117+0000",' '"modified":' '"2024-09-16T03:24:50.642444+0000",' '"last_up_change":' '"2024-09-16T03:24:37.708512+0000",' '"last_in_change":' '"2024-09-16T03:24:01.831039+0000",' '"flags":' '"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit",' '"flags_num":' 5799936, '"flags_set":' '[' '"pglog_hardlimit",' '"purged_snapdirs",' '"recovery_deletes",' '"sortbitwise"' '],' '"crush_version":' 7, '"full_ratio":' 0.97000002861022949, '"backfillfull_ratio":' 0.97000002861022949, '"nearfull_ratio":' 0.85000002384185791, '"cluster_snapshot":' '"",' '"pool_max":' 2, '"max_osd":' 3, '"require_min_compat_client":' '"luminous",' '"min_compat_client":' '"jewel",' '"require_osd_release":' '"squid",' '"allow_crimson":' false, '"pools":' '[' '{' '"pool":' 1, '"pool_name":' '"foo",' '"create_time":' '"2024-09-16T03:24:44.525189+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"21",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.690000057220459, '"score_stable":' 1.690000057220459, '"optimal_score":' 1, '"raw_score_acting":' 1.690000057220459, '"raw_score_stable":' 1.690000057220459, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '},' '{' '"pool":' 2, '"pool_name":' '"bar",' '"create_time":' '"2024-09-16T03:24:46.226575+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"24",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.1299999952316284, '"score_stable":' 1.1299999952316284, '"optimal_score":' 1, '"raw_score_acting":' 1.1299999952316284, '"raw_score_stable":' 1.1299999952316284, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '}' '],' '"osds":' '[' '{' '"osd":' 0, '"uuid":' '"64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 5, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6802",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6803",' '"nonce":' 3375787448 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6804",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6805",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6808",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6809",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6806",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6807",' '"nonce":' 3375787448 '}' ']' '},' '"public_addr":' '"127.0.0.1:6803/3375787448",' '"cluster_addr":' '"127.0.0.1:6805/3375787448",' '"heartbeat_back_addr":' '"127.0.0.1:6809/3375787448",' '"heartbeat_front_addr":' '"127.0.0.1:6807/3375787448",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 1, '"uuid":' '"74b26727-75c9-444d-8782-719e4197a382",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 10, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6810",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6811",' '"nonce":' 3733255132 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6812",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6813",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6816",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6817",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6814",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6815",' '"nonce":' 3733255132 '}' ']' '},' '"public_addr":' '"127.0.0.1:6811/3733255132",' '"cluster_addr":' '"127.0.0.1:6813/3733255132",' '"heartbeat_back_addr":' '"127.0.0.1:6817/3733255132",' '"heartbeat_front_addr":' '"127.0.0.1:6815/3733255132",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 2, '"uuid":' '"143da3a7-dad9-4b1e-966b-76cf5bdd3c82",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 15, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6818",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6819",' '"nonce":' 963814857 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6820",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6821",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6824",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6825",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6822",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6823",' '"nonce":' 963814857 '}' ']' '},' '"public_addr":' '"127.0.0.1:6819/963814857",' '"cluster_addr":' '"127.0.0.1:6821/963814857",' '"heartbeat_back_addr":' '"127.0.0.1:6825/963814857",' '"heartbeat_front_addr":' '"127.0.0.1:6823/963814857",' '"state":' '[' '"exists",' '"up"' ']' '}' '],' '"osd_xinfo":' '[' '{' '"osd":' 0, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:22.481942+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 1, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:59.663703+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 2, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:24:37.320822+0000",' '"dead_epoch":' 0 '}' '],' '"pg_upmap":' '[],' '"pg_upmap_items":' '[],' '"pg_upmap_primaries":' '[],' '"pg_temp":' '[],' '"primary_temp":' '[],' '"blocklist":' '{},' '"range_blocklist":' '{},' '"erasure_code_profiles":' '{' '"default":' '{' '"k":' '"2",' '"m":' '"2",' '"plugin":' '"jerasure",' '"technique":' '"reed_sol_van"' '}' '},' '"removed_snaps_queue":' '[],' '"new_removed_snaps":' '[],' '"new_purged_snaps":' '[],' '"crush_node_flags":' '{},' '"device_class_flags":' '{},' '"stretch_mode":' '{' '"stretch_mode_enabled":' false, '"stretch_bucket_count":' 0, '"degraded_stretch_mode":' 0, '"recovering_stretch_mode":' 0, '"stretch_mode_bucket":' 0 '}' '},' '"osd_metadata":' '[' '{' '"id":' 0, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/0/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:22:53.662571Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]",' '"hb_front_addr":' '"[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/0",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 1, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/1/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:23:30.129885Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]",' '"hb_front_addr":' '"[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/1",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 2, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/2/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:24:07.764502Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]",' '"hb_front_addr":' '"[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/2",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '}' '],' '"osdmap_clean_epochs":' '{' '"min_last_epoch_clean":' 23, '"last_epoch_clean":' '{' '"per_pool":' '[' '{' '"poolid":' 1, '"floor":' 23 '},' '{' '"poolid":' 2, '"floor":' 23 '}' ']' '},' '"osd_epochs":' '[' '{' '"id":' 0, '"epoch":' 28 '},' '{' '"id":' 1, '"epoch":' 28 '},' '{' '"id":' 2, '"epoch":' 23 '}' ']' '},' '"osdmap_first_committed":' 23, '"osdmap_last_committed":' 28, '"crushmap":' '{' '"devices":' '[' '{' '"id":' 0, '"name":' '"osd.0",' '"class":' '"hdd"' '},' '{' '"id":' 1, '"name":' '"osd.1",' '"class":' '"hdd"' '},' '{' '"id":' 2, '"name":' '"osd.2",' '"class":' '"hdd"' '}' '],' '"types":' '[' '{' '"type_id":' 0, '"name":' '"osd"' '},' '{' '"type_id":' 1, '"name":' '"host"' '},' '{' '"type_id":' 2, '"name":' '"chassis"' '},' '{' '"type_id":' 3, '"name":' '"rack"' '},' '{' '"type_id":' 4, '"name":' '"row"' '},' '{' '"type_id":' 5, '"name":' '"pdu"' '},' '{' '"type_id":' 6, '"name":' '"pod"' '},' '{' '"type_id":' 7, '"name":' '"room"' '},' '{' '"type_id":' 8, '"name":' '"datacenter"' '},' '{' '"type_id":' 9, '"name":' '"zone"' '},' '{' '"type_id":' 10, '"name":' '"region"' '},' '{' '"type_id":' 11, '"name":' '"root"' '}' '],' '"buckets":' '[' '{' '"id":' -1, '"name":' '"default",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -3, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -2, '"name":' '"default~hdd",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -4, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -3, '"name":' '"smithi096",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '},' '{' '"id":' -4, '"name":' '"smithi096~hdd",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '}' '],' '"rules":' '[' '{' '"rule_id":' 0, '"rule_name":' '"replicated_rule",' '"type":' 1, '"steps":' '[' '{' '"op":' '"take",' '"item":' -1, '"item_name":' '"default"' '},' '{' '"op":' '"choose_firstn",' '"num":' 0, '"type":' '"osd"' '},' '{' '"op":' '"emit"' '}' ']' '}' '],' '"tunables":' '{' '"choose_local_tries":' 0, '"choose_local_fallback_tries":' 0, '"choose_total_tries":' 50, '"chooseleaf_descend_once":' 1, '"chooseleaf_vary_r":' 1, '"chooseleaf_stable":' 1, '"msr_descents":' 100, '"msr_collision_tries":' 100, '"straw_calc_version":' 1, '"allowed_bucket_algs":' 54, '"profile":' '"jewel",' '"optimal_tunables":' 1, '"legacy_tunables":' 0, '"minimum_required_version":' '"jewel",' '"require_feature_tunables":' 1, '"require_feature_tunables2":' 1, '"has_v2_rules":' 0, '"require_feature_tunables3":' 1, '"has_v3_rules":' 0, '"has_v4_buckets":' 1, '"require_feature_tunables5":' 1, '"has_v5_rules":' 0, '"has_msr_rules":' 0 '},' '"choose_args":' '{}' '},' '"fsmap":' '{' '"epoch":' 1, '"btime":' '"2024-09-16T03:22:46:882186+0000",' '"default_fscid":' -1, '"compat":' '{' '"compat":' '{},' '"ro_compat":' '{},' '"incompat":' '{' '"feature_1":' '"base' 'v0.20",' '"feature_2":' '"client' writeable 'ranges",' '"feature_3":' '"default' file layouts on 'dirs",' '"feature_4":' '"dir' inode in separate 'object",' '"feature_5":' '"mds' uses versioned 'encoding",' '"feature_6":' '"dirfrag' is stored in 'omap",' '"feature_8":' '"no' anchor 'table",' '"feature_9":' '"file' layout 'v2",' '"feature_10":' '"snaprealm' 'v2",' '"feature_11":' '"minor' log 'segments",' '"feature_12":' '"quiesce' 'subvolumes"' '}' '},' '"feature_flags":' '{' '"enable_multiple":' true, '"ever_enabled_multiple":' true '},' '"standbys":' '[],' '"filesystems":' '[]' '},' '"mdsmap_first_committed":' 1, '"mdsmap_last_committed":' 1, '"auth":' '{' '"first_committed":' 1, '"last_committed":' 5, '"num_secrets":' 3 '},' '"num_pg":' 64, '"num_pg_active":' 64, '"num_pg_unknown":' 0, '"num_osd":' 3, '"pool_sum":' '{' '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 192, '"acting":' 192, '"num_store_stats":' 0 '},' '"osd_sum":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 192, '"num_osds":' 3, '"num_per_pool_osds":' 3, '"num_per_pool_omap_osds":' 3, '"kb":' 314572800, '"kb_used":' 81232, '"kb_used_data":' 696, '"kb_used_omap":' 4, '"kb_used_meta":' 80443, '"kb_avail":' 314491568, '"statfs":' '{' '"total":' 322122547200, '"available":' 322039365632, '"internally_reserved":' 0, '"allocated":' 712704, '"data_stored":' 209643, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 4785, '"internal_metadata":' 82373967 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 235, '"apply_latency_ms":' 235, '"commit_latency_ns":' 235000000, '"apply_latency_ns":' 235000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '},' '"osd_sum_by_class":' '{' '"hdd":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 192, '"num_osds":' 3, '"num_per_pool_osds":' 3, '"num_per_pool_omap_osds":' 3, '"kb":' 314572800, '"kb_used":' 81232, '"kb_used_data":' 696, '"kb_used_omap":' 4, '"kb_used_meta":' 80443, '"kb_avail":' 314491568, '"statfs":' '{' '"total":' 322122547200, '"available":' 322039365632, '"internally_reserved":' 0, '"allocated":' 712704, '"data_stored":' 209643, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 4785, '"internal_metadata":' 82373967 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 235, '"apply_latency_ms":' 235, '"commit_latency_ns":' 235000000, '"apply_latency_ns":' 235000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '}' '},' '"pool_stats":' '[' '{' '"poolid":' 2, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 96, '"acting":' 96, '"num_store_stats":' 3 '},' '{' '"poolid":' 1, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 96, '"acting":' 96, '"num_store_stats":' 3 '}' '],' '"osd_stats":' '[' '{' '"osd":' 0, '"seq":' 21474836505 '},' '{' '"osd":' 1, '"seq":' 42949672977 '},' '{' '"osd":' 2, '"seq":' 64424509450 '}' '],' '"num_pg_by_state":' '[' '{' '"state":' '"active+clean",' '"num":' 64 '}' '],' '"num_pg_by_osd":' '[' '{' '"osd":' 2, '"num_primary_pg":' 15, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 0, '"num_primary_pg":' 20, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 1, '"num_primary_pg":' 29, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '}' '],' '"purged_snaps":' '[' '{' '"pool":' 1, '"purged_snaps":' '{}' '},' '{' '"pool":' 2, '"purged_snaps":' '{}' '}' '],' '"servicemap":' '{' '"epoch":' 3, '"modified":' '"2024-09-16T03:24:24.403052+0000",' '"services":' '{' '"osd":' '{' '"daemons":' '{' '"summary":' '"",' '"1":' '{' '"start_epoch":' 0, '"start_stamp":' '"0.000000",' '"gid":' 0, '"addr":' '"(unrecognized' address family '0)/0",' '"metadata":' '{},' '"task_status":' '{}' '}' '}' '}' '}' '},' '"mgrstat_first_committed":' 49, '"mgrstat_last_committed":' 55, '"logm_first_committed":' 1, '"logm_last_committed":' 242, '"paxos":' '{' '"first_committed":' 1, '"last_committed":' 335, '"last_pn":' 0, '"accepted_pn":' 0 '}' '}' 2024-09-16T03:24:59.484 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:134: get_fc_lc_diff: osdm_lc=28 2024-09-16T03:24:59.485 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:136: get_fc_lc_diff: echo 5 2024-09-16T03:24:59.485 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:161: wait_for_total_num_maps: [[ 5 -gt 2 ]] 2024-09-16T03:24:59.485 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:162: wait_for_total_num_maps: (( 5 >= 27 )) 2024-09-16T03:24:59.485 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:166: wait_for_total_num_maps: sleep 3.2 2024-09-16T03:25:02.649 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:167: wait_for_total_num_maps: loop+=1 2024-09-16T03:25:02.650 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:161: wait_for_total_num_maps: get_fc_lc_diff 2024-09-16T03:25:02.651 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:130: get_fc_lc_diff: ceph report 2024-09-16T03:25:03.309 INFO:tasks.workunit.client.0.smithi096.stderr:report 620163819 2024-09-16T03:25:03.327 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:130: get_fc_lc_diff: report='{ 2024-09-16T03:25:03.327 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_fingerprint": "fda2fc64-07ed-4add-8224-2e527e11d427", 2024-09-16T03:25:03.327 INFO:tasks.workunit.client.0.smithi096.stderr: "version": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:25:03.328 INFO:tasks.workunit.client.0.smithi096.stderr: "commit": "fc3e0bff7468fd55478adbae7f75508b749124b6", 2024-09-16T03:25:03.328 INFO:tasks.workunit.client.0.smithi096.stderr: "timestamp": "2024-09-16T03:25:03.309542+0000", 2024-09-16T03:25:03.328 INFO:tasks.workunit.client.0.smithi096.stderr: "tag": "", 2024-09-16T03:25:03.328 INFO:tasks.workunit.client.0.smithi096.stderr: "health": { 2024-09-16T03:25:03.328 INFO:tasks.workunit.client.0.smithi096.stderr: "status": "HEALTH_OK", 2024-09-16T03:25:03.328 INFO:tasks.workunit.client.0.smithi096.stderr: "checks": {}, 2024-09-16T03:25:03.328 INFO:tasks.workunit.client.0.smithi096.stderr: "mutes": [] 2024-09-16T03:25:03.328 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.328 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap_first_committed": 1, 2024-09-16T03:25:03.328 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap_last_committed": 1, 2024-09-16T03:25:03.328 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap": { 2024-09-16T03:25:03.328 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 1, 2024-09-16T03:25:03.328 INFO:tasks.workunit.client.0.smithi096.stderr: "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", 2024-09-16T03:25:03.329 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:22:45.872880Z", 2024-09-16T03:25:03.329 INFO:tasks.workunit.client.0.smithi096.stderr: "created": "2024-09-16T03:22:45.872880Z", 2024-09-16T03:25:03.329 INFO:tasks.workunit.client.0.smithi096.stderr: "min_mon_release": 19, 2024-09-16T03:25:03.329 INFO:tasks.workunit.client.0.smithi096.stderr: "min_mon_release_name": "squid", 2024-09-16T03:25:03.329 INFO:tasks.workunit.client.0.smithi096.stderr: "election_strategy": 1, 2024-09-16T03:25:03.329 INFO:tasks.workunit.client.0.smithi096.stderr: "disallowed_leaders: ": "", 2024-09-16T03:25:03.329 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode": false, 2024-09-16T03:25:03.329 INFO:tasks.workunit.client.0.smithi096.stderr: "tiebreaker_mon": "", 2024-09-16T03:25:03.329 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_ranks: ": "", 2024-09-16T03:25:03.329 INFO:tasks.workunit.client.0.smithi096.stderr: "features": { 2024-09-16T03:25:03.329 INFO:tasks.workunit.client.0.smithi096.stderr: "persistent": [ 2024-09-16T03:25:03.329 INFO:tasks.workunit.client.0.smithi096.stderr: "kraken", 2024-09-16T03:25:03.330 INFO:tasks.workunit.client.0.smithi096.stderr: "luminous", 2024-09-16T03:25:03.330 INFO:tasks.workunit.client.0.smithi096.stderr: "mimic", 2024-09-16T03:25:03.330 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap-prune", 2024-09-16T03:25:03.330 INFO:tasks.workunit.client.0.smithi096.stderr: "nautilus", 2024-09-16T03:25:03.330 INFO:tasks.workunit.client.0.smithi096.stderr: "octopus", 2024-09-16T03:25:03.330 INFO:tasks.workunit.client.0.smithi096.stderr: "pacific", 2024-09-16T03:25:03.330 INFO:tasks.workunit.client.0.smithi096.stderr: "elector-pinging", 2024-09-16T03:25:03.330 INFO:tasks.workunit.client.0.smithi096.stderr: "quincy", 2024-09-16T03:25:03.330 INFO:tasks.workunit.client.0.smithi096.stderr: "reef", 2024-09-16T03:25:03.330 INFO:tasks.workunit.client.0.smithi096.stderr: "squid" 2024-09-16T03:25:03.330 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:03.330 INFO:tasks.workunit.client.0.smithi096.stderr: "optional": [] 2024-09-16T03:25:03.331 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.331 INFO:tasks.workunit.client.0.smithi096.stderr: "mons": [ 2024-09-16T03:25:03.331 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.331 INFO:tasks.workunit.client.0.smithi096.stderr: "rank": 0, 2024-09-16T03:25:03.331 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "a", 2024-09-16T03:25:03.331 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:25:03.331 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:03.331 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.331 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:03.331 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:7302", 2024-09-16T03:25:03.331 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 0 2024-09-16T03:25:03.331 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:03.331 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:03.332 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.332 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:7302/0", 2024-09-16T03:25:03.332 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:7302/0", 2024-09-16T03:25:03.332 INFO:tasks.workunit.client.0.smithi096.stderr: "priority": 0, 2024-09-16T03:25:03.332 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 0, 2024-09-16T03:25:03.332 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_location": "{}" 2024-09-16T03:25:03.332 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:03.332 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:03.332 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.332 INFO:tasks.workunit.client.0.smithi096.stderr: "quorum": [ 2024-09-16T03:25:03.332 INFO:tasks.workunit.client.0.smithi096.stderr: 0 2024-09-16T03:25:03.332 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:03.332 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap": { 2024-09-16T03:25:03.333 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 28, 2024-09-16T03:25:03.333 INFO:tasks.workunit.client.0.smithi096.stderr: "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", 2024-09-16T03:25:03.333 INFO:tasks.workunit.client.0.smithi096.stderr: "created": "2024-09-16T03:22:46.906117+0000", 2024-09-16T03:25:03.333 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:24:50.642444+0000", 2024-09-16T03:25:03.333 INFO:tasks.workunit.client.0.smithi096.stderr: "last_up_change": "2024-09-16T03:24:37.708512+0000", 2024-09-16T03:25:03.333 INFO:tasks.workunit.client.0.smithi096.stderr: "last_in_change": "2024-09-16T03:24:01.831039+0000", 2024-09-16T03:25:03.333 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-16T03:25:03.333 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_num": 5799936, 2024-09-16T03:25:03.333 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_set": [ 2024-09-16T03:25:03.333 INFO:tasks.workunit.client.0.smithi096.stderr: "pglog_hardlimit", 2024-09-16T03:25:03.333 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snapdirs", 2024-09-16T03:25:03.333 INFO:tasks.workunit.client.0.smithi096.stderr: "recovery_deletes", 2024-09-16T03:25:03.333 INFO:tasks.workunit.client.0.smithi096.stderr: "sortbitwise" 2024-09-16T03:25:03.334 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:03.334 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_version": 7, 2024-09-16T03:25:03.334 INFO:tasks.workunit.client.0.smithi096.stderr: "full_ratio": 0.97000002861022949, 2024-09-16T03:25:03.334 INFO:tasks.workunit.client.0.smithi096.stderr: "backfillfull_ratio": 0.97000002861022949, 2024-09-16T03:25:03.334 INFO:tasks.workunit.client.0.smithi096.stderr: "nearfull_ratio": 0.85000002384185791, 2024-09-16T03:25:03.334 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_snapshot": "", 2024-09-16T03:25:03.334 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_max": 2, 2024-09-16T03:25:03.334 INFO:tasks.workunit.client.0.smithi096.stderr: "max_osd": 3, 2024-09-16T03:25:03.334 INFO:tasks.workunit.client.0.smithi096.stderr: "require_min_compat_client": "luminous", 2024-09-16T03:25:03.334 INFO:tasks.workunit.client.0.smithi096.stderr: "min_compat_client": "jewel", 2024-09-16T03:25:03.334 INFO:tasks.workunit.client.0.smithi096.stderr: "require_osd_release": "squid", 2024-09-16T03:25:03.334 INFO:tasks.workunit.client.0.smithi096.stderr: "allow_crimson": false, 2024-09-16T03:25:03.334 INFO:tasks.workunit.client.0.smithi096.stderr: "pools": [ 2024-09-16T03:25:03.334 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.335 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 1, 2024-09-16T03:25:03.335 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_name": "foo", 2024-09-16T03:25:03.335 INFO:tasks.workunit.client.0.smithi096.stderr: "create_time": "2024-09-16T03:24:44.525189+0000", 2024-09-16T03:25:03.335 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": 1, 2024-09-16T03:25:03.335 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_names": "hashpspool", 2024-09-16T03:25:03.335 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:25:03.335 INFO:tasks.workunit.client.0.smithi096.stderr: "size": 3, 2024-09-16T03:25:03.335 INFO:tasks.workunit.client.0.smithi096.stderr: "min_size": 2, 2024-09-16T03:25:03.335 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_rule": 0, 2024-09-16T03:25:03.335 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_count": 0, 2024-09-16T03:25:03.335 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_target": 0, 2024-09-16T03:25:03.335 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_barrier": 0, 2024-09-16T03:25:03.335 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-16T03:25:03.336 INFO:tasks.workunit.client.0.smithi096.stderr: "is_stretch_pool": false, 2024-09-16T03:25:03.336 INFO:tasks.workunit.client.0.smithi096.stderr: "object_hash": 2, 2024-09-16T03:25:03.336 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_autoscale_mode": "off", 2024-09-16T03:25:03.336 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num": 32, 2024-09-16T03:25:03.336 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num": 32, 2024-09-16T03:25:03.336 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num_target": 32, 2024-09-16T03:25:03.336 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_target": 32, 2024-09-16T03:25:03.336 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_pending": 32, 2024-09-16T03:25:03.336 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pg_merge_meta": { 2024-09-16T03:25:03.336 INFO:tasks.workunit.client.0.smithi096.stderr: "source_pgid": "0.0", 2024-09-16T03:25:03.336 INFO:tasks.workunit.client.0.smithi096.stderr: "ready_epoch": 0, 2024-09-16T03:25:03.336 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_started": 0, 2024-09-16T03:25:03.336 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": 0, 2024-09-16T03:25:03.336 INFO:tasks.workunit.client.0.smithi096.stderr: "source_version": "0'\''0", 2024-09-16T03:25:03.337 INFO:tasks.workunit.client.0.smithi096.stderr: "target_version": "0'\''0" 2024-09-16T03:25:03.337 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.337 INFO:tasks.workunit.client.0.smithi096.stderr: "last_change": "21", 2024-09-16T03:25:03.337 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend": "0", 2024-09-16T03:25:03.337 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_prenautilus": "0", 2024-09-16T03:25:03.337 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_preluminous": "0", 2024-09-16T03:25:03.337 INFO:tasks.workunit.client.0.smithi096.stderr: "auid": 0, 2024-09-16T03:25:03.337 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_mode": "selfmanaged", 2024-09-16T03:25:03.337 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_seq": 0, 2024-09-16T03:25:03.337 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_epoch": 0, 2024-09-16T03:25:03.337 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_snaps": [], 2024-09-16T03:25:03.337 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps": "[]", 2024-09-16T03:25:03.337 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_bytes": 0, 2024-09-16T03:25:03.338 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_objects": 0, 2024-09-16T03:25:03.338 INFO:tasks.workunit.client.0.smithi096.stderr: "tiers": [], 2024-09-16T03:25:03.338 INFO:tasks.workunit.client.0.smithi096.stderr: "tier_of": -1, 2024-09-16T03:25:03.338 INFO:tasks.workunit.client.0.smithi096.stderr: "read_tier": -1, 2024-09-16T03:25:03.338 INFO:tasks.workunit.client.0.smithi096.stderr: "write_tier": -1, 2024-09-16T03:25:03.338 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_mode": "none", 2024-09-16T03:25:03.338 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_bytes": 0, 2024-09-16T03:25:03.338 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_objects": 0, 2024-09-16T03:25:03.338 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_ratio_micro": 400000, 2024-09-16T03:25:03.338 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-16T03:25:03.338 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_full_ratio_micro": 800000, 2024-09-16T03:25:03.338 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_flush_age": 0, 2024-09-16T03:25:03.338 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_evict_age": 0, 2024-09-16T03:25:03.339 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profile": "", 2024-09-16T03:25:03.339 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_params": { 2024-09-16T03:25:03.339 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "none" 2024-09-16T03:25:03.339 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.339 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_period": 0, 2024-09-16T03:25:03.339 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_count": 0, 2024-09-16T03:25:03.339 INFO:tasks.workunit.client.0.smithi096.stderr: "use_gmt_hitset": true, 2024-09-16T03:25:03.339 INFO:tasks.workunit.client.0.smithi096.stderr: "min_read_recency_for_promote": 0, 2024-09-16T03:25:03.339 INFO:tasks.workunit.client.0.smithi096.stderr: "min_write_recency_for_promote": 0, 2024-09-16T03:25:03.339 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_grade_decay_rate": 0, 2024-09-16T03:25:03.339 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_search_last_n": 0, 2024-09-16T03:25:03.339 INFO:tasks.workunit.client.0.smithi096.stderr: "grade_table": [], 2024-09-16T03:25:03.339 INFO:tasks.workunit.client.0.smithi096.stderr: "stripe_width": 0, 2024-09-16T03:25:03.339 INFO:tasks.workunit.client.0.smithi096.stderr: "expected_num_objects": 0, 2024-09-16T03:25:03.340 INFO:tasks.workunit.client.0.smithi096.stderr: "fast_read": false, 2024-09-16T03:25:03.340 INFO:tasks.workunit.client.0.smithi096.stderr: "options": {}, 2024-09-16T03:25:03.340 INFO:tasks.workunit.client.0.smithi096.stderr: "application_metadata": {}, 2024-09-16T03:25:03.340 INFO:tasks.workunit.client.0.smithi096.stderr: "read_balance": { 2024-09-16T03:25:03.340 INFO:tasks.workunit.client.0.smithi096.stderr: "score_type": "Fair distribution", 2024-09-16T03:25:03.340 INFO:tasks.workunit.client.0.smithi096.stderr: "score_acting": 1.690000057220459, 2024-09-16T03:25:03.340 INFO:tasks.workunit.client.0.smithi096.stderr: "score_stable": 1.690000057220459, 2024-09-16T03:25:03.340 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_score": 1, 2024-09-16T03:25:03.340 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_acting": 1.690000057220459, 2024-09-16T03:25:03.340 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_stable": 1.690000057220459, 2024-09-16T03:25:03.340 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity_weighted": 1, 2024-09-16T03:25:03.340 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity": 1, 2024-09-16T03:25:03.340 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity_weighted": 1 2024-09-16T03:25:03.341 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:03.341 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.341 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.341 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 2, 2024-09-16T03:25:03.341 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_name": "bar", 2024-09-16T03:25:03.341 INFO:tasks.workunit.client.0.smithi096.stderr: "create_time": "2024-09-16T03:24:46.226575+0000", 2024-09-16T03:25:03.341 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": 1, 2024-09-16T03:25:03.341 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_names": "hashpspool", 2024-09-16T03:25:03.341 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:25:03.341 INFO:tasks.workunit.client.0.smithi096.stderr: "size": 3, 2024-09-16T03:25:03.341 INFO:tasks.workunit.client.0.smithi096.stderr: "min_size": 2, 2024-09-16T03:25:03.341 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_rule": 0, 2024-09-16T03:25:03.341 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_count": 0, 2024-09-16T03:25:03.341 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_target": 0, 2024-09-16T03:25:03.342 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_barrier": 0, 2024-09-16T03:25:03.342 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-16T03:25:03.342 INFO:tasks.workunit.client.0.smithi096.stderr: "is_stretch_pool": false, 2024-09-16T03:25:03.342 INFO:tasks.workunit.client.0.smithi096.stderr: "object_hash": 2, 2024-09-16T03:25:03.342 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_autoscale_mode": "off", 2024-09-16T03:25:03.342 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num": 32, 2024-09-16T03:25:03.342 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num": 32, 2024-09-16T03:25:03.342 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num_target": 32, 2024-09-16T03:25:03.342 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_target": 32, 2024-09-16T03:25:03.342 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_pending": 32, 2024-09-16T03:25:03.342 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pg_merge_meta": { 2024-09-16T03:25:03.342 INFO:tasks.workunit.client.0.smithi096.stderr: "source_pgid": "0.0", 2024-09-16T03:25:03.342 INFO:tasks.workunit.client.0.smithi096.stderr: "ready_epoch": 0, 2024-09-16T03:25:03.342 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_started": 0, 2024-09-16T03:25:03.343 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": 0, 2024-09-16T03:25:03.343 INFO:tasks.workunit.client.0.smithi096.stderr: "source_version": "0'\''0", 2024-09-16T03:25:03.343 INFO:tasks.workunit.client.0.smithi096.stderr: "target_version": "0'\''0" 2024-09-16T03:25:03.343 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.343 INFO:tasks.workunit.client.0.smithi096.stderr: "last_change": "24", 2024-09-16T03:25:03.343 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend": "0", 2024-09-16T03:25:03.343 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_prenautilus": "0", 2024-09-16T03:25:03.343 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_preluminous": "0", 2024-09-16T03:25:03.343 INFO:tasks.workunit.client.0.smithi096.stderr: "auid": 0, 2024-09-16T03:25:03.343 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_mode": "selfmanaged", 2024-09-16T03:25:03.343 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_seq": 0, 2024-09-16T03:25:03.343 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_epoch": 0, 2024-09-16T03:25:03.343 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_snaps": [], 2024-09-16T03:25:03.344 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps": "[]", 2024-09-16T03:25:03.344 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_bytes": 0, 2024-09-16T03:25:03.344 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_objects": 0, 2024-09-16T03:25:03.344 INFO:tasks.workunit.client.0.smithi096.stderr: "tiers": [], 2024-09-16T03:25:03.344 INFO:tasks.workunit.client.0.smithi096.stderr: "tier_of": -1, 2024-09-16T03:25:03.344 INFO:tasks.workunit.client.0.smithi096.stderr: "read_tier": -1, 2024-09-16T03:25:03.344 INFO:tasks.workunit.client.0.smithi096.stderr: "write_tier": -1, 2024-09-16T03:25:03.344 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_mode": "none", 2024-09-16T03:25:03.344 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_bytes": 0, 2024-09-16T03:25:03.344 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_objects": 0, 2024-09-16T03:25:03.344 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_ratio_micro": 400000, 2024-09-16T03:25:03.344 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-16T03:25:03.344 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_full_ratio_micro": 800000, 2024-09-16T03:25:03.345 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_flush_age": 0, 2024-09-16T03:25:03.345 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_evict_age": 0, 2024-09-16T03:25:03.345 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profile": "", 2024-09-16T03:25:03.345 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_params": { 2024-09-16T03:25:03.345 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "none" 2024-09-16T03:25:03.345 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.345 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_period": 0, 2024-09-16T03:25:03.345 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_count": 0, 2024-09-16T03:25:03.345 INFO:tasks.workunit.client.0.smithi096.stderr: "use_gmt_hitset": true, 2024-09-16T03:25:03.345 INFO:tasks.workunit.client.0.smithi096.stderr: "min_read_recency_for_promote": 0, 2024-09-16T03:25:03.345 INFO:tasks.workunit.client.0.smithi096.stderr: "min_write_recency_for_promote": 0, 2024-09-16T03:25:03.345 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_grade_decay_rate": 0, 2024-09-16T03:25:03.345 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_search_last_n": 0, 2024-09-16T03:25:03.345 INFO:tasks.workunit.client.0.smithi096.stderr: "grade_table": [], 2024-09-16T03:25:03.346 INFO:tasks.workunit.client.0.smithi096.stderr: "stripe_width": 0, 2024-09-16T03:25:03.346 INFO:tasks.workunit.client.0.smithi096.stderr: "expected_num_objects": 0, 2024-09-16T03:25:03.346 INFO:tasks.workunit.client.0.smithi096.stderr: "fast_read": false, 2024-09-16T03:25:03.346 INFO:tasks.workunit.client.0.smithi096.stderr: "options": {}, 2024-09-16T03:25:03.346 INFO:tasks.workunit.client.0.smithi096.stderr: "application_metadata": {}, 2024-09-16T03:25:03.346 INFO:tasks.workunit.client.0.smithi096.stderr: "read_balance": { 2024-09-16T03:25:03.346 INFO:tasks.workunit.client.0.smithi096.stderr: "score_type": "Fair distribution", 2024-09-16T03:25:03.346 INFO:tasks.workunit.client.0.smithi096.stderr: "score_acting": 1.1299999952316284, 2024-09-16T03:25:03.346 INFO:tasks.workunit.client.0.smithi096.stderr: "score_stable": 1.1299999952316284, 2024-09-16T03:25:03.346 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_score": 1, 2024-09-16T03:25:03.346 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_acting": 1.1299999952316284, 2024-09-16T03:25:03.346 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_stable": 1.1299999952316284, 2024-09-16T03:25:03.346 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity_weighted": 1, 2024-09-16T03:25:03.346 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity": 1, 2024-09-16T03:25:03.347 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity_weighted": 1 2024-09-16T03:25:03.347 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:03.347 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:03.347 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:03.347 INFO:tasks.workunit.client.0.smithi096.stderr: "osds": [ 2024-09-16T03:25:03.347 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.347 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:25:03.347 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6", 2024-09-16T03:25:03.347 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:25:03.347 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:25:03.347 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:25:03.347 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:25:03.347 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:25:03.348 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:25:03.348 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 5, 2024-09-16T03:25:03.348 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 21, 2024-09-16T03:25:03.348 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:25:03.348 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:25:03.348 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:25:03.348 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:03.348 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.348 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:03.348 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6802", 2024-09-16T03:25:03.348 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:03.348 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.348 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.348 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:03.349 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6803", 2024-09-16T03:25:03.349 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:03.349 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:03.349 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:03.349 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.349 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:25:03.349 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:03.349 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.349 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:03.349 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6804", 2024-09-16T03:25:03.349 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:03.349 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.349 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.350 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:03.350 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6805", 2024-09-16T03:25:03.350 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:03.350 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:03.350 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:03.350 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.350 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:25:03.350 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:03.350 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.350 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:03.350 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6808", 2024-09-16T03:25:03.350 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:03.350 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.350 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.351 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:03.351 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6809", 2024-09-16T03:25:03.351 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:03.351 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:03.351 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:03.351 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.351 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:25:03.351 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:03.351 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.351 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:03.351 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6806", 2024-09-16T03:25:03.351 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:03.351 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.351 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.352 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:03.352 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6807", 2024-09-16T03:25:03.352 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:03.352 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:03.352 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:03.352 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.352 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6803/3375787448", 2024-09-16T03:25:03.352 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6805/3375787448", 2024-09-16T03:25:03.352 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6809/3375787448", 2024-09-16T03:25:03.352 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6807/3375787448", 2024-09-16T03:25:03.352 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:25:03.352 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:25:03.352 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:25:03.353 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:03.353 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.353 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.353 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:25:03.353 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "74b26727-75c9-444d-8782-719e4197a382", 2024-09-16T03:25:03.353 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:25:03.353 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:25:03.353 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:25:03.353 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:25:03.353 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:25:03.353 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:25:03.353 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 10, 2024-09-16T03:25:03.353 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 21, 2024-09-16T03:25:03.353 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:25:03.354 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:25:03.354 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:25:03.354 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:03.354 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.354 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:03.354 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6810", 2024-09-16T03:25:03.354 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:03.354 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.354 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.354 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:03.354 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6811", 2024-09-16T03:25:03.354 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:03.354 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:03.354 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:03.355 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.355 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:25:03.355 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:03.355 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.355 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:03.355 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6812", 2024-09-16T03:25:03.355 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:03.355 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.355 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.355 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:03.355 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6813", 2024-09-16T03:25:03.355 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:03.355 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:03.355 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:03.356 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.356 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:25:03.356 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:03.356 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.356 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:03.356 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6816", 2024-09-16T03:25:03.356 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:03.356 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.356 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.356 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:03.356 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6817", 2024-09-16T03:25:03.356 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:03.356 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:03.357 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:03.357 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.357 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:25:03.357 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:03.357 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.357 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:03.357 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6814", 2024-09-16T03:25:03.357 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:03.357 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.357 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.357 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:03.357 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6815", 2024-09-16T03:25:03.357 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:03.358 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:03.358 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:03.358 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.358 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6811/3733255132", 2024-09-16T03:25:03.358 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6813/3733255132", 2024-09-16T03:25:03.358 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6817/3733255132", 2024-09-16T03:25:03.358 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6815/3733255132", 2024-09-16T03:25:03.358 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:25:03.358 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:25:03.358 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:25:03.358 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:03.358 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.358 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.358 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:25:03.359 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "143da3a7-dad9-4b1e-966b-76cf5bdd3c82", 2024-09-16T03:25:03.359 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:25:03.359 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:25:03.359 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:25:03.359 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:25:03.359 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:25:03.359 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:25:03.359 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 15, 2024-09-16T03:25:03.359 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 21, 2024-09-16T03:25:03.359 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:25:03.359 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:25:03.359 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:25:03.359 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:03.360 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.360 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:03.360 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6818", 2024-09-16T03:25:03.360 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:03.360 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.360 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.360 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:03.360 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6819", 2024-09-16T03:25:03.360 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:03.360 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:03.360 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:03.360 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.360 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:25:03.361 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:03.361 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.361 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:03.361 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6820", 2024-09-16T03:25:03.361 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:03.361 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.361 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.361 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:03.361 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6821", 2024-09-16T03:25:03.361 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:03.361 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:03.361 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:03.361 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.361 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:25:03.362 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:03.362 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.362 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:03.362 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6824", 2024-09-16T03:25:03.362 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:03.362 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.362 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.362 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:03.362 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6825", 2024-09-16T03:25:03.362 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:03.362 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:03.362 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:03.362 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.363 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:25:03.363 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:03.363 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.363 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:03.363 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6822", 2024-09-16T03:25:03.363 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:03.363 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.363 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.363 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:03.363 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6823", 2024-09-16T03:25:03.363 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:03.363 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:03.363 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:03.363 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.364 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6819/963814857", 2024-09-16T03:25:03.364 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6821/963814857", 2024-09-16T03:25:03.364 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6825/963814857", 2024-09-16T03:25:03.364 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6823/963814857", 2024-09-16T03:25:03.364 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:25:03.364 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:25:03.364 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:25:03.364 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:03.364 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:03.364 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:03.364 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_xinfo": [ 2024-09-16T03:25:03.364 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.364 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:25:03.364 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:25:03.365 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:25:03.365 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:25:03.365 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:25:03.365 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:25:03.365 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:23:22.481942+0000", 2024-09-16T03:25:03.365 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:25:03.365 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.365 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.365 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:25:03.365 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:25:03.365 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:25:03.365 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:25:03.365 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:25:03.366 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:25:03.366 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:23:59.663703+0000", 2024-09-16T03:25:03.366 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:25:03.366 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.366 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.366 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:25:03.366 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:25:03.366 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:25:03.366 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:25:03.366 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:25:03.366 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:25:03.366 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:24:37.320822+0000", 2024-09-16T03:25:03.366 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:25:03.367 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:03.367 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:03.367 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap": [], 2024-09-16T03:25:03.367 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap_items": [], 2024-09-16T03:25:03.367 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap_primaries": [], 2024-09-16T03:25:03.367 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_temp": [], 2024-09-16T03:25:03.367 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_temp": [], 2024-09-16T03:25:03.367 INFO:tasks.workunit.client.0.smithi096.stderr: "blocklist": {}, 2024-09-16T03:25:03.367 INFO:tasks.workunit.client.0.smithi096.stderr: "range_blocklist": {}, 2024-09-16T03:25:03.367 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profiles": { 2024-09-16T03:25:03.367 INFO:tasks.workunit.client.0.smithi096.stderr: "default": { 2024-09-16T03:25:03.367 INFO:tasks.workunit.client.0.smithi096.stderr: "k": "2", 2024-09-16T03:25:03.367 INFO:tasks.workunit.client.0.smithi096.stderr: "m": "2", 2024-09-16T03:25:03.367 INFO:tasks.workunit.client.0.smithi096.stderr: "plugin": "jerasure", 2024-09-16T03:25:03.367 INFO:tasks.workunit.client.0.smithi096.stderr: "technique": "reed_sol_van" 2024-09-16T03:25:03.368 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:03.368 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.368 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps_queue": [], 2024-09-16T03:25:03.368 INFO:tasks.workunit.client.0.smithi096.stderr: "new_removed_snaps": [], 2024-09-16T03:25:03.368 INFO:tasks.workunit.client.0.smithi096.stderr: "new_purged_snaps": [], 2024-09-16T03:25:03.368 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_node_flags": {}, 2024-09-16T03:25:03.368 INFO:tasks.workunit.client.0.smithi096.stderr: "device_class_flags": {}, 2024-09-16T03:25:03.368 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode": { 2024-09-16T03:25:03.368 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode_enabled": false, 2024-09-16T03:25:03.368 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_bucket_count": 0, 2024-09-16T03:25:03.368 INFO:tasks.workunit.client.0.smithi096.stderr: "degraded_stretch_mode": 0, 2024-09-16T03:25:03.368 INFO:tasks.workunit.client.0.smithi096.stderr: "recovering_stretch_mode": 0, 2024-09-16T03:25:03.368 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode_bucket": 0 2024-09-16T03:25:03.369 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:03.369 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.369 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_metadata": [ 2024-09-16T03:25:03.369 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.369 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:25:03.369 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:25:03.369 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]", 2024-09-16T03:25:03.369 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:25:03.369 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:25:03.369 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:25:03.369 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:25:03.369 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:25:03.369 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:25:03.369 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:25:03.370 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:25:03.370 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:25:03.370 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:25:03.370 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:25:03.370 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/0/block", 2024-09-16T03:25:03.370 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:25:03.370 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:25:03.370 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:25:03.370 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:25:03.370 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:25:03.370 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:25:03.370 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:25:03.370 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:25:03.371 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:25:03.371 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:25:03.371 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:22:53.662571Z", 2024-09-16T03:25:03.371 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:25:03.371 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:25:03.371 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:25:03.371 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:25:03.371 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:25:03.371 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:25:03.371 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:25:03.371 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]", 2024-09-16T03:25:03.371 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:25:03.371 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]", 2024-09-16T03:25:03.371 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]", 2024-09-16T03:25:03.372 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:25:03.372 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:25:03.372 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:25:03.372 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:25:03.372 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:25:03.372 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:25:03.372 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:25:03.372 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:25:03.372 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:25:03.372 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/0", 2024-09-16T03:25:03.372 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:25:03.372 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:25:03.372 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:25:03.372 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.373 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.373 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:25:03.373 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:25:03.373 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]", 2024-09-16T03:25:03.373 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:25:03.373 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:25:03.373 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:25:03.373 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:25:03.373 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:25:03.373 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:25:03.373 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:25:03.373 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:25:03.373 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:25:03.373 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:25:03.374 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:25:03.374 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/1/block", 2024-09-16T03:25:03.374 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:25:03.374 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:25:03.374 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:25:03.374 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:25:03.374 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:25:03.374 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:25:03.374 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:25:03.374 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:25:03.374 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:25:03.374 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:25:03.374 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:23:30.129885Z", 2024-09-16T03:25:03.374 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:25:03.375 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:25:03.375 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:25:03.375 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:25:03.375 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:25:03.375 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:25:03.375 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:25:03.375 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]", 2024-09-16T03:25:03.375 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:25:03.375 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]", 2024-09-16T03:25:03.375 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]", 2024-09-16T03:25:03.375 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:25:03.375 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:25:03.375 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:25:03.375 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:25:03.376 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:25:03.376 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:25:03.376 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:25:03.376 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:25:03.376 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:25:03.376 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/1", 2024-09-16T03:25:03.376 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:25:03.376 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:25:03.376 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:25:03.376 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.376 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.376 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:25:03.376 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:25:03.377 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]", 2024-09-16T03:25:03.377 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:25:03.377 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:25:03.377 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:25:03.377 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:25:03.377 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:25:03.377 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:25:03.377 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:25:03.377 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:25:03.377 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:25:03.377 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:25:03.377 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:25:03.377 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/2/block", 2024-09-16T03:25:03.377 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:25:03.378 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:25:03.378 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:25:03.378 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:25:03.378 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:25:03.378 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:25:03.378 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:25:03.378 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:25:03.378 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:25:03.378 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:25:03.378 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:24:07.764502Z", 2024-09-16T03:25:03.378 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:25:03.378 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:25:03.378 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:25:03.379 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:25:03.379 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:25:03.379 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:25:03.379 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:25:03.379 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]", 2024-09-16T03:25:03.379 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:25:03.379 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]", 2024-09-16T03:25:03.379 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]", 2024-09-16T03:25:03.379 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:25:03.379 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:25:03.379 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:25:03.379 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:25:03.379 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:25:03.379 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:25:03.380 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:25:03.380 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:25:03.380 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:25:03.380 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/2", 2024-09-16T03:25:03.380 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:25:03.380 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:25:03.380 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:25:03.380 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:03.380 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:03.380 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_clean_epochs": { 2024-09-16T03:25:03.380 INFO:tasks.workunit.client.0.smithi096.stderr: "min_last_epoch_clean": 28, 2024-09-16T03:25:03.380 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": { 2024-09-16T03:25:03.380 INFO:tasks.workunit.client.0.smithi096.stderr: "per_pool": [ 2024-09-16T03:25:03.381 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.381 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 1, 2024-09-16T03:25:03.381 INFO:tasks.workunit.client.0.smithi096.stderr: "floor": 28 2024-09-16T03:25:03.381 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.381 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.381 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 2, 2024-09-16T03:25:03.381 INFO:tasks.workunit.client.0.smithi096.stderr: "floor": 28 2024-09-16T03:25:03.381 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:03.381 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:03.381 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.381 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_epochs": [ 2024-09-16T03:25:03.381 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.381 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:25:03.381 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 28 2024-09-16T03:25:03.382 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.382 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.382 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:25:03.382 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 28 2024-09-16T03:25:03.382 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.382 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.382 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:25:03.382 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 28 2024-09-16T03:25:03.382 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:03.382 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:03.382 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.382 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_first_committed": 26, 2024-09-16T03:25:03.382 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_last_committed": 28, 2024-09-16T03:25:03.382 INFO:tasks.workunit.client.0.smithi096.stderr: "crushmap": { 2024-09-16T03:25:03.383 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": [ 2024-09-16T03:25:03.383 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.383 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:25:03.383 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.0", 2024-09-16T03:25:03.383 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:25:03.383 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.383 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.383 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:25:03.383 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.1", 2024-09-16T03:25:03.383 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:25:03.383 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.383 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.383 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:25:03.384 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.2", 2024-09-16T03:25:03.384 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:25:03.384 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:03.384 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:03.384 INFO:tasks.workunit.client.0.smithi096.stderr: "types": [ 2024-09-16T03:25:03.384 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.384 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 0, 2024-09-16T03:25:03.384 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd" 2024-09-16T03:25:03.384 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.384 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.384 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:25:03.384 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "host" 2024-09-16T03:25:03.385 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.385 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.385 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 2, 2024-09-16T03:25:03.385 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "chassis" 2024-09-16T03:25:03.385 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.385 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.385 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 3, 2024-09-16T03:25:03.385 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "rack" 2024-09-16T03:25:03.385 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.385 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.385 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 4, 2024-09-16T03:25:03.385 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "row" 2024-09-16T03:25:03.385 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.386 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.386 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 5, 2024-09-16T03:25:03.386 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "pdu" 2024-09-16T03:25:03.386 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.386 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.386 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 6, 2024-09-16T03:25:03.386 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "pod" 2024-09-16T03:25:03.386 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.386 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.386 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 7, 2024-09-16T03:25:03.386 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "room" 2024-09-16T03:25:03.386 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.386 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.387 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 8, 2024-09-16T03:25:03.387 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "datacenter" 2024-09-16T03:25:03.387 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.387 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.387 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 9, 2024-09-16T03:25:03.387 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "zone" 2024-09-16T03:25:03.387 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.387 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.387 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 10, 2024-09-16T03:25:03.387 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "region" 2024-09-16T03:25:03.387 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.387 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.387 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:25:03.388 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "root" 2024-09-16T03:25:03.388 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:03.388 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:03.388 INFO:tasks.workunit.client.0.smithi096.stderr: "buckets": [ 2024-09-16T03:25:03.388 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.388 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -1, 2024-09-16T03:25:03.388 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "default", 2024-09-16T03:25:03.388 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:25:03.388 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "root", 2024-09-16T03:25:03.388 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:25:03.388 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:25:03.388 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:25:03.388 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:25:03.389 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.389 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -3, 2024-09-16T03:25:03.389 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:25:03.389 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:25:03.389 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:03.389 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:03.389 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.389 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.389 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -2, 2024-09-16T03:25:03.389 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "default~hdd", 2024-09-16T03:25:03.389 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:25:03.389 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "root", 2024-09-16T03:25:03.389 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:25:03.390 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:25:03.390 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:25:03.390 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:25:03.390 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.390 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -4, 2024-09-16T03:25:03.390 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:25:03.390 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:25:03.390 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:03.390 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:03.390 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.390 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.390 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -3, 2024-09-16T03:25:03.390 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "smithi096", 2024-09-16T03:25:03.391 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:25:03.391 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "host", 2024-09-16T03:25:03.391 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:25:03.391 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:25:03.391 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:25:03.391 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:25:03.391 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.391 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:25:03.391 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:25:03.391 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:25:03.391 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.391 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.391 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:25:03.391 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:25:03.392 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 1 2024-09-16T03:25:03.392 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.392 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.392 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:25:03.392 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:25:03.392 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 2 2024-09-16T03:25:03.392 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:03.392 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:03.392 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.392 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.392 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -4, 2024-09-16T03:25:03.392 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "smithi096~hdd", 2024-09-16T03:25:03.392 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:25:03.392 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "host", 2024-09-16T03:25:03.392 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:25:03.393 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:25:03.393 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:25:03.393 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:25:03.393 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.393 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:25:03.393 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:25:03.393 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:25:03.393 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.393 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.393 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:25:03.393 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:25:03.393 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 1 2024-09-16T03:25:03.393 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.393 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.394 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:25:03.394 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:25:03.394 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 2 2024-09-16T03:25:03.394 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:03.394 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:03.394 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:03.394 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:03.394 INFO:tasks.workunit.client.0.smithi096.stderr: "rules": [ 2024-09-16T03:25:03.394 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.394 INFO:tasks.workunit.client.0.smithi096.stderr: "rule_id": 0, 2024-09-16T03:25:03.394 INFO:tasks.workunit.client.0.smithi096.stderr: "rule_name": "replicated_rule", 2024-09-16T03:25:03.394 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:25:03.394 INFO:tasks.workunit.client.0.smithi096.stderr: "steps": [ 2024-09-16T03:25:03.395 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.395 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "take", 2024-09-16T03:25:03.395 INFO:tasks.workunit.client.0.smithi096.stderr: "item": -1, 2024-09-16T03:25:03.395 INFO:tasks.workunit.client.0.smithi096.stderr: "item_name": "default" 2024-09-16T03:25:03.395 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.395 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.395 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "choose_firstn", 2024-09-16T03:25:03.395 INFO:tasks.workunit.client.0.smithi096.stderr: "num": 0, 2024-09-16T03:25:03.395 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "osd" 2024-09-16T03:25:03.396 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.396 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.396 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "emit" 2024-09-16T03:25:03.396 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:03.396 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:03.396 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:03.396 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:03.396 INFO:tasks.workunit.client.0.smithi096.stderr: "tunables": { 2024-09-16T03:25:03.396 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_local_tries": 0, 2024-09-16T03:25:03.396 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_local_fallback_tries": 0, 2024-09-16T03:25:03.396 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_total_tries": 50, 2024-09-16T03:25:03.396 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_descend_once": 1, 2024-09-16T03:25:03.396 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_vary_r": 1, 2024-09-16T03:25:03.397 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_stable": 1, 2024-09-16T03:25:03.397 INFO:tasks.workunit.client.0.smithi096.stderr: "msr_descents": 100, 2024-09-16T03:25:03.397 INFO:tasks.workunit.client.0.smithi096.stderr: "msr_collision_tries": 100, 2024-09-16T03:25:03.397 INFO:tasks.workunit.client.0.smithi096.stderr: "straw_calc_version": 1, 2024-09-16T03:25:03.397 INFO:tasks.workunit.client.0.smithi096.stderr: "allowed_bucket_algs": 54, 2024-09-16T03:25:03.397 INFO:tasks.workunit.client.0.smithi096.stderr: "profile": "jewel", 2024-09-16T03:25:03.397 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_tunables": 1, 2024-09-16T03:25:03.397 INFO:tasks.workunit.client.0.smithi096.stderr: "legacy_tunables": 0, 2024-09-16T03:25:03.397 INFO:tasks.workunit.client.0.smithi096.stderr: "minimum_required_version": "jewel", 2024-09-16T03:25:03.397 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables": 1, 2024-09-16T03:25:03.397 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables2": 1, 2024-09-16T03:25:03.397 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v2_rules": 0, 2024-09-16T03:25:03.397 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables3": 1, 2024-09-16T03:25:03.398 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v3_rules": 0, 2024-09-16T03:25:03.398 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v4_buckets": 1, 2024-09-16T03:25:03.398 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables5": 1, 2024-09-16T03:25:03.398 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v5_rules": 0, 2024-09-16T03:25:03.398 INFO:tasks.workunit.client.0.smithi096.stderr: "has_msr_rules": 0 2024-09-16T03:25:03.398 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.398 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_args": {} 2024-09-16T03:25:03.398 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.398 INFO:tasks.workunit.client.0.smithi096.stderr: "fsmap": { 2024-09-16T03:25:03.398 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 1, 2024-09-16T03:25:03.398 INFO:tasks.workunit.client.0.smithi096.stderr: "btime": "2024-09-16T03:22:46:882186+0000", 2024-09-16T03:25:03.398 INFO:tasks.workunit.client.0.smithi096.stderr: "default_fscid": -1, 2024-09-16T03:25:03.398 INFO:tasks.workunit.client.0.smithi096.stderr: "compat": { 2024-09-16T03:25:03.399 INFO:tasks.workunit.client.0.smithi096.stderr: "compat": {}, 2024-09-16T03:25:03.399 INFO:tasks.workunit.client.0.smithi096.stderr: "ro_compat": {}, 2024-09-16T03:25:03.399 INFO:tasks.workunit.client.0.smithi096.stderr: "incompat": { 2024-09-16T03:25:03.399 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_1": "base v0.20", 2024-09-16T03:25:03.399 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_2": "client writeable ranges", 2024-09-16T03:25:03.399 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_3": "default file layouts on dirs", 2024-09-16T03:25:03.399 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_4": "dir inode in separate object", 2024-09-16T03:25:03.399 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_5": "mds uses versioned encoding", 2024-09-16T03:25:03.399 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_6": "dirfrag is stored in omap", 2024-09-16T03:25:03.399 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_8": "no anchor table", 2024-09-16T03:25:03.399 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_9": "file layout v2", 2024-09-16T03:25:03.399 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_10": "snaprealm v2", 2024-09-16T03:25:03.399 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_11": "minor log segments", 2024-09-16T03:25:03.400 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_12": "quiesce subvolumes" 2024-09-16T03:25:03.400 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:03.400 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.400 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_flags": { 2024-09-16T03:25:03.400 INFO:tasks.workunit.client.0.smithi096.stderr: "enable_multiple": true, 2024-09-16T03:25:03.400 INFO:tasks.workunit.client.0.smithi096.stderr: "ever_enabled_multiple": true 2024-09-16T03:25:03.400 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.400 INFO:tasks.workunit.client.0.smithi096.stderr: "standbys": [], 2024-09-16T03:25:03.400 INFO:tasks.workunit.client.0.smithi096.stderr: "filesystems": [] 2024-09-16T03:25:03.400 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.400 INFO:tasks.workunit.client.0.smithi096.stderr: "mdsmap_first_committed": 1, 2024-09-16T03:25:03.400 INFO:tasks.workunit.client.0.smithi096.stderr: "mdsmap_last_committed": 1, 2024-09-16T03:25:03.400 INFO:tasks.workunit.client.0.smithi096.stderr: "auth": { 2024-09-16T03:25:03.400 INFO:tasks.workunit.client.0.smithi096.stderr: "first_committed": 1, 2024-09-16T03:25:03.401 INFO:tasks.workunit.client.0.smithi096.stderr: "last_committed": 5, 2024-09-16T03:25:03.401 INFO:tasks.workunit.client.0.smithi096.stderr: "num_secrets": 3 2024-09-16T03:25:03.401 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.401 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 64, 2024-09-16T03:25:03.401 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_active": 64, 2024-09-16T03:25:03.401 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_unknown": 0, 2024-09-16T03:25:03.401 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osd": 3, 2024-09-16T03:25:03.401 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_sum": { 2024-09-16T03:25:03.401 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:25:03.401 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:25:03.401 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:25:03.401 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:25:03.401 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:25:03.402 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:25:03.402 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:25:03.402 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:25:03.402 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:25:03.402 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:25:03.402 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:25:03.402 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:25:03.402 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:25:03.402 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:25:03.402 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:25:03.402 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:25:03.402 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:25:03.402 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:25:03.403 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:25:03.403 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:25:03.403 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:25:03.403 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:25:03.403 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:25:03.403 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:25:03.403 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:25:03.403 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:25:03.403 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:25:03.403 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:25:03.403 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:25:03.403 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:25:03.403 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:25:03.404 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:25:03.404 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:25:03.404 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:25:03.404 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:25:03.404 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:25:03.404 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:25:03.404 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:25:03.404 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:25:03.404 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:25:03.404 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:25:03.404 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.404 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:25:03.404 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:25:03.405 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:25:03.405 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:25:03.405 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:25:03.405 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:25:03.405 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:25:03.405 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:25:03.405 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:25:03.405 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:25:03.405 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:25:03.405 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.405 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:25:03.405 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:25:03.406 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 192, 2024-09-16T03:25:03.406 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 192, 2024-09-16T03:25:03.406 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 0 2024-09-16T03:25:03.406 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.406 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_sum": { 2024-09-16T03:25:03.406 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 0, 2024-09-16T03:25:03.406 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 0, 2024-09-16T03:25:03.406 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pgs": 192, 2024-09-16T03:25:03.406 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osds": 3, 2024-09-16T03:25:03.406 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_osds": 3, 2024-09-16T03:25:03.406 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_omap_osds": 3, 2024-09-16T03:25:03.406 INFO:tasks.workunit.client.0.smithi096.stderr: "kb": 314572800, 2024-09-16T03:25:03.406 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used": 81232, 2024-09-16T03:25:03.406 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_data": 696, 2024-09-16T03:25:03.407 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_omap": 4, 2024-09-16T03:25:03.407 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_meta": 80443, 2024-09-16T03:25:03.407 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_avail": 314491568, 2024-09-16T03:25:03.407 INFO:tasks.workunit.client.0.smithi096.stderr: "statfs": { 2024-09-16T03:25:03.407 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 322122547200, 2024-09-16T03:25:03.407 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 322039365632, 2024-09-16T03:25:03.407 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:25:03.407 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 712704, 2024-09-16T03:25:03.407 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 209643, 2024-09-16T03:25:03.407 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:25:03.407 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:25:03.407 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:25:03.407 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 4785, 2024-09-16T03:25:03.408 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 82373967 2024-09-16T03:25:03.408 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.408 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_peers": [], 2024-09-16T03:25:03.408 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_trim_queue_len": 0, 2024-09-16T03:25:03.408 INFO:tasks.workunit.client.0.smithi096.stderr: "num_snap_trimming": 0, 2024-09-16T03:25:03.408 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shards_repaired": 0, 2024-09-16T03:25:03.408 INFO:tasks.workunit.client.0.smithi096.stderr: "op_queue_age_hist": { 2024-09-16T03:25:03.408 INFO:tasks.workunit.client.0.smithi096.stderr: "histogram": [], 2024-09-16T03:25:03.408 INFO:tasks.workunit.client.0.smithi096.stderr: "upper_bound": 1 2024-09-16T03:25:03.408 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.408 INFO:tasks.workunit.client.0.smithi096.stderr: "perf_stat": { 2024-09-16T03:25:03.408 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ms": 0, 2024-09-16T03:25:03.408 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ms": 0, 2024-09-16T03:25:03.409 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ns": 0, 2024-09-16T03:25:03.409 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ns": 0 2024-09-16T03:25:03.409 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.409 INFO:tasks.workunit.client.0.smithi096.stderr: "alerts": [], 2024-09-16T03:25:03.409 INFO:tasks.workunit.client.0.smithi096.stderr: "network_ping_times": [] 2024-09-16T03:25:03.409 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.409 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_sum_by_class": { 2024-09-16T03:25:03.409 INFO:tasks.workunit.client.0.smithi096.stderr: "hdd": { 2024-09-16T03:25:03.409 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 0, 2024-09-16T03:25:03.409 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 0, 2024-09-16T03:25:03.409 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pgs": 192, 2024-09-16T03:25:03.409 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osds": 3, 2024-09-16T03:25:03.409 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_osds": 3, 2024-09-16T03:25:03.409 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_omap_osds": 3, 2024-09-16T03:25:03.410 INFO:tasks.workunit.client.0.smithi096.stderr: "kb": 314572800, 2024-09-16T03:25:03.410 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used": 81232, 2024-09-16T03:25:03.410 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_data": 696, 2024-09-16T03:25:03.410 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_omap": 4, 2024-09-16T03:25:03.410 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_meta": 80443, 2024-09-16T03:25:03.410 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_avail": 314491568, 2024-09-16T03:25:03.410 INFO:tasks.workunit.client.0.smithi096.stderr: "statfs": { 2024-09-16T03:25:03.410 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 322122547200, 2024-09-16T03:25:03.410 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 322039365632, 2024-09-16T03:25:03.410 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:25:03.410 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 712704, 2024-09-16T03:25:03.410 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 209643, 2024-09-16T03:25:03.410 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:25:03.411 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:25:03.411 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:25:03.411 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 4785, 2024-09-16T03:25:03.411 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 82373967 2024-09-16T03:25:03.411 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.411 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_peers": [], 2024-09-16T03:25:03.411 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_trim_queue_len": 0, 2024-09-16T03:25:03.411 INFO:tasks.workunit.client.0.smithi096.stderr: "num_snap_trimming": 0, 2024-09-16T03:25:03.411 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shards_repaired": 0, 2024-09-16T03:25:03.411 INFO:tasks.workunit.client.0.smithi096.stderr: "op_queue_age_hist": { 2024-09-16T03:25:03.411 INFO:tasks.workunit.client.0.smithi096.stderr: "histogram": [], 2024-09-16T03:25:03.411 INFO:tasks.workunit.client.0.smithi096.stderr: "upper_bound": 1 2024-09-16T03:25:03.411 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.411 INFO:tasks.workunit.client.0.smithi096.stderr: "perf_stat": { 2024-09-16T03:25:03.412 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ms": 0, 2024-09-16T03:25:03.412 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ms": 0, 2024-09-16T03:25:03.412 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ns": 0, 2024-09-16T03:25:03.412 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ns": 0 2024-09-16T03:25:03.412 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.412 INFO:tasks.workunit.client.0.smithi096.stderr: "alerts": [], 2024-09-16T03:25:03.412 INFO:tasks.workunit.client.0.smithi096.stderr: "network_ping_times": [] 2024-09-16T03:25:03.412 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:03.412 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.412 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_stats": [ 2024-09-16T03:25:03.412 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.412 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 2, 2024-09-16T03:25:03.412 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 32, 2024-09-16T03:25:03.413 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:25:03.413 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:25:03.413 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:25:03.413 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:25:03.413 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:25:03.413 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:25:03.413 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:25:03.413 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:25:03.413 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:25:03.413 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:25:03.413 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:25:03.413 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:25:03.413 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:25:03.414 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:25:03.414 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:25:03.414 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:25:03.414 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:25:03.414 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:25:03.414 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:25:03.414 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:25:03.414 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:25:03.414 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:25:03.414 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:25:03.414 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:25:03.414 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:25:03.414 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:25:03.415 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:25:03.415 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:25:03.415 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:25:03.415 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:25:03.415 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:25:03.415 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:25:03.415 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:25:03.415 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:25:03.415 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:25:03.415 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:25:03.415 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:25:03.415 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:25:03.415 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:25:03.415 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:25:03.416 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:25:03.416 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.416 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:25:03.416 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:25:03.416 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:25:03.416 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:25:03.416 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:25:03.416 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:25:03.416 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:25:03.416 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:25:03.416 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:25:03.416 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:25:03.416 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:25:03.417 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.417 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:25:03.417 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:25:03.417 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 96, 2024-09-16T03:25:03.417 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 96, 2024-09-16T03:25:03.417 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 3 2024-09-16T03:25:03.417 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.417 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.417 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 1, 2024-09-16T03:25:03.417 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 32, 2024-09-16T03:25:03.417 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:25:03.417 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:25:03.417 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:25:03.418 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:25:03.418 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:25:03.418 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:25:03.418 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:25:03.418 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:25:03.418 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:25:03.418 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:25:03.418 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:25:03.418 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:25:03.418 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:25:03.418 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:25:03.418 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:25:03.418 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:25:03.419 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:25:03.419 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:25:03.419 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:25:03.419 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:25:03.419 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:25:03.419 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:25:03.419 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:25:03.419 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:25:03.419 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:25:03.419 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:25:03.419 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:25:03.419 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:25:03.419 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:25:03.419 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:25:03.420 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:25:03.420 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:25:03.420 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:25:03.420 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:25:03.420 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:25:03.420 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:25:03.420 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:25:03.420 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:25:03.420 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:25:03.420 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:25:03.420 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:25:03.420 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.420 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:25:03.420 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:25:03.421 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:25:03.421 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:25:03.421 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:25:03.421 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:25:03.421 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:25:03.421 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:25:03.421 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:25:03.421 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:25:03.421 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:25:03.421 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.421 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:25:03.421 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:25:03.421 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 96, 2024-09-16T03:25:03.421 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 96, 2024-09-16T03:25:03.422 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 3 2024-09-16T03:25:03.422 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:03.422 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:03.422 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_stats": [ 2024-09-16T03:25:03.422 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.422 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:25:03.422 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 21474836506 2024-09-16T03:25:03.422 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.422 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.422 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:25:03.422 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 42949672978 2024-09-16T03:25:03.422 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.422 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.423 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:25:03.423 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 64424509450 2024-09-16T03:25:03.423 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:03.423 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:03.423 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_by_state": [ 2024-09-16T03:25:03.423 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.423 INFO:tasks.workunit.client.0.smithi096.stderr: "state": "active+clean", 2024-09-16T03:25:03.423 INFO:tasks.workunit.client.0.smithi096.stderr: "num": 64 2024-09-16T03:25:03.423 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:03.423 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:03.423 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_by_osd": [ 2024-09-16T03:25:03.423 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.423 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:25:03.423 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 15, 2024-09-16T03:25:03.423 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 64, 2024-09-16T03:25:03.424 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:25:03.424 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.424 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.424 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:25:03.424 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 20, 2024-09-16T03:25:03.424 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 64, 2024-09-16T03:25:03.424 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:25:03.424 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.424 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.424 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:25:03.424 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 29, 2024-09-16T03:25:03.424 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 64, 2024-09-16T03:25:03.424 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:25:03.425 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:03.425 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:03.425 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": [ 2024-09-16T03:25:03.425 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.425 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 1, 2024-09-16T03:25:03.425 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": {} 2024-09-16T03:25:03.425 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.425 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.425 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 2, 2024-09-16T03:25:03.425 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": {} 2024-09-16T03:25:03.425 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:03.425 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:03.425 INFO:tasks.workunit.client.0.smithi096.stderr: "servicemap": { 2024-09-16T03:25:03.425 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 4, 2024-09-16T03:25:03.426 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:25:02.412573+0000", 2024-09-16T03:25:03.426 INFO:tasks.workunit.client.0.smithi096.stderr: "services": { 2024-09-16T03:25:03.426 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": { 2024-09-16T03:25:03.426 INFO:tasks.workunit.client.0.smithi096.stderr: "daemons": { 2024-09-16T03:25:03.426 INFO:tasks.workunit.client.0.smithi096.stderr: "summary": "", 2024-09-16T03:25:03.426 INFO:tasks.workunit.client.0.smithi096.stderr: "2": { 2024-09-16T03:25:03.426 INFO:tasks.workunit.client.0.smithi096.stderr: "start_epoch": 0, 2024-09-16T03:25:03.426 INFO:tasks.workunit.client.0.smithi096.stderr: "start_stamp": "0.000000", 2024-09-16T03:25:03.426 INFO:tasks.workunit.client.0.smithi096.stderr: "gid": 0, 2024-09-16T03:25:03.426 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "(unrecognized address family 0)/0", 2024-09-16T03:25:03.426 INFO:tasks.workunit.client.0.smithi096.stderr: "metadata": {}, 2024-09-16T03:25:03.426 INFO:tasks.workunit.client.0.smithi096.stderr: "task_status": {} 2024-09-16T03:25:03.426 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:03.426 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:03.427 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:03.427 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:03.427 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.427 INFO:tasks.workunit.client.0.smithi096.stderr: "mgrstat_first_committed": 52, 2024-09-16T03:25:03.427 INFO:tasks.workunit.client.0.smithi096.stderr: "mgrstat_last_committed": 57, 2024-09-16T03:25:03.427 INFO:tasks.workunit.client.0.smithi096.stderr: "logm_first_committed": 1, 2024-09-16T03:25:03.427 INFO:tasks.workunit.client.0.smithi096.stderr: "logm_last_committed": 246, 2024-09-16T03:25:03.427 INFO:tasks.workunit.client.0.smithi096.stderr: "paxos": { 2024-09-16T03:25:03.427 INFO:tasks.workunit.client.0.smithi096.stderr: "first_committed": 1, 2024-09-16T03:25:03.427 INFO:tasks.workunit.client.0.smithi096.stderr: "last_committed": 343, 2024-09-16T03:25:03.427 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pn": 0, 2024-09-16T03:25:03.427 INFO:tasks.workunit.client.0.smithi096.stderr: "accepted_pn": 0 2024-09-16T03:25:03.427 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:03.427 INFO:tasks.workunit.client.0.smithi096.stderr:}' 2024-09-16T03:25:03.427 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:132: get_fc_lc_diff: jq .osdmap_first_committed 2024-09-16T03:25:03.431 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:132: get_fc_lc_diff: echo '{' '"cluster_fingerprint":' '"fda2fc64-07ed-4add-8224-2e527e11d427",' '"version":' '"19.3.0-4930-gfc3e0bff",' '"commit":' '"fc3e0bff7468fd55478adbae7f75508b749124b6",' '"timestamp":' '"2024-09-16T03:25:03.309542+0000",' '"tag":' '"",' '"health":' '{' '"status":' '"HEALTH_OK",' '"checks":' '{},' '"mutes":' '[]' '},' '"monmap_first_committed":' 1, '"monmap_last_committed":' 1, '"monmap":' '{' '"epoch":' 1, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"modified":' '"2024-09-16T03:22:45.872880Z",' '"created":' '"2024-09-16T03:22:45.872880Z",' '"min_mon_release":' 19, '"min_mon_release_name":' '"squid",' '"election_strategy":' 1, '"disallowed_leaders:' '":' '"",' '"stretch_mode":' false, '"tiebreaker_mon":' '"",' '"removed_ranks:' '":' '"",' '"features":' '{' '"persistent":' '[' '"kraken",' '"luminous",' '"mimic",' '"osdmap-prune",' '"nautilus",' '"octopus",' '"pacific",' '"elector-pinging",' '"quincy",' '"reef",' '"squid"' '],' '"optional":' '[]' '},' '"mons":' '[' '{' '"rank":' 0, '"name":' '"a",' '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:7302",' '"nonce":' 0 '}' ']' '},' '"addr":' '"127.0.0.1:7302/0",' '"public_addr":' '"127.0.0.1:7302/0",' '"priority":' 0, '"weight":' 0, '"crush_location":' '"{}"' '}' ']' '},' '"quorum":' '[' 0 '],' '"osdmap":' '{' '"epoch":' 28, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"created":' '"2024-09-16T03:22:46.906117+0000",' '"modified":' '"2024-09-16T03:24:50.642444+0000",' '"last_up_change":' '"2024-09-16T03:24:37.708512+0000",' '"last_in_change":' '"2024-09-16T03:24:01.831039+0000",' '"flags":' '"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit",' '"flags_num":' 5799936, '"flags_set":' '[' '"pglog_hardlimit",' '"purged_snapdirs",' '"recovery_deletes",' '"sortbitwise"' '],' '"crush_version":' 7, '"full_ratio":' 0.97000002861022949, '"backfillfull_ratio":' 0.97000002861022949, '"nearfull_ratio":' 0.85000002384185791, '"cluster_snapshot":' '"",' '"pool_max":' 2, '"max_osd":' 3, '"require_min_compat_client":' '"luminous",' '"min_compat_client":' '"jewel",' '"require_osd_release":' '"squid",' '"allow_crimson":' false, '"pools":' '[' '{' '"pool":' 1, '"pool_name":' '"foo",' '"create_time":' '"2024-09-16T03:24:44.525189+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"21",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.690000057220459, '"score_stable":' 1.690000057220459, '"optimal_score":' 1, '"raw_score_acting":' 1.690000057220459, '"raw_score_stable":' 1.690000057220459, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '},' '{' '"pool":' 2, '"pool_name":' '"bar",' '"create_time":' '"2024-09-16T03:24:46.226575+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"24",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.1299999952316284, '"score_stable":' 1.1299999952316284, '"optimal_score":' 1, '"raw_score_acting":' 1.1299999952316284, '"raw_score_stable":' 1.1299999952316284, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '}' '],' '"osds":' '[' '{' '"osd":' 0, '"uuid":' '"64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 5, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6802",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6803",' '"nonce":' 3375787448 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6804",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6805",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6808",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6809",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6806",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6807",' '"nonce":' 3375787448 '}' ']' '},' '"public_addr":' '"127.0.0.1:6803/3375787448",' '"cluster_addr":' '"127.0.0.1:6805/3375787448",' '"heartbeat_back_addr":' '"127.0.0.1:6809/3375787448",' '"heartbeat_front_addr":' '"127.0.0.1:6807/3375787448",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 1, '"uuid":' '"74b26727-75c9-444d-8782-719e4197a382",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 10, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6810",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6811",' '"nonce":' 3733255132 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6812",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6813",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6816",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6817",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6814",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6815",' '"nonce":' 3733255132 '}' ']' '},' '"public_addr":' '"127.0.0.1:6811/3733255132",' '"cluster_addr":' '"127.0.0.1:6813/3733255132",' '"heartbeat_back_addr":' '"127.0.0.1:6817/3733255132",' '"heartbeat_front_addr":' '"127.0.0.1:6815/3733255132",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 2, '"uuid":' '"143da3a7-dad9-4b1e-966b-76cf5bdd3c82",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 15, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6818",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6819",' '"nonce":' 963814857 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6820",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6821",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6824",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6825",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6822",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6823",' '"nonce":' 963814857 '}' ']' '},' '"public_addr":' '"127.0.0.1:6819/963814857",' '"cluster_addr":' '"127.0.0.1:6821/963814857",' '"heartbeat_back_addr":' '"127.0.0.1:6825/963814857",' '"heartbeat_front_addr":' '"127.0.0.1:6823/963814857",' '"state":' '[' '"exists",' '"up"' ']' '}' '],' '"osd_xinfo":' '[' '{' '"osd":' 0, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:22.481942+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 1, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:59.663703+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 2, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:24:37.320822+0000",' '"dead_epoch":' 0 '}' '],' '"pg_upmap":' '[],' '"pg_upmap_items":' '[],' '"pg_upmap_primaries":' '[],' '"pg_temp":' '[],' '"primary_temp":' '[],' '"blocklist":' '{},' '"range_blocklist":' '{},' '"erasure_code_profiles":' '{' '"default":' '{' '"k":' '"2",' '"m":' '"2",' '"plugin":' '"jerasure",' '"technique":' '"reed_sol_van"' '}' '},' '"removed_snaps_queue":' '[],' '"new_removed_snaps":' '[],' '"new_purged_snaps":' '[],' '"crush_node_flags":' '{},' '"device_class_flags":' '{},' '"stretch_mode":' '{' '"stretch_mode_enabled":' false, '"stretch_bucket_count":' 0, '"degraded_stretch_mode":' 0, '"recovering_stretch_mode":' 0, '"stretch_mode_bucket":' 0 '}' '},' '"osd_metadata":' '[' '{' '"id":' 0, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/0/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:22:53.662571Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]",' '"hb_front_addr":' '"[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/0",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 1, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/1/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:23:30.129885Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]",' '"hb_front_addr":' '"[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/1",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 2, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/2/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:24:07.764502Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]",' '"hb_front_addr":' '"[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/2",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '}' '],' '"osdmap_clean_epochs":' '{' '"min_last_epoch_clean":' 28, '"last_epoch_clean":' '{' '"per_pool":' '[' '{' '"poolid":' 1, '"floor":' 28 '},' '{' '"poolid":' 2, '"floor":' 28 '}' ']' '},' '"osd_epochs":' '[' '{' '"id":' 0, '"epoch":' 28 '},' '{' '"id":' 1, '"epoch":' 28 '},' '{' '"id":' 2, '"epoch":' 28 '}' ']' '},' '"osdmap_first_committed":' 26, '"osdmap_last_committed":' 28, '"crushmap":' '{' '"devices":' '[' '{' '"id":' 0, '"name":' '"osd.0",' '"class":' '"hdd"' '},' '{' '"id":' 1, '"name":' '"osd.1",' '"class":' '"hdd"' '},' '{' '"id":' 2, '"name":' '"osd.2",' '"class":' '"hdd"' '}' '],' '"types":' '[' '{' '"type_id":' 0, '"name":' '"osd"' '},' '{' '"type_id":' 1, '"name":' '"host"' '},' '{' '"type_id":' 2, '"name":' '"chassis"' '},' '{' '"type_id":' 3, '"name":' '"rack"' '},' '{' '"type_id":' 4, '"name":' '"row"' '},' '{' '"type_id":' 5, '"name":' '"pdu"' '},' '{' '"type_id":' 6, '"name":' '"pod"' '},' '{' '"type_id":' 7, '"name":' '"room"' '},' '{' '"type_id":' 8, '"name":' '"datacenter"' '},' '{' '"type_id":' 9, '"name":' '"zone"' '},' '{' '"type_id":' 10, '"name":' '"region"' '},' '{' '"type_id":' 11, '"name":' '"root"' '}' '],' '"buckets":' '[' '{' '"id":' -1, '"name":' '"default",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -3, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -2, '"name":' '"default~hdd",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -4, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -3, '"name":' '"smithi096",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '},' '{' '"id":' -4, '"name":' '"smithi096~hdd",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '}' '],' '"rules":' '[' '{' '"rule_id":' 0, '"rule_name":' '"replicated_rule",' '"type":' 1, '"steps":' '[' '{' '"op":' '"take",' '"item":' -1, '"item_name":' '"default"' '},' '{' '"op":' '"choose_firstn",' '"num":' 0, '"type":' '"osd"' '},' '{' '"op":' '"emit"' '}' ']' '}' '],' '"tunables":' '{' '"choose_local_tries":' 0, '"choose_local_fallback_tries":' 0, '"choose_total_tries":' 50, '"chooseleaf_descend_once":' 1, '"chooseleaf_vary_r":' 1, '"chooseleaf_stable":' 1, '"msr_descents":' 100, '"msr_collision_tries":' 100, '"straw_calc_version":' 1, '"allowed_bucket_algs":' 54, '"profile":' '"jewel",' '"optimal_tunables":' 1, '"legacy_tunables":' 0, '"minimum_required_version":' '"jewel",' '"require_feature_tunables":' 1, '"require_feature_tunables2":' 1, '"has_v2_rules":' 0, '"require_feature_tunables3":' 1, '"has_v3_rules":' 0, '"has_v4_buckets":' 1, '"require_feature_tunables5":' 1, '"has_v5_rules":' 0, '"has_msr_rules":' 0 '},' '"choose_args":' '{}' '},' '"fsmap":' '{' '"epoch":' 1, '"btime":' '"2024-09-16T03:22:46:882186+0000",' '"default_fscid":' -1, '"compat":' '{' '"compat":' '{},' '"ro_compat":' '{},' '"incompat":' '{' '"feature_1":' '"base' 'v0.20",' '"feature_2":' '"client' writeable 'ranges",' '"feature_3":' '"default' file layouts on 'dirs",' '"feature_4":' '"dir' inode in separate 'object",' '"feature_5":' '"mds' uses versioned 'encoding",' '"feature_6":' '"dirfrag' is stored in 'omap",' '"feature_8":' '"no' anchor 'table",' '"feature_9":' '"file' layout 'v2",' '"feature_10":' '"snaprealm' 'v2",' '"feature_11":' '"minor' log 'segments",' '"feature_12":' '"quiesce' 'subvolumes"' '}' '},' '"feature_flags":' '{' '"enable_multiple":' true, '"ever_enabled_multiple":' true '},' '"standbys":' '[],' '"filesystems":' '[]' '},' '"mdsmap_first_committed":' 1, '"mdsmap_last_committed":' 1, '"auth":' '{' '"first_committed":' 1, '"last_committed":' 5, '"num_secrets":' 3 '},' '"num_pg":' 64, '"num_pg_active":' 64, '"num_pg_unknown":' 0, '"num_osd":' 3, '"pool_sum":' '{' '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 192, '"acting":' 192, '"num_store_stats":' 0 '},' '"osd_sum":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 192, '"num_osds":' 3, '"num_per_pool_osds":' 3, '"num_per_pool_omap_osds":' 3, '"kb":' 314572800, '"kb_used":' 81232, '"kb_used_data":' 696, '"kb_used_omap":' 4, '"kb_used_meta":' 80443, '"kb_avail":' 314491568, '"statfs":' '{' '"total":' 322122547200, '"available":' 322039365632, '"internally_reserved":' 0, '"allocated":' 712704, '"data_stored":' 209643, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 4785, '"internal_metadata":' 82373967 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 0, '"apply_latency_ms":' 0, '"commit_latency_ns":' 0, '"apply_latency_ns":' 0 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '},' '"osd_sum_by_class":' '{' '"hdd":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 192, '"num_osds":' 3, '"num_per_pool_osds":' 3, '"num_per_pool_omap_osds":' 3, '"kb":' 314572800, '"kb_used":' 81232, '"kb_used_data":' 696, '"kb_used_omap":' 4, '"kb_used_meta":' 80443, '"kb_avail":' 314491568, '"statfs":' '{' '"total":' 322122547200, '"available":' 322039365632, '"internally_reserved":' 0, '"allocated":' 712704, '"data_stored":' 209643, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 4785, '"internal_metadata":' 82373967 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 0, '"apply_latency_ms":' 0, '"commit_latency_ns":' 0, '"apply_latency_ns":' 0 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '}' '},' '"pool_stats":' '[' '{' '"poolid":' 2, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 96, '"acting":' 96, '"num_store_stats":' 3 '},' '{' '"poolid":' 1, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 96, '"acting":' 96, '"num_store_stats":' 3 '}' '],' '"osd_stats":' '[' '{' '"osd":' 0, '"seq":' 21474836506 '},' '{' '"osd":' 1, '"seq":' 42949672978 '},' '{' '"osd":' 2, '"seq":' 64424509450 '}' '],' '"num_pg_by_state":' '[' '{' '"state":' '"active+clean",' '"num":' 64 '}' '],' '"num_pg_by_osd":' '[' '{' '"osd":' 2, '"num_primary_pg":' 15, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 0, '"num_primary_pg":' 20, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 1, '"num_primary_pg":' 29, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '}' '],' '"purged_snaps":' '[' '{' '"pool":' 1, '"purged_snaps":' '{}' '},' '{' '"pool":' 2, '"purged_snaps":' '{}' '}' '],' '"servicemap":' '{' '"epoch":' 4, '"modified":' '"2024-09-16T03:25:02.412573+0000",' '"services":' '{' '"osd":' '{' '"daemons":' '{' '"summary":' '"",' '"2":' '{' '"start_epoch":' 0, '"start_stamp":' '"0.000000",' '"gid":' 0, '"addr":' '"(unrecognized' address family '0)/0",' '"metadata":' '{},' '"task_status":' '{}' '}' '}' '}' '}' '},' '"mgrstat_first_committed":' 52, '"mgrstat_last_committed":' 57, '"logm_first_committed":' 1, '"logm_last_committed":' 246, '"paxos":' '{' '"first_committed":' 1, '"last_committed":' 343, '"last_pn":' 0, '"accepted_pn":' 0 '}' '}' 2024-09-16T03:25:03.431 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:132: get_fc_lc_diff: osdm_fc=26 2024-09-16T03:25:03.431 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:134: get_fc_lc_diff: jq .osdmap_last_committed 2024-09-16T03:25:03.431 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:134: get_fc_lc_diff: echo '{' '"cluster_fingerprint":' '"fda2fc64-07ed-4add-8224-2e527e11d427",' '"version":' '"19.3.0-4930-gfc3e0bff",' '"commit":' '"fc3e0bff7468fd55478adbae7f75508b749124b6",' '"timestamp":' '"2024-09-16T03:25:03.309542+0000",' '"tag":' '"",' '"health":' '{' '"status":' '"HEALTH_OK",' '"checks":' '{},' '"mutes":' '[]' '},' '"monmap_first_committed":' 1, '"monmap_last_committed":' 1, '"monmap":' '{' '"epoch":' 1, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"modified":' '"2024-09-16T03:22:45.872880Z",' '"created":' '"2024-09-16T03:22:45.872880Z",' '"min_mon_release":' 19, '"min_mon_release_name":' '"squid",' '"election_strategy":' 1, '"disallowed_leaders:' '":' '"",' '"stretch_mode":' false, '"tiebreaker_mon":' '"",' '"removed_ranks:' '":' '"",' '"features":' '{' '"persistent":' '[' '"kraken",' '"luminous",' '"mimic",' '"osdmap-prune",' '"nautilus",' '"octopus",' '"pacific",' '"elector-pinging",' '"quincy",' '"reef",' '"squid"' '],' '"optional":' '[]' '},' '"mons":' '[' '{' '"rank":' 0, '"name":' '"a",' '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:7302",' '"nonce":' 0 '}' ']' '},' '"addr":' '"127.0.0.1:7302/0",' '"public_addr":' '"127.0.0.1:7302/0",' '"priority":' 0, '"weight":' 0, '"crush_location":' '"{}"' '}' ']' '},' '"quorum":' '[' 0 '],' '"osdmap":' '{' '"epoch":' 28, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"created":' '"2024-09-16T03:22:46.906117+0000",' '"modified":' '"2024-09-16T03:24:50.642444+0000",' '"last_up_change":' '"2024-09-16T03:24:37.708512+0000",' '"last_in_change":' '"2024-09-16T03:24:01.831039+0000",' '"flags":' '"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit",' '"flags_num":' 5799936, '"flags_set":' '[' '"pglog_hardlimit",' '"purged_snapdirs",' '"recovery_deletes",' '"sortbitwise"' '],' '"crush_version":' 7, '"full_ratio":' 0.97000002861022949, '"backfillfull_ratio":' 0.97000002861022949, '"nearfull_ratio":' 0.85000002384185791, '"cluster_snapshot":' '"",' '"pool_max":' 2, '"max_osd":' 3, '"require_min_compat_client":' '"luminous",' '"min_compat_client":' '"jewel",' '"require_osd_release":' '"squid",' '"allow_crimson":' false, '"pools":' '[' '{' '"pool":' 1, '"pool_name":' '"foo",' '"create_time":' '"2024-09-16T03:24:44.525189+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"21",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.690000057220459, '"score_stable":' 1.690000057220459, '"optimal_score":' 1, '"raw_score_acting":' 1.690000057220459, '"raw_score_stable":' 1.690000057220459, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '},' '{' '"pool":' 2, '"pool_name":' '"bar",' '"create_time":' '"2024-09-16T03:24:46.226575+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"24",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.1299999952316284, '"score_stable":' 1.1299999952316284, '"optimal_score":' 1, '"raw_score_acting":' 1.1299999952316284, '"raw_score_stable":' 1.1299999952316284, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '}' '],' '"osds":' '[' '{' '"osd":' 0, '"uuid":' '"64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 5, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6802",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6803",' '"nonce":' 3375787448 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6804",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6805",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6808",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6809",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6806",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6807",' '"nonce":' 3375787448 '}' ']' '},' '"public_addr":' '"127.0.0.1:6803/3375787448",' '"cluster_addr":' '"127.0.0.1:6805/3375787448",' '"heartbeat_back_addr":' '"127.0.0.1:6809/3375787448",' '"heartbeat_front_addr":' '"127.0.0.1:6807/3375787448",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 1, '"uuid":' '"74b26727-75c9-444d-8782-719e4197a382",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 10, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6810",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6811",' '"nonce":' 3733255132 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6812",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6813",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6816",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6817",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6814",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6815",' '"nonce":' 3733255132 '}' ']' '},' '"public_addr":' '"127.0.0.1:6811/3733255132",' '"cluster_addr":' '"127.0.0.1:6813/3733255132",' '"heartbeat_back_addr":' '"127.0.0.1:6817/3733255132",' '"heartbeat_front_addr":' '"127.0.0.1:6815/3733255132",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 2, '"uuid":' '"143da3a7-dad9-4b1e-966b-76cf5bdd3c82",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 15, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6818",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6819",' '"nonce":' 963814857 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6820",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6821",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6824",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6825",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6822",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6823",' '"nonce":' 963814857 '}' ']' '},' '"public_addr":' '"127.0.0.1:6819/963814857",' '"cluster_addr":' '"127.0.0.1:6821/963814857",' '"heartbeat_back_addr":' '"127.0.0.1:6825/963814857",' '"heartbeat_front_addr":' '"127.0.0.1:6823/963814857",' '"state":' '[' '"exists",' '"up"' ']' '}' '],' '"osd_xinfo":' '[' '{' '"osd":' 0, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:22.481942+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 1, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:59.663703+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 2, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:24:37.320822+0000",' '"dead_epoch":' 0 '}' '],' '"pg_upmap":' '[],' '"pg_upmap_items":' '[],' '"pg_upmap_primaries":' '[],' '"pg_temp":' '[],' '"primary_temp":' '[],' '"blocklist":' '{},' '"range_blocklist":' '{},' '"erasure_code_profiles":' '{' '"default":' '{' '"k":' '"2",' '"m":' '"2",' '"plugin":' '"jerasure",' '"technique":' '"reed_sol_van"' '}' '},' '"removed_snaps_queue":' '[],' '"new_removed_snaps":' '[],' '"new_purged_snaps":' '[],' '"crush_node_flags":' '{},' '"device_class_flags":' '{},' '"stretch_mode":' '{' '"stretch_mode_enabled":' false, '"stretch_bucket_count":' 0, '"degraded_stretch_mode":' 0, '"recovering_stretch_mode":' 0, '"stretch_mode_bucket":' 0 '}' '},' '"osd_metadata":' '[' '{' '"id":' 0, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/0/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:22:53.662571Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]",' '"hb_front_addr":' '"[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/0",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 1, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/1/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:23:30.129885Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]",' '"hb_front_addr":' '"[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/1",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 2, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/2/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:24:07.764502Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]",' '"hb_front_addr":' '"[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/2",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '}' '],' '"osdmap_clean_epochs":' '{' '"min_last_epoch_clean":' 28, '"last_epoch_clean":' '{' '"per_pool":' '[' '{' '"poolid":' 1, '"floor":' 28 '},' '{' '"poolid":' 2, '"floor":' 28 '}' ']' '},' '"osd_epochs":' '[' '{' '"id":' 0, '"epoch":' 28 '},' '{' '"id":' 1, '"epoch":' 28 '},' '{' '"id":' 2, '"epoch":' 28 '}' ']' '},' '"osdmap_first_committed":' 26, '"osdmap_last_committed":' 28, '"crushmap":' '{' '"devices":' '[' '{' '"id":' 0, '"name":' '"osd.0",' '"class":' '"hdd"' '},' '{' '"id":' 1, '"name":' '"osd.1",' '"class":' '"hdd"' '},' '{' '"id":' 2, '"name":' '"osd.2",' '"class":' '"hdd"' '}' '],' '"types":' '[' '{' '"type_id":' 0, '"name":' '"osd"' '},' '{' '"type_id":' 1, '"name":' '"host"' '},' '{' '"type_id":' 2, '"name":' '"chassis"' '},' '{' '"type_id":' 3, '"name":' '"rack"' '},' '{' '"type_id":' 4, '"name":' '"row"' '},' '{' '"type_id":' 5, '"name":' '"pdu"' '},' '{' '"type_id":' 6, '"name":' '"pod"' '},' '{' '"type_id":' 7, '"name":' '"room"' '},' '{' '"type_id":' 8, '"name":' '"datacenter"' '},' '{' '"type_id":' 9, '"name":' '"zone"' '},' '{' '"type_id":' 10, '"name":' '"region"' '},' '{' '"type_id":' 11, '"name":' '"root"' '}' '],' '"buckets":' '[' '{' '"id":' -1, '"name":' '"default",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -3, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -2, '"name":' '"default~hdd",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -4, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -3, '"name":' '"smithi096",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '},' '{' '"id":' -4, '"name":' '"smithi096~hdd",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '}' '],' '"rules":' '[' '{' '"rule_id":' 0, '"rule_name":' '"replicated_rule",' '"type":' 1, '"steps":' '[' '{' '"op":' '"take",' '"item":' -1, '"item_name":' '"default"' '},' '{' '"op":' '"choose_firstn",' '"num":' 0, '"type":' '"osd"' '},' '{' '"op":' '"emit"' '}' ']' '}' '],' '"tunables":' '{' '"choose_local_tries":' 0, '"choose_local_fallback_tries":' 0, '"choose_total_tries":' 50, '"chooseleaf_descend_once":' 1, '"chooseleaf_vary_r":' 1, '"chooseleaf_stable":' 1, '"msr_descents":' 100, '"msr_collision_tries":' 100, '"straw_calc_version":' 1, '"allowed_bucket_algs":' 54, '"profile":' '"jewel",' '"optimal_tunables":' 1, '"legacy_tunables":' 0, '"minimum_required_version":' '"jewel",' '"require_feature_tunables":' 1, '"require_feature_tunables2":' 1, '"has_v2_rules":' 0, '"require_feature_tunables3":' 1, '"has_v3_rules":' 0, '"has_v4_buckets":' 1, '"require_feature_tunables5":' 1, '"has_v5_rules":' 0, '"has_msr_rules":' 0 '},' '"choose_args":' '{}' '},' '"fsmap":' '{' '"epoch":' 1, '"btime":' '"2024-09-16T03:22:46:882186+0000",' '"default_fscid":' -1, '"compat":' '{' '"compat":' '{},' '"ro_compat":' '{},' '"incompat":' '{' '"feature_1":' '"base' 'v0.20",' '"feature_2":' '"client' writeable 'ranges",' '"feature_3":' '"default' file layouts on 'dirs",' '"feature_4":' '"dir' inode in separate 'object",' '"feature_5":' '"mds' uses versioned 'encoding",' '"feature_6":' '"dirfrag' is stored in 'omap",' '"feature_8":' '"no' anchor 'table",' '"feature_9":' '"file' layout 'v2",' '"feature_10":' '"snaprealm' 'v2",' '"feature_11":' '"minor' log 'segments",' '"feature_12":' '"quiesce' 'subvolumes"' '}' '},' '"feature_flags":' '{' '"enable_multiple":' true, '"ever_enabled_multiple":' true '},' '"standbys":' '[],' '"filesystems":' '[]' '},' '"mdsmap_first_committed":' 1, '"mdsmap_last_committed":' 1, '"auth":' '{' '"first_committed":' 1, '"last_committed":' 5, '"num_secrets":' 3 '},' '"num_pg":' 64, '"num_pg_active":' 64, '"num_pg_unknown":' 0, '"num_osd":' 3, '"pool_sum":' '{' '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 192, '"acting":' 192, '"num_store_stats":' 0 '},' '"osd_sum":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 192, '"num_osds":' 3, '"num_per_pool_osds":' 3, '"num_per_pool_omap_osds":' 3, '"kb":' 314572800, '"kb_used":' 81232, '"kb_used_data":' 696, '"kb_used_omap":' 4, '"kb_used_meta":' 80443, '"kb_avail":' 314491568, '"statfs":' '{' '"total":' 322122547200, '"available":' 322039365632, '"internally_reserved":' 0, '"allocated":' 712704, '"data_stored":' 209643, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 4785, '"internal_metadata":' 82373967 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 0, '"apply_latency_ms":' 0, '"commit_latency_ns":' 0, '"apply_latency_ns":' 0 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '},' '"osd_sum_by_class":' '{' '"hdd":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 192, '"num_osds":' 3, '"num_per_pool_osds":' 3, '"num_per_pool_omap_osds":' 3, '"kb":' 314572800, '"kb_used":' 81232, '"kb_used_data":' 696, '"kb_used_omap":' 4, '"kb_used_meta":' 80443, '"kb_avail":' 314491568, '"statfs":' '{' '"total":' 322122547200, '"available":' 322039365632, '"internally_reserved":' 0, '"allocated":' 712704, '"data_stored":' 209643, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 4785, '"internal_metadata":' 82373967 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 0, '"apply_latency_ms":' 0, '"commit_latency_ns":' 0, '"apply_latency_ns":' 0 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '}' '},' '"pool_stats":' '[' '{' '"poolid":' 2, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 96, '"acting":' 96, '"num_store_stats":' 3 '},' '{' '"poolid":' 1, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 96, '"acting":' 96, '"num_store_stats":' 3 '}' '],' '"osd_stats":' '[' '{' '"osd":' 0, '"seq":' 21474836506 '},' '{' '"osd":' 1, '"seq":' 42949672978 '},' '{' '"osd":' 2, '"seq":' 64424509450 '}' '],' '"num_pg_by_state":' '[' '{' '"state":' '"active+clean",' '"num":' 64 '}' '],' '"num_pg_by_osd":' '[' '{' '"osd":' 2, '"num_primary_pg":' 15, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 0, '"num_primary_pg":' 20, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 1, '"num_primary_pg":' 29, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '}' '],' '"purged_snaps":' '[' '{' '"pool":' 1, '"purged_snaps":' '{}' '},' '{' '"pool":' 2, '"purged_snaps":' '{}' '}' '],' '"servicemap":' '{' '"epoch":' 4, '"modified":' '"2024-09-16T03:25:02.412573+0000",' '"services":' '{' '"osd":' '{' '"daemons":' '{' '"summary":' '"",' '"2":' '{' '"start_epoch":' 0, '"start_stamp":' '"0.000000",' '"gid":' 0, '"addr":' '"(unrecognized' address family '0)/0",' '"metadata":' '{},' '"task_status":' '{}' '}' '}' '}' '}' '},' '"mgrstat_first_committed":' 52, '"mgrstat_last_committed":' 57, '"logm_first_committed":' 1, '"logm_last_committed":' 246, '"paxos":' '{' '"first_committed":' 1, '"last_committed":' 343, '"last_pn":' 0, '"accepted_pn":' 0 '}' '}' 2024-09-16T03:25:03.431 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:134: get_fc_lc_diff: osdm_lc=28 2024-09-16T03:25:03.431 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:136: get_fc_lc_diff: echo 2 2024-09-16T03:25:03.431 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:161: wait_for_total_num_maps: [[ 2 -gt 2 ]] 2024-09-16T03:25:03.431 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:207: TEST_mon_last_clean_epoch: get_fc_lc_diff 2024-09-16T03:25:03.431 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:130: get_fc_lc_diff: ceph report 2024-09-16T03:25:03.927 INFO:tasks.workunit.client.0.smithi096.stderr:report 2609253599 2024-09-16T03:25:03.943 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:130: get_fc_lc_diff: report='{ 2024-09-16T03:25:03.943 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_fingerprint": "fda2fc64-07ed-4add-8224-2e527e11d427", 2024-09-16T03:25:03.943 INFO:tasks.workunit.client.0.smithi096.stderr: "version": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:25:03.943 INFO:tasks.workunit.client.0.smithi096.stderr: "commit": "fc3e0bff7468fd55478adbae7f75508b749124b6", 2024-09-16T03:25:03.943 INFO:tasks.workunit.client.0.smithi096.stderr: "timestamp": "2024-09-16T03:25:03.927488+0000", 2024-09-16T03:25:03.943 INFO:tasks.workunit.client.0.smithi096.stderr: "tag": "", 2024-09-16T03:25:03.943 INFO:tasks.workunit.client.0.smithi096.stderr: "health": { 2024-09-16T03:25:03.943 INFO:tasks.workunit.client.0.smithi096.stderr: "status": "HEALTH_OK", 2024-09-16T03:25:03.943 INFO:tasks.workunit.client.0.smithi096.stderr: "checks": {}, 2024-09-16T03:25:03.943 INFO:tasks.workunit.client.0.smithi096.stderr: "mutes": [] 2024-09-16T03:25:03.943 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.944 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap_first_committed": 1, 2024-09-16T03:25:03.944 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap_last_committed": 1, 2024-09-16T03:25:03.944 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap": { 2024-09-16T03:25:03.944 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 1, 2024-09-16T03:25:03.944 INFO:tasks.workunit.client.0.smithi096.stderr: "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", 2024-09-16T03:25:03.944 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:22:45.872880Z", 2024-09-16T03:25:03.944 INFO:tasks.workunit.client.0.smithi096.stderr: "created": "2024-09-16T03:22:45.872880Z", 2024-09-16T03:25:03.944 INFO:tasks.workunit.client.0.smithi096.stderr: "min_mon_release": 19, 2024-09-16T03:25:03.944 INFO:tasks.workunit.client.0.smithi096.stderr: "min_mon_release_name": "squid", 2024-09-16T03:25:03.944 INFO:tasks.workunit.client.0.smithi096.stderr: "election_strategy": 1, 2024-09-16T03:25:03.944 INFO:tasks.workunit.client.0.smithi096.stderr: "disallowed_leaders: ": "", 2024-09-16T03:25:03.944 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode": false, 2024-09-16T03:25:03.945 INFO:tasks.workunit.client.0.smithi096.stderr: "tiebreaker_mon": "", 2024-09-16T03:25:03.945 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_ranks: ": "", 2024-09-16T03:25:03.945 INFO:tasks.workunit.client.0.smithi096.stderr: "features": { 2024-09-16T03:25:03.945 INFO:tasks.workunit.client.0.smithi096.stderr: "persistent": [ 2024-09-16T03:25:03.945 INFO:tasks.workunit.client.0.smithi096.stderr: "kraken", 2024-09-16T03:25:03.945 INFO:tasks.workunit.client.0.smithi096.stderr: "luminous", 2024-09-16T03:25:03.945 INFO:tasks.workunit.client.0.smithi096.stderr: "mimic", 2024-09-16T03:25:03.945 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap-prune", 2024-09-16T03:25:03.945 INFO:tasks.workunit.client.0.smithi096.stderr: "nautilus", 2024-09-16T03:25:03.945 INFO:tasks.workunit.client.0.smithi096.stderr: "octopus", 2024-09-16T03:25:03.945 INFO:tasks.workunit.client.0.smithi096.stderr: "pacific", 2024-09-16T03:25:03.945 INFO:tasks.workunit.client.0.smithi096.stderr: "elector-pinging", 2024-09-16T03:25:03.945 INFO:tasks.workunit.client.0.smithi096.stderr: "quincy", 2024-09-16T03:25:03.946 INFO:tasks.workunit.client.0.smithi096.stderr: "reef", 2024-09-16T03:25:03.946 INFO:tasks.workunit.client.0.smithi096.stderr: "squid" 2024-09-16T03:25:03.946 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:03.946 INFO:tasks.workunit.client.0.smithi096.stderr: "optional": [] 2024-09-16T03:25:03.946 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.946 INFO:tasks.workunit.client.0.smithi096.stderr: "mons": [ 2024-09-16T03:25:03.946 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.946 INFO:tasks.workunit.client.0.smithi096.stderr: "rank": 0, 2024-09-16T03:25:03.946 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "a", 2024-09-16T03:25:03.946 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:25:03.946 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:03.946 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.946 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:03.946 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:7302", 2024-09-16T03:25:03.947 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 0 2024-09-16T03:25:03.947 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:03.947 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:03.947 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.947 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:7302/0", 2024-09-16T03:25:03.947 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:7302/0", 2024-09-16T03:25:03.947 INFO:tasks.workunit.client.0.smithi096.stderr: "priority": 0, 2024-09-16T03:25:03.947 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 0, 2024-09-16T03:25:03.947 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_location": "{}" 2024-09-16T03:25:03.947 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:03.947 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:03.947 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.947 INFO:tasks.workunit.client.0.smithi096.stderr: "quorum": [ 2024-09-16T03:25:03.947 INFO:tasks.workunit.client.0.smithi096.stderr: 0 2024-09-16T03:25:03.948 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:03.948 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap": { 2024-09-16T03:25:03.948 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 28, 2024-09-16T03:25:03.948 INFO:tasks.workunit.client.0.smithi096.stderr: "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", 2024-09-16T03:25:03.948 INFO:tasks.workunit.client.0.smithi096.stderr: "created": "2024-09-16T03:22:46.906117+0000", 2024-09-16T03:25:03.948 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:24:50.642444+0000", 2024-09-16T03:25:03.948 INFO:tasks.workunit.client.0.smithi096.stderr: "last_up_change": "2024-09-16T03:24:37.708512+0000", 2024-09-16T03:25:03.948 INFO:tasks.workunit.client.0.smithi096.stderr: "last_in_change": "2024-09-16T03:24:01.831039+0000", 2024-09-16T03:25:03.948 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-16T03:25:03.948 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_num": 5799936, 2024-09-16T03:25:03.948 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_set": [ 2024-09-16T03:25:03.948 INFO:tasks.workunit.client.0.smithi096.stderr: "pglog_hardlimit", 2024-09-16T03:25:03.948 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snapdirs", 2024-09-16T03:25:03.949 INFO:tasks.workunit.client.0.smithi096.stderr: "recovery_deletes", 2024-09-16T03:25:03.949 INFO:tasks.workunit.client.0.smithi096.stderr: "sortbitwise" 2024-09-16T03:25:03.949 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:03.949 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_version": 7, 2024-09-16T03:25:03.949 INFO:tasks.workunit.client.0.smithi096.stderr: "full_ratio": 0.97000002861022949, 2024-09-16T03:25:03.949 INFO:tasks.workunit.client.0.smithi096.stderr: "backfillfull_ratio": 0.97000002861022949, 2024-09-16T03:25:03.949 INFO:tasks.workunit.client.0.smithi096.stderr: "nearfull_ratio": 0.85000002384185791, 2024-09-16T03:25:03.949 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_snapshot": "", 2024-09-16T03:25:03.949 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_max": 2, 2024-09-16T03:25:03.949 INFO:tasks.workunit.client.0.smithi096.stderr: "max_osd": 3, 2024-09-16T03:25:03.949 INFO:tasks.workunit.client.0.smithi096.stderr: "require_min_compat_client": "luminous", 2024-09-16T03:25:03.949 INFO:tasks.workunit.client.0.smithi096.stderr: "min_compat_client": "jewel", 2024-09-16T03:25:03.949 INFO:tasks.workunit.client.0.smithi096.stderr: "require_osd_release": "squid", 2024-09-16T03:25:03.950 INFO:tasks.workunit.client.0.smithi096.stderr: "allow_crimson": false, 2024-09-16T03:25:03.950 INFO:tasks.workunit.client.0.smithi096.stderr: "pools": [ 2024-09-16T03:25:03.950 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.950 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 1, 2024-09-16T03:25:03.950 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_name": "foo", 2024-09-16T03:25:03.950 INFO:tasks.workunit.client.0.smithi096.stderr: "create_time": "2024-09-16T03:24:44.525189+0000", 2024-09-16T03:25:03.950 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": 1, 2024-09-16T03:25:03.950 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_names": "hashpspool", 2024-09-16T03:25:03.950 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:25:03.950 INFO:tasks.workunit.client.0.smithi096.stderr: "size": 3, 2024-09-16T03:25:03.950 INFO:tasks.workunit.client.0.smithi096.stderr: "min_size": 2, 2024-09-16T03:25:03.950 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_rule": 0, 2024-09-16T03:25:03.950 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_count": 0, 2024-09-16T03:25:03.950 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_target": 0, 2024-09-16T03:25:03.951 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_barrier": 0, 2024-09-16T03:25:03.951 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-16T03:25:03.951 INFO:tasks.workunit.client.0.smithi096.stderr: "is_stretch_pool": false, 2024-09-16T03:25:03.951 INFO:tasks.workunit.client.0.smithi096.stderr: "object_hash": 2, 2024-09-16T03:25:03.951 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_autoscale_mode": "off", 2024-09-16T03:25:03.951 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num": 32, 2024-09-16T03:25:03.951 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num": 32, 2024-09-16T03:25:03.951 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num_target": 32, 2024-09-16T03:25:03.951 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_target": 32, 2024-09-16T03:25:03.951 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_pending": 32, 2024-09-16T03:25:03.951 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pg_merge_meta": { 2024-09-16T03:25:03.951 INFO:tasks.workunit.client.0.smithi096.stderr: "source_pgid": "0.0", 2024-09-16T03:25:03.951 INFO:tasks.workunit.client.0.smithi096.stderr: "ready_epoch": 0, 2024-09-16T03:25:03.951 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_started": 0, 2024-09-16T03:25:03.952 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": 0, 2024-09-16T03:25:03.952 INFO:tasks.workunit.client.0.smithi096.stderr: "source_version": "0'\''0", 2024-09-16T03:25:03.952 INFO:tasks.workunit.client.0.smithi096.stderr: "target_version": "0'\''0" 2024-09-16T03:25:03.952 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.952 INFO:tasks.workunit.client.0.smithi096.stderr: "last_change": "21", 2024-09-16T03:25:03.952 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend": "0", 2024-09-16T03:25:03.952 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_prenautilus": "0", 2024-09-16T03:25:03.952 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_preluminous": "0", 2024-09-16T03:25:03.952 INFO:tasks.workunit.client.0.smithi096.stderr: "auid": 0, 2024-09-16T03:25:03.952 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_mode": "selfmanaged", 2024-09-16T03:25:03.952 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_seq": 0, 2024-09-16T03:25:03.952 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_epoch": 0, 2024-09-16T03:25:03.952 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_snaps": [], 2024-09-16T03:25:03.953 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps": "[]", 2024-09-16T03:25:03.953 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_bytes": 0, 2024-09-16T03:25:03.953 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_objects": 0, 2024-09-16T03:25:03.953 INFO:tasks.workunit.client.0.smithi096.stderr: "tiers": [], 2024-09-16T03:25:03.953 INFO:tasks.workunit.client.0.smithi096.stderr: "tier_of": -1, 2024-09-16T03:25:03.953 INFO:tasks.workunit.client.0.smithi096.stderr: "read_tier": -1, 2024-09-16T03:25:03.953 INFO:tasks.workunit.client.0.smithi096.stderr: "write_tier": -1, 2024-09-16T03:25:03.953 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_mode": "none", 2024-09-16T03:25:03.953 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_bytes": 0, 2024-09-16T03:25:03.953 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_objects": 0, 2024-09-16T03:25:03.953 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_ratio_micro": 400000, 2024-09-16T03:25:03.953 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-16T03:25:03.953 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_full_ratio_micro": 800000, 2024-09-16T03:25:03.953 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_flush_age": 0, 2024-09-16T03:25:03.954 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_evict_age": 0, 2024-09-16T03:25:03.954 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profile": "", 2024-09-16T03:25:03.954 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_params": { 2024-09-16T03:25:03.954 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "none" 2024-09-16T03:25:03.954 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.954 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_period": 0, 2024-09-16T03:25:03.954 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_count": 0, 2024-09-16T03:25:03.954 INFO:tasks.workunit.client.0.smithi096.stderr: "use_gmt_hitset": true, 2024-09-16T03:25:03.954 INFO:tasks.workunit.client.0.smithi096.stderr: "min_read_recency_for_promote": 0, 2024-09-16T03:25:03.954 INFO:tasks.workunit.client.0.smithi096.stderr: "min_write_recency_for_promote": 0, 2024-09-16T03:25:03.954 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_grade_decay_rate": 0, 2024-09-16T03:25:03.954 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_search_last_n": 0, 2024-09-16T03:25:03.955 INFO:tasks.workunit.client.0.smithi096.stderr: "grade_table": [], 2024-09-16T03:25:03.955 INFO:tasks.workunit.client.0.smithi096.stderr: "stripe_width": 0, 2024-09-16T03:25:03.955 INFO:tasks.workunit.client.0.smithi096.stderr: "expected_num_objects": 0, 2024-09-16T03:25:03.955 INFO:tasks.workunit.client.0.smithi096.stderr: "fast_read": false, 2024-09-16T03:25:03.955 INFO:tasks.workunit.client.0.smithi096.stderr: "options": {}, 2024-09-16T03:25:03.955 INFO:tasks.workunit.client.0.smithi096.stderr: "application_metadata": {}, 2024-09-16T03:25:03.955 INFO:tasks.workunit.client.0.smithi096.stderr: "read_balance": { 2024-09-16T03:25:03.955 INFO:tasks.workunit.client.0.smithi096.stderr: "score_type": "Fair distribution", 2024-09-16T03:25:03.955 INFO:tasks.workunit.client.0.smithi096.stderr: "score_acting": 1.690000057220459, 2024-09-16T03:25:03.955 INFO:tasks.workunit.client.0.smithi096.stderr: "score_stable": 1.690000057220459, 2024-09-16T03:25:03.955 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_score": 1, 2024-09-16T03:25:03.955 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_acting": 1.690000057220459, 2024-09-16T03:25:03.955 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_stable": 1.690000057220459, 2024-09-16T03:25:03.956 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity_weighted": 1, 2024-09-16T03:25:03.956 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity": 1, 2024-09-16T03:25:03.956 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity_weighted": 1 2024-09-16T03:25:03.956 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:03.956 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.956 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.956 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 2, 2024-09-16T03:25:03.956 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_name": "bar", 2024-09-16T03:25:03.956 INFO:tasks.workunit.client.0.smithi096.stderr: "create_time": "2024-09-16T03:24:46.226575+0000", 2024-09-16T03:25:03.956 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": 1, 2024-09-16T03:25:03.956 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_names": "hashpspool", 2024-09-16T03:25:03.956 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:25:03.957 INFO:tasks.workunit.client.0.smithi096.stderr: "size": 3, 2024-09-16T03:25:03.957 INFO:tasks.workunit.client.0.smithi096.stderr: "min_size": 2, 2024-09-16T03:25:03.957 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_rule": 0, 2024-09-16T03:25:03.957 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_count": 0, 2024-09-16T03:25:03.957 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_target": 0, 2024-09-16T03:25:03.957 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_barrier": 0, 2024-09-16T03:25:03.957 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-16T03:25:03.957 INFO:tasks.workunit.client.0.smithi096.stderr: "is_stretch_pool": false, 2024-09-16T03:25:03.957 INFO:tasks.workunit.client.0.smithi096.stderr: "object_hash": 2, 2024-09-16T03:25:03.957 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_autoscale_mode": "off", 2024-09-16T03:25:03.957 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num": 32, 2024-09-16T03:25:03.957 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num": 32, 2024-09-16T03:25:03.957 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num_target": 32, 2024-09-16T03:25:03.958 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_target": 32, 2024-09-16T03:25:03.958 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_pending": 32, 2024-09-16T03:25:03.958 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pg_merge_meta": { 2024-09-16T03:25:03.958 INFO:tasks.workunit.client.0.smithi096.stderr: "source_pgid": "0.0", 2024-09-16T03:25:03.958 INFO:tasks.workunit.client.0.smithi096.stderr: "ready_epoch": 0, 2024-09-16T03:25:03.958 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_started": 0, 2024-09-16T03:25:03.958 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": 0, 2024-09-16T03:25:03.958 INFO:tasks.workunit.client.0.smithi096.stderr: "source_version": "0'\''0", 2024-09-16T03:25:03.958 INFO:tasks.workunit.client.0.smithi096.stderr: "target_version": "0'\''0" 2024-09-16T03:25:03.958 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.958 INFO:tasks.workunit.client.0.smithi096.stderr: "last_change": "24", 2024-09-16T03:25:03.958 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend": "0", 2024-09-16T03:25:03.958 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_prenautilus": "0", 2024-09-16T03:25:03.958 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_preluminous": "0", 2024-09-16T03:25:03.959 INFO:tasks.workunit.client.0.smithi096.stderr: "auid": 0, 2024-09-16T03:25:03.959 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_mode": "selfmanaged", 2024-09-16T03:25:03.959 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_seq": 0, 2024-09-16T03:25:03.959 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_epoch": 0, 2024-09-16T03:25:03.959 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_snaps": [], 2024-09-16T03:25:03.959 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps": "[]", 2024-09-16T03:25:03.959 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_bytes": 0, 2024-09-16T03:25:03.959 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_objects": 0, 2024-09-16T03:25:03.959 INFO:tasks.workunit.client.0.smithi096.stderr: "tiers": [], 2024-09-16T03:25:03.959 INFO:tasks.workunit.client.0.smithi096.stderr: "tier_of": -1, 2024-09-16T03:25:03.959 INFO:tasks.workunit.client.0.smithi096.stderr: "read_tier": -1, 2024-09-16T03:25:03.959 INFO:tasks.workunit.client.0.smithi096.stderr: "write_tier": -1, 2024-09-16T03:25:03.959 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_mode": "none", 2024-09-16T03:25:03.960 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_bytes": 0, 2024-09-16T03:25:03.960 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_objects": 0, 2024-09-16T03:25:03.960 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_ratio_micro": 400000, 2024-09-16T03:25:03.960 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-16T03:25:03.960 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_full_ratio_micro": 800000, 2024-09-16T03:25:03.960 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_flush_age": 0, 2024-09-16T03:25:03.960 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_evict_age": 0, 2024-09-16T03:25:03.960 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profile": "", 2024-09-16T03:25:03.960 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_params": { 2024-09-16T03:25:03.960 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "none" 2024-09-16T03:25:03.960 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.960 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_period": 0, 2024-09-16T03:25:03.960 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_count": 0, 2024-09-16T03:25:03.960 INFO:tasks.workunit.client.0.smithi096.stderr: "use_gmt_hitset": true, 2024-09-16T03:25:03.961 INFO:tasks.workunit.client.0.smithi096.stderr: "min_read_recency_for_promote": 0, 2024-09-16T03:25:03.961 INFO:tasks.workunit.client.0.smithi096.stderr: "min_write_recency_for_promote": 0, 2024-09-16T03:25:03.961 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_grade_decay_rate": 0, 2024-09-16T03:25:03.961 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_search_last_n": 0, 2024-09-16T03:25:03.961 INFO:tasks.workunit.client.0.smithi096.stderr: "grade_table": [], 2024-09-16T03:25:03.961 INFO:tasks.workunit.client.0.smithi096.stderr: "stripe_width": 0, 2024-09-16T03:25:03.961 INFO:tasks.workunit.client.0.smithi096.stderr: "expected_num_objects": 0, 2024-09-16T03:25:03.961 INFO:tasks.workunit.client.0.smithi096.stderr: "fast_read": false, 2024-09-16T03:25:03.961 INFO:tasks.workunit.client.0.smithi096.stderr: "options": {}, 2024-09-16T03:25:03.961 INFO:tasks.workunit.client.0.smithi096.stderr: "application_metadata": {}, 2024-09-16T03:25:03.961 INFO:tasks.workunit.client.0.smithi096.stderr: "read_balance": { 2024-09-16T03:25:03.961 INFO:tasks.workunit.client.0.smithi096.stderr: "score_type": "Fair distribution", 2024-09-16T03:25:03.961 INFO:tasks.workunit.client.0.smithi096.stderr: "score_acting": 1.1299999952316284, 2024-09-16T03:25:03.961 INFO:tasks.workunit.client.0.smithi096.stderr: "score_stable": 1.1299999952316284, 2024-09-16T03:25:03.962 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_score": 1, 2024-09-16T03:25:03.962 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_acting": 1.1299999952316284, 2024-09-16T03:25:03.962 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_stable": 1.1299999952316284, 2024-09-16T03:25:03.962 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity_weighted": 1, 2024-09-16T03:25:03.962 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity": 1, 2024-09-16T03:25:03.962 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity_weighted": 1 2024-09-16T03:25:03.962 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:03.962 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:03.962 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:03.962 INFO:tasks.workunit.client.0.smithi096.stderr: "osds": [ 2024-09-16T03:25:03.962 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.962 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:25:03.962 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6", 2024-09-16T03:25:03.962 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:25:03.962 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:25:03.963 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:25:03.963 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:25:03.963 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:25:03.963 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:25:03.963 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 5, 2024-09-16T03:25:03.963 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 21, 2024-09-16T03:25:03.963 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:25:03.963 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:25:03.963 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:25:03.963 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:03.963 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.963 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:03.963 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6802", 2024-09-16T03:25:03.963 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:03.964 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.964 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.964 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:03.964 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6803", 2024-09-16T03:25:03.964 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:03.964 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:03.964 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:03.964 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.964 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:25:03.964 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:03.964 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.964 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:03.964 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6804", 2024-09-16T03:25:03.964 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:03.964 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.965 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.965 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:03.965 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6805", 2024-09-16T03:25:03.965 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:03.965 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:03.965 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:03.965 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.965 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:25:03.965 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:03.965 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.965 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:03.965 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6808", 2024-09-16T03:25:03.965 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:03.966 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.966 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.966 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:03.966 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6809", 2024-09-16T03:25:03.966 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:03.966 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:03.966 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:03.966 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.966 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:25:03.966 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:03.966 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.966 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:03.966 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6806", 2024-09-16T03:25:03.967 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:03.967 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.967 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.967 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:03.967 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6807", 2024-09-16T03:25:03.967 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:03.967 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:03.967 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:03.967 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.967 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6803/3375787448", 2024-09-16T03:25:03.967 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6805/3375787448", 2024-09-16T03:25:03.967 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6809/3375787448", 2024-09-16T03:25:03.968 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6807/3375787448", 2024-09-16T03:25:03.968 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:25:03.968 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:25:03.968 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:25:03.968 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:03.968 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.968 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.968 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:25:03.968 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "74b26727-75c9-444d-8782-719e4197a382", 2024-09-16T03:25:03.968 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:25:03.968 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:25:03.968 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:25:03.968 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:25:03.969 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:25:03.969 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:25:03.969 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 10, 2024-09-16T03:25:03.969 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 21, 2024-09-16T03:25:03.969 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:25:03.969 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:25:03.969 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:25:03.969 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:03.969 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.969 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:03.969 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6810", 2024-09-16T03:25:03.969 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:03.969 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.970 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.970 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:03.970 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6811", 2024-09-16T03:25:03.970 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:03.970 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:03.970 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:03.970 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.970 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:25:03.970 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:03.970 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.970 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:03.970 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6812", 2024-09-16T03:25:03.970 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:03.971 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.971 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.971 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:03.971 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6813", 2024-09-16T03:25:03.971 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:03.971 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:03.971 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:03.971 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.971 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:25:03.971 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:03.971 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.971 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:03.971 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6816", 2024-09-16T03:25:03.971 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:03.972 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.972 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.972 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:03.972 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6817", 2024-09-16T03:25:03.972 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:03.972 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:03.972 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:03.972 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.972 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:25:03.972 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:03.972 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.972 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:03.972 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6814", 2024-09-16T03:25:03.973 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:03.973 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.973 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.973 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:03.973 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6815", 2024-09-16T03:25:03.973 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:03.973 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:03.973 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:03.973 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.973 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6811/3733255132", 2024-09-16T03:25:03.973 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6813/3733255132", 2024-09-16T03:25:03.973 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6817/3733255132", 2024-09-16T03:25:03.973 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6815/3733255132", 2024-09-16T03:25:03.974 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:25:03.974 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:25:03.974 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:25:03.974 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:03.974 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.974 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.974 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:25:03.974 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "143da3a7-dad9-4b1e-966b-76cf5bdd3c82", 2024-09-16T03:25:03.974 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:25:03.974 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:25:03.974 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:25:03.974 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:25:03.974 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:25:03.974 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:25:03.975 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 15, 2024-09-16T03:25:03.975 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 21, 2024-09-16T03:25:03.975 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:25:03.975 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:25:03.975 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:25:03.975 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:03.975 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.975 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:03.975 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6818", 2024-09-16T03:25:03.975 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:03.975 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.975 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.975 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:03.975 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6819", 2024-09-16T03:25:03.975 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:03.976 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:03.976 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:03.976 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.976 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:25:03.976 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:03.976 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.976 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:03.976 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6820", 2024-09-16T03:25:03.976 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:03.976 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.976 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.976 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:03.976 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6821", 2024-09-16T03:25:03.977 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:03.977 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:03.977 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:03.977 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.977 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:25:03.977 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:03.977 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.977 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:03.977 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6824", 2024-09-16T03:25:03.977 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:03.977 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.977 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.977 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:03.977 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6825", 2024-09-16T03:25:03.978 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:03.978 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:03.978 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:03.978 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.978 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:25:03.978 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:03.978 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.978 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:03.978 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6822", 2024-09-16T03:25:03.978 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:03.978 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.978 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.978 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:03.979 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6823", 2024-09-16T03:25:03.979 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:03.979 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:03.979 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:03.979 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.979 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6819/963814857", 2024-09-16T03:25:03.979 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6821/963814857", 2024-09-16T03:25:03.979 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6825/963814857", 2024-09-16T03:25:03.979 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6823/963814857", 2024-09-16T03:25:03.979 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:25:03.979 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:25:03.979 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:25:03.979 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:03.980 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:03.980 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:03.980 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_xinfo": [ 2024-09-16T03:25:03.980 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.980 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:25:03.980 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:25:03.980 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:25:03.980 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:25:03.980 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:25:03.980 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:25:03.980 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:23:22.481942+0000", 2024-09-16T03:25:03.980 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:25:03.980 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.981 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.981 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:25:03.981 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:25:03.981 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:25:03.981 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:25:03.981 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:25:03.981 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:25:03.981 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:23:59.663703+0000", 2024-09-16T03:25:03.981 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:25:03.981 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.981 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.981 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:25:03.981 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:25:03.981 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:25:03.982 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:25:03.982 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:25:03.982 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:25:03.982 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:24:37.320822+0000", 2024-09-16T03:25:03.982 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:25:03.982 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:03.982 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:03.982 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap": [], 2024-09-16T03:25:03.982 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap_items": [], 2024-09-16T03:25:03.982 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap_primaries": [], 2024-09-16T03:25:03.982 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_temp": [], 2024-09-16T03:25:03.982 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_temp": [], 2024-09-16T03:25:03.982 INFO:tasks.workunit.client.0.smithi096.stderr: "blocklist": {}, 2024-09-16T03:25:03.982 INFO:tasks.workunit.client.0.smithi096.stderr: "range_blocklist": {}, 2024-09-16T03:25:03.983 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profiles": { 2024-09-16T03:25:03.983 INFO:tasks.workunit.client.0.smithi096.stderr: "default": { 2024-09-16T03:25:03.983 INFO:tasks.workunit.client.0.smithi096.stderr: "k": "2", 2024-09-16T03:25:03.983 INFO:tasks.workunit.client.0.smithi096.stderr: "m": "2", 2024-09-16T03:25:03.983 INFO:tasks.workunit.client.0.smithi096.stderr: "plugin": "jerasure", 2024-09-16T03:25:03.983 INFO:tasks.workunit.client.0.smithi096.stderr: "technique": "reed_sol_van" 2024-09-16T03:25:03.983 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:03.983 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.983 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps_queue": [], 2024-09-16T03:25:03.983 INFO:tasks.workunit.client.0.smithi096.stderr: "new_removed_snaps": [], 2024-09-16T03:25:03.983 INFO:tasks.workunit.client.0.smithi096.stderr: "new_purged_snaps": [], 2024-09-16T03:25:03.983 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_node_flags": {}, 2024-09-16T03:25:03.984 INFO:tasks.workunit.client.0.smithi096.stderr: "device_class_flags": {}, 2024-09-16T03:25:03.984 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode": { 2024-09-16T03:25:03.984 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode_enabled": false, 2024-09-16T03:25:03.984 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_bucket_count": 0, 2024-09-16T03:25:03.984 INFO:tasks.workunit.client.0.smithi096.stderr: "degraded_stretch_mode": 0, 2024-09-16T03:25:03.984 INFO:tasks.workunit.client.0.smithi096.stderr: "recovering_stretch_mode": 0, 2024-09-16T03:25:03.984 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode_bucket": 0 2024-09-16T03:25:03.984 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:03.984 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.984 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_metadata": [ 2024-09-16T03:25:03.984 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.984 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:25:03.984 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:25:03.984 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]", 2024-09-16T03:25:03.985 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:25:03.985 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:25:03.985 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:25:03.985 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:25:03.985 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:25:03.985 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:25:03.985 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:25:03.985 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:25:03.985 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:25:03.985 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:25:03.985 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:25:03.985 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/0/block", 2024-09-16T03:25:03.985 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:25:03.986 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:25:03.986 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:25:03.986 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:25:03.986 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:25:03.986 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:25:03.986 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:25:03.986 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:25:03.986 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:25:03.986 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:25:03.986 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:22:53.662571Z", 2024-09-16T03:25:03.986 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:25:03.986 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:25:03.986 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:25:03.987 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:25:03.987 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:25:03.987 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:25:03.987 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:25:03.987 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]", 2024-09-16T03:25:03.987 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:25:03.987 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]", 2024-09-16T03:25:03.987 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]", 2024-09-16T03:25:03.987 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:25:03.987 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:25:03.987 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:25:03.987 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:25:03.987 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:25:03.988 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:25:03.988 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:25:03.988 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:25:03.988 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:25:03.988 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/0", 2024-09-16T03:25:03.988 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:25:03.988 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:25:03.988 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:25:03.988 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.988 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.988 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:25:03.988 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:25:03.988 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]", 2024-09-16T03:25:03.988 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:25:03.989 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:25:03.989 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:25:03.989 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:25:03.989 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:25:03.989 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:25:03.989 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:25:03.989 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:25:03.989 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:25:03.989 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:25:03.989 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:25:03.989 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/1/block", 2024-09-16T03:25:03.989 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:25:03.989 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:25:03.989 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:25:03.990 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:25:03.990 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:25:03.990 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:25:03.990 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:25:03.990 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:25:03.990 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:25:03.990 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:25:03.991 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:23:30.129885Z", 2024-09-16T03:25:03.991 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:25:03.991 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:25:03.991 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:25:03.991 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:25:03.991 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:25:03.991 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:25:03.991 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:25:03.991 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]", 2024-09-16T03:25:03.991 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:25:03.992 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]", 2024-09-16T03:25:03.992 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]", 2024-09-16T03:25:03.992 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:25:03.992 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:25:03.992 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:25:03.992 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:25:03.992 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:25:03.992 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:25:03.992 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:25:03.992 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:25:03.992 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:25:03.992 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/1", 2024-09-16T03:25:03.992 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:25:03.992 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:25:03.993 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:25:03.993 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.993 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.993 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:25:03.993 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:25:03.993 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]", 2024-09-16T03:25:03.993 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:25:03.993 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:25:03.993 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:25:03.993 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:25:03.993 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:25:03.993 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:25:03.994 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:25:03.994 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:25:03.994 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:25:03.994 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:25:03.994 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:25:03.994 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/2/block", 2024-09-16T03:25:03.994 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:25:03.994 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:25:03.994 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:25:03.994 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:25:03.995 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:25:03.995 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:25:03.995 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:25:03.995 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:25:03.995 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:25:03.995 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:25:03.995 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:24:07.764502Z", 2024-09-16T03:25:03.995 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:25:03.995 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:25:03.995 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:25:03.995 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:25:03.995 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:25:03.995 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:25:03.996 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:25:03.996 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]", 2024-09-16T03:25:03.996 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:25:03.996 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]", 2024-09-16T03:25:03.996 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]", 2024-09-16T03:25:03.996 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:25:03.996 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:25:03.996 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:25:03.996 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:25:03.996 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:25:03.996 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:25:03.996 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:25:03.996 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:25:03.997 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:25:03.997 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/2", 2024-09-16T03:25:03.997 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:25:03.997 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:25:03.997 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:25:03.997 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:03.997 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:03.997 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_clean_epochs": { 2024-09-16T03:25:03.997 INFO:tasks.workunit.client.0.smithi096.stderr: "min_last_epoch_clean": 28, 2024-09-16T03:25:03.997 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": { 2024-09-16T03:25:03.997 INFO:tasks.workunit.client.0.smithi096.stderr: "per_pool": [ 2024-09-16T03:25:03.997 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.997 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 1, 2024-09-16T03:25:03.998 INFO:tasks.workunit.client.0.smithi096.stderr: "floor": 28 2024-09-16T03:25:03.998 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.998 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.998 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 2, 2024-09-16T03:25:03.998 INFO:tasks.workunit.client.0.smithi096.stderr: "floor": 28 2024-09-16T03:25:03.998 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:03.998 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:03.998 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.998 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_epochs": [ 2024-09-16T03:25:03.998 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.998 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:25:03.998 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 28 2024-09-16T03:25:03.998 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.999 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.999 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:25:03.999 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 28 2024-09-16T03:25:03.999 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.999 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:03.999 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:25:03.999 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 28 2024-09-16T03:25:03.999 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:03.999 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:03.999 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:03.999 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_first_committed": 26, 2024-09-16T03:25:03.999 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_last_committed": 28, 2024-09-16T03:25:03.999 INFO:tasks.workunit.client.0.smithi096.stderr: "crushmap": { 2024-09-16T03:25:04.000 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": [ 2024-09-16T03:25:04.000 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:04.000 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:25:04.000 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.0", 2024-09-16T03:25:04.000 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:25:04.000 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:04.000 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:04.000 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:25:04.000 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.1", 2024-09-16T03:25:04.000 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:25:04.000 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:04.000 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:04.000 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:25:04.001 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.2", 2024-09-16T03:25:04.001 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:25:04.001 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:04.001 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:04.001 INFO:tasks.workunit.client.0.smithi096.stderr: "types": [ 2024-09-16T03:25:04.001 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:04.001 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 0, 2024-09-16T03:25:04.001 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd" 2024-09-16T03:25:04.001 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:04.001 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:04.001 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:25:04.001 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "host" 2024-09-16T03:25:04.001 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:04.001 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:04.002 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 2, 2024-09-16T03:25:04.002 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "chassis" 2024-09-16T03:25:04.002 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:04.002 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:04.002 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 3, 2024-09-16T03:25:04.002 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "rack" 2024-09-16T03:25:04.002 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:04.002 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:04.002 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 4, 2024-09-16T03:25:04.002 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "row" 2024-09-16T03:25:04.002 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:04.002 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:04.002 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 5, 2024-09-16T03:25:04.002 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "pdu" 2024-09-16T03:25:04.003 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:04.003 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:04.003 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 6, 2024-09-16T03:25:04.003 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "pod" 2024-09-16T03:25:04.003 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:04.003 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:04.003 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 7, 2024-09-16T03:25:04.003 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "room" 2024-09-16T03:25:04.003 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:04.003 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:04.003 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 8, 2024-09-16T03:25:04.003 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "datacenter" 2024-09-16T03:25:04.003 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:04.003 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:04.003 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 9, 2024-09-16T03:25:04.004 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "zone" 2024-09-16T03:25:04.004 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:04.004 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:04.004 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 10, 2024-09-16T03:25:04.004 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "region" 2024-09-16T03:25:04.004 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:04.004 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:04.004 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:25:04.004 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "root" 2024-09-16T03:25:04.004 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:04.004 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:04.004 INFO:tasks.workunit.client.0.smithi096.stderr: "buckets": [ 2024-09-16T03:25:04.004 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:04.004 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -1, 2024-09-16T03:25:04.005 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "default", 2024-09-16T03:25:04.005 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:25:04.005 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "root", 2024-09-16T03:25:04.005 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:25:04.005 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:25:04.005 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:25:04.005 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:25:04.005 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:04.005 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -3, 2024-09-16T03:25:04.005 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:25:04.005 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:25:04.005 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:04.005 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:04.005 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:04.005 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:04.006 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -2, 2024-09-16T03:25:04.006 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "default~hdd", 2024-09-16T03:25:04.006 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:25:04.006 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "root", 2024-09-16T03:25:04.006 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:25:04.006 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:25:04.006 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:25:04.006 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:25:04.006 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:04.006 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -4, 2024-09-16T03:25:04.006 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:25:04.006 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:25:04.006 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:04.006 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:04.007 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:04.007 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:04.007 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -3, 2024-09-16T03:25:04.007 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "smithi096", 2024-09-16T03:25:04.007 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:25:04.007 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "host", 2024-09-16T03:25:04.007 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:25:04.007 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:25:04.007 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:25:04.007 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:25:04.007 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:04.007 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:25:04.007 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:25:04.008 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:25:04.008 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:04.008 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:04.008 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:25:04.008 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:25:04.008 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 1 2024-09-16T03:25:04.008 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:04.008 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:04.008 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:25:04.008 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:25:04.008 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 2 2024-09-16T03:25:04.008 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:04.008 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:04.008 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:04.009 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:04.009 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -4, 2024-09-16T03:25:04.009 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "smithi096~hdd", 2024-09-16T03:25:04.009 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:25:04.009 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "host", 2024-09-16T03:25:04.009 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:25:04.009 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:25:04.009 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:25:04.009 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:25:04.009 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:04.009 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:25:04.009 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:25:04.009 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:25:04.010 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:04.010 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:04.010 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:25:04.010 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:25:04.010 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 1 2024-09-16T03:25:04.010 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:04.010 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:04.010 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:25:04.010 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:25:04.010 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 2 2024-09-16T03:25:04.010 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:04.010 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:04.010 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:04.011 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:04.011 INFO:tasks.workunit.client.0.smithi096.stderr: "rules": [ 2024-09-16T03:25:04.011 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:04.011 INFO:tasks.workunit.client.0.smithi096.stderr: "rule_id": 0, 2024-09-16T03:25:04.011 INFO:tasks.workunit.client.0.smithi096.stderr: "rule_name": "replicated_rule", 2024-09-16T03:25:04.011 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:25:04.011 INFO:tasks.workunit.client.0.smithi096.stderr: "steps": [ 2024-09-16T03:25:04.011 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:04.011 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "take", 2024-09-16T03:25:04.011 INFO:tasks.workunit.client.0.smithi096.stderr: "item": -1, 2024-09-16T03:25:04.011 INFO:tasks.workunit.client.0.smithi096.stderr: "item_name": "default" 2024-09-16T03:25:04.011 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:04.011 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:04.012 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "choose_firstn", 2024-09-16T03:25:04.012 INFO:tasks.workunit.client.0.smithi096.stderr: "num": 0, 2024-09-16T03:25:04.012 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "osd" 2024-09-16T03:25:04.012 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:04.012 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:04.012 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "emit" 2024-09-16T03:25:04.012 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:04.012 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:04.012 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:04.012 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:04.012 INFO:tasks.workunit.client.0.smithi096.stderr: "tunables": { 2024-09-16T03:25:04.012 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_local_tries": 0, 2024-09-16T03:25:04.012 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_local_fallback_tries": 0, 2024-09-16T03:25:04.012 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_total_tries": 50, 2024-09-16T03:25:04.013 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_descend_once": 1, 2024-09-16T03:25:04.013 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_vary_r": 1, 2024-09-16T03:25:04.013 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_stable": 1, 2024-09-16T03:25:04.013 INFO:tasks.workunit.client.0.smithi096.stderr: "msr_descents": 100, 2024-09-16T03:25:04.013 INFO:tasks.workunit.client.0.smithi096.stderr: "msr_collision_tries": 100, 2024-09-16T03:25:04.013 INFO:tasks.workunit.client.0.smithi096.stderr: "straw_calc_version": 1, 2024-09-16T03:25:04.013 INFO:tasks.workunit.client.0.smithi096.stderr: "allowed_bucket_algs": 54, 2024-09-16T03:25:04.013 INFO:tasks.workunit.client.0.smithi096.stderr: "profile": "jewel", 2024-09-16T03:25:04.013 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_tunables": 1, 2024-09-16T03:25:04.013 INFO:tasks.workunit.client.0.smithi096.stderr: "legacy_tunables": 0, 2024-09-16T03:25:04.013 INFO:tasks.workunit.client.0.smithi096.stderr: "minimum_required_version": "jewel", 2024-09-16T03:25:04.013 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables": 1, 2024-09-16T03:25:04.013 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables2": 1, 2024-09-16T03:25:04.013 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v2_rules": 0, 2024-09-16T03:25:04.014 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables3": 1, 2024-09-16T03:25:04.014 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v3_rules": 0, 2024-09-16T03:25:04.014 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v4_buckets": 1, 2024-09-16T03:25:04.014 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables5": 1, 2024-09-16T03:25:04.014 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v5_rules": 0, 2024-09-16T03:25:04.014 INFO:tasks.workunit.client.0.smithi096.stderr: "has_msr_rules": 0 2024-09-16T03:25:04.014 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:04.014 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_args": {} 2024-09-16T03:25:04.014 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:04.014 INFO:tasks.workunit.client.0.smithi096.stderr: "fsmap": { 2024-09-16T03:25:04.014 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 1, 2024-09-16T03:25:04.014 INFO:tasks.workunit.client.0.smithi096.stderr: "btime": "2024-09-16T03:22:46:882186+0000", 2024-09-16T03:25:04.014 INFO:tasks.workunit.client.0.smithi096.stderr: "default_fscid": -1, 2024-09-16T03:25:04.015 INFO:tasks.workunit.client.0.smithi096.stderr: "compat": { 2024-09-16T03:25:04.015 INFO:tasks.workunit.client.0.smithi096.stderr: "compat": {}, 2024-09-16T03:25:04.015 INFO:tasks.workunit.client.0.smithi096.stderr: "ro_compat": {}, 2024-09-16T03:25:04.015 INFO:tasks.workunit.client.0.smithi096.stderr: "incompat": { 2024-09-16T03:25:04.015 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_1": "base v0.20", 2024-09-16T03:25:04.015 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_2": "client writeable ranges", 2024-09-16T03:25:04.015 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_3": "default file layouts on dirs", 2024-09-16T03:25:04.015 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_4": "dir inode in separate object", 2024-09-16T03:25:04.015 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_5": "mds uses versioned encoding", 2024-09-16T03:25:04.015 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_6": "dirfrag is stored in omap", 2024-09-16T03:25:04.015 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_8": "no anchor table", 2024-09-16T03:25:04.015 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_9": "file layout v2", 2024-09-16T03:25:04.015 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_10": "snaprealm v2", 2024-09-16T03:25:04.016 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_11": "minor log segments", 2024-09-16T03:25:04.016 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_12": "quiesce subvolumes" 2024-09-16T03:25:04.016 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:04.016 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:04.016 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_flags": { 2024-09-16T03:25:04.016 INFO:tasks.workunit.client.0.smithi096.stderr: "enable_multiple": true, 2024-09-16T03:25:04.016 INFO:tasks.workunit.client.0.smithi096.stderr: "ever_enabled_multiple": true 2024-09-16T03:25:04.016 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:04.016 INFO:tasks.workunit.client.0.smithi096.stderr: "standbys": [], 2024-09-16T03:25:04.016 INFO:tasks.workunit.client.0.smithi096.stderr: "filesystems": [] 2024-09-16T03:25:04.016 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:04.016 INFO:tasks.workunit.client.0.smithi096.stderr: "mdsmap_first_committed": 1, 2024-09-16T03:25:04.016 INFO:tasks.workunit.client.0.smithi096.stderr: "mdsmap_last_committed": 1, 2024-09-16T03:25:04.017 INFO:tasks.workunit.client.0.smithi096.stderr: "auth": { 2024-09-16T03:25:04.017 INFO:tasks.workunit.client.0.smithi096.stderr: "first_committed": 1, 2024-09-16T03:25:04.017 INFO:tasks.workunit.client.0.smithi096.stderr: "last_committed": 5, 2024-09-16T03:25:04.017 INFO:tasks.workunit.client.0.smithi096.stderr: "num_secrets": 3 2024-09-16T03:25:04.017 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:04.017 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 64, 2024-09-16T03:25:04.017 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_active": 64, 2024-09-16T03:25:04.017 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_unknown": 0, 2024-09-16T03:25:04.017 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osd": 3, 2024-09-16T03:25:04.017 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_sum": { 2024-09-16T03:25:04.017 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:25:04.017 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:25:04.017 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:25:04.018 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:25:04.018 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:25:04.018 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:25:04.018 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:25:04.018 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:25:04.018 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:25:04.018 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:25:04.018 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:25:04.018 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:25:04.018 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:25:04.018 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:25:04.018 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:25:04.018 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:25:04.018 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:25:04.019 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:25:04.019 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:25:04.019 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:25:04.019 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:25:04.019 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:25:04.019 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:25:04.019 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:25:04.019 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:25:04.019 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:25:04.019 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:25:04.019 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:25:04.019 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:25:04.020 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:25:04.020 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:25:04.020 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:25:04.020 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:25:04.020 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:25:04.020 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:25:04.020 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:25:04.020 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:25:04.020 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:25:04.020 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:25:04.020 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:25:04.020 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:25:04.021 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:04.021 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:25:04.021 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:25:04.021 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:25:04.021 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:25:04.021 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:25:04.021 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:25:04.021 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:25:04.021 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:25:04.021 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:25:04.021 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:25:04.021 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:25:04.021 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:04.022 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:25:04.022 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:25:04.022 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 192, 2024-09-16T03:25:04.022 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 192, 2024-09-16T03:25:04.022 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 0 2024-09-16T03:25:04.022 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:04.022 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_sum": { 2024-09-16T03:25:04.022 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 0, 2024-09-16T03:25:04.022 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 0, 2024-09-16T03:25:04.022 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pgs": 192, 2024-09-16T03:25:04.022 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osds": 3, 2024-09-16T03:25:04.022 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_osds": 3, 2024-09-16T03:25:04.022 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_omap_osds": 3, 2024-09-16T03:25:04.023 INFO:tasks.workunit.client.0.smithi096.stderr: "kb": 314572800, 2024-09-16T03:25:04.023 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used": 81232, 2024-09-16T03:25:04.023 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_data": 696, 2024-09-16T03:25:04.023 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_omap": 4, 2024-09-16T03:25:04.023 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_meta": 80443, 2024-09-16T03:25:04.023 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_avail": 314491568, 2024-09-16T03:25:04.023 INFO:tasks.workunit.client.0.smithi096.stderr: "statfs": { 2024-09-16T03:25:04.023 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 322122547200, 2024-09-16T03:25:04.023 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 322039365632, 2024-09-16T03:25:04.023 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:25:04.023 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 712704, 2024-09-16T03:25:04.023 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 209643, 2024-09-16T03:25:04.023 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:25:04.023 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:25:04.024 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:25:04.024 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 4785, 2024-09-16T03:25:04.024 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 82373967 2024-09-16T03:25:04.024 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:04.024 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_peers": [], 2024-09-16T03:25:04.024 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_trim_queue_len": 0, 2024-09-16T03:25:04.024 INFO:tasks.workunit.client.0.smithi096.stderr: "num_snap_trimming": 0, 2024-09-16T03:25:04.024 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shards_repaired": 0, 2024-09-16T03:25:04.024 INFO:tasks.workunit.client.0.smithi096.stderr: "op_queue_age_hist": { 2024-09-16T03:25:04.024 INFO:tasks.workunit.client.0.smithi096.stderr: "histogram": [], 2024-09-16T03:25:04.024 INFO:tasks.workunit.client.0.smithi096.stderr: "upper_bound": 1 2024-09-16T03:25:04.024 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:04.024 INFO:tasks.workunit.client.0.smithi096.stderr: "perf_stat": { 2024-09-16T03:25:04.025 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ms": 0, 2024-09-16T03:25:04.025 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ms": 0, 2024-09-16T03:25:04.025 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ns": 0, 2024-09-16T03:25:04.025 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ns": 0 2024-09-16T03:25:04.025 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:04.025 INFO:tasks.workunit.client.0.smithi096.stderr: "alerts": [], 2024-09-16T03:25:04.025 INFO:tasks.workunit.client.0.smithi096.stderr: "network_ping_times": [] 2024-09-16T03:25:04.025 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:04.025 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_sum_by_class": { 2024-09-16T03:25:04.025 INFO:tasks.workunit.client.0.smithi096.stderr: "hdd": { 2024-09-16T03:25:04.025 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 0, 2024-09-16T03:25:04.026 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 0, 2024-09-16T03:25:04.026 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pgs": 192, 2024-09-16T03:25:04.026 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osds": 3, 2024-09-16T03:25:04.026 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_osds": 3, 2024-09-16T03:25:04.026 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_omap_osds": 3, 2024-09-16T03:25:04.026 INFO:tasks.workunit.client.0.smithi096.stderr: "kb": 314572800, 2024-09-16T03:25:04.026 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used": 81232, 2024-09-16T03:25:04.026 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_data": 696, 2024-09-16T03:25:04.026 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_omap": 4, 2024-09-16T03:25:04.026 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_meta": 80443, 2024-09-16T03:25:04.026 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_avail": 314491568, 2024-09-16T03:25:04.026 INFO:tasks.workunit.client.0.smithi096.stderr: "statfs": { 2024-09-16T03:25:04.026 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 322122547200, 2024-09-16T03:25:04.026 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 322039365632, 2024-09-16T03:25:04.027 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:25:04.027 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 712704, 2024-09-16T03:25:04.027 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 209643, 2024-09-16T03:25:04.027 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:25:04.027 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:25:04.027 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:25:04.027 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 4785, 2024-09-16T03:25:04.027 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 82373967 2024-09-16T03:25:04.027 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:04.027 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_peers": [], 2024-09-16T03:25:04.027 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_trim_queue_len": 0, 2024-09-16T03:25:04.027 INFO:tasks.workunit.client.0.smithi096.stderr: "num_snap_trimming": 0, 2024-09-16T03:25:04.028 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shards_repaired": 0, 2024-09-16T03:25:04.028 INFO:tasks.workunit.client.0.smithi096.stderr: "op_queue_age_hist": { 2024-09-16T03:25:04.028 INFO:tasks.workunit.client.0.smithi096.stderr: "histogram": [], 2024-09-16T03:25:04.028 INFO:tasks.workunit.client.0.smithi096.stderr: "upper_bound": 1 2024-09-16T03:25:04.028 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:04.028 INFO:tasks.workunit.client.0.smithi096.stderr: "perf_stat": { 2024-09-16T03:25:04.028 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ms": 0, 2024-09-16T03:25:04.028 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ms": 0, 2024-09-16T03:25:04.028 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ns": 0, 2024-09-16T03:25:04.028 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ns": 0 2024-09-16T03:25:04.028 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:04.028 INFO:tasks.workunit.client.0.smithi096.stderr: "alerts": [], 2024-09-16T03:25:04.028 INFO:tasks.workunit.client.0.smithi096.stderr: "network_ping_times": [] 2024-09-16T03:25:04.029 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:04.029 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:04.029 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_stats": [ 2024-09-16T03:25:04.029 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:04.029 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 2, 2024-09-16T03:25:04.029 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 32, 2024-09-16T03:25:04.029 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:25:04.029 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:25:04.029 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:25:04.029 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:25:04.029 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:25:04.029 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:25:04.029 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:25:04.030 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:25:04.030 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:25:04.030 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:25:04.030 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:25:04.030 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:25:04.030 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:25:04.030 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:25:04.030 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:25:04.030 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:25:04.030 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:25:04.030 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:25:04.031 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:25:04.031 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:25:04.031 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:25:04.031 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:25:04.031 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:25:04.031 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:25:04.031 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:25:04.031 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:25:04.031 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:25:04.031 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:25:04.031 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:25:04.031 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:25:04.031 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:25:04.031 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:25:04.032 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:25:04.032 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:25:04.032 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:25:04.032 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:25:04.032 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:25:04.032 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:25:04.032 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:25:04.032 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:25:04.032 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:25:04.032 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:04.032 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:25:04.032 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:25:04.032 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:25:04.032 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:25:04.033 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:25:04.033 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:25:04.033 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:25:04.033 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:25:04.033 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:25:04.033 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:25:04.033 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:25:04.033 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:04.033 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:25:04.033 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:25:04.033 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 96, 2024-09-16T03:25:04.033 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 96, 2024-09-16T03:25:04.033 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 3 2024-09-16T03:25:04.034 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:04.034 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:04.034 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 1, 2024-09-16T03:25:04.034 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 32, 2024-09-16T03:25:04.034 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:25:04.034 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:25:04.034 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:25:04.034 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:25:04.034 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:25:04.034 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:25:04.034 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:25:04.034 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:25:04.034 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:25:04.034 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:25:04.035 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:25:04.035 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:25:04.035 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:25:04.035 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:25:04.035 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:25:04.035 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:25:04.035 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:25:04.035 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:25:04.035 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:25:04.035 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:25:04.035 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:25:04.035 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:25:04.035 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:25:04.035 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:25:04.035 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:25:04.036 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:25:04.036 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:25:04.036 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:25:04.036 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:25:04.036 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:25:04.036 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:25:04.036 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:25:04.036 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:25:04.036 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:25:04.036 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:25:04.036 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:25:04.036 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:25:04.036 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:25:04.037 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:25:04.037 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:25:04.037 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:25:04.037 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:04.037 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:25:04.037 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:25:04.037 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:25:04.037 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:25:04.037 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:25:04.037 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:25:04.037 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:25:04.037 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:25:04.037 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:25:04.038 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:25:04.038 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:25:04.038 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:04.038 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:25:04.038 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:25:04.038 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 96, 2024-09-16T03:25:04.038 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 96, 2024-09-16T03:25:04.038 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 3 2024-09-16T03:25:04.038 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:04.038 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:04.038 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_stats": [ 2024-09-16T03:25:04.038 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:04.038 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:25:04.039 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 21474836506 2024-09-16T03:25:04.039 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:04.039 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:04.039 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:25:04.039 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 42949672978 2024-09-16T03:25:04.039 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:04.039 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:04.039 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:25:04.039 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 64424509450 2024-09-16T03:25:04.039 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:04.039 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:04.039 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_by_state": [ 2024-09-16T03:25:04.039 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:04.039 INFO:tasks.workunit.client.0.smithi096.stderr: "state": "active+clean", 2024-09-16T03:25:04.040 INFO:tasks.workunit.client.0.smithi096.stderr: "num": 64 2024-09-16T03:25:04.040 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:04.040 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:04.040 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_by_osd": [ 2024-09-16T03:25:04.040 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:04.040 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:25:04.040 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 15, 2024-09-16T03:25:04.040 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 64, 2024-09-16T03:25:04.040 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:25:04.040 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:04.040 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:04.040 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:25:04.040 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 20, 2024-09-16T03:25:04.041 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 64, 2024-09-16T03:25:04.041 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:25:04.041 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:04.041 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:04.041 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:25:04.041 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 29, 2024-09-16T03:25:04.041 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 64, 2024-09-16T03:25:04.041 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:25:04.041 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:04.042 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:04.042 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": [ 2024-09-16T03:25:04.042 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:04.042 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 1, 2024-09-16T03:25:04.042 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": {} 2024-09-16T03:25:04.042 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:04.042 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:04.042 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 2, 2024-09-16T03:25:04.042 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": {} 2024-09-16T03:25:04.042 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:04.042 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:04.042 INFO:tasks.workunit.client.0.smithi096.stderr: "servicemap": { 2024-09-16T03:25:04.042 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 4, 2024-09-16T03:25:04.043 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:25:02.412573+0000", 2024-09-16T03:25:04.043 INFO:tasks.workunit.client.0.smithi096.stderr: "services": { 2024-09-16T03:25:04.043 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": { 2024-09-16T03:25:04.043 INFO:tasks.workunit.client.0.smithi096.stderr: "daemons": { 2024-09-16T03:25:04.043 INFO:tasks.workunit.client.0.smithi096.stderr: "summary": "", 2024-09-16T03:25:04.043 INFO:tasks.workunit.client.0.smithi096.stderr: "2": { 2024-09-16T03:25:04.043 INFO:tasks.workunit.client.0.smithi096.stderr: "start_epoch": 0, 2024-09-16T03:25:04.043 INFO:tasks.workunit.client.0.smithi096.stderr: "start_stamp": "0.000000", 2024-09-16T03:25:04.043 INFO:tasks.workunit.client.0.smithi096.stderr: "gid": 0, 2024-09-16T03:25:04.043 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "(unrecognized address family 0)/0", 2024-09-16T03:25:04.043 INFO:tasks.workunit.client.0.smithi096.stderr: "metadata": {}, 2024-09-16T03:25:04.043 INFO:tasks.workunit.client.0.smithi096.stderr: "task_status": {} 2024-09-16T03:25:04.043 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:04.043 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:04.044 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:04.044 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:04.044 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:04.044 INFO:tasks.workunit.client.0.smithi096.stderr: "mgrstat_first_committed": 52, 2024-09-16T03:25:04.044 INFO:tasks.workunit.client.0.smithi096.stderr: "mgrstat_last_committed": 57, 2024-09-16T03:25:04.044 INFO:tasks.workunit.client.0.smithi096.stderr: "logm_first_committed": 1, 2024-09-16T03:25:04.044 INFO:tasks.workunit.client.0.smithi096.stderr: "logm_last_committed": 248, 2024-09-16T03:25:04.044 INFO:tasks.workunit.client.0.smithi096.stderr: "paxos": { 2024-09-16T03:25:04.044 INFO:tasks.workunit.client.0.smithi096.stderr: "first_committed": 1, 2024-09-16T03:25:04.044 INFO:tasks.workunit.client.0.smithi096.stderr: "last_committed": 345, 2024-09-16T03:25:04.044 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pn": 0, 2024-09-16T03:25:04.044 INFO:tasks.workunit.client.0.smithi096.stderr: "accepted_pn": 0 2024-09-16T03:25:04.044 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:04.045 INFO:tasks.workunit.client.0.smithi096.stderr:}' 2024-09-16T03:25:04.047 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:132: get_fc_lc_diff: jq .osdmap_first_committed 2024-09-16T03:25:04.048 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:132: get_fc_lc_diff: echo '{' '"cluster_fingerprint":' '"fda2fc64-07ed-4add-8224-2e527e11d427",' '"version":' '"19.3.0-4930-gfc3e0bff",' '"commit":' '"fc3e0bff7468fd55478adbae7f75508b749124b6",' '"timestamp":' '"2024-09-16T03:25:03.927488+0000",' '"tag":' '"",' '"health":' '{' '"status":' '"HEALTH_OK",' '"checks":' '{},' '"mutes":' '[]' '},' '"monmap_first_committed":' 1, '"monmap_last_committed":' 1, '"monmap":' '{' '"epoch":' 1, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"modified":' '"2024-09-16T03:22:45.872880Z",' '"created":' '"2024-09-16T03:22:45.872880Z",' '"min_mon_release":' 19, '"min_mon_release_name":' '"squid",' '"election_strategy":' 1, '"disallowed_leaders:' '":' '"",' '"stretch_mode":' false, '"tiebreaker_mon":' '"",' '"removed_ranks:' '":' '"",' '"features":' '{' '"persistent":' '[' '"kraken",' '"luminous",' '"mimic",' '"osdmap-prune",' '"nautilus",' '"octopus",' '"pacific",' '"elector-pinging",' '"quincy",' '"reef",' '"squid"' '],' '"optional":' '[]' '},' '"mons":' '[' '{' '"rank":' 0, '"name":' '"a",' '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:7302",' '"nonce":' 0 '}' ']' '},' '"addr":' '"127.0.0.1:7302/0",' '"public_addr":' '"127.0.0.1:7302/0",' '"priority":' 0, '"weight":' 0, '"crush_location":' '"{}"' '}' ']' '},' '"quorum":' '[' 0 '],' '"osdmap":' '{' '"epoch":' 28, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"created":' '"2024-09-16T03:22:46.906117+0000",' '"modified":' '"2024-09-16T03:24:50.642444+0000",' '"last_up_change":' '"2024-09-16T03:24:37.708512+0000",' '"last_in_change":' '"2024-09-16T03:24:01.831039+0000",' '"flags":' '"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit",' '"flags_num":' 5799936, '"flags_set":' '[' '"pglog_hardlimit",' '"purged_snapdirs",' '"recovery_deletes",' '"sortbitwise"' '],' '"crush_version":' 7, '"full_ratio":' 0.97000002861022949, '"backfillfull_ratio":' 0.97000002861022949, '"nearfull_ratio":' 0.85000002384185791, '"cluster_snapshot":' '"",' '"pool_max":' 2, '"max_osd":' 3, '"require_min_compat_client":' '"luminous",' '"min_compat_client":' '"jewel",' '"require_osd_release":' '"squid",' '"allow_crimson":' false, '"pools":' '[' '{' '"pool":' 1, '"pool_name":' '"foo",' '"create_time":' '"2024-09-16T03:24:44.525189+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"21",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.690000057220459, '"score_stable":' 1.690000057220459, '"optimal_score":' 1, '"raw_score_acting":' 1.690000057220459, '"raw_score_stable":' 1.690000057220459, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '},' '{' '"pool":' 2, '"pool_name":' '"bar",' '"create_time":' '"2024-09-16T03:24:46.226575+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"24",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.1299999952316284, '"score_stable":' 1.1299999952316284, '"optimal_score":' 1, '"raw_score_acting":' 1.1299999952316284, '"raw_score_stable":' 1.1299999952316284, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '}' '],' '"osds":' '[' '{' '"osd":' 0, '"uuid":' '"64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 5, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6802",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6803",' '"nonce":' 3375787448 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6804",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6805",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6808",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6809",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6806",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6807",' '"nonce":' 3375787448 '}' ']' '},' '"public_addr":' '"127.0.0.1:6803/3375787448",' '"cluster_addr":' '"127.0.0.1:6805/3375787448",' '"heartbeat_back_addr":' '"127.0.0.1:6809/3375787448",' '"heartbeat_front_addr":' '"127.0.0.1:6807/3375787448",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 1, '"uuid":' '"74b26727-75c9-444d-8782-719e4197a382",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 10, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6810",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6811",' '"nonce":' 3733255132 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6812",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6813",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6816",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6817",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6814",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6815",' '"nonce":' 3733255132 '}' ']' '},' '"public_addr":' '"127.0.0.1:6811/3733255132",' '"cluster_addr":' '"127.0.0.1:6813/3733255132",' '"heartbeat_back_addr":' '"127.0.0.1:6817/3733255132",' '"heartbeat_front_addr":' '"127.0.0.1:6815/3733255132",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 2, '"uuid":' '"143da3a7-dad9-4b1e-966b-76cf5bdd3c82",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 15, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6818",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6819",' '"nonce":' 963814857 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6820",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6821",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6824",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6825",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6822",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6823",' '"nonce":' 963814857 '}' ']' '},' '"public_addr":' '"127.0.0.1:6819/963814857",' '"cluster_addr":' '"127.0.0.1:6821/963814857",' '"heartbeat_back_addr":' '"127.0.0.1:6825/963814857",' '"heartbeat_front_addr":' '"127.0.0.1:6823/963814857",' '"state":' '[' '"exists",' '"up"' ']' '}' '],' '"osd_xinfo":' '[' '{' '"osd":' 0, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:22.481942+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 1, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:59.663703+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 2, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:24:37.320822+0000",' '"dead_epoch":' 0 '}' '],' '"pg_upmap":' '[],' '"pg_upmap_items":' '[],' '"pg_upmap_primaries":' '[],' '"pg_temp":' '[],' '"primary_temp":' '[],' '"blocklist":' '{},' '"range_blocklist":' '{},' '"erasure_code_profiles":' '{' '"default":' '{' '"k":' '"2",' '"m":' '"2",' '"plugin":' '"jerasure",' '"technique":' '"reed_sol_van"' '}' '},' '"removed_snaps_queue":' '[],' '"new_removed_snaps":' '[],' '"new_purged_snaps":' '[],' '"crush_node_flags":' '{},' '"device_class_flags":' '{},' '"stretch_mode":' '{' '"stretch_mode_enabled":' false, '"stretch_bucket_count":' 0, '"degraded_stretch_mode":' 0, '"recovering_stretch_mode":' 0, '"stretch_mode_bucket":' 0 '}' '},' '"osd_metadata":' '[' '{' '"id":' 0, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/0/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:22:53.662571Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]",' '"hb_front_addr":' '"[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/0",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 1, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/1/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:23:30.129885Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]",' '"hb_front_addr":' '"[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/1",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 2, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/2/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:24:07.764502Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]",' '"hb_front_addr":' '"[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/2",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '}' '],' '"osdmap_clean_epochs":' '{' '"min_last_epoch_clean":' 28, '"last_epoch_clean":' '{' '"per_pool":' '[' '{' '"poolid":' 1, '"floor":' 28 '},' '{' '"poolid":' 2, '"floor":' 28 '}' ']' '},' '"osd_epochs":' '[' '{' '"id":' 0, '"epoch":' 28 '},' '{' '"id":' 1, '"epoch":' 28 '},' '{' '"id":' 2, '"epoch":' 28 '}' ']' '},' '"osdmap_first_committed":' 26, '"osdmap_last_committed":' 28, '"crushmap":' '{' '"devices":' '[' '{' '"id":' 0, '"name":' '"osd.0",' '"class":' '"hdd"' '},' '{' '"id":' 1, '"name":' '"osd.1",' '"class":' '"hdd"' '},' '{' '"id":' 2, '"name":' '"osd.2",' '"class":' '"hdd"' '}' '],' '"types":' '[' '{' '"type_id":' 0, '"name":' '"osd"' '},' '{' '"type_id":' 1, '"name":' '"host"' '},' '{' '"type_id":' 2, '"name":' '"chassis"' '},' '{' '"type_id":' 3, '"name":' '"rack"' '},' '{' '"type_id":' 4, '"name":' '"row"' '},' '{' '"type_id":' 5, '"name":' '"pdu"' '},' '{' '"type_id":' 6, '"name":' '"pod"' '},' '{' '"type_id":' 7, '"name":' '"room"' '},' '{' '"type_id":' 8, '"name":' '"datacenter"' '},' '{' '"type_id":' 9, '"name":' '"zone"' '},' '{' '"type_id":' 10, '"name":' '"region"' '},' '{' '"type_id":' 11, '"name":' '"root"' '}' '],' '"buckets":' '[' '{' '"id":' -1, '"name":' '"default",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -3, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -2, '"name":' '"default~hdd",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -4, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -3, '"name":' '"smithi096",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '},' '{' '"id":' -4, '"name":' '"smithi096~hdd",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '}' '],' '"rules":' '[' '{' '"rule_id":' 0, '"rule_name":' '"replicated_rule",' '"type":' 1, '"steps":' '[' '{' '"op":' '"take",' '"item":' -1, '"item_name":' '"default"' '},' '{' '"op":' '"choose_firstn",' '"num":' 0, '"type":' '"osd"' '},' '{' '"op":' '"emit"' '}' ']' '}' '],' '"tunables":' '{' '"choose_local_tries":' 0, '"choose_local_fallback_tries":' 0, '"choose_total_tries":' 50, '"chooseleaf_descend_once":' 1, '"chooseleaf_vary_r":' 1, '"chooseleaf_stable":' 1, '"msr_descents":' 100, '"msr_collision_tries":' 100, '"straw_calc_version":' 1, '"allowed_bucket_algs":' 54, '"profile":' '"jewel",' '"optimal_tunables":' 1, '"legacy_tunables":' 0, '"minimum_required_version":' '"jewel",' '"require_feature_tunables":' 1, '"require_feature_tunables2":' 1, '"has_v2_rules":' 0, '"require_feature_tunables3":' 1, '"has_v3_rules":' 0, '"has_v4_buckets":' 1, '"require_feature_tunables5":' 1, '"has_v5_rules":' 0, '"has_msr_rules":' 0 '},' '"choose_args":' '{}' '},' '"fsmap":' '{' '"epoch":' 1, '"btime":' '"2024-09-16T03:22:46:882186+0000",' '"default_fscid":' -1, '"compat":' '{' '"compat":' '{},' '"ro_compat":' '{},' '"incompat":' '{' '"feature_1":' '"base' 'v0.20",' '"feature_2":' '"client' writeable 'ranges",' '"feature_3":' '"default' file layouts on 'dirs",' '"feature_4":' '"dir' inode in separate 'object",' '"feature_5":' '"mds' uses versioned 'encoding",' '"feature_6":' '"dirfrag' is stored in 'omap",' '"feature_8":' '"no' anchor 'table",' '"feature_9":' '"file' layout 'v2",' '"feature_10":' '"snaprealm' 'v2",' '"feature_11":' '"minor' log 'segments",' '"feature_12":' '"quiesce' 'subvolumes"' '}' '},' '"feature_flags":' '{' '"enable_multiple":' true, '"ever_enabled_multiple":' true '},' '"standbys":' '[],' '"filesystems":' '[]' '},' '"mdsmap_first_committed":' 1, '"mdsmap_last_committed":' 1, '"auth":' '{' '"first_committed":' 1, '"last_committed":' 5, '"num_secrets":' 3 '},' '"num_pg":' 64, '"num_pg_active":' 64, '"num_pg_unknown":' 0, '"num_osd":' 3, '"pool_sum":' '{' '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 192, '"acting":' 192, '"num_store_stats":' 0 '},' '"osd_sum":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 192, '"num_osds":' 3, '"num_per_pool_osds":' 3, '"num_per_pool_omap_osds":' 3, '"kb":' 314572800, '"kb_used":' 81232, '"kb_used_data":' 696, '"kb_used_omap":' 4, '"kb_used_meta":' 80443, '"kb_avail":' 314491568, '"statfs":' '{' '"total":' 322122547200, '"available":' 322039365632, '"internally_reserved":' 0, '"allocated":' 712704, '"data_stored":' 209643, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 4785, '"internal_metadata":' 82373967 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 0, '"apply_latency_ms":' 0, '"commit_latency_ns":' 0, '"apply_latency_ns":' 0 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '},' '"osd_sum_by_class":' '{' '"hdd":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 192, '"num_osds":' 3, '"num_per_pool_osds":' 3, '"num_per_pool_omap_osds":' 3, '"kb":' 314572800, '"kb_used":' 81232, '"kb_used_data":' 696, '"kb_used_omap":' 4, '"kb_used_meta":' 80443, '"kb_avail":' 314491568, '"statfs":' '{' '"total":' 322122547200, '"available":' 322039365632, '"internally_reserved":' 0, '"allocated":' 712704, '"data_stored":' 209643, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 4785, '"internal_metadata":' 82373967 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 0, '"apply_latency_ms":' 0, '"commit_latency_ns":' 0, '"apply_latency_ns":' 0 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '}' '},' '"pool_stats":' '[' '{' '"poolid":' 2, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 96, '"acting":' 96, '"num_store_stats":' 3 '},' '{' '"poolid":' 1, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 96, '"acting":' 96, '"num_store_stats":' 3 '}' '],' '"osd_stats":' '[' '{' '"osd":' 0, '"seq":' 21474836506 '},' '{' '"osd":' 1, '"seq":' 42949672978 '},' '{' '"osd":' 2, '"seq":' 64424509450 '}' '],' '"num_pg_by_state":' '[' '{' '"state":' '"active+clean",' '"num":' 64 '}' '],' '"num_pg_by_osd":' '[' '{' '"osd":' 2, '"num_primary_pg":' 15, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 0, '"num_primary_pg":' 20, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 1, '"num_primary_pg":' 29, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '}' '],' '"purged_snaps":' '[' '{' '"pool":' 1, '"purged_snaps":' '{}' '},' '{' '"pool":' 2, '"purged_snaps":' '{}' '}' '],' '"servicemap":' '{' '"epoch":' 4, '"modified":' '"2024-09-16T03:25:02.412573+0000",' '"services":' '{' '"osd":' '{' '"daemons":' '{' '"summary":' '"",' '"2":' '{' '"start_epoch":' 0, '"start_stamp":' '"0.000000",' '"gid":' 0, '"addr":' '"(unrecognized' address family '0)/0",' '"metadata":' '{},' '"task_status":' '{}' '}' '}' '}' '}' '},' '"mgrstat_first_committed":' 52, '"mgrstat_last_committed":' 57, '"logm_first_committed":' 1, '"logm_last_committed":' 248, '"paxos":' '{' '"first_committed":' 1, '"last_committed":' 345, '"last_pn":' 0, '"accepted_pn":' 0 '}' '}' 2024-09-16T03:25:04.048 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:132: get_fc_lc_diff: osdm_fc=26 2024-09-16T03:25:04.048 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:134: get_fc_lc_diff: jq .osdmap_last_committed 2024-09-16T03:25:04.048 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:134: get_fc_lc_diff: echo '{' '"cluster_fingerprint":' '"fda2fc64-07ed-4add-8224-2e527e11d427",' '"version":' '"19.3.0-4930-gfc3e0bff",' '"commit":' '"fc3e0bff7468fd55478adbae7f75508b749124b6",' '"timestamp":' '"2024-09-16T03:25:03.927488+0000",' '"tag":' '"",' '"health":' '{' '"status":' '"HEALTH_OK",' '"checks":' '{},' '"mutes":' '[]' '},' '"monmap_first_committed":' 1, '"monmap_last_committed":' 1, '"monmap":' '{' '"epoch":' 1, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"modified":' '"2024-09-16T03:22:45.872880Z",' '"created":' '"2024-09-16T03:22:45.872880Z",' '"min_mon_release":' 19, '"min_mon_release_name":' '"squid",' '"election_strategy":' 1, '"disallowed_leaders:' '":' '"",' '"stretch_mode":' false, '"tiebreaker_mon":' '"",' '"removed_ranks:' '":' '"",' '"features":' '{' '"persistent":' '[' '"kraken",' '"luminous",' '"mimic",' '"osdmap-prune",' '"nautilus",' '"octopus",' '"pacific",' '"elector-pinging",' '"quincy",' '"reef",' '"squid"' '],' '"optional":' '[]' '},' '"mons":' '[' '{' '"rank":' 0, '"name":' '"a",' '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:7302",' '"nonce":' 0 '}' ']' '},' '"addr":' '"127.0.0.1:7302/0",' '"public_addr":' '"127.0.0.1:7302/0",' '"priority":' 0, '"weight":' 0, '"crush_location":' '"{}"' '}' ']' '},' '"quorum":' '[' 0 '],' '"osdmap":' '{' '"epoch":' 28, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"created":' '"2024-09-16T03:22:46.906117+0000",' '"modified":' '"2024-09-16T03:24:50.642444+0000",' '"last_up_change":' '"2024-09-16T03:24:37.708512+0000",' '"last_in_change":' '"2024-09-16T03:24:01.831039+0000",' '"flags":' '"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit",' '"flags_num":' 5799936, '"flags_set":' '[' '"pglog_hardlimit",' '"purged_snapdirs",' '"recovery_deletes",' '"sortbitwise"' '],' '"crush_version":' 7, '"full_ratio":' 0.97000002861022949, '"backfillfull_ratio":' 0.97000002861022949, '"nearfull_ratio":' 0.85000002384185791, '"cluster_snapshot":' '"",' '"pool_max":' 2, '"max_osd":' 3, '"require_min_compat_client":' '"luminous",' '"min_compat_client":' '"jewel",' '"require_osd_release":' '"squid",' '"allow_crimson":' false, '"pools":' '[' '{' '"pool":' 1, '"pool_name":' '"foo",' '"create_time":' '"2024-09-16T03:24:44.525189+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"21",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.690000057220459, '"score_stable":' 1.690000057220459, '"optimal_score":' 1, '"raw_score_acting":' 1.690000057220459, '"raw_score_stable":' 1.690000057220459, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '},' '{' '"pool":' 2, '"pool_name":' '"bar",' '"create_time":' '"2024-09-16T03:24:46.226575+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"24",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.1299999952316284, '"score_stable":' 1.1299999952316284, '"optimal_score":' 1, '"raw_score_acting":' 1.1299999952316284, '"raw_score_stable":' 1.1299999952316284, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '}' '],' '"osds":' '[' '{' '"osd":' 0, '"uuid":' '"64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 5, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6802",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6803",' '"nonce":' 3375787448 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6804",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6805",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6808",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6809",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6806",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6807",' '"nonce":' 3375787448 '}' ']' '},' '"public_addr":' '"127.0.0.1:6803/3375787448",' '"cluster_addr":' '"127.0.0.1:6805/3375787448",' '"heartbeat_back_addr":' '"127.0.0.1:6809/3375787448",' '"heartbeat_front_addr":' '"127.0.0.1:6807/3375787448",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 1, '"uuid":' '"74b26727-75c9-444d-8782-719e4197a382",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 10, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6810",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6811",' '"nonce":' 3733255132 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6812",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6813",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6816",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6817",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6814",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6815",' '"nonce":' 3733255132 '}' ']' '},' '"public_addr":' '"127.0.0.1:6811/3733255132",' '"cluster_addr":' '"127.0.0.1:6813/3733255132",' '"heartbeat_back_addr":' '"127.0.0.1:6817/3733255132",' '"heartbeat_front_addr":' '"127.0.0.1:6815/3733255132",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 2, '"uuid":' '"143da3a7-dad9-4b1e-966b-76cf5bdd3c82",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 15, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6818",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6819",' '"nonce":' 963814857 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6820",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6821",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6824",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6825",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6822",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6823",' '"nonce":' 963814857 '}' ']' '},' '"public_addr":' '"127.0.0.1:6819/963814857",' '"cluster_addr":' '"127.0.0.1:6821/963814857",' '"heartbeat_back_addr":' '"127.0.0.1:6825/963814857",' '"heartbeat_front_addr":' '"127.0.0.1:6823/963814857",' '"state":' '[' '"exists",' '"up"' ']' '}' '],' '"osd_xinfo":' '[' '{' '"osd":' 0, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:22.481942+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 1, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:59.663703+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 2, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:24:37.320822+0000",' '"dead_epoch":' 0 '}' '],' '"pg_upmap":' '[],' '"pg_upmap_items":' '[],' '"pg_upmap_primaries":' '[],' '"pg_temp":' '[],' '"primary_temp":' '[],' '"blocklist":' '{},' '"range_blocklist":' '{},' '"erasure_code_profiles":' '{' '"default":' '{' '"k":' '"2",' '"m":' '"2",' '"plugin":' '"jerasure",' '"technique":' '"reed_sol_van"' '}' '},' '"removed_snaps_queue":' '[],' '"new_removed_snaps":' '[],' '"new_purged_snaps":' '[],' '"crush_node_flags":' '{},' '"device_class_flags":' '{},' '"stretch_mode":' '{' '"stretch_mode_enabled":' false, '"stretch_bucket_count":' 0, '"degraded_stretch_mode":' 0, '"recovering_stretch_mode":' 0, '"stretch_mode_bucket":' 0 '}' '},' '"osd_metadata":' '[' '{' '"id":' 0, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/0/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:22:53.662571Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]",' '"hb_front_addr":' '"[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/0",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 1, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/1/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:23:30.129885Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]",' '"hb_front_addr":' '"[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/1",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 2, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/2/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:24:07.764502Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]",' '"hb_front_addr":' '"[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/2",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '}' '],' '"osdmap_clean_epochs":' '{' '"min_last_epoch_clean":' 28, '"last_epoch_clean":' '{' '"per_pool":' '[' '{' '"poolid":' 1, '"floor":' 28 '},' '{' '"poolid":' 2, '"floor":' 28 '}' ']' '},' '"osd_epochs":' '[' '{' '"id":' 0, '"epoch":' 28 '},' '{' '"id":' 1, '"epoch":' 28 '},' '{' '"id":' 2, '"epoch":' 28 '}' ']' '},' '"osdmap_first_committed":' 26, '"osdmap_last_committed":' 28, '"crushmap":' '{' '"devices":' '[' '{' '"id":' 0, '"name":' '"osd.0",' '"class":' '"hdd"' '},' '{' '"id":' 1, '"name":' '"osd.1",' '"class":' '"hdd"' '},' '{' '"id":' 2, '"name":' '"osd.2",' '"class":' '"hdd"' '}' '],' '"types":' '[' '{' '"type_id":' 0, '"name":' '"osd"' '},' '{' '"type_id":' 1, '"name":' '"host"' '},' '{' '"type_id":' 2, '"name":' '"chassis"' '},' '{' '"type_id":' 3, '"name":' '"rack"' '},' '{' '"type_id":' 4, '"name":' '"row"' '},' '{' '"type_id":' 5, '"name":' '"pdu"' '},' '{' '"type_id":' 6, '"name":' '"pod"' '},' '{' '"type_id":' 7, '"name":' '"room"' '},' '{' '"type_id":' 8, '"name":' '"datacenter"' '},' '{' '"type_id":' 9, '"name":' '"zone"' '},' '{' '"type_id":' 10, '"name":' '"region"' '},' '{' '"type_id":' 11, '"name":' '"root"' '}' '],' '"buckets":' '[' '{' '"id":' -1, '"name":' '"default",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -3, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -2, '"name":' '"default~hdd",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -4, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -3, '"name":' '"smithi096",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '},' '{' '"id":' -4, '"name":' '"smithi096~hdd",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '}' '],' '"rules":' '[' '{' '"rule_id":' 0, '"rule_name":' '"replicated_rule",' '"type":' 1, '"steps":' '[' '{' '"op":' '"take",' '"item":' -1, '"item_name":' '"default"' '},' '{' '"op":' '"choose_firstn",' '"num":' 0, '"type":' '"osd"' '},' '{' '"op":' '"emit"' '}' ']' '}' '],' '"tunables":' '{' '"choose_local_tries":' 0, '"choose_local_fallback_tries":' 0, '"choose_total_tries":' 50, '"chooseleaf_descend_once":' 1, '"chooseleaf_vary_r":' 1, '"chooseleaf_stable":' 1, '"msr_descents":' 100, '"msr_collision_tries":' 100, '"straw_calc_version":' 1, '"allowed_bucket_algs":' 54, '"profile":' '"jewel",' '"optimal_tunables":' 1, '"legacy_tunables":' 0, '"minimum_required_version":' '"jewel",' '"require_feature_tunables":' 1, '"require_feature_tunables2":' 1, '"has_v2_rules":' 0, '"require_feature_tunables3":' 1, '"has_v3_rules":' 0, '"has_v4_buckets":' 1, '"require_feature_tunables5":' 1, '"has_v5_rules":' 0, '"has_msr_rules":' 0 '},' '"choose_args":' '{}' '},' '"fsmap":' '{' '"epoch":' 1, '"btime":' '"2024-09-16T03:22:46:882186+0000",' '"default_fscid":' -1, '"compat":' '{' '"compat":' '{},' '"ro_compat":' '{},' '"incompat":' '{' '"feature_1":' '"base' 'v0.20",' '"feature_2":' '"client' writeable 'ranges",' '"feature_3":' '"default' file layouts on 'dirs",' '"feature_4":' '"dir' inode in separate 'object",' '"feature_5":' '"mds' uses versioned 'encoding",' '"feature_6":' '"dirfrag' is stored in 'omap",' '"feature_8":' '"no' anchor 'table",' '"feature_9":' '"file' layout 'v2",' '"feature_10":' '"snaprealm' 'v2",' '"feature_11":' '"minor' log 'segments",' '"feature_12":' '"quiesce' 'subvolumes"' '}' '},' '"feature_flags":' '{' '"enable_multiple":' true, '"ever_enabled_multiple":' true '},' '"standbys":' '[],' '"filesystems":' '[]' '},' '"mdsmap_first_committed":' 1, '"mdsmap_last_committed":' 1, '"auth":' '{' '"first_committed":' 1, '"last_committed":' 5, '"num_secrets":' 3 '},' '"num_pg":' 64, '"num_pg_active":' 64, '"num_pg_unknown":' 0, '"num_osd":' 3, '"pool_sum":' '{' '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 192, '"acting":' 192, '"num_store_stats":' 0 '},' '"osd_sum":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 192, '"num_osds":' 3, '"num_per_pool_osds":' 3, '"num_per_pool_omap_osds":' 3, '"kb":' 314572800, '"kb_used":' 81232, '"kb_used_data":' 696, '"kb_used_omap":' 4, '"kb_used_meta":' 80443, '"kb_avail":' 314491568, '"statfs":' '{' '"total":' 322122547200, '"available":' 322039365632, '"internally_reserved":' 0, '"allocated":' 712704, '"data_stored":' 209643, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 4785, '"internal_metadata":' 82373967 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 0, '"apply_latency_ms":' 0, '"commit_latency_ns":' 0, '"apply_latency_ns":' 0 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '},' '"osd_sum_by_class":' '{' '"hdd":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 192, '"num_osds":' 3, '"num_per_pool_osds":' 3, '"num_per_pool_omap_osds":' 3, '"kb":' 314572800, '"kb_used":' 81232, '"kb_used_data":' 696, '"kb_used_omap":' 4, '"kb_used_meta":' 80443, '"kb_avail":' 314491568, '"statfs":' '{' '"total":' 322122547200, '"available":' 322039365632, '"internally_reserved":' 0, '"allocated":' 712704, '"data_stored":' 209643, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 4785, '"internal_metadata":' 82373967 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 0, '"apply_latency_ms":' 0, '"commit_latency_ns":' 0, '"apply_latency_ns":' 0 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '}' '},' '"pool_stats":' '[' '{' '"poolid":' 2, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 96, '"acting":' 96, '"num_store_stats":' 3 '},' '{' '"poolid":' 1, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 96, '"acting":' 96, '"num_store_stats":' 3 '}' '],' '"osd_stats":' '[' '{' '"osd":' 0, '"seq":' 21474836506 '},' '{' '"osd":' 1, '"seq":' 42949672978 '},' '{' '"osd":' 2, '"seq":' 64424509450 '}' '],' '"num_pg_by_state":' '[' '{' '"state":' '"active+clean",' '"num":' 64 '}' '],' '"num_pg_by_osd":' '[' '{' '"osd":' 2, '"num_primary_pg":' 15, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 0, '"num_primary_pg":' 20, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 1, '"num_primary_pg":' 29, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '}' '],' '"purged_snaps":' '[' '{' '"pool":' 1, '"purged_snaps":' '{}' '},' '{' '"pool":' 2, '"purged_snaps":' '{}' '}' '],' '"servicemap":' '{' '"epoch":' 4, '"modified":' '"2024-09-16T03:25:02.412573+0000",' '"services":' '{' '"osd":' '{' '"daemons":' '{' '"summary":' '"",' '"2":' '{' '"start_epoch":' 0, '"start_stamp":' '"0.000000",' '"gid":' 0, '"addr":' '"(unrecognized' address family '0)/0",' '"metadata":' '{},' '"task_status":' '{}' '}' '}' '}' '}' '},' '"mgrstat_first_committed":' 52, '"mgrstat_last_committed":' 57, '"logm_first_committed":' 1, '"logm_last_committed":' 248, '"paxos":' '{' '"first_committed":' 1, '"last_committed":' 345, '"last_pn":' 0, '"accepted_pn":' 0 '}' '}' 2024-09-16T03:25:04.048 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:134: get_fc_lc_diff: osdm_lc=28 2024-09-16T03:25:04.048 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:136: get_fc_lc_diff: echo 2 2024-09-16T03:25:04.048 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:207: TEST_mon_last_clean_epoch: post_map_diff=2 2024-09-16T03:25:04.048 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:209: TEST_mon_last_clean_epoch: [[ 2 -le 27 ]] 2024-09-16T03:25:04.048 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:211: TEST_mon_last_clean_epoch: pre_map_diff=2 2024-09-16T03:25:04.049 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:213: TEST_mon_last_clean_epoch: ceph osd pool set foo size 3 2024-09-16T03:25:04.688 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 1 size to 3 2024-09-16T03:25:04.713 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:214: TEST_mon_last_clean_epoch: ceph osd pool set bar size 3 2024-09-16T03:25:05.492 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 2 size to 3 2024-09-16T03:25:05.512 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:216: TEST_mon_last_clean_epoch: wait_for_health_ok 2024-09-16T03:25:05.512 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1809: wait_for_health_ok: wait_for_health HEALTH_OK 2024-09-16T03:25:05.512 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1788: wait_for_health: local grepstr=HEALTH_OK 2024-09-16T03:25:05.512 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1789: wait_for_health: get_timeout_delays 300 .1 2024-09-16T03:25:05.513 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: shopt -q -o xtrace 2024-09-16T03:25:05.513 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: echo true 2024-09-16T03:25:05.514 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: local trace=true 2024-09-16T03:25:05.514 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: true 2024-09-16T03:25:05.514 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: shopt -u -o xtrace 2024-09-16T03:25:05.743 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1789: wait_for_health: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '4.5') 2024-09-16T03:25:05.743 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1789: wait_for_health: local -a delays 2024-09-16T03:25:05.743 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1790: wait_for_health: local -i loop=0 2024-09-16T03:25:05.743 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1792: wait_for_health: ceph health detail 2024-09-16T03:25:05.743 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1792: wait_for_health: grep HEALTH_OK 2024-09-16T03:25:06.364 INFO:tasks.workunit.client.0.smithi096.stdout:HEALTH_OK 2024-09-16T03:25:06.364 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:218: TEST_mon_last_clean_epoch: check_lec_equals_pools 2024-09-16T03:25:06.364 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:26: check_lec_equals_pools: local pool_id= 2024-09-16T03:25:06.365 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:28: check_lec_equals_pools: ceph report 2024-09-16T03:25:06.992 INFO:tasks.workunit.client.0.smithi096.stderr:report 3199671631 2024-09-16T03:25:07.010 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:28: check_lec_equals_pools: report='{ 2024-09-16T03:25:07.010 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_fingerprint": "fda2fc64-07ed-4add-8224-2e527e11d427", 2024-09-16T03:25:07.010 INFO:tasks.workunit.client.0.smithi096.stderr: "version": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:25:07.010 INFO:tasks.workunit.client.0.smithi096.stderr: "commit": "fc3e0bff7468fd55478adbae7f75508b749124b6", 2024-09-16T03:25:07.010 INFO:tasks.workunit.client.0.smithi096.stderr: "timestamp": "2024-09-16T03:25:06.993636+0000", 2024-09-16T03:25:07.010 INFO:tasks.workunit.client.0.smithi096.stderr: "tag": "", 2024-09-16T03:25:07.010 INFO:tasks.workunit.client.0.smithi096.stderr: "health": { 2024-09-16T03:25:07.010 INFO:tasks.workunit.client.0.smithi096.stderr: "status": "HEALTH_OK", 2024-09-16T03:25:07.011 INFO:tasks.workunit.client.0.smithi096.stderr: "checks": {}, 2024-09-16T03:25:07.011 INFO:tasks.workunit.client.0.smithi096.stderr: "mutes": [] 2024-09-16T03:25:07.011 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.011 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap_first_committed": 1, 2024-09-16T03:25:07.011 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap_last_committed": 1, 2024-09-16T03:25:07.011 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap": { 2024-09-16T03:25:07.011 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 1, 2024-09-16T03:25:07.011 INFO:tasks.workunit.client.0.smithi096.stderr: "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", 2024-09-16T03:25:07.011 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:22:45.872880Z", 2024-09-16T03:25:07.011 INFO:tasks.workunit.client.0.smithi096.stderr: "created": "2024-09-16T03:22:45.872880Z", 2024-09-16T03:25:07.011 INFO:tasks.workunit.client.0.smithi096.stderr: "min_mon_release": 19, 2024-09-16T03:25:07.011 INFO:tasks.workunit.client.0.smithi096.stderr: "min_mon_release_name": "squid", 2024-09-16T03:25:07.011 INFO:tasks.workunit.client.0.smithi096.stderr: "election_strategy": 1, 2024-09-16T03:25:07.012 INFO:tasks.workunit.client.0.smithi096.stderr: "disallowed_leaders: ": "", 2024-09-16T03:25:07.012 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode": false, 2024-09-16T03:25:07.012 INFO:tasks.workunit.client.0.smithi096.stderr: "tiebreaker_mon": "", 2024-09-16T03:25:07.012 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_ranks: ": "", 2024-09-16T03:25:07.012 INFO:tasks.workunit.client.0.smithi096.stderr: "features": { 2024-09-16T03:25:07.012 INFO:tasks.workunit.client.0.smithi096.stderr: "persistent": [ 2024-09-16T03:25:07.012 INFO:tasks.workunit.client.0.smithi096.stderr: "kraken", 2024-09-16T03:25:07.012 INFO:tasks.workunit.client.0.smithi096.stderr: "luminous", 2024-09-16T03:25:07.012 INFO:tasks.workunit.client.0.smithi096.stderr: "mimic", 2024-09-16T03:25:07.012 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap-prune", 2024-09-16T03:25:07.012 INFO:tasks.workunit.client.0.smithi096.stderr: "nautilus", 2024-09-16T03:25:07.012 INFO:tasks.workunit.client.0.smithi096.stderr: "octopus", 2024-09-16T03:25:07.012 INFO:tasks.workunit.client.0.smithi096.stderr: "pacific", 2024-09-16T03:25:07.012 INFO:tasks.workunit.client.0.smithi096.stderr: "elector-pinging", 2024-09-16T03:25:07.013 INFO:tasks.workunit.client.0.smithi096.stderr: "quincy", 2024-09-16T03:25:07.013 INFO:tasks.workunit.client.0.smithi096.stderr: "reef", 2024-09-16T03:25:07.013 INFO:tasks.workunit.client.0.smithi096.stderr: "squid" 2024-09-16T03:25:07.013 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:07.013 INFO:tasks.workunit.client.0.smithi096.stderr: "optional": [] 2024-09-16T03:25:07.013 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.013 INFO:tasks.workunit.client.0.smithi096.stderr: "mons": [ 2024-09-16T03:25:07.013 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.013 INFO:tasks.workunit.client.0.smithi096.stderr: "rank": 0, 2024-09-16T03:25:07.013 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "a", 2024-09-16T03:25:07.013 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:25:07.013 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:07.013 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.013 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:07.014 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:7302", 2024-09-16T03:25:07.014 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 0 2024-09-16T03:25:07.014 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.014 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:07.014 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.014 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:7302/0", 2024-09-16T03:25:07.014 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:7302/0", 2024-09-16T03:25:07.014 INFO:tasks.workunit.client.0.smithi096.stderr: "priority": 0, 2024-09-16T03:25:07.014 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 0, 2024-09-16T03:25:07.014 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_location": "{}" 2024-09-16T03:25:07.014 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.014 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:07.014 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.015 INFO:tasks.workunit.client.0.smithi096.stderr: "quorum": [ 2024-09-16T03:25:07.015 INFO:tasks.workunit.client.0.smithi096.stderr: 0 2024-09-16T03:25:07.015 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:07.015 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap": { 2024-09-16T03:25:07.015 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 32, 2024-09-16T03:25:07.015 INFO:tasks.workunit.client.0.smithi096.stderr: "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", 2024-09-16T03:25:07.015 INFO:tasks.workunit.client.0.smithi096.stderr: "created": "2024-09-16T03:22:46.906117+0000", 2024-09-16T03:25:07.015 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:25:05.447882+0000", 2024-09-16T03:25:07.015 INFO:tasks.workunit.client.0.smithi096.stderr: "last_up_change": "2024-09-16T03:24:37.708512+0000", 2024-09-16T03:25:07.015 INFO:tasks.workunit.client.0.smithi096.stderr: "last_in_change": "2024-09-16T03:24:01.831039+0000", 2024-09-16T03:25:07.015 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-16T03:25:07.015 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_num": 5799936, 2024-09-16T03:25:07.015 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_set": [ 2024-09-16T03:25:07.015 INFO:tasks.workunit.client.0.smithi096.stderr: "pglog_hardlimit", 2024-09-16T03:25:07.015 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snapdirs", 2024-09-16T03:25:07.016 INFO:tasks.workunit.client.0.smithi096.stderr: "recovery_deletes", 2024-09-16T03:25:07.016 INFO:tasks.workunit.client.0.smithi096.stderr: "sortbitwise" 2024-09-16T03:25:07.016 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:07.016 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_version": 7, 2024-09-16T03:25:07.016 INFO:tasks.workunit.client.0.smithi096.stderr: "full_ratio": 0.97000002861022949, 2024-09-16T03:25:07.016 INFO:tasks.workunit.client.0.smithi096.stderr: "backfillfull_ratio": 0.97000002861022949, 2024-09-16T03:25:07.016 INFO:tasks.workunit.client.0.smithi096.stderr: "nearfull_ratio": 0.85000002384185791, 2024-09-16T03:25:07.016 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_snapshot": "", 2024-09-16T03:25:07.016 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_max": 2, 2024-09-16T03:25:07.016 INFO:tasks.workunit.client.0.smithi096.stderr: "max_osd": 3, 2024-09-16T03:25:07.016 INFO:tasks.workunit.client.0.smithi096.stderr: "require_min_compat_client": "luminous", 2024-09-16T03:25:07.016 INFO:tasks.workunit.client.0.smithi096.stderr: "min_compat_client": "jewel", 2024-09-16T03:25:07.016 INFO:tasks.workunit.client.0.smithi096.stderr: "require_osd_release": "squid", 2024-09-16T03:25:07.017 INFO:tasks.workunit.client.0.smithi096.stderr: "allow_crimson": false, 2024-09-16T03:25:07.017 INFO:tasks.workunit.client.0.smithi096.stderr: "pools": [ 2024-09-16T03:25:07.017 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.017 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 1, 2024-09-16T03:25:07.017 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_name": "foo", 2024-09-16T03:25:07.017 INFO:tasks.workunit.client.0.smithi096.stderr: "create_time": "2024-09-16T03:24:44.525189+0000", 2024-09-16T03:25:07.017 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": 1, 2024-09-16T03:25:07.017 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_names": "hashpspool", 2024-09-16T03:25:07.017 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:25:07.017 INFO:tasks.workunit.client.0.smithi096.stderr: "size": 3, 2024-09-16T03:25:07.017 INFO:tasks.workunit.client.0.smithi096.stderr: "min_size": 2, 2024-09-16T03:25:07.017 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_rule": 0, 2024-09-16T03:25:07.017 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_count": 0, 2024-09-16T03:25:07.018 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_target": 0, 2024-09-16T03:25:07.018 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_barrier": 0, 2024-09-16T03:25:07.018 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-16T03:25:07.018 INFO:tasks.workunit.client.0.smithi096.stderr: "is_stretch_pool": false, 2024-09-16T03:25:07.018 INFO:tasks.workunit.client.0.smithi096.stderr: "object_hash": 2, 2024-09-16T03:25:07.018 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_autoscale_mode": "off", 2024-09-16T03:25:07.018 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num": 32, 2024-09-16T03:25:07.018 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num": 32, 2024-09-16T03:25:07.018 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num_target": 32, 2024-09-16T03:25:07.018 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_target": 32, 2024-09-16T03:25:07.018 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_pending": 32, 2024-09-16T03:25:07.019 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pg_merge_meta": { 2024-09-16T03:25:07.019 INFO:tasks.workunit.client.0.smithi096.stderr: "source_pgid": "0.0", 2024-09-16T03:25:07.019 INFO:tasks.workunit.client.0.smithi096.stderr: "ready_epoch": 0, 2024-09-16T03:25:07.019 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_started": 0, 2024-09-16T03:25:07.019 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": 0, 2024-09-16T03:25:07.019 INFO:tasks.workunit.client.0.smithi096.stderr: "source_version": "0'\''0", 2024-09-16T03:25:07.019 INFO:tasks.workunit.client.0.smithi096.stderr: "target_version": "0'\''0" 2024-09-16T03:25:07.019 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.019 INFO:tasks.workunit.client.0.smithi096.stderr: "last_change": "30", 2024-09-16T03:25:07.019 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend": "0", 2024-09-16T03:25:07.019 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_prenautilus": "0", 2024-09-16T03:25:07.019 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_preluminous": "0", 2024-09-16T03:25:07.019 INFO:tasks.workunit.client.0.smithi096.stderr: "auid": 0, 2024-09-16T03:25:07.020 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_mode": "selfmanaged", 2024-09-16T03:25:07.020 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_seq": 0, 2024-09-16T03:25:07.020 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_epoch": 0, 2024-09-16T03:25:07.020 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_snaps": [], 2024-09-16T03:25:07.020 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps": "[]", 2024-09-16T03:25:07.020 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_bytes": 0, 2024-09-16T03:25:07.020 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_objects": 0, 2024-09-16T03:25:07.020 INFO:tasks.workunit.client.0.smithi096.stderr: "tiers": [], 2024-09-16T03:25:07.020 INFO:tasks.workunit.client.0.smithi096.stderr: "tier_of": -1, 2024-09-16T03:25:07.020 INFO:tasks.workunit.client.0.smithi096.stderr: "read_tier": -1, 2024-09-16T03:25:07.020 INFO:tasks.workunit.client.0.smithi096.stderr: "write_tier": -1, 2024-09-16T03:25:07.020 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_mode": "none", 2024-09-16T03:25:07.020 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_bytes": 0, 2024-09-16T03:25:07.020 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_objects": 0, 2024-09-16T03:25:07.021 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_ratio_micro": 400000, 2024-09-16T03:25:07.021 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-16T03:25:07.021 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_full_ratio_micro": 800000, 2024-09-16T03:25:07.021 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_flush_age": 0, 2024-09-16T03:25:07.021 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_evict_age": 0, 2024-09-16T03:25:07.021 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profile": "", 2024-09-16T03:25:07.021 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_params": { 2024-09-16T03:25:07.021 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "none" 2024-09-16T03:25:07.021 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.021 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_period": 0, 2024-09-16T03:25:07.021 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_count": 0, 2024-09-16T03:25:07.021 INFO:tasks.workunit.client.0.smithi096.stderr: "use_gmt_hitset": true, 2024-09-16T03:25:07.021 INFO:tasks.workunit.client.0.smithi096.stderr: "min_read_recency_for_promote": 0, 2024-09-16T03:25:07.021 INFO:tasks.workunit.client.0.smithi096.stderr: "min_write_recency_for_promote": 0, 2024-09-16T03:25:07.022 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_grade_decay_rate": 0, 2024-09-16T03:25:07.022 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_search_last_n": 0, 2024-09-16T03:25:07.022 INFO:tasks.workunit.client.0.smithi096.stderr: "grade_table": [], 2024-09-16T03:25:07.022 INFO:tasks.workunit.client.0.smithi096.stderr: "stripe_width": 0, 2024-09-16T03:25:07.022 INFO:tasks.workunit.client.0.smithi096.stderr: "expected_num_objects": 0, 2024-09-16T03:25:07.022 INFO:tasks.workunit.client.0.smithi096.stderr: "fast_read": false, 2024-09-16T03:25:07.022 INFO:tasks.workunit.client.0.smithi096.stderr: "options": {}, 2024-09-16T03:25:07.022 INFO:tasks.workunit.client.0.smithi096.stderr: "application_metadata": {}, 2024-09-16T03:25:07.022 INFO:tasks.workunit.client.0.smithi096.stderr: "read_balance": { 2024-09-16T03:25:07.022 INFO:tasks.workunit.client.0.smithi096.stderr: "score_type": "Fair distribution", 2024-09-16T03:25:07.022 INFO:tasks.workunit.client.0.smithi096.stderr: "score_acting": 1.690000057220459, 2024-09-16T03:25:07.022 INFO:tasks.workunit.client.0.smithi096.stderr: "score_stable": 1.690000057220459, 2024-09-16T03:25:07.022 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_score": 1, 2024-09-16T03:25:07.023 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_acting": 1.690000057220459, 2024-09-16T03:25:07.023 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_stable": 1.690000057220459, 2024-09-16T03:25:07.023 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity_weighted": 1, 2024-09-16T03:25:07.023 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity": 1, 2024-09-16T03:25:07.023 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity_weighted": 1 2024-09-16T03:25:07.023 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.023 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.023 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.023 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 2, 2024-09-16T03:25:07.023 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_name": "bar", 2024-09-16T03:25:07.023 INFO:tasks.workunit.client.0.smithi096.stderr: "create_time": "2024-09-16T03:24:46.226575+0000", 2024-09-16T03:25:07.023 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": 1, 2024-09-16T03:25:07.023 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_names": "hashpspool", 2024-09-16T03:25:07.024 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:25:07.024 INFO:tasks.workunit.client.0.smithi096.stderr: "size": 3, 2024-09-16T03:25:07.024 INFO:tasks.workunit.client.0.smithi096.stderr: "min_size": 2, 2024-09-16T03:25:07.024 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_rule": 0, 2024-09-16T03:25:07.024 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_count": 0, 2024-09-16T03:25:07.024 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_target": 0, 2024-09-16T03:25:07.024 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_barrier": 0, 2024-09-16T03:25:07.024 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-16T03:25:07.024 INFO:tasks.workunit.client.0.smithi096.stderr: "is_stretch_pool": false, 2024-09-16T03:25:07.024 INFO:tasks.workunit.client.0.smithi096.stderr: "object_hash": 2, 2024-09-16T03:25:07.024 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_autoscale_mode": "off", 2024-09-16T03:25:07.024 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num": 32, 2024-09-16T03:25:07.025 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num": 32, 2024-09-16T03:25:07.025 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num_target": 32, 2024-09-16T03:25:07.025 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_target": 32, 2024-09-16T03:25:07.025 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_pending": 32, 2024-09-16T03:25:07.025 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pg_merge_meta": { 2024-09-16T03:25:07.025 INFO:tasks.workunit.client.0.smithi096.stderr: "source_pgid": "0.0", 2024-09-16T03:25:07.025 INFO:tasks.workunit.client.0.smithi096.stderr: "ready_epoch": 0, 2024-09-16T03:25:07.025 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_started": 0, 2024-09-16T03:25:07.025 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": 0, 2024-09-16T03:25:07.025 INFO:tasks.workunit.client.0.smithi096.stderr: "source_version": "0'\''0", 2024-09-16T03:25:07.025 INFO:tasks.workunit.client.0.smithi096.stderr: "target_version": "0'\''0" 2024-09-16T03:25:07.025 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.025 INFO:tasks.workunit.client.0.smithi096.stderr: "last_change": "32", 2024-09-16T03:25:07.026 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend": "0", 2024-09-16T03:25:07.026 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_prenautilus": "0", 2024-09-16T03:25:07.026 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_preluminous": "0", 2024-09-16T03:25:07.026 INFO:tasks.workunit.client.0.smithi096.stderr: "auid": 0, 2024-09-16T03:25:07.026 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_mode": "selfmanaged", 2024-09-16T03:25:07.026 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_seq": 0, 2024-09-16T03:25:07.026 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_epoch": 0, 2024-09-16T03:25:07.026 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_snaps": [], 2024-09-16T03:25:07.026 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps": "[]", 2024-09-16T03:25:07.026 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_bytes": 0, 2024-09-16T03:25:07.026 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_objects": 0, 2024-09-16T03:25:07.026 INFO:tasks.workunit.client.0.smithi096.stderr: "tiers": [], 2024-09-16T03:25:07.026 INFO:tasks.workunit.client.0.smithi096.stderr: "tier_of": -1, 2024-09-16T03:25:07.026 INFO:tasks.workunit.client.0.smithi096.stderr: "read_tier": -1, 2024-09-16T03:25:07.027 INFO:tasks.workunit.client.0.smithi096.stderr: "write_tier": -1, 2024-09-16T03:25:07.027 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_mode": "none", 2024-09-16T03:25:07.027 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_bytes": 0, 2024-09-16T03:25:07.027 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_objects": 0, 2024-09-16T03:25:07.027 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_ratio_micro": 400000, 2024-09-16T03:25:07.027 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-16T03:25:07.027 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_full_ratio_micro": 800000, 2024-09-16T03:25:07.027 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_flush_age": 0, 2024-09-16T03:25:07.027 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_evict_age": 0, 2024-09-16T03:25:07.027 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profile": "", 2024-09-16T03:25:07.027 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_params": { 2024-09-16T03:25:07.027 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "none" 2024-09-16T03:25:07.027 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.028 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_period": 0, 2024-09-16T03:25:07.028 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_count": 0, 2024-09-16T03:25:07.028 INFO:tasks.workunit.client.0.smithi096.stderr: "use_gmt_hitset": true, 2024-09-16T03:25:07.028 INFO:tasks.workunit.client.0.smithi096.stderr: "min_read_recency_for_promote": 0, 2024-09-16T03:25:07.028 INFO:tasks.workunit.client.0.smithi096.stderr: "min_write_recency_for_promote": 0, 2024-09-16T03:25:07.028 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_grade_decay_rate": 0, 2024-09-16T03:25:07.028 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_search_last_n": 0, 2024-09-16T03:25:07.028 INFO:tasks.workunit.client.0.smithi096.stderr: "grade_table": [], 2024-09-16T03:25:07.028 INFO:tasks.workunit.client.0.smithi096.stderr: "stripe_width": 0, 2024-09-16T03:25:07.029 INFO:tasks.workunit.client.0.smithi096.stderr: "expected_num_objects": 0, 2024-09-16T03:25:07.029 INFO:tasks.workunit.client.0.smithi096.stderr: "fast_read": false, 2024-09-16T03:25:07.029 INFO:tasks.workunit.client.0.smithi096.stderr: "options": {}, 2024-09-16T03:25:07.029 INFO:tasks.workunit.client.0.smithi096.stderr: "application_metadata": {}, 2024-09-16T03:25:07.029 INFO:tasks.workunit.client.0.smithi096.stderr: "read_balance": { 2024-09-16T03:25:07.029 INFO:tasks.workunit.client.0.smithi096.stderr: "score_type": "Fair distribution", 2024-09-16T03:25:07.029 INFO:tasks.workunit.client.0.smithi096.stderr: "score_acting": 1.1299999952316284, 2024-09-16T03:25:07.029 INFO:tasks.workunit.client.0.smithi096.stderr: "score_stable": 1.1299999952316284, 2024-09-16T03:25:07.029 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_score": 1, 2024-09-16T03:25:07.029 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_acting": 1.1299999952316284, 2024-09-16T03:25:07.029 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_stable": 1.1299999952316284, 2024-09-16T03:25:07.029 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity_weighted": 1, 2024-09-16T03:25:07.029 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity": 1, 2024-09-16T03:25:07.029 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity_weighted": 1 2024-09-16T03:25:07.029 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.030 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.030 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:07.030 INFO:tasks.workunit.client.0.smithi096.stderr: "osds": [ 2024-09-16T03:25:07.030 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.030 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:25:07.030 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6", 2024-09-16T03:25:07.030 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:25:07.030 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:25:07.030 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:25:07.030 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:25:07.030 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:25:07.030 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:25:07.030 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 5, 2024-09-16T03:25:07.030 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 21, 2024-09-16T03:25:07.031 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:25:07.031 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:25:07.031 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:25:07.031 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:07.031 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.031 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:07.031 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6802", 2024-09-16T03:25:07.031 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:07.031 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.031 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.031 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:07.031 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6803", 2024-09-16T03:25:07.031 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:07.031 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.032 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:07.032 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.032 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:25:07.032 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:07.032 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.032 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:07.032 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6804", 2024-09-16T03:25:07.032 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:07.032 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.032 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.032 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:07.032 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6805", 2024-09-16T03:25:07.032 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:07.033 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.033 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:07.033 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.033 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:25:07.033 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:07.033 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.033 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:07.033 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6808", 2024-09-16T03:25:07.033 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:07.033 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.033 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.033 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:07.033 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6809", 2024-09-16T03:25:07.034 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:07.034 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.034 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:07.034 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.034 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:25:07.034 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:07.034 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.034 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:07.034 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6806", 2024-09-16T03:25:07.034 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:07.034 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.034 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.034 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:07.034 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6807", 2024-09-16T03:25:07.035 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:07.035 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.035 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:07.035 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.035 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6803/3375787448", 2024-09-16T03:25:07.035 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6805/3375787448", 2024-09-16T03:25:07.035 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6809/3375787448", 2024-09-16T03:25:07.035 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6807/3375787448", 2024-09-16T03:25:07.035 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:25:07.035 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:25:07.035 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:25:07.035 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:07.035 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.036 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.036 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:25:07.036 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "74b26727-75c9-444d-8782-719e4197a382", 2024-09-16T03:25:07.036 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:25:07.036 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:25:07.036 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:25:07.036 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:25:07.036 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:25:07.036 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:25:07.036 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 10, 2024-09-16T03:25:07.036 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 21, 2024-09-16T03:25:07.036 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:25:07.036 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:25:07.037 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:25:07.037 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:07.037 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.037 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:07.037 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6810", 2024-09-16T03:25:07.037 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:07.037 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.037 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.037 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:07.037 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6811", 2024-09-16T03:25:07.037 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:07.037 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.037 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:07.038 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.038 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:25:07.038 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:07.038 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.038 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:07.038 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6812", 2024-09-16T03:25:07.038 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:07.038 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.038 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.038 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:07.038 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6813", 2024-09-16T03:25:07.039 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:07.039 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.039 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:07.039 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.039 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:25:07.039 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:07.039 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.039 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:07.039 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6816", 2024-09-16T03:25:07.039 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:07.039 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.039 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.039 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:07.039 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6817", 2024-09-16T03:25:07.040 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:07.040 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.040 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:07.040 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.040 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:25:07.040 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:07.040 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.040 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:07.040 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6814", 2024-09-16T03:25:07.040 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:07.040 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.040 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.040 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:07.040 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6815", 2024-09-16T03:25:07.041 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:07.041 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.041 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:07.041 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.041 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6811/3733255132", 2024-09-16T03:25:07.041 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6813/3733255132", 2024-09-16T03:25:07.041 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6817/3733255132", 2024-09-16T03:25:07.041 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6815/3733255132", 2024-09-16T03:25:07.041 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:25:07.041 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:25:07.041 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:25:07.041 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:07.041 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.041 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.042 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:25:07.042 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "143da3a7-dad9-4b1e-966b-76cf5bdd3c82", 2024-09-16T03:25:07.042 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:25:07.042 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:25:07.042 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:25:07.042 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:25:07.042 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:25:07.042 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:25:07.042 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 15, 2024-09-16T03:25:07.042 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 21, 2024-09-16T03:25:07.042 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:25:07.042 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:25:07.042 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:25:07.042 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:07.043 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.043 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:07.043 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6818", 2024-09-16T03:25:07.043 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:07.043 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.043 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.043 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:07.043 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6819", 2024-09-16T03:25:07.043 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:07.043 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.043 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:07.043 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.043 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:25:07.043 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:07.044 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.044 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:07.044 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6820", 2024-09-16T03:25:07.044 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:07.044 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.044 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.044 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:07.044 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6821", 2024-09-16T03:25:07.044 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:07.044 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.044 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:07.044 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.044 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:25:07.044 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:07.045 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.045 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:07.045 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6824", 2024-09-16T03:25:07.045 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:07.045 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.045 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.045 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:07.045 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6825", 2024-09-16T03:25:07.045 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:07.045 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.045 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:07.045 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.045 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:25:07.046 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:07.046 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.046 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:07.046 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6822", 2024-09-16T03:25:07.046 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:07.046 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.046 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.046 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:07.046 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6823", 2024-09-16T03:25:07.046 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:07.046 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.046 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:07.046 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.046 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6819/963814857", 2024-09-16T03:25:07.046 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6821/963814857", 2024-09-16T03:25:07.047 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6825/963814857", 2024-09-16T03:25:07.047 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6823/963814857", 2024-09-16T03:25:07.047 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:25:07.047 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:25:07.047 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:25:07.047 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:07.047 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.047 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:07.047 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_xinfo": [ 2024-09-16T03:25:07.047 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.047 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:25:07.047 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:25:07.047 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:25:07.047 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:25:07.048 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:25:07.048 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:25:07.048 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:23:22.481942+0000", 2024-09-16T03:25:07.048 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:25:07.048 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.048 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.048 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:25:07.048 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:25:07.048 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:25:07.048 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:25:07.048 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:25:07.048 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:25:07.048 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:23:59.663703+0000", 2024-09-16T03:25:07.049 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:25:07.049 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.049 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.049 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:25:07.049 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:25:07.049 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:25:07.049 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:25:07.049 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:25:07.049 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:25:07.049 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:24:37.320822+0000", 2024-09-16T03:25:07.049 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:25:07.049 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.049 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:07.049 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap": [], 2024-09-16T03:25:07.049 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap_items": [], 2024-09-16T03:25:07.050 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap_primaries": [], 2024-09-16T03:25:07.050 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_temp": [], 2024-09-16T03:25:07.050 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_temp": [], 2024-09-16T03:25:07.050 INFO:tasks.workunit.client.0.smithi096.stderr: "blocklist": {}, 2024-09-16T03:25:07.050 INFO:tasks.workunit.client.0.smithi096.stderr: "range_blocklist": {}, 2024-09-16T03:25:07.050 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profiles": { 2024-09-16T03:25:07.050 INFO:tasks.workunit.client.0.smithi096.stderr: "default": { 2024-09-16T03:25:07.050 INFO:tasks.workunit.client.0.smithi096.stderr: "k": "2", 2024-09-16T03:25:07.050 INFO:tasks.workunit.client.0.smithi096.stderr: "m": "2", 2024-09-16T03:25:07.050 INFO:tasks.workunit.client.0.smithi096.stderr: "plugin": "jerasure", 2024-09-16T03:25:07.050 INFO:tasks.workunit.client.0.smithi096.stderr: "technique": "reed_sol_van" 2024-09-16T03:25:07.050 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.050 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.050 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps_queue": [], 2024-09-16T03:25:07.051 INFO:tasks.workunit.client.0.smithi096.stderr: "new_removed_snaps": [], 2024-09-16T03:25:07.051 INFO:tasks.workunit.client.0.smithi096.stderr: "new_purged_snaps": [], 2024-09-16T03:25:07.051 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_node_flags": {}, 2024-09-16T03:25:07.051 INFO:tasks.workunit.client.0.smithi096.stderr: "device_class_flags": {}, 2024-09-16T03:25:07.051 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode": { 2024-09-16T03:25:07.051 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode_enabled": false, 2024-09-16T03:25:07.051 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_bucket_count": 0, 2024-09-16T03:25:07.051 INFO:tasks.workunit.client.0.smithi096.stderr: "degraded_stretch_mode": 0, 2024-09-16T03:25:07.051 INFO:tasks.workunit.client.0.smithi096.stderr: "recovering_stretch_mode": 0, 2024-09-16T03:25:07.051 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode_bucket": 0 2024-09-16T03:25:07.051 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.051 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.051 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_metadata": [ 2024-09-16T03:25:07.051 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.051 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:25:07.052 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:25:07.052 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]", 2024-09-16T03:25:07.052 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:25:07.052 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:25:07.052 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:25:07.052 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:25:07.052 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:25:07.052 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:25:07.052 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:25:07.052 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:25:07.052 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:25:07.052 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:25:07.052 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:25:07.053 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/0/block", 2024-09-16T03:25:07.053 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:25:07.053 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:25:07.053 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:25:07.053 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:25:07.053 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:25:07.053 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:25:07.053 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:25:07.053 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:25:07.053 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:25:07.053 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:25:07.053 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:22:53.662571Z", 2024-09-16T03:25:07.053 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:25:07.053 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:25:07.054 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:25:07.054 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:25:07.054 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:25:07.054 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:25:07.054 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:25:07.054 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]", 2024-09-16T03:25:07.054 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:25:07.054 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]", 2024-09-16T03:25:07.054 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]", 2024-09-16T03:25:07.054 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:25:07.054 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:25:07.054 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:25:07.054 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:25:07.054 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:25:07.054 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:25:07.055 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:25:07.055 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:25:07.055 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:25:07.055 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/0", 2024-09-16T03:25:07.055 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:25:07.055 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:25:07.055 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:25:07.055 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.055 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.055 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:25:07.055 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:25:07.055 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]", 2024-09-16T03:25:07.055 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:25:07.055 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:25:07.056 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:25:07.056 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:25:07.056 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:25:07.056 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:25:07.056 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:25:07.056 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:25:07.056 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:25:07.056 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:25:07.056 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:25:07.056 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/1/block", 2024-09-16T03:25:07.056 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:25:07.056 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:25:07.056 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:25:07.057 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:25:07.057 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:25:07.057 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:25:07.057 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:25:07.057 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:25:07.057 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:25:07.057 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:25:07.057 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:23:30.129885Z", 2024-09-16T03:25:07.057 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:25:07.057 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:25:07.057 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:25:07.057 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:25:07.057 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:25:07.058 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:25:07.058 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:25:07.058 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]", 2024-09-16T03:25:07.058 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:25:07.058 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]", 2024-09-16T03:25:07.058 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]", 2024-09-16T03:25:07.058 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:25:07.058 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:25:07.058 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:25:07.058 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:25:07.058 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:25:07.058 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:25:07.058 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:25:07.059 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:25:07.059 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:25:07.059 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/1", 2024-09-16T03:25:07.059 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:25:07.059 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:25:07.059 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:25:07.059 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.059 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.059 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:25:07.059 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:25:07.059 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]", 2024-09-16T03:25:07.059 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:25:07.059 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:25:07.060 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:25:07.060 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:25:07.060 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:25:07.060 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:25:07.060 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:25:07.060 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:25:07.060 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:25:07.060 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:25:07.060 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:25:07.060 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/2/block", 2024-09-16T03:25:07.060 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:25:07.060 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:25:07.060 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:25:07.061 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:25:07.061 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:25:07.061 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:25:07.061 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:25:07.061 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:25:07.061 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:25:07.061 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:25:07.061 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:24:07.764502Z", 2024-09-16T03:25:07.061 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:25:07.061 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:25:07.061 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:25:07.061 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:25:07.061 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:25:07.061 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:25:07.062 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:25:07.062 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]", 2024-09-16T03:25:07.062 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:25:07.062 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]", 2024-09-16T03:25:07.062 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]", 2024-09-16T03:25:07.062 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:25:07.062 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:25:07.062 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:25:07.062 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:25:07.062 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:25:07.062 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:25:07.062 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:25:07.062 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:25:07.062 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:25:07.063 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/2", 2024-09-16T03:25:07.063 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:25:07.063 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:25:07.063 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:25:07.063 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.063 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:07.063 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_clean_epochs": { 2024-09-16T03:25:07.063 INFO:tasks.workunit.client.0.smithi096.stderr: "min_last_epoch_clean": 28, 2024-09-16T03:25:07.063 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": { 2024-09-16T03:25:07.063 INFO:tasks.workunit.client.0.smithi096.stderr: "per_pool": [ 2024-09-16T03:25:07.063 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.063 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 1, 2024-09-16T03:25:07.063 INFO:tasks.workunit.client.0.smithi096.stderr: "floor": 28 2024-09-16T03:25:07.064 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.064 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.064 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 2, 2024-09-16T03:25:07.064 INFO:tasks.workunit.client.0.smithi096.stderr: "floor": 28 2024-09-16T03:25:07.064 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.064 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:07.064 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.064 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_epochs": [ 2024-09-16T03:25:07.064 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.064 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:25:07.064 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 28 2024-09-16T03:25:07.064 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.064 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.064 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:25:07.065 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 28 2024-09-16T03:25:07.065 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.065 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.065 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:25:07.065 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 28 2024-09-16T03:25:07.065 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.065 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:07.065 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.065 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_first_committed": 26, 2024-09-16T03:25:07.065 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_last_committed": 32, 2024-09-16T03:25:07.065 INFO:tasks.workunit.client.0.smithi096.stderr: "crushmap": { 2024-09-16T03:25:07.065 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": [ 2024-09-16T03:25:07.065 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.065 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:25:07.066 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.0", 2024-09-16T03:25:07.066 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:25:07.066 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.066 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.066 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:25:07.066 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.1", 2024-09-16T03:25:07.066 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:25:07.066 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.066 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.066 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:25:07.066 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.2", 2024-09-16T03:25:07.066 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:25:07.066 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.066 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:07.067 INFO:tasks.workunit.client.0.smithi096.stderr: "types": [ 2024-09-16T03:25:07.067 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.067 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 0, 2024-09-16T03:25:07.067 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd" 2024-09-16T03:25:07.067 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.067 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.067 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:25:07.067 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "host" 2024-09-16T03:25:07.067 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.067 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.067 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 2, 2024-09-16T03:25:07.067 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "chassis" 2024-09-16T03:25:07.067 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.067 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.068 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 3, 2024-09-16T03:25:07.068 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "rack" 2024-09-16T03:25:07.068 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.068 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.068 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 4, 2024-09-16T03:25:07.068 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "row" 2024-09-16T03:25:07.068 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.068 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.068 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 5, 2024-09-16T03:25:07.068 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "pdu" 2024-09-16T03:25:07.068 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.068 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.068 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 6, 2024-09-16T03:25:07.069 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "pod" 2024-09-16T03:25:07.069 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.069 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.069 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 7, 2024-09-16T03:25:07.069 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "room" 2024-09-16T03:25:07.069 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.069 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.069 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 8, 2024-09-16T03:25:07.069 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "datacenter" 2024-09-16T03:25:07.069 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.069 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.069 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 9, 2024-09-16T03:25:07.069 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "zone" 2024-09-16T03:25:07.069 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.070 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.070 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 10, 2024-09-16T03:25:07.070 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "region" 2024-09-16T03:25:07.070 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.070 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.070 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:25:07.070 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "root" 2024-09-16T03:25:07.070 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.070 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:07.070 INFO:tasks.workunit.client.0.smithi096.stderr: "buckets": [ 2024-09-16T03:25:07.070 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.070 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -1, 2024-09-16T03:25:07.070 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "default", 2024-09-16T03:25:07.071 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:25:07.071 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "root", 2024-09-16T03:25:07.071 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:25:07.071 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:25:07.071 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:25:07.071 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:25:07.071 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.071 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -3, 2024-09-16T03:25:07.071 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:25:07.071 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:25:07.071 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.071 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:07.071 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.071 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.072 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -2, 2024-09-16T03:25:07.072 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "default~hdd", 2024-09-16T03:25:07.072 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:25:07.072 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "root", 2024-09-16T03:25:07.072 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:25:07.072 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:25:07.072 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:25:07.072 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:25:07.072 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.072 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -4, 2024-09-16T03:25:07.072 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:25:07.072 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:25:07.072 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.072 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:07.073 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.073 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.073 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -3, 2024-09-16T03:25:07.073 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "smithi096", 2024-09-16T03:25:07.073 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:25:07.073 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "host", 2024-09-16T03:25:07.073 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:25:07.073 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:25:07.073 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:25:07.073 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:25:07.073 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.073 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:25:07.073 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:25:07.074 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:25:07.074 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.074 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.074 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:25:07.074 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:25:07.074 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 1 2024-09-16T03:25:07.074 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.074 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.074 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:25:07.074 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:25:07.074 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 2 2024-09-16T03:25:07.074 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.074 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:07.074 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.074 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.075 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -4, 2024-09-16T03:25:07.075 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "smithi096~hdd", 2024-09-16T03:25:07.075 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:25:07.075 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "host", 2024-09-16T03:25:07.075 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:25:07.075 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:25:07.075 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:25:07.075 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:25:07.075 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.075 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:25:07.075 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:25:07.075 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:25:07.075 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.075 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.076 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:25:07.076 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:25:07.076 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 1 2024-09-16T03:25:07.076 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.076 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.076 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:25:07.076 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:25:07.076 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 2 2024-09-16T03:25:07.076 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.076 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:07.076 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.076 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:07.076 INFO:tasks.workunit.client.0.smithi096.stderr: "rules": [ 2024-09-16T03:25:07.077 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.077 INFO:tasks.workunit.client.0.smithi096.stderr: "rule_id": 0, 2024-09-16T03:25:07.077 INFO:tasks.workunit.client.0.smithi096.stderr: "rule_name": "replicated_rule", 2024-09-16T03:25:07.077 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:25:07.077 INFO:tasks.workunit.client.0.smithi096.stderr: "steps": [ 2024-09-16T03:25:07.077 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.077 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "take", 2024-09-16T03:25:07.077 INFO:tasks.workunit.client.0.smithi096.stderr: "item": -1, 2024-09-16T03:25:07.077 INFO:tasks.workunit.client.0.smithi096.stderr: "item_name": "default" 2024-09-16T03:25:07.077 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.077 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.077 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "choose_firstn", 2024-09-16T03:25:07.077 INFO:tasks.workunit.client.0.smithi096.stderr: "num": 0, 2024-09-16T03:25:07.077 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "osd" 2024-09-16T03:25:07.078 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.078 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.078 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "emit" 2024-09-16T03:25:07.078 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.078 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:07.078 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.078 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:07.078 INFO:tasks.workunit.client.0.smithi096.stderr: "tunables": { 2024-09-16T03:25:07.078 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_local_tries": 0, 2024-09-16T03:25:07.078 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_local_fallback_tries": 0, 2024-09-16T03:25:07.078 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_total_tries": 50, 2024-09-16T03:25:07.078 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_descend_once": 1, 2024-09-16T03:25:07.078 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_vary_r": 1, 2024-09-16T03:25:07.078 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_stable": 1, 2024-09-16T03:25:07.079 INFO:tasks.workunit.client.0.smithi096.stderr: "msr_descents": 100, 2024-09-16T03:25:07.079 INFO:tasks.workunit.client.0.smithi096.stderr: "msr_collision_tries": 100, 2024-09-16T03:25:07.079 INFO:tasks.workunit.client.0.smithi096.stderr: "straw_calc_version": 1, 2024-09-16T03:25:07.079 INFO:tasks.workunit.client.0.smithi096.stderr: "allowed_bucket_algs": 54, 2024-09-16T03:25:07.079 INFO:tasks.workunit.client.0.smithi096.stderr: "profile": "jewel", 2024-09-16T03:25:07.079 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_tunables": 1, 2024-09-16T03:25:07.079 INFO:tasks.workunit.client.0.smithi096.stderr: "legacy_tunables": 0, 2024-09-16T03:25:07.079 INFO:tasks.workunit.client.0.smithi096.stderr: "minimum_required_version": "jewel", 2024-09-16T03:25:07.079 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables": 1, 2024-09-16T03:25:07.079 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables2": 1, 2024-09-16T03:25:07.079 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v2_rules": 0, 2024-09-16T03:25:07.079 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables3": 1, 2024-09-16T03:25:07.079 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v3_rules": 0, 2024-09-16T03:25:07.079 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v4_buckets": 1, 2024-09-16T03:25:07.080 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables5": 1, 2024-09-16T03:25:07.080 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v5_rules": 0, 2024-09-16T03:25:07.080 INFO:tasks.workunit.client.0.smithi096.stderr: "has_msr_rules": 0 2024-09-16T03:25:07.080 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.080 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_args": {} 2024-09-16T03:25:07.080 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.080 INFO:tasks.workunit.client.0.smithi096.stderr: "fsmap": { 2024-09-16T03:25:07.080 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 1, 2024-09-16T03:25:07.080 INFO:tasks.workunit.client.0.smithi096.stderr: "btime": "2024-09-16T03:22:46:882186+0000", 2024-09-16T03:25:07.080 INFO:tasks.workunit.client.0.smithi096.stderr: "default_fscid": -1, 2024-09-16T03:25:07.080 INFO:tasks.workunit.client.0.smithi096.stderr: "compat": { 2024-09-16T03:25:07.080 INFO:tasks.workunit.client.0.smithi096.stderr: "compat": {}, 2024-09-16T03:25:07.080 INFO:tasks.workunit.client.0.smithi096.stderr: "ro_compat": {}, 2024-09-16T03:25:07.080 INFO:tasks.workunit.client.0.smithi096.stderr: "incompat": { 2024-09-16T03:25:07.081 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_1": "base v0.20", 2024-09-16T03:25:07.081 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_2": "client writeable ranges", 2024-09-16T03:25:07.081 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_3": "default file layouts on dirs", 2024-09-16T03:25:07.081 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_4": "dir inode in separate object", 2024-09-16T03:25:07.081 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_5": "mds uses versioned encoding", 2024-09-16T03:25:07.081 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_6": "dirfrag is stored in omap", 2024-09-16T03:25:07.081 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_8": "no anchor table", 2024-09-16T03:25:07.081 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_9": "file layout v2", 2024-09-16T03:25:07.081 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_10": "snaprealm v2", 2024-09-16T03:25:07.081 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_11": "minor log segments", 2024-09-16T03:25:07.081 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_12": "quiesce subvolumes" 2024-09-16T03:25:07.081 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.081 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.082 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_flags": { 2024-09-16T03:25:07.082 INFO:tasks.workunit.client.0.smithi096.stderr: "enable_multiple": true, 2024-09-16T03:25:07.082 INFO:tasks.workunit.client.0.smithi096.stderr: "ever_enabled_multiple": true 2024-09-16T03:25:07.082 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.082 INFO:tasks.workunit.client.0.smithi096.stderr: "standbys": [], 2024-09-16T03:25:07.082 INFO:tasks.workunit.client.0.smithi096.stderr: "filesystems": [] 2024-09-16T03:25:07.082 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.082 INFO:tasks.workunit.client.0.smithi096.stderr: "mdsmap_first_committed": 1, 2024-09-16T03:25:07.082 INFO:tasks.workunit.client.0.smithi096.stderr: "mdsmap_last_committed": 1, 2024-09-16T03:25:07.082 INFO:tasks.workunit.client.0.smithi096.stderr: "auth": { 2024-09-16T03:25:07.082 INFO:tasks.workunit.client.0.smithi096.stderr: "first_committed": 1, 2024-09-16T03:25:07.082 INFO:tasks.workunit.client.0.smithi096.stderr: "last_committed": 5, 2024-09-16T03:25:07.082 INFO:tasks.workunit.client.0.smithi096.stderr: "num_secrets": 3 2024-09-16T03:25:07.082 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.083 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 64, 2024-09-16T03:25:07.083 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_active": 64, 2024-09-16T03:25:07.083 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_unknown": 0, 2024-09-16T03:25:07.083 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osd": 3, 2024-09-16T03:25:07.083 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_sum": { 2024-09-16T03:25:07.083 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:25:07.083 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:25:07.083 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:25:07.083 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:25:07.083 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:25:07.083 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:25:07.083 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:25:07.083 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:25:07.083 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:25:07.083 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:25:07.084 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:25:07.084 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:25:07.084 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:25:07.084 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:25:07.084 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:25:07.084 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:25:07.084 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:25:07.084 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:25:07.084 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:25:07.084 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:25:07.084 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:25:07.084 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:25:07.084 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:25:07.084 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:25:07.085 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:25:07.085 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:25:07.085 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:25:07.085 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:25:07.085 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:25:07.085 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:25:07.085 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:25:07.085 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:25:07.085 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:25:07.085 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:25:07.085 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:25:07.085 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:25:07.085 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:25:07.085 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:25:07.085 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:25:07.086 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:25:07.086 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:25:07.086 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.086 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:25:07.086 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:25:07.086 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:25:07.086 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:25:07.086 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:25:07.086 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:25:07.086 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:25:07.086 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:25:07.086 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:25:07.086 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:25:07.086 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:25:07.087 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.087 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:25:07.087 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:25:07.087 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 192, 2024-09-16T03:25:07.087 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 192, 2024-09-16T03:25:07.087 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 0 2024-09-16T03:25:07.087 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.087 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_sum": { 2024-09-16T03:25:07.087 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 0, 2024-09-16T03:25:07.087 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 0, 2024-09-16T03:25:07.087 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pgs": 192, 2024-09-16T03:25:07.087 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osds": 3, 2024-09-16T03:25:07.087 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_osds": 3, 2024-09-16T03:25:07.087 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_omap_osds": 3, 2024-09-16T03:25:07.088 INFO:tasks.workunit.client.0.smithi096.stderr: "kb": 314572800, 2024-09-16T03:25:07.088 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used": 81232, 2024-09-16T03:25:07.088 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_data": 696, 2024-09-16T03:25:07.088 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_omap": 4, 2024-09-16T03:25:07.088 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_meta": 80443, 2024-09-16T03:25:07.088 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_avail": 314491568, 2024-09-16T03:25:07.088 INFO:tasks.workunit.client.0.smithi096.stderr: "statfs": { 2024-09-16T03:25:07.088 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 322122547200, 2024-09-16T03:25:07.088 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 322039365632, 2024-09-16T03:25:07.088 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:25:07.088 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 712704, 2024-09-16T03:25:07.088 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 209643, 2024-09-16T03:25:07.088 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:25:07.089 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:25:07.089 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:25:07.089 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 4785, 2024-09-16T03:25:07.089 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 82373967 2024-09-16T03:25:07.089 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.089 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_peers": [], 2024-09-16T03:25:07.089 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_trim_queue_len": 0, 2024-09-16T03:25:07.089 INFO:tasks.workunit.client.0.smithi096.stderr: "num_snap_trimming": 0, 2024-09-16T03:25:07.089 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shards_repaired": 0, 2024-09-16T03:25:07.089 INFO:tasks.workunit.client.0.smithi096.stderr: "op_queue_age_hist": { 2024-09-16T03:25:07.089 INFO:tasks.workunit.client.0.smithi096.stderr: "histogram": [], 2024-09-16T03:25:07.089 INFO:tasks.workunit.client.0.smithi096.stderr: "upper_bound": 1 2024-09-16T03:25:07.089 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.089 INFO:tasks.workunit.client.0.smithi096.stderr: "perf_stat": { 2024-09-16T03:25:07.089 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ms": 108, 2024-09-16T03:25:07.090 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ms": 108, 2024-09-16T03:25:07.090 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ns": 108000000, 2024-09-16T03:25:07.090 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ns": 108000000 2024-09-16T03:25:07.090 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.090 INFO:tasks.workunit.client.0.smithi096.stderr: "alerts": [], 2024-09-16T03:25:07.090 INFO:tasks.workunit.client.0.smithi096.stderr: "network_ping_times": [] 2024-09-16T03:25:07.090 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.090 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_sum_by_class": { 2024-09-16T03:25:07.090 INFO:tasks.workunit.client.0.smithi096.stderr: "hdd": { 2024-09-16T03:25:07.090 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 0, 2024-09-16T03:25:07.090 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 0, 2024-09-16T03:25:07.090 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pgs": 192, 2024-09-16T03:25:07.090 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osds": 3, 2024-09-16T03:25:07.091 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_osds": 3, 2024-09-16T03:25:07.091 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_omap_osds": 3, 2024-09-16T03:25:07.091 INFO:tasks.workunit.client.0.smithi096.stderr: "kb": 314572800, 2024-09-16T03:25:07.091 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used": 81232, 2024-09-16T03:25:07.091 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_data": 696, 2024-09-16T03:25:07.091 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_omap": 4, 2024-09-16T03:25:07.091 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_meta": 80443, 2024-09-16T03:25:07.091 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_avail": 314491568, 2024-09-16T03:25:07.091 INFO:tasks.workunit.client.0.smithi096.stderr: "statfs": { 2024-09-16T03:25:07.091 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 322122547200, 2024-09-16T03:25:07.091 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 322039365632, 2024-09-16T03:25:07.091 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:25:07.091 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 712704, 2024-09-16T03:25:07.091 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 209643, 2024-09-16T03:25:07.092 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:25:07.092 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:25:07.092 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:25:07.092 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 4785, 2024-09-16T03:25:07.092 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 82373967 2024-09-16T03:25:07.092 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.092 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_peers": [], 2024-09-16T03:25:07.092 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_trim_queue_len": 0, 2024-09-16T03:25:07.092 INFO:tasks.workunit.client.0.smithi096.stderr: "num_snap_trimming": 0, 2024-09-16T03:25:07.092 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shards_repaired": 0, 2024-09-16T03:25:07.092 INFO:tasks.workunit.client.0.smithi096.stderr: "op_queue_age_hist": { 2024-09-16T03:25:07.092 INFO:tasks.workunit.client.0.smithi096.stderr: "histogram": [], 2024-09-16T03:25:07.092 INFO:tasks.workunit.client.0.smithi096.stderr: "upper_bound": 1 2024-09-16T03:25:07.092 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.093 INFO:tasks.workunit.client.0.smithi096.stderr: "perf_stat": { 2024-09-16T03:25:07.093 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ms": 108, 2024-09-16T03:25:07.093 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ms": 108, 2024-09-16T03:25:07.093 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ns": 108000000, 2024-09-16T03:25:07.093 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ns": 108000000 2024-09-16T03:25:07.093 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.093 INFO:tasks.workunit.client.0.smithi096.stderr: "alerts": [], 2024-09-16T03:25:07.093 INFO:tasks.workunit.client.0.smithi096.stderr: "network_ping_times": [] 2024-09-16T03:25:07.093 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.093 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.093 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_stats": [ 2024-09-16T03:25:07.093 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.093 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 2, 2024-09-16T03:25:07.093 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 32, 2024-09-16T03:25:07.094 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:25:07.094 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:25:07.094 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:25:07.094 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:25:07.094 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:25:07.094 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:25:07.094 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:25:07.094 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:25:07.094 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:25:07.094 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:25:07.094 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:25:07.094 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:25:07.095 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:25:07.095 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:25:07.095 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:25:07.095 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:25:07.095 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:25:07.095 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:25:07.095 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:25:07.095 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:25:07.095 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:25:07.095 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:25:07.095 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:25:07.095 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:25:07.095 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:25:07.095 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:25:07.096 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:25:07.096 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:25:07.096 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:25:07.096 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:25:07.096 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:25:07.096 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:25:07.096 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:25:07.096 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:25:07.096 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:25:07.096 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:25:07.096 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:25:07.096 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:25:07.096 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:25:07.097 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:25:07.097 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:25:07.097 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.097 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:25:07.097 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:25:07.097 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:25:07.097 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:25:07.097 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:25:07.097 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:25:07.097 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:25:07.097 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:25:07.097 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:25:07.097 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:25:07.097 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:25:07.098 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.098 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:25:07.098 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:25:07.098 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 96, 2024-09-16T03:25:07.098 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 96, 2024-09-16T03:25:07.098 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 3 2024-09-16T03:25:07.098 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.098 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.098 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 1, 2024-09-16T03:25:07.098 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 32, 2024-09-16T03:25:07.098 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:25:07.098 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:25:07.098 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:25:07.099 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:25:07.099 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:25:07.099 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:25:07.099 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:25:07.099 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:25:07.099 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:25:07.099 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:25:07.099 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:25:07.099 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:25:07.099 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:25:07.099 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:25:07.099 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:25:07.099 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:25:07.099 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:25:07.100 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:25:07.100 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:25:07.100 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:25:07.100 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:25:07.100 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:25:07.100 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:25:07.100 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:25:07.100 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:25:07.100 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:25:07.100 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:25:07.100 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:25:07.100 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:25:07.100 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:25:07.100 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:25:07.101 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:25:07.101 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:25:07.101 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:25:07.101 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:25:07.101 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:25:07.101 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:25:07.101 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:25:07.101 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:25:07.101 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:25:07.101 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:25:07.101 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.101 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:25:07.101 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:25:07.101 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:25:07.102 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:25:07.102 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:25:07.102 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:25:07.102 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:25:07.102 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:25:07.102 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:25:07.102 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:25:07.102 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:25:07.102 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.102 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:25:07.102 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:25:07.102 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 96, 2024-09-16T03:25:07.102 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 96, 2024-09-16T03:25:07.102 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 3 2024-09-16T03:25:07.103 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.103 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:07.103 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_stats": [ 2024-09-16T03:25:07.103 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.103 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:25:07.103 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 21474836507 2024-09-16T03:25:07.103 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.103 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.103 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:25:07.103 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 42949672979 2024-09-16T03:25:07.103 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.103 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.103 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:25:07.104 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 64424509451 2024-09-16T03:25:07.104 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.104 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:07.104 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_by_state": [ 2024-09-16T03:25:07.104 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.104 INFO:tasks.workunit.client.0.smithi096.stderr: "state": "active+clean", 2024-09-16T03:25:07.104 INFO:tasks.workunit.client.0.smithi096.stderr: "num": 64 2024-09-16T03:25:07.104 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.104 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:07.104 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_by_osd": [ 2024-09-16T03:25:07.104 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.104 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:25:07.104 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 15, 2024-09-16T03:25:07.104 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 64, 2024-09-16T03:25:07.105 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:25:07.105 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.105 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.105 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:25:07.105 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 20, 2024-09-16T03:25:07.105 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 64, 2024-09-16T03:25:07.105 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:25:07.105 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.105 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.105 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:25:07.105 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 29, 2024-09-16T03:25:07.105 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 64, 2024-09-16T03:25:07.105 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:25:07.106 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.106 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:07.106 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": [ 2024-09-16T03:25:07.106 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.106 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 1, 2024-09-16T03:25:07.106 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": {} 2024-09-16T03:25:07.106 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.106 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.106 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 2, 2024-09-16T03:25:07.106 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": {} 2024-09-16T03:25:07.106 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.106 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:07.106 INFO:tasks.workunit.client.0.smithi096.stderr: "servicemap": { 2024-09-16T03:25:07.106 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 4, 2024-09-16T03:25:07.107 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:25:02.412573+0000", 2024-09-16T03:25:07.107 INFO:tasks.workunit.client.0.smithi096.stderr: "services": { 2024-09-16T03:25:07.107 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": { 2024-09-16T03:25:07.107 INFO:tasks.workunit.client.0.smithi096.stderr: "daemons": { 2024-09-16T03:25:07.107 INFO:tasks.workunit.client.0.smithi096.stderr: "summary": "", 2024-09-16T03:25:07.107 INFO:tasks.workunit.client.0.smithi096.stderr: "2": { 2024-09-16T03:25:07.107 INFO:tasks.workunit.client.0.smithi096.stderr: "start_epoch": 0, 2024-09-16T03:25:07.107 INFO:tasks.workunit.client.0.smithi096.stderr: "start_stamp": "0.000000", 2024-09-16T03:25:07.107 INFO:tasks.workunit.client.0.smithi096.stderr: "gid": 0, 2024-09-16T03:25:07.107 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "(unrecognized address family 0)/0", 2024-09-16T03:25:07.107 INFO:tasks.workunit.client.0.smithi096.stderr: "metadata": {}, 2024-09-16T03:25:07.107 INFO:tasks.workunit.client.0.smithi096.stderr: "task_status": {} 2024-09-16T03:25:07.107 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.108 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.108 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.108 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.108 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.108 INFO:tasks.workunit.client.0.smithi096.stderr: "mgrstat_first_committed": 52, 2024-09-16T03:25:07.108 INFO:tasks.workunit.client.0.smithi096.stderr: "mgrstat_last_committed": 59, 2024-09-16T03:25:07.108 INFO:tasks.workunit.client.0.smithi096.stderr: "logm_first_committed": 1, 2024-09-16T03:25:07.108 INFO:tasks.workunit.client.0.smithi096.stderr: "logm_last_committed": 259, 2024-09-16T03:25:07.108 INFO:tasks.workunit.client.0.smithi096.stderr: "paxos": { 2024-09-16T03:25:07.108 INFO:tasks.workunit.client.0.smithi096.stderr: "first_committed": 1, 2024-09-16T03:25:07.108 INFO:tasks.workunit.client.0.smithi096.stderr: "last_committed": 362, 2024-09-16T03:25:07.108 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pn": 0, 2024-09-16T03:25:07.108 INFO:tasks.workunit.client.0.smithi096.stderr: "accepted_pn": 0 2024-09-16T03:25:07.108 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.109 INFO:tasks.workunit.client.0.smithi096.stderr:}' 2024-09-16T03:25:07.109 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:30: check_lec_equals_pools: jq .osdmap_clean_epochs.min_last_epoch_clean 2024-09-16T03:25:07.113 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:30: check_lec_equals_pools: echo '{' '"cluster_fingerprint":' '"fda2fc64-07ed-4add-8224-2e527e11d427",' '"version":' '"19.3.0-4930-gfc3e0bff",' '"commit":' '"fc3e0bff7468fd55478adbae7f75508b749124b6",' '"timestamp":' '"2024-09-16T03:25:06.993636+0000",' '"tag":' '"",' '"health":' '{' '"status":' '"HEALTH_OK",' '"checks":' '{},' '"mutes":' '[]' '},' '"monmap_first_committed":' 1, '"monmap_last_committed":' 1, '"monmap":' '{' '"epoch":' 1, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"modified":' '"2024-09-16T03:22:45.872880Z",' '"created":' '"2024-09-16T03:22:45.872880Z",' '"min_mon_release":' 19, '"min_mon_release_name":' '"squid",' '"election_strategy":' 1, '"disallowed_leaders:' '":' '"",' '"stretch_mode":' false, '"tiebreaker_mon":' '"",' '"removed_ranks:' '":' '"",' '"features":' '{' '"persistent":' '[' '"kraken",' '"luminous",' '"mimic",' '"osdmap-prune",' '"nautilus",' '"octopus",' '"pacific",' '"elector-pinging",' '"quincy",' '"reef",' '"squid"' '],' '"optional":' '[]' '},' '"mons":' '[' '{' '"rank":' 0, '"name":' '"a",' '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:7302",' '"nonce":' 0 '}' ']' '},' '"addr":' '"127.0.0.1:7302/0",' '"public_addr":' '"127.0.0.1:7302/0",' '"priority":' 0, '"weight":' 0, '"crush_location":' '"{}"' '}' ']' '},' '"quorum":' '[' 0 '],' '"osdmap":' '{' '"epoch":' 32, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"created":' '"2024-09-16T03:22:46.906117+0000",' '"modified":' '"2024-09-16T03:25:05.447882+0000",' '"last_up_change":' '"2024-09-16T03:24:37.708512+0000",' '"last_in_change":' '"2024-09-16T03:24:01.831039+0000",' '"flags":' '"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit",' '"flags_num":' 5799936, '"flags_set":' '[' '"pglog_hardlimit",' '"purged_snapdirs",' '"recovery_deletes",' '"sortbitwise"' '],' '"crush_version":' 7, '"full_ratio":' 0.97000002861022949, '"backfillfull_ratio":' 0.97000002861022949, '"nearfull_ratio":' 0.85000002384185791, '"cluster_snapshot":' '"",' '"pool_max":' 2, '"max_osd":' 3, '"require_min_compat_client":' '"luminous",' '"min_compat_client":' '"jewel",' '"require_osd_release":' '"squid",' '"allow_crimson":' false, '"pools":' '[' '{' '"pool":' 1, '"pool_name":' '"foo",' '"create_time":' '"2024-09-16T03:24:44.525189+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"30",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.690000057220459, '"score_stable":' 1.690000057220459, '"optimal_score":' 1, '"raw_score_acting":' 1.690000057220459, '"raw_score_stable":' 1.690000057220459, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '},' '{' '"pool":' 2, '"pool_name":' '"bar",' '"create_time":' '"2024-09-16T03:24:46.226575+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"32",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.1299999952316284, '"score_stable":' 1.1299999952316284, '"optimal_score":' 1, '"raw_score_acting":' 1.1299999952316284, '"raw_score_stable":' 1.1299999952316284, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '}' '],' '"osds":' '[' '{' '"osd":' 0, '"uuid":' '"64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 5, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6802",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6803",' '"nonce":' 3375787448 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6804",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6805",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6808",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6809",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6806",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6807",' '"nonce":' 3375787448 '}' ']' '},' '"public_addr":' '"127.0.0.1:6803/3375787448",' '"cluster_addr":' '"127.0.0.1:6805/3375787448",' '"heartbeat_back_addr":' '"127.0.0.1:6809/3375787448",' '"heartbeat_front_addr":' '"127.0.0.1:6807/3375787448",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 1, '"uuid":' '"74b26727-75c9-444d-8782-719e4197a382",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 10, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6810",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6811",' '"nonce":' 3733255132 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6812",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6813",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6816",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6817",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6814",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6815",' '"nonce":' 3733255132 '}' ']' '},' '"public_addr":' '"127.0.0.1:6811/3733255132",' '"cluster_addr":' '"127.0.0.1:6813/3733255132",' '"heartbeat_back_addr":' '"127.0.0.1:6817/3733255132",' '"heartbeat_front_addr":' '"127.0.0.1:6815/3733255132",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 2, '"uuid":' '"143da3a7-dad9-4b1e-966b-76cf5bdd3c82",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 15, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6818",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6819",' '"nonce":' 963814857 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6820",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6821",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6824",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6825",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6822",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6823",' '"nonce":' 963814857 '}' ']' '},' '"public_addr":' '"127.0.0.1:6819/963814857",' '"cluster_addr":' '"127.0.0.1:6821/963814857",' '"heartbeat_back_addr":' '"127.0.0.1:6825/963814857",' '"heartbeat_front_addr":' '"127.0.0.1:6823/963814857",' '"state":' '[' '"exists",' '"up"' ']' '}' '],' '"osd_xinfo":' '[' '{' '"osd":' 0, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:22.481942+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 1, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:59.663703+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 2, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:24:37.320822+0000",' '"dead_epoch":' 0 '}' '],' '"pg_upmap":' '[],' '"pg_upmap_items":' '[],' '"pg_upmap_primaries":' '[],' '"pg_temp":' '[],' '"primary_temp":' '[],' '"blocklist":' '{},' '"range_blocklist":' '{},' '"erasure_code_profiles":' '{' '"default":' '{' '"k":' '"2",' '"m":' '"2",' '"plugin":' '"jerasure",' '"technique":' '"reed_sol_van"' '}' '},' '"removed_snaps_queue":' '[],' '"new_removed_snaps":' '[],' '"new_purged_snaps":' '[],' '"crush_node_flags":' '{},' '"device_class_flags":' '{},' '"stretch_mode":' '{' '"stretch_mode_enabled":' false, '"stretch_bucket_count":' 0, '"degraded_stretch_mode":' 0, '"recovering_stretch_mode":' 0, '"stretch_mode_bucket":' 0 '}' '},' '"osd_metadata":' '[' '{' '"id":' 0, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/0/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:22:53.662571Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]",' '"hb_front_addr":' '"[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/0",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 1, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/1/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:23:30.129885Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]",' '"hb_front_addr":' '"[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/1",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 2, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/2/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:24:07.764502Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]",' '"hb_front_addr":' '"[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/2",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '}' '],' '"osdmap_clean_epochs":' '{' '"min_last_epoch_clean":' 28, '"last_epoch_clean":' '{' '"per_pool":' '[' '{' '"poolid":' 1, '"floor":' 28 '},' '{' '"poolid":' 2, '"floor":' 28 '}' ']' '},' '"osd_epochs":' '[' '{' '"id":' 0, '"epoch":' 28 '},' '{' '"id":' 1, '"epoch":' 28 '},' '{' '"id":' 2, '"epoch":' 28 '}' ']' '},' '"osdmap_first_committed":' 26, '"osdmap_last_committed":' 32, '"crushmap":' '{' '"devices":' '[' '{' '"id":' 0, '"name":' '"osd.0",' '"class":' '"hdd"' '},' '{' '"id":' 1, '"name":' '"osd.1",' '"class":' '"hdd"' '},' '{' '"id":' 2, '"name":' '"osd.2",' '"class":' '"hdd"' '}' '],' '"types":' '[' '{' '"type_id":' 0, '"name":' '"osd"' '},' '{' '"type_id":' 1, '"name":' '"host"' '},' '{' '"type_id":' 2, '"name":' '"chassis"' '},' '{' '"type_id":' 3, '"name":' '"rack"' '},' '{' '"type_id":' 4, '"name":' '"row"' '},' '{' '"type_id":' 5, '"name":' '"pdu"' '},' '{' '"type_id":' 6, '"name":' '"pod"' '},' '{' '"type_id":' 7, '"name":' '"room"' '},' '{' '"type_id":' 8, '"name":' '"datacenter"' '},' '{' '"type_id":' 9, '"name":' '"zone"' '},' '{' '"type_id":' 10, '"name":' '"region"' '},' '{' '"type_id":' 11, '"name":' '"root"' '}' '],' '"buckets":' '[' '{' '"id":' -1, '"name":' '"default",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -3, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -2, '"name":' '"default~hdd",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -4, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -3, '"name":' '"smithi096",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '},' '{' '"id":' -4, '"name":' '"smithi096~hdd",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '}' '],' '"rules":' '[' '{' '"rule_id":' 0, '"rule_name":' '"replicated_rule",' '"type":' 1, '"steps":' '[' '{' '"op":' '"take",' '"item":' -1, '"item_name":' '"default"' '},' '{' '"op":' '"choose_firstn",' '"num":' 0, '"type":' '"osd"' '},' '{' '"op":' '"emit"' '}' ']' '}' '],' '"tunables":' '{' '"choose_local_tries":' 0, '"choose_local_fallback_tries":' 0, '"choose_total_tries":' 50, '"chooseleaf_descend_once":' 1, '"chooseleaf_vary_r":' 1, '"chooseleaf_stable":' 1, '"msr_descents":' 100, '"msr_collision_tries":' 100, '"straw_calc_version":' 1, '"allowed_bucket_algs":' 54, '"profile":' '"jewel",' '"optimal_tunables":' 1, '"legacy_tunables":' 0, '"minimum_required_version":' '"jewel",' '"require_feature_tunables":' 1, '"require_feature_tunables2":' 1, '"has_v2_rules":' 0, '"require_feature_tunables3":' 1, '"has_v3_rules":' 0, '"has_v4_buckets":' 1, '"require_feature_tunables5":' 1, '"has_v5_rules":' 0, '"has_msr_rules":' 0 '},' '"choose_args":' '{}' '},' '"fsmap":' '{' '"epoch":' 1, '"btime":' '"2024-09-16T03:22:46:882186+0000",' '"default_fscid":' -1, '"compat":' '{' '"compat":' '{},' '"ro_compat":' '{},' '"incompat":' '{' '"feature_1":' '"base' 'v0.20",' '"feature_2":' '"client' writeable 'ranges",' '"feature_3":' '"default' file layouts on 'dirs",' '"feature_4":' '"dir' inode in separate 'object",' '"feature_5":' '"mds' uses versioned 'encoding",' '"feature_6":' '"dirfrag' is stored in 'omap",' '"feature_8":' '"no' anchor 'table",' '"feature_9":' '"file' layout 'v2",' '"feature_10":' '"snaprealm' 'v2",' '"feature_11":' '"minor' log 'segments",' '"feature_12":' '"quiesce' 'subvolumes"' '}' '},' '"feature_flags":' '{' '"enable_multiple":' true, '"ever_enabled_multiple":' true '},' '"standbys":' '[],' '"filesystems":' '[]' '},' '"mdsmap_first_committed":' 1, '"mdsmap_last_committed":' 1, '"auth":' '{' '"first_committed":' 1, '"last_committed":' 5, '"num_secrets":' 3 '},' '"num_pg":' 64, '"num_pg_active":' 64, '"num_pg_unknown":' 0, '"num_osd":' 3, '"pool_sum":' '{' '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 192, '"acting":' 192, '"num_store_stats":' 0 '},' '"osd_sum":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 192, '"num_osds":' 3, '"num_per_pool_osds":' 3, '"num_per_pool_omap_osds":' 3, '"kb":' 314572800, '"kb_used":' 81232, '"kb_used_data":' 696, '"kb_used_omap":' 4, '"kb_used_meta":' 80443, '"kb_avail":' 314491568, '"statfs":' '{' '"total":' 322122547200, '"available":' 322039365632, '"internally_reserved":' 0, '"allocated":' 712704, '"data_stored":' 209643, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 4785, '"internal_metadata":' 82373967 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 108, '"apply_latency_ms":' 108, '"commit_latency_ns":' 108000000, '"apply_latency_ns":' 108000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '},' '"osd_sum_by_class":' '{' '"hdd":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 192, '"num_osds":' 3, '"num_per_pool_osds":' 3, '"num_per_pool_omap_osds":' 3, '"kb":' 314572800, '"kb_used":' 81232, '"kb_used_data":' 696, '"kb_used_omap":' 4, '"kb_used_meta":' 80443, '"kb_avail":' 314491568, '"statfs":' '{' '"total":' 322122547200, '"available":' 322039365632, '"internally_reserved":' 0, '"allocated":' 712704, '"data_stored":' 209643, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 4785, '"internal_metadata":' 82373967 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 108, '"apply_latency_ms":' 108, '"commit_latency_ns":' 108000000, '"apply_latency_ns":' 108000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '}' '},' '"pool_stats":' '[' '{' '"poolid":' 2, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 96, '"acting":' 96, '"num_store_stats":' 3 '},' '{' '"poolid":' 1, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 96, '"acting":' 96, '"num_store_stats":' 3 '}' '],' '"osd_stats":' '[' '{' '"osd":' 0, '"seq":' 21474836507 '},' '{' '"osd":' 1, '"seq":' 42949672979 '},' '{' '"osd":' 2, '"seq":' 64424509451 '}' '],' '"num_pg_by_state":' '[' '{' '"state":' '"active+clean",' '"num":' 64 '}' '],' '"num_pg_by_osd":' '[' '{' '"osd":' 2, '"num_primary_pg":' 15, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 0, '"num_primary_pg":' 20, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 1, '"num_primary_pg":' 29, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '}' '],' '"purged_snaps":' '[' '{' '"pool":' 1, '"purged_snaps":' '{}' '},' '{' '"pool":' 2, '"purged_snaps":' '{}' '}' '],' '"servicemap":' '{' '"epoch":' 4, '"modified":' '"2024-09-16T03:25:02.412573+0000",' '"services":' '{' '"osd":' '{' '"daemons":' '{' '"summary":' '"",' '"2":' '{' '"start_epoch":' 0, '"start_stamp":' '"0.000000",' '"gid":' 0, '"addr":' '"(unrecognized' address family '0)/0",' '"metadata":' '{},' '"task_status":' '{}' '}' '}' '}' '}' '},' '"mgrstat_first_committed":' 52, '"mgrstat_last_committed":' 59, '"logm_first_committed":' 1, '"logm_last_committed":' 259, '"paxos":' '{' '"first_committed":' 1, '"last_committed":' 362, '"last_pn":' 0, '"accepted_pn":' 0 '}' '}' 2024-09-16T03:25:07.113 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:30: check_lec_equals_pools: lec=28 2024-09-16T03:25:07.113 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:32: check_lec_equals_pools: [[ -z '' ]] 2024-09-16T03:25:07.113 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:36: check_lec_equals_pools: pools=($(echo $report | jq ".osdmap_clean_epochs.last_epoch_clean.per_pool[] |" " select(.floor == $lec) | .poolid")) 2024-09-16T03:25:07.113 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:36: check_lec_equals_pools: jq '.osdmap_clean_epochs.last_epoch_clean.per_pool[] |' ' select(.floor == 28) | .poolid' 2024-09-16T03:25:07.113 INFO:tasks.workunit.client.0.smithi096.stderr:jq: error: syntax error, unexpected $end (Unix shell quoting issues?) at , line 1: 2024-09-16T03:25:07.113 INFO:tasks.workunit.client.0.smithi096.stderr:.osdmap_clean_epochs.last_epoch_clean.per_pool[] | 2024-09-16T03:25:07.113 INFO:tasks.workunit.client.0.smithi096.stderr:jq: 1 compile error 2024-09-16T03:25:07.113 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:36: check_lec_equals_pools: echo '{' '"cluster_fingerprint":' '"fda2fc64-07ed-4add-8224-2e527e11d427",' '"version":' '"19.3.0-4930-gfc3e0bff",' '"commit":' '"fc3e0bff7468fd55478adbae7f75508b749124b6",' '"timestamp":' '"2024-09-16T03:25:06.993636+0000",' '"tag":' '"",' '"health":' '{' '"status":' '"HEALTH_OK",' '"checks":' '{},' '"mutes":' '[]' '},' '"monmap_first_committed":' 1, '"monmap_last_committed":' 1, '"monmap":' '{' '"epoch":' 1, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"modified":' '"2024-09-16T03:22:45.872880Z",' '"created":' '"2024-09-16T03:22:45.872880Z",' '"min_mon_release":' 19, '"min_mon_release_name":' '"squid",' '"election_strategy":' 1, '"disallowed_leaders:' '":' '"",' '"stretch_mode":' false, '"tiebreaker_mon":' '"",' '"removed_ranks:' '":' '"",' '"features":' '{' '"persistent":' '[' '"kraken",' '"luminous",' '"mimic",' '"osdmap-prune",' '"nautilus",' '"octopus",' '"pacific",' '"elector-pinging",' '"quincy",' '"reef",' '"squid"' '],' '"optional":' '[]' '},' '"mons":' '[' '{' '"rank":' 0, '"name":' '"a",' '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:7302",' '"nonce":' 0 '}' ']' '},' '"addr":' '"127.0.0.1:7302/0",' '"public_addr":' '"127.0.0.1:7302/0",' '"priority":' 0, '"weight":' 0, '"crush_location":' '"{}"' '}' ']' '},' '"quorum":' '[' 0 '],' '"osdmap":' '{' '"epoch":' 32, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"created":' '"2024-09-16T03:22:46.906117+0000",' '"modified":' '"2024-09-16T03:25:05.447882+0000",' '"last_up_change":' '"2024-09-16T03:24:37.708512+0000",' '"last_in_change":' '"2024-09-16T03:24:01.831039+0000",' '"flags":' '"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit",' '"flags_num":' 5799936, '"flags_set":' '[' '"pglog_hardlimit",' '"purged_snapdirs",' '"recovery_deletes",' '"sortbitwise"' '],' '"crush_version":' 7, '"full_ratio":' 0.97000002861022949, '"backfillfull_ratio":' 0.97000002861022949, '"nearfull_ratio":' 0.85000002384185791, '"cluster_snapshot":' '"",' '"pool_max":' 2, '"max_osd":' 3, '"require_min_compat_client":' '"luminous",' '"min_compat_client":' '"jewel",' '"require_osd_release":' '"squid",' '"allow_crimson":' false, '"pools":' '[' '{' '"pool":' 1, '"pool_name":' '"foo",' '"create_time":' '"2024-09-16T03:24:44.525189+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"30",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.690000057220459, '"score_stable":' 1.690000057220459, '"optimal_score":' 1, '"raw_score_acting":' 1.690000057220459, '"raw_score_stable":' 1.690000057220459, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '},' '{' '"pool":' 2, '"pool_name":' '"bar",' '"create_time":' '"2024-09-16T03:24:46.226575+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"32",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.1299999952316284, '"score_stable":' 1.1299999952316284, '"optimal_score":' 1, '"raw_score_acting":' 1.1299999952316284, '"raw_score_stable":' 1.1299999952316284, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '}' '],' '"osds":' '[' '{' '"osd":' 0, '"uuid":' '"64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 5, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6802",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6803",' '"nonce":' 3375787448 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6804",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6805",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6808",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6809",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6806",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6807",' '"nonce":' 3375787448 '}' ']' '},' '"public_addr":' '"127.0.0.1:6803/3375787448",' '"cluster_addr":' '"127.0.0.1:6805/3375787448",' '"heartbeat_back_addr":' '"127.0.0.1:6809/3375787448",' '"heartbeat_front_addr":' '"127.0.0.1:6807/3375787448",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 1, '"uuid":' '"74b26727-75c9-444d-8782-719e4197a382",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 10, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6810",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6811",' '"nonce":' 3733255132 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6812",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6813",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6816",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6817",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6814",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6815",' '"nonce":' 3733255132 '}' ']' '},' '"public_addr":' '"127.0.0.1:6811/3733255132",' '"cluster_addr":' '"127.0.0.1:6813/3733255132",' '"heartbeat_back_addr":' '"127.0.0.1:6817/3733255132",' '"heartbeat_front_addr":' '"127.0.0.1:6815/3733255132",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 2, '"uuid":' '"143da3a7-dad9-4b1e-966b-76cf5bdd3c82",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 15, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6818",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6819",' '"nonce":' 963814857 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6820",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6821",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6824",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6825",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6822",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6823",' '"nonce":' 963814857 '}' ']' '},' '"public_addr":' '"127.0.0.1:6819/963814857",' '"cluster_addr":' '"127.0.0.1:6821/963814857",' '"heartbeat_back_addr":' '"127.0.0.1:6825/963814857",' '"heartbeat_front_addr":' '"127.0.0.1:6823/963814857",' '"state":' '[' '"exists",' '"up"' ']' '}' '],' '"osd_xinfo":' '[' '{' '"osd":' 0, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:22.481942+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 1, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:59.663703+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 2, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:24:37.320822+0000",' '"dead_epoch":' 0 '}' '],' '"pg_upmap":' '[],' '"pg_upmap_items":' '[],' '"pg_upmap_primaries":' '[],' '"pg_temp":' '[],' '"primary_temp":' '[],' '"blocklist":' '{},' '"range_blocklist":' '{},' '"erasure_code_profiles":' '{' '"default":' '{' '"k":' '"2",' '"m":' '"2",' '"plugin":' '"jerasure",' '"technique":' '"reed_sol_van"' '}' '},' '"removed_snaps_queue":' '[],' '"new_removed_snaps":' '[],' '"new_purged_snaps":' '[],' '"crush_node_flags":' '{},' '"device_class_flags":' '{},' '"stretch_mode":' '{' '"stretch_mode_enabled":' false, '"stretch_bucket_count":' 0, '"degraded_stretch_mode":' 0, '"recovering_stretch_mode":' 0, '"stretch_mode_bucket":' 0 '}' '},' '"osd_metadata":' '[' '{' '"id":' 0, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/0/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:22:53.662571Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]",' '"hb_front_addr":' '"[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/0",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 1, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/1/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:23:30.129885Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]",' '"hb_front_addr":' '"[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/1",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 2, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/2/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:24:07.764502Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]",' '"hb_front_addr":' '"[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/2",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '}' '],' '"osdmap_clean_epochs":' '{' '"min_last_epoch_clean":' 28, '"last_epoch_clean":' '{' '"per_pool":' '[' '{' '"poolid":' 1, '"floor":' 28 '},' '{' '"poolid":' 2, '"floor":' 28 '}' ']' '},' '"osd_epochs":' '[' '{' '"id":' 0, '"epoch":' 28 '},' '{' '"id":' 1, '"epoch":' 28 '},' '{' '"id":' 2, '"epoch":' 28 '}' ']' '},' '"osdmap_first_committed":' 26, '"osdmap_last_committed":' 32, '"crushmap":' '{' '"devices":' '[' '{' '"id":' 0, '"name":' '"osd.0",' '"class":' '"hdd"' '},' '{' '"id":' 1, '"name":' '"osd.1",' '"class":' '"hdd"' '},' '{' '"id":' 2, '"name":' '"osd.2",' '"class":' '"hdd"' '}' '],' '"types":' '[' '{' '"type_id":' 0, '"name":' '"osd"' '},' '{' '"type_id":' 1, '"name":' '"host"' '},' '{' '"type_id":' 2, '"name":' '"chassis"' '},' '{' '"type_id":' 3, '"name":' '"rack"' '},' '{' '"type_id":' 4, '"name":' '"row"' '},' '{' '"type_id":' 5, '"name":' '"pdu"' '},' '{' '"type_id":' 6, '"name":' '"pod"' '},' '{' '"type_id":' 7, '"name":' '"room"' '},' '{' '"type_id":' 8, '"name":' '"datacenter"' '},' '{' '"type_id":' 9, '"name":' '"zone"' '},' '{' '"type_id":' 10, '"name":' '"region"' '},' '{' '"type_id":' 11, '"name":' '"root"' '}' '],' '"buckets":' '[' '{' '"id":' -1, '"name":' '"default",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -3, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -2, '"name":' '"default~hdd",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -4, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -3, '"name":' '"smithi096",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '},' '{' '"id":' -4, '"name":' '"smithi096~hdd",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '}' '],' '"rules":' '[' '{' '"rule_id":' 0, '"rule_name":' '"replicated_rule",' '"type":' 1, '"steps":' '[' '{' '"op":' '"take",' '"item":' -1, '"item_name":' '"default"' '},' '{' '"op":' '"choose_firstn",' '"num":' 0, '"type":' '"osd"' '},' '{' '"op":' '"emit"' '}' ']' '}' '],' '"tunables":' '{' '"choose_local_tries":' 0, '"choose_local_fallback_tries":' 0, '"choose_total_tries":' 50, '"chooseleaf_descend_once":' 1, '"chooseleaf_vary_r":' 1, '"chooseleaf_stable":' 1, '"msr_descents":' 100, '"msr_collision_tries":' 100, '"straw_calc_version":' 1, '"allowed_bucket_algs":' 54, '"profile":' '"jewel",' '"optimal_tunables":' 1, '"legacy_tunables":' 0, '"minimum_required_version":' '"jewel",' '"require_feature_tunables":' 1, '"require_feature_tunables2":' 1, '"has_v2_rules":' 0, '"require_feature_tunables3":' 1, '"has_v3_rules":' 0, '"has_v4_buckets":' 1, '"require_feature_tunables5":' 1, '"has_v5_rules":' 0, '"has_msr_rules":' 0 '},' '"choose_args":' '{}' '},' '"fsmap":' '{' '"epoch":' 1, '"btime":' '"2024-09-16T03:22:46:882186+0000",' '"default_fscid":' -1, '"compat":' '{' '"compat":' '{},' '"ro_compat":' '{},' '"incompat":' '{' '"feature_1":' '"base' 'v0.20",' '"feature_2":' '"client' writeable 'ranges",' '"feature_3":' '"default' file layouts on 'dirs",' '"feature_4":' '"dir' inode in separate 'object",' '"feature_5":' '"mds' uses versioned 'encoding",' '"feature_6":' '"dirfrag' is stored in 'omap",' '"feature_8":' '"no' anchor 'table",' '"feature_9":' '"file' layout 'v2",' '"feature_10":' '"snaprealm' 'v2",' '"feature_11":' '"minor' log 'segments",' '"feature_12":' '"quiesce' 'subvolumes"' '}' '},' '"feature_flags":' '{' '"enable_multiple":' true, '"ever_enabled_multiple":' true '},' '"standbys":' '[],' '"filesystems":' '[]' '},' '"mdsmap_first_committed":' 1, '"mdsmap_last_committed":' 1, '"auth":' '{' '"first_committed":' 1, '"last_committed":' 5, '"num_secrets":' 3 '},' '"num_pg":' 64, '"num_pg_active":' 64, '"num_pg_unknown":' 0, '"num_osd":' 3, '"pool_sum":' '{' '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 192, '"acting":' 192, '"num_store_stats":' 0 '},' '"osd_sum":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 192, '"num_osds":' 3, '"num_per_pool_osds":' 3, '"num_per_pool_omap_osds":' 3, '"kb":' 314572800, '"kb_used":' 81232, '"kb_used_data":' 696, '"kb_used_omap":' 4, '"kb_used_meta":' 80443, '"kb_avail":' 314491568, '"statfs":' '{' '"total":' 322122547200, '"available":' 322039365632, '"internally_reserved":' 0, '"allocated":' 712704, '"data_stored":' 209643, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 4785, '"internal_metadata":' 82373967 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 108, '"apply_latency_ms":' 108, '"commit_latency_ns":' 108000000, '"apply_latency_ns":' 108000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '},' '"osd_sum_by_class":' '{' '"hdd":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 192, '"num_osds":' 3, '"num_per_pool_osds":' 3, '"num_per_pool_omap_osds":' 3, '"kb":' 314572800, '"kb_used":' 81232, '"kb_used_data":' 696, '"kb_used_omap":' 4, '"kb_used_meta":' 80443, '"kb_avail":' 314491568, '"statfs":' '{' '"total":' 322122547200, '"available":' 322039365632, '"internally_reserved":' 0, '"allocated":' 712704, '"data_stored":' 209643, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 4785, '"internal_metadata":' 82373967 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 108, '"apply_latency_ms":' 108, '"commit_latency_ns":' 108000000, '"apply_latency_ns":' 108000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '}' '},' '"pool_stats":' '[' '{' '"poolid":' 2, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 96, '"acting":' 96, '"num_store_stats":' 3 '},' '{' '"poolid":' 1, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 96, '"acting":' 96, '"num_store_stats":' 3 '}' '],' '"osd_stats":' '[' '{' '"osd":' 0, '"seq":' 21474836507 '},' '{' '"osd":' 1, '"seq":' 42949672979 '},' '{' '"osd":' 2, '"seq":' 64424509451 '}' '],' '"num_pg_by_state":' '[' '{' '"state":' '"active+clean",' '"num":' 64 '}' '],' '"num_pg_by_osd":' '[' '{' '"osd":' 2, '"num_primary_pg":' 15, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 0, '"num_primary_pg":' 20, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 1, '"num_primary_pg":' 29, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '}' '],' '"purged_snaps":' '[' '{' '"pool":' 1, '"purged_snaps":' '{}' '},' '{' '"pool":' 2, '"purged_snaps":' '{}' '}' '],' '"servicemap":' '{' '"epoch":' 4, '"modified":' '"2024-09-16T03:25:02.412573+0000",' '"services":' '{' '"osd":' '{' '"daemons":' '{' '"summary":' '"",' '"2":' '{' '"start_epoch":' 0, '"start_stamp":' '"0.000000",' '"gid":' 0, '"addr":' '"(unrecognized' address family '0)/0",' '"metadata":' '{},' '"task_status":' '{}' '}' '}' '}' '}' '},' '"mgrstat_first_committed":' 52, '"mgrstat_last_committed":' 59, '"logm_first_committed":' 1, '"logm_last_committed":' 259, '"paxos":' '{' '"first_committed":' 1, '"last_committed":' 362, '"last_pn":' 0, '"accepted_pn":' 0 '}' '}' 2024-09-16T03:25:07.114 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:38: check_lec_equals_pools: [[ 0 -eq 2 ]] 2024-09-16T03:25:07.114 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:38: check_lec_equals_pools: echo '{' '"cluster_fingerprint":' '"fda2fc64-07ed-4add-8224-2e527e11d427",' '"version":' '"19.3.0-4930-gfc3e0bff",' '"commit":' '"fc3e0bff7468fd55478adbae7f75508b749124b6",' '"timestamp":' '"2024-09-16T03:25:06.993636+0000",' '"tag":' '"",' '"health":' '{' '"status":' '"HEALTH_OK",' '"checks":' '{},' '"mutes":' '[]' '},' '"monmap_first_committed":' 1, '"monmap_last_committed":' 1, '"monmap":' '{' '"epoch":' 1, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"modified":' '"2024-09-16T03:22:45.872880Z",' '"created":' '"2024-09-16T03:22:45.872880Z",' '"min_mon_release":' 19, '"min_mon_release_name":' '"squid",' '"election_strategy":' 1, '"disallowed_leaders:' '":' '"",' '"stretch_mode":' false, '"tiebreaker_mon":' '"",' '"removed_ranks:' '":' '"",' '"features":' '{' '"persistent":' '[' '"kraken",' '"luminous",' '"mimic",' '"osdmap-prune",' '"nautilus",' '"octopus",' '"pacific",' '"elector-pinging",' '"quincy",' '"reef",' '"squid"' '],' '"optional":' '[]' '},' '"mons":' '[' '{' '"rank":' 0, '"name":' '"a",' '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:7302",' '"nonce":' 0 '}' ']' '},' '"addr":' '"127.0.0.1:7302/0",' '"public_addr":' '"127.0.0.1:7302/0",' '"priority":' 0, '"weight":' 0, '"crush_location":' '"{}"' '}' ']' '},' '"quorum":' '[' 0 '],' '"osdmap":' '{' '"epoch":' 32, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"created":' '"2024-09-16T03:22:46.906117+0000",' '"modified":' '"2024-09-16T03:25:05.447882+0000",' '"last_up_change":' '"2024-09-16T03:24:37.708512+0000",' '"last_in_change":' '"2024-09-16T03:24:01.831039+0000",' '"flags":' '"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit",' '"flags_num":' 5799936, '"flags_set":' '[' '"pglog_hardlimit",' '"purged_snapdirs",' '"recovery_deletes",' '"sortbitwise"' '],' '"crush_version":' 7, '"full_ratio":' 0.97000002861022949, '"backfillfull_ratio":' 0.97000002861022949, '"nearfull_ratio":' 0.85000002384185791, '"cluster_snapshot":' '"",' '"pool_max":' 2, '"max_osd":' 3, '"require_min_compat_client":' '"luminous",' '"min_compat_client":' '"jewel",' '"require_osd_release":' '"squid",' '"allow_crimson":' false, '"pools":' '[' '{' '"pool":' 1, '"pool_name":' '"foo",' '"create_time":' '"2024-09-16T03:24:44.525189+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"30",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.690000057220459, '"score_stable":' 1.690000057220459, '"optimal_score":' 1, '"raw_score_acting":' 1.690000057220459, '"raw_score_stable":' 1.690000057220459, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '},' '{' '"pool":' 2, '"pool_name":' '"bar",' '"create_time":' '"2024-09-16T03:24:46.226575+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"32",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.1299999952316284, '"score_stable":' 1.1299999952316284, '"optimal_score":' 1, '"raw_score_acting":' 1.1299999952316284, '"raw_score_stable":' 1.1299999952316284, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '}' '],' '"osds":' '[' '{' '"osd":' 0, '"uuid":' '"64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 5, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6802",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6803",' '"nonce":' 3375787448 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6804",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6805",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6808",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6809",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6806",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6807",' '"nonce":' 3375787448 '}' ']' '},' '"public_addr":' '"127.0.0.1:6803/3375787448",' '"cluster_addr":' '"127.0.0.1:6805/3375787448",' '"heartbeat_back_addr":' '"127.0.0.1:6809/3375787448",' '"heartbeat_front_addr":' '"127.0.0.1:6807/3375787448",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 1, '"uuid":' '"74b26727-75c9-444d-8782-719e4197a382",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 10, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6810",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6811",' '"nonce":' 3733255132 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6812",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6813",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6816",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6817",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6814",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6815",' '"nonce":' 3733255132 '}' ']' '},' '"public_addr":' '"127.0.0.1:6811/3733255132",' '"cluster_addr":' '"127.0.0.1:6813/3733255132",' '"heartbeat_back_addr":' '"127.0.0.1:6817/3733255132",' '"heartbeat_front_addr":' '"127.0.0.1:6815/3733255132",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 2, '"uuid":' '"143da3a7-dad9-4b1e-966b-76cf5bdd3c82",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 15, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6818",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6819",' '"nonce":' 963814857 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6820",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6821",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6824",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6825",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6822",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6823",' '"nonce":' 963814857 '}' ']' '},' '"public_addr":' '"127.0.0.1:6819/963814857",' '"cluster_addr":' '"127.0.0.1:6821/963814857",' '"heartbeat_back_addr":' '"127.0.0.1:6825/963814857",' '"heartbeat_front_addr":' '"127.0.0.1:6823/963814857",' '"state":' '[' '"exists",' '"up"' ']' '}' '],' '"osd_xinfo":' '[' '{' '"osd":' 0, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:22.481942+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 1, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:59.663703+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 2, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:24:37.320822+0000",' '"dead_epoch":' 0 '}' '],' '"pg_upmap":' '[],' '"pg_upmap_items":' '[],' '"pg_upmap_primaries":' '[],' '"pg_temp":' '[],' '"primary_temp":' '[],' '"blocklist":' '{},' '"range_blocklist":' '{},' '"erasure_code_profiles":' '{' '"default":' '{' '"k":' '"2",' '"m":' '"2",' '"plugin":' '"jerasure",' '"technique":' '"reed_sol_van"' '}' '},' '"removed_snaps_queue":' '[],' '"new_removed_snaps":' '[],' '"new_purged_snaps":' '[],' '"crush_node_flags":' '{},' '"device_class_flags":' '{},' '"stretch_mode":' '{' '"stretch_mode_enabled":' false, '"stretch_bucket_count":' 0, '"degraded_stretch_mode":' 0, '"recovering_stretch_mode":' 0, '"stretch_mode_bucket":' 0 '}' '},' '"osd_metadata":' '[' '{' '"id":' 0, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/0/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:22:53.662571Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]",' '"hb_front_addr":' '"[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/0",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 1, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/1/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:23:30.129885Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]",' '"hb_front_addr":' '"[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/1",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 2, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/2/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:24:07.764502Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]",' '"hb_front_addr":' '"[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/2",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '}' '],' '"osdmap_clean_epochs":' '{' '"min_last_epoch_clean":' 28, '"last_epoch_clean":' '{' '"per_pool":' '[' '{' '"poolid":' 1, '"floor":' 28 '},' '{' '"poolid":' 2, '"floor":' 28 '}' ']' '},' '"osd_epochs":' '[' '{' '"id":' 0, '"epoch":' 28 '},' '{' '"id":' 1, '"epoch":' 28 '},' '{' '"id":' 2, '"epoch":' 28 '}' ']' '},' '"osdmap_first_committed":' 26, '"osdmap_last_committed":' 32, '"crushmap":' '{' '"devices":' '[' '{' '"id":' 0, '"name":' '"osd.0",' '"class":' '"hdd"' '},' '{' '"id":' 1, '"name":' '"osd.1",' '"class":' '"hdd"' '},' '{' '"id":' 2, '"name":' '"osd.2",' '"class":' '"hdd"' '}' '],' '"types":' '[' '{' '"type_id":' 0, '"name":' '"osd"' '},' '{' '"type_id":' 1, '"name":' '"host"' '},' '{' '"type_id":' 2, '"name":' '"chassis"' '},' '{' '"type_id":' 3, '"name":' '"rack"' '},' '{' '"type_id":' 4, '"name":' '"row"' '},' '{' '"type_id":' 5, '"name":' '"pdu"' '},' '{' '"type_id":' 6, '"name":' '"pod"' '},' '{' '"type_id":' 7, '"name":' '"room"' '},' '{' '"type_id":' 8, '"name":' '"datacenter"' '},' '{' '"type_id":' 9, '"name":' '"zone"' '},' '{' '"type_id":' 10, '"name":' '"region"' '},' '{' '"type_id":' 11, '"name":' '"root"' '}' '],' '"buckets":' '[' '{' '"id":' -1, '"name":' '"default",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -3, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -2, '"name":' '"default~hdd",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -4, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -3, '"name":' '"smithi096",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '},' '{' '"id":' -4, '"name":' '"smithi096~hdd",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '}' '],' '"rules":' '[' '{' '"rule_id":' 0, '"rule_name":' '"replicated_rule",' '"type":' 1, '"steps":' '[' '{' '"op":' '"take",' '"item":' -1, '"item_name":' '"default"' '},' '{' '"op":' '"choose_firstn",' '"num":' 0, '"type":' '"osd"' '},' '{' '"op":' '"emit"' '}' ']' '}' '],' '"tunables":' '{' '"choose_local_tries":' 0, '"choose_local_fallback_tries":' 0, '"choose_total_tries":' 50, '"chooseleaf_descend_once":' 1, '"chooseleaf_vary_r":' 1, '"chooseleaf_stable":' 1, '"msr_descents":' 100, '"msr_collision_tries":' 100, '"straw_calc_version":' 1, '"allowed_bucket_algs":' 54, '"profile":' '"jewel",' '"optimal_tunables":' 1, '"legacy_tunables":' 0, '"minimum_required_version":' '"jewel",' '"require_feature_tunables":' 1, '"require_feature_tunables2":' 1, '"has_v2_rules":' 0, '"require_feature_tunables3":' 1, '"has_v3_rules":' 0, '"has_v4_buckets":' 1, '"require_feature_tunables5":' 1, '"has_v5_rules":' 0, '"has_msr_rules":' 0 '},' '"choose_args":' '{}' '},' '"fsmap":' '{' '"epoch":' 1, '"btime":' '"2024-09-16T03:22:46:882186+0000",' '"default_fscid":' -1, '"compat":' '{' '"compat":' '{},' '"ro_compat":' '{},' '"incompat":' '{' '"feature_1":' '"base' 'v0.20",' '"feature_2":' '"client' writeable 'ranges",' '"feature_3":' '"default' file layouts on 'dirs",' '"feature_4":' '"dir' inode in separate 'object",' '"feature_5":' '"mds' uses versioned 'encoding",' '"feature_6":' '"dirfrag' is stored in 'omap",' '"feature_8":' '"no' anchor 'table",' '"feature_9":' '"file' layout 'v2",' '"feature_10":' '"snaprealm' 'v2",' '"feature_11":' '"minor' log 'segments",' '"feature_12":' '"quiesce' 'subvolumes"' '}' '},' '"feature_flags":' '{' '"enable_multiple":' true, '"ever_enabled_multiple":' true '},' '"standbys":' '[],' '"filesystems":' '[]' '},' '"mdsmap_first_committed":' 1, '"mdsmap_last_committed":' 1, '"auth":' '{' '"first_committed":' 1, '"last_committed":' 5, '"num_secrets":' 3 '},' '"num_pg":' 64, '"num_pg_active":' 64, '"num_pg_unknown":' 0, '"num_osd":' 3, '"pool_sum":' '{' '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 192, '"acting":' 192, '"num_store_stats":' 0 '},' '"osd_sum":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 192, '"num_osds":' 3, '"num_per_pool_osds":' 3, '"num_per_pool_omap_osds":' 3, '"kb":' 314572800, '"kb_used":' 81232, '"kb_used_data":' 696, '"kb_used_omap":' 4, '"kb_used_meta":' 80443, '"kb_avail":' 314491568, '"statfs":' '{' '"total":' 322122547200, '"available":' 322039365632, '"internally_reserved":' 0, '"allocated":' 712704, '"data_stored":' 209643, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 4785, '"internal_metadata":' 82373967 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 108, '"apply_latency_ms":' 108, '"commit_latency_ns":' 108000000, '"apply_latency_ns":' 108000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '},' '"osd_sum_by_class":' '{' '"hdd":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 192, '"num_osds":' 3, '"num_per_pool_osds":' 3, '"num_per_pool_omap_osds":' 3, '"kb":' 314572800, '"kb_used":' 81232, '"kb_used_data":' 696, '"kb_used_omap":' 4, '"kb_used_meta":' 80443, '"kb_avail":' 314491568, '"statfs":' '{' '"total":' 322122547200, '"available":' 322039365632, '"internally_reserved":' 0, '"allocated":' 712704, '"data_stored":' 209643, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 4785, '"internal_metadata":' 82373967 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 108, '"apply_latency_ms":' 108, '"commit_latency_ns":' 108000000, '"apply_latency_ns":' 108000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '}' '},' '"pool_stats":' '[' '{' '"poolid":' 2, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 96, '"acting":' 96, '"num_store_stats":' 3 '},' '{' '"poolid":' 1, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 96, '"acting":' 96, '"num_store_stats":' 3 '}' '],' '"osd_stats":' '[' '{' '"osd":' 0, '"seq":' 21474836507 '},' '{' '"osd":' 1, '"seq":' 42949672979 '},' '{' '"osd":' 2, '"seq":' 64424509451 '}' '],' '"num_pg_by_state":' '[' '{' '"state":' '"active+clean",' '"num":' 64 '}' '],' '"num_pg_by_osd":' '[' '{' '"osd":' 2, '"num_primary_pg":' 15, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 0, '"num_primary_pg":' 20, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 1, '"num_primary_pg":' 29, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '}' '],' '"purged_snaps":' '[' '{' '"pool":' 1, '"purged_snaps":' '{}' '},' '{' '"pool":' 2, '"purged_snaps":' '{}' '}' '],' '"servicemap":' '{' '"epoch":' 4, '"modified":' '"2024-09-16T03:25:02.412573+0000",' '"services":' '{' '"osd":' '{' '"daemons":' '{' '"summary":' '"",' '"2":' '{' '"start_epoch":' 0, '"start_stamp":' '"0.000000",' '"gid":' 0, '"addr":' '"(unrecognized' address family '0)/0",' '"metadata":' '{},' '"task_status":' '{}' '}' '}' '}' '}' '},' '"mgrstat_first_committed":' 52, '"mgrstat_last_committed":' 59, '"logm_first_committed":' 1, '"logm_last_committed":' 259, '"paxos":' '{' '"first_committed":' 1, '"last_committed":' 362, '"last_pn":' 0, '"accepted_pn":' 0 '}' '}' 2024-09-16T03:25:07.115 INFO:tasks.workunit.client.0.smithi096.stdout:{ "cluster_fingerprint": "fda2fc64-07ed-4add-8224-2e527e11d427", "version": "19.3.0-4930-gfc3e0bff", "commit": "fc3e0bff7468fd55478adbae7f75508b749124b6", "timestamp": "2024-09-16T03:25:06.993636+0000", "tag": "", "health": { "status": "HEALTH_OK", "checks": {}, "mutes": [] }, "monmap_first_committed": 1, "monmap_last_committed": 1, "monmap": { "epoch": 1, "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", "modified": "2024-09-16T03:22:45.872880Z", "created": "2024-09-16T03:22:45.872880Z", "min_mon_release": 19, "min_mon_release_name": "squid", "election_strategy": 1, "disallowed_leaders: ": "", "stretch_mode": false, "tiebreaker_mon": "", "removed_ranks: ": "", "features": { "persistent": [ "kraken", "luminous", "mimic", "osdmap-prune", "nautilus", "octopus", "pacific", "elector-pinging", "quincy", "reef", "squid" ], "optional": [] }, "mons": [ { "rank": 0, "name": "a", "public_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:7302", "nonce": 0 } ] }, "addr": "127.0.0.1:7302/0", "public_addr": "127.0.0.1:7302/0", "priority": 0, "weight": 0, "crush_location": "{}" } ] }, "quorum": [ 0 ], "osdmap": { "epoch": 32, "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", "created": "2024-09-16T03:22:46.906117+0000", "modified": "2024-09-16T03:25:05.447882+0000", "last_up_change": "2024-09-16T03:24:37.708512+0000", "last_in_change": "2024-09-16T03:24:01.831039+0000", "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", "flags_num": 5799936, "flags_set": [ "pglog_hardlimit", "purged_snapdirs", "recovery_deletes", "sortbitwise" ], "crush_version": 7, "full_ratio": 0.97000002861022949, "backfillfull_ratio": 0.97000002861022949, "nearfull_ratio": 0.85000002384185791, "cluster_snapshot": "", "pool_max": 2, "max_osd": 3, "require_min_compat_client": "luminous", "min_compat_client": "jewel", "require_osd_release": "squid", "allow_crimson": false, "pools": [ { "pool": 1, "pool_name": "foo", "create_time": "2024-09-16T03:24:44.525189+0000", "flags": 1, "flags_names": "hashpspool", "type": 1, "size": 3, "min_size": 2, "crush_rule": 0, "peering_crush_bucket_count": 0, "peering_crush_bucket_target": 0, "peering_crush_bucket_barrier": 0, "peering_crush_bucket_mandatory_member": 2147483647, "is_stretch_pool": false, "object_hash": 2, "pg_autoscale_mode": "off", "pg_num": 32, "pg_placement_num": 32, "pg_placement_num_target": 32, "pg_num_target": 32, "pg_num_pending": 32, "last_pg_merge_meta": { "source_pgid": "0.0", "ready_epoch": 0, "last_epoch_started": 0, "last_epoch_clean": 0, "source_version": "0'0", "target_version": "0'0" }, "last_change": "30", "last_force_op_resend": "0", "last_force_op_resend_prenautilus": "0", "last_force_op_resend_preluminous": "0", "auid": 0, "snap_mode": "selfmanaged", "snap_seq": 0, "snap_epoch": 0, "pool_snaps": [], "removed_snaps": "[]", "quota_max_bytes": 0, "quota_max_objects": 0, "tiers": [], "tier_of": -1, "read_tier": -1, "write_tier": -1, "cache_mode": "none", "target_max_bytes": 0, "target_max_objects": 0, "cache_target_dirty_ratio_micro": 400000, "cache_target_dirty_high_ratio_micro": 600000, "cache_target_full_ratio_micro": 800000, "cache_min_flush_age": 0, "cache_min_evict_age": 0, "erasure_code_profile": "", "hit_set_params": { "type": "none" }, "hit_set_period": 0, "hit_set_count": 0, "use_gmt_hitset": true, "min_read_recency_for_promote": 0, "min_write_recency_for_promote": 0, "hit_set_grade_decay_rate": 0, "hit_set_search_last_n": 0, "grade_table": [], "stripe_width": 0, "expected_num_objects": 0, "fast_read": false, "options": {}, "application_metadata": {}, "read_balance": { "score_type": "Fair distribution", "score_acting": 1.690000057220459, "score_stable": 1.690000057220459, "optimal_score": 1, "raw_score_acting": 1.690000057220459, "raw_score_stable": 1.690000057220459, "primary_affinity_weighted": 1, "average_primary_affinity": 1, "average_primary_affinity_weighted": 1 } }, { "pool": 2, "pool_name": "bar", "create_time": "2024-09-16T03:24:46.226575+0000", "flags": 1, "flags_names": "hashpspool", "type": 1, "size": 3, "min_size": 2, "crush_rule": 0, "peering_crush_bucket_count": 0, "peering_crush_bucket_target": 0, "peering_crush_bucket_barrier": 0, "peering_crush_bucket_mandatory_member": 2147483647, "is_stretch_pool": false, "object_hash": 2, "pg_autoscale_mode": "off", "pg_num": 32, "pg_placement_num": 32, "pg_placement_num_target": 32, "pg_num_target": 32, "pg_num_pending": 32, "last_pg_merge_meta": { "source_pgid": "0.0", "ready_epoch": 0, "last_epoch_started": 0, "last_epoch_clean": 0, "source_version": "0'0", "target_version": "0'0" }, "last_change": "32", "last_force_op_resend": "0", "last_force_op_resend_prenautilus": "0", "last_force_op_resend_preluminous": "0", "auid": 0, "snap_mode": "selfmanaged", "snap_seq": 0, "snap_epoch": 0, "pool_snaps": [], "removed_snaps": "[]", "quota_max_bytes": 0, "quota_max_objects": 0, "tiers": [], "tier_of": -1, "read_tier": -1, "write_tier": -1, "cache_mode": "none", "target_max_bytes": 0, "target_max_objects": 0, "cache_target_dirty_ratio_micro": 400000, "cache_target_dirty_high_ratio_micro": 600000, "cache_target_full_ratio_micro": 800000, "cache_min_flush_age": 0, "cache_min_evict_age": 0, "erasure_code_profile": "", "hit_set_params": { "type": "none" }, "hit_set_period": 0, "hit_set_count": 0, "use_gmt_hitset": true, "min_read_recency_for_promote": 0, "min_write_recency_for_promote": 0, "hit_set_grade_decay_rate": 0, "hit_set_search_last_n": 0, "grade_table": [], "stripe_width": 0, "expected_num_objects": 0, "fast_read": false, "options": {}, "application_metadata": {}, "read_balance": { "score_type": "Fair distribution", "score_acting": 1.1299999952316284, "score_stable": 1.1299999952316284, "optimal_score": 1, "raw_score_acting": 1.1299999952316284, "raw_score_stable": 1.1299999952316284, "primary_affinity_weighted": 1, "average_primary_affinity": 1, "average_primary_affinity_weighted": 1 } } ], "osds": [ { "osd": 0, "uuid": "64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6", "up": 1, "in": 1, "weight": 1, "primary_affinity": 1, "last_clean_begin": 0, "last_clean_end": 0, "up_from": 5, "up_thru": 21, "down_at": 0, "lost_at": 0, "public_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6802", "nonce": 3375787448 }, { "type": "v1", "addr": "127.0.0.1:6803", "nonce": 3375787448 } ] }, "cluster_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6804", "nonce": 3375787448 }, { "type": "v1", "addr": "127.0.0.1:6805", "nonce": 3375787448 } ] }, "heartbeat_back_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6808", "nonce": 3375787448 }, { "type": "v1", "addr": "127.0.0.1:6809", "nonce": 3375787448 } ] }, "heartbeat_front_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6806", "nonce": 3375787448 }, { "type": "v1", "addr": "127.0.0.1:6807", "nonce": 3375787448 } ] }, "public_addr": "127.0.0.1:6803/3375787448", "cluster_addr": "127.0.0.1:6805/3375787448", "heartbeat_back_addr": "127.0.0.1:6809/3375787448", "heartbeat_front_addr": "127.0.0.1:6807/3375787448", "state": [ "exists", "up" ] }, { "osd": 1, "uuid": "74b26727-75c9-444d-8782-719e4197a382", "up": 1, "in": 1, "weight": 1, "primary_affinity": 1, "last_clean_begin": 0, "last_clean_end": 0, "up_from": 10, "up_thru": 21, "down_at": 0, "lost_at": 0, "public_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6810", "nonce": 3733255132 }, { "type": "v1", "addr": "127.0.0.1:6811", "nonce": 3733255132 } ] }, "cluster_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6812", "nonce": 3733255132 }, { "type": "v1", "addr": "127.0.0.1:6813", "nonce": 3733255132 } ] }, "heartbeat_back_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6816", "nonce": 3733255132 }, { "type": "v1", "addr": "127.0.0.1:6817", "nonce": 3733255132 } ] }, "heartbeat_front_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6814", "nonce": 3733255132 }, { "type": "v1", "addr": "127.0.0.1:6815", "nonce": 3733255132 } ] }, "public_addr": "127.0.0.1:6811/3733255132", "cluster_addr": "127.0.0.1:6813/3733255132", "heartbeat_back_addr": "127.0.0.1:6817/3733255132", "heartbeat_front_addr": "127.0.0.1:6815/3733255132", "state": [ "exists", "up" ] }, { "osd": 2, "uuid": "143da3a7-dad9-4b1e-966b-76cf5bdd3c82", "up": 1, "in": 1, "weight": 1, "primary_affinity": 1, "last_clean_begin": 0, "last_clean_end": 0, "up_from": 15, "up_thru": 21, "down_at": 0, "lost_at": 0, "public_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6818", "nonce": 963814857 }, { "type": "v1", "addr": "127.0.0.1:6819", "nonce": 963814857 } ] }, "cluster_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6820", "nonce": 963814857 }, { "type": "v1", "addr": "127.0.0.1:6821", "nonce": 963814857 } ] }, "heartbeat_back_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6824", "nonce": 963814857 }, { "type": "v1", "addr": "127.0.0.1:6825", "nonce": 963814857 } ] }, "heartbeat_front_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6822", "nonce": 963814857 }, { "type": "v1", "addr": "127.0.0.1:6823", "nonce": 963814857 } ] }, "public_addr": "127.0.0.1:6819/963814857", "cluster_addr": "127.0.0.1:6821/963814857", "heartbeat_back_addr": "127.0.0.1:6825/963814857", "heartbeat_front_addr": "127.0.0.1:6823/963814857", "state": [ "exists", "up" ] } ], "osd_xinfo": [ { "osd": 0, "down_stamp": "0.000000", "laggy_probability": 0, "laggy_interval": 0, "features": 4540719139924082687, "old_weight": 0, "last_purged_snaps_scrub": "2024-09-16T03:23:22.481942+0000", "dead_epoch": 0 }, { "osd": 1, "down_stamp": "0.000000", "laggy_probability": 0, "laggy_interval": 0, "features": 4540719139924082687, "old_weight": 0, "last_purged_snaps_scrub": "2024-09-16T03:23:59.663703+0000", "dead_epoch": 0 }, { "osd": 2, "down_stamp": "0.000000", "laggy_probability": 0, "laggy_interval": 0, "features": 4540719139924082687, "old_weight": 0, "last_purged_snaps_scrub": "2024-09-16T03:24:37.320822+0000", "dead_epoch": 0 } ], "pg_upmap": [], "pg_upmap_items": [], "pg_upmap_primaries": [], "pg_temp": [], "primary_temp": [], "blocklist": {}, "range_blocklist": {}, "erasure_code_profiles": { "default": { "k": "2", "m": "2", "plugin": "jerasure", "technique": "reed_sol_van" } }, "removed_snaps_queue": [], "new_removed_snaps": [], "new_purged_snaps": [], "crush_node_flags": {}, "device_class_flags": {}, "stretch_mode": { "stretch_mode_enabled": false, "stretch_bucket_count": 0, "degraded_stretch_mode": 0, "recovering_stretch_mode": 0, "stretch_mode_bucket": 0 } }, "osd_metadata": [ { "id": 0, "arch": "x86_64", "back_addr": "[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]", "back_iface": "", "bluefs": "1", "bluefs_dedicated_db": "0", "bluefs_dedicated_wal": "0", "bluefs_single_shared_device": "1", "bluestore_allocation_from_file": "0", "bluestore_bdev_access_mode": "file", "bluestore_bdev_block_size": "4096", "bluestore_bdev_devices": "sda", "bluestore_bdev_driver": "KernelDevice", "bluestore_bdev_optimal_io_size": "0", "bluestore_bdev_path": "td/mon-last-clean-epoch/0/block", "bluestore_bdev_rotational": "1", "bluestore_bdev_size": "107374182400", "bluestore_bdev_support_discard": "0", "bluestore_bdev_type": "hdd", "bluestore_min_alloc_size": "4096", "ceph_release": "squid", "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", "ceph_version_short": "19.3.0-4930-gfc3e0bff", "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", "created_at": "2024-09-16T03:22:53.662571Z", "default_device_class": "hdd", "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", "devices": "sda", "distro": "ubuntu", "distro_description": "Ubuntu 22.04.1 LTS", "distro_version": "22.04", "front_addr": "[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]", "front_iface": "", "hb_back_addr": "[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]", "hb_front_addr": "[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]", "hostname": "smithi096", "journal_rotational": "1", "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", "kernel_version": "5.15.0-121-generic", "mem_swap_kb": "2097148", "mem_total_kb": "32746824", "network_numa_unknown_ifaces": "back_iface,front_iface", "objectstore_numa_unknown_devices": "sda", "os": "Linux", "osd_data": "td/mon-last-clean-epoch/0", "osd_objectstore": "bluestore", "osdspec_affinity": "", "rotational": "1" }, { "id": 1, "arch": "x86_64", "back_addr": "[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]", "back_iface": "", "bluefs": "1", "bluefs_dedicated_db": "0", "bluefs_dedicated_wal": "0", "bluefs_single_shared_device": "1", "bluestore_allocation_from_file": "0", "bluestore_bdev_access_mode": "file", "bluestore_bdev_block_size": "4096", "bluestore_bdev_devices": "sda", "bluestore_bdev_driver": "KernelDevice", "bluestore_bdev_optimal_io_size": "0", "bluestore_bdev_path": "td/mon-last-clean-epoch/1/block", "bluestore_bdev_rotational": "1", "bluestore_bdev_size": "107374182400", "bluestore_bdev_support_discard": "0", "bluestore_bdev_type": "hdd", "bluestore_min_alloc_size": "4096", "ceph_release": "squid", "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", "ceph_version_short": "19.3.0-4930-gfc3e0bff", "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", "created_at": "2024-09-16T03:23:30.129885Z", "default_device_class": "hdd", "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", "devices": "sda", "distro": "ubuntu", "distro_description": "Ubuntu 22.04.1 LTS", "distro_version": "22.04", "front_addr": "[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]", "front_iface": "", "hb_back_addr": "[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]", "hb_front_addr": "[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]", "hostname": "smithi096", "journal_rotational": "1", "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", "kernel_version": "5.15.0-121-generic", "mem_swap_kb": "2097148", "mem_total_kb": "32746824", "network_numa_unknown_ifaces": "back_iface,front_iface", "objectstore_numa_unknown_devices": "sda", "os": "Linux", "osd_data": "td/mon-last-clean-epoch/1", "osd_objectstore": "bluestore", "osdspec_affinity": "", "rotational": "1" }, { "id": 2, "arch": "x86_64", "back_addr": "[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]", "back_iface": "", "bluefs": "1", "bluefs_dedicated_db": "0", "bluefs_dedicated_wal": "0", "bluefs_single_shared_device": "1", "bluestore_allocation_from_file": "0", "bluestore_bdev_access_mode": "file", "bluestore_bdev_block_size": "4096", "bluestore_bdev_devices": "sda", "bluestore_bdev_driver": "KernelDevice", "bluestore_bdev_optimal_io_size": "0", "bluestore_bdev_path": "td/mon-last-clean-epoch/2/block", "bluestore_bdev_rotational": "1", "bluestore_bdev_size": "107374182400", "bluestore_bdev_support_discard": "0", "bluestore_bdev_type": "hdd", "bluestore_min_alloc_size": "4096", "ceph_release": "squid", "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", "ceph_version_short": "19.3.0-4930-gfc3e0bff", "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", "created_at": "2024-09-16T03:24:07.764502Z", "default_device_class": "hdd", "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", "devices": "sda", "distro": "ubuntu", "distro_description": "Ubuntu 22.04.1 LTS", "distro_version": "22.04", "front_addr": "[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]", "front_iface": "", "hb_back_addr": "[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]", "hb_front_addr": "[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]", "hostname": "smithi096", "journal_rotational": "1", "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", "kernel_version": "5.15.0-121-generic", "mem_swap_kb": "2097148", "mem_total_kb": "32746824", "network_numa_unknown_ifaces": "back_iface,front_iface", "objectstore_numa_unknown_devices": "sda", "os": "Linux", "osd_data": "td/mon-last-clean-epoch/2", "osd_objectstore": "bluestore", "osdspec_affinity": "", "rotational": "1" } ], "osdmap_clean_epochs": { "min_last_epoch_clean": 28, "last_epoch_clean": { "per_pool": [ { "poolid": 1, "floor": 28 }, { "poolid": 2, "floor": 28 } ] }, "osd_epochs": [ { "id": 0, "epoch": 28 }, { "id": 1, "epoch": 28 }, { "id": 2, "epoch": 28 } ] }, "osdmap_first_committed": 26, "osdmap_last_committed": 32, "crushmap": { "devices": [ { "id": 0, "name": "osd.0", "class": "hdd" }, { "id": 1, "name": "osd.1", "class": "hdd" }, { "id": 2, "name": "osd.2", "class": "hdd" } ], "types": [ { "type_id": 0, "name": "osd" }, { "type_id": 1, "name": "host" }, { "type_id": 2, "name": "chassis" }, { "type_id": 3, "name": "rack" }, { "type_id": 4, "name": "row" }, { "type_id": 5, "name": "pdu" }, { "type_id": 6, "name": "pod" }, { "type_id": 7, "name": "room" }, { "type_id": 8, "name": "datacenter" }, { "type_id": 9, "name": "zone" }, { "type_id": 10, "name": "region" }, { "type_id": 11, "name": "root" } ], "buckets": [ { "id": -1, "name": "default", "type_id": 11, "type_name": "root", "weight": 19206, "alg": "straw2", "hash": "rjenkins1", "items": [ { "id": -3, "weight": 19206, "pos": 0 } ] }, { "id": -2, "name": "default~hdd", "type_id": 11, "type_name": "root", "weight": 19206, "alg": "straw2", "hash": "rjenkins1", "items": [ { "id": -4, "weight": 19206, "pos": 0 } ] }, { "id": -3, "name": "smithi096", "type_id": 1, "type_name": "host", "weight": 19206, "alg": "straw2", "hash": "rjenkins1", "items": [ { "id": 0, "weight": 6402, "pos": 0 }, { "id": 1, "weight": 6402, "pos": 1 }, { "id": 2, "weight": 6402, "pos": 2 } ] }, { "id": -4, "name": "smithi096~hdd", "type_id": 1, "type_name": "host", "weight": 19206, "alg": "straw2", "hash": "rjenkins1", "items": [ { "id": 0, "weight": 6402, "pos": 0 }, { "id": 1, "weight": 6402, "pos": 1 }, { "id": 2, "weight": 6402, "pos": 2 } ] } ], "rules": [ { "rule_id": 0, "rule_name": "replicated_rule", "type": 1, "steps": [ { "op": "take", "item": -1, "item_name": "default" }, { "op": "choose_firstn", "num": 0, "type": "osd" }, { "op": "emit" } ] } ], "tunables": { "choose_local_tries": 0, "choose_local_fallback_tries": 0, "choose_total_tries": 50, "chooseleaf_descend_once": 1, "chooseleaf_vary_r": 1, "chooseleaf_stable": 1, "msr_descents": 100, "msr_collision_tries": 100, "straw_calc_version": 1, "allowed_bucket_algs": 54, "profile": "jewel", "optimal_tunables": 1, "legacy_tunables": 0, "minimum_required_version": "jewel", "require_feature_tunables": 1, "require_feature_tunables2": 1, "has_v2_rules": 0, "require_feature_tunables3": 1, "has_v3_rules": 0, "has_v4_buckets": 1, "require_feature_tunables5": 1, "has_v5_rules": 0, "has_msr_rules": 0 }, "choose_args": {} }, "fsmap": { "epoch": 1, "btime": "2024-09-16T03:22:46:882186+0000", "default_fscid": -1, "compat": { "compat": {}, "ro_compat": {}, "incompat": { "feature_1": "base v0.20", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes" } }, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "standbys": [], "filesystems": [] }, "mdsmap_first_committed": 1, "mdsmap_last_committed": 1, "auth": { "first_committed": 1, "last_committed": 5, "num_secrets": 3 }, "num_pg": 64, "num_pg_active": 64, "num_pg_unknown": 0, "num_osd": 3, "pool_sum": { "stat_sum": { "num_bytes": 0, "num_objects": 0, "num_object_clones": 0, "num_object_copies": 0, "num_objects_missing_on_primary": 0, "num_objects_missing": 0, "num_objects_degraded": 0, "num_objects_misplaced": 0, "num_objects_unfound": 0, "num_objects_dirty": 0, "num_whiteouts": 0, "num_read": 0, "num_read_kb": 0, "num_write": 0, "num_write_kb": 0, "num_scrub_errors": 0, "num_shallow_scrub_errors": 0, "num_deep_scrub_errors": 0, "num_objects_recovered": 0, "num_bytes_recovered": 0, "num_keys_recovered": 0, "num_objects_omap": 0, "num_objects_hit_set_archive": 0, "num_bytes_hit_set_archive": 0, "num_flush": 0, "num_flush_kb": 0, "num_evict": 0, "num_evict_kb": 0, "num_promote": 0, "num_flush_mode_high": 0, "num_flush_mode_low": 0, "num_evict_mode_some": 0, "num_evict_mode_full": 0, "num_objects_pinned": 0, "num_legacy_snapsets": 0, "num_large_omap_objects": 0, "num_objects_manifest": 0, "num_omap_bytes": 0, "num_omap_keys": 0, "num_objects_repaired": 0 }, "store_stats": { "total": 0, "available": 0, "internally_reserved": 0, "allocated": 0, "data_stored": 0, "data_compressed": 0, "data_compressed_allocated": 0, "data_compressed_original": 0, "omap_allocated": 0, "internal_metadata": 0 }, "log_size": 0, "ondisk_log_size": 0, "up": 192, "acting": 192, "num_store_stats": 0 }, "osd_sum": { "up_from": 0, "seq": 0, "num_pgs": 192, "num_osds": 3, "num_per_pool_osds": 3, "num_per_pool_omap_osds": 3, "kb": 314572800, "kb_used": 81232, "kb_used_data": 696, "kb_used_omap": 4, "kb_used_meta": 80443, "kb_avail": 314491568, "statfs": { "total": 322122547200, "available": 322039365632, "internally_reserved": 0, "allocated": 712704, "data_stored": 209643, "data_compressed": 0, "data_compressed_allocated": 0, "data_compressed_original": 0, "omap_allocated": 4785, "internal_metadata": 82373967 }, "hb_peers": [], "snap_trim_queue_len": 0, "num_snap_trimming": 0, "num_shards_repaired": 0, "op_queue_age_hist": { "histogram": [], "upper_bound": 1 }, "perf_stat": { "commit_latency_ms": 108, "apply_latency_ms": 108, "commit_latency_ns": 108000000, "apply_latency_ns": 108000000 }, "alerts": [], "network_ping_times": [] }, "osd_sum_by_class": { "hdd": { "up_from": 0, "seq": 0, "num_pgs": 192, "num_osds": 3, "num_per_pool_osds": 3, "num_per_pool_omap_osds": 3, "kb": 314572800, "kb_used": 81232, "kb_used_data": 696, "kb_used_omap": 4, "kb_used_meta": 80443, "kb_avail": 314491568, "statfs": { "total": 322122547200, "available": 322039365632, "internally_reserved": 0, "allocated": 712704, "data_stored": 209643, "data_compressed": 0, "data_compressed_allocated": 0, "data_compressed_original": 0, "omap_allocated": 4785, "internal_metadata": 82373967 }, "hb_peers": [], "snap_trim_queue_len": 0, "num_snap_trimming": 0, "num_shards_repaired": 0, "op_queue_age_hist": { "histogram": [], "upper_bound": 1 }, "perf_stat": { "commit_latency_ms": 108, "apply_latency_ms": 108, "commit_latency_ns": 108000000, "apply_latency_ns": 108000000 }, "alerts": [], "network_ping_times": [] } }, "pool_stats": [ { "poolid": 2, "num_pg": 32, "stat_sum": { "num_bytes": 0, "num_objects": 0, "num_object_clones": 0, "num_object_copies": 0, "num_objects_missing_on_primary": 0, "num_objects_missing": 0, "num_objects_degraded": 0, "num_objects_misplaced": 0, "num_objects_unfound": 0, "num_objects_dirty": 0, "num_whiteouts": 0, "num_read": 0, "num_read_kb": 0, "num_write": 0, "num_write_kb": 0, "num_scrub_errors": 0, "num_shallow_scrub_errors": 0, "num_deep_scrub_errors": 0, "num_objects_recovered": 0, "num_bytes_recovered": 0, "num_keys_recovered": 0, "num_objects_omap": 0, "num_objects_hit_set_archive": 0, "num_bytes_hit_set_archive": 0, "num_flush": 0, "num_flush_kb": 0, "num_evict": 0, "num_evict_kb": 0, "num_promote": 0, "num_flush_mode_high": 0, "num_flush_mode_low": 0, "num_evict_mode_some": 0, "num_evict_mode_full": 0, "num_objects_pinned": 0, "num_legacy_snapsets": 0, "num_large_omap_objects": 0, "num_objects_manifest": 0, "num_omap_bytes": 0, "num_omap_keys": 0, "num_objects_repaired": 0 }, "store_stats": { "total": 0, "available": 0, "internally_reserved": 0, "allocated": 0, "data_stored": 0, "data_compressed": 0, "data_compressed_allocated": 0, "data_compressed_original": 0, "omap_allocated": 0, "internal_metadata": 0 }, "log_size": 0, "ondisk_log_size": 0, "up": 96, "acting": 96, "num_store_stats": 3 }, { "poolid": 1, "num_pg": 32, "stat_sum": { "num_bytes": 0, "num_objects": 0, "num_object_clones": 0, "num_object_copies": 0, "num_objects_missing_on_primary": 0, "num_objects_missing": 0, "num_objects_degraded": 0, "num_objects_misplaced": 0, "num_objects_unfound": 0, "num_objects_dirty": 0, "num_whiteouts": 0, "num_read": 0, "num_read_kb": 0, "num_write": 0, "num_write_kb": 0, "num_scrub_errors": 0, "num_shallow_scrub_errors": 0, "num_deep_scrub_errors": 0, "num_objects_recovered": 0, "num_bytes_recovered": 0, "num_keys_recovered": 0, "num_objects_omap": 0, "num_objects_hit_set_archive": 0, "num_bytes_hit_set_archive": 0, "num_flush": 0, "num_flush_kb": 0, "num_evict": 0, "num_evict_kb": 0, "num_promote": 0, "num_flush_mode_high": 0, "num_flush_mode_low": 0, "num_evict_mode_some": 0, "num_evict_mode_full": 0, "num_objects_pinned": 0, "num_legacy_snapsets": 0, "num_large_omap_objects": 0, "num_objects_manifest": 0, "num_omap_bytes": 0, "num_omap_keys": 0, "num_objects_repaired": 0 }, "store_stats": { "total": 0, "available": 0, "internally_reserved": 0, "allocated": 0, "data_stored": 0, "data_compressed": 0, "data_compressed_allocated": 0, "data_compressed_original": 0, "omap_allocated": 0, "internal_metadata": 0 }, "log_size": 0, "ondisk_log_size": 0, "up": 96, "acting": 96, "num_store_stats": 3 } ], "osd_stats": [ { "osd": 0, "seq": 21474836507 }, { "osd": 1, "seq": 42949672979 }, { "osd": 2, "seq": 64424509451 } ], "num_pg_by_state": [ { "state": "active+clean", "num": 64 } ], "num_pg_by_osd": [ { "osd": 2, "num_primary_pg": 15, "num_acting_pg": 64, "num_up_not_acting_pg": 0 }, { "osd": 0, "num_primary_pg": 20, "num_acting_pg": 64, "num_up_not_acting_pg": 0 }, { "osd": 1, "num_primary_pg": 29, "num_acting_pg": 64, "num_up_not_acting_pg": 0 } ], "purged_snaps": [ { "pool": 1, "purged_snaps": {} }, { "pool": 2, "purged_snaps": {} } ], "servicemap": { "epoch": 4, "modified": "2024-09-16T03:25:02.412573+0000", "services": { "osd": { "daemons": { "summary": "", "2": { "start_epoch": 0, "start_stamp": "0.000000", "gid": 0, "addr": "(unrecognized address family 0)/0", "metadata": {}, "task_status": {} } } } } }, "mgrstat_first_committed": 52, "mgrstat_last_committed": 59, "logm_first_committed": 1, "logm_last_committed": 259, "paxos": { "first_committed": 1, "last_committed": 362, "last_pn": 0, "accepted_pn": 0 } } 2024-09-16T03:25:07.115 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:38: check_lec_equals_pools: return 1 2024-09-16T03:25:07.116 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:47: check_lec_equals_pools: return 0 2024-09-16T03:25:07.116 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:219: TEST_mon_last_clean_epoch: check_lec_honours_osd 2024-09-16T03:25:07.116 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:93: check_lec_honours_osd: local osd= 2024-09-16T03:25:07.116 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:95: check_lec_honours_osd: ceph report 2024-09-16T03:25:07.640 INFO:tasks.workunit.client.0.smithi096.stderr:report 1940310127 2024-09-16T03:25:07.657 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:95: check_lec_honours_osd: report='{ 2024-09-16T03:25:07.657 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_fingerprint": "fda2fc64-07ed-4add-8224-2e527e11d427", 2024-09-16T03:25:07.657 INFO:tasks.workunit.client.0.smithi096.stderr: "version": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:25:07.657 INFO:tasks.workunit.client.0.smithi096.stderr: "commit": "fc3e0bff7468fd55478adbae7f75508b749124b6", 2024-09-16T03:25:07.658 INFO:tasks.workunit.client.0.smithi096.stderr: "timestamp": "2024-09-16T03:25:07.642033+0000", 2024-09-16T03:25:07.658 INFO:tasks.workunit.client.0.smithi096.stderr: "tag": "", 2024-09-16T03:25:07.658 INFO:tasks.workunit.client.0.smithi096.stderr: "health": { 2024-09-16T03:25:07.658 INFO:tasks.workunit.client.0.smithi096.stderr: "status": "HEALTH_OK", 2024-09-16T03:25:07.658 INFO:tasks.workunit.client.0.smithi096.stderr: "checks": {}, 2024-09-16T03:25:07.658 INFO:tasks.workunit.client.0.smithi096.stderr: "mutes": [] 2024-09-16T03:25:07.658 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.658 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap_first_committed": 1, 2024-09-16T03:25:07.658 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap_last_committed": 1, 2024-09-16T03:25:07.658 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap": { 2024-09-16T03:25:07.658 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 1, 2024-09-16T03:25:07.658 INFO:tasks.workunit.client.0.smithi096.stderr: "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", 2024-09-16T03:25:07.658 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:22:45.872880Z", 2024-09-16T03:25:07.658 INFO:tasks.workunit.client.0.smithi096.stderr: "created": "2024-09-16T03:22:45.872880Z", 2024-09-16T03:25:07.659 INFO:tasks.workunit.client.0.smithi096.stderr: "min_mon_release": 19, 2024-09-16T03:25:07.659 INFO:tasks.workunit.client.0.smithi096.stderr: "min_mon_release_name": "squid", 2024-09-16T03:25:07.659 INFO:tasks.workunit.client.0.smithi096.stderr: "election_strategy": 1, 2024-09-16T03:25:07.659 INFO:tasks.workunit.client.0.smithi096.stderr: "disallowed_leaders: ": "", 2024-09-16T03:25:07.659 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode": false, 2024-09-16T03:25:07.659 INFO:tasks.workunit.client.0.smithi096.stderr: "tiebreaker_mon": "", 2024-09-16T03:25:07.659 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_ranks: ": "", 2024-09-16T03:25:07.659 INFO:tasks.workunit.client.0.smithi096.stderr: "features": { 2024-09-16T03:25:07.659 INFO:tasks.workunit.client.0.smithi096.stderr: "persistent": [ 2024-09-16T03:25:07.659 INFO:tasks.workunit.client.0.smithi096.stderr: "kraken", 2024-09-16T03:25:07.659 INFO:tasks.workunit.client.0.smithi096.stderr: "luminous", 2024-09-16T03:25:07.659 INFO:tasks.workunit.client.0.smithi096.stderr: "mimic", 2024-09-16T03:25:07.659 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap-prune", 2024-09-16T03:25:07.659 INFO:tasks.workunit.client.0.smithi096.stderr: "nautilus", 2024-09-16T03:25:07.660 INFO:tasks.workunit.client.0.smithi096.stderr: "octopus", 2024-09-16T03:25:07.660 INFO:tasks.workunit.client.0.smithi096.stderr: "pacific", 2024-09-16T03:25:07.660 INFO:tasks.workunit.client.0.smithi096.stderr: "elector-pinging", 2024-09-16T03:25:07.660 INFO:tasks.workunit.client.0.smithi096.stderr: "quincy", 2024-09-16T03:25:07.660 INFO:tasks.workunit.client.0.smithi096.stderr: "reef", 2024-09-16T03:25:07.660 INFO:tasks.workunit.client.0.smithi096.stderr: "squid" 2024-09-16T03:25:07.660 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:07.660 INFO:tasks.workunit.client.0.smithi096.stderr: "optional": [] 2024-09-16T03:25:07.660 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.660 INFO:tasks.workunit.client.0.smithi096.stderr: "mons": [ 2024-09-16T03:25:07.660 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.661 INFO:tasks.workunit.client.0.smithi096.stderr: "rank": 0, 2024-09-16T03:25:07.661 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "a", 2024-09-16T03:25:07.661 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:25:07.661 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:07.661 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.661 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:07.661 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:7302", 2024-09-16T03:25:07.661 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 0 2024-09-16T03:25:07.661 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.661 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:07.661 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.661 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:7302/0", 2024-09-16T03:25:07.661 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:7302/0", 2024-09-16T03:25:07.661 INFO:tasks.workunit.client.0.smithi096.stderr: "priority": 0, 2024-09-16T03:25:07.662 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 0, 2024-09-16T03:25:07.662 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_location": "{}" 2024-09-16T03:25:07.662 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.662 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:07.662 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.662 INFO:tasks.workunit.client.0.smithi096.stderr: "quorum": [ 2024-09-16T03:25:07.662 INFO:tasks.workunit.client.0.smithi096.stderr: 0 2024-09-16T03:25:07.662 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:07.662 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap": { 2024-09-16T03:25:07.662 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 32, 2024-09-16T03:25:07.662 INFO:tasks.workunit.client.0.smithi096.stderr: "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", 2024-09-16T03:25:07.662 INFO:tasks.workunit.client.0.smithi096.stderr: "created": "2024-09-16T03:22:46.906117+0000", 2024-09-16T03:25:07.662 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:25:05.447882+0000", 2024-09-16T03:25:07.662 INFO:tasks.workunit.client.0.smithi096.stderr: "last_up_change": "2024-09-16T03:24:37.708512+0000", 2024-09-16T03:25:07.663 INFO:tasks.workunit.client.0.smithi096.stderr: "last_in_change": "2024-09-16T03:24:01.831039+0000", 2024-09-16T03:25:07.663 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-16T03:25:07.663 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_num": 5799936, 2024-09-16T03:25:07.663 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_set": [ 2024-09-16T03:25:07.663 INFO:tasks.workunit.client.0.smithi096.stderr: "pglog_hardlimit", 2024-09-16T03:25:07.663 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snapdirs", 2024-09-16T03:25:07.663 INFO:tasks.workunit.client.0.smithi096.stderr: "recovery_deletes", 2024-09-16T03:25:07.663 INFO:tasks.workunit.client.0.smithi096.stderr: "sortbitwise" 2024-09-16T03:25:07.663 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:07.663 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_version": 7, 2024-09-16T03:25:07.663 INFO:tasks.workunit.client.0.smithi096.stderr: "full_ratio": 0.97000002861022949, 2024-09-16T03:25:07.663 INFO:tasks.workunit.client.0.smithi096.stderr: "backfillfull_ratio": 0.97000002861022949, 2024-09-16T03:25:07.663 INFO:tasks.workunit.client.0.smithi096.stderr: "nearfull_ratio": 0.85000002384185791, 2024-09-16T03:25:07.663 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_snapshot": "", 2024-09-16T03:25:07.664 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_max": 2, 2024-09-16T03:25:07.664 INFO:tasks.workunit.client.0.smithi096.stderr: "max_osd": 3, 2024-09-16T03:25:07.664 INFO:tasks.workunit.client.0.smithi096.stderr: "require_min_compat_client": "luminous", 2024-09-16T03:25:07.664 INFO:tasks.workunit.client.0.smithi096.stderr: "min_compat_client": "jewel", 2024-09-16T03:25:07.664 INFO:tasks.workunit.client.0.smithi096.stderr: "require_osd_release": "squid", 2024-09-16T03:25:07.664 INFO:tasks.workunit.client.0.smithi096.stderr: "allow_crimson": false, 2024-09-16T03:25:07.664 INFO:tasks.workunit.client.0.smithi096.stderr: "pools": [ 2024-09-16T03:25:07.664 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.664 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 1, 2024-09-16T03:25:07.664 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_name": "foo", 2024-09-16T03:25:07.665 INFO:tasks.workunit.client.0.smithi096.stderr: "create_time": "2024-09-16T03:24:44.525189+0000", 2024-09-16T03:25:07.665 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": 1, 2024-09-16T03:25:07.665 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_names": "hashpspool", 2024-09-16T03:25:07.665 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:25:07.665 INFO:tasks.workunit.client.0.smithi096.stderr: "size": 3, 2024-09-16T03:25:07.665 INFO:tasks.workunit.client.0.smithi096.stderr: "min_size": 2, 2024-09-16T03:25:07.665 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_rule": 0, 2024-09-16T03:25:07.665 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_count": 0, 2024-09-16T03:25:07.665 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_target": 0, 2024-09-16T03:25:07.665 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_barrier": 0, 2024-09-16T03:25:07.665 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-16T03:25:07.665 INFO:tasks.workunit.client.0.smithi096.stderr: "is_stretch_pool": false, 2024-09-16T03:25:07.665 INFO:tasks.workunit.client.0.smithi096.stderr: "object_hash": 2, 2024-09-16T03:25:07.665 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_autoscale_mode": "off", 2024-09-16T03:25:07.666 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num": 32, 2024-09-16T03:25:07.666 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num": 32, 2024-09-16T03:25:07.666 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num_target": 32, 2024-09-16T03:25:07.666 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_target": 32, 2024-09-16T03:25:07.666 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_pending": 32, 2024-09-16T03:25:07.666 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pg_merge_meta": { 2024-09-16T03:25:07.666 INFO:tasks.workunit.client.0.smithi096.stderr: "source_pgid": "0.0", 2024-09-16T03:25:07.666 INFO:tasks.workunit.client.0.smithi096.stderr: "ready_epoch": 0, 2024-09-16T03:25:07.666 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_started": 0, 2024-09-16T03:25:07.666 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": 0, 2024-09-16T03:25:07.666 INFO:tasks.workunit.client.0.smithi096.stderr: "source_version": "0'\''0", 2024-09-16T03:25:07.666 INFO:tasks.workunit.client.0.smithi096.stderr: "target_version": "0'\''0" 2024-09-16T03:25:07.666 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.666 INFO:tasks.workunit.client.0.smithi096.stderr: "last_change": "30", 2024-09-16T03:25:07.667 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend": "0", 2024-09-16T03:25:07.667 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_prenautilus": "0", 2024-09-16T03:25:07.667 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_preluminous": "0", 2024-09-16T03:25:07.667 INFO:tasks.workunit.client.0.smithi096.stderr: "auid": 0, 2024-09-16T03:25:07.667 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_mode": "selfmanaged", 2024-09-16T03:25:07.667 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_seq": 0, 2024-09-16T03:25:07.667 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_epoch": 0, 2024-09-16T03:25:07.667 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_snaps": [], 2024-09-16T03:25:07.667 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps": "[]", 2024-09-16T03:25:07.667 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_bytes": 0, 2024-09-16T03:25:07.667 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_objects": 0, 2024-09-16T03:25:07.667 INFO:tasks.workunit.client.0.smithi096.stderr: "tiers": [], 2024-09-16T03:25:07.667 INFO:tasks.workunit.client.0.smithi096.stderr: "tier_of": -1, 2024-09-16T03:25:07.667 INFO:tasks.workunit.client.0.smithi096.stderr: "read_tier": -1, 2024-09-16T03:25:07.668 INFO:tasks.workunit.client.0.smithi096.stderr: "write_tier": -1, 2024-09-16T03:25:07.668 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_mode": "none", 2024-09-16T03:25:07.668 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_bytes": 0, 2024-09-16T03:25:07.668 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_objects": 0, 2024-09-16T03:25:07.668 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_ratio_micro": 400000, 2024-09-16T03:25:07.668 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-16T03:25:07.668 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_full_ratio_micro": 800000, 2024-09-16T03:25:07.668 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_flush_age": 0, 2024-09-16T03:25:07.668 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_evict_age": 0, 2024-09-16T03:25:07.668 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profile": "", 2024-09-16T03:25:07.668 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_params": { 2024-09-16T03:25:07.668 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "none" 2024-09-16T03:25:07.668 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.668 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_period": 0, 2024-09-16T03:25:07.669 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_count": 0, 2024-09-16T03:25:07.669 INFO:tasks.workunit.client.0.smithi096.stderr: "use_gmt_hitset": true, 2024-09-16T03:25:07.669 INFO:tasks.workunit.client.0.smithi096.stderr: "min_read_recency_for_promote": 0, 2024-09-16T03:25:07.669 INFO:tasks.workunit.client.0.smithi096.stderr: "min_write_recency_for_promote": 0, 2024-09-16T03:25:07.669 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_grade_decay_rate": 0, 2024-09-16T03:25:07.669 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_search_last_n": 0, 2024-09-16T03:25:07.669 INFO:tasks.workunit.client.0.smithi096.stderr: "grade_table": [], 2024-09-16T03:25:07.669 INFO:tasks.workunit.client.0.smithi096.stderr: "stripe_width": 0, 2024-09-16T03:25:07.669 INFO:tasks.workunit.client.0.smithi096.stderr: "expected_num_objects": 0, 2024-09-16T03:25:07.669 INFO:tasks.workunit.client.0.smithi096.stderr: "fast_read": false, 2024-09-16T03:25:07.669 INFO:tasks.workunit.client.0.smithi096.stderr: "options": {}, 2024-09-16T03:25:07.669 INFO:tasks.workunit.client.0.smithi096.stderr: "application_metadata": {}, 2024-09-16T03:25:07.669 INFO:tasks.workunit.client.0.smithi096.stderr: "read_balance": { 2024-09-16T03:25:07.669 INFO:tasks.workunit.client.0.smithi096.stderr: "score_type": "Fair distribution", 2024-09-16T03:25:07.670 INFO:tasks.workunit.client.0.smithi096.stderr: "score_acting": 1.690000057220459, 2024-09-16T03:25:07.670 INFO:tasks.workunit.client.0.smithi096.stderr: "score_stable": 1.690000057220459, 2024-09-16T03:25:07.670 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_score": 1, 2024-09-16T03:25:07.670 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_acting": 1.690000057220459, 2024-09-16T03:25:07.670 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_stable": 1.690000057220459, 2024-09-16T03:25:07.670 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity_weighted": 1, 2024-09-16T03:25:07.670 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity": 1, 2024-09-16T03:25:07.670 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity_weighted": 1 2024-09-16T03:25:07.670 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.670 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.671 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.671 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 2, 2024-09-16T03:25:07.671 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_name": "bar", 2024-09-16T03:25:07.671 INFO:tasks.workunit.client.0.smithi096.stderr: "create_time": "2024-09-16T03:24:46.226575+0000", 2024-09-16T03:25:07.671 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": 1, 2024-09-16T03:25:07.671 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_names": "hashpspool", 2024-09-16T03:25:07.671 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:25:07.671 INFO:tasks.workunit.client.0.smithi096.stderr: "size": 3, 2024-09-16T03:25:07.671 INFO:tasks.workunit.client.0.smithi096.stderr: "min_size": 2, 2024-09-16T03:25:07.671 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_rule": 0, 2024-09-16T03:25:07.671 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_count": 0, 2024-09-16T03:25:07.671 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_target": 0, 2024-09-16T03:25:07.671 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_barrier": 0, 2024-09-16T03:25:07.671 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-16T03:25:07.672 INFO:tasks.workunit.client.0.smithi096.stderr: "is_stretch_pool": false, 2024-09-16T03:25:07.672 INFO:tasks.workunit.client.0.smithi096.stderr: "object_hash": 2, 2024-09-16T03:25:07.672 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_autoscale_mode": "off", 2024-09-16T03:25:07.672 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num": 32, 2024-09-16T03:25:07.672 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num": 32, 2024-09-16T03:25:07.672 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num_target": 32, 2024-09-16T03:25:07.672 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_target": 32, 2024-09-16T03:25:07.672 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_pending": 32, 2024-09-16T03:25:07.672 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pg_merge_meta": { 2024-09-16T03:25:07.672 INFO:tasks.workunit.client.0.smithi096.stderr: "source_pgid": "0.0", 2024-09-16T03:25:07.672 INFO:tasks.workunit.client.0.smithi096.stderr: "ready_epoch": 0, 2024-09-16T03:25:07.672 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_started": 0, 2024-09-16T03:25:07.672 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": 0, 2024-09-16T03:25:07.672 INFO:tasks.workunit.client.0.smithi096.stderr: "source_version": "0'\''0", 2024-09-16T03:25:07.673 INFO:tasks.workunit.client.0.smithi096.stderr: "target_version": "0'\''0" 2024-09-16T03:25:07.673 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.673 INFO:tasks.workunit.client.0.smithi096.stderr: "last_change": "32", 2024-09-16T03:25:07.673 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend": "0", 2024-09-16T03:25:07.673 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_prenautilus": "0", 2024-09-16T03:25:07.673 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_preluminous": "0", 2024-09-16T03:25:07.673 INFO:tasks.workunit.client.0.smithi096.stderr: "auid": 0, 2024-09-16T03:25:07.673 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_mode": "selfmanaged", 2024-09-16T03:25:07.673 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_seq": 0, 2024-09-16T03:25:07.673 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_epoch": 0, 2024-09-16T03:25:07.673 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_snaps": [], 2024-09-16T03:25:07.673 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps": "[]", 2024-09-16T03:25:07.673 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_bytes": 0, 2024-09-16T03:25:07.673 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_objects": 0, 2024-09-16T03:25:07.674 INFO:tasks.workunit.client.0.smithi096.stderr: "tiers": [], 2024-09-16T03:25:07.674 INFO:tasks.workunit.client.0.smithi096.stderr: "tier_of": -1, 2024-09-16T03:25:07.674 INFO:tasks.workunit.client.0.smithi096.stderr: "read_tier": -1, 2024-09-16T03:25:07.674 INFO:tasks.workunit.client.0.smithi096.stderr: "write_tier": -1, 2024-09-16T03:25:07.674 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_mode": "none", 2024-09-16T03:25:07.674 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_bytes": 0, 2024-09-16T03:25:07.674 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_objects": 0, 2024-09-16T03:25:07.674 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_ratio_micro": 400000, 2024-09-16T03:25:07.674 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-16T03:25:07.674 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_full_ratio_micro": 800000, 2024-09-16T03:25:07.675 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_flush_age": 0, 2024-09-16T03:25:07.675 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_evict_age": 0, 2024-09-16T03:25:07.675 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profile": "", 2024-09-16T03:25:07.675 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_params": { 2024-09-16T03:25:07.675 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "none" 2024-09-16T03:25:07.675 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.675 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_period": 0, 2024-09-16T03:25:07.675 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_count": 0, 2024-09-16T03:25:07.675 INFO:tasks.workunit.client.0.smithi096.stderr: "use_gmt_hitset": true, 2024-09-16T03:25:07.675 INFO:tasks.workunit.client.0.smithi096.stderr: "min_read_recency_for_promote": 0, 2024-09-16T03:25:07.675 INFO:tasks.workunit.client.0.smithi096.stderr: "min_write_recency_for_promote": 0, 2024-09-16T03:25:07.675 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_grade_decay_rate": 0, 2024-09-16T03:25:07.675 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_search_last_n": 0, 2024-09-16T03:25:07.675 INFO:tasks.workunit.client.0.smithi096.stderr: "grade_table": [], 2024-09-16T03:25:07.676 INFO:tasks.workunit.client.0.smithi096.stderr: "stripe_width": 0, 2024-09-16T03:25:07.676 INFO:tasks.workunit.client.0.smithi096.stderr: "expected_num_objects": 0, 2024-09-16T03:25:07.676 INFO:tasks.workunit.client.0.smithi096.stderr: "fast_read": false, 2024-09-16T03:25:07.676 INFO:tasks.workunit.client.0.smithi096.stderr: "options": {}, 2024-09-16T03:25:07.676 INFO:tasks.workunit.client.0.smithi096.stderr: "application_metadata": {}, 2024-09-16T03:25:07.676 INFO:tasks.workunit.client.0.smithi096.stderr: "read_balance": { 2024-09-16T03:25:07.676 INFO:tasks.workunit.client.0.smithi096.stderr: "score_type": "Fair distribution", 2024-09-16T03:25:07.676 INFO:tasks.workunit.client.0.smithi096.stderr: "score_acting": 1.1299999952316284, 2024-09-16T03:25:07.676 INFO:tasks.workunit.client.0.smithi096.stderr: "score_stable": 1.1299999952316284, 2024-09-16T03:25:07.676 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_score": 1, 2024-09-16T03:25:07.676 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_acting": 1.1299999952316284, 2024-09-16T03:25:07.676 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_stable": 1.1299999952316284, 2024-09-16T03:25:07.676 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity_weighted": 1, 2024-09-16T03:25:07.677 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity": 1, 2024-09-16T03:25:07.677 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity_weighted": 1 2024-09-16T03:25:07.677 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.677 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.677 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:07.677 INFO:tasks.workunit.client.0.smithi096.stderr: "osds": [ 2024-09-16T03:25:07.677 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.677 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:25:07.677 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6", 2024-09-16T03:25:07.677 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:25:07.677 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:25:07.678 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:25:07.678 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:25:07.678 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:25:07.678 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:25:07.678 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 5, 2024-09-16T03:25:07.678 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 21, 2024-09-16T03:25:07.678 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:25:07.678 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:25:07.678 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:25:07.678 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:07.678 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.678 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:07.678 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6802", 2024-09-16T03:25:07.678 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:07.678 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.679 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.679 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:07.679 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6803", 2024-09-16T03:25:07.679 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:07.679 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.679 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:07.679 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.679 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:25:07.679 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:07.679 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.679 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:07.679 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6804", 2024-09-16T03:25:07.679 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:07.679 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.680 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.680 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:07.680 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6805", 2024-09-16T03:25:07.680 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:07.680 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.680 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:07.680 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.680 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:25:07.680 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:07.680 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.681 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:07.681 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6808", 2024-09-16T03:25:07.681 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:07.681 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.681 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.681 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:07.681 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6809", 2024-09-16T03:25:07.681 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:07.681 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.681 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:07.681 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.681 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:25:07.681 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:07.682 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.682 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:07.682 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6806", 2024-09-16T03:25:07.682 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:07.682 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.682 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.682 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:07.682 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6807", 2024-09-16T03:25:07.682 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:07.682 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.682 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:07.682 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.682 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6803/3375787448", 2024-09-16T03:25:07.682 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6805/3375787448", 2024-09-16T03:25:07.683 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6809/3375787448", 2024-09-16T03:25:07.683 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6807/3375787448", 2024-09-16T03:25:07.683 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:25:07.683 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:25:07.683 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:25:07.683 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:07.683 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.683 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.683 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:25:07.683 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "74b26727-75c9-444d-8782-719e4197a382", 2024-09-16T03:25:07.683 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:25:07.683 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:25:07.683 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:25:07.683 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:25:07.684 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:25:07.684 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:25:07.684 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 10, 2024-09-16T03:25:07.684 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 21, 2024-09-16T03:25:07.684 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:25:07.684 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:25:07.684 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:25:07.684 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:07.684 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.684 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:07.684 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6810", 2024-09-16T03:25:07.684 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:07.684 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.685 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.685 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:07.685 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6811", 2024-09-16T03:25:07.685 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:07.685 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.685 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:07.685 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.685 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:25:07.685 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:07.685 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.685 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:07.685 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6812", 2024-09-16T03:25:07.685 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:07.685 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.686 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.686 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:07.686 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6813", 2024-09-16T03:25:07.686 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:07.686 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.686 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:07.686 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.686 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:25:07.686 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:07.686 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.686 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:07.686 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6816", 2024-09-16T03:25:07.686 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:07.686 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.686 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.687 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:07.687 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6817", 2024-09-16T03:25:07.687 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:07.687 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.687 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:07.687 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.687 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:25:07.687 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:07.687 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.687 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:07.687 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6814", 2024-09-16T03:25:07.687 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:07.687 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.687 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.688 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:07.688 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6815", 2024-09-16T03:25:07.688 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:07.688 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.688 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:07.688 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.688 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6811/3733255132", 2024-09-16T03:25:07.688 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6813/3733255132", 2024-09-16T03:25:07.688 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6817/3733255132", 2024-09-16T03:25:07.688 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6815/3733255132", 2024-09-16T03:25:07.688 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:25:07.688 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:25:07.688 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:25:07.688 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:07.689 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.689 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.689 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:25:07.689 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "143da3a7-dad9-4b1e-966b-76cf5bdd3c82", 2024-09-16T03:25:07.689 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:25:07.689 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:25:07.689 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:25:07.689 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:25:07.689 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:25:07.689 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:25:07.689 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 15, 2024-09-16T03:25:07.689 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 21, 2024-09-16T03:25:07.689 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:25:07.689 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:25:07.690 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:25:07.690 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:07.690 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.690 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:07.690 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6818", 2024-09-16T03:25:07.690 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:07.690 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.690 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.690 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:07.690 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6819", 2024-09-16T03:25:07.690 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:07.690 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.690 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:07.690 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.691 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:25:07.691 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:07.691 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.691 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:07.691 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6820", 2024-09-16T03:25:07.691 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:07.691 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.691 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.691 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:07.691 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6821", 2024-09-16T03:25:07.691 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:07.691 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.691 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:07.692 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.692 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:25:07.692 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:07.692 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.692 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:07.692 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6824", 2024-09-16T03:25:07.692 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:07.692 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.692 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.692 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:07.692 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6825", 2024-09-16T03:25:07.692 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:07.692 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.693 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:07.693 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.693 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:25:07.693 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:07.693 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.693 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:07.693 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6822", 2024-09-16T03:25:07.693 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:07.693 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.693 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.693 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:07.693 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6823", 2024-09-16T03:25:07.693 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:07.693 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.694 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:07.694 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.694 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6819/963814857", 2024-09-16T03:25:07.694 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6821/963814857", 2024-09-16T03:25:07.694 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6825/963814857", 2024-09-16T03:25:07.694 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6823/963814857", 2024-09-16T03:25:07.694 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:25:07.694 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:25:07.694 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:25:07.694 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:07.694 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.694 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:07.694 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_xinfo": [ 2024-09-16T03:25:07.694 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.695 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:25:07.695 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:25:07.695 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:25:07.695 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:25:07.695 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:25:07.695 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:25:07.695 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:23:22.481942+0000", 2024-09-16T03:25:07.695 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:25:07.695 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.695 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.695 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:25:07.695 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:25:07.695 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:25:07.695 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:25:07.695 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:25:07.696 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:25:07.696 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:23:59.663703+0000", 2024-09-16T03:25:07.696 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:25:07.696 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.696 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.696 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:25:07.696 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:25:07.696 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:25:07.696 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:25:07.696 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:25:07.696 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:25:07.696 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:24:37.320822+0000", 2024-09-16T03:25:07.696 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:25:07.696 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.697 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:07.697 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap": [], 2024-09-16T03:25:07.697 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap_items": [], 2024-09-16T03:25:07.697 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap_primaries": [], 2024-09-16T03:25:07.697 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_temp": [], 2024-09-16T03:25:07.697 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_temp": [], 2024-09-16T03:25:07.697 INFO:tasks.workunit.client.0.smithi096.stderr: "blocklist": {}, 2024-09-16T03:25:07.697 INFO:tasks.workunit.client.0.smithi096.stderr: "range_blocklist": {}, 2024-09-16T03:25:07.697 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profiles": { 2024-09-16T03:25:07.697 INFO:tasks.workunit.client.0.smithi096.stderr: "default": { 2024-09-16T03:25:07.697 INFO:tasks.workunit.client.0.smithi096.stderr: "k": "2", 2024-09-16T03:25:07.697 INFO:tasks.workunit.client.0.smithi096.stderr: "m": "2", 2024-09-16T03:25:07.697 INFO:tasks.workunit.client.0.smithi096.stderr: "plugin": "jerasure", 2024-09-16T03:25:07.698 INFO:tasks.workunit.client.0.smithi096.stderr: "technique": "reed_sol_van" 2024-09-16T03:25:07.698 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.698 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.698 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps_queue": [], 2024-09-16T03:25:07.698 INFO:tasks.workunit.client.0.smithi096.stderr: "new_removed_snaps": [], 2024-09-16T03:25:07.698 INFO:tasks.workunit.client.0.smithi096.stderr: "new_purged_snaps": [], 2024-09-16T03:25:07.698 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_node_flags": {}, 2024-09-16T03:25:07.698 INFO:tasks.workunit.client.0.smithi096.stderr: "device_class_flags": {}, 2024-09-16T03:25:07.698 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode": { 2024-09-16T03:25:07.698 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode_enabled": false, 2024-09-16T03:25:07.698 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_bucket_count": 0, 2024-09-16T03:25:07.698 INFO:tasks.workunit.client.0.smithi096.stderr: "degraded_stretch_mode": 0, 2024-09-16T03:25:07.698 INFO:tasks.workunit.client.0.smithi096.stderr: "recovering_stretch_mode": 0, 2024-09-16T03:25:07.698 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode_bucket": 0 2024-09-16T03:25:07.699 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.699 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.699 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_metadata": [ 2024-09-16T03:25:07.699 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.699 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:25:07.699 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:25:07.699 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]", 2024-09-16T03:25:07.699 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:25:07.699 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:25:07.699 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:25:07.699 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:25:07.699 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:25:07.699 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:25:07.699 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:25:07.700 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:25:07.700 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:25:07.700 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:25:07.700 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:25:07.700 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/0/block", 2024-09-16T03:25:07.700 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:25:07.700 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:25:07.700 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:25:07.700 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:25:07.700 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:25:07.700 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:25:07.700 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:25:07.700 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:25:07.701 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:25:07.701 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:25:07.701 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:22:53.662571Z", 2024-09-16T03:25:07.701 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:25:07.701 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:25:07.701 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:25:07.701 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:25:07.701 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:25:07.701 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:25:07.701 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:25:07.701 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]", 2024-09-16T03:25:07.701 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:25:07.701 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]", 2024-09-16T03:25:07.701 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]", 2024-09-16T03:25:07.702 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:25:07.702 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:25:07.702 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:25:07.702 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:25:07.702 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:25:07.702 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:25:07.702 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:25:07.702 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:25:07.702 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:25:07.702 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/0", 2024-09-16T03:25:07.702 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:25:07.702 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:25:07.702 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:25:07.702 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.703 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.703 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:25:07.703 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:25:07.703 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]", 2024-09-16T03:25:07.703 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:25:07.703 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:25:07.703 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:25:07.703 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:25:07.703 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:25:07.703 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:25:07.703 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:25:07.703 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:25:07.703 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:25:07.703 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:25:07.704 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:25:07.704 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/1/block", 2024-09-16T03:25:07.704 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:25:07.704 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:25:07.704 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:25:07.704 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:25:07.704 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:25:07.704 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:25:07.704 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:25:07.704 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:25:07.704 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:25:07.704 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:25:07.704 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:23:30.129885Z", 2024-09-16T03:25:07.704 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:25:07.705 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:25:07.705 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:25:07.705 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:25:07.705 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:25:07.705 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:25:07.705 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:25:07.705 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]", 2024-09-16T03:25:07.705 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:25:07.705 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]", 2024-09-16T03:25:07.705 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]", 2024-09-16T03:25:07.705 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:25:07.705 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:25:07.705 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:25:07.706 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:25:07.706 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:25:07.706 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:25:07.706 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:25:07.706 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:25:07.706 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:25:07.706 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/1", 2024-09-16T03:25:07.706 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:25:07.706 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:25:07.706 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:25:07.706 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.706 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.706 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:25:07.706 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:25:07.707 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]", 2024-09-16T03:25:07.707 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:25:07.707 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:25:07.707 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:25:07.707 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:25:07.707 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:25:07.707 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:25:07.707 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:25:07.707 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:25:07.707 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:25:07.707 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:25:07.707 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:25:07.707 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/2/block", 2024-09-16T03:25:07.707 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:25:07.707 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:25:07.708 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:25:07.708 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:25:07.708 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:25:07.708 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:25:07.708 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:25:07.708 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:25:07.708 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:25:07.708 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:25:07.708 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:24:07.764502Z", 2024-09-16T03:25:07.708 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:25:07.709 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:25:07.709 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:25:07.709 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:25:07.709 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:25:07.709 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:25:07.709 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:25:07.709 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]", 2024-09-16T03:25:07.709 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:25:07.709 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]", 2024-09-16T03:25:07.709 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]", 2024-09-16T03:25:07.709 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:25:07.709 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:25:07.709 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:25:07.709 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:25:07.710 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:25:07.710 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:25:07.710 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:25:07.710 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:25:07.710 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:25:07.710 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/2", 2024-09-16T03:25:07.710 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:25:07.710 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:25:07.710 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:25:07.710 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.710 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:07.710 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_clean_epochs": { 2024-09-16T03:25:07.710 INFO:tasks.workunit.client.0.smithi096.stderr: "min_last_epoch_clean": 28, 2024-09-16T03:25:07.710 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": { 2024-09-16T03:25:07.711 INFO:tasks.workunit.client.0.smithi096.stderr: "per_pool": [ 2024-09-16T03:25:07.711 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.711 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 1, 2024-09-16T03:25:07.711 INFO:tasks.workunit.client.0.smithi096.stderr: "floor": 28 2024-09-16T03:25:07.711 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.711 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.711 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 2, 2024-09-16T03:25:07.711 INFO:tasks.workunit.client.0.smithi096.stderr: "floor": 28 2024-09-16T03:25:07.711 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.711 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:07.711 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.711 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_epochs": [ 2024-09-16T03:25:07.711 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.711 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:25:07.711 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 32 2024-09-16T03:25:07.712 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.712 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.712 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:25:07.712 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 28 2024-09-16T03:25:07.712 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.712 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.712 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:25:07.712 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 28 2024-09-16T03:25:07.712 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.712 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:07.712 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.712 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_first_committed": 26, 2024-09-16T03:25:07.712 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_last_committed": 32, 2024-09-16T03:25:07.712 INFO:tasks.workunit.client.0.smithi096.stderr: "crushmap": { 2024-09-16T03:25:07.713 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": [ 2024-09-16T03:25:07.713 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.713 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:25:07.713 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.0", 2024-09-16T03:25:07.713 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:25:07.713 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.713 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.713 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:25:07.713 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.1", 2024-09-16T03:25:07.713 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:25:07.713 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.713 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.713 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:25:07.713 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.2", 2024-09-16T03:25:07.714 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:25:07.714 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.714 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:07.714 INFO:tasks.workunit.client.0.smithi096.stderr: "types": [ 2024-09-16T03:25:07.714 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.714 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 0, 2024-09-16T03:25:07.714 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd" 2024-09-16T03:25:07.714 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.714 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.714 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:25:07.714 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "host" 2024-09-16T03:25:07.714 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.714 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.714 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 2, 2024-09-16T03:25:07.714 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "chassis" 2024-09-16T03:25:07.715 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.715 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.715 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 3, 2024-09-16T03:25:07.715 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "rack" 2024-09-16T03:25:07.715 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.715 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.715 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 4, 2024-09-16T03:25:07.715 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "row" 2024-09-16T03:25:07.715 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.715 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.715 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 5, 2024-09-16T03:25:07.715 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "pdu" 2024-09-16T03:25:07.715 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.715 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.716 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 6, 2024-09-16T03:25:07.716 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "pod" 2024-09-16T03:25:07.716 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.716 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.716 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 7, 2024-09-16T03:25:07.716 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "room" 2024-09-16T03:25:07.716 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.716 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.716 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 8, 2024-09-16T03:25:07.716 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "datacenter" 2024-09-16T03:25:07.716 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.716 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.716 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 9, 2024-09-16T03:25:07.716 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "zone" 2024-09-16T03:25:07.717 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.717 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.717 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 10, 2024-09-16T03:25:07.717 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "region" 2024-09-16T03:25:07.717 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.717 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.717 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:25:07.717 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "root" 2024-09-16T03:25:07.717 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.717 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:07.717 INFO:tasks.workunit.client.0.smithi096.stderr: "buckets": [ 2024-09-16T03:25:07.717 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.717 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -1, 2024-09-16T03:25:07.717 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "default", 2024-09-16T03:25:07.718 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:25:07.718 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "root", 2024-09-16T03:25:07.718 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:25:07.718 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:25:07.718 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:25:07.718 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:25:07.718 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.718 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -3, 2024-09-16T03:25:07.718 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:25:07.718 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:25:07.718 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.718 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:07.718 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.718 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.718 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -2, 2024-09-16T03:25:07.719 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "default~hdd", 2024-09-16T03:25:07.719 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:25:07.719 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "root", 2024-09-16T03:25:07.719 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:25:07.719 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:25:07.719 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:25:07.719 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:25:07.719 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.719 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -4, 2024-09-16T03:25:07.719 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:25:07.719 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:25:07.719 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.719 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:07.719 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.720 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.720 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -3, 2024-09-16T03:25:07.720 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "smithi096", 2024-09-16T03:25:07.720 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:25:07.720 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "host", 2024-09-16T03:25:07.720 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:25:07.720 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:25:07.720 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:25:07.720 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:25:07.720 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.720 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:25:07.720 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:25:07.720 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:25:07.720 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.721 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.721 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:25:07.721 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:25:07.721 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 1 2024-09-16T03:25:07.721 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.721 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.721 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:25:07.721 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:25:07.721 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 2 2024-09-16T03:25:07.721 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.721 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:07.721 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.721 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.721 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -4, 2024-09-16T03:25:07.722 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "smithi096~hdd", 2024-09-16T03:25:07.722 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:25:07.722 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "host", 2024-09-16T03:25:07.722 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:25:07.722 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:25:07.722 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:25:07.722 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:25:07.722 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.722 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:25:07.722 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:25:07.722 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:25:07.722 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.722 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.722 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:25:07.723 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:25:07.723 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 1 2024-09-16T03:25:07.723 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.723 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.723 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:25:07.723 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:25:07.723 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 2 2024-09-16T03:25:07.723 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.723 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:07.723 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.723 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:07.723 INFO:tasks.workunit.client.0.smithi096.stderr: "rules": [ 2024-09-16T03:25:07.723 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.724 INFO:tasks.workunit.client.0.smithi096.stderr: "rule_id": 0, 2024-09-16T03:25:07.724 INFO:tasks.workunit.client.0.smithi096.stderr: "rule_name": "replicated_rule", 2024-09-16T03:25:07.724 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:25:07.724 INFO:tasks.workunit.client.0.smithi096.stderr: "steps": [ 2024-09-16T03:25:07.724 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.724 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "take", 2024-09-16T03:25:07.724 INFO:tasks.workunit.client.0.smithi096.stderr: "item": -1, 2024-09-16T03:25:07.724 INFO:tasks.workunit.client.0.smithi096.stderr: "item_name": "default" 2024-09-16T03:25:07.724 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.724 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.724 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "choose_firstn", 2024-09-16T03:25:07.724 INFO:tasks.workunit.client.0.smithi096.stderr: "num": 0, 2024-09-16T03:25:07.724 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "osd" 2024-09-16T03:25:07.724 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.725 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.725 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "emit" 2024-09-16T03:25:07.725 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.725 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:07.725 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.725 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:07.725 INFO:tasks.workunit.client.0.smithi096.stderr: "tunables": { 2024-09-16T03:25:07.725 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_local_tries": 0, 2024-09-16T03:25:07.725 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_local_fallback_tries": 0, 2024-09-16T03:25:07.725 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_total_tries": 50, 2024-09-16T03:25:07.725 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_descend_once": 1, 2024-09-16T03:25:07.725 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_vary_r": 1, 2024-09-16T03:25:07.725 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_stable": 1, 2024-09-16T03:25:07.726 INFO:tasks.workunit.client.0.smithi096.stderr: "msr_descents": 100, 2024-09-16T03:25:07.726 INFO:tasks.workunit.client.0.smithi096.stderr: "msr_collision_tries": 100, 2024-09-16T03:25:07.726 INFO:tasks.workunit.client.0.smithi096.stderr: "straw_calc_version": 1, 2024-09-16T03:25:07.726 INFO:tasks.workunit.client.0.smithi096.stderr: "allowed_bucket_algs": 54, 2024-09-16T03:25:07.726 INFO:tasks.workunit.client.0.smithi096.stderr: "profile": "jewel", 2024-09-16T03:25:07.726 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_tunables": 1, 2024-09-16T03:25:07.726 INFO:tasks.workunit.client.0.smithi096.stderr: "legacy_tunables": 0, 2024-09-16T03:25:07.726 INFO:tasks.workunit.client.0.smithi096.stderr: "minimum_required_version": "jewel", 2024-09-16T03:25:07.726 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables": 1, 2024-09-16T03:25:07.726 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables2": 1, 2024-09-16T03:25:07.726 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v2_rules": 0, 2024-09-16T03:25:07.726 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables3": 1, 2024-09-16T03:25:07.726 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v3_rules": 0, 2024-09-16T03:25:07.726 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v4_buckets": 1, 2024-09-16T03:25:07.727 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables5": 1, 2024-09-16T03:25:07.727 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v5_rules": 0, 2024-09-16T03:25:07.727 INFO:tasks.workunit.client.0.smithi096.stderr: "has_msr_rules": 0 2024-09-16T03:25:07.727 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.727 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_args": {} 2024-09-16T03:25:07.727 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.727 INFO:tasks.workunit.client.0.smithi096.stderr: "fsmap": { 2024-09-16T03:25:07.727 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 1, 2024-09-16T03:25:07.727 INFO:tasks.workunit.client.0.smithi096.stderr: "btime": "2024-09-16T03:22:46:882186+0000", 2024-09-16T03:25:07.727 INFO:tasks.workunit.client.0.smithi096.stderr: "default_fscid": -1, 2024-09-16T03:25:07.727 INFO:tasks.workunit.client.0.smithi096.stderr: "compat": { 2024-09-16T03:25:07.727 INFO:tasks.workunit.client.0.smithi096.stderr: "compat": {}, 2024-09-16T03:25:07.727 INFO:tasks.workunit.client.0.smithi096.stderr: "ro_compat": {}, 2024-09-16T03:25:07.727 INFO:tasks.workunit.client.0.smithi096.stderr: "incompat": { 2024-09-16T03:25:07.727 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_1": "base v0.20", 2024-09-16T03:25:07.728 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_2": "client writeable ranges", 2024-09-16T03:25:07.728 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_3": "default file layouts on dirs", 2024-09-16T03:25:07.728 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_4": "dir inode in separate object", 2024-09-16T03:25:07.728 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_5": "mds uses versioned encoding", 2024-09-16T03:25:07.728 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_6": "dirfrag is stored in omap", 2024-09-16T03:25:07.728 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_8": "no anchor table", 2024-09-16T03:25:07.728 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_9": "file layout v2", 2024-09-16T03:25:07.728 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_10": "snaprealm v2", 2024-09-16T03:25:07.728 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_11": "minor log segments", 2024-09-16T03:25:07.728 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_12": "quiesce subvolumes" 2024-09-16T03:25:07.728 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.728 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.728 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_flags": { 2024-09-16T03:25:07.729 INFO:tasks.workunit.client.0.smithi096.stderr: "enable_multiple": true, 2024-09-16T03:25:07.729 INFO:tasks.workunit.client.0.smithi096.stderr: "ever_enabled_multiple": true 2024-09-16T03:25:07.729 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.729 INFO:tasks.workunit.client.0.smithi096.stderr: "standbys": [], 2024-09-16T03:25:07.729 INFO:tasks.workunit.client.0.smithi096.stderr: "filesystems": [] 2024-09-16T03:25:07.729 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.729 INFO:tasks.workunit.client.0.smithi096.stderr: "mdsmap_first_committed": 1, 2024-09-16T03:25:07.729 INFO:tasks.workunit.client.0.smithi096.stderr: "mdsmap_last_committed": 1, 2024-09-16T03:25:07.729 INFO:tasks.workunit.client.0.smithi096.stderr: "auth": { 2024-09-16T03:25:07.729 INFO:tasks.workunit.client.0.smithi096.stderr: "first_committed": 1, 2024-09-16T03:25:07.729 INFO:tasks.workunit.client.0.smithi096.stderr: "last_committed": 5, 2024-09-16T03:25:07.729 INFO:tasks.workunit.client.0.smithi096.stderr: "num_secrets": 3 2024-09-16T03:25:07.729 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.730 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 64, 2024-09-16T03:25:07.730 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_active": 64, 2024-09-16T03:25:07.730 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_unknown": 0, 2024-09-16T03:25:07.730 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osd": 3, 2024-09-16T03:25:07.730 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_sum": { 2024-09-16T03:25:07.730 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:25:07.730 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:25:07.730 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:25:07.730 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:25:07.730 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:25:07.730 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:25:07.730 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:25:07.730 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:25:07.730 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:25:07.730 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:25:07.731 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:25:07.731 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:25:07.731 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:25:07.731 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:25:07.731 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:25:07.731 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:25:07.731 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:25:07.731 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:25:07.731 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:25:07.731 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:25:07.731 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:25:07.731 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:25:07.731 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:25:07.731 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:25:07.732 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:25:07.732 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:25:07.732 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:25:07.732 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:25:07.732 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:25:07.732 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:25:07.732 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:25:07.732 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:25:07.732 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:25:07.732 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:25:07.732 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:25:07.732 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:25:07.732 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:25:07.732 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:25:07.733 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:25:07.733 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:25:07.733 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:25:07.733 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.733 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:25:07.733 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:25:07.733 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:25:07.733 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:25:07.733 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:25:07.733 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:25:07.733 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:25:07.733 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:25:07.733 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:25:07.733 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:25:07.734 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:25:07.734 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.734 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:25:07.734 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:25:07.734 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 192, 2024-09-16T03:25:07.734 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 192, 2024-09-16T03:25:07.734 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 0 2024-09-16T03:25:07.734 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.734 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_sum": { 2024-09-16T03:25:07.734 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 0, 2024-09-16T03:25:07.734 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 0, 2024-09-16T03:25:07.734 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pgs": 192, 2024-09-16T03:25:07.734 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osds": 3, 2024-09-16T03:25:07.734 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_osds": 3, 2024-09-16T03:25:07.735 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_omap_osds": 3, 2024-09-16T03:25:07.735 INFO:tasks.workunit.client.0.smithi096.stderr: "kb": 314572800, 2024-09-16T03:25:07.735 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used": 81232, 2024-09-16T03:25:07.735 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_data": 696, 2024-09-16T03:25:07.735 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_omap": 4, 2024-09-16T03:25:07.735 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_meta": 80443, 2024-09-16T03:25:07.735 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_avail": 314491568, 2024-09-16T03:25:07.735 INFO:tasks.workunit.client.0.smithi096.stderr: "statfs": { 2024-09-16T03:25:07.735 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 322122547200, 2024-09-16T03:25:07.735 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 322039365632, 2024-09-16T03:25:07.735 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:25:07.735 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 712704, 2024-09-16T03:25:07.735 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 209643, 2024-09-16T03:25:07.735 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:25:07.735 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:25:07.736 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:25:07.736 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 4785, 2024-09-16T03:25:07.736 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 82373967 2024-09-16T03:25:07.736 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.736 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_peers": [], 2024-09-16T03:25:07.736 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_trim_queue_len": 0, 2024-09-16T03:25:07.736 INFO:tasks.workunit.client.0.smithi096.stderr: "num_snap_trimming": 0, 2024-09-16T03:25:07.736 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shards_repaired": 0, 2024-09-16T03:25:07.736 INFO:tasks.workunit.client.0.smithi096.stderr: "op_queue_age_hist": { 2024-09-16T03:25:07.736 INFO:tasks.workunit.client.0.smithi096.stderr: "histogram": [], 2024-09-16T03:25:07.736 INFO:tasks.workunit.client.0.smithi096.stderr: "upper_bound": 1 2024-09-16T03:25:07.736 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.736 INFO:tasks.workunit.client.0.smithi096.stderr: "perf_stat": { 2024-09-16T03:25:07.737 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ms": 108, 2024-09-16T03:25:07.737 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ms": 108, 2024-09-16T03:25:07.737 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ns": 108000000, 2024-09-16T03:25:07.737 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ns": 108000000 2024-09-16T03:25:07.737 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.737 INFO:tasks.workunit.client.0.smithi096.stderr: "alerts": [], 2024-09-16T03:25:07.737 INFO:tasks.workunit.client.0.smithi096.stderr: "network_ping_times": [] 2024-09-16T03:25:07.737 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.737 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_sum_by_class": { 2024-09-16T03:25:07.737 INFO:tasks.workunit.client.0.smithi096.stderr: "hdd": { 2024-09-16T03:25:07.737 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 0, 2024-09-16T03:25:07.737 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 0, 2024-09-16T03:25:07.737 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pgs": 192, 2024-09-16T03:25:07.737 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osds": 3, 2024-09-16T03:25:07.738 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_osds": 3, 2024-09-16T03:25:07.738 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_omap_osds": 3, 2024-09-16T03:25:07.738 INFO:tasks.workunit.client.0.smithi096.stderr: "kb": 314572800, 2024-09-16T03:25:07.738 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used": 81232, 2024-09-16T03:25:07.738 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_data": 696, 2024-09-16T03:25:07.738 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_omap": 4, 2024-09-16T03:25:07.738 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_meta": 80443, 2024-09-16T03:25:07.738 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_avail": 314491568, 2024-09-16T03:25:07.738 INFO:tasks.workunit.client.0.smithi096.stderr: "statfs": { 2024-09-16T03:25:07.738 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 322122547200, 2024-09-16T03:25:07.738 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 322039365632, 2024-09-16T03:25:07.738 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:25:07.738 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 712704, 2024-09-16T03:25:07.738 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 209643, 2024-09-16T03:25:07.739 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:25:07.739 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:25:07.739 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:25:07.739 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 4785, 2024-09-16T03:25:07.739 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 82373967 2024-09-16T03:25:07.739 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.739 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_peers": [], 2024-09-16T03:25:07.739 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_trim_queue_len": 0, 2024-09-16T03:25:07.739 INFO:tasks.workunit.client.0.smithi096.stderr: "num_snap_trimming": 0, 2024-09-16T03:25:07.739 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shards_repaired": 0, 2024-09-16T03:25:07.739 INFO:tasks.workunit.client.0.smithi096.stderr: "op_queue_age_hist": { 2024-09-16T03:25:07.739 INFO:tasks.workunit.client.0.smithi096.stderr: "histogram": [], 2024-09-16T03:25:07.739 INFO:tasks.workunit.client.0.smithi096.stderr: "upper_bound": 1 2024-09-16T03:25:07.739 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.740 INFO:tasks.workunit.client.0.smithi096.stderr: "perf_stat": { 2024-09-16T03:25:07.740 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ms": 108, 2024-09-16T03:25:07.740 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ms": 108, 2024-09-16T03:25:07.740 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ns": 108000000, 2024-09-16T03:25:07.740 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ns": 108000000 2024-09-16T03:25:07.740 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.740 INFO:tasks.workunit.client.0.smithi096.stderr: "alerts": [], 2024-09-16T03:25:07.740 INFO:tasks.workunit.client.0.smithi096.stderr: "network_ping_times": [] 2024-09-16T03:25:07.740 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.740 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.740 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_stats": [ 2024-09-16T03:25:07.740 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.740 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 2, 2024-09-16T03:25:07.740 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 32, 2024-09-16T03:25:07.741 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:25:07.741 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:25:07.741 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:25:07.741 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:25:07.741 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:25:07.741 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:25:07.741 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:25:07.741 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:25:07.741 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:25:07.741 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:25:07.741 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:25:07.741 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:25:07.741 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:25:07.742 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:25:07.742 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:25:07.742 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:25:07.742 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:25:07.742 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:25:07.742 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:25:07.742 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:25:07.742 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:25:07.742 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:25:07.742 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:25:07.742 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:25:07.742 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:25:07.742 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:25:07.742 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:25:07.742 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:25:07.743 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:25:07.743 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:25:07.743 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:25:07.743 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:25:07.743 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:25:07.743 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:25:07.743 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:25:07.743 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:25:07.743 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:25:07.743 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:25:07.743 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:25:07.743 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:25:07.743 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:25:07.743 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.744 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:25:07.744 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:25:07.744 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:25:07.744 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:25:07.744 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:25:07.744 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:25:07.744 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:25:07.744 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:25:07.744 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:25:07.744 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:25:07.744 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:25:07.744 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.744 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:25:07.744 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:25:07.745 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 96, 2024-09-16T03:25:07.745 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 96, 2024-09-16T03:25:07.745 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 3 2024-09-16T03:25:07.745 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.745 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.745 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 1, 2024-09-16T03:25:07.745 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 32, 2024-09-16T03:25:07.745 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:25:07.745 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:25:07.745 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:25:07.745 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:25:07.745 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:25:07.745 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:25:07.745 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:25:07.746 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:25:07.746 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:25:07.746 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:25:07.746 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:25:07.746 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:25:07.746 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:25:07.746 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:25:07.746 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:25:07.746 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:25:07.746 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:25:07.746 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:25:07.746 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:25:07.746 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:25:07.746 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:25:07.747 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:25:07.747 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:25:07.747 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:25:07.747 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:25:07.747 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:25:07.747 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:25:07.747 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:25:07.747 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:25:07.747 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:25:07.747 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:25:07.747 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:25:07.747 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:25:07.747 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:25:07.747 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:25:07.748 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:25:07.748 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:25:07.748 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:25:07.748 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:25:07.748 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:25:07.748 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:25:07.748 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.748 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:25:07.748 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:25:07.748 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:25:07.748 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:25:07.748 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:25:07.748 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:25:07.748 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:25:07.749 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:25:07.749 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:25:07.749 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:25:07.749 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:25:07.749 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.749 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:25:07.749 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:25:07.749 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 96, 2024-09-16T03:25:07.749 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 96, 2024-09-16T03:25:07.749 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 3 2024-09-16T03:25:07.749 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.749 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:07.749 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_stats": [ 2024-09-16T03:25:07.749 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.750 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:25:07.750 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 21474836507 2024-09-16T03:25:07.750 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.750 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.750 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:25:07.750 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 42949672979 2024-09-16T03:25:07.750 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.750 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.750 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:25:07.750 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 64424509451 2024-09-16T03:25:07.750 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.750 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:07.750 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_by_state": [ 2024-09-16T03:25:07.750 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.751 INFO:tasks.workunit.client.0.smithi096.stderr: "state": "active+clean", 2024-09-16T03:25:07.751 INFO:tasks.workunit.client.0.smithi096.stderr: "num": 64 2024-09-16T03:25:07.751 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.751 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:07.751 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_by_osd": [ 2024-09-16T03:25:07.751 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.751 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:25:07.751 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 15, 2024-09-16T03:25:07.751 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 64, 2024-09-16T03:25:07.751 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:25:07.751 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.751 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.751 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:25:07.751 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 20, 2024-09-16T03:25:07.752 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 64, 2024-09-16T03:25:07.752 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:25:07.752 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.752 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.752 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:25:07.752 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 29, 2024-09-16T03:25:07.752 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 64, 2024-09-16T03:25:07.752 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:25:07.752 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.752 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:07.752 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": [ 2024-09-16T03:25:07.752 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.752 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 1, 2024-09-16T03:25:07.752 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": {} 2024-09-16T03:25:07.753 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.753 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:07.753 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 2, 2024-09-16T03:25:07.753 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": {} 2024-09-16T03:25:07.753 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.753 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:07.753 INFO:tasks.workunit.client.0.smithi096.stderr: "servicemap": { 2024-09-16T03:25:07.753 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 4, 2024-09-16T03:25:07.753 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:25:02.412573+0000", 2024-09-16T03:25:07.753 INFO:tasks.workunit.client.0.smithi096.stderr: "services": { 2024-09-16T03:25:07.753 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": { 2024-09-16T03:25:07.753 INFO:tasks.workunit.client.0.smithi096.stderr: "daemons": { 2024-09-16T03:25:07.753 INFO:tasks.workunit.client.0.smithi096.stderr: "summary": "", 2024-09-16T03:25:07.754 INFO:tasks.workunit.client.0.smithi096.stderr: "2": { 2024-09-16T03:25:07.754 INFO:tasks.workunit.client.0.smithi096.stderr: "start_epoch": 0, 2024-09-16T03:25:07.754 INFO:tasks.workunit.client.0.smithi096.stderr: "start_stamp": "0.000000", 2024-09-16T03:25:07.754 INFO:tasks.workunit.client.0.smithi096.stderr: "gid": 0, 2024-09-16T03:25:07.754 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "(unrecognized address family 0)/0", 2024-09-16T03:25:07.754 INFO:tasks.workunit.client.0.smithi096.stderr: "metadata": {}, 2024-09-16T03:25:07.754 INFO:tasks.workunit.client.0.smithi096.stderr: "task_status": {} 2024-09-16T03:25:07.754 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.754 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.754 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.754 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.754 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:07.754 INFO:tasks.workunit.client.0.smithi096.stderr: "mgrstat_first_committed": 52, 2024-09-16T03:25:07.754 INFO:tasks.workunit.client.0.smithi096.stderr: "mgrstat_last_committed": 59, 2024-09-16T03:25:07.755 INFO:tasks.workunit.client.0.smithi096.stderr: "logm_first_committed": 1, 2024-09-16T03:25:07.755 INFO:tasks.workunit.client.0.smithi096.stderr: "logm_last_committed": 261, 2024-09-16T03:25:07.755 INFO:tasks.workunit.client.0.smithi096.stderr: "paxos": { 2024-09-16T03:25:07.755 INFO:tasks.workunit.client.0.smithi096.stderr: "first_committed": 1, 2024-09-16T03:25:07.755 INFO:tasks.workunit.client.0.smithi096.stderr: "last_committed": 364, 2024-09-16T03:25:07.755 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pn": 0, 2024-09-16T03:25:07.755 INFO:tasks.workunit.client.0.smithi096.stderr: "accepted_pn": 0 2024-09-16T03:25:07.755 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:07.755 INFO:tasks.workunit.client.0.smithi096.stderr:}' 2024-09-16T03:25:07.759 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:97: check_lec_honours_osd: jq .osdmap_clean_epochs.min_last_epoch_clean 2024-09-16T03:25:07.759 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:97: check_lec_honours_osd: echo '{' '"cluster_fingerprint":' '"fda2fc64-07ed-4add-8224-2e527e11d427",' '"version":' '"19.3.0-4930-gfc3e0bff",' '"commit":' '"fc3e0bff7468fd55478adbae7f75508b749124b6",' '"timestamp":' '"2024-09-16T03:25:07.642033+0000",' '"tag":' '"",' '"health":' '{' '"status":' '"HEALTH_OK",' '"checks":' '{},' '"mutes":' '[]' '},' '"monmap_first_committed":' 1, '"monmap_last_committed":' 1, '"monmap":' '{' '"epoch":' 1, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"modified":' '"2024-09-16T03:22:45.872880Z",' '"created":' '"2024-09-16T03:22:45.872880Z",' '"min_mon_release":' 19, '"min_mon_release_name":' '"squid",' '"election_strategy":' 1, '"disallowed_leaders:' '":' '"",' '"stretch_mode":' false, '"tiebreaker_mon":' '"",' '"removed_ranks:' '":' '"",' '"features":' '{' '"persistent":' '[' '"kraken",' '"luminous",' '"mimic",' '"osdmap-prune",' '"nautilus",' '"octopus",' '"pacific",' '"elector-pinging",' '"quincy",' '"reef",' '"squid"' '],' '"optional":' '[]' '},' '"mons":' '[' '{' '"rank":' 0, '"name":' '"a",' '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:7302",' '"nonce":' 0 '}' ']' '},' '"addr":' '"127.0.0.1:7302/0",' '"public_addr":' '"127.0.0.1:7302/0",' '"priority":' 0, '"weight":' 0, '"crush_location":' '"{}"' '}' ']' '},' '"quorum":' '[' 0 '],' '"osdmap":' '{' '"epoch":' 32, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"created":' '"2024-09-16T03:22:46.906117+0000",' '"modified":' '"2024-09-16T03:25:05.447882+0000",' '"last_up_change":' '"2024-09-16T03:24:37.708512+0000",' '"last_in_change":' '"2024-09-16T03:24:01.831039+0000",' '"flags":' '"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit",' '"flags_num":' 5799936, '"flags_set":' '[' '"pglog_hardlimit",' '"purged_snapdirs",' '"recovery_deletes",' '"sortbitwise"' '],' '"crush_version":' 7, '"full_ratio":' 0.97000002861022949, '"backfillfull_ratio":' 0.97000002861022949, '"nearfull_ratio":' 0.85000002384185791, '"cluster_snapshot":' '"",' '"pool_max":' 2, '"max_osd":' 3, '"require_min_compat_client":' '"luminous",' '"min_compat_client":' '"jewel",' '"require_osd_release":' '"squid",' '"allow_crimson":' false, '"pools":' '[' '{' '"pool":' 1, '"pool_name":' '"foo",' '"create_time":' '"2024-09-16T03:24:44.525189+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"30",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.690000057220459, '"score_stable":' 1.690000057220459, '"optimal_score":' 1, '"raw_score_acting":' 1.690000057220459, '"raw_score_stable":' 1.690000057220459, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '},' '{' '"pool":' 2, '"pool_name":' '"bar",' '"create_time":' '"2024-09-16T03:24:46.226575+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"32",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.1299999952316284, '"score_stable":' 1.1299999952316284, '"optimal_score":' 1, '"raw_score_acting":' 1.1299999952316284, '"raw_score_stable":' 1.1299999952316284, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '}' '],' '"osds":' '[' '{' '"osd":' 0, '"uuid":' '"64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 5, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6802",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6803",' '"nonce":' 3375787448 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6804",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6805",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6808",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6809",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6806",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6807",' '"nonce":' 3375787448 '}' ']' '},' '"public_addr":' '"127.0.0.1:6803/3375787448",' '"cluster_addr":' '"127.0.0.1:6805/3375787448",' '"heartbeat_back_addr":' '"127.0.0.1:6809/3375787448",' '"heartbeat_front_addr":' '"127.0.0.1:6807/3375787448",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 1, '"uuid":' '"74b26727-75c9-444d-8782-719e4197a382",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 10, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6810",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6811",' '"nonce":' 3733255132 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6812",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6813",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6816",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6817",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6814",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6815",' '"nonce":' 3733255132 '}' ']' '},' '"public_addr":' '"127.0.0.1:6811/3733255132",' '"cluster_addr":' '"127.0.0.1:6813/3733255132",' '"heartbeat_back_addr":' '"127.0.0.1:6817/3733255132",' '"heartbeat_front_addr":' '"127.0.0.1:6815/3733255132",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 2, '"uuid":' '"143da3a7-dad9-4b1e-966b-76cf5bdd3c82",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 15, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6818",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6819",' '"nonce":' 963814857 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6820",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6821",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6824",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6825",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6822",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6823",' '"nonce":' 963814857 '}' ']' '},' '"public_addr":' '"127.0.0.1:6819/963814857",' '"cluster_addr":' '"127.0.0.1:6821/963814857",' '"heartbeat_back_addr":' '"127.0.0.1:6825/963814857",' '"heartbeat_front_addr":' '"127.0.0.1:6823/963814857",' '"state":' '[' '"exists",' '"up"' ']' '}' '],' '"osd_xinfo":' '[' '{' '"osd":' 0, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:22.481942+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 1, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:59.663703+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 2, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:24:37.320822+0000",' '"dead_epoch":' 0 '}' '],' '"pg_upmap":' '[],' '"pg_upmap_items":' '[],' '"pg_upmap_primaries":' '[],' '"pg_temp":' '[],' '"primary_temp":' '[],' '"blocklist":' '{},' '"range_blocklist":' '{},' '"erasure_code_profiles":' '{' '"default":' '{' '"k":' '"2",' '"m":' '"2",' '"plugin":' '"jerasure",' '"technique":' '"reed_sol_van"' '}' '},' '"removed_snaps_queue":' '[],' '"new_removed_snaps":' '[],' '"new_purged_snaps":' '[],' '"crush_node_flags":' '{},' '"device_class_flags":' '{},' '"stretch_mode":' '{' '"stretch_mode_enabled":' false, '"stretch_bucket_count":' 0, '"degraded_stretch_mode":' 0, '"recovering_stretch_mode":' 0, '"stretch_mode_bucket":' 0 '}' '},' '"osd_metadata":' '[' '{' '"id":' 0, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/0/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:22:53.662571Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]",' '"hb_front_addr":' '"[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/0",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 1, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/1/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:23:30.129885Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]",' '"hb_front_addr":' '"[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/1",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 2, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/2/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:24:07.764502Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]",' '"hb_front_addr":' '"[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/2",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '}' '],' '"osdmap_clean_epochs":' '{' '"min_last_epoch_clean":' 28, '"last_epoch_clean":' '{' '"per_pool":' '[' '{' '"poolid":' 1, '"floor":' 28 '},' '{' '"poolid":' 2, '"floor":' 28 '}' ']' '},' '"osd_epochs":' '[' '{' '"id":' 0, '"epoch":' 32 '},' '{' '"id":' 1, '"epoch":' 28 '},' '{' '"id":' 2, '"epoch":' 28 '}' ']' '},' '"osdmap_first_committed":' 26, '"osdmap_last_committed":' 32, '"crushmap":' '{' '"devices":' '[' '{' '"id":' 0, '"name":' '"osd.0",' '"class":' '"hdd"' '},' '{' '"id":' 1, '"name":' '"osd.1",' '"class":' '"hdd"' '},' '{' '"id":' 2, '"name":' '"osd.2",' '"class":' '"hdd"' '}' '],' '"types":' '[' '{' '"type_id":' 0, '"name":' '"osd"' '},' '{' '"type_id":' 1, '"name":' '"host"' '},' '{' '"type_id":' 2, '"name":' '"chassis"' '},' '{' '"type_id":' 3, '"name":' '"rack"' '},' '{' '"type_id":' 4, '"name":' '"row"' '},' '{' '"type_id":' 5, '"name":' '"pdu"' '},' '{' '"type_id":' 6, '"name":' '"pod"' '},' '{' '"type_id":' 7, '"name":' '"room"' '},' '{' '"type_id":' 8, '"name":' '"datacenter"' '},' '{' '"type_id":' 9, '"name":' '"zone"' '},' '{' '"type_id":' 10, '"name":' '"region"' '},' '{' '"type_id":' 11, '"name":' '"root"' '}' '],' '"buckets":' '[' '{' '"id":' -1, '"name":' '"default",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -3, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -2, '"name":' '"default~hdd",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -4, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -3, '"name":' '"smithi096",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '},' '{' '"id":' -4, '"name":' '"smithi096~hdd",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '}' '],' '"rules":' '[' '{' '"rule_id":' 0, '"rule_name":' '"replicated_rule",' '"type":' 1, '"steps":' '[' '{' '"op":' '"take",' '"item":' -1, '"item_name":' '"default"' '},' '{' '"op":' '"choose_firstn",' '"num":' 0, '"type":' '"osd"' '},' '{' '"op":' '"emit"' '}' ']' '}' '],' '"tunables":' '{' '"choose_local_tries":' 0, '"choose_local_fallback_tries":' 0, '"choose_total_tries":' 50, '"chooseleaf_descend_once":' 1, '"chooseleaf_vary_r":' 1, '"chooseleaf_stable":' 1, '"msr_descents":' 100, '"msr_collision_tries":' 100, '"straw_calc_version":' 1, '"allowed_bucket_algs":' 54, '"profile":' '"jewel",' '"optimal_tunables":' 1, '"legacy_tunables":' 0, '"minimum_required_version":' '"jewel",' '"require_feature_tunables":' 1, '"require_feature_tunables2":' 1, '"has_v2_rules":' 0, '"require_feature_tunables3":' 1, '"has_v3_rules":' 0, '"has_v4_buckets":' 1, '"require_feature_tunables5":' 1, '"has_v5_rules":' 0, '"has_msr_rules":' 0 '},' '"choose_args":' '{}' '},' '"fsmap":' '{' '"epoch":' 1, '"btime":' '"2024-09-16T03:22:46:882186+0000",' '"default_fscid":' -1, '"compat":' '{' '"compat":' '{},' '"ro_compat":' '{},' '"incompat":' '{' '"feature_1":' '"base' 'v0.20",' '"feature_2":' '"client' writeable 'ranges",' '"feature_3":' '"default' file layouts on 'dirs",' '"feature_4":' '"dir' inode in separate 'object",' '"feature_5":' '"mds' uses versioned 'encoding",' '"feature_6":' '"dirfrag' is stored in 'omap",' '"feature_8":' '"no' anchor 'table",' '"feature_9":' '"file' layout 'v2",' '"feature_10":' '"snaprealm' 'v2",' '"feature_11":' '"minor' log 'segments",' '"feature_12":' '"quiesce' 'subvolumes"' '}' '},' '"feature_flags":' '{' '"enable_multiple":' true, '"ever_enabled_multiple":' true '},' '"standbys":' '[],' '"filesystems":' '[]' '},' '"mdsmap_first_committed":' 1, '"mdsmap_last_committed":' 1, '"auth":' '{' '"first_committed":' 1, '"last_committed":' 5, '"num_secrets":' 3 '},' '"num_pg":' 64, '"num_pg_active":' 64, '"num_pg_unknown":' 0, '"num_osd":' 3, '"pool_sum":' '{' '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 192, '"acting":' 192, '"num_store_stats":' 0 '},' '"osd_sum":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 192, '"num_osds":' 3, '"num_per_pool_osds":' 3, '"num_per_pool_omap_osds":' 3, '"kb":' 314572800, '"kb_used":' 81232, '"kb_used_data":' 696, '"kb_used_omap":' 4, '"kb_used_meta":' 80443, '"kb_avail":' 314491568, '"statfs":' '{' '"total":' 322122547200, '"available":' 322039365632, '"internally_reserved":' 0, '"allocated":' 712704, '"data_stored":' 209643, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 4785, '"internal_metadata":' 82373967 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 108, '"apply_latency_ms":' 108, '"commit_latency_ns":' 108000000, '"apply_latency_ns":' 108000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '},' '"osd_sum_by_class":' '{' '"hdd":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 192, '"num_osds":' 3, '"num_per_pool_osds":' 3, '"num_per_pool_omap_osds":' 3, '"kb":' 314572800, '"kb_used":' 81232, '"kb_used_data":' 696, '"kb_used_omap":' 4, '"kb_used_meta":' 80443, '"kb_avail":' 314491568, '"statfs":' '{' '"total":' 322122547200, '"available":' 322039365632, '"internally_reserved":' 0, '"allocated":' 712704, '"data_stored":' 209643, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 4785, '"internal_metadata":' 82373967 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 108, '"apply_latency_ms":' 108, '"commit_latency_ns":' 108000000, '"apply_latency_ns":' 108000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '}' '},' '"pool_stats":' '[' '{' '"poolid":' 2, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 96, '"acting":' 96, '"num_store_stats":' 3 '},' '{' '"poolid":' 1, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 96, '"acting":' 96, '"num_store_stats":' 3 '}' '],' '"osd_stats":' '[' '{' '"osd":' 0, '"seq":' 21474836507 '},' '{' '"osd":' 1, '"seq":' 42949672979 '},' '{' '"osd":' 2, '"seq":' 64424509451 '}' '],' '"num_pg_by_state":' '[' '{' '"state":' '"active+clean",' '"num":' 64 '}' '],' '"num_pg_by_osd":' '[' '{' '"osd":' 2, '"num_primary_pg":' 15, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 0, '"num_primary_pg":' 20, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 1, '"num_primary_pg":' 29, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '}' '],' '"purged_snaps":' '[' '{' '"pool":' 1, '"purged_snaps":' '{}' '},' '{' '"pool":' 2, '"purged_snaps":' '{}' '}' '],' '"servicemap":' '{' '"epoch":' 4, '"modified":' '"2024-09-16T03:25:02.412573+0000",' '"services":' '{' '"osd":' '{' '"daemons":' '{' '"summary":' '"",' '"2":' '{' '"start_epoch":' 0, '"start_stamp":' '"0.000000",' '"gid":' 0, '"addr":' '"(unrecognized' address family '0)/0",' '"metadata":' '{},' '"task_status":' '{}' '}' '}' '}' '}' '},' '"mgrstat_first_committed":' 52, '"mgrstat_last_committed":' 59, '"logm_first_committed":' 1, '"logm_last_committed":' 261, '"paxos":' '{' '"first_committed":' 1, '"last_committed":' 364, '"last_pn":' 0, '"accepted_pn":' 0 '}' '}' 2024-09-16T03:25:07.759 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:97: check_lec_honours_osd: lec=28 2024-09-16T03:25:07.759 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:99: check_lec_honours_osd: [[ -z '' ]] 2024-09-16T03:25:07.759 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:103: check_lec_honours_osd: osds=($(echo $report | jq ".osdmap_clean_epochs.osd_epochs[] |" " select(.epoch >= $lec) | .id")) 2024-09-16T03:25:07.759 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:103: check_lec_honours_osd: jq '.osdmap_clean_epochs.osd_epochs[] |' ' select(.epoch >= 28) | .id' 2024-09-16T03:25:07.759 INFO:tasks.workunit.client.0.smithi096.stderr:jq: error: syntax error, unexpected $end (Unix shell quoting issues?) at , line 1: 2024-09-16T03:25:07.759 INFO:tasks.workunit.client.0.smithi096.stderr:.osdmap_clean_epochs.osd_epochs[] | 2024-09-16T03:25:07.759 INFO:tasks.workunit.client.0.smithi096.stderr:jq: 1 compile error 2024-09-16T03:25:07.760 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:103: check_lec_honours_osd: echo '{' '"cluster_fingerprint":' '"fda2fc64-07ed-4add-8224-2e527e11d427",' '"version":' '"19.3.0-4930-gfc3e0bff",' '"commit":' '"fc3e0bff7468fd55478adbae7f75508b749124b6",' '"timestamp":' '"2024-09-16T03:25:07.642033+0000",' '"tag":' '"",' '"health":' '{' '"status":' '"HEALTH_OK",' '"checks":' '{},' '"mutes":' '[]' '},' '"monmap_first_committed":' 1, '"monmap_last_committed":' 1, '"monmap":' '{' '"epoch":' 1, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"modified":' '"2024-09-16T03:22:45.872880Z",' '"created":' '"2024-09-16T03:22:45.872880Z",' '"min_mon_release":' 19, '"min_mon_release_name":' '"squid",' '"election_strategy":' 1, '"disallowed_leaders:' '":' '"",' '"stretch_mode":' false, '"tiebreaker_mon":' '"",' '"removed_ranks:' '":' '"",' '"features":' '{' '"persistent":' '[' '"kraken",' '"luminous",' '"mimic",' '"osdmap-prune",' '"nautilus",' '"octopus",' '"pacific",' '"elector-pinging",' '"quincy",' '"reef",' '"squid"' '],' '"optional":' '[]' '},' '"mons":' '[' '{' '"rank":' 0, '"name":' '"a",' '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:7302",' '"nonce":' 0 '}' ']' '},' '"addr":' '"127.0.0.1:7302/0",' '"public_addr":' '"127.0.0.1:7302/0",' '"priority":' 0, '"weight":' 0, '"crush_location":' '"{}"' '}' ']' '},' '"quorum":' '[' 0 '],' '"osdmap":' '{' '"epoch":' 32, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"created":' '"2024-09-16T03:22:46.906117+0000",' '"modified":' '"2024-09-16T03:25:05.447882+0000",' '"last_up_change":' '"2024-09-16T03:24:37.708512+0000",' '"last_in_change":' '"2024-09-16T03:24:01.831039+0000",' '"flags":' '"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit",' '"flags_num":' 5799936, '"flags_set":' '[' '"pglog_hardlimit",' '"purged_snapdirs",' '"recovery_deletes",' '"sortbitwise"' '],' '"crush_version":' 7, '"full_ratio":' 0.97000002861022949, '"backfillfull_ratio":' 0.97000002861022949, '"nearfull_ratio":' 0.85000002384185791, '"cluster_snapshot":' '"",' '"pool_max":' 2, '"max_osd":' 3, '"require_min_compat_client":' '"luminous",' '"min_compat_client":' '"jewel",' '"require_osd_release":' '"squid",' '"allow_crimson":' false, '"pools":' '[' '{' '"pool":' 1, '"pool_name":' '"foo",' '"create_time":' '"2024-09-16T03:24:44.525189+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"30",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.690000057220459, '"score_stable":' 1.690000057220459, '"optimal_score":' 1, '"raw_score_acting":' 1.690000057220459, '"raw_score_stable":' 1.690000057220459, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '},' '{' '"pool":' 2, '"pool_name":' '"bar",' '"create_time":' '"2024-09-16T03:24:46.226575+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"32",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.1299999952316284, '"score_stable":' 1.1299999952316284, '"optimal_score":' 1, '"raw_score_acting":' 1.1299999952316284, '"raw_score_stable":' 1.1299999952316284, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '}' '],' '"osds":' '[' '{' '"osd":' 0, '"uuid":' '"64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 5, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6802",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6803",' '"nonce":' 3375787448 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6804",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6805",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6808",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6809",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6806",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6807",' '"nonce":' 3375787448 '}' ']' '},' '"public_addr":' '"127.0.0.1:6803/3375787448",' '"cluster_addr":' '"127.0.0.1:6805/3375787448",' '"heartbeat_back_addr":' '"127.0.0.1:6809/3375787448",' '"heartbeat_front_addr":' '"127.0.0.1:6807/3375787448",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 1, '"uuid":' '"74b26727-75c9-444d-8782-719e4197a382",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 10, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6810",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6811",' '"nonce":' 3733255132 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6812",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6813",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6816",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6817",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6814",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6815",' '"nonce":' 3733255132 '}' ']' '},' '"public_addr":' '"127.0.0.1:6811/3733255132",' '"cluster_addr":' '"127.0.0.1:6813/3733255132",' '"heartbeat_back_addr":' '"127.0.0.1:6817/3733255132",' '"heartbeat_front_addr":' '"127.0.0.1:6815/3733255132",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 2, '"uuid":' '"143da3a7-dad9-4b1e-966b-76cf5bdd3c82",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 15, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6818",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6819",' '"nonce":' 963814857 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6820",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6821",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6824",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6825",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6822",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6823",' '"nonce":' 963814857 '}' ']' '},' '"public_addr":' '"127.0.0.1:6819/963814857",' '"cluster_addr":' '"127.0.0.1:6821/963814857",' '"heartbeat_back_addr":' '"127.0.0.1:6825/963814857",' '"heartbeat_front_addr":' '"127.0.0.1:6823/963814857",' '"state":' '[' '"exists",' '"up"' ']' '}' '],' '"osd_xinfo":' '[' '{' '"osd":' 0, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:22.481942+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 1, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:59.663703+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 2, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:24:37.320822+0000",' '"dead_epoch":' 0 '}' '],' '"pg_upmap":' '[],' '"pg_upmap_items":' '[],' '"pg_upmap_primaries":' '[],' '"pg_temp":' '[],' '"primary_temp":' '[],' '"blocklist":' '{},' '"range_blocklist":' '{},' '"erasure_code_profiles":' '{' '"default":' '{' '"k":' '"2",' '"m":' '"2",' '"plugin":' '"jerasure",' '"technique":' '"reed_sol_van"' '}' '},' '"removed_snaps_queue":' '[],' '"new_removed_snaps":' '[],' '"new_purged_snaps":' '[],' '"crush_node_flags":' '{},' '"device_class_flags":' '{},' '"stretch_mode":' '{' '"stretch_mode_enabled":' false, '"stretch_bucket_count":' 0, '"degraded_stretch_mode":' 0, '"recovering_stretch_mode":' 0, '"stretch_mode_bucket":' 0 '}' '},' '"osd_metadata":' '[' '{' '"id":' 0, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/0/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:22:53.662571Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]",' '"hb_front_addr":' '"[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/0",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 1, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/1/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:23:30.129885Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]",' '"hb_front_addr":' '"[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/1",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 2, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/2/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:24:07.764502Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]",' '"hb_front_addr":' '"[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/2",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '}' '],' '"osdmap_clean_epochs":' '{' '"min_last_epoch_clean":' 28, '"last_epoch_clean":' '{' '"per_pool":' '[' '{' '"poolid":' 1, '"floor":' 28 '},' '{' '"poolid":' 2, '"floor":' 28 '}' ']' '},' '"osd_epochs":' '[' '{' '"id":' 0, '"epoch":' 32 '},' '{' '"id":' 1, '"epoch":' 28 '},' '{' '"id":' 2, '"epoch":' 28 '}' ']' '},' '"osdmap_first_committed":' 26, '"osdmap_last_committed":' 32, '"crushmap":' '{' '"devices":' '[' '{' '"id":' 0, '"name":' '"osd.0",' '"class":' '"hdd"' '},' '{' '"id":' 1, '"name":' '"osd.1",' '"class":' '"hdd"' '},' '{' '"id":' 2, '"name":' '"osd.2",' '"class":' '"hdd"' '}' '],' '"types":' '[' '{' '"type_id":' 0, '"name":' '"osd"' '},' '{' '"type_id":' 1, '"name":' '"host"' '},' '{' '"type_id":' 2, '"name":' '"chassis"' '},' '{' '"type_id":' 3, '"name":' '"rack"' '},' '{' '"type_id":' 4, '"name":' '"row"' '},' '{' '"type_id":' 5, '"name":' '"pdu"' '},' '{' '"type_id":' 6, '"name":' '"pod"' '},' '{' '"type_id":' 7, '"name":' '"room"' '},' '{' '"type_id":' 8, '"name":' '"datacenter"' '},' '{' '"type_id":' 9, '"name":' '"zone"' '},' '{' '"type_id":' 10, '"name":' '"region"' '},' '{' '"type_id":' 11, '"name":' '"root"' '}' '],' '"buckets":' '[' '{' '"id":' -1, '"name":' '"default",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -3, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -2, '"name":' '"default~hdd",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -4, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -3, '"name":' '"smithi096",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '},' '{' '"id":' -4, '"name":' '"smithi096~hdd",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '}' '],' '"rules":' '[' '{' '"rule_id":' 0, '"rule_name":' '"replicated_rule",' '"type":' 1, '"steps":' '[' '{' '"op":' '"take",' '"item":' -1, '"item_name":' '"default"' '},' '{' '"op":' '"choose_firstn",' '"num":' 0, '"type":' '"osd"' '},' '{' '"op":' '"emit"' '}' ']' '}' '],' '"tunables":' '{' '"choose_local_tries":' 0, '"choose_local_fallback_tries":' 0, '"choose_total_tries":' 50, '"chooseleaf_descend_once":' 1, '"chooseleaf_vary_r":' 1, '"chooseleaf_stable":' 1, '"msr_descents":' 100, '"msr_collision_tries":' 100, '"straw_calc_version":' 1, '"allowed_bucket_algs":' 54, '"profile":' '"jewel",' '"optimal_tunables":' 1, '"legacy_tunables":' 0, '"minimum_required_version":' '"jewel",' '"require_feature_tunables":' 1, '"require_feature_tunables2":' 1, '"has_v2_rules":' 0, '"require_feature_tunables3":' 1, '"has_v3_rules":' 0, '"has_v4_buckets":' 1, '"require_feature_tunables5":' 1, '"has_v5_rules":' 0, '"has_msr_rules":' 0 '},' '"choose_args":' '{}' '},' '"fsmap":' '{' '"epoch":' 1, '"btime":' '"2024-09-16T03:22:46:882186+0000",' '"default_fscid":' -1, '"compat":' '{' '"compat":' '{},' '"ro_compat":' '{},' '"incompat":' '{' '"feature_1":' '"base' 'v0.20",' '"feature_2":' '"client' writeable 'ranges",' '"feature_3":' '"default' file layouts on 'dirs",' '"feature_4":' '"dir' inode in separate 'object",' '"feature_5":' '"mds' uses versioned 'encoding",' '"feature_6":' '"dirfrag' is stored in 'omap",' '"feature_8":' '"no' anchor 'table",' '"feature_9":' '"file' layout 'v2",' '"feature_10":' '"snaprealm' 'v2",' '"feature_11":' '"minor' log 'segments",' '"feature_12":' '"quiesce' 'subvolumes"' '}' '},' '"feature_flags":' '{' '"enable_multiple":' true, '"ever_enabled_multiple":' true '},' '"standbys":' '[],' '"filesystems":' '[]' '},' '"mdsmap_first_committed":' 1, '"mdsmap_last_committed":' 1, '"auth":' '{' '"first_committed":' 1, '"last_committed":' 5, '"num_secrets":' 3 '},' '"num_pg":' 64, '"num_pg_active":' 64, '"num_pg_unknown":' 0, '"num_osd":' 3, '"pool_sum":' '{' '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 192, '"acting":' 192, '"num_store_stats":' 0 '},' '"osd_sum":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 192, '"num_osds":' 3, '"num_per_pool_osds":' 3, '"num_per_pool_omap_osds":' 3, '"kb":' 314572800, '"kb_used":' 81232, '"kb_used_data":' 696, '"kb_used_omap":' 4, '"kb_used_meta":' 80443, '"kb_avail":' 314491568, '"statfs":' '{' '"total":' 322122547200, '"available":' 322039365632, '"internally_reserved":' 0, '"allocated":' 712704, '"data_stored":' 209643, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 4785, '"internal_metadata":' 82373967 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 108, '"apply_latency_ms":' 108, '"commit_latency_ns":' 108000000, '"apply_latency_ns":' 108000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '},' '"osd_sum_by_class":' '{' '"hdd":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 192, '"num_osds":' 3, '"num_per_pool_osds":' 3, '"num_per_pool_omap_osds":' 3, '"kb":' 314572800, '"kb_used":' 81232, '"kb_used_data":' 696, '"kb_used_omap":' 4, '"kb_used_meta":' 80443, '"kb_avail":' 314491568, '"statfs":' '{' '"total":' 322122547200, '"available":' 322039365632, '"internally_reserved":' 0, '"allocated":' 712704, '"data_stored":' 209643, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 4785, '"internal_metadata":' 82373967 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 108, '"apply_latency_ms":' 108, '"commit_latency_ns":' 108000000, '"apply_latency_ns":' 108000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '}' '},' '"pool_stats":' '[' '{' '"poolid":' 2, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 96, '"acting":' 96, '"num_store_stats":' 3 '},' '{' '"poolid":' 1, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 96, '"acting":' 96, '"num_store_stats":' 3 '}' '],' '"osd_stats":' '[' '{' '"osd":' 0, '"seq":' 21474836507 '},' '{' '"osd":' 1, '"seq":' 42949672979 '},' '{' '"osd":' 2, '"seq":' 64424509451 '}' '],' '"num_pg_by_state":' '[' '{' '"state":' '"active+clean",' '"num":' 64 '}' '],' '"num_pg_by_osd":' '[' '{' '"osd":' 2, '"num_primary_pg":' 15, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 0, '"num_primary_pg":' 20, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 1, '"num_primary_pg":' 29, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '}' '],' '"purged_snaps":' '[' '{' '"pool":' 1, '"purged_snaps":' '{}' '},' '{' '"pool":' 2, '"purged_snaps":' '{}' '}' '],' '"servicemap":' '{' '"epoch":' 4, '"modified":' '"2024-09-16T03:25:02.412573+0000",' '"services":' '{' '"osd":' '{' '"daemons":' '{' '"summary":' '"",' '"2":' '{' '"start_epoch":' 0, '"start_stamp":' '"0.000000",' '"gid":' 0, '"addr":' '"(unrecognized' address family '0)/0",' '"metadata":' '{},' '"task_status":' '{}' '}' '}' '}' '}' '},' '"mgrstat_first_committed":' 52, '"mgrstat_last_committed":' 59, '"logm_first_committed":' 1, '"logm_last_committed":' 261, '"paxos":' '{' '"first_committed":' 1, '"last_committed":' 364, '"last_pn":' 0, '"accepted_pn":' 0 '}' '}' 2024-09-16T03:25:07.760 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:105: check_lec_honours_osd: [[ 0 -eq 3 ]] 2024-09-16T03:25:07.760 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:105: check_lec_honours_osd: echo '{' '"cluster_fingerprint":' '"fda2fc64-07ed-4add-8224-2e527e11d427",' '"version":' '"19.3.0-4930-gfc3e0bff",' '"commit":' '"fc3e0bff7468fd55478adbae7f75508b749124b6",' '"timestamp":' '"2024-09-16T03:25:07.642033+0000",' '"tag":' '"",' '"health":' '{' '"status":' '"HEALTH_OK",' '"checks":' '{},' '"mutes":' '[]' '},' '"monmap_first_committed":' 1, '"monmap_last_committed":' 1, '"monmap":' '{' '"epoch":' 1, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"modified":' '"2024-09-16T03:22:45.872880Z",' '"created":' '"2024-09-16T03:22:45.872880Z",' '"min_mon_release":' 19, '"min_mon_release_name":' '"squid",' '"election_strategy":' 1, '"disallowed_leaders:' '":' '"",' '"stretch_mode":' false, '"tiebreaker_mon":' '"",' '"removed_ranks:' '":' '"",' '"features":' '{' '"persistent":' '[' '"kraken",' '"luminous",' '"mimic",' '"osdmap-prune",' '"nautilus",' '"octopus",' '"pacific",' '"elector-pinging",' '"quincy",' '"reef",' '"squid"' '],' '"optional":' '[]' '},' '"mons":' '[' '{' '"rank":' 0, '"name":' '"a",' '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:7302",' '"nonce":' 0 '}' ']' '},' '"addr":' '"127.0.0.1:7302/0",' '"public_addr":' '"127.0.0.1:7302/0",' '"priority":' 0, '"weight":' 0, '"crush_location":' '"{}"' '}' ']' '},' '"quorum":' '[' 0 '],' '"osdmap":' '{' '"epoch":' 32, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"created":' '"2024-09-16T03:22:46.906117+0000",' '"modified":' '"2024-09-16T03:25:05.447882+0000",' '"last_up_change":' '"2024-09-16T03:24:37.708512+0000",' '"last_in_change":' '"2024-09-16T03:24:01.831039+0000",' '"flags":' '"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit",' '"flags_num":' 5799936, '"flags_set":' '[' '"pglog_hardlimit",' '"purged_snapdirs",' '"recovery_deletes",' '"sortbitwise"' '],' '"crush_version":' 7, '"full_ratio":' 0.97000002861022949, '"backfillfull_ratio":' 0.97000002861022949, '"nearfull_ratio":' 0.85000002384185791, '"cluster_snapshot":' '"",' '"pool_max":' 2, '"max_osd":' 3, '"require_min_compat_client":' '"luminous",' '"min_compat_client":' '"jewel",' '"require_osd_release":' '"squid",' '"allow_crimson":' false, '"pools":' '[' '{' '"pool":' 1, '"pool_name":' '"foo",' '"create_time":' '"2024-09-16T03:24:44.525189+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"30",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.690000057220459, '"score_stable":' 1.690000057220459, '"optimal_score":' 1, '"raw_score_acting":' 1.690000057220459, '"raw_score_stable":' 1.690000057220459, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '},' '{' '"pool":' 2, '"pool_name":' '"bar",' '"create_time":' '"2024-09-16T03:24:46.226575+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"32",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.1299999952316284, '"score_stable":' 1.1299999952316284, '"optimal_score":' 1, '"raw_score_acting":' 1.1299999952316284, '"raw_score_stable":' 1.1299999952316284, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '}' '],' '"osds":' '[' '{' '"osd":' 0, '"uuid":' '"64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 5, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6802",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6803",' '"nonce":' 3375787448 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6804",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6805",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6808",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6809",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6806",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6807",' '"nonce":' 3375787448 '}' ']' '},' '"public_addr":' '"127.0.0.1:6803/3375787448",' '"cluster_addr":' '"127.0.0.1:6805/3375787448",' '"heartbeat_back_addr":' '"127.0.0.1:6809/3375787448",' '"heartbeat_front_addr":' '"127.0.0.1:6807/3375787448",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 1, '"uuid":' '"74b26727-75c9-444d-8782-719e4197a382",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 10, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6810",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6811",' '"nonce":' 3733255132 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6812",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6813",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6816",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6817",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6814",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6815",' '"nonce":' 3733255132 '}' ']' '},' '"public_addr":' '"127.0.0.1:6811/3733255132",' '"cluster_addr":' '"127.0.0.1:6813/3733255132",' '"heartbeat_back_addr":' '"127.0.0.1:6817/3733255132",' '"heartbeat_front_addr":' '"127.0.0.1:6815/3733255132",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 2, '"uuid":' '"143da3a7-dad9-4b1e-966b-76cf5bdd3c82",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 15, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6818",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6819",' '"nonce":' 963814857 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6820",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6821",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6824",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6825",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6822",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6823",' '"nonce":' 963814857 '}' ']' '},' '"public_addr":' '"127.0.0.1:6819/963814857",' '"cluster_addr":' '"127.0.0.1:6821/963814857",' '"heartbeat_back_addr":' '"127.0.0.1:6825/963814857",' '"heartbeat_front_addr":' '"127.0.0.1:6823/963814857",' '"state":' '[' '"exists",' '"up"' ']' '}' '],' '"osd_xinfo":' '[' '{' '"osd":' 0, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:22.481942+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 1, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:59.663703+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 2, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:24:37.320822+0000",' '"dead_epoch":' 0 '}' '],' '"pg_upmap":' '[],' '"pg_upmap_items":' '[],' '"pg_upmap_primaries":' '[],' '"pg_temp":' '[],' '"primary_temp":' '[],' '"blocklist":' '{},' '"range_blocklist":' '{},' '"erasure_code_profiles":' '{' '"default":' '{' '"k":' '"2",' '"m":' '"2",' '"plugin":' '"jerasure",' '"technique":' '"reed_sol_van"' '}' '},' '"removed_snaps_queue":' '[],' '"new_removed_snaps":' '[],' '"new_purged_snaps":' '[],' '"crush_node_flags":' '{},' '"device_class_flags":' '{},' '"stretch_mode":' '{' '"stretch_mode_enabled":' false, '"stretch_bucket_count":' 0, '"degraded_stretch_mode":' 0, '"recovering_stretch_mode":' 0, '"stretch_mode_bucket":' 0 '}' '},' '"osd_metadata":' '[' '{' '"id":' 0, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/0/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:22:53.662571Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]",' '"hb_front_addr":' '"[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/0",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 1, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/1/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:23:30.129885Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]",' '"hb_front_addr":' '"[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/1",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 2, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/2/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:24:07.764502Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]",' '"hb_front_addr":' '"[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/2",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '}' '],' '"osdmap_clean_epochs":' '{' '"min_last_epoch_clean":' 28, '"last_epoch_clean":' '{' '"per_pool":' '[' '{' '"poolid":' 1, '"floor":' 28 '},' '{' '"poolid":' 2, '"floor":' 28 '}' ']' '},' '"osd_epochs":' '[' '{' '"id":' 0, '"epoch":' 32 '},' '{' '"id":' 1, '"epoch":' 28 '},' '{' '"id":' 2, '"epoch":' 28 '}' ']' '},' '"osdmap_first_committed":' 26, '"osdmap_last_committed":' 32, '"crushmap":' '{' '"devices":' '[' '{' '"id":' 0, '"name":' '"osd.0",' '"class":' '"hdd"' '},' '{' '"id":' 1, '"name":' '"osd.1",' '"class":' '"hdd"' '},' '{' '"id":' 2, '"name":' '"osd.2",' '"class":' '"hdd"' '}' '],' '"types":' '[' '{' '"type_id":' 0, '"name":' '"osd"' '},' '{' '"type_id":' 1, '"name":' '"host"' '},' '{' '"type_id":' 2, '"name":' '"chassis"' '},' '{' '"type_id":' 3, '"name":' '"rack"' '},' '{' '"type_id":' 4, '"name":' '"row"' '},' '{' '"type_id":' 5, '"name":' '"pdu"' '},' '{' '"type_id":' 6, '"name":' '"pod"' '},' '{' '"type_id":' 7, '"name":' '"room"' '},' '{' '"type_id":' 8, '"name":' '"datacenter"' '},' '{' '"type_id":' 9, '"name":' '"zone"' '},' '{' '"type_id":' 10, '"name":' '"region"' '},' '{' '"type_id":' 11, '"name":' '"root"' '}' '],' '"buckets":' '[' '{' '"id":' -1, '"name":' '"default",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -3, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -2, '"name":' '"default~hdd",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -4, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -3, '"name":' '"smithi096",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '},' '{' '"id":' -4, '"name":' '"smithi096~hdd",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '}' '],' '"rules":' '[' '{' '"rule_id":' 0, '"rule_name":' '"replicated_rule",' '"type":' 1, '"steps":' '[' '{' '"op":' '"take",' '"item":' -1, '"item_name":' '"default"' '},' '{' '"op":' '"choose_firstn",' '"num":' 0, '"type":' '"osd"' '},' '{' '"op":' '"emit"' '}' ']' '}' '],' '"tunables":' '{' '"choose_local_tries":' 0, '"choose_local_fallback_tries":' 0, '"choose_total_tries":' 50, '"chooseleaf_descend_once":' 1, '"chooseleaf_vary_r":' 1, '"chooseleaf_stable":' 1, '"msr_descents":' 100, '"msr_collision_tries":' 100, '"straw_calc_version":' 1, '"allowed_bucket_algs":' 54, '"profile":' '"jewel",' '"optimal_tunables":' 1, '"legacy_tunables":' 0, '"minimum_required_version":' '"jewel",' '"require_feature_tunables":' 1, '"require_feature_tunables2":' 1, '"has_v2_rules":' 0, '"require_feature_tunables3":' 1, '"has_v3_rules":' 0, '"has_v4_buckets":' 1, '"require_feature_tunables5":' 1, '"has_v5_rules":' 0, '"has_msr_rules":' 0 '},' '"choose_args":' '{}' '},' '"fsmap":' '{' '"epoch":' 1, '"btime":' '"2024-09-16T03:22:46:882186+0000",' '"default_fscid":' -1, '"compat":' '{' '"compat":' '{},' '"ro_compat":' '{},' '"incompat":' '{' '"feature_1":' '"base' 'v0.20",' '"feature_2":' '"client' writeable 'ranges",' '"feature_3":' '"default' file layouts on 'dirs",' '"feature_4":' '"dir' inode in separate 'object",' '"feature_5":' '"mds' uses versioned 'encoding",' '"feature_6":' '"dirfrag' is stored in 'omap",' '"feature_8":' '"no' anchor 'table",' '"feature_9":' '"file' layout 'v2",' '"feature_10":' '"snaprealm' 'v2",' '"feature_11":' '"minor' log 'segments",' '"feature_12":' '"quiesce' 'subvolumes"' '}' '},' '"feature_flags":' '{' '"enable_multiple":' true, '"ever_enabled_multiple":' true '},' '"standbys":' '[],' '"filesystems":' '[]' '},' '"mdsmap_first_committed":' 1, '"mdsmap_last_committed":' 1, '"auth":' '{' '"first_committed":' 1, '"last_committed":' 5, '"num_secrets":' 3 '},' '"num_pg":' 64, '"num_pg_active":' 64, '"num_pg_unknown":' 0, '"num_osd":' 3, '"pool_sum":' '{' '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 192, '"acting":' 192, '"num_store_stats":' 0 '},' '"osd_sum":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 192, '"num_osds":' 3, '"num_per_pool_osds":' 3, '"num_per_pool_omap_osds":' 3, '"kb":' 314572800, '"kb_used":' 81232, '"kb_used_data":' 696, '"kb_used_omap":' 4, '"kb_used_meta":' 80443, '"kb_avail":' 314491568, '"statfs":' '{' '"total":' 322122547200, '"available":' 322039365632, '"internally_reserved":' 0, '"allocated":' 712704, '"data_stored":' 209643, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 4785, '"internal_metadata":' 82373967 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 108, '"apply_latency_ms":' 108, '"commit_latency_ns":' 108000000, '"apply_latency_ns":' 108000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '},' '"osd_sum_by_class":' '{' '"hdd":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 192, '"num_osds":' 3, '"num_per_pool_osds":' 3, '"num_per_pool_omap_osds":' 3, '"kb":' 314572800, '"kb_used":' 81232, '"kb_used_data":' 696, '"kb_used_omap":' 4, '"kb_used_meta":' 80443, '"kb_avail":' 314491568, '"statfs":' '{' '"total":' 322122547200, '"available":' 322039365632, '"internally_reserved":' 0, '"allocated":' 712704, '"data_stored":' 209643, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 4785, '"internal_metadata":' 82373967 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 108, '"apply_latency_ms":' 108, '"commit_latency_ns":' 108000000, '"apply_latency_ns":' 108000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '}' '},' '"pool_stats":' '[' '{' '"poolid":' 2, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 96, '"acting":' 96, '"num_store_stats":' 3 '},' '{' '"poolid":' 1, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 96, '"acting":' 96, '"num_store_stats":' 3 '}' '],' '"osd_stats":' '[' '{' '"osd":' 0, '"seq":' 21474836507 '},' '{' '"osd":' 1, '"seq":' 42949672979 '},' '{' '"osd":' 2, '"seq":' 64424509451 '}' '],' '"num_pg_by_state":' '[' '{' '"state":' '"active+clean",' '"num":' 64 '}' '],' '"num_pg_by_osd":' '[' '{' '"osd":' 2, '"num_primary_pg":' 15, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 0, '"num_primary_pg":' 20, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 1, '"num_primary_pg":' 29, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '}' '],' '"purged_snaps":' '[' '{' '"pool":' 1, '"purged_snaps":' '{}' '},' '{' '"pool":' 2, '"purged_snaps":' '{}' '}' '],' '"servicemap":' '{' '"epoch":' 4, '"modified":' '"2024-09-16T03:25:02.412573+0000",' '"services":' '{' '"osd":' '{' '"daemons":' '{' '"summary":' '"",' '"2":' '{' '"start_epoch":' 0, '"start_stamp":' '"0.000000",' '"gid":' 0, '"addr":' '"(unrecognized' address family '0)/0",' '"metadata":' '{},' '"task_status":' '{}' '}' '}' '}' '}' '},' '"mgrstat_first_committed":' 52, '"mgrstat_last_committed":' 59, '"logm_first_committed":' 1, '"logm_last_committed":' 261, '"paxos":' '{' '"first_committed":' 1, '"last_committed":' 364, '"last_pn":' 0, '"accepted_pn":' 0 '}' '}' 2024-09-16T03:25:07.764 INFO:tasks.workunit.client.0.smithi096.stdout:{ "cluster_fingerprint": "fda2fc64-07ed-4add-8224-2e527e11d427", "version": "19.3.0-4930-gfc3e0bff", "commit": "fc3e0bff7468fd55478adbae7f75508b749124b6", "timestamp": "2024-09-16T03:25:07.642033+0000", "tag": "", "health": { "status": "HEALTH_OK", "checks": {}, "mutes": [] }, "monmap_first_committed": 1, "monmap_last_committed": 1, "monmap": { "epoch": 1, "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", "modified": "2024-09-16T03:22:45.872880Z", "created": "2024-09-16T03:22:45.872880Z", "min_mon_release": 19, "min_mon_release_name": "squid", "election_strategy": 1, "disallowed_leaders: ": "", "stretch_mode": false, "tiebreaker_mon": "", "removed_ranks: ": "", "features": { "persistent": [ "kraken", "luminous", "mimic", "osdmap-prune", "nautilus", "octopus", "pacific", "elector-pinging", "quincy", "reef", "squid" ], "optional": [] }, "mons": [ { "rank": 0, "name": "a", "public_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:7302", "nonce": 0 } ] }, "addr": "127.0.0.1:7302/0", "public_addr": "127.0.0.1:7302/0", "priority": 0, "weight": 0, "crush_location": "{}" } ] }, "quorum": [ 0 ], "osdmap": { "epoch": 32, "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", "created": "2024-09-16T03:22:46.906117+0000", "modified": "2024-09-16T03:25:05.447882+0000", "last_up_change": "2024-09-16T03:24:37.708512+0000", "last_in_change": "2024-09-16T03:24:01.831039+0000", "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", "flags_num": 5799936, "flags_set": [ "pglog_hardlimit", "purged_snapdirs", "recovery_deletes", "sortbitwise" ], "crush_version": 7, "full_ratio": 0.97000002861022949, "backfillfull_ratio": 0.97000002861022949, "nearfull_ratio": 0.85000002384185791, "cluster_snapshot": "", "pool_max": 2, "max_osd": 3, "require_min_compat_client": "luminous", "min_compat_client": "jewel", "require_osd_release": "squid", "allow_crimson": false, "pools": [ { "pool": 1, "pool_name": "foo", "create_time": "2024-09-16T03:24:44.525189+0000", "flags": 1, "flags_names": "hashpspool", "type": 1, "size": 3, "min_size": 2, "crush_rule": 0, "peering_crush_bucket_count": 0, "peering_crush_bucket_target": 0, "peering_crush_bucket_barrier": 0, "peering_crush_bucket_mandatory_member": 2147483647, "is_stretch_pool": false, "object_hash": 2, "pg_autoscale_mode": "off", "pg_num": 32, "pg_placement_num": 32, "pg_placement_num_target": 32, "pg_num_target": 32, "pg_num_pending": 32, "last_pg_merge_meta": { "source_pgid": "0.0", "ready_epoch": 0, "last_epoch_started": 0, "last_epoch_clean": 0, "source_version": "0'0", "target_version": "0'0" }, "last_change": "30", "last_force_op_resend": "0", "last_force_op_resend_prenautilus": "0", "last_force_op_resend_preluminous": "0", "auid": 0, "snap_mode": "selfmanaged", "snap_seq": 0, "snap_epoch": 0, "pool_snaps": [], "removed_snaps": "[]", "quota_max_bytes": 0, "quota_max_objects": 0, "tiers": [], "tier_of": -1, "read_tier": -1, "write_tier": -1, "cache_mode": "none", "target_max_bytes": 0, "target_max_objects": 0, "cache_target_dirty_ratio_micro": 400000, "cache_target_dirty_high_ratio_micro": 600000, "cache_target_full_ratio_micro": 800000, "cache_min_flush_age": 0, "cache_min_evict_age": 0, "erasure_code_profile": "", "hit_set_params": { "type": "none" }, "hit_set_period": 0, "hit_set_count": 0, "use_gmt_hitset": true, "min_read_recency_for_promote": 0, "min_write_recency_for_promote": 0, "hit_set_grade_decay_rate": 0, "hit_set_search_last_n": 0, "grade_table": [], "stripe_width": 0, "expected_num_objects": 0, "fast_read": false, "options": {}, "application_metadata": {}, "read_balance": { "score_type": "Fair distribution", "score_acting": 1.690000057220459, "score_stable": 1.690000057220459, "optimal_score": 1, "raw_score_acting": 1.690000057220459, "raw_score_stable": 1.690000057220459, "primary_affinity_weighted": 1, "average_primary_affinity": 1, "average_primary_affinity_weighted": 1 } }, { "pool": 2, "pool_name": "bar", "create_time": "2024-09-16T03:24:46.226575+0000", "flags": 1, "flags_names": "hashpspool", "type": 1, "size": 3, "min_size": 2, "crush_rule": 0, "peering_crush_bucket_count": 0, "peering_crush_bucket_target": 0, "peering_crush_bucket_barrier": 0, "peering_crush_bucket_mandatory_member": 2147483647, "is_stretch_pool": false, "object_hash": 2, "pg_autoscale_mode": "off", "pg_num": 32, "pg_placement_num": 32, "pg_placement_num_target": 32, "pg_num_target": 32, "pg_num_pending": 32, "last_pg_merge_meta": { "source_pgid": "0.0", "ready_epoch": 0, "last_epoch_started": 0, "last_epoch_clean": 0, "source_version": "0'0", "target_version": "0'0" }, "last_change": "32", "last_force_op_resend": "0", "last_force_op_resend_prenautilus": "0", "last_force_op_resend_preluminous": "0", "auid": 0, "snap_mode": "selfmanaged", "snap_seq": 0, "snap_epoch": 0, "pool_snaps": [], "removed_snaps": "[]", "quota_max_bytes": 0, "quota_max_objects": 0, "tiers": [], "tier_of": -1, "read_tier": -1, "write_tier": -1, "cache_mode": "none", "target_max_bytes": 0, "target_max_objects": 0, "cache_target_dirty_ratio_micro": 400000, "cache_target_dirty_high_ratio_micro": 600000, "cache_target_full_ratio_micro": 800000, "cache_min_flush_age": 0, "cache_min_evict_age": 0, "erasure_code_profile": "", "hit_set_params": { "type": "none" }, "hit_set_period": 0, "hit_set_count": 0, "use_gmt_hitset": true, "min_read_recency_for_promote": 0, "min_write_recency_for_promote": 0, "hit_set_grade_decay_rate": 0, "hit_set_search_last_n": 0, "grade_table": [], "stripe_width": 0, "expected_num_objects": 0, "fast_read": false, "options": {}, "application_metadata": {}, "read_balance": { "score_type": "Fair distribution", "score_acting": 1.1299999952316284, "score_stable": 1.1299999952316284, "optimal_score": 1, "raw_score_acting": 1.1299999952316284, "raw_score_stable": 1.1299999952316284, "primary_affinity_weighted": 1, "average_primary_affinity": 1, "average_primary_affinity_weighted": 1 } } ], "osds": [ { "osd": 0, "uuid": "64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6", "up": 1, "in": 1, "weight": 1, "primary_affinity": 1, "last_clean_begin": 0, "last_clean_end": 0, "up_from": 5, "up_thru": 21, "down_at": 0, "lost_at": 0, "public_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6802", "nonce": 3375787448 }, { "type": "v1", "addr": "127.0.0.1:6803", "nonce": 3375787448 } ] }, "cluster_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6804", "nonce": 3375787448 }, { "type": "v1", "addr": "127.0.0.1:6805", "nonce": 3375787448 } ] }, "heartbeat_back_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6808", "nonce": 3375787448 }, { "type": "v1", "addr": "127.0.0.1:6809", "nonce": 3375787448 } ] }, "heartbeat_front_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6806", "nonce": 3375787448 }, { "type": "v1", "addr": "127.0.0.1:6807", "nonce": 3375787448 } ] }, "public_addr": "127.0.0.1:6803/3375787448", "cluster_addr": "127.0.0.1:6805/3375787448", "heartbeat_back_addr": "127.0.0.1:6809/3375787448", "heartbeat_front_addr": "127.0.0.1:6807/3375787448", "state": [ "exists", "up" ] }, { "osd": 1, "uuid": "74b26727-75c9-444d-8782-719e4197a382", "up": 1, "in": 1, "weight": 1, "primary_affinity": 1, "last_clean_begin": 0, "last_clean_end": 0, "up_from": 10, "up_thru": 21, "down_at": 0, "lost_at": 0, "public_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6810", "nonce": 3733255132 }, { "type": "v1", "addr": "127.0.0.1:6811", "nonce": 3733255132 } ] }, "cluster_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6812", "nonce": 3733255132 }, { "type": "v1", "addr": "127.0.0.1:6813", "nonce": 3733255132 } ] }, "heartbeat_back_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6816", "nonce": 3733255132 }, { "type": "v1", "addr": "127.0.0.1:6817", "nonce": 3733255132 } ] }, "heartbeat_front_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6814", "nonce": 3733255132 }, { "type": "v1", "addr": "127.0.0.1:6815", "nonce": 3733255132 } ] }, "public_addr": "127.0.0.1:6811/3733255132", "cluster_addr": "127.0.0.1:6813/3733255132", "heartbeat_back_addr": "127.0.0.1:6817/3733255132", "heartbeat_front_addr": "127.0.0.1:6815/3733255132", "state": [ "exists", "up" ] }, { "osd": 2, "uuid": "143da3a7-dad9-4b1e-966b-76cf5bdd3c82", "up": 1, "in": 1, "weight": 1, "primary_affinity": 1, "last_clean_begin": 0, "last_clean_end": 0, "up_from": 15, "up_thru": 21, "down_at": 0, "lost_at": 0, "public_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6818", "nonce": 963814857 }, { "type": "v1", "addr": "127.0.0.1:6819", "nonce": 963814857 } ] }, "cluster_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6820", "nonce": 963814857 }, { "type": "v1", "addr": "127.0.0.1:6821", "nonce": 963814857 } ] }, "heartbeat_back_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6824", "nonce": 963814857 }, { "type": "v1", "addr": "127.0.0.1:6825", "nonce": 963814857 } ] }, "heartbeat_front_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6822", "nonce": 963814857 }, { "type": "v1", "addr": "127.0.0.1:6823", "nonce": 963814857 } ] }, "public_addr": "127.0.0.1:6819/963814857", "cluster_addr": "127.0.0.1:6821/963814857", "heartbeat_back_addr": "127.0.0.1:6825/963814857", "heartbeat_front_addr": "127.0.0.1:6823/963814857", "state": [ "exists", "up" ] } ], "osd_xinfo": [ { "osd": 0, "down_stamp": "0.000000", "laggy_probability": 0, "laggy_interval": 0, "features": 4540719139924082687, "old_weight": 0, "last_purged_snaps_scrub": "2024-09-16T03:23:22.481942+0000", "dead_epoch": 0 }, { "osd": 1, "down_stamp": "0.000000", "laggy_probability": 0, "laggy_interval": 0, "features": 4540719139924082687, "old_weight": 0, "last_purged_snaps_scrub": "2024-09-16T03:23:59.663703+0000", "dead_epoch": 0 }, { "osd": 2, "down_stamp": "0.000000", "laggy_probability": 0, "laggy_interval": 0, "features": 4540719139924082687, "old_weight": 0, "last_purged_snaps_scrub": "2024-09-16T03:24:37.320822+0000", "dead_epoch": 0 } ], "pg_upmap": [], "pg_upmap_items": [], "pg_upmap_primaries": [], "pg_temp": [], "primary_temp": [], "blocklist": {}, "range_blocklist": {}, "erasure_code_profiles": { "default": { "k": "2", "m": "2", "plugin": "jerasure", "technique": "reed_sol_van" } }, "removed_snaps_queue": [], "new_removed_snaps": [], "new_purged_snaps": [], "crush_node_flags": {}, "device_class_flags": {}, "stretch_mode": { "stretch_mode_enabled": false, "stretch_bucket_count": 0, "degraded_stretch_mode": 0, "recovering_stretch_mode": 0, "stretch_mode_bucket": 0 } }, "osd_metadata": [ { "id": 0, "arch": "x86_64", "back_addr": "[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]", "back_iface": "", "bluefs": "1", "bluefs_dedicated_db": "0", "bluefs_dedicated_wal": "0", "bluefs_single_shared_device": "1", "bluestore_allocation_from_file": "0", "bluestore_bdev_access_mode": "file", "bluestore_bdev_block_size": "4096", "bluestore_bdev_devices": "sda", "bluestore_bdev_driver": "KernelDevice", "bluestore_bdev_optimal_io_size": "0", "bluestore_bdev_path": "td/mon-last-clean-epoch/0/block", "bluestore_bdev_rotational": "1", "bluestore_bdev_size": "107374182400", "bluestore_bdev_support_discard": "0", "bluestore_bdev_type": "hdd", "bluestore_min_alloc_size": "4096", "ceph_release": "squid", "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", "ceph_version_short": "19.3.0-4930-gfc3e0bff", "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", "created_at": "2024-09-16T03:22:53.662571Z", "default_device_class": "hdd", "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", "devices": "sda", "distro": "ubuntu", "distro_description": "Ubuntu 22.04.1 LTS", "distro_version": "22.04", "front_addr": "[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]", "front_iface": "", "hb_back_addr": "[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]", "hb_front_addr": "[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]", "hostname": "smithi096", "journal_rotational": "1", "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", "kernel_version": "5.15.0-121-generic", "mem_swap_kb": "2097148", "mem_total_kb": "32746824", "network_numa_unknown_ifaces": "back_iface,front_iface", "objectstore_numa_unknown_devices": "sda", "os": "Linux", "osd_data": "td/mon-last-clean-epoch/0", "osd_objectstore": "bluestore", "osdspec_affinity": "", "rotational": "1" }, { "id": 1, "arch": "x86_64", "back_addr": "[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]", "back_iface": "", "bluefs": "1", "bluefs_dedicated_db": "0", "bluefs_dedicated_wal": "0", "bluefs_single_shared_device": "1", "bluestore_allocation_from_file": "0", "bluestore_bdev_access_mode": "file", "bluestore_bdev_block_size": "4096", "bluestore_bdev_devices": "sda", "bluestore_bdev_driver": "KernelDevice", "bluestore_bdev_optimal_io_size": "0", "bluestore_bdev_path": "td/mon-last-clean-epoch/1/block", "bluestore_bdev_rotational": "1", "bluestore_bdev_size": "107374182400", "bluestore_bdev_support_discard": "0", "bluestore_bdev_type": "hdd", "bluestore_min_alloc_size": "4096", "ceph_release": "squid", "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", "ceph_version_short": "19.3.0-4930-gfc3e0bff", "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", "created_at": "2024-09-16T03:23:30.129885Z", "default_device_class": "hdd", "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", "devices": "sda", "distro": "ubuntu", "distro_description": "Ubuntu 22.04.1 LTS", "distro_version": "22.04", "front_addr": "[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]", "front_iface": "", "hb_back_addr": "[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]", "hb_front_addr": "[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]", "hostname": "smithi096", "journal_rotational": "1", "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", "kernel_version": "5.15.0-121-generic", "mem_swap_kb": "2097148", "mem_total_kb": "32746824", "network_numa_unknown_ifaces": "back_iface,front_iface", "objectstore_numa_unknown_devices": "sda", "os": "Linux", "osd_data": "td/mon-last-clean-epoch/1", "osd_objectstore": "bluestore", "osdspec_affinity": "", "rotational": "1" }, { "id": 2, "arch": "x86_64", "back_addr": "[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]", "back_iface": "", "bluefs": "1", "bluefs_dedicated_db": "0", "bluefs_dedicated_wal": "0", "bluefs_single_shared_device": "1", "bluestore_allocation_from_file": "0", "bluestore_bdev_access_mode": "file", "bluestore_bdev_block_size": "4096", "bluestore_bdev_devices": "sda", "bluestore_bdev_driver": "KernelDevice", "bluestore_bdev_optimal_io_size": "0", "bluestore_bdev_path": "td/mon-last-clean-epoch/2/block", "bluestore_bdev_rotational": "1", "bluestore_bdev_size": "107374182400", "bluestore_bdev_support_discard": "0", "bluestore_bdev_type": "hdd", "bluestore_min_alloc_size": "4096", "ceph_release": "squid", "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", "ceph_version_short": "19.3.0-4930-gfc3e0bff", "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", "created_at": "2024-09-16T03:24:07.764502Z", "default_device_class": "hdd", "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", "devices": "sda", "distro": "ubuntu", "distro_description": "Ubuntu 22.04.1 LTS", "distro_version": "22.04", "front_addr": "[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]", "front_iface": "", "hb_back_addr": "[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]", "hb_front_addr": "[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]", "hostname": "smithi096", "journal_rotational": "1", "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", "kernel_version": "5.15.0-121-generic", "mem_swap_kb": "2097148", "mem_total_kb": "32746824", "network_numa_unknown_ifaces": "back_iface,front_iface", "objectstore_numa_unknown_devices": "sda", "os": "Linux", "osd_data": "td/mon-last-clean-epoch/2", "osd_objectstore": "bluestore", "osdspec_affinity": "", "rotational": "1" } ], "osdmap_clean_epochs": { "min_last_epoch_clean": 28, "last_epoch_clean": { "per_pool": [ { "poolid": 1, "floor": 28 }, { "poolid": 2, "floor": 28 } ] }, "osd_epochs": [ { "id": 0, "epoch": 32 }, { "id": 1, "epoch": 28 }, { "id": 2, "epoch": 28 } ] }, "osdmap_first_committed": 26, "osdmap_last_committed": 32, "crushmap": { "devices": [ { "id": 0, "name": "osd.0", "class": "hdd" }, { "id": 1, "name": "osd.1", "class": "hdd" }, { "id": 2, "name": "osd.2", "class": "hdd" } ], "types": [ { "type_id": 0, "name": "osd" }, { "type_id": 1, "name": "host" }, { "type_id": 2, "name": "chassis" }, { "type_id": 3, "name": "rack" }, { "type_id": 4, "name": "row" }, { "type_id": 5, "name": "pdu" }, { "type_id": 6, "name": "pod" }, { "type_id": 7, "name": "room" }, { "type_id": 8, "name": "datacenter" }, { "type_id": 9, "name": "zone" }, { "type_id": 10, "name": "region" }, { "type_id": 11, "name": "root" } ], "buckets": [ { "id": -1, "name": "default", "type_id": 11, "type_name": "root", "weight": 19206, "alg": "straw2", "hash": "rjenkins1", "items": [ { "id": -3, "weight": 19206, "pos": 0 } ] }, { "id": -2, "name": "default~hdd", "type_id": 11, "type_name": "root", "weight": 19206, "alg": "straw2", "hash": "rjenkins1", "items": [ { "id": -4, "weight": 19206, "pos": 0 } ] }, { "id": -3, "name": "smithi096", "type_id": 1, "type_name": "host", "weight": 19206, "alg": "straw2", "hash": "rjenkins1", "items": [ { "id": 0, "weight": 6402, "pos": 0 }, { "id": 1, "weight": 6402, "pos": 1 }, { "id": 2, "weight": 6402, "pos": 2 } ] }, { "id": -4, "name": "smithi096~hdd", "type_id": 1, "type_name": "host", "weight": 19206, "alg": "straw2", "hash": "rjenkins1", "items": [ { "id": 0, "weight": 6402, "pos": 0 }, { "id": 1, "weight": 6402, "pos": 1 }, { "id": 2, "weight": 6402, "pos": 2 } ] } ], "rules": [ { "rule_id": 0, "rule_name": "replicated_rule", "type": 1, "steps": [ { "op": "take", "item": -1, "item_name": "default" }, { "op": "choose_firstn", "num": 0, "type": "osd" }, { "op": "emit" } ] } ], "tunables": { "choose_local_tries": 0, "choose_local_fallback_tries": 0, "choose_total_tries": 50, "chooseleaf_descend_once": 1, "chooseleaf_vary_r": 1, "chooseleaf_stable": 1, "msr_descents": 100, "msr_collision_tries": 100, "straw_calc_version": 1, "allowed_bucket_algs": 54, "profile": "jewel", "optimal_tunables": 1, "legacy_tunables": 0, "minimum_required_version": "jewel", "require_feature_tunables": 1, "require_feature_tunables2": 1, "has_v2_rules": 0, "require_feature_tunables3": 1, "has_v3_rules": 0, "has_v4_buckets": 1, "require_feature_tunables5": 1, "has_v5_rules": 0, "has_msr_rules": 0 }, "choose_args": {} }, "fsmap": { "epoch": 1, "btime": "2024-09-16T03:22:46:882186+0000", "default_fscid": -1, "compat": { "compat": {}, "ro_compat": {}, "incompat": { "feature_1": "base v0.20", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes" } }, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "standbys": [], "filesystems": [] }, "mdsmap_first_committed": 1, "mdsmap_last_committed": 1, "auth": { "first_committed": 1, "last_committed": 5, "num_secrets": 3 }, "num_pg": 64, "num_pg_active": 64, "num_pg_unknown": 0, "num_osd": 3, "pool_sum": { "stat_sum": { "num_bytes": 0, "num_objects": 0, "num_object_clones": 0, "num_object_copies": 0, "num_objects_missing_on_primary": 0, "num_objects_missing": 0, "num_objects_degraded": 0, "num_objects_misplaced": 0, "num_objects_unfound": 0, "num_objects_dirty": 0, "num_whiteouts": 0, "num_read": 0, "num_read_kb": 0, "num_write": 0, "num_write_kb": 0, "num_scrub_errors": 0, "num_shallow_scrub_errors": 0, "num_deep_scrub_errors": 0, "num_objects_recovered": 0, "num_bytes_recovered": 0, "num_keys_recovered": 0, "num_objects_omap": 0, "num_objects_hit_set_archive": 0, "num_bytes_hit_set_archive": 0, "num_flush": 0, "num_flush_kb": 0, "num_evict": 0, "num_evict_kb": 0, "num_promote": 0, "num_flush_mode_high": 0, "num_flush_mode_low": 0, "num_evict_mode_some": 0, "num_evict_mode_full": 0, "num_objects_pinned": 0, "num_legacy_snapsets": 0, "num_large_omap_objects": 0, "num_objects_manifest": 0, "num_omap_bytes": 0, "num_omap_keys": 0, "num_objects_repaired": 0 }, "store_stats": { "total": 0, "available": 0, "internally_reserved": 0, "allocated": 0, "data_stored": 0, "data_compressed": 0, "data_compressed_allocated": 0, "data_compressed_original": 0, "omap_allocated": 0, "internal_metadata": 0 }, "log_size": 0, "ondisk_log_size": 0, "up": 192, "acting": 192, "num_store_stats": 0 }, "osd_sum": { "up_from": 0, "seq": 0, "num_pgs": 192, "num_osds": 3, "num_per_pool_osds": 3, "num_per_pool_omap_osds": 3, "kb": 314572800, "kb_used": 81232, "kb_used_data": 696, "kb_used_omap": 4, "kb_used_meta": 80443, "kb_avail": 314491568, "statfs": { "total": 322122547200, "available": 322039365632, "internally_reserved": 0, "allocated": 712704, "data_stored": 209643, "data_compressed": 0, "data_compressed_allocated": 0, "data_compressed_original": 0, "omap_allocated": 4785, "internal_metadata": 82373967 }, "hb_peers": [], "snap_trim_queue_len": 0, "num_snap_trimming": 0, "num_shards_repaired": 0, "op_queue_age_hist": { "histogram": [], "upper_bound": 1 }, "perf_stat": { "commit_latency_ms": 108, "apply_latency_ms": 108, "commit_latency_ns": 108000000, "apply_latency_ns": 108000000 }, "alerts": [], "network_ping_times": [] }, "osd_sum_by_class": { "hdd": { "up_from": 0, "seq": 0, "num_pgs": 192, "num_osds": 3, "num_per_pool_osds": 3, "num_per_pool_omap_osds": 3, "kb": 314572800, "kb_used": 81232, "kb_used_data": 696, "kb_used_omap": 4, "kb_used_meta": 80443, "kb_avail": 314491568, "statfs": { "total": 322122547200, "available": 322039365632, "internally_reserved": 0, "allocated": 712704, "data_stored": 209643, "data_compressed": 0, "data_compressed_allocated": 0, "data_compressed_original": 0, "omap_allocated": 4785, "internal_metadata": 82373967 }, "hb_peers": [], "snap_trim_queue_len": 0, "num_snap_trimming": 0, "num_shards_repaired": 0, "op_queue_age_hist": { "histogram": [], "upper_bound": 1 }, "perf_stat": { "commit_latency_ms": 108, "apply_latency_ms": 108, "commit_latency_ns": 108000000, "apply_latency_ns": 108000000 }, "alerts": [], "network_ping_times": [] } }, "pool_stats": [ { "poolid": 2, "num_pg": 32, "stat_sum": { "num_bytes": 0, "num_objects": 0, "num_object_clones": 0, "num_object_copies": 0, "num_objects_missing_on_primary": 0, "num_objects_missing": 0, "num_objects_degraded": 0, "num_objects_misplaced": 0, "num_objects_unfound": 0, "num_objects_dirty": 0, "num_whiteouts": 0, "num_read": 0, "num_read_kb": 0, "num_write": 0, "num_write_kb": 0, "num_scrub_errors": 0, "num_shallow_scrub_errors": 0, "num_deep_scrub_errors": 0, "num_objects_recovered": 0, "num_bytes_recovered": 0, "num_keys_recovered": 0, "num_objects_omap": 0, "num_objects_hit_set_archive": 0, "num_bytes_hit_set_archive": 0, "num_flush": 0, "num_flush_kb": 0, "num_evict": 0, "num_evict_kb": 0, "num_promote": 0, "num_flush_mode_high": 0, "num_flush_mode_low": 0, "num_evict_mode_some": 0, "num_evict_mode_full": 0, "num_objects_pinned": 0, "num_legacy_snapsets": 0, "num_large_omap_objects": 0, "num_objects_manifest": 0, "num_omap_bytes": 0, "num_omap_keys": 0, "num_objects_repaired": 0 }, "store_stats": { "total": 0, "available": 0, "internally_reserved": 0, "allocated": 0, "data_stored": 0, "data_compressed": 0, "data_compressed_allocated": 0, "data_compressed_original": 0, "omap_allocated": 0, "internal_metadata": 0 }, "log_size": 0, "ondisk_log_size": 0, "up": 96, "acting": 96, "num_store_stats": 3 }, { "poolid": 1, "num_pg": 32, "stat_sum": { "num_bytes": 0, "num_objects": 0, "num_object_clones": 0, "num_object_copies": 0, "num_objects_missing_on_primary": 0, "num_objects_missing": 0, "num_objects_degraded": 0, "num_objects_misplaced": 0, "num_objects_unfound": 0, "num_objects_dirty": 0, "num_whiteouts": 0, "num_read": 0, "num_read_kb": 0, "num_write": 0, "num_write_kb": 0, "num_scrub_errors": 0, "num_shallow_scrub_errors": 0, "num_deep_scrub_errors": 0, "num_objects_recovered": 0, "num_bytes_recovered": 0, "num_keys_recovered": 0, "num_objects_omap": 0, "num_objects_hit_set_archive": 0, "num_bytes_hit_set_archive": 0, "num_flush": 0, "num_flush_kb": 0, "num_evict": 0, "num_evict_kb": 0, "num_promote": 0, "num_flush_mode_high": 0, "num_flush_mode_low": 0, "num_evict_mode_some": 0, "num_evict_mode_full": 0, "num_objects_pinned": 0, "num_legacy_snapsets": 0, "num_large_omap_objects": 0, "num_objects_manifest": 0, "num_omap_bytes": 0, "num_omap_keys": 0, "num_objects_repaired": 0 }, "store_stats": { "total": 0, "available": 0, "internally_reserved": 0, "allocated": 0, "data_stored": 0, "data_compressed": 0, "data_compressed_allocated": 0, "data_compressed_original": 0, "omap_allocated": 0, "internal_metadata": 0 }, "log_size": 0, "ondisk_log_size": 0, "up": 96, "acting": 96, "num_store_stats": 3 } ], "osd_stats": [ { "osd": 0, "seq": 21474836507 }, { "osd": 1, "seq": 42949672979 }, { "osd": 2, "seq": 64424509451 } ], "num_pg_by_state": [ { "state": "active+clean", "num": 64 } ], "num_pg_by_osd": [ { "osd": 2, "num_primary_pg": 15, "num_acting_pg": 64, "num_up_not_acting_pg": 0 }, { "osd": 0, "num_primary_pg": 20, "num_acting_pg": 64, "num_up_not_acting_pg": 0 }, { "osd": 1, "num_primary_pg": 29, "num_acting_pg": 64, "num_up_not_acting_pg": 0 } ], "purged_snaps": [ { "pool": 1, "purged_snaps": {} }, { "pool": 2, "purged_snaps": {} } ], "servicemap": { "epoch": 4, "modified": "2024-09-16T03:25:02.412573+0000", "services": { "osd": { "daemons": { "summary": "", "2": { "start_epoch": 0, "start_stamp": "0.000000", "gid": 0, "addr": "(unrecognized address family 0)/0", "metadata": {}, "task_status": {} } } } } }, "mgrstat_first_committed": 52, "mgrstat_last_committed": 59, "logm_first_committed": 1, "logm_last_committed": 261, "paxos": { "first_committed": 1, "last_committed": 364, "last_pn": 0, "accepted_pn": 0 } } 2024-09-16T03:25:07.765 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:105: check_lec_honours_osd: return 1 2024-09-16T03:25:07.765 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:115: check_lec_honours_osd: return 0 2024-09-16T03:25:07.765 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:220: TEST_mon_last_clean_epoch: validate_fc 2024-09-16T03:25:07.765 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:119: validate_fc: ceph report 2024-09-16T03:25:08.306 INFO:tasks.workunit.client.0.smithi096.stderr:report 3461564701 2024-09-16T03:25:08.324 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:119: validate_fc: report='{ 2024-09-16T03:25:08.324 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_fingerprint": "fda2fc64-07ed-4add-8224-2e527e11d427", 2024-09-16T03:25:08.324 INFO:tasks.workunit.client.0.smithi096.stderr: "version": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:25:08.324 INFO:tasks.workunit.client.0.smithi096.stderr: "commit": "fc3e0bff7468fd55478adbae7f75508b749124b6", 2024-09-16T03:25:08.324 INFO:tasks.workunit.client.0.smithi096.stderr: "timestamp": "2024-09-16T03:25:08.307630+0000", 2024-09-16T03:25:08.324 INFO:tasks.workunit.client.0.smithi096.stderr: "tag": "", 2024-09-16T03:25:08.324 INFO:tasks.workunit.client.0.smithi096.stderr: "health": { 2024-09-16T03:25:08.324 INFO:tasks.workunit.client.0.smithi096.stderr: "status": "HEALTH_OK", 2024-09-16T03:25:08.325 INFO:tasks.workunit.client.0.smithi096.stderr: "checks": {}, 2024-09-16T03:25:08.325 INFO:tasks.workunit.client.0.smithi096.stderr: "mutes": [] 2024-09-16T03:25:08.325 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.325 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap_first_committed": 1, 2024-09-16T03:25:08.325 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap_last_committed": 1, 2024-09-16T03:25:08.325 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap": { 2024-09-16T03:25:08.325 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 1, 2024-09-16T03:25:08.325 INFO:tasks.workunit.client.0.smithi096.stderr: "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", 2024-09-16T03:25:08.325 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:22:45.872880Z", 2024-09-16T03:25:08.325 INFO:tasks.workunit.client.0.smithi096.stderr: "created": "2024-09-16T03:22:45.872880Z", 2024-09-16T03:25:08.325 INFO:tasks.workunit.client.0.smithi096.stderr: "min_mon_release": 19, 2024-09-16T03:25:08.326 INFO:tasks.workunit.client.0.smithi096.stderr: "min_mon_release_name": "squid", 2024-09-16T03:25:08.326 INFO:tasks.workunit.client.0.smithi096.stderr: "election_strategy": 1, 2024-09-16T03:25:08.326 INFO:tasks.workunit.client.0.smithi096.stderr: "disallowed_leaders: ": "", 2024-09-16T03:25:08.326 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode": false, 2024-09-16T03:25:08.326 INFO:tasks.workunit.client.0.smithi096.stderr: "tiebreaker_mon": "", 2024-09-16T03:25:08.326 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_ranks: ": "", 2024-09-16T03:25:08.326 INFO:tasks.workunit.client.0.smithi096.stderr: "features": { 2024-09-16T03:25:08.326 INFO:tasks.workunit.client.0.smithi096.stderr: "persistent": [ 2024-09-16T03:25:08.326 INFO:tasks.workunit.client.0.smithi096.stderr: "kraken", 2024-09-16T03:25:08.326 INFO:tasks.workunit.client.0.smithi096.stderr: "luminous", 2024-09-16T03:25:08.326 INFO:tasks.workunit.client.0.smithi096.stderr: "mimic", 2024-09-16T03:25:08.327 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap-prune", 2024-09-16T03:25:08.327 INFO:tasks.workunit.client.0.smithi096.stderr: "nautilus", 2024-09-16T03:25:08.327 INFO:tasks.workunit.client.0.smithi096.stderr: "octopus", 2024-09-16T03:25:08.327 INFO:tasks.workunit.client.0.smithi096.stderr: "pacific", 2024-09-16T03:25:08.327 INFO:tasks.workunit.client.0.smithi096.stderr: "elector-pinging", 2024-09-16T03:25:08.327 INFO:tasks.workunit.client.0.smithi096.stderr: "quincy", 2024-09-16T03:25:08.327 INFO:tasks.workunit.client.0.smithi096.stderr: "reef", 2024-09-16T03:25:08.327 INFO:tasks.workunit.client.0.smithi096.stderr: "squid" 2024-09-16T03:25:08.327 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:08.327 INFO:tasks.workunit.client.0.smithi096.stderr: "optional": [] 2024-09-16T03:25:08.327 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.327 INFO:tasks.workunit.client.0.smithi096.stderr: "mons": [ 2024-09-16T03:25:08.327 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.328 INFO:tasks.workunit.client.0.smithi096.stderr: "rank": 0, 2024-09-16T03:25:08.328 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "a", 2024-09-16T03:25:08.328 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:25:08.328 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:08.328 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.328 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:08.328 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:7302", 2024-09-16T03:25:08.328 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 0 2024-09-16T03:25:08.328 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:08.328 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:08.328 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.328 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:7302/0", 2024-09-16T03:25:08.329 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:7302/0", 2024-09-16T03:25:08.329 INFO:tasks.workunit.client.0.smithi096.stderr: "priority": 0, 2024-09-16T03:25:08.329 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 0, 2024-09-16T03:25:08.329 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_location": "{}" 2024-09-16T03:25:08.329 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:08.330 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:08.330 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.330 INFO:tasks.workunit.client.0.smithi096.stderr: "quorum": [ 2024-09-16T03:25:08.330 INFO:tasks.workunit.client.0.smithi096.stderr: 0 2024-09-16T03:25:08.330 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:08.330 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap": { 2024-09-16T03:25:08.330 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 32, 2024-09-16T03:25:08.330 INFO:tasks.workunit.client.0.smithi096.stderr: "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", 2024-09-16T03:25:08.330 INFO:tasks.workunit.client.0.smithi096.stderr: "created": "2024-09-16T03:22:46.906117+0000", 2024-09-16T03:25:08.330 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:25:05.447882+0000", 2024-09-16T03:25:08.330 INFO:tasks.workunit.client.0.smithi096.stderr: "last_up_change": "2024-09-16T03:24:37.708512+0000", 2024-09-16T03:25:08.330 INFO:tasks.workunit.client.0.smithi096.stderr: "last_in_change": "2024-09-16T03:24:01.831039+0000", 2024-09-16T03:25:08.331 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-16T03:25:08.331 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_num": 5799936, 2024-09-16T03:25:08.331 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_set": [ 2024-09-16T03:25:08.331 INFO:tasks.workunit.client.0.smithi096.stderr: "pglog_hardlimit", 2024-09-16T03:25:08.331 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snapdirs", 2024-09-16T03:25:08.331 INFO:tasks.workunit.client.0.smithi096.stderr: "recovery_deletes", 2024-09-16T03:25:08.331 INFO:tasks.workunit.client.0.smithi096.stderr: "sortbitwise" 2024-09-16T03:25:08.331 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:08.331 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_version": 7, 2024-09-16T03:25:08.331 INFO:tasks.workunit.client.0.smithi096.stderr: "full_ratio": 0.97000002861022949, 2024-09-16T03:25:08.332 INFO:tasks.workunit.client.0.smithi096.stderr: "backfillfull_ratio": 0.97000002861022949, 2024-09-16T03:25:08.332 INFO:tasks.workunit.client.0.smithi096.stderr: "nearfull_ratio": 0.85000002384185791, 2024-09-16T03:25:08.332 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_snapshot": "", 2024-09-16T03:25:08.332 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_max": 2, 2024-09-16T03:25:08.332 INFO:tasks.workunit.client.0.smithi096.stderr: "max_osd": 3, 2024-09-16T03:25:08.332 INFO:tasks.workunit.client.0.smithi096.stderr: "require_min_compat_client": "luminous", 2024-09-16T03:25:08.332 INFO:tasks.workunit.client.0.smithi096.stderr: "min_compat_client": "jewel", 2024-09-16T03:25:08.332 INFO:tasks.workunit.client.0.smithi096.stderr: "require_osd_release": "squid", 2024-09-16T03:25:08.332 INFO:tasks.workunit.client.0.smithi096.stderr: "allow_crimson": false, 2024-09-16T03:25:08.332 INFO:tasks.workunit.client.0.smithi096.stderr: "pools": [ 2024-09-16T03:25:08.333 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.333 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 1, 2024-09-16T03:25:08.333 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_name": "foo", 2024-09-16T03:25:08.333 INFO:tasks.workunit.client.0.smithi096.stderr: "create_time": "2024-09-16T03:24:44.525189+0000", 2024-09-16T03:25:08.333 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": 1, 2024-09-16T03:25:08.333 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_names": "hashpspool", 2024-09-16T03:25:08.334 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:25:08.334 INFO:tasks.workunit.client.0.smithi096.stderr: "size": 3, 2024-09-16T03:25:08.334 INFO:tasks.workunit.client.0.smithi096.stderr: "min_size": 2, 2024-09-16T03:25:08.334 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_rule": 0, 2024-09-16T03:25:08.334 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_count": 0, 2024-09-16T03:25:08.334 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_target": 0, 2024-09-16T03:25:08.334 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_barrier": 0, 2024-09-16T03:25:08.334 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-16T03:25:08.334 INFO:tasks.workunit.client.0.smithi096.stderr: "is_stretch_pool": false, 2024-09-16T03:25:08.334 INFO:tasks.workunit.client.0.smithi096.stderr: "object_hash": 2, 2024-09-16T03:25:08.334 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_autoscale_mode": "off", 2024-09-16T03:25:08.334 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num": 32, 2024-09-16T03:25:08.335 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num": 32, 2024-09-16T03:25:08.335 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num_target": 32, 2024-09-16T03:25:08.335 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_target": 32, 2024-09-16T03:25:08.335 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_pending": 32, 2024-09-16T03:25:08.335 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pg_merge_meta": { 2024-09-16T03:25:08.335 INFO:tasks.workunit.client.0.smithi096.stderr: "source_pgid": "0.0", 2024-09-16T03:25:08.335 INFO:tasks.workunit.client.0.smithi096.stderr: "ready_epoch": 0, 2024-09-16T03:25:08.335 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_started": 0, 2024-09-16T03:25:08.335 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": 0, 2024-09-16T03:25:08.335 INFO:tasks.workunit.client.0.smithi096.stderr: "source_version": "0'\''0", 2024-09-16T03:25:08.335 INFO:tasks.workunit.client.0.smithi096.stderr: "target_version": "0'\''0" 2024-09-16T03:25:08.335 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.335 INFO:tasks.workunit.client.0.smithi096.stderr: "last_change": "30", 2024-09-16T03:25:08.336 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend": "0", 2024-09-16T03:25:08.336 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_prenautilus": "0", 2024-09-16T03:25:08.336 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_preluminous": "0", 2024-09-16T03:25:08.336 INFO:tasks.workunit.client.0.smithi096.stderr: "auid": 0, 2024-09-16T03:25:08.336 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_mode": "selfmanaged", 2024-09-16T03:25:08.336 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_seq": 0, 2024-09-16T03:25:08.336 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_epoch": 0, 2024-09-16T03:25:08.336 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_snaps": [], 2024-09-16T03:25:08.336 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps": "[]", 2024-09-16T03:25:08.336 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_bytes": 0, 2024-09-16T03:25:08.336 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_objects": 0, 2024-09-16T03:25:08.337 INFO:tasks.workunit.client.0.smithi096.stderr: "tiers": [], 2024-09-16T03:25:08.337 INFO:tasks.workunit.client.0.smithi096.stderr: "tier_of": -1, 2024-09-16T03:25:08.337 INFO:tasks.workunit.client.0.smithi096.stderr: "read_tier": -1, 2024-09-16T03:25:08.337 INFO:tasks.workunit.client.0.smithi096.stderr: "write_tier": -1, 2024-09-16T03:25:08.337 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_mode": "none", 2024-09-16T03:25:08.337 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_bytes": 0, 2024-09-16T03:25:08.337 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_objects": 0, 2024-09-16T03:25:08.337 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_ratio_micro": 400000, 2024-09-16T03:25:08.337 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-16T03:25:08.337 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_full_ratio_micro": 800000, 2024-09-16T03:25:08.337 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_flush_age": 0, 2024-09-16T03:25:08.337 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_evict_age": 0, 2024-09-16T03:25:08.337 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profile": "", 2024-09-16T03:25:08.337 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_params": { 2024-09-16T03:25:08.338 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "none" 2024-09-16T03:25:08.338 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.338 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_period": 0, 2024-09-16T03:25:08.338 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_count": 0, 2024-09-16T03:25:08.338 INFO:tasks.workunit.client.0.smithi096.stderr: "use_gmt_hitset": true, 2024-09-16T03:25:08.338 INFO:tasks.workunit.client.0.smithi096.stderr: "min_read_recency_for_promote": 0, 2024-09-16T03:25:08.338 INFO:tasks.workunit.client.0.smithi096.stderr: "min_write_recency_for_promote": 0, 2024-09-16T03:25:08.338 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_grade_decay_rate": 0, 2024-09-16T03:25:08.338 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_search_last_n": 0, 2024-09-16T03:25:08.338 INFO:tasks.workunit.client.0.smithi096.stderr: "grade_table": [], 2024-09-16T03:25:08.338 INFO:tasks.workunit.client.0.smithi096.stderr: "stripe_width": 0, 2024-09-16T03:25:08.338 INFO:tasks.workunit.client.0.smithi096.stderr: "expected_num_objects": 0, 2024-09-16T03:25:08.338 INFO:tasks.workunit.client.0.smithi096.stderr: "fast_read": false, 2024-09-16T03:25:08.338 INFO:tasks.workunit.client.0.smithi096.stderr: "options": {}, 2024-09-16T03:25:08.339 INFO:tasks.workunit.client.0.smithi096.stderr: "application_metadata": {}, 2024-09-16T03:25:08.339 INFO:tasks.workunit.client.0.smithi096.stderr: "read_balance": { 2024-09-16T03:25:08.339 INFO:tasks.workunit.client.0.smithi096.stderr: "score_type": "Fair distribution", 2024-09-16T03:25:08.339 INFO:tasks.workunit.client.0.smithi096.stderr: "score_acting": 1.690000057220459, 2024-09-16T03:25:08.339 INFO:tasks.workunit.client.0.smithi096.stderr: "score_stable": 1.690000057220459, 2024-09-16T03:25:08.339 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_score": 1, 2024-09-16T03:25:08.339 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_acting": 1.690000057220459, 2024-09-16T03:25:08.340 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_stable": 1.690000057220459, 2024-09-16T03:25:08.340 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity_weighted": 1, 2024-09-16T03:25:08.340 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity": 1, 2024-09-16T03:25:08.340 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity_weighted": 1 2024-09-16T03:25:08.340 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:08.340 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.340 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.340 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 2, 2024-09-16T03:25:08.340 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_name": "bar", 2024-09-16T03:25:08.340 INFO:tasks.workunit.client.0.smithi096.stderr: "create_time": "2024-09-16T03:24:46.226575+0000", 2024-09-16T03:25:08.340 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": 1, 2024-09-16T03:25:08.340 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_names": "hashpspool", 2024-09-16T03:25:08.340 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:25:08.340 INFO:tasks.workunit.client.0.smithi096.stderr: "size": 3, 2024-09-16T03:25:08.341 INFO:tasks.workunit.client.0.smithi096.stderr: "min_size": 2, 2024-09-16T03:25:08.341 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_rule": 0, 2024-09-16T03:25:08.341 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_count": 0, 2024-09-16T03:25:08.341 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_target": 0, 2024-09-16T03:25:08.341 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_barrier": 0, 2024-09-16T03:25:08.341 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-16T03:25:08.341 INFO:tasks.workunit.client.0.smithi096.stderr: "is_stretch_pool": false, 2024-09-16T03:25:08.341 INFO:tasks.workunit.client.0.smithi096.stderr: "object_hash": 2, 2024-09-16T03:25:08.341 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_autoscale_mode": "off", 2024-09-16T03:25:08.341 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num": 32, 2024-09-16T03:25:08.341 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num": 32, 2024-09-16T03:25:08.341 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num_target": 32, 2024-09-16T03:25:08.341 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_target": 32, 2024-09-16T03:25:08.342 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_pending": 32, 2024-09-16T03:25:08.342 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pg_merge_meta": { 2024-09-16T03:25:08.342 INFO:tasks.workunit.client.0.smithi096.stderr: "source_pgid": "0.0", 2024-09-16T03:25:08.342 INFO:tasks.workunit.client.0.smithi096.stderr: "ready_epoch": 0, 2024-09-16T03:25:08.342 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_started": 0, 2024-09-16T03:25:08.342 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": 0, 2024-09-16T03:25:08.342 INFO:tasks.workunit.client.0.smithi096.stderr: "source_version": "0'\''0", 2024-09-16T03:25:08.342 INFO:tasks.workunit.client.0.smithi096.stderr: "target_version": "0'\''0" 2024-09-16T03:25:08.342 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.342 INFO:tasks.workunit.client.0.smithi096.stderr: "last_change": "32", 2024-09-16T03:25:08.342 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend": "0", 2024-09-16T03:25:08.343 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_prenautilus": "0", 2024-09-16T03:25:08.343 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_preluminous": "0", 2024-09-16T03:25:08.343 INFO:tasks.workunit.client.0.smithi096.stderr: "auid": 0, 2024-09-16T03:25:08.343 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_mode": "selfmanaged", 2024-09-16T03:25:08.344 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_seq": 0, 2024-09-16T03:25:08.344 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_epoch": 0, 2024-09-16T03:25:08.344 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_snaps": [], 2024-09-16T03:25:08.344 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps": "[]", 2024-09-16T03:25:08.344 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_bytes": 0, 2024-09-16T03:25:08.344 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_objects": 0, 2024-09-16T03:25:08.344 INFO:tasks.workunit.client.0.smithi096.stderr: "tiers": [], 2024-09-16T03:25:08.344 INFO:tasks.workunit.client.0.smithi096.stderr: "tier_of": -1, 2024-09-16T03:25:08.344 INFO:tasks.workunit.client.0.smithi096.stderr: "read_tier": -1, 2024-09-16T03:25:08.345 INFO:tasks.workunit.client.0.smithi096.stderr: "write_tier": -1, 2024-09-16T03:25:08.345 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_mode": "none", 2024-09-16T03:25:08.345 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_bytes": 0, 2024-09-16T03:25:08.345 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_objects": 0, 2024-09-16T03:25:08.345 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_ratio_micro": 400000, 2024-09-16T03:25:08.345 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-16T03:25:08.345 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_full_ratio_micro": 800000, 2024-09-16T03:25:08.345 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_flush_age": 0, 2024-09-16T03:25:08.345 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_evict_age": 0, 2024-09-16T03:25:08.345 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profile": "", 2024-09-16T03:25:08.345 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_params": { 2024-09-16T03:25:08.346 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "none" 2024-09-16T03:25:08.346 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.346 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_period": 0, 2024-09-16T03:25:08.346 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_count": 0, 2024-09-16T03:25:08.346 INFO:tasks.workunit.client.0.smithi096.stderr: "use_gmt_hitset": true, 2024-09-16T03:25:08.346 INFO:tasks.workunit.client.0.smithi096.stderr: "min_read_recency_for_promote": 0, 2024-09-16T03:25:08.346 INFO:tasks.workunit.client.0.smithi096.stderr: "min_write_recency_for_promote": 0, 2024-09-16T03:25:08.346 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_grade_decay_rate": 0, 2024-09-16T03:25:08.346 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_search_last_n": 0, 2024-09-16T03:25:08.346 INFO:tasks.workunit.client.0.smithi096.stderr: "grade_table": [], 2024-09-16T03:25:08.346 INFO:tasks.workunit.client.0.smithi096.stderr: "stripe_width": 0, 2024-09-16T03:25:08.346 INFO:tasks.workunit.client.0.smithi096.stderr: "expected_num_objects": 0, 2024-09-16T03:25:08.346 INFO:tasks.workunit.client.0.smithi096.stderr: "fast_read": false, 2024-09-16T03:25:08.347 INFO:tasks.workunit.client.0.smithi096.stderr: "options": {}, 2024-09-16T03:25:08.347 INFO:tasks.workunit.client.0.smithi096.stderr: "application_metadata": {}, 2024-09-16T03:25:08.347 INFO:tasks.workunit.client.0.smithi096.stderr: "read_balance": { 2024-09-16T03:25:08.347 INFO:tasks.workunit.client.0.smithi096.stderr: "score_type": "Fair distribution", 2024-09-16T03:25:08.347 INFO:tasks.workunit.client.0.smithi096.stderr: "score_acting": 1.1299999952316284, 2024-09-16T03:25:08.347 INFO:tasks.workunit.client.0.smithi096.stderr: "score_stable": 1.1299999952316284, 2024-09-16T03:25:08.347 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_score": 1, 2024-09-16T03:25:08.347 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_acting": 1.1299999952316284, 2024-09-16T03:25:08.347 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_stable": 1.1299999952316284, 2024-09-16T03:25:08.347 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity_weighted": 1, 2024-09-16T03:25:08.347 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity": 1, 2024-09-16T03:25:08.347 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity_weighted": 1 2024-09-16T03:25:08.347 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:08.348 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:08.348 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:08.348 INFO:tasks.workunit.client.0.smithi096.stderr: "osds": [ 2024-09-16T03:25:08.348 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.348 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:25:08.348 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6", 2024-09-16T03:25:08.348 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:25:08.348 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:25:08.348 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:25:08.348 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:25:08.348 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:25:08.348 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:25:08.349 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 5, 2024-09-16T03:25:08.349 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 21, 2024-09-16T03:25:08.349 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:25:08.349 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:25:08.349 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:25:08.349 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:08.349 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.349 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:08.349 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6802", 2024-09-16T03:25:08.349 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:08.349 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.350 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.350 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:08.350 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6803", 2024-09-16T03:25:08.350 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:08.350 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:08.350 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:08.350 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.350 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:25:08.350 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:08.350 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.350 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:08.350 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6804", 2024-09-16T03:25:08.351 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:08.351 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.351 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.351 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:08.351 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6805", 2024-09-16T03:25:08.351 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:08.351 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:08.351 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:08.351 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.351 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:25:08.351 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:08.351 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.351 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:08.351 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6808", 2024-09-16T03:25:08.352 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:08.352 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.352 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.352 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:08.352 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6809", 2024-09-16T03:25:08.352 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:08.352 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:08.352 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:08.352 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.352 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:25:08.352 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:08.353 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.353 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:08.353 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6806", 2024-09-16T03:25:08.353 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:08.353 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.353 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.353 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:08.353 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6807", 2024-09-16T03:25:08.353 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:08.353 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:08.353 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:08.354 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.354 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6803/3375787448", 2024-09-16T03:25:08.354 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6805/3375787448", 2024-09-16T03:25:08.354 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6809/3375787448", 2024-09-16T03:25:08.354 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6807/3375787448", 2024-09-16T03:25:08.354 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:25:08.354 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:25:08.354 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:25:08.355 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:08.355 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.355 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.355 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:25:08.355 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "74b26727-75c9-444d-8782-719e4197a382", 2024-09-16T03:25:08.355 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:25:08.355 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:25:08.355 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:25:08.355 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:25:08.355 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:25:08.355 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:25:08.355 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 10, 2024-09-16T03:25:08.355 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 21, 2024-09-16T03:25:08.356 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:25:08.356 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:25:08.356 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:25:08.356 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:08.356 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.356 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:08.356 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6810", 2024-09-16T03:25:08.356 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:08.356 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.356 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.356 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:08.356 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6811", 2024-09-16T03:25:08.356 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:08.356 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:08.357 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:08.357 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.357 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:25:08.357 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:08.357 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.357 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:08.357 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6812", 2024-09-16T03:25:08.357 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:08.357 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.357 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.357 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:08.357 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6813", 2024-09-16T03:25:08.357 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:08.358 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:08.358 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:08.358 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.358 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:25:08.358 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:08.358 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.358 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:08.358 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6816", 2024-09-16T03:25:08.358 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:08.358 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.358 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.358 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:08.359 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6817", 2024-09-16T03:25:08.359 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:08.359 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:08.359 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:08.359 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.359 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:25:08.359 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:08.359 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.359 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:08.359 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6814", 2024-09-16T03:25:08.359 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:08.359 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.359 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.360 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:08.360 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6815", 2024-09-16T03:25:08.360 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:08.360 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:08.360 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:08.360 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.360 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6811/3733255132", 2024-09-16T03:25:08.360 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6813/3733255132", 2024-09-16T03:25:08.360 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6817/3733255132", 2024-09-16T03:25:08.360 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6815/3733255132", 2024-09-16T03:25:08.361 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:25:08.361 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:25:08.361 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:25:08.361 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:08.361 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.361 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.361 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:25:08.361 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "143da3a7-dad9-4b1e-966b-76cf5bdd3c82", 2024-09-16T03:25:08.361 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:25:08.361 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:25:08.361 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:25:08.362 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:25:08.362 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:25:08.362 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:25:08.362 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 15, 2024-09-16T03:25:08.362 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 21, 2024-09-16T03:25:08.362 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:25:08.362 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:25:08.362 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:25:08.362 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:08.362 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.362 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:08.362 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6818", 2024-09-16T03:25:08.362 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:08.363 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.363 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.363 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:08.363 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6819", 2024-09-16T03:25:08.363 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:08.363 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:08.363 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:08.363 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.363 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:25:08.363 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:08.363 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.363 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:08.364 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6820", 2024-09-16T03:25:08.364 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:08.364 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.364 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.364 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:08.364 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6821", 2024-09-16T03:25:08.364 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:08.364 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:08.365 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:08.365 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.365 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:25:08.365 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:08.365 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.365 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:08.365 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6824", 2024-09-16T03:25:08.365 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:08.365 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.365 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.365 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:08.365 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6825", 2024-09-16T03:25:08.366 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:08.366 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:08.366 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:08.366 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.366 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:25:08.366 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:08.366 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.366 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:08.366 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6822", 2024-09-16T03:25:08.366 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:08.366 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.366 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.366 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:08.366 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6823", 2024-09-16T03:25:08.367 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:08.367 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:08.367 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:08.367 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.367 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6819/963814857", 2024-09-16T03:25:08.367 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6821/963814857", 2024-09-16T03:25:08.367 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6825/963814857", 2024-09-16T03:25:08.367 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6823/963814857", 2024-09-16T03:25:08.367 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:25:08.367 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:25:08.367 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:25:08.368 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:08.368 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:08.368 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:08.368 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_xinfo": [ 2024-09-16T03:25:08.368 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.368 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:25:08.368 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:25:08.368 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:25:08.368 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:25:08.368 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:25:08.368 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:25:08.368 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:23:22.481942+0000", 2024-09-16T03:25:08.368 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:25:08.368 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.369 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.369 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:25:08.369 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:25:08.369 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:25:08.369 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:25:08.369 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:25:08.369 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:25:08.369 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:23:59.663703+0000", 2024-09-16T03:25:08.369 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:25:08.369 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.369 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.369 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:25:08.369 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:25:08.369 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:25:08.370 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:25:08.370 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:25:08.370 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:25:08.370 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:24:37.320822+0000", 2024-09-16T03:25:08.370 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:25:08.370 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:08.370 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:08.370 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap": [], 2024-09-16T03:25:08.370 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap_items": [], 2024-09-16T03:25:08.370 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap_primaries": [], 2024-09-16T03:25:08.370 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_temp": [], 2024-09-16T03:25:08.370 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_temp": [], 2024-09-16T03:25:08.370 INFO:tasks.workunit.client.0.smithi096.stderr: "blocklist": {}, 2024-09-16T03:25:08.370 INFO:tasks.workunit.client.0.smithi096.stderr: "range_blocklist": {}, 2024-09-16T03:25:08.371 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profiles": { 2024-09-16T03:25:08.371 INFO:tasks.workunit.client.0.smithi096.stderr: "default": { 2024-09-16T03:25:08.371 INFO:tasks.workunit.client.0.smithi096.stderr: "k": "2", 2024-09-16T03:25:08.371 INFO:tasks.workunit.client.0.smithi096.stderr: "m": "2", 2024-09-16T03:25:08.371 INFO:tasks.workunit.client.0.smithi096.stderr: "plugin": "jerasure", 2024-09-16T03:25:08.371 INFO:tasks.workunit.client.0.smithi096.stderr: "technique": "reed_sol_van" 2024-09-16T03:25:08.371 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:08.371 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.371 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps_queue": [], 2024-09-16T03:25:08.371 INFO:tasks.workunit.client.0.smithi096.stderr: "new_removed_snaps": [], 2024-09-16T03:25:08.371 INFO:tasks.workunit.client.0.smithi096.stderr: "new_purged_snaps": [], 2024-09-16T03:25:08.371 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_node_flags": {}, 2024-09-16T03:25:08.371 INFO:tasks.workunit.client.0.smithi096.stderr: "device_class_flags": {}, 2024-09-16T03:25:08.372 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode": { 2024-09-16T03:25:08.372 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode_enabled": false, 2024-09-16T03:25:08.372 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_bucket_count": 0, 2024-09-16T03:25:08.372 INFO:tasks.workunit.client.0.smithi096.stderr: "degraded_stretch_mode": 0, 2024-09-16T03:25:08.372 INFO:tasks.workunit.client.0.smithi096.stderr: "recovering_stretch_mode": 0, 2024-09-16T03:25:08.372 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode_bucket": 0 2024-09-16T03:25:08.372 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:08.372 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.372 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_metadata": [ 2024-09-16T03:25:08.372 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.372 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:25:08.372 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:25:08.373 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]", 2024-09-16T03:25:08.373 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:25:08.373 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:25:08.373 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:25:08.374 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:25:08.374 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:25:08.374 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:25:08.374 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:25:08.374 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:25:08.374 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:25:08.374 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:25:08.374 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:25:08.375 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/0/block", 2024-09-16T03:25:08.375 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:25:08.375 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:25:08.375 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:25:08.375 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:25:08.375 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:25:08.376 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:25:08.376 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:25:08.376 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:25:08.376 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:25:08.376 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:25:08.376 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:22:53.662571Z", 2024-09-16T03:25:08.376 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:25:08.376 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:25:08.376 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:25:08.376 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:25:08.377 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:25:08.377 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:25:08.377 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:25:08.377 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]", 2024-09-16T03:25:08.377 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:25:08.377 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]", 2024-09-16T03:25:08.377 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]", 2024-09-16T03:25:08.377 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:25:08.377 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:25:08.377 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:25:08.377 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:25:08.377 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:25:08.377 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:25:08.378 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:25:08.378 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:25:08.378 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:25:08.378 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/0", 2024-09-16T03:25:08.378 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:25:08.378 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:25:08.378 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:25:08.378 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.378 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.378 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:25:08.378 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:25:08.378 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]", 2024-09-16T03:25:08.378 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:25:08.379 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:25:08.379 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:25:08.379 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:25:08.379 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:25:08.379 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:25:08.379 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:25:08.379 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:25:08.379 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:25:08.379 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:25:08.379 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:25:08.379 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/1/block", 2024-09-16T03:25:08.379 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:25:08.379 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:25:08.380 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:25:08.380 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:25:08.380 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:25:08.380 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:25:08.380 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:25:08.380 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:25:08.380 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:25:08.380 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:25:08.380 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:23:30.129885Z", 2024-09-16T03:25:08.380 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:25:08.380 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:25:08.380 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:25:08.381 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:25:08.381 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:25:08.384 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:25:08.384 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:25:08.385 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]", 2024-09-16T03:25:08.385 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:25:08.385 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]", 2024-09-16T03:25:08.385 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]", 2024-09-16T03:25:08.385 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:25:08.385 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:25:08.385 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:25:08.385 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:25:08.385 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:25:08.385 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:25:08.385 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:25:08.385 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:25:08.385 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:25:08.386 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/1", 2024-09-16T03:25:08.386 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:25:08.386 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:25:08.386 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:25:08.386 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.386 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.386 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:25:08.386 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:25:08.386 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]", 2024-09-16T03:25:08.386 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:25:08.386 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:25:08.386 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:25:08.386 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:25:08.386 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:25:08.386 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:25:08.387 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:25:08.387 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:25:08.387 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:25:08.387 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:25:08.387 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:25:08.387 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/2/block", 2024-09-16T03:25:08.387 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:25:08.387 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:25:08.387 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:25:08.387 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:25:08.387 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:25:08.387 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:25:08.387 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:25:08.387 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:25:08.388 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:25:08.388 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:25:08.388 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:24:07.764502Z", 2024-09-16T03:25:08.388 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:25:08.388 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:25:08.388 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:25:08.388 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:25:08.388 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:25:08.388 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:25:08.388 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:25:08.388 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]", 2024-09-16T03:25:08.388 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:25:08.388 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]", 2024-09-16T03:25:08.389 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]", 2024-09-16T03:25:08.389 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:25:08.389 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:25:08.389 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:25:08.389 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:25:08.389 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:25:08.389 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:25:08.389 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:25:08.389 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:25:08.389 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:25:08.389 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/2", 2024-09-16T03:25:08.389 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:25:08.389 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:25:08.390 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:25:08.390 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:08.390 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:08.390 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_clean_epochs": { 2024-09-16T03:25:08.390 INFO:tasks.workunit.client.0.smithi096.stderr: "min_last_epoch_clean": 28, 2024-09-16T03:25:08.390 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": { 2024-09-16T03:25:08.390 INFO:tasks.workunit.client.0.smithi096.stderr: "per_pool": [ 2024-09-16T03:25:08.390 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.390 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 1, 2024-09-16T03:25:08.390 INFO:tasks.workunit.client.0.smithi096.stderr: "floor": 28 2024-09-16T03:25:08.390 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.390 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.390 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 2, 2024-09-16T03:25:08.390 INFO:tasks.workunit.client.0.smithi096.stderr: "floor": 28 2024-09-16T03:25:08.391 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:08.391 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:08.391 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.391 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_epochs": [ 2024-09-16T03:25:08.391 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.391 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:25:08.391 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 32 2024-09-16T03:25:08.391 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.391 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.391 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:25:08.391 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 32 2024-09-16T03:25:08.392 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.392 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.392 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:25:08.392 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 28 2024-09-16T03:25:08.392 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:08.392 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:08.392 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.392 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_first_committed": 28, 2024-09-16T03:25:08.392 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_last_committed": 32, 2024-09-16T03:25:08.392 INFO:tasks.workunit.client.0.smithi096.stderr: "crushmap": { 2024-09-16T03:25:08.392 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": [ 2024-09-16T03:25:08.392 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.393 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:25:08.393 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.0", 2024-09-16T03:25:08.393 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:25:08.393 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.393 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.393 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:25:08.393 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.1", 2024-09-16T03:25:08.393 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:25:08.393 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.393 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.393 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:25:08.393 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.2", 2024-09-16T03:25:08.394 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:25:08.394 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:08.394 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:08.394 INFO:tasks.workunit.client.0.smithi096.stderr: "types": [ 2024-09-16T03:25:08.394 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.394 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 0, 2024-09-16T03:25:08.394 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd" 2024-09-16T03:25:08.394 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.394 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.394 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:25:08.394 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "host" 2024-09-16T03:25:08.394 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.394 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.394 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 2, 2024-09-16T03:25:08.395 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "chassis" 2024-09-16T03:25:08.395 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.395 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.395 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 3, 2024-09-16T03:25:08.395 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "rack" 2024-09-16T03:25:08.395 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.395 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.395 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 4, 2024-09-16T03:25:08.395 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "row" 2024-09-16T03:25:08.395 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.395 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.396 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 5, 2024-09-16T03:25:08.396 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "pdu" 2024-09-16T03:25:08.396 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.396 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.396 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 6, 2024-09-16T03:25:08.396 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "pod" 2024-09-16T03:25:08.396 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.396 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.396 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 7, 2024-09-16T03:25:08.396 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "room" 2024-09-16T03:25:08.396 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.396 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.396 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 8, 2024-09-16T03:25:08.397 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "datacenter" 2024-09-16T03:25:08.397 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.397 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.397 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 9, 2024-09-16T03:25:08.397 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "zone" 2024-09-16T03:25:08.397 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.397 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.397 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 10, 2024-09-16T03:25:08.397 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "region" 2024-09-16T03:25:08.397 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.397 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.397 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:25:08.397 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "root" 2024-09-16T03:25:08.398 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:08.398 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:08.398 INFO:tasks.workunit.client.0.smithi096.stderr: "buckets": [ 2024-09-16T03:25:08.398 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.398 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -1, 2024-09-16T03:25:08.398 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "default", 2024-09-16T03:25:08.398 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:25:08.398 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "root", 2024-09-16T03:25:08.398 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:25:08.398 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:25:08.398 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:25:08.398 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:25:08.399 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.399 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -3, 2024-09-16T03:25:08.399 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:25:08.399 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:25:08.399 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:08.399 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:08.399 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.399 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.399 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -2, 2024-09-16T03:25:08.399 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "default~hdd", 2024-09-16T03:25:08.399 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:25:08.399 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "root", 2024-09-16T03:25:08.399 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:25:08.399 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:25:08.400 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:25:08.400 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:25:08.400 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.400 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -4, 2024-09-16T03:25:08.400 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:25:08.400 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:25:08.400 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:08.400 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:08.400 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.400 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.400 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -3, 2024-09-16T03:25:08.400 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "smithi096", 2024-09-16T03:25:08.400 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:25:08.400 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "host", 2024-09-16T03:25:08.401 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:25:08.401 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:25:08.401 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:25:08.401 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:25:08.401 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.401 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:25:08.401 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:25:08.401 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:25:08.401 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.401 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.401 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:25:08.401 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:25:08.401 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 1 2024-09-16T03:25:08.401 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.402 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.402 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:25:08.402 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:25:08.402 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 2 2024-09-16T03:25:08.402 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:08.402 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:08.402 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.402 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.402 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -4, 2024-09-16T03:25:08.402 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "smithi096~hdd", 2024-09-16T03:25:08.402 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:25:08.402 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "host", 2024-09-16T03:25:08.402 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:25:08.402 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:25:08.402 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:25:08.403 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:25:08.403 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.403 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:25:08.403 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:25:08.403 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:25:08.403 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.403 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.403 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:25:08.403 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:25:08.403 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 1 2024-09-16T03:25:08.403 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.403 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.404 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:25:08.404 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:25:08.404 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 2 2024-09-16T03:25:08.404 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:08.404 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:08.404 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:08.404 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:08.404 INFO:tasks.workunit.client.0.smithi096.stderr: "rules": [ 2024-09-16T03:25:08.404 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.404 INFO:tasks.workunit.client.0.smithi096.stderr: "rule_id": 0, 2024-09-16T03:25:08.404 INFO:tasks.workunit.client.0.smithi096.stderr: "rule_name": "replicated_rule", 2024-09-16T03:25:08.404 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:25:08.405 INFO:tasks.workunit.client.0.smithi096.stderr: "steps": [ 2024-09-16T03:25:08.405 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.405 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "take", 2024-09-16T03:25:08.405 INFO:tasks.workunit.client.0.smithi096.stderr: "item": -1, 2024-09-16T03:25:08.405 INFO:tasks.workunit.client.0.smithi096.stderr: "item_name": "default" 2024-09-16T03:25:08.405 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.405 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.405 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "choose_firstn", 2024-09-16T03:25:08.405 INFO:tasks.workunit.client.0.smithi096.stderr: "num": 0, 2024-09-16T03:25:08.405 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "osd" 2024-09-16T03:25:08.405 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.405 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.405 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "emit" 2024-09-16T03:25:08.405 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:08.406 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:08.406 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:08.406 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:08.406 INFO:tasks.workunit.client.0.smithi096.stderr: "tunables": { 2024-09-16T03:25:08.406 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_local_tries": 0, 2024-09-16T03:25:08.406 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_local_fallback_tries": 0, 2024-09-16T03:25:08.406 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_total_tries": 50, 2024-09-16T03:25:08.406 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_descend_once": 1, 2024-09-16T03:25:08.406 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_vary_r": 1, 2024-09-16T03:25:08.406 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_stable": 1, 2024-09-16T03:25:08.406 INFO:tasks.workunit.client.0.smithi096.stderr: "msr_descents": 100, 2024-09-16T03:25:08.406 INFO:tasks.workunit.client.0.smithi096.stderr: "msr_collision_tries": 100, 2024-09-16T03:25:08.407 INFO:tasks.workunit.client.0.smithi096.stderr: "straw_calc_version": 1, 2024-09-16T03:25:08.407 INFO:tasks.workunit.client.0.smithi096.stderr: "allowed_bucket_algs": 54, 2024-09-16T03:25:08.407 INFO:tasks.workunit.client.0.smithi096.stderr: "profile": "jewel", 2024-09-16T03:25:08.407 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_tunables": 1, 2024-09-16T03:25:08.407 INFO:tasks.workunit.client.0.smithi096.stderr: "legacy_tunables": 0, 2024-09-16T03:25:08.407 INFO:tasks.workunit.client.0.smithi096.stderr: "minimum_required_version": "jewel", 2024-09-16T03:25:08.407 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables": 1, 2024-09-16T03:25:08.407 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables2": 1, 2024-09-16T03:25:08.407 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v2_rules": 0, 2024-09-16T03:25:08.407 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables3": 1, 2024-09-16T03:25:08.407 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v3_rules": 0, 2024-09-16T03:25:08.407 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v4_buckets": 1, 2024-09-16T03:25:08.407 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables5": 1, 2024-09-16T03:25:08.407 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v5_rules": 0, 2024-09-16T03:25:08.408 INFO:tasks.workunit.client.0.smithi096.stderr: "has_msr_rules": 0 2024-09-16T03:25:08.408 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.408 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_args": {} 2024-09-16T03:25:08.408 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.408 INFO:tasks.workunit.client.0.smithi096.stderr: "fsmap": { 2024-09-16T03:25:08.408 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 1, 2024-09-16T03:25:08.408 INFO:tasks.workunit.client.0.smithi096.stderr: "btime": "2024-09-16T03:22:46:882186+0000", 2024-09-16T03:25:08.408 INFO:tasks.workunit.client.0.smithi096.stderr: "default_fscid": -1, 2024-09-16T03:25:08.408 INFO:tasks.workunit.client.0.smithi096.stderr: "compat": { 2024-09-16T03:25:08.408 INFO:tasks.workunit.client.0.smithi096.stderr: "compat": {}, 2024-09-16T03:25:08.408 INFO:tasks.workunit.client.0.smithi096.stderr: "ro_compat": {}, 2024-09-16T03:25:08.408 INFO:tasks.workunit.client.0.smithi096.stderr: "incompat": { 2024-09-16T03:25:08.409 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_1": "base v0.20", 2024-09-16T03:25:08.409 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_2": "client writeable ranges", 2024-09-16T03:25:08.409 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_3": "default file layouts on dirs", 2024-09-16T03:25:08.409 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_4": "dir inode in separate object", 2024-09-16T03:25:08.409 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_5": "mds uses versioned encoding", 2024-09-16T03:25:08.409 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_6": "dirfrag is stored in omap", 2024-09-16T03:25:08.409 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_8": "no anchor table", 2024-09-16T03:25:08.409 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_9": "file layout v2", 2024-09-16T03:25:08.409 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_10": "snaprealm v2", 2024-09-16T03:25:08.409 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_11": "minor log segments", 2024-09-16T03:25:08.410 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_12": "quiesce subvolumes" 2024-09-16T03:25:08.410 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:08.410 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.410 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_flags": { 2024-09-16T03:25:08.410 INFO:tasks.workunit.client.0.smithi096.stderr: "enable_multiple": true, 2024-09-16T03:25:08.410 INFO:tasks.workunit.client.0.smithi096.stderr: "ever_enabled_multiple": true 2024-09-16T03:25:08.410 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.410 INFO:tasks.workunit.client.0.smithi096.stderr: "standbys": [], 2024-09-16T03:25:08.410 INFO:tasks.workunit.client.0.smithi096.stderr: "filesystems": [] 2024-09-16T03:25:08.410 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.410 INFO:tasks.workunit.client.0.smithi096.stderr: "mdsmap_first_committed": 1, 2024-09-16T03:25:08.410 INFO:tasks.workunit.client.0.smithi096.stderr: "mdsmap_last_committed": 1, 2024-09-16T03:25:08.410 INFO:tasks.workunit.client.0.smithi096.stderr: "auth": { 2024-09-16T03:25:08.410 INFO:tasks.workunit.client.0.smithi096.stderr: "first_committed": 1, 2024-09-16T03:25:08.411 INFO:tasks.workunit.client.0.smithi096.stderr: "last_committed": 5, 2024-09-16T03:25:08.411 INFO:tasks.workunit.client.0.smithi096.stderr: "num_secrets": 3 2024-09-16T03:25:08.411 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.411 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 64, 2024-09-16T03:25:08.411 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_active": 64, 2024-09-16T03:25:08.411 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_unknown": 0, 2024-09-16T03:25:08.411 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osd": 3, 2024-09-16T03:25:08.411 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_sum": { 2024-09-16T03:25:08.411 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:25:08.411 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:25:08.411 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:25:08.411 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:25:08.411 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:25:08.412 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:25:08.412 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:25:08.412 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:25:08.412 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:25:08.412 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:25:08.412 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:25:08.412 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:25:08.412 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:25:08.412 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:25:08.412 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:25:08.412 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:25:08.412 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:25:08.412 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:25:08.413 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:25:08.413 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:25:08.413 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:25:08.413 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:25:08.413 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:25:08.413 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:25:08.413 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:25:08.413 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:25:08.413 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:25:08.413 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:25:08.413 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:25:08.413 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:25:08.414 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:25:08.414 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:25:08.414 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:25:08.414 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:25:08.414 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:25:08.414 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:25:08.414 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:25:08.414 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:25:08.414 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:25:08.414 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:25:08.414 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:25:08.414 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.414 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:25:08.414 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:25:08.415 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:25:08.415 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:25:08.415 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:25:08.415 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:25:08.415 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:25:08.415 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:25:08.415 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:25:08.415 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:25:08.415 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:25:08.415 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.415 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:25:08.415 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:25:08.415 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 192, 2024-09-16T03:25:08.415 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 192, 2024-09-16T03:25:08.416 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 0 2024-09-16T03:25:08.416 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.416 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_sum": { 2024-09-16T03:25:08.416 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 0, 2024-09-16T03:25:08.416 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 0, 2024-09-16T03:25:08.416 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pgs": 192, 2024-09-16T03:25:08.416 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osds": 3, 2024-09-16T03:25:08.416 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_osds": 3, 2024-09-16T03:25:08.416 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_omap_osds": 3, 2024-09-16T03:25:08.416 INFO:tasks.workunit.client.0.smithi096.stderr: "kb": 314572800, 2024-09-16T03:25:08.416 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used": 81232, 2024-09-16T03:25:08.416 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_data": 696, 2024-09-16T03:25:08.416 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_omap": 4, 2024-09-16T03:25:08.417 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_meta": 80443, 2024-09-16T03:25:08.417 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_avail": 314491568, 2024-09-16T03:25:08.417 INFO:tasks.workunit.client.0.smithi096.stderr: "statfs": { 2024-09-16T03:25:08.417 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 322122547200, 2024-09-16T03:25:08.417 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 322039365632, 2024-09-16T03:25:08.417 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:25:08.417 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 712704, 2024-09-16T03:25:08.417 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 209643, 2024-09-16T03:25:08.417 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:25:08.417 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:25:08.417 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:25:08.417 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 4785, 2024-09-16T03:25:08.417 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 82373967 2024-09-16T03:25:08.417 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.418 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_peers": [], 2024-09-16T03:25:08.418 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_trim_queue_len": 0, 2024-09-16T03:25:08.418 INFO:tasks.workunit.client.0.smithi096.stderr: "num_snap_trimming": 0, 2024-09-16T03:25:08.418 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shards_repaired": 0, 2024-09-16T03:25:08.418 INFO:tasks.workunit.client.0.smithi096.stderr: "op_queue_age_hist": { 2024-09-16T03:25:08.418 INFO:tasks.workunit.client.0.smithi096.stderr: "histogram": [], 2024-09-16T03:25:08.418 INFO:tasks.workunit.client.0.smithi096.stderr: "upper_bound": 1 2024-09-16T03:25:08.418 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.418 INFO:tasks.workunit.client.0.smithi096.stderr: "perf_stat": { 2024-09-16T03:25:08.418 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ms": 108, 2024-09-16T03:25:08.418 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ms": 108, 2024-09-16T03:25:08.418 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ns": 108000000, 2024-09-16T03:25:08.418 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ns": 108000000 2024-09-16T03:25:08.419 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.419 INFO:tasks.workunit.client.0.smithi096.stderr: "alerts": [], 2024-09-16T03:25:08.419 INFO:tasks.workunit.client.0.smithi096.stderr: "network_ping_times": [] 2024-09-16T03:25:08.419 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.419 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_sum_by_class": { 2024-09-16T03:25:08.419 INFO:tasks.workunit.client.0.smithi096.stderr: "hdd": { 2024-09-16T03:25:08.419 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 0, 2024-09-16T03:25:08.419 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 0, 2024-09-16T03:25:08.419 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pgs": 192, 2024-09-16T03:25:08.419 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osds": 3, 2024-09-16T03:25:08.419 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_osds": 3, 2024-09-16T03:25:08.419 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_omap_osds": 3, 2024-09-16T03:25:08.419 INFO:tasks.workunit.client.0.smithi096.stderr: "kb": 314572800, 2024-09-16T03:25:08.419 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used": 81232, 2024-09-16T03:25:08.420 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_data": 696, 2024-09-16T03:25:08.420 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_omap": 4, 2024-09-16T03:25:08.420 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_meta": 80443, 2024-09-16T03:25:08.420 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_avail": 314491568, 2024-09-16T03:25:08.420 INFO:tasks.workunit.client.0.smithi096.stderr: "statfs": { 2024-09-16T03:25:08.420 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 322122547200, 2024-09-16T03:25:08.420 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 322039365632, 2024-09-16T03:25:08.420 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:25:08.420 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 712704, 2024-09-16T03:25:08.420 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 209643, 2024-09-16T03:25:08.420 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:25:08.420 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:25:08.420 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:25:08.421 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 4785, 2024-09-16T03:25:08.421 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 82373967 2024-09-16T03:25:08.421 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.421 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_peers": [], 2024-09-16T03:25:08.421 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_trim_queue_len": 0, 2024-09-16T03:25:08.421 INFO:tasks.workunit.client.0.smithi096.stderr: "num_snap_trimming": 0, 2024-09-16T03:25:08.421 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shards_repaired": 0, 2024-09-16T03:25:08.421 INFO:tasks.workunit.client.0.smithi096.stderr: "op_queue_age_hist": { 2024-09-16T03:25:08.421 INFO:tasks.workunit.client.0.smithi096.stderr: "histogram": [], 2024-09-16T03:25:08.421 INFO:tasks.workunit.client.0.smithi096.stderr: "upper_bound": 1 2024-09-16T03:25:08.421 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.421 INFO:tasks.workunit.client.0.smithi096.stderr: "perf_stat": { 2024-09-16T03:25:08.421 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ms": 108, 2024-09-16T03:25:08.422 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ms": 108, 2024-09-16T03:25:08.422 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ns": 108000000, 2024-09-16T03:25:08.422 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ns": 108000000 2024-09-16T03:25:08.422 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.422 INFO:tasks.workunit.client.0.smithi096.stderr: "alerts": [], 2024-09-16T03:25:08.422 INFO:tasks.workunit.client.0.smithi096.stderr: "network_ping_times": [] 2024-09-16T03:25:08.422 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:08.422 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.422 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_stats": [ 2024-09-16T03:25:08.422 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.422 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 2, 2024-09-16T03:25:08.422 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 32, 2024-09-16T03:25:08.422 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:25:08.422 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:25:08.423 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:25:08.423 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:25:08.423 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:25:08.423 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:25:08.423 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:25:08.423 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:25:08.423 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:25:08.423 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:25:08.423 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:25:08.423 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:25:08.423 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:25:08.423 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:25:08.424 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:25:08.424 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:25:08.424 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:25:08.424 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:25:08.424 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:25:08.424 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:25:08.424 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:25:08.424 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:25:08.424 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:25:08.424 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:25:08.424 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:25:08.424 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:25:08.425 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:25:08.425 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:25:08.425 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:25:08.425 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:25:08.425 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:25:08.425 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:25:08.425 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:25:08.425 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:25:08.425 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:25:08.425 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:25:08.425 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:25:08.425 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:25:08.425 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:25:08.425 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:25:08.426 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:25:08.426 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.426 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:25:08.426 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:25:08.426 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:25:08.426 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:25:08.426 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:25:08.426 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:25:08.426 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:25:08.426 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:25:08.426 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:25:08.426 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:25:08.426 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:25:08.426 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.426 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:25:08.427 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:25:08.427 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 96, 2024-09-16T03:25:08.427 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 96, 2024-09-16T03:25:08.427 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 3 2024-09-16T03:25:08.427 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.427 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.427 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 1, 2024-09-16T03:25:08.427 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 32, 2024-09-16T03:25:08.427 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:25:08.427 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:25:08.427 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:25:08.427 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:25:08.428 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:25:08.428 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:25:08.428 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:25:08.428 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:25:08.428 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:25:08.428 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:25:08.428 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:25:08.428 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:25:08.428 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:25:08.428 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:25:08.428 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:25:08.428 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:25:08.428 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:25:08.428 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:25:08.429 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:25:08.429 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:25:08.429 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:25:08.429 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:25:08.429 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:25:08.429 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:25:08.429 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:25:08.429 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:25:08.430 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:25:08.430 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:25:08.430 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:25:08.430 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:25:08.430 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:25:08.430 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:25:08.430 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:25:08.430 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:25:08.430 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:25:08.430 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:25:08.430 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:25:08.430 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:25:08.430 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:25:08.430 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:25:08.431 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:25:08.431 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.431 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:25:08.431 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:25:08.431 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:25:08.431 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:25:08.431 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:25:08.431 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:25:08.431 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:25:08.431 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:25:08.431 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:25:08.431 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:25:08.431 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:25:08.431 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.432 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:25:08.432 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:25:08.432 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 96, 2024-09-16T03:25:08.432 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 96, 2024-09-16T03:25:08.432 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 3 2024-09-16T03:25:08.432 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:08.432 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:08.432 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_stats": [ 2024-09-16T03:25:08.432 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.432 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:25:08.432 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 21474836507 2024-09-16T03:25:08.432 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.432 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.433 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:25:08.433 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 42949672979 2024-09-16T03:25:08.433 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.433 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.433 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:25:08.433 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 64424509451 2024-09-16T03:25:08.433 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:08.433 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:08.433 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_by_state": [ 2024-09-16T03:25:08.433 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.433 INFO:tasks.workunit.client.0.smithi096.stderr: "state": "active+clean", 2024-09-16T03:25:08.433 INFO:tasks.workunit.client.0.smithi096.stderr: "num": 64 2024-09-16T03:25:08.433 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:08.434 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:08.434 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_by_osd": [ 2024-09-16T03:25:08.434 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.434 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:25:08.434 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 15, 2024-09-16T03:25:08.434 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 64, 2024-09-16T03:25:08.434 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:25:08.434 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.434 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.434 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:25:08.434 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 20, 2024-09-16T03:25:08.434 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 64, 2024-09-16T03:25:08.434 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:25:08.434 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.435 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.435 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:25:08.435 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 29, 2024-09-16T03:25:08.435 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 64, 2024-09-16T03:25:08.435 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:25:08.435 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:08.435 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:08.435 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": [ 2024-09-16T03:25:08.435 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.435 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 1, 2024-09-16T03:25:08.435 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": {} 2024-09-16T03:25:08.435 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.435 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:08.436 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 2, 2024-09-16T03:25:08.436 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": {} 2024-09-16T03:25:08.436 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:08.436 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:08.436 INFO:tasks.workunit.client.0.smithi096.stderr: "servicemap": { 2024-09-16T03:25:08.436 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 4, 2024-09-16T03:25:08.436 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:25:02.412573+0000", 2024-09-16T03:25:08.436 INFO:tasks.workunit.client.0.smithi096.stderr: "services": { 2024-09-16T03:25:08.436 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": { 2024-09-16T03:25:08.436 INFO:tasks.workunit.client.0.smithi096.stderr: "daemons": { 2024-09-16T03:25:08.436 INFO:tasks.workunit.client.0.smithi096.stderr: "summary": "", 2024-09-16T03:25:08.436 INFO:tasks.workunit.client.0.smithi096.stderr: "2": { 2024-09-16T03:25:08.437 INFO:tasks.workunit.client.0.smithi096.stderr: "start_epoch": 0, 2024-09-16T03:25:08.437 INFO:tasks.workunit.client.0.smithi096.stderr: "start_stamp": "0.000000", 2024-09-16T03:25:08.437 INFO:tasks.workunit.client.0.smithi096.stderr: "gid": 0, 2024-09-16T03:25:08.437 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "(unrecognized address family 0)/0", 2024-09-16T03:25:08.437 INFO:tasks.workunit.client.0.smithi096.stderr: "metadata": {}, 2024-09-16T03:25:08.437 INFO:tasks.workunit.client.0.smithi096.stderr: "task_status": {} 2024-09-16T03:25:08.437 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:08.437 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:08.437 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:08.437 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:08.437 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:08.437 INFO:tasks.workunit.client.0.smithi096.stderr: "mgrstat_first_committed": 54, 2024-09-16T03:25:08.437 INFO:tasks.workunit.client.0.smithi096.stderr: "mgrstat_last_committed": 59, 2024-09-16T03:25:08.437 INFO:tasks.workunit.client.0.smithi096.stderr: "logm_first_committed": 1, 2024-09-16T03:25:08.438 INFO:tasks.workunit.client.0.smithi096.stderr: "logm_last_committed": 264, 2024-09-16T03:25:08.438 INFO:tasks.workunit.client.0.smithi096.stderr: "paxos": { 2024-09-16T03:25:08.438 INFO:tasks.workunit.client.0.smithi096.stderr: "first_committed": 1, 2024-09-16T03:25:08.438 INFO:tasks.workunit.client.0.smithi096.stderr: "last_committed": 369, 2024-09-16T03:25:08.438 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pn": 0, 2024-09-16T03:25:08.438 INFO:tasks.workunit.client.0.smithi096.stderr: "accepted_pn": 0 2024-09-16T03:25:08.438 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:08.438 INFO:tasks.workunit.client.0.smithi096.stderr:}' 2024-09-16T03:25:08.441 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:121: validate_fc: jq .osdmap_clean_epochs.min_last_epoch_clean 2024-09-16T03:25:08.441 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:121: validate_fc: echo '{' '"cluster_fingerprint":' '"fda2fc64-07ed-4add-8224-2e527e11d427",' '"version":' '"19.3.0-4930-gfc3e0bff",' '"commit":' '"fc3e0bff7468fd55478adbae7f75508b749124b6",' '"timestamp":' '"2024-09-16T03:25:08.307630+0000",' '"tag":' '"",' '"health":' '{' '"status":' '"HEALTH_OK",' '"checks":' '{},' '"mutes":' '[]' '},' '"monmap_first_committed":' 1, '"monmap_last_committed":' 1, '"monmap":' '{' '"epoch":' 1, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"modified":' '"2024-09-16T03:22:45.872880Z",' '"created":' '"2024-09-16T03:22:45.872880Z",' '"min_mon_release":' 19, '"min_mon_release_name":' '"squid",' '"election_strategy":' 1, '"disallowed_leaders:' '":' '"",' '"stretch_mode":' false, '"tiebreaker_mon":' '"",' '"removed_ranks:' '":' '"",' '"features":' '{' '"persistent":' '[' '"kraken",' '"luminous",' '"mimic",' '"osdmap-prune",' '"nautilus",' '"octopus",' '"pacific",' '"elector-pinging",' '"quincy",' '"reef",' '"squid"' '],' '"optional":' '[]' '},' '"mons":' '[' '{' '"rank":' 0, '"name":' '"a",' '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:7302",' '"nonce":' 0 '}' ']' '},' '"addr":' '"127.0.0.1:7302/0",' '"public_addr":' '"127.0.0.1:7302/0",' '"priority":' 0, '"weight":' 0, '"crush_location":' '"{}"' '}' ']' '},' '"quorum":' '[' 0 '],' '"osdmap":' '{' '"epoch":' 32, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"created":' '"2024-09-16T03:22:46.906117+0000",' '"modified":' '"2024-09-16T03:25:05.447882+0000",' '"last_up_change":' '"2024-09-16T03:24:37.708512+0000",' '"last_in_change":' '"2024-09-16T03:24:01.831039+0000",' '"flags":' '"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit",' '"flags_num":' 5799936, '"flags_set":' '[' '"pglog_hardlimit",' '"purged_snapdirs",' '"recovery_deletes",' '"sortbitwise"' '],' '"crush_version":' 7, '"full_ratio":' 0.97000002861022949, '"backfillfull_ratio":' 0.97000002861022949, '"nearfull_ratio":' 0.85000002384185791, '"cluster_snapshot":' '"",' '"pool_max":' 2, '"max_osd":' 3, '"require_min_compat_client":' '"luminous",' '"min_compat_client":' '"jewel",' '"require_osd_release":' '"squid",' '"allow_crimson":' false, '"pools":' '[' '{' '"pool":' 1, '"pool_name":' '"foo",' '"create_time":' '"2024-09-16T03:24:44.525189+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"30",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.690000057220459, '"score_stable":' 1.690000057220459, '"optimal_score":' 1, '"raw_score_acting":' 1.690000057220459, '"raw_score_stable":' 1.690000057220459, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '},' '{' '"pool":' 2, '"pool_name":' '"bar",' '"create_time":' '"2024-09-16T03:24:46.226575+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"32",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.1299999952316284, '"score_stable":' 1.1299999952316284, '"optimal_score":' 1, '"raw_score_acting":' 1.1299999952316284, '"raw_score_stable":' 1.1299999952316284, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '}' '],' '"osds":' '[' '{' '"osd":' 0, '"uuid":' '"64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 5, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6802",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6803",' '"nonce":' 3375787448 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6804",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6805",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6808",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6809",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6806",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6807",' '"nonce":' 3375787448 '}' ']' '},' '"public_addr":' '"127.0.0.1:6803/3375787448",' '"cluster_addr":' '"127.0.0.1:6805/3375787448",' '"heartbeat_back_addr":' '"127.0.0.1:6809/3375787448",' '"heartbeat_front_addr":' '"127.0.0.1:6807/3375787448",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 1, '"uuid":' '"74b26727-75c9-444d-8782-719e4197a382",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 10, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6810",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6811",' '"nonce":' 3733255132 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6812",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6813",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6816",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6817",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6814",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6815",' '"nonce":' 3733255132 '}' ']' '},' '"public_addr":' '"127.0.0.1:6811/3733255132",' '"cluster_addr":' '"127.0.0.1:6813/3733255132",' '"heartbeat_back_addr":' '"127.0.0.1:6817/3733255132",' '"heartbeat_front_addr":' '"127.0.0.1:6815/3733255132",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 2, '"uuid":' '"143da3a7-dad9-4b1e-966b-76cf5bdd3c82",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 15, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6818",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6819",' '"nonce":' 963814857 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6820",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6821",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6824",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6825",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6822",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6823",' '"nonce":' 963814857 '}' ']' '},' '"public_addr":' '"127.0.0.1:6819/963814857",' '"cluster_addr":' '"127.0.0.1:6821/963814857",' '"heartbeat_back_addr":' '"127.0.0.1:6825/963814857",' '"heartbeat_front_addr":' '"127.0.0.1:6823/963814857",' '"state":' '[' '"exists",' '"up"' ']' '}' '],' '"osd_xinfo":' '[' '{' '"osd":' 0, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:22.481942+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 1, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:59.663703+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 2, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:24:37.320822+0000",' '"dead_epoch":' 0 '}' '],' '"pg_upmap":' '[],' '"pg_upmap_items":' '[],' '"pg_upmap_primaries":' '[],' '"pg_temp":' '[],' '"primary_temp":' '[],' '"blocklist":' '{},' '"range_blocklist":' '{},' '"erasure_code_profiles":' '{' '"default":' '{' '"k":' '"2",' '"m":' '"2",' '"plugin":' '"jerasure",' '"technique":' '"reed_sol_van"' '}' '},' '"removed_snaps_queue":' '[],' '"new_removed_snaps":' '[],' '"new_purged_snaps":' '[],' '"crush_node_flags":' '{},' '"device_class_flags":' '{},' '"stretch_mode":' '{' '"stretch_mode_enabled":' false, '"stretch_bucket_count":' 0, '"degraded_stretch_mode":' 0, '"recovering_stretch_mode":' 0, '"stretch_mode_bucket":' 0 '}' '},' '"osd_metadata":' '[' '{' '"id":' 0, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/0/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:22:53.662571Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]",' '"hb_front_addr":' '"[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/0",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 1, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/1/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:23:30.129885Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]",' '"hb_front_addr":' '"[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/1",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 2, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/2/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:24:07.764502Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]",' '"hb_front_addr":' '"[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/2",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '}' '],' '"osdmap_clean_epochs":' '{' '"min_last_epoch_clean":' 28, '"last_epoch_clean":' '{' '"per_pool":' '[' '{' '"poolid":' 1, '"floor":' 28 '},' '{' '"poolid":' 2, '"floor":' 28 '}' ']' '},' '"osd_epochs":' '[' '{' '"id":' 0, '"epoch":' 32 '},' '{' '"id":' 1, '"epoch":' 32 '},' '{' '"id":' 2, '"epoch":' 28 '}' ']' '},' '"osdmap_first_committed":' 28, '"osdmap_last_committed":' 32, '"crushmap":' '{' '"devices":' '[' '{' '"id":' 0, '"name":' '"osd.0",' '"class":' '"hdd"' '},' '{' '"id":' 1, '"name":' '"osd.1",' '"class":' '"hdd"' '},' '{' '"id":' 2, '"name":' '"osd.2",' '"class":' '"hdd"' '}' '],' '"types":' '[' '{' '"type_id":' 0, '"name":' '"osd"' '},' '{' '"type_id":' 1, '"name":' '"host"' '},' '{' '"type_id":' 2, '"name":' '"chassis"' '},' '{' '"type_id":' 3, '"name":' '"rack"' '},' '{' '"type_id":' 4, '"name":' '"row"' '},' '{' '"type_id":' 5, '"name":' '"pdu"' '},' '{' '"type_id":' 6, '"name":' '"pod"' '},' '{' '"type_id":' 7, '"name":' '"room"' '},' '{' '"type_id":' 8, '"name":' '"datacenter"' '},' '{' '"type_id":' 9, '"name":' '"zone"' '},' '{' '"type_id":' 10, '"name":' '"region"' '},' '{' '"type_id":' 11, '"name":' '"root"' '}' '],' '"buckets":' '[' '{' '"id":' -1, '"name":' '"default",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -3, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -2, '"name":' '"default~hdd",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -4, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -3, '"name":' '"smithi096",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '},' '{' '"id":' -4, '"name":' '"smithi096~hdd",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '}' '],' '"rules":' '[' '{' '"rule_id":' 0, '"rule_name":' '"replicated_rule",' '"type":' 1, '"steps":' '[' '{' '"op":' '"take",' '"item":' -1, '"item_name":' '"default"' '},' '{' '"op":' '"choose_firstn",' '"num":' 0, '"type":' '"osd"' '},' '{' '"op":' '"emit"' '}' ']' '}' '],' '"tunables":' '{' '"choose_local_tries":' 0, '"choose_local_fallback_tries":' 0, '"choose_total_tries":' 50, '"chooseleaf_descend_once":' 1, '"chooseleaf_vary_r":' 1, '"chooseleaf_stable":' 1, '"msr_descents":' 100, '"msr_collision_tries":' 100, '"straw_calc_version":' 1, '"allowed_bucket_algs":' 54, '"profile":' '"jewel",' '"optimal_tunables":' 1, '"legacy_tunables":' 0, '"minimum_required_version":' '"jewel",' '"require_feature_tunables":' 1, '"require_feature_tunables2":' 1, '"has_v2_rules":' 0, '"require_feature_tunables3":' 1, '"has_v3_rules":' 0, '"has_v4_buckets":' 1, '"require_feature_tunables5":' 1, '"has_v5_rules":' 0, '"has_msr_rules":' 0 '},' '"choose_args":' '{}' '},' '"fsmap":' '{' '"epoch":' 1, '"btime":' '"2024-09-16T03:22:46:882186+0000",' '"default_fscid":' -1, '"compat":' '{' '"compat":' '{},' '"ro_compat":' '{},' '"incompat":' '{' '"feature_1":' '"base' 'v0.20",' '"feature_2":' '"client' writeable 'ranges",' '"feature_3":' '"default' file layouts on 'dirs",' '"feature_4":' '"dir' inode in separate 'object",' '"feature_5":' '"mds' uses versioned 'encoding",' '"feature_6":' '"dirfrag' is stored in 'omap",' '"feature_8":' '"no' anchor 'table",' '"feature_9":' '"file' layout 'v2",' '"feature_10":' '"snaprealm' 'v2",' '"feature_11":' '"minor' log 'segments",' '"feature_12":' '"quiesce' 'subvolumes"' '}' '},' '"feature_flags":' '{' '"enable_multiple":' true, '"ever_enabled_multiple":' true '},' '"standbys":' '[],' '"filesystems":' '[]' '},' '"mdsmap_first_committed":' 1, '"mdsmap_last_committed":' 1, '"auth":' '{' '"first_committed":' 1, '"last_committed":' 5, '"num_secrets":' 3 '},' '"num_pg":' 64, '"num_pg_active":' 64, '"num_pg_unknown":' 0, '"num_osd":' 3, '"pool_sum":' '{' '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 192, '"acting":' 192, '"num_store_stats":' 0 '},' '"osd_sum":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 192, '"num_osds":' 3, '"num_per_pool_osds":' 3, '"num_per_pool_omap_osds":' 3, '"kb":' 314572800, '"kb_used":' 81232, '"kb_used_data":' 696, '"kb_used_omap":' 4, '"kb_used_meta":' 80443, '"kb_avail":' 314491568, '"statfs":' '{' '"total":' 322122547200, '"available":' 322039365632, '"internally_reserved":' 0, '"allocated":' 712704, '"data_stored":' 209643, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 4785, '"internal_metadata":' 82373967 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 108, '"apply_latency_ms":' 108, '"commit_latency_ns":' 108000000, '"apply_latency_ns":' 108000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '},' '"osd_sum_by_class":' '{' '"hdd":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 192, '"num_osds":' 3, '"num_per_pool_osds":' 3, '"num_per_pool_omap_osds":' 3, '"kb":' 314572800, '"kb_used":' 81232, '"kb_used_data":' 696, '"kb_used_omap":' 4, '"kb_used_meta":' 80443, '"kb_avail":' 314491568, '"statfs":' '{' '"total":' 322122547200, '"available":' 322039365632, '"internally_reserved":' 0, '"allocated":' 712704, '"data_stored":' 209643, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 4785, '"internal_metadata":' 82373967 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 108, '"apply_latency_ms":' 108, '"commit_latency_ns":' 108000000, '"apply_latency_ns":' 108000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '}' '},' '"pool_stats":' '[' '{' '"poolid":' 2, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 96, '"acting":' 96, '"num_store_stats":' 3 '},' '{' '"poolid":' 1, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 96, '"acting":' 96, '"num_store_stats":' 3 '}' '],' '"osd_stats":' '[' '{' '"osd":' 0, '"seq":' 21474836507 '},' '{' '"osd":' 1, '"seq":' 42949672979 '},' '{' '"osd":' 2, '"seq":' 64424509451 '}' '],' '"num_pg_by_state":' '[' '{' '"state":' '"active+clean",' '"num":' 64 '}' '],' '"num_pg_by_osd":' '[' '{' '"osd":' 2, '"num_primary_pg":' 15, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 0, '"num_primary_pg":' 20, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 1, '"num_primary_pg":' 29, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '}' '],' '"purged_snaps":' '[' '{' '"pool":' 1, '"purged_snaps":' '{}' '},' '{' '"pool":' 2, '"purged_snaps":' '{}' '}' '],' '"servicemap":' '{' '"epoch":' 4, '"modified":' '"2024-09-16T03:25:02.412573+0000",' '"services":' '{' '"osd":' '{' '"daemons":' '{' '"summary":' '"",' '"2":' '{' '"start_epoch":' 0, '"start_stamp":' '"0.000000",' '"gid":' 0, '"addr":' '"(unrecognized' address family '0)/0",' '"metadata":' '{},' '"task_status":' '{}' '}' '}' '}' '}' '},' '"mgrstat_first_committed":' 54, '"mgrstat_last_committed":' 59, '"logm_first_committed":' 1, '"logm_last_committed":' 264, '"paxos":' '{' '"first_committed":' 1, '"last_committed":' 369, '"last_pn":' 0, '"accepted_pn":' 0 '}' '}' 2024-09-16T03:25:08.441 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:121: validate_fc: lec=28 2024-09-16T03:25:08.441 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:123: validate_fc: jq .osdmap_first_committed 2024-09-16T03:25:08.442 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:123: validate_fc: echo '{' '"cluster_fingerprint":' '"fda2fc64-07ed-4add-8224-2e527e11d427",' '"version":' '"19.3.0-4930-gfc3e0bff",' '"commit":' '"fc3e0bff7468fd55478adbae7f75508b749124b6",' '"timestamp":' '"2024-09-16T03:25:08.307630+0000",' '"tag":' '"",' '"health":' '{' '"status":' '"HEALTH_OK",' '"checks":' '{},' '"mutes":' '[]' '},' '"monmap_first_committed":' 1, '"monmap_last_committed":' 1, '"monmap":' '{' '"epoch":' 1, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"modified":' '"2024-09-16T03:22:45.872880Z",' '"created":' '"2024-09-16T03:22:45.872880Z",' '"min_mon_release":' 19, '"min_mon_release_name":' '"squid",' '"election_strategy":' 1, '"disallowed_leaders:' '":' '"",' '"stretch_mode":' false, '"tiebreaker_mon":' '"",' '"removed_ranks:' '":' '"",' '"features":' '{' '"persistent":' '[' '"kraken",' '"luminous",' '"mimic",' '"osdmap-prune",' '"nautilus",' '"octopus",' '"pacific",' '"elector-pinging",' '"quincy",' '"reef",' '"squid"' '],' '"optional":' '[]' '},' '"mons":' '[' '{' '"rank":' 0, '"name":' '"a",' '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:7302",' '"nonce":' 0 '}' ']' '},' '"addr":' '"127.0.0.1:7302/0",' '"public_addr":' '"127.0.0.1:7302/0",' '"priority":' 0, '"weight":' 0, '"crush_location":' '"{}"' '}' ']' '},' '"quorum":' '[' 0 '],' '"osdmap":' '{' '"epoch":' 32, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"created":' '"2024-09-16T03:22:46.906117+0000",' '"modified":' '"2024-09-16T03:25:05.447882+0000",' '"last_up_change":' '"2024-09-16T03:24:37.708512+0000",' '"last_in_change":' '"2024-09-16T03:24:01.831039+0000",' '"flags":' '"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit",' '"flags_num":' 5799936, '"flags_set":' '[' '"pglog_hardlimit",' '"purged_snapdirs",' '"recovery_deletes",' '"sortbitwise"' '],' '"crush_version":' 7, '"full_ratio":' 0.97000002861022949, '"backfillfull_ratio":' 0.97000002861022949, '"nearfull_ratio":' 0.85000002384185791, '"cluster_snapshot":' '"",' '"pool_max":' 2, '"max_osd":' 3, '"require_min_compat_client":' '"luminous",' '"min_compat_client":' '"jewel",' '"require_osd_release":' '"squid",' '"allow_crimson":' false, '"pools":' '[' '{' '"pool":' 1, '"pool_name":' '"foo",' '"create_time":' '"2024-09-16T03:24:44.525189+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"30",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.690000057220459, '"score_stable":' 1.690000057220459, '"optimal_score":' 1, '"raw_score_acting":' 1.690000057220459, '"raw_score_stable":' 1.690000057220459, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '},' '{' '"pool":' 2, '"pool_name":' '"bar",' '"create_time":' '"2024-09-16T03:24:46.226575+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"32",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.1299999952316284, '"score_stable":' 1.1299999952316284, '"optimal_score":' 1, '"raw_score_acting":' 1.1299999952316284, '"raw_score_stable":' 1.1299999952316284, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '}' '],' '"osds":' '[' '{' '"osd":' 0, '"uuid":' '"64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 5, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6802",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6803",' '"nonce":' 3375787448 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6804",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6805",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6808",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6809",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6806",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6807",' '"nonce":' 3375787448 '}' ']' '},' '"public_addr":' '"127.0.0.1:6803/3375787448",' '"cluster_addr":' '"127.0.0.1:6805/3375787448",' '"heartbeat_back_addr":' '"127.0.0.1:6809/3375787448",' '"heartbeat_front_addr":' '"127.0.0.1:6807/3375787448",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 1, '"uuid":' '"74b26727-75c9-444d-8782-719e4197a382",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 10, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6810",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6811",' '"nonce":' 3733255132 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6812",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6813",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6816",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6817",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6814",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6815",' '"nonce":' 3733255132 '}' ']' '},' '"public_addr":' '"127.0.0.1:6811/3733255132",' '"cluster_addr":' '"127.0.0.1:6813/3733255132",' '"heartbeat_back_addr":' '"127.0.0.1:6817/3733255132",' '"heartbeat_front_addr":' '"127.0.0.1:6815/3733255132",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 2, '"uuid":' '"143da3a7-dad9-4b1e-966b-76cf5bdd3c82",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 15, '"up_thru":' 21, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6818",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6819",' '"nonce":' 963814857 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6820",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6821",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6824",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6825",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6822",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6823",' '"nonce":' 963814857 '}' ']' '},' '"public_addr":' '"127.0.0.1:6819/963814857",' '"cluster_addr":' '"127.0.0.1:6821/963814857",' '"heartbeat_back_addr":' '"127.0.0.1:6825/963814857",' '"heartbeat_front_addr":' '"127.0.0.1:6823/963814857",' '"state":' '[' '"exists",' '"up"' ']' '}' '],' '"osd_xinfo":' '[' '{' '"osd":' 0, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:22.481942+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 1, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:59.663703+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 2, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:24:37.320822+0000",' '"dead_epoch":' 0 '}' '],' '"pg_upmap":' '[],' '"pg_upmap_items":' '[],' '"pg_upmap_primaries":' '[],' '"pg_temp":' '[],' '"primary_temp":' '[],' '"blocklist":' '{},' '"range_blocklist":' '{},' '"erasure_code_profiles":' '{' '"default":' '{' '"k":' '"2",' '"m":' '"2",' '"plugin":' '"jerasure",' '"technique":' '"reed_sol_van"' '}' '},' '"removed_snaps_queue":' '[],' '"new_removed_snaps":' '[],' '"new_purged_snaps":' '[],' '"crush_node_flags":' '{},' '"device_class_flags":' '{},' '"stretch_mode":' '{' '"stretch_mode_enabled":' false, '"stretch_bucket_count":' 0, '"degraded_stretch_mode":' 0, '"recovering_stretch_mode":' 0, '"stretch_mode_bucket":' 0 '}' '},' '"osd_metadata":' '[' '{' '"id":' 0, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/0/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:22:53.662571Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]",' '"hb_front_addr":' '"[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/0",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 1, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/1/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:23:30.129885Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]",' '"hb_front_addr":' '"[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/1",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 2, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/2/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:24:07.764502Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]",' '"hb_front_addr":' '"[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/2",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '}' '],' '"osdmap_clean_epochs":' '{' '"min_last_epoch_clean":' 28, '"last_epoch_clean":' '{' '"per_pool":' '[' '{' '"poolid":' 1, '"floor":' 28 '},' '{' '"poolid":' 2, '"floor":' 28 '}' ']' '},' '"osd_epochs":' '[' '{' '"id":' 0, '"epoch":' 32 '},' '{' '"id":' 1, '"epoch":' 32 '},' '{' '"id":' 2, '"epoch":' 28 '}' ']' '},' '"osdmap_first_committed":' 28, '"osdmap_last_committed":' 32, '"crushmap":' '{' '"devices":' '[' '{' '"id":' 0, '"name":' '"osd.0",' '"class":' '"hdd"' '},' '{' '"id":' 1, '"name":' '"osd.1",' '"class":' '"hdd"' '},' '{' '"id":' 2, '"name":' '"osd.2",' '"class":' '"hdd"' '}' '],' '"types":' '[' '{' '"type_id":' 0, '"name":' '"osd"' '},' '{' '"type_id":' 1, '"name":' '"host"' '},' '{' '"type_id":' 2, '"name":' '"chassis"' '},' '{' '"type_id":' 3, '"name":' '"rack"' '},' '{' '"type_id":' 4, '"name":' '"row"' '},' '{' '"type_id":' 5, '"name":' '"pdu"' '},' '{' '"type_id":' 6, '"name":' '"pod"' '},' '{' '"type_id":' 7, '"name":' '"room"' '},' '{' '"type_id":' 8, '"name":' '"datacenter"' '},' '{' '"type_id":' 9, '"name":' '"zone"' '},' '{' '"type_id":' 10, '"name":' '"region"' '},' '{' '"type_id":' 11, '"name":' '"root"' '}' '],' '"buckets":' '[' '{' '"id":' -1, '"name":' '"default",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -3, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -2, '"name":' '"default~hdd",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -4, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -3, '"name":' '"smithi096",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '},' '{' '"id":' -4, '"name":' '"smithi096~hdd",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '}' '],' '"rules":' '[' '{' '"rule_id":' 0, '"rule_name":' '"replicated_rule",' '"type":' 1, '"steps":' '[' '{' '"op":' '"take",' '"item":' -1, '"item_name":' '"default"' '},' '{' '"op":' '"choose_firstn",' '"num":' 0, '"type":' '"osd"' '},' '{' '"op":' '"emit"' '}' ']' '}' '],' '"tunables":' '{' '"choose_local_tries":' 0, '"choose_local_fallback_tries":' 0, '"choose_total_tries":' 50, '"chooseleaf_descend_once":' 1, '"chooseleaf_vary_r":' 1, '"chooseleaf_stable":' 1, '"msr_descents":' 100, '"msr_collision_tries":' 100, '"straw_calc_version":' 1, '"allowed_bucket_algs":' 54, '"profile":' '"jewel",' '"optimal_tunables":' 1, '"legacy_tunables":' 0, '"minimum_required_version":' '"jewel",' '"require_feature_tunables":' 1, '"require_feature_tunables2":' 1, '"has_v2_rules":' 0, '"require_feature_tunables3":' 1, '"has_v3_rules":' 0, '"has_v4_buckets":' 1, '"require_feature_tunables5":' 1, '"has_v5_rules":' 0, '"has_msr_rules":' 0 '},' '"choose_args":' '{}' '},' '"fsmap":' '{' '"epoch":' 1, '"btime":' '"2024-09-16T03:22:46:882186+0000",' '"default_fscid":' -1, '"compat":' '{' '"compat":' '{},' '"ro_compat":' '{},' '"incompat":' '{' '"feature_1":' '"base' 'v0.20",' '"feature_2":' '"client' writeable 'ranges",' '"feature_3":' '"default' file layouts on 'dirs",' '"feature_4":' '"dir' inode in separate 'object",' '"feature_5":' '"mds' uses versioned 'encoding",' '"feature_6":' '"dirfrag' is stored in 'omap",' '"feature_8":' '"no' anchor 'table",' '"feature_9":' '"file' layout 'v2",' '"feature_10":' '"snaprealm' 'v2",' '"feature_11":' '"minor' log 'segments",' '"feature_12":' '"quiesce' 'subvolumes"' '}' '},' '"feature_flags":' '{' '"enable_multiple":' true, '"ever_enabled_multiple":' true '},' '"standbys":' '[],' '"filesystems":' '[]' '},' '"mdsmap_first_committed":' 1, '"mdsmap_last_committed":' 1, '"auth":' '{' '"first_committed":' 1, '"last_committed":' 5, '"num_secrets":' 3 '},' '"num_pg":' 64, '"num_pg_active":' 64, '"num_pg_unknown":' 0, '"num_osd":' 3, '"pool_sum":' '{' '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 192, '"acting":' 192, '"num_store_stats":' 0 '},' '"osd_sum":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 192, '"num_osds":' 3, '"num_per_pool_osds":' 3, '"num_per_pool_omap_osds":' 3, '"kb":' 314572800, '"kb_used":' 81232, '"kb_used_data":' 696, '"kb_used_omap":' 4, '"kb_used_meta":' 80443, '"kb_avail":' 314491568, '"statfs":' '{' '"total":' 322122547200, '"available":' 322039365632, '"internally_reserved":' 0, '"allocated":' 712704, '"data_stored":' 209643, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 4785, '"internal_metadata":' 82373967 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 108, '"apply_latency_ms":' 108, '"commit_latency_ns":' 108000000, '"apply_latency_ns":' 108000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '},' '"osd_sum_by_class":' '{' '"hdd":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 192, '"num_osds":' 3, '"num_per_pool_osds":' 3, '"num_per_pool_omap_osds":' 3, '"kb":' 314572800, '"kb_used":' 81232, '"kb_used_data":' 696, '"kb_used_omap":' 4, '"kb_used_meta":' 80443, '"kb_avail":' 314491568, '"statfs":' '{' '"total":' 322122547200, '"available":' 322039365632, '"internally_reserved":' 0, '"allocated":' 712704, '"data_stored":' 209643, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 4785, '"internal_metadata":' 82373967 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 108, '"apply_latency_ms":' 108, '"commit_latency_ns":' 108000000, '"apply_latency_ns":' 108000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '}' '},' '"pool_stats":' '[' '{' '"poolid":' 2, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 96, '"acting":' 96, '"num_store_stats":' 3 '},' '{' '"poolid":' 1, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 96, '"acting":' 96, '"num_store_stats":' 3 '}' '],' '"osd_stats":' '[' '{' '"osd":' 0, '"seq":' 21474836507 '},' '{' '"osd":' 1, '"seq":' 42949672979 '},' '{' '"osd":' 2, '"seq":' 64424509451 '}' '],' '"num_pg_by_state":' '[' '{' '"state":' '"active+clean",' '"num":' 64 '}' '],' '"num_pg_by_osd":' '[' '{' '"osd":' 2, '"num_primary_pg":' 15, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 0, '"num_primary_pg":' 20, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 1, '"num_primary_pg":' 29, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '}' '],' '"purged_snaps":' '[' '{' '"pool":' 1, '"purged_snaps":' '{}' '},' '{' '"pool":' 2, '"purged_snaps":' '{}' '}' '],' '"servicemap":' '{' '"epoch":' 4, '"modified":' '"2024-09-16T03:25:02.412573+0000",' '"services":' '{' '"osd":' '{' '"daemons":' '{' '"summary":' '"",' '"2":' '{' '"start_epoch":' 0, '"start_stamp":' '"0.000000",' '"gid":' 0, '"addr":' '"(unrecognized' address family '0)/0",' '"metadata":' '{},' '"task_status":' '{}' '}' '}' '}' '}' '},' '"mgrstat_first_committed":' 54, '"mgrstat_last_committed":' 59, '"logm_first_committed":' 1, '"logm_last_committed":' 264, '"paxos":' '{' '"first_committed":' 1, '"last_committed":' 369, '"last_pn":' 0, '"accepted_pn":' 0 '}' '}' 2024-09-16T03:25:08.442 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:123: validate_fc: osdm_fc=28 2024-09-16T03:25:08.442 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:125: validate_fc: [[ 28 -eq 28 ]] 2024-09-16T03:25:08.442 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:126: validate_fc: return 0 2024-09-16T03:25:08.442 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:228: TEST_mon_last_clean_epoch: kill 52063 2024-09-16T03:25:08.442 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:228: TEST_mon_last_clean_epoch: sleep 1 2024-09-16T03:25:09.398 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:228: TEST_mon_last_clean_epoch: kill 52063 2024-09-16T03:25:09.398 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh: line 228: kill: (52063) - No such process 2024-09-16T03:25:09.398 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:229: TEST_mon_last_clean_epoch: ceph osd out 2 2024-09-16T03:25:10.134 INFO:tasks.workunit.client.0.smithi096.stderr:osd.2 is already out. 2024-09-16T03:25:10.151 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:230: TEST_mon_last_clean_epoch: sleep 5 2024-09-16T03:25:15.153 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:233: TEST_mon_last_clean_epoch: (( i=0 )) 2024-09-16T03:25:15.154 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:233: TEST_mon_last_clean_epoch: (( i <= 10 )) 2024-09-16T03:25:15.154 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:234: TEST_mon_last_clean_epoch: ceph osd set noup 2024-09-16T03:25:15.825 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:25:15.842 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:235: TEST_mon_last_clean_epoch: sleep 1 2024-09-16T03:25:16.844 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:236: TEST_mon_last_clean_epoch: ceph osd unset noup 2024-09-16T03:25:17.503 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:25:17.527 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:237: TEST_mon_last_clean_epoch: sleep 1 2024-09-16T03:25:18.528 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:233: TEST_mon_last_clean_epoch: (( ++i )) 2024-09-16T03:25:18.528 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:233: TEST_mon_last_clean_epoch: (( i <= 10 )) 2024-09-16T03:25:18.529 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:234: TEST_mon_last_clean_epoch: ceph osd set noup 2024-09-16T03:25:19.225 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:25:19.245 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:235: TEST_mon_last_clean_epoch: sleep 1 2024-09-16T03:25:20.247 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:236: TEST_mon_last_clean_epoch: ceph osd unset noup 2024-09-16T03:25:20.996 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:25:21.018 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:237: TEST_mon_last_clean_epoch: sleep 1 2024-09-16T03:25:22.020 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:233: TEST_mon_last_clean_epoch: (( ++i )) 2024-09-16T03:25:22.020 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:233: TEST_mon_last_clean_epoch: (( i <= 10 )) 2024-09-16T03:25:22.020 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:234: TEST_mon_last_clean_epoch: ceph osd set noup 2024-09-16T03:25:22.849 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:25:22.871 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:235: TEST_mon_last_clean_epoch: sleep 1 2024-09-16T03:25:23.872 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:236: TEST_mon_last_clean_epoch: ceph osd unset noup 2024-09-16T03:25:24.520 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:25:24.541 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:237: TEST_mon_last_clean_epoch: sleep 1 2024-09-16T03:25:25.542 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:233: TEST_mon_last_clean_epoch: (( ++i )) 2024-09-16T03:25:25.543 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:233: TEST_mon_last_clean_epoch: (( i <= 10 )) 2024-09-16T03:25:25.543 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:234: TEST_mon_last_clean_epoch: ceph osd set noup 2024-09-16T03:25:26.198 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:25:26.219 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:235: TEST_mon_last_clean_epoch: sleep 1 2024-09-16T03:25:27.220 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:236: TEST_mon_last_clean_epoch: ceph osd unset noup 2024-09-16T03:25:28.043 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:25:28.067 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:237: TEST_mon_last_clean_epoch: sleep 1 2024-09-16T03:25:29.069 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:233: TEST_mon_last_clean_epoch: (( ++i )) 2024-09-16T03:25:29.070 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:233: TEST_mon_last_clean_epoch: (( i <= 10 )) 2024-09-16T03:25:29.070 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:234: TEST_mon_last_clean_epoch: ceph osd set noup 2024-09-16T03:25:29.782 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:25:29.801 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:235: TEST_mon_last_clean_epoch: sleep 1 2024-09-16T03:25:30.802 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:236: TEST_mon_last_clean_epoch: ceph osd unset noup 2024-09-16T03:25:31.502 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:25:31.523 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:237: TEST_mon_last_clean_epoch: sleep 1 2024-09-16T03:25:32.525 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:233: TEST_mon_last_clean_epoch: (( ++i )) 2024-09-16T03:25:32.525 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:233: TEST_mon_last_clean_epoch: (( i <= 10 )) 2024-09-16T03:25:32.525 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:234: TEST_mon_last_clean_epoch: ceph osd set noup 2024-09-16T03:25:33.365 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:25:33.389 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:235: TEST_mon_last_clean_epoch: sleep 1 2024-09-16T03:25:34.390 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:236: TEST_mon_last_clean_epoch: ceph osd unset noup 2024-09-16T03:25:35.103 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:25:35.125 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:237: TEST_mon_last_clean_epoch: sleep 1 2024-09-16T03:25:36.127 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:233: TEST_mon_last_clean_epoch: (( ++i )) 2024-09-16T03:25:36.127 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:233: TEST_mon_last_clean_epoch: (( i <= 10 )) 2024-09-16T03:25:36.127 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:234: TEST_mon_last_clean_epoch: ceph osd set noup 2024-09-16T03:25:36.949 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:25:36.972 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:235: TEST_mon_last_clean_epoch: sleep 1 2024-09-16T03:25:37.974 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:236: TEST_mon_last_clean_epoch: ceph osd unset noup 2024-09-16T03:25:38.871 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:25:38.895 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:237: TEST_mon_last_clean_epoch: sleep 1 2024-09-16T03:25:39.897 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:233: TEST_mon_last_clean_epoch: (( ++i )) 2024-09-16T03:25:39.897 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:233: TEST_mon_last_clean_epoch: (( i <= 10 )) 2024-09-16T03:25:39.897 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:234: TEST_mon_last_clean_epoch: ceph osd set noup 2024-09-16T03:25:40.658 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:25:40.681 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:235: TEST_mon_last_clean_epoch: sleep 1 2024-09-16T03:25:41.682 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:236: TEST_mon_last_clean_epoch: ceph osd unset noup 2024-09-16T03:25:42.403 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:25:42.425 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:237: TEST_mon_last_clean_epoch: sleep 1 2024-09-16T03:25:43.427 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:233: TEST_mon_last_clean_epoch: (( ++i )) 2024-09-16T03:25:43.427 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:233: TEST_mon_last_clean_epoch: (( i <= 10 )) 2024-09-16T03:25:43.427 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:234: TEST_mon_last_clean_epoch: ceph osd set noup 2024-09-16T03:25:44.100 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:25:44.120 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:235: TEST_mon_last_clean_epoch: sleep 1 2024-09-16T03:25:45.122 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:236: TEST_mon_last_clean_epoch: ceph osd unset noup 2024-09-16T03:25:45.821 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:25:45.843 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:237: TEST_mon_last_clean_epoch: sleep 1 2024-09-16T03:25:46.844 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:233: TEST_mon_last_clean_epoch: (( ++i )) 2024-09-16T03:25:46.845 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:233: TEST_mon_last_clean_epoch: (( i <= 10 )) 2024-09-16T03:25:46.845 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:234: TEST_mon_last_clean_epoch: ceph osd set noup 2024-09-16T03:25:47.542 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:25:47.563 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:235: TEST_mon_last_clean_epoch: sleep 1 2024-09-16T03:25:48.565 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:236: TEST_mon_last_clean_epoch: ceph osd unset noup 2024-09-16T03:25:49.499 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:25:49.517 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:237: TEST_mon_last_clean_epoch: sleep 1 2024-09-16T03:25:50.518 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:233: TEST_mon_last_clean_epoch: (( ++i )) 2024-09-16T03:25:50.518 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:233: TEST_mon_last_clean_epoch: (( i <= 10 )) 2024-09-16T03:25:50.518 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:234: TEST_mon_last_clean_epoch: ceph osd set noup 2024-09-16T03:25:51.221 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:25:51.242 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:235: TEST_mon_last_clean_epoch: sleep 1 2024-09-16T03:25:52.244 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:236: TEST_mon_last_clean_epoch: ceph osd unset noup 2024-09-16T03:25:53.000 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:25:53.021 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:237: TEST_mon_last_clean_epoch: sleep 1 2024-09-16T03:25:54.024 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:233: TEST_mon_last_clean_epoch: (( ++i )) 2024-09-16T03:25:54.024 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:233: TEST_mon_last_clean_epoch: (( i <= 10 )) 2024-09-16T03:25:54.025 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:240: TEST_mon_last_clean_epoch: get_fc_lc_diff 2024-09-16T03:25:54.025 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:130: get_fc_lc_diff: ceph report 2024-09-16T03:25:54.593 INFO:tasks.workunit.client.0.smithi096.stderr:report 80215504 2024-09-16T03:25:54.610 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:130: get_fc_lc_diff: report='{ 2024-09-16T03:25:54.611 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_fingerprint": "fda2fc64-07ed-4add-8224-2e527e11d427", 2024-09-16T03:25:54.611 INFO:tasks.workunit.client.0.smithi096.stderr: "version": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:25:54.611 INFO:tasks.workunit.client.0.smithi096.stderr: "commit": "fc3e0bff7468fd55478adbae7f75508b749124b6", 2024-09-16T03:25:54.611 INFO:tasks.workunit.client.0.smithi096.stderr: "timestamp": "2024-09-16T03:25:54.589189+0000", 2024-09-16T03:25:54.611 INFO:tasks.workunit.client.0.smithi096.stderr: "tag": "", 2024-09-16T03:25:54.611 INFO:tasks.workunit.client.0.smithi096.stderr: "health": { 2024-09-16T03:25:54.611 INFO:tasks.workunit.client.0.smithi096.stderr: "status": "HEALTH_OK", 2024-09-16T03:25:54.611 INFO:tasks.workunit.client.0.smithi096.stderr: "checks": {}, 2024-09-16T03:25:54.611 INFO:tasks.workunit.client.0.smithi096.stderr: "mutes": [] 2024-09-16T03:25:54.612 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.612 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap_first_committed": 1, 2024-09-16T03:25:54.612 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap_last_committed": 1, 2024-09-16T03:25:54.612 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap": { 2024-09-16T03:25:54.612 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 1, 2024-09-16T03:25:54.612 INFO:tasks.workunit.client.0.smithi096.stderr: "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", 2024-09-16T03:25:54.612 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:22:45.872880Z", 2024-09-16T03:25:54.612 INFO:tasks.workunit.client.0.smithi096.stderr: "created": "2024-09-16T03:22:45.872880Z", 2024-09-16T03:25:54.612 INFO:tasks.workunit.client.0.smithi096.stderr: "min_mon_release": 19, 2024-09-16T03:25:54.612 INFO:tasks.workunit.client.0.smithi096.stderr: "min_mon_release_name": "squid", 2024-09-16T03:25:54.613 INFO:tasks.workunit.client.0.smithi096.stderr: "election_strategy": 1, 2024-09-16T03:25:54.613 INFO:tasks.workunit.client.0.smithi096.stderr: "disallowed_leaders: ": "", 2024-09-16T03:25:54.613 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode": false, 2024-09-16T03:25:54.613 INFO:tasks.workunit.client.0.smithi096.stderr: "tiebreaker_mon": "", 2024-09-16T03:25:54.613 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_ranks: ": "", 2024-09-16T03:25:54.613 INFO:tasks.workunit.client.0.smithi096.stderr: "features": { 2024-09-16T03:25:54.613 INFO:tasks.workunit.client.0.smithi096.stderr: "persistent": [ 2024-09-16T03:25:54.613 INFO:tasks.workunit.client.0.smithi096.stderr: "kraken", 2024-09-16T03:25:54.613 INFO:tasks.workunit.client.0.smithi096.stderr: "luminous", 2024-09-16T03:25:54.613 INFO:tasks.workunit.client.0.smithi096.stderr: "mimic", 2024-09-16T03:25:54.613 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap-prune", 2024-09-16T03:25:54.614 INFO:tasks.workunit.client.0.smithi096.stderr: "nautilus", 2024-09-16T03:25:54.614 INFO:tasks.workunit.client.0.smithi096.stderr: "octopus", 2024-09-16T03:25:54.614 INFO:tasks.workunit.client.0.smithi096.stderr: "pacific", 2024-09-16T03:25:54.614 INFO:tasks.workunit.client.0.smithi096.stderr: "elector-pinging", 2024-09-16T03:25:54.614 INFO:tasks.workunit.client.0.smithi096.stderr: "quincy", 2024-09-16T03:25:54.614 INFO:tasks.workunit.client.0.smithi096.stderr: "reef", 2024-09-16T03:25:54.614 INFO:tasks.workunit.client.0.smithi096.stderr: "squid" 2024-09-16T03:25:54.614 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:54.614 INFO:tasks.workunit.client.0.smithi096.stderr: "optional": [] 2024-09-16T03:25:54.614 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.614 INFO:tasks.workunit.client.0.smithi096.stderr: "mons": [ 2024-09-16T03:25:54.614 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:54.614 INFO:tasks.workunit.client.0.smithi096.stderr: "rank": 0, 2024-09-16T03:25:54.615 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "a", 2024-09-16T03:25:54.615 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:25:54.615 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:54.615 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:54.615 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:54.615 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:7302", 2024-09-16T03:25:54.615 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 0 2024-09-16T03:25:54.615 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:54.615 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:54.615 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.615 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:7302/0", 2024-09-16T03:25:54.615 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:7302/0", 2024-09-16T03:25:54.616 INFO:tasks.workunit.client.0.smithi096.stderr: "priority": 0, 2024-09-16T03:25:54.616 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 0, 2024-09-16T03:25:54.616 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_location": "{}" 2024-09-16T03:25:54.616 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:54.616 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:54.616 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.616 INFO:tasks.workunit.client.0.smithi096.stderr: "quorum": [ 2024-09-16T03:25:54.616 INFO:tasks.workunit.client.0.smithi096.stderr: 0 2024-09-16T03:25:54.616 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:54.616 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap": { 2024-09-16T03:25:54.616 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 80, 2024-09-16T03:25:54.616 INFO:tasks.workunit.client.0.smithi096.stderr: "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", 2024-09-16T03:25:54.616 INFO:tasks.workunit.client.0.smithi096.stderr: "created": "2024-09-16T03:22:46.906117+0000", 2024-09-16T03:25:54.617 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:25:52.948673+0000", 2024-09-16T03:25:54.617 INFO:tasks.workunit.client.0.smithi096.stderr: "last_up_change": "2024-09-16T03:25:08.513363+0000", 2024-09-16T03:25:54.617 INFO:tasks.workunit.client.0.smithi096.stderr: "last_in_change": "2024-09-16T03:25:09.839444+0000", 2024-09-16T03:25:54.617 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-16T03:25:54.617 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_num": 5799936, 2024-09-16T03:25:54.617 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_set": [ 2024-09-16T03:25:54.617 INFO:tasks.workunit.client.0.smithi096.stderr: "pglog_hardlimit", 2024-09-16T03:25:54.617 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snapdirs", 2024-09-16T03:25:54.617 INFO:tasks.workunit.client.0.smithi096.stderr: "recovery_deletes", 2024-09-16T03:25:54.617 INFO:tasks.workunit.client.0.smithi096.stderr: "sortbitwise" 2024-09-16T03:25:54.617 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:54.617 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_version": 7, 2024-09-16T03:25:54.618 INFO:tasks.workunit.client.0.smithi096.stderr: "full_ratio": 0.97000002861022949, 2024-09-16T03:25:54.618 INFO:tasks.workunit.client.0.smithi096.stderr: "backfillfull_ratio": 0.97000002861022949, 2024-09-16T03:25:54.618 INFO:tasks.workunit.client.0.smithi096.stderr: "nearfull_ratio": 0.85000002384185791, 2024-09-16T03:25:54.618 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_snapshot": "", 2024-09-16T03:25:54.618 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_max": 2, 2024-09-16T03:25:54.618 INFO:tasks.workunit.client.0.smithi096.stderr: "max_osd": 3, 2024-09-16T03:25:54.618 INFO:tasks.workunit.client.0.smithi096.stderr: "require_min_compat_client": "luminous", 2024-09-16T03:25:54.618 INFO:tasks.workunit.client.0.smithi096.stderr: "min_compat_client": "jewel", 2024-09-16T03:25:54.618 INFO:tasks.workunit.client.0.smithi096.stderr: "require_osd_release": "squid", 2024-09-16T03:25:54.618 INFO:tasks.workunit.client.0.smithi096.stderr: "allow_crimson": false, 2024-09-16T03:25:54.618 INFO:tasks.workunit.client.0.smithi096.stderr: "pools": [ 2024-09-16T03:25:54.618 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:54.619 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 1, 2024-09-16T03:25:54.619 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_name": "foo", 2024-09-16T03:25:54.619 INFO:tasks.workunit.client.0.smithi096.stderr: "create_time": "2024-09-16T03:24:44.525189+0000", 2024-09-16T03:25:54.619 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": 1, 2024-09-16T03:25:54.619 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_names": "hashpspool", 2024-09-16T03:25:54.619 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:25:54.619 INFO:tasks.workunit.client.0.smithi096.stderr: "size": 3, 2024-09-16T03:25:54.619 INFO:tasks.workunit.client.0.smithi096.stderr: "min_size": 2, 2024-09-16T03:25:54.619 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_rule": 0, 2024-09-16T03:25:54.619 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_count": 0, 2024-09-16T03:25:54.619 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_target": 0, 2024-09-16T03:25:54.620 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_barrier": 0, 2024-09-16T03:25:54.620 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-16T03:25:54.620 INFO:tasks.workunit.client.0.smithi096.stderr: "is_stretch_pool": false, 2024-09-16T03:25:54.620 INFO:tasks.workunit.client.0.smithi096.stderr: "object_hash": 2, 2024-09-16T03:25:54.620 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_autoscale_mode": "off", 2024-09-16T03:25:54.620 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num": 32, 2024-09-16T03:25:54.620 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num": 32, 2024-09-16T03:25:54.620 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num_target": 32, 2024-09-16T03:25:54.620 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_target": 32, 2024-09-16T03:25:54.620 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_pending": 32, 2024-09-16T03:25:54.620 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pg_merge_meta": { 2024-09-16T03:25:54.621 INFO:tasks.workunit.client.0.smithi096.stderr: "source_pgid": "0.0", 2024-09-16T03:25:54.621 INFO:tasks.workunit.client.0.smithi096.stderr: "ready_epoch": 0, 2024-09-16T03:25:54.621 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_started": 0, 2024-09-16T03:25:54.621 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": 0, 2024-09-16T03:25:54.621 INFO:tasks.workunit.client.0.smithi096.stderr: "source_version": "0'\''0", 2024-09-16T03:25:54.621 INFO:tasks.workunit.client.0.smithi096.stderr: "target_version": "0'\''0" 2024-09-16T03:25:54.621 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.621 INFO:tasks.workunit.client.0.smithi096.stderr: "last_change": "30", 2024-09-16T03:25:54.621 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend": "0", 2024-09-16T03:25:54.621 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_prenautilus": "0", 2024-09-16T03:25:54.621 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_preluminous": "0", 2024-09-16T03:25:54.621 INFO:tasks.workunit.client.0.smithi096.stderr: "auid": 0, 2024-09-16T03:25:54.621 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_mode": "selfmanaged", 2024-09-16T03:25:54.622 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_seq": 0, 2024-09-16T03:25:54.622 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_epoch": 0, 2024-09-16T03:25:54.622 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_snaps": [], 2024-09-16T03:25:54.622 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps": "[]", 2024-09-16T03:25:54.622 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_bytes": 0, 2024-09-16T03:25:54.622 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_objects": 0, 2024-09-16T03:25:54.622 INFO:tasks.workunit.client.0.smithi096.stderr: "tiers": [], 2024-09-16T03:25:54.622 INFO:tasks.workunit.client.0.smithi096.stderr: "tier_of": -1, 2024-09-16T03:25:54.622 INFO:tasks.workunit.client.0.smithi096.stderr: "read_tier": -1, 2024-09-16T03:25:54.622 INFO:tasks.workunit.client.0.smithi096.stderr: "write_tier": -1, 2024-09-16T03:25:54.622 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_mode": "none", 2024-09-16T03:25:54.622 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_bytes": 0, 2024-09-16T03:25:54.623 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_objects": 0, 2024-09-16T03:25:54.623 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_ratio_micro": 400000, 2024-09-16T03:25:54.623 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-16T03:25:54.623 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_full_ratio_micro": 800000, 2024-09-16T03:25:54.623 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_flush_age": 0, 2024-09-16T03:25:54.623 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_evict_age": 0, 2024-09-16T03:25:54.623 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profile": "", 2024-09-16T03:25:54.623 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_params": { 2024-09-16T03:25:54.623 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "none" 2024-09-16T03:25:54.623 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.623 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_period": 0, 2024-09-16T03:25:54.623 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_count": 0, 2024-09-16T03:25:54.624 INFO:tasks.workunit.client.0.smithi096.stderr: "use_gmt_hitset": true, 2024-09-16T03:25:54.624 INFO:tasks.workunit.client.0.smithi096.stderr: "min_read_recency_for_promote": 0, 2024-09-16T03:25:54.624 INFO:tasks.workunit.client.0.smithi096.stderr: "min_write_recency_for_promote": 0, 2024-09-16T03:25:54.624 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_grade_decay_rate": 0, 2024-09-16T03:25:54.624 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_search_last_n": 0, 2024-09-16T03:25:54.624 INFO:tasks.workunit.client.0.smithi096.stderr: "grade_table": [], 2024-09-16T03:25:54.624 INFO:tasks.workunit.client.0.smithi096.stderr: "stripe_width": 0, 2024-09-16T03:25:54.624 INFO:tasks.workunit.client.0.smithi096.stderr: "expected_num_objects": 0, 2024-09-16T03:25:54.624 INFO:tasks.workunit.client.0.smithi096.stderr: "fast_read": false, 2024-09-16T03:25:54.624 INFO:tasks.workunit.client.0.smithi096.stderr: "options": {}, 2024-09-16T03:25:54.624 INFO:tasks.workunit.client.0.smithi096.stderr: "application_metadata": {}, 2024-09-16T03:25:54.625 INFO:tasks.workunit.client.0.smithi096.stderr: "read_balance": { 2024-09-16T03:25:54.625 INFO:tasks.workunit.client.0.smithi096.stderr: "score_type": "Fair distribution", 2024-09-16T03:25:54.625 INFO:tasks.workunit.client.0.smithi096.stderr: "score_acting": 1.8700000047683716, 2024-09-16T03:25:54.625 INFO:tasks.workunit.client.0.smithi096.stderr: "score_stable": 1.8700000047683716, 2024-09-16T03:25:54.625 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_score": 0.67000001668930054, 2024-09-16T03:25:54.625 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_acting": 1.25, 2024-09-16T03:25:54.625 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_stable": 1.25, 2024-09-16T03:25:54.625 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity_weighted": 1, 2024-09-16T03:25:54.625 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity": 1, 2024-09-16T03:25:54.625 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity_weighted": 1 2024-09-16T03:25:54.625 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:54.625 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.626 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:54.626 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 2, 2024-09-16T03:25:54.626 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_name": "bar", 2024-09-16T03:25:54.626 INFO:tasks.workunit.client.0.smithi096.stderr: "create_time": "2024-09-16T03:24:46.226575+0000", 2024-09-16T03:25:54.626 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": 1, 2024-09-16T03:25:54.626 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_names": "hashpspool", 2024-09-16T03:25:54.626 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:25:54.626 INFO:tasks.workunit.client.0.smithi096.stderr: "size": 3, 2024-09-16T03:25:54.626 INFO:tasks.workunit.client.0.smithi096.stderr: "min_size": 2, 2024-09-16T03:25:54.626 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_rule": 0, 2024-09-16T03:25:54.626 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_count": 0, 2024-09-16T03:25:54.626 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_target": 0, 2024-09-16T03:25:54.626 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_barrier": 0, 2024-09-16T03:25:54.627 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-16T03:25:54.627 INFO:tasks.workunit.client.0.smithi096.stderr: "is_stretch_pool": false, 2024-09-16T03:25:54.627 INFO:tasks.workunit.client.0.smithi096.stderr: "object_hash": 2, 2024-09-16T03:25:54.627 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_autoscale_mode": "off", 2024-09-16T03:25:54.627 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num": 32, 2024-09-16T03:25:54.627 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num": 32, 2024-09-16T03:25:54.627 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num_target": 32, 2024-09-16T03:25:54.627 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_target": 32, 2024-09-16T03:25:54.627 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_pending": 32, 2024-09-16T03:25:54.627 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pg_merge_meta": { 2024-09-16T03:25:54.627 INFO:tasks.workunit.client.0.smithi096.stderr: "source_pgid": "0.0", 2024-09-16T03:25:54.627 INFO:tasks.workunit.client.0.smithi096.stderr: "ready_epoch": 0, 2024-09-16T03:25:54.628 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_started": 0, 2024-09-16T03:25:54.628 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": 0, 2024-09-16T03:25:54.628 INFO:tasks.workunit.client.0.smithi096.stderr: "source_version": "0'\''0", 2024-09-16T03:25:54.628 INFO:tasks.workunit.client.0.smithi096.stderr: "target_version": "0'\''0" 2024-09-16T03:25:54.628 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.628 INFO:tasks.workunit.client.0.smithi096.stderr: "last_change": "32", 2024-09-16T03:25:54.628 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend": "0", 2024-09-16T03:25:54.628 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_prenautilus": "0", 2024-09-16T03:25:54.628 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_preluminous": "0", 2024-09-16T03:25:54.628 INFO:tasks.workunit.client.0.smithi096.stderr: "auid": 0, 2024-09-16T03:25:54.628 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_mode": "selfmanaged", 2024-09-16T03:25:54.629 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_seq": 0, 2024-09-16T03:25:54.629 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_epoch": 0, 2024-09-16T03:25:54.629 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_snaps": [], 2024-09-16T03:25:54.629 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps": "[]", 2024-09-16T03:25:54.629 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_bytes": 0, 2024-09-16T03:25:54.629 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_objects": 0, 2024-09-16T03:25:54.629 INFO:tasks.workunit.client.0.smithi096.stderr: "tiers": [], 2024-09-16T03:25:54.629 INFO:tasks.workunit.client.0.smithi096.stderr: "tier_of": -1, 2024-09-16T03:25:54.629 INFO:tasks.workunit.client.0.smithi096.stderr: "read_tier": -1, 2024-09-16T03:25:54.629 INFO:tasks.workunit.client.0.smithi096.stderr: "write_tier": -1, 2024-09-16T03:25:54.629 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_mode": "none", 2024-09-16T03:25:54.629 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_bytes": 0, 2024-09-16T03:25:54.630 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_objects": 0, 2024-09-16T03:25:54.630 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_ratio_micro": 400000, 2024-09-16T03:25:54.630 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-16T03:25:54.630 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_full_ratio_micro": 800000, 2024-09-16T03:25:54.630 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_flush_age": 0, 2024-09-16T03:25:54.630 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_evict_age": 0, 2024-09-16T03:25:54.630 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profile": "", 2024-09-16T03:25:54.630 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_params": { 2024-09-16T03:25:54.630 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "none" 2024-09-16T03:25:54.630 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.630 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_period": 0, 2024-09-16T03:25:54.630 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_count": 0, 2024-09-16T03:25:54.630 INFO:tasks.workunit.client.0.smithi096.stderr: "use_gmt_hitset": true, 2024-09-16T03:25:54.631 INFO:tasks.workunit.client.0.smithi096.stderr: "min_read_recency_for_promote": 0, 2024-09-16T03:25:54.631 INFO:tasks.workunit.client.0.smithi096.stderr: "min_write_recency_for_promote": 0, 2024-09-16T03:25:54.631 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_grade_decay_rate": 0, 2024-09-16T03:25:54.631 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_search_last_n": 0, 2024-09-16T03:25:54.631 INFO:tasks.workunit.client.0.smithi096.stderr: "grade_table": [], 2024-09-16T03:25:54.631 INFO:tasks.workunit.client.0.smithi096.stderr: "stripe_width": 0, 2024-09-16T03:25:54.631 INFO:tasks.workunit.client.0.smithi096.stderr: "expected_num_objects": 0, 2024-09-16T03:25:54.631 INFO:tasks.workunit.client.0.smithi096.stderr: "fast_read": false, 2024-09-16T03:25:54.631 INFO:tasks.workunit.client.0.smithi096.stderr: "options": {}, 2024-09-16T03:25:54.631 INFO:tasks.workunit.client.0.smithi096.stderr: "application_metadata": {}, 2024-09-16T03:25:54.631 INFO:tasks.workunit.client.0.smithi096.stderr: "read_balance": { 2024-09-16T03:25:54.631 INFO:tasks.workunit.client.0.smithi096.stderr: "score_type": "Fair distribution", 2024-09-16T03:25:54.632 INFO:tasks.workunit.client.0.smithi096.stderr: "score_acting": 1.4900000095367432, 2024-09-16T03:25:54.632 INFO:tasks.workunit.client.0.smithi096.stderr: "score_stable": 1.4900000095367432, 2024-09-16T03:25:54.632 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_score": 0.67000001668930054, 2024-09-16T03:25:54.632 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_acting": 1, 2024-09-16T03:25:54.632 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_stable": 1, 2024-09-16T03:25:54.632 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity_weighted": 1, 2024-09-16T03:25:54.632 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity": 1, 2024-09-16T03:25:54.632 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity_weighted": 1 2024-09-16T03:25:54.632 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:54.632 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:54.632 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:54.632 INFO:tasks.workunit.client.0.smithi096.stderr: "osds": [ 2024-09-16T03:25:54.633 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:54.633 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:25:54.633 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6", 2024-09-16T03:25:54.633 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:25:54.633 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:25:54.633 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:25:54.633 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:25:54.633 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:25:54.633 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:25:54.633 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 5, 2024-09-16T03:25:54.633 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 33, 2024-09-16T03:25:54.633 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:25:54.633 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:25:54.633 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:25:54.634 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:54.634 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:54.634 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:54.634 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6802", 2024-09-16T03:25:54.634 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:54.634 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.634 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:54.634 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:54.634 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6803", 2024-09-16T03:25:54.634 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:54.634 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:54.635 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:54.635 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.635 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:25:54.635 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:54.635 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:54.635 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:54.635 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6804", 2024-09-16T03:25:54.635 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:54.635 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.635 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:54.635 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:54.635 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6805", 2024-09-16T03:25:54.635 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:54.636 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:54.636 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:54.636 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.636 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:25:54.636 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:54.636 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:54.636 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:54.636 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6808", 2024-09-16T03:25:54.636 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:54.636 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.636 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:54.636 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:54.636 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6809", 2024-09-16T03:25:54.636 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:54.637 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:54.637 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:54.637 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.637 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:25:54.637 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:54.637 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:54.637 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:54.637 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6806", 2024-09-16T03:25:54.637 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:54.637 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.637 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:54.637 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:54.637 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6807", 2024-09-16T03:25:54.637 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:54.637 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:54.638 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:54.638 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.638 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6803/3375787448", 2024-09-16T03:25:54.638 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6805/3375787448", 2024-09-16T03:25:54.638 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6809/3375787448", 2024-09-16T03:25:54.638 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6807/3375787448", 2024-09-16T03:25:54.638 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:25:54.638 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:25:54.638 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:25:54.638 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:54.638 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.638 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:54.638 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:25:54.638 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "74b26727-75c9-444d-8782-719e4197a382", 2024-09-16T03:25:54.638 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:25:54.639 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:25:54.639 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:25:54.639 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:25:54.639 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:25:54.639 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:25:54.639 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 10, 2024-09-16T03:25:54.639 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 33, 2024-09-16T03:25:54.639 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:25:54.639 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:25:54.639 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:25:54.639 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:54.639 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:54.639 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:54.639 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6810", 2024-09-16T03:25:54.640 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:54.640 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.640 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:54.640 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:54.640 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6811", 2024-09-16T03:25:54.640 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:54.640 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:54.640 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:54.640 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.640 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:25:54.640 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:54.640 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:54.640 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:54.640 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6812", 2024-09-16T03:25:54.641 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:54.641 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.641 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:54.641 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:54.641 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6813", 2024-09-16T03:25:54.641 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:54.641 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:54.641 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:54.641 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.641 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:25:54.641 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:54.641 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:54.642 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:54.642 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6816", 2024-09-16T03:25:54.642 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:54.642 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.642 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:54.642 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:54.642 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6817", 2024-09-16T03:25:54.642 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:54.642 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:54.642 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:54.642 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.642 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:25:54.643 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:54.643 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:54.643 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:54.643 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6814", 2024-09-16T03:25:54.643 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:54.643 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.643 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:54.643 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:54.643 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6815", 2024-09-16T03:25:54.643 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:54.643 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:54.643 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:54.644 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.644 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6811/3733255132", 2024-09-16T03:25:54.644 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6813/3733255132", 2024-09-16T03:25:54.644 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6817/3733255132", 2024-09-16T03:25:54.644 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6815/3733255132", 2024-09-16T03:25:54.644 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:25:54.644 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:25:54.644 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:25:54.644 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:54.644 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.644 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:54.644 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:25:54.644 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "143da3a7-dad9-4b1e-966b-76cf5bdd3c82", 2024-09-16T03:25:54.645 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 0, 2024-09-16T03:25:54.645 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 0, 2024-09-16T03:25:54.645 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 0, 2024-09-16T03:25:54.645 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:25:54.645 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:25:54.645 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:25:54.645 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 15, 2024-09-16T03:25:54.645 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 21, 2024-09-16T03:25:54.645 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 33, 2024-09-16T03:25:54.645 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:25:54.645 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:25:54.645 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:54.645 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:54.646 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:54.646 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6818", 2024-09-16T03:25:54.646 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:54.646 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.646 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:54.646 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:54.646 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6819", 2024-09-16T03:25:54.646 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:54.646 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:54.646 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:54.646 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.647 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:25:54.647 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:54.647 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:54.647 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:54.647 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6820", 2024-09-16T03:25:54.647 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:54.647 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.647 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:54.647 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:54.647 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6821", 2024-09-16T03:25:54.647 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:54.647 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:54.647 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:54.648 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.648 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:25:54.648 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:54.648 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:54.648 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:54.648 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6824", 2024-09-16T03:25:54.648 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:54.648 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.648 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:54.648 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:54.648 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6825", 2024-09-16T03:25:54.648 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:54.649 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:54.649 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:54.649 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.649 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:25:54.649 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:54.649 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:54.649 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:54.649 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6822", 2024-09-16T03:25:54.649 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:54.649 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.649 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:54.649 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:54.649 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6823", 2024-09-16T03:25:54.650 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:54.650 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:54.650 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:54.650 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.650 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6819/963814857", 2024-09-16T03:25:54.650 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6821/963814857", 2024-09-16T03:25:54.650 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6825/963814857", 2024-09-16T03:25:54.650 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6823/963814857", 2024-09-16T03:25:54.650 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:25:54.650 INFO:tasks.workunit.client.0.smithi096.stderr: "exists" 2024-09-16T03:25:54.650 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:54.650 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:54.650 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:54.651 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_xinfo": [ 2024-09-16T03:25:54.651 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:54.651 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:25:54.651 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:25:54.651 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:25:54.651 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:25:54.651 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:25:54.651 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:25:54.651 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:23:22.481942+0000", 2024-09-16T03:25:54.651 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:25:54.651 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.651 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:54.652 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:25:54.652 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:25:54.652 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:25:54.652 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:25:54.652 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:25:54.652 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:25:54.652 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:23:59.663703+0000", 2024-09-16T03:25:54.652 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:25:54.652 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.652 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:54.652 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:25:54.652 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:25:54.652 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:25:54.653 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:25:54.653 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:25:54.653 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 65536, 2024-09-16T03:25:54.653 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:24:37.320822+0000", 2024-09-16T03:25:54.653 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 32 2024-09-16T03:25:54.653 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:54.653 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:54.653 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap": [], 2024-09-16T03:25:54.653 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap_items": [], 2024-09-16T03:25:54.653 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap_primaries": [], 2024-09-16T03:25:54.653 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_temp": [], 2024-09-16T03:25:54.653 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_temp": [], 2024-09-16T03:25:54.654 INFO:tasks.workunit.client.0.smithi096.stderr: "blocklist": {}, 2024-09-16T03:25:54.654 INFO:tasks.workunit.client.0.smithi096.stderr: "range_blocklist": {}, 2024-09-16T03:25:54.654 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profiles": { 2024-09-16T03:25:54.654 INFO:tasks.workunit.client.0.smithi096.stderr: "default": { 2024-09-16T03:25:54.654 INFO:tasks.workunit.client.0.smithi096.stderr: "k": "2", 2024-09-16T03:25:54.654 INFO:tasks.workunit.client.0.smithi096.stderr: "m": "2", 2024-09-16T03:25:54.654 INFO:tasks.workunit.client.0.smithi096.stderr: "plugin": "jerasure", 2024-09-16T03:25:54.654 INFO:tasks.workunit.client.0.smithi096.stderr: "technique": "reed_sol_van" 2024-09-16T03:25:54.654 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:54.654 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.654 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps_queue": [], 2024-09-16T03:25:54.654 INFO:tasks.workunit.client.0.smithi096.stderr: "new_removed_snaps": [], 2024-09-16T03:25:54.654 INFO:tasks.workunit.client.0.smithi096.stderr: "new_purged_snaps": [], 2024-09-16T03:25:54.655 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_node_flags": {}, 2024-09-16T03:25:54.655 INFO:tasks.workunit.client.0.smithi096.stderr: "device_class_flags": {}, 2024-09-16T03:25:54.655 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode": { 2024-09-16T03:25:54.655 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode_enabled": false, 2024-09-16T03:25:54.655 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_bucket_count": 0, 2024-09-16T03:25:54.655 INFO:tasks.workunit.client.0.smithi096.stderr: "degraded_stretch_mode": 0, 2024-09-16T03:25:54.655 INFO:tasks.workunit.client.0.smithi096.stderr: "recovering_stretch_mode": 0, 2024-09-16T03:25:54.655 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode_bucket": 0 2024-09-16T03:25:54.655 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:54.655 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.655 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_metadata": [ 2024-09-16T03:25:54.655 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:54.655 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:25:54.656 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:25:54.656 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]", 2024-09-16T03:25:54.656 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:25:54.656 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:25:54.656 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:25:54.656 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:25:54.656 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:25:54.656 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:25:54.656 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:25:54.656 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:25:54.656 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:25:54.656 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:25:54.656 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:25:54.657 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/0/block", 2024-09-16T03:25:54.657 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:25:54.657 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:25:54.657 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:25:54.657 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:25:54.657 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:25:54.657 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:25:54.657 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:25:54.657 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:25:54.657 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:25:54.657 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:25:54.657 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:22:53.662571Z", 2024-09-16T03:25:54.657 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:25:54.658 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:25:54.658 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:25:54.658 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:25:54.658 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:25:54.658 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:25:54.658 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:25:54.658 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]", 2024-09-16T03:25:54.658 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:25:54.658 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]", 2024-09-16T03:25:54.658 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]", 2024-09-16T03:25:54.658 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:25:54.658 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:25:54.658 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:25:54.659 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:25:54.659 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:25:54.659 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:25:54.659 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:25:54.659 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:25:54.659 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:25:54.659 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/0", 2024-09-16T03:25:54.659 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:25:54.659 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:25:54.659 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:25:54.659 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.659 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:54.659 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:25:54.660 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:25:54.660 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]", 2024-09-16T03:25:54.660 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:25:54.660 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:25:54.660 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:25:54.660 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:25:54.660 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:25:54.660 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:25:54.660 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:25:54.660 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:25:54.660 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:25:54.661 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:25:54.661 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:25:54.661 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/1/block", 2024-09-16T03:25:54.661 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:25:54.661 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:25:54.661 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:25:54.661 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:25:54.661 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:25:54.661 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:25:54.661 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:25:54.661 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:25:54.661 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:25:54.661 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:25:54.661 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:23:30.129885Z", 2024-09-16T03:25:54.662 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:25:54.662 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:25:54.662 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:25:54.662 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:25:54.662 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:25:54.662 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:25:54.662 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:25:54.662 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]", 2024-09-16T03:25:54.662 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:25:54.662 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]", 2024-09-16T03:25:54.663 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]", 2024-09-16T03:25:54.663 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:25:54.663 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:25:54.663 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:25:54.663 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:25:54.663 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:25:54.663 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:25:54.663 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:25:54.663 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:25:54.663 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:25:54.663 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/1", 2024-09-16T03:25:54.663 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:25:54.663 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:25:54.664 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:25:54.664 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.664 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:54.664 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:25:54.664 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:25:54.664 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]", 2024-09-16T03:25:54.664 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:25:54.664 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:25:54.664 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:25:54.664 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:25:54.664 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:25:54.664 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:25:54.664 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:25:54.664 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:25:54.665 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:25:54.665 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:25:54.665 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:25:54.665 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/2/block", 2024-09-16T03:25:54.665 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:25:54.665 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:25:54.665 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:25:54.665 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:25:54.665 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:25:54.665 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:25:54.665 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:25:54.665 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:25:54.665 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:25:54.666 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:25:54.666 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:24:07.764502Z", 2024-09-16T03:25:54.666 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:25:54.666 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:25:54.666 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:25:54.666 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:25:54.666 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:25:54.666 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:25:54.666 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:25:54.666 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]", 2024-09-16T03:25:54.666 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:25:54.666 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]", 2024-09-16T03:25:54.666 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]", 2024-09-16T03:25:54.666 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:25:54.667 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:25:54.667 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:25:54.667 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:25:54.667 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:25:54.667 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:25:54.667 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:25:54.667 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:25:54.667 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:25:54.667 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/2", 2024-09-16T03:25:54.667 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:25:54.667 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:25:54.667 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:25:54.667 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:54.668 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:54.668 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_clean_epochs": { 2024-09-16T03:25:54.668 INFO:tasks.workunit.client.0.smithi096.stderr: "min_last_epoch_clean": 28, 2024-09-16T03:25:54.668 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": { 2024-09-16T03:25:54.668 INFO:tasks.workunit.client.0.smithi096.stderr: "per_pool": [ 2024-09-16T03:25:54.668 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:54.668 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 1, 2024-09-16T03:25:54.668 INFO:tasks.workunit.client.0.smithi096.stderr: "floor": 28 2024-09-16T03:25:54.668 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.668 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:54.668 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 2, 2024-09-16T03:25:54.668 INFO:tasks.workunit.client.0.smithi096.stderr: "floor": 28 2024-09-16T03:25:54.668 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:54.669 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:54.669 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.669 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_epochs": [ 2024-09-16T03:25:54.669 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:54.669 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:25:54.669 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 78 2024-09-16T03:25:54.669 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.669 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:54.669 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:25:54.669 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 68 2024-09-16T03:25:54.669 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:54.670 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:54.670 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.670 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_first_committed": 28, 2024-09-16T03:25:54.670 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_last_committed": 80, 2024-09-16T03:25:54.670 INFO:tasks.workunit.client.0.smithi096.stderr: "crushmap": { 2024-09-16T03:25:54.670 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": [ 2024-09-16T03:25:54.670 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:54.670 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:25:54.670 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.0", 2024-09-16T03:25:54.670 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:25:54.670 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.670 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:54.671 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:25:54.671 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.1", 2024-09-16T03:25:54.671 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:25:54.671 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.671 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:54.671 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:25:54.671 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.2", 2024-09-16T03:25:54.671 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:25:54.671 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:54.671 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:54.671 INFO:tasks.workunit.client.0.smithi096.stderr: "types": [ 2024-09-16T03:25:54.671 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:54.671 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 0, 2024-09-16T03:25:54.671 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd" 2024-09-16T03:25:54.672 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.672 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:54.672 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:25:54.672 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "host" 2024-09-16T03:25:54.672 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.672 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:54.672 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 2, 2024-09-16T03:25:54.672 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "chassis" 2024-09-16T03:25:54.672 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.672 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:54.672 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 3, 2024-09-16T03:25:54.672 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "rack" 2024-09-16T03:25:54.673 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.673 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:54.673 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 4, 2024-09-16T03:25:54.673 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "row" 2024-09-16T03:25:54.673 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.673 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:54.673 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 5, 2024-09-16T03:25:54.673 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "pdu" 2024-09-16T03:25:54.673 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.673 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:54.673 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 6, 2024-09-16T03:25:54.673 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "pod" 2024-09-16T03:25:54.673 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.673 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:54.674 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 7, 2024-09-16T03:25:54.674 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "room" 2024-09-16T03:25:54.674 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.674 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:54.674 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 8, 2024-09-16T03:25:54.674 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "datacenter" 2024-09-16T03:25:54.674 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.674 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:54.674 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 9, 2024-09-16T03:25:54.674 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "zone" 2024-09-16T03:25:54.674 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.674 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:54.674 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 10, 2024-09-16T03:25:54.674 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "region" 2024-09-16T03:25:54.675 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.675 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:54.675 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:25:54.675 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "root" 2024-09-16T03:25:54.675 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:54.675 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:54.675 INFO:tasks.workunit.client.0.smithi096.stderr: "buckets": [ 2024-09-16T03:25:54.675 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:54.675 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -1, 2024-09-16T03:25:54.675 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "default", 2024-09-16T03:25:54.675 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:25:54.675 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "root", 2024-09-16T03:25:54.675 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:25:54.676 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:25:54.676 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:25:54.676 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:25:54.676 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:54.676 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -3, 2024-09-16T03:25:54.676 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:25:54.676 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:25:54.676 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:54.676 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:54.676 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.676 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:54.676 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -2, 2024-09-16T03:25:54.677 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "default~hdd", 2024-09-16T03:25:54.677 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:25:54.677 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "root", 2024-09-16T03:25:54.677 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:25:54.677 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:25:54.677 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:25:54.677 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:25:54.677 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:54.677 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -4, 2024-09-16T03:25:54.677 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:25:54.677 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:25:54.677 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:54.677 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:54.678 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.678 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:54.678 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -3, 2024-09-16T03:25:54.678 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "smithi096", 2024-09-16T03:25:54.678 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:25:54.678 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "host", 2024-09-16T03:25:54.678 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:25:54.678 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:25:54.678 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:25:54.678 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:25:54.678 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:54.678 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:25:54.678 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:25:54.679 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:25:54.679 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.679 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:54.679 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:25:54.679 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:25:54.679 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 1 2024-09-16T03:25:54.679 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.679 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:54.679 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:25:54.679 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:25:54.679 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 2 2024-09-16T03:25:54.679 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:54.679 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:54.679 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.680 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:54.680 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -4, 2024-09-16T03:25:54.680 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "smithi096~hdd", 2024-09-16T03:25:54.680 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:25:54.680 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "host", 2024-09-16T03:25:54.680 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:25:54.680 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:25:54.680 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:25:54.680 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:25:54.680 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:54.680 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:25:54.680 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:25:54.680 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:25:54.680 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.680 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:54.681 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:25:54.681 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:25:54.681 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 1 2024-09-16T03:25:54.681 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.681 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:54.681 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:25:54.681 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:25:54.681 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 2 2024-09-16T03:25:54.681 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:54.681 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:54.681 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:54.681 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:54.681 INFO:tasks.workunit.client.0.smithi096.stderr: "rules": [ 2024-09-16T03:25:54.682 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:54.682 INFO:tasks.workunit.client.0.smithi096.stderr: "rule_id": 0, 2024-09-16T03:25:54.682 INFO:tasks.workunit.client.0.smithi096.stderr: "rule_name": "replicated_rule", 2024-09-16T03:25:54.682 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:25:54.682 INFO:tasks.workunit.client.0.smithi096.stderr: "steps": [ 2024-09-16T03:25:54.682 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:54.682 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "take", 2024-09-16T03:25:54.682 INFO:tasks.workunit.client.0.smithi096.stderr: "item": -1, 2024-09-16T03:25:54.682 INFO:tasks.workunit.client.0.smithi096.stderr: "item_name": "default" 2024-09-16T03:25:54.682 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.682 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:54.682 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "choose_firstn", 2024-09-16T03:25:54.682 INFO:tasks.workunit.client.0.smithi096.stderr: "num": 0, 2024-09-16T03:25:54.682 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "osd" 2024-09-16T03:25:54.683 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.683 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:54.683 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "emit" 2024-09-16T03:25:54.683 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:54.683 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:54.683 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:54.683 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:54.683 INFO:tasks.workunit.client.0.smithi096.stderr: "tunables": { 2024-09-16T03:25:54.683 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_local_tries": 0, 2024-09-16T03:25:54.683 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_local_fallback_tries": 0, 2024-09-16T03:25:54.683 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_total_tries": 50, 2024-09-16T03:25:54.683 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_descend_once": 1, 2024-09-16T03:25:54.683 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_vary_r": 1, 2024-09-16T03:25:54.683 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_stable": 1, 2024-09-16T03:25:54.683 INFO:tasks.workunit.client.0.smithi096.stderr: "msr_descents": 100, 2024-09-16T03:25:54.684 INFO:tasks.workunit.client.0.smithi096.stderr: "msr_collision_tries": 100, 2024-09-16T03:25:54.684 INFO:tasks.workunit.client.0.smithi096.stderr: "straw_calc_version": 1, 2024-09-16T03:25:54.684 INFO:tasks.workunit.client.0.smithi096.stderr: "allowed_bucket_algs": 54, 2024-09-16T03:25:54.684 INFO:tasks.workunit.client.0.smithi096.stderr: "profile": "jewel", 2024-09-16T03:25:54.684 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_tunables": 1, 2024-09-16T03:25:54.684 INFO:tasks.workunit.client.0.smithi096.stderr: "legacy_tunables": 0, 2024-09-16T03:25:54.684 INFO:tasks.workunit.client.0.smithi096.stderr: "minimum_required_version": "jewel", 2024-09-16T03:25:54.684 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables": 1, 2024-09-16T03:25:54.684 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables2": 1, 2024-09-16T03:25:54.684 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v2_rules": 0, 2024-09-16T03:25:54.684 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables3": 1, 2024-09-16T03:25:54.684 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v3_rules": 0, 2024-09-16T03:25:54.684 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v4_buckets": 1, 2024-09-16T03:25:54.685 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables5": 1, 2024-09-16T03:25:54.685 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v5_rules": 0, 2024-09-16T03:25:54.685 INFO:tasks.workunit.client.0.smithi096.stderr: "has_msr_rules": 0 2024-09-16T03:25:54.685 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.685 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_args": {} 2024-09-16T03:25:54.685 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.685 INFO:tasks.workunit.client.0.smithi096.stderr: "fsmap": { 2024-09-16T03:25:54.685 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 1, 2024-09-16T03:25:54.685 INFO:tasks.workunit.client.0.smithi096.stderr: "btime": "2024-09-16T03:22:46:882186+0000", 2024-09-16T03:25:54.685 INFO:tasks.workunit.client.0.smithi096.stderr: "default_fscid": -1, 2024-09-16T03:25:54.686 INFO:tasks.workunit.client.0.smithi096.stderr: "compat": { 2024-09-16T03:25:54.686 INFO:tasks.workunit.client.0.smithi096.stderr: "compat": {}, 2024-09-16T03:25:54.686 INFO:tasks.workunit.client.0.smithi096.stderr: "ro_compat": {}, 2024-09-16T03:25:54.686 INFO:tasks.workunit.client.0.smithi096.stderr: "incompat": { 2024-09-16T03:25:54.686 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_1": "base v0.20", 2024-09-16T03:25:54.686 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_2": "client writeable ranges", 2024-09-16T03:25:54.686 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_3": "default file layouts on dirs", 2024-09-16T03:25:54.686 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_4": "dir inode in separate object", 2024-09-16T03:25:54.686 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_5": "mds uses versioned encoding", 2024-09-16T03:25:54.686 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_6": "dirfrag is stored in omap", 2024-09-16T03:25:54.686 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_8": "no anchor table", 2024-09-16T03:25:54.686 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_9": "file layout v2", 2024-09-16T03:25:54.686 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_10": "snaprealm v2", 2024-09-16T03:25:54.686 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_11": "minor log segments", 2024-09-16T03:25:54.686 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_12": "quiesce subvolumes" 2024-09-16T03:25:54.687 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:54.687 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.687 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_flags": { 2024-09-16T03:25:54.687 INFO:tasks.workunit.client.0.smithi096.stderr: "enable_multiple": true, 2024-09-16T03:25:54.687 INFO:tasks.workunit.client.0.smithi096.stderr: "ever_enabled_multiple": true 2024-09-16T03:25:54.687 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.687 INFO:tasks.workunit.client.0.smithi096.stderr: "standbys": [], 2024-09-16T03:25:54.687 INFO:tasks.workunit.client.0.smithi096.stderr: "filesystems": [] 2024-09-16T03:25:54.687 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.687 INFO:tasks.workunit.client.0.smithi096.stderr: "mdsmap_first_committed": 1, 2024-09-16T03:25:54.687 INFO:tasks.workunit.client.0.smithi096.stderr: "mdsmap_last_committed": 1, 2024-09-16T03:25:54.687 INFO:tasks.workunit.client.0.smithi096.stderr: "auth": { 2024-09-16T03:25:54.687 INFO:tasks.workunit.client.0.smithi096.stderr: "first_committed": 1, 2024-09-16T03:25:54.688 INFO:tasks.workunit.client.0.smithi096.stderr: "last_committed": 5, 2024-09-16T03:25:54.688 INFO:tasks.workunit.client.0.smithi096.stderr: "num_secrets": 3 2024-09-16T03:25:54.688 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.688 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 64, 2024-09-16T03:25:54.688 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_active": 64, 2024-09-16T03:25:54.688 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_unknown": 0, 2024-09-16T03:25:54.688 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osd": 3, 2024-09-16T03:25:54.688 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_sum": { 2024-09-16T03:25:54.688 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:25:54.688 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:25:54.688 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:25:54.688 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:25:54.689 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:25:54.689 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:25:54.689 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:25:54.689 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:25:54.689 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:25:54.689 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:25:54.689 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:25:54.689 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:25:54.689 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:25:54.689 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:25:54.689 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:25:54.689 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:25:54.689 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:25:54.689 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:25:54.690 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:25:54.690 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:25:54.690 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:25:54.690 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:25:54.690 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:25:54.690 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:25:54.690 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:25:54.690 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:25:54.690 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:25:54.691 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:25:54.691 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:25:54.691 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:25:54.691 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:25:54.691 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:25:54.691 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:25:54.691 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:25:54.691 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:25:54.691 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:25:54.691 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:25:54.691 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:25:54.691 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:25:54.691 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:25:54.691 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:25:54.692 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.692 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:25:54.692 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:25:54.692 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:25:54.692 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:25:54.692 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:25:54.692 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:25:54.692 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:25:54.692 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:25:54.692 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:25:54.692 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:25:54.692 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:25:54.692 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.693 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:25:54.693 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:25:54.693 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 128, 2024-09-16T03:25:54.693 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 128, 2024-09-16T03:25:54.693 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 0 2024-09-16T03:25:54.693 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.693 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_sum": { 2024-09-16T03:25:54.693 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 0, 2024-09-16T03:25:54.693 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 0, 2024-09-16T03:25:54.693 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pgs": 128, 2024-09-16T03:25:54.693 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osds": 2, 2024-09-16T03:25:54.693 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_osds": 2, 2024-09-16T03:25:54.693 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_omap_osds": 2, 2024-09-16T03:25:54.694 INFO:tasks.workunit.client.0.smithi096.stderr: "kb": 209715200, 2024-09-16T03:25:54.694 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used": 54568, 2024-09-16T03:25:54.694 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_data": 816, 2024-09-16T03:25:54.694 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_omap": 3, 2024-09-16T03:25:54.694 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_meta": 53628, 2024-09-16T03:25:54.694 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_avail": 209660632, 2024-09-16T03:25:54.694 INFO:tasks.workunit.client.0.smithi096.stderr: "statfs": { 2024-09-16T03:25:54.694 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 214748364800, 2024-09-16T03:25:54.694 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 214692487168, 2024-09-16T03:25:54.694 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:25:54.694 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 835584, 2024-09-16T03:25:54.694 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 312647, 2024-09-16T03:25:54.694 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:25:54.694 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:25:54.695 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:25:54.695 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 3190, 2024-09-16T03:25:54.695 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 54915978 2024-09-16T03:25:54.695 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.695 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_peers": [], 2024-09-16T03:25:54.695 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_trim_queue_len": 0, 2024-09-16T03:25:54.695 INFO:tasks.workunit.client.0.smithi096.stderr: "num_snap_trimming": 0, 2024-09-16T03:25:54.695 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shards_repaired": 0, 2024-09-16T03:25:54.695 INFO:tasks.workunit.client.0.smithi096.stderr: "op_queue_age_hist": { 2024-09-16T03:25:54.695 INFO:tasks.workunit.client.0.smithi096.stderr: "histogram": [], 2024-09-16T03:25:54.695 INFO:tasks.workunit.client.0.smithi096.stderr: "upper_bound": 1 2024-09-16T03:25:54.695 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.695 INFO:tasks.workunit.client.0.smithi096.stderr: "perf_stat": { 2024-09-16T03:25:54.695 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ms": 288, 2024-09-16T03:25:54.696 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ms": 288, 2024-09-16T03:25:54.696 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ns": 288000000, 2024-09-16T03:25:54.696 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ns": 288000000 2024-09-16T03:25:54.696 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.696 INFO:tasks.workunit.client.0.smithi096.stderr: "alerts": [], 2024-09-16T03:25:54.696 INFO:tasks.workunit.client.0.smithi096.stderr: "network_ping_times": [] 2024-09-16T03:25:54.696 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.696 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_sum_by_class": { 2024-09-16T03:25:54.696 INFO:tasks.workunit.client.0.smithi096.stderr: "hdd": { 2024-09-16T03:25:54.696 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 0, 2024-09-16T03:25:54.696 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 0, 2024-09-16T03:25:54.696 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pgs": 128, 2024-09-16T03:25:54.696 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osds": 2, 2024-09-16T03:25:54.696 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_osds": 2, 2024-09-16T03:25:54.696 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_omap_osds": 2, 2024-09-16T03:25:54.697 INFO:tasks.workunit.client.0.smithi096.stderr: "kb": 209715200, 2024-09-16T03:25:54.697 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used": 54568, 2024-09-16T03:25:54.697 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_data": 816, 2024-09-16T03:25:54.697 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_omap": 3, 2024-09-16T03:25:54.697 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_meta": 53628, 2024-09-16T03:25:54.697 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_avail": 209660632, 2024-09-16T03:25:54.697 INFO:tasks.workunit.client.0.smithi096.stderr: "statfs": { 2024-09-16T03:25:54.697 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 214748364800, 2024-09-16T03:25:54.697 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 214692487168, 2024-09-16T03:25:54.697 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:25:54.697 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 835584, 2024-09-16T03:25:54.697 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 312647, 2024-09-16T03:25:54.697 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:25:54.698 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:25:54.698 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:25:54.698 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 3190, 2024-09-16T03:25:54.698 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 54915978 2024-09-16T03:25:54.698 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.698 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_peers": [], 2024-09-16T03:25:54.698 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_trim_queue_len": 0, 2024-09-16T03:25:54.698 INFO:tasks.workunit.client.0.smithi096.stderr: "num_snap_trimming": 0, 2024-09-16T03:25:54.698 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shards_repaired": 0, 2024-09-16T03:25:54.698 INFO:tasks.workunit.client.0.smithi096.stderr: "op_queue_age_hist": { 2024-09-16T03:25:54.698 INFO:tasks.workunit.client.0.smithi096.stderr: "histogram": [], 2024-09-16T03:25:54.698 INFO:tasks.workunit.client.0.smithi096.stderr: "upper_bound": 1 2024-09-16T03:25:54.698 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.699 INFO:tasks.workunit.client.0.smithi096.stderr: "perf_stat": { 2024-09-16T03:25:54.699 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ms": 288, 2024-09-16T03:25:54.699 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ms": 288, 2024-09-16T03:25:54.699 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ns": 288000000, 2024-09-16T03:25:54.699 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ns": 288000000 2024-09-16T03:25:54.699 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.699 INFO:tasks.workunit.client.0.smithi096.stderr: "alerts": [], 2024-09-16T03:25:54.699 INFO:tasks.workunit.client.0.smithi096.stderr: "network_ping_times": [] 2024-09-16T03:25:54.699 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:54.699 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.699 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_stats": [ 2024-09-16T03:25:54.699 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:54.699 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 2, 2024-09-16T03:25:54.699 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 32, 2024-09-16T03:25:54.700 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:25:54.700 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:25:54.700 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:25:54.700 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:25:54.700 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:25:54.700 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:25:54.700 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:25:54.700 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:25:54.700 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:25:54.700 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:25:54.700 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:25:54.700 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:25:54.700 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:25:54.701 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:25:54.701 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:25:54.701 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:25:54.701 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:25:54.701 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:25:54.701 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:25:54.701 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:25:54.701 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:25:54.701 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:25:54.701 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:25:54.701 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:25:54.701 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:25:54.702 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:25:54.702 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:25:54.702 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:25:54.702 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:25:54.702 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:25:54.702 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:25:54.702 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:25:54.702 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:25:54.702 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:25:54.702 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:25:54.702 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:25:54.702 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:25:54.702 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:25:54.702 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:25:54.702 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:25:54.703 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:25:54.703 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.703 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:25:54.703 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:25:54.703 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:25:54.703 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:25:54.703 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:25:54.703 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:25:54.703 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:25:54.703 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:25:54.703 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:25:54.703 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:25:54.703 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:25:54.703 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.703 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:25:54.704 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:25:54.704 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 64, 2024-09-16T03:25:54.704 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 64, 2024-09-16T03:25:54.704 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 3 2024-09-16T03:25:54.704 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.704 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:54.704 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 1, 2024-09-16T03:25:54.704 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 32, 2024-09-16T03:25:54.704 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:25:54.704 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:25:54.704 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:25:54.704 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:25:54.704 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:25:54.704 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:25:54.705 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:25:54.705 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:25:54.705 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:25:54.705 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:25:54.705 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:25:54.705 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:25:54.705 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:25:54.705 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:25:54.705 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:25:54.705 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:25:54.705 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:25:54.705 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:25:54.706 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:25:54.706 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:25:54.706 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:25:54.706 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:25:54.706 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:25:54.706 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:25:54.706 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:25:54.706 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:25:54.706 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:25:54.706 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:25:54.706 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:25:54.706 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:25:54.706 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:25:54.706 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:25:54.706 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:25:54.707 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:25:54.707 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:25:54.707 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:25:54.707 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:25:54.707 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:25:54.707 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:25:54.707 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:25:54.707 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:25:54.707 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.707 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:25:54.707 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:25:54.707 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:25:54.707 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:25:54.708 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:25:54.708 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:25:54.708 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:25:54.708 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:25:54.708 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:25:54.708 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:25:54.708 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:25:54.708 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.708 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:25:54.708 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:25:54.708 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 64, 2024-09-16T03:25:54.708 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 64, 2024-09-16T03:25:54.709 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 3 2024-09-16T03:25:54.709 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:54.709 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:54.709 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_stats": [ 2024-09-16T03:25:54.709 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:54.709 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:25:54.709 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 21474836516 2024-09-16T03:25:54.709 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.709 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:54.709 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:25:54.709 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 42949672988 2024-09-16T03:25:54.709 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.710 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:54.710 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:25:54.710 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 0 2024-09-16T03:25:54.710 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:54.710 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:54.710 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_by_state": [ 2024-09-16T03:25:54.710 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:54.710 INFO:tasks.workunit.client.0.smithi096.stderr: "state": "active+undersized", 2024-09-16T03:25:54.710 INFO:tasks.workunit.client.0.smithi096.stderr: "num": 64 2024-09-16T03:25:54.710 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:54.710 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:54.710 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_by_osd": [ 2024-09-16T03:25:54.710 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:54.711 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:25:54.711 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 0, 2024-09-16T03:25:54.711 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 0, 2024-09-16T03:25:54.711 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:25:54.711 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.711 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:54.711 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:25:54.711 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 28, 2024-09-16T03:25:54.711 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 64, 2024-09-16T03:25:54.711 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:25:54.711 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.712 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:54.712 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:25:54.712 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 36, 2024-09-16T03:25:54.712 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 64, 2024-09-16T03:25:54.712 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:25:54.712 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:54.712 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:54.712 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": [ 2024-09-16T03:25:54.712 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:54.712 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 1, 2024-09-16T03:25:54.712 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": {} 2024-09-16T03:25:54.712 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.713 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:54.713 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 2, 2024-09-16T03:25:54.713 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": {} 2024-09-16T03:25:54.713 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:54.713 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:54.713 INFO:tasks.workunit.client.0.smithi096.stderr: "servicemap": { 2024-09-16T03:25:54.713 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 5, 2024-09-16T03:25:54.713 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:25:38.422788+0000", 2024-09-16T03:25:54.713 INFO:tasks.workunit.client.0.smithi096.stderr: "services": {} 2024-09-16T03:25:54.713 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:54.713 INFO:tasks.workunit.client.0.smithi096.stderr: "mgrstat_first_committed": 77, 2024-09-16T03:25:54.713 INFO:tasks.workunit.client.0.smithi096.stderr: "mgrstat_last_committed": 82, 2024-09-16T03:25:54.713 INFO:tasks.workunit.client.0.smithi096.stderr: "logm_first_committed": 1, 2024-09-16T03:25:54.713 INFO:tasks.workunit.client.0.smithi096.stderr: "logm_last_committed": 358, 2024-09-16T03:25:54.714 INFO:tasks.workunit.client.0.smithi096.stderr: "paxos": { 2024-09-16T03:25:54.714 INFO:tasks.workunit.client.0.smithi096.stderr: "first_committed": 1, 2024-09-16T03:25:54.714 INFO:tasks.workunit.client.0.smithi096.stderr: "last_committed": 536, 2024-09-16T03:25:54.714 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pn": 0, 2024-09-16T03:25:54.714 INFO:tasks.workunit.client.0.smithi096.stderr: "accepted_pn": 0 2024-09-16T03:25:54.714 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:54.714 INFO:tasks.workunit.client.0.smithi096.stderr:}' 2024-09-16T03:25:54.717 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:132: get_fc_lc_diff: jq .osdmap_first_committed 2024-09-16T03:25:54.717 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:132: get_fc_lc_diff: echo '{' '"cluster_fingerprint":' '"fda2fc64-07ed-4add-8224-2e527e11d427",' '"version":' '"19.3.0-4930-gfc3e0bff",' '"commit":' '"fc3e0bff7468fd55478adbae7f75508b749124b6",' '"timestamp":' '"2024-09-16T03:25:54.589189+0000",' '"tag":' '"",' '"health":' '{' '"status":' '"HEALTH_OK",' '"checks":' '{},' '"mutes":' '[]' '},' '"monmap_first_committed":' 1, '"monmap_last_committed":' 1, '"monmap":' '{' '"epoch":' 1, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"modified":' '"2024-09-16T03:22:45.872880Z",' '"created":' '"2024-09-16T03:22:45.872880Z",' '"min_mon_release":' 19, '"min_mon_release_name":' '"squid",' '"election_strategy":' 1, '"disallowed_leaders:' '":' '"",' '"stretch_mode":' false, '"tiebreaker_mon":' '"",' '"removed_ranks:' '":' '"",' '"features":' '{' '"persistent":' '[' '"kraken",' '"luminous",' '"mimic",' '"osdmap-prune",' '"nautilus",' '"octopus",' '"pacific",' '"elector-pinging",' '"quincy",' '"reef",' '"squid"' '],' '"optional":' '[]' '},' '"mons":' '[' '{' '"rank":' 0, '"name":' '"a",' '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:7302",' '"nonce":' 0 '}' ']' '},' '"addr":' '"127.0.0.1:7302/0",' '"public_addr":' '"127.0.0.1:7302/0",' '"priority":' 0, '"weight":' 0, '"crush_location":' '"{}"' '}' ']' '},' '"quorum":' '[' 0 '],' '"osdmap":' '{' '"epoch":' 80, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"created":' '"2024-09-16T03:22:46.906117+0000",' '"modified":' '"2024-09-16T03:25:52.948673+0000",' '"last_up_change":' '"2024-09-16T03:25:08.513363+0000",' '"last_in_change":' '"2024-09-16T03:25:09.839444+0000",' '"flags":' '"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit",' '"flags_num":' 5799936, '"flags_set":' '[' '"pglog_hardlimit",' '"purged_snapdirs",' '"recovery_deletes",' '"sortbitwise"' '],' '"crush_version":' 7, '"full_ratio":' 0.97000002861022949, '"backfillfull_ratio":' 0.97000002861022949, '"nearfull_ratio":' 0.85000002384185791, '"cluster_snapshot":' '"",' '"pool_max":' 2, '"max_osd":' 3, '"require_min_compat_client":' '"luminous",' '"min_compat_client":' '"jewel",' '"require_osd_release":' '"squid",' '"allow_crimson":' false, '"pools":' '[' '{' '"pool":' 1, '"pool_name":' '"foo",' '"create_time":' '"2024-09-16T03:24:44.525189+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"30",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.8700000047683716, '"score_stable":' 1.8700000047683716, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1.25, '"raw_score_stable":' 1.25, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '},' '{' '"pool":' 2, '"pool_name":' '"bar",' '"create_time":' '"2024-09-16T03:24:46.226575+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"32",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.4900000095367432, '"score_stable":' 1.4900000095367432, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1, '"raw_score_stable":' 1, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '}' '],' '"osds":' '[' '{' '"osd":' 0, '"uuid":' '"64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 5, '"up_thru":' 33, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6802",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6803",' '"nonce":' 3375787448 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6804",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6805",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6808",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6809",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6806",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6807",' '"nonce":' 3375787448 '}' ']' '},' '"public_addr":' '"127.0.0.1:6803/3375787448",' '"cluster_addr":' '"127.0.0.1:6805/3375787448",' '"heartbeat_back_addr":' '"127.0.0.1:6809/3375787448",' '"heartbeat_front_addr":' '"127.0.0.1:6807/3375787448",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 1, '"uuid":' '"74b26727-75c9-444d-8782-719e4197a382",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 10, '"up_thru":' 33, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6810",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6811",' '"nonce":' 3733255132 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6812",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6813",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6816",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6817",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6814",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6815",' '"nonce":' 3733255132 '}' ']' '},' '"public_addr":' '"127.0.0.1:6811/3733255132",' '"cluster_addr":' '"127.0.0.1:6813/3733255132",' '"heartbeat_back_addr":' '"127.0.0.1:6817/3733255132",' '"heartbeat_front_addr":' '"127.0.0.1:6815/3733255132",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 2, '"uuid":' '"143da3a7-dad9-4b1e-966b-76cf5bdd3c82",' '"up":' 0, '"in":' 0, '"weight":' 0, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 15, '"up_thru":' 21, '"down_at":' 33, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6818",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6819",' '"nonce":' 963814857 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6820",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6821",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6824",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6825",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6822",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6823",' '"nonce":' 963814857 '}' ']' '},' '"public_addr":' '"127.0.0.1:6819/963814857",' '"cluster_addr":' '"127.0.0.1:6821/963814857",' '"heartbeat_back_addr":' '"127.0.0.1:6825/963814857",' '"heartbeat_front_addr":' '"127.0.0.1:6823/963814857",' '"state":' '[' '"exists"' ']' '}' '],' '"osd_xinfo":' '[' '{' '"osd":' 0, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:22.481942+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 1, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:59.663703+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 2, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 65536, '"last_purged_snaps_scrub":' '"2024-09-16T03:24:37.320822+0000",' '"dead_epoch":' 32 '}' '],' '"pg_upmap":' '[],' '"pg_upmap_items":' '[],' '"pg_upmap_primaries":' '[],' '"pg_temp":' '[],' '"primary_temp":' '[],' '"blocklist":' '{},' '"range_blocklist":' '{},' '"erasure_code_profiles":' '{' '"default":' '{' '"k":' '"2",' '"m":' '"2",' '"plugin":' '"jerasure",' '"technique":' '"reed_sol_van"' '}' '},' '"removed_snaps_queue":' '[],' '"new_removed_snaps":' '[],' '"new_purged_snaps":' '[],' '"crush_node_flags":' '{},' '"device_class_flags":' '{},' '"stretch_mode":' '{' '"stretch_mode_enabled":' false, '"stretch_bucket_count":' 0, '"degraded_stretch_mode":' 0, '"recovering_stretch_mode":' 0, '"stretch_mode_bucket":' 0 '}' '},' '"osd_metadata":' '[' '{' '"id":' 0, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/0/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:22:53.662571Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]",' '"hb_front_addr":' '"[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/0",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 1, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/1/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:23:30.129885Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]",' '"hb_front_addr":' '"[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/1",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 2, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/2/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:24:07.764502Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]",' '"hb_front_addr":' '"[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/2",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '}' '],' '"osdmap_clean_epochs":' '{' '"min_last_epoch_clean":' 28, '"last_epoch_clean":' '{' '"per_pool":' '[' '{' '"poolid":' 1, '"floor":' 28 '},' '{' '"poolid":' 2, '"floor":' 28 '}' ']' '},' '"osd_epochs":' '[' '{' '"id":' 0, '"epoch":' 78 '},' '{' '"id":' 1, '"epoch":' 68 '}' ']' '},' '"osdmap_first_committed":' 28, '"osdmap_last_committed":' 80, '"crushmap":' '{' '"devices":' '[' '{' '"id":' 0, '"name":' '"osd.0",' '"class":' '"hdd"' '},' '{' '"id":' 1, '"name":' '"osd.1",' '"class":' '"hdd"' '},' '{' '"id":' 2, '"name":' '"osd.2",' '"class":' '"hdd"' '}' '],' '"types":' '[' '{' '"type_id":' 0, '"name":' '"osd"' '},' '{' '"type_id":' 1, '"name":' '"host"' '},' '{' '"type_id":' 2, '"name":' '"chassis"' '},' '{' '"type_id":' 3, '"name":' '"rack"' '},' '{' '"type_id":' 4, '"name":' '"row"' '},' '{' '"type_id":' 5, '"name":' '"pdu"' '},' '{' '"type_id":' 6, '"name":' '"pod"' '},' '{' '"type_id":' 7, '"name":' '"room"' '},' '{' '"type_id":' 8, '"name":' '"datacenter"' '},' '{' '"type_id":' 9, '"name":' '"zone"' '},' '{' '"type_id":' 10, '"name":' '"region"' '},' '{' '"type_id":' 11, '"name":' '"root"' '}' '],' '"buckets":' '[' '{' '"id":' -1, '"name":' '"default",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -3, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -2, '"name":' '"default~hdd",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -4, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -3, '"name":' '"smithi096",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '},' '{' '"id":' -4, '"name":' '"smithi096~hdd",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '}' '],' '"rules":' '[' '{' '"rule_id":' 0, '"rule_name":' '"replicated_rule",' '"type":' 1, '"steps":' '[' '{' '"op":' '"take",' '"item":' -1, '"item_name":' '"default"' '},' '{' '"op":' '"choose_firstn",' '"num":' 0, '"type":' '"osd"' '},' '{' '"op":' '"emit"' '}' ']' '}' '],' '"tunables":' '{' '"choose_local_tries":' 0, '"choose_local_fallback_tries":' 0, '"choose_total_tries":' 50, '"chooseleaf_descend_once":' 1, '"chooseleaf_vary_r":' 1, '"chooseleaf_stable":' 1, '"msr_descents":' 100, '"msr_collision_tries":' 100, '"straw_calc_version":' 1, '"allowed_bucket_algs":' 54, '"profile":' '"jewel",' '"optimal_tunables":' 1, '"legacy_tunables":' 0, '"minimum_required_version":' '"jewel",' '"require_feature_tunables":' 1, '"require_feature_tunables2":' 1, '"has_v2_rules":' 0, '"require_feature_tunables3":' 1, '"has_v3_rules":' 0, '"has_v4_buckets":' 1, '"require_feature_tunables5":' 1, '"has_v5_rules":' 0, '"has_msr_rules":' 0 '},' '"choose_args":' '{}' '},' '"fsmap":' '{' '"epoch":' 1, '"btime":' '"2024-09-16T03:22:46:882186+0000",' '"default_fscid":' -1, '"compat":' '{' '"compat":' '{},' '"ro_compat":' '{},' '"incompat":' '{' '"feature_1":' '"base' 'v0.20",' '"feature_2":' '"client' writeable 'ranges",' '"feature_3":' '"default' file layouts on 'dirs",' '"feature_4":' '"dir' inode in separate 'object",' '"feature_5":' '"mds' uses versioned 'encoding",' '"feature_6":' '"dirfrag' is stored in 'omap",' '"feature_8":' '"no' anchor 'table",' '"feature_9":' '"file' layout 'v2",' '"feature_10":' '"snaprealm' 'v2",' '"feature_11":' '"minor' log 'segments",' '"feature_12":' '"quiesce' 'subvolumes"' '}' '},' '"feature_flags":' '{' '"enable_multiple":' true, '"ever_enabled_multiple":' true '},' '"standbys":' '[],' '"filesystems":' '[]' '},' '"mdsmap_first_committed":' 1, '"mdsmap_last_committed":' 1, '"auth":' '{' '"first_committed":' 1, '"last_committed":' 5, '"num_secrets":' 3 '},' '"num_pg":' 64, '"num_pg_active":' 64, '"num_pg_unknown":' 0, '"num_osd":' 3, '"pool_sum":' '{' '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 128, '"acting":' 128, '"num_store_stats":' 0 '},' '"osd_sum":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54568, '"kb_used_data":' 816, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660632, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692487168, '"internally_reserved":' 0, '"allocated":' 835584, '"data_stored":' 312647, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 288, '"apply_latency_ms":' 288, '"commit_latency_ns":' 288000000, '"apply_latency_ns":' 288000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '},' '"osd_sum_by_class":' '{' '"hdd":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54568, '"kb_used_data":' 816, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660632, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692487168, '"internally_reserved":' 0, '"allocated":' 835584, '"data_stored":' 312647, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 288, '"apply_latency_ms":' 288, '"commit_latency_ns":' 288000000, '"apply_latency_ns":' 288000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '}' '},' '"pool_stats":' '[' '{' '"poolid":' 2, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '},' '{' '"poolid":' 1, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '}' '],' '"osd_stats":' '[' '{' '"osd":' 0, '"seq":' 21474836516 '},' '{' '"osd":' 1, '"seq":' 42949672988 '},' '{' '"osd":' 2, '"seq":' 0 '}' '],' '"num_pg_by_state":' '[' '{' '"state":' '"active+undersized",' '"num":' 64 '}' '],' '"num_pg_by_osd":' '[' '{' '"osd":' 2, '"num_primary_pg":' 0, '"num_acting_pg":' 0, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 0, '"num_primary_pg":' 28, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 1, '"num_primary_pg":' 36, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '}' '],' '"purged_snaps":' '[' '{' '"pool":' 1, '"purged_snaps":' '{}' '},' '{' '"pool":' 2, '"purged_snaps":' '{}' '}' '],' '"servicemap":' '{' '"epoch":' 5, '"modified":' '"2024-09-16T03:25:38.422788+0000",' '"services":' '{}' '},' '"mgrstat_first_committed":' 77, '"mgrstat_last_committed":' 82, '"logm_first_committed":' 1, '"logm_last_committed":' 358, '"paxos":' '{' '"first_committed":' 1, '"last_committed":' 536, '"last_pn":' 0, '"accepted_pn":' 0 '}' '}' 2024-09-16T03:25:54.717 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:132: get_fc_lc_diff: osdm_fc=28 2024-09-16T03:25:54.717 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:134: get_fc_lc_diff: jq .osdmap_last_committed 2024-09-16T03:25:54.717 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:134: get_fc_lc_diff: echo '{' '"cluster_fingerprint":' '"fda2fc64-07ed-4add-8224-2e527e11d427",' '"version":' '"19.3.0-4930-gfc3e0bff",' '"commit":' '"fc3e0bff7468fd55478adbae7f75508b749124b6",' '"timestamp":' '"2024-09-16T03:25:54.589189+0000",' '"tag":' '"",' '"health":' '{' '"status":' '"HEALTH_OK",' '"checks":' '{},' '"mutes":' '[]' '},' '"monmap_first_committed":' 1, '"monmap_last_committed":' 1, '"monmap":' '{' '"epoch":' 1, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"modified":' '"2024-09-16T03:22:45.872880Z",' '"created":' '"2024-09-16T03:22:45.872880Z",' '"min_mon_release":' 19, '"min_mon_release_name":' '"squid",' '"election_strategy":' 1, '"disallowed_leaders:' '":' '"",' '"stretch_mode":' false, '"tiebreaker_mon":' '"",' '"removed_ranks:' '":' '"",' '"features":' '{' '"persistent":' '[' '"kraken",' '"luminous",' '"mimic",' '"osdmap-prune",' '"nautilus",' '"octopus",' '"pacific",' '"elector-pinging",' '"quincy",' '"reef",' '"squid"' '],' '"optional":' '[]' '},' '"mons":' '[' '{' '"rank":' 0, '"name":' '"a",' '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:7302",' '"nonce":' 0 '}' ']' '},' '"addr":' '"127.0.0.1:7302/0",' '"public_addr":' '"127.0.0.1:7302/0",' '"priority":' 0, '"weight":' 0, '"crush_location":' '"{}"' '}' ']' '},' '"quorum":' '[' 0 '],' '"osdmap":' '{' '"epoch":' 80, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"created":' '"2024-09-16T03:22:46.906117+0000",' '"modified":' '"2024-09-16T03:25:52.948673+0000",' '"last_up_change":' '"2024-09-16T03:25:08.513363+0000",' '"last_in_change":' '"2024-09-16T03:25:09.839444+0000",' '"flags":' '"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit",' '"flags_num":' 5799936, '"flags_set":' '[' '"pglog_hardlimit",' '"purged_snapdirs",' '"recovery_deletes",' '"sortbitwise"' '],' '"crush_version":' 7, '"full_ratio":' 0.97000002861022949, '"backfillfull_ratio":' 0.97000002861022949, '"nearfull_ratio":' 0.85000002384185791, '"cluster_snapshot":' '"",' '"pool_max":' 2, '"max_osd":' 3, '"require_min_compat_client":' '"luminous",' '"min_compat_client":' '"jewel",' '"require_osd_release":' '"squid",' '"allow_crimson":' false, '"pools":' '[' '{' '"pool":' 1, '"pool_name":' '"foo",' '"create_time":' '"2024-09-16T03:24:44.525189+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"30",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.8700000047683716, '"score_stable":' 1.8700000047683716, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1.25, '"raw_score_stable":' 1.25, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '},' '{' '"pool":' 2, '"pool_name":' '"bar",' '"create_time":' '"2024-09-16T03:24:46.226575+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"32",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.4900000095367432, '"score_stable":' 1.4900000095367432, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1, '"raw_score_stable":' 1, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '}' '],' '"osds":' '[' '{' '"osd":' 0, '"uuid":' '"64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 5, '"up_thru":' 33, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6802",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6803",' '"nonce":' 3375787448 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6804",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6805",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6808",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6809",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6806",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6807",' '"nonce":' 3375787448 '}' ']' '},' '"public_addr":' '"127.0.0.1:6803/3375787448",' '"cluster_addr":' '"127.0.0.1:6805/3375787448",' '"heartbeat_back_addr":' '"127.0.0.1:6809/3375787448",' '"heartbeat_front_addr":' '"127.0.0.1:6807/3375787448",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 1, '"uuid":' '"74b26727-75c9-444d-8782-719e4197a382",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 10, '"up_thru":' 33, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6810",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6811",' '"nonce":' 3733255132 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6812",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6813",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6816",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6817",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6814",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6815",' '"nonce":' 3733255132 '}' ']' '},' '"public_addr":' '"127.0.0.1:6811/3733255132",' '"cluster_addr":' '"127.0.0.1:6813/3733255132",' '"heartbeat_back_addr":' '"127.0.0.1:6817/3733255132",' '"heartbeat_front_addr":' '"127.0.0.1:6815/3733255132",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 2, '"uuid":' '"143da3a7-dad9-4b1e-966b-76cf5bdd3c82",' '"up":' 0, '"in":' 0, '"weight":' 0, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 15, '"up_thru":' 21, '"down_at":' 33, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6818",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6819",' '"nonce":' 963814857 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6820",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6821",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6824",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6825",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6822",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6823",' '"nonce":' 963814857 '}' ']' '},' '"public_addr":' '"127.0.0.1:6819/963814857",' '"cluster_addr":' '"127.0.0.1:6821/963814857",' '"heartbeat_back_addr":' '"127.0.0.1:6825/963814857",' '"heartbeat_front_addr":' '"127.0.0.1:6823/963814857",' '"state":' '[' '"exists"' ']' '}' '],' '"osd_xinfo":' '[' '{' '"osd":' 0, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:22.481942+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 1, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:59.663703+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 2, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 65536, '"last_purged_snaps_scrub":' '"2024-09-16T03:24:37.320822+0000",' '"dead_epoch":' 32 '}' '],' '"pg_upmap":' '[],' '"pg_upmap_items":' '[],' '"pg_upmap_primaries":' '[],' '"pg_temp":' '[],' '"primary_temp":' '[],' '"blocklist":' '{},' '"range_blocklist":' '{},' '"erasure_code_profiles":' '{' '"default":' '{' '"k":' '"2",' '"m":' '"2",' '"plugin":' '"jerasure",' '"technique":' '"reed_sol_van"' '}' '},' '"removed_snaps_queue":' '[],' '"new_removed_snaps":' '[],' '"new_purged_snaps":' '[],' '"crush_node_flags":' '{},' '"device_class_flags":' '{},' '"stretch_mode":' '{' '"stretch_mode_enabled":' false, '"stretch_bucket_count":' 0, '"degraded_stretch_mode":' 0, '"recovering_stretch_mode":' 0, '"stretch_mode_bucket":' 0 '}' '},' '"osd_metadata":' '[' '{' '"id":' 0, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/0/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:22:53.662571Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]",' '"hb_front_addr":' '"[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/0",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 1, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/1/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:23:30.129885Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]",' '"hb_front_addr":' '"[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/1",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 2, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/2/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:24:07.764502Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]",' '"hb_front_addr":' '"[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/2",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '}' '],' '"osdmap_clean_epochs":' '{' '"min_last_epoch_clean":' 28, '"last_epoch_clean":' '{' '"per_pool":' '[' '{' '"poolid":' 1, '"floor":' 28 '},' '{' '"poolid":' 2, '"floor":' 28 '}' ']' '},' '"osd_epochs":' '[' '{' '"id":' 0, '"epoch":' 78 '},' '{' '"id":' 1, '"epoch":' 68 '}' ']' '},' '"osdmap_first_committed":' 28, '"osdmap_last_committed":' 80, '"crushmap":' '{' '"devices":' '[' '{' '"id":' 0, '"name":' '"osd.0",' '"class":' '"hdd"' '},' '{' '"id":' 1, '"name":' '"osd.1",' '"class":' '"hdd"' '},' '{' '"id":' 2, '"name":' '"osd.2",' '"class":' '"hdd"' '}' '],' '"types":' '[' '{' '"type_id":' 0, '"name":' '"osd"' '},' '{' '"type_id":' 1, '"name":' '"host"' '},' '{' '"type_id":' 2, '"name":' '"chassis"' '},' '{' '"type_id":' 3, '"name":' '"rack"' '},' '{' '"type_id":' 4, '"name":' '"row"' '},' '{' '"type_id":' 5, '"name":' '"pdu"' '},' '{' '"type_id":' 6, '"name":' '"pod"' '},' '{' '"type_id":' 7, '"name":' '"room"' '},' '{' '"type_id":' 8, '"name":' '"datacenter"' '},' '{' '"type_id":' 9, '"name":' '"zone"' '},' '{' '"type_id":' 10, '"name":' '"region"' '},' '{' '"type_id":' 11, '"name":' '"root"' '}' '],' '"buckets":' '[' '{' '"id":' -1, '"name":' '"default",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -3, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -2, '"name":' '"default~hdd",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -4, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -3, '"name":' '"smithi096",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '},' '{' '"id":' -4, '"name":' '"smithi096~hdd",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '}' '],' '"rules":' '[' '{' '"rule_id":' 0, '"rule_name":' '"replicated_rule",' '"type":' 1, '"steps":' '[' '{' '"op":' '"take",' '"item":' -1, '"item_name":' '"default"' '},' '{' '"op":' '"choose_firstn",' '"num":' 0, '"type":' '"osd"' '},' '{' '"op":' '"emit"' '}' ']' '}' '],' '"tunables":' '{' '"choose_local_tries":' 0, '"choose_local_fallback_tries":' 0, '"choose_total_tries":' 50, '"chooseleaf_descend_once":' 1, '"chooseleaf_vary_r":' 1, '"chooseleaf_stable":' 1, '"msr_descents":' 100, '"msr_collision_tries":' 100, '"straw_calc_version":' 1, '"allowed_bucket_algs":' 54, '"profile":' '"jewel",' '"optimal_tunables":' 1, '"legacy_tunables":' 0, '"minimum_required_version":' '"jewel",' '"require_feature_tunables":' 1, '"require_feature_tunables2":' 1, '"has_v2_rules":' 0, '"require_feature_tunables3":' 1, '"has_v3_rules":' 0, '"has_v4_buckets":' 1, '"require_feature_tunables5":' 1, '"has_v5_rules":' 0, '"has_msr_rules":' 0 '},' '"choose_args":' '{}' '},' '"fsmap":' '{' '"epoch":' 1, '"btime":' '"2024-09-16T03:22:46:882186+0000",' '"default_fscid":' -1, '"compat":' '{' '"compat":' '{},' '"ro_compat":' '{},' '"incompat":' '{' '"feature_1":' '"base' 'v0.20",' '"feature_2":' '"client' writeable 'ranges",' '"feature_3":' '"default' file layouts on 'dirs",' '"feature_4":' '"dir' inode in separate 'object",' '"feature_5":' '"mds' uses versioned 'encoding",' '"feature_6":' '"dirfrag' is stored in 'omap",' '"feature_8":' '"no' anchor 'table",' '"feature_9":' '"file' layout 'v2",' '"feature_10":' '"snaprealm' 'v2",' '"feature_11":' '"minor' log 'segments",' '"feature_12":' '"quiesce' 'subvolumes"' '}' '},' '"feature_flags":' '{' '"enable_multiple":' true, '"ever_enabled_multiple":' true '},' '"standbys":' '[],' '"filesystems":' '[]' '},' '"mdsmap_first_committed":' 1, '"mdsmap_last_committed":' 1, '"auth":' '{' '"first_committed":' 1, '"last_committed":' 5, '"num_secrets":' 3 '},' '"num_pg":' 64, '"num_pg_active":' 64, '"num_pg_unknown":' 0, '"num_osd":' 3, '"pool_sum":' '{' '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 128, '"acting":' 128, '"num_store_stats":' 0 '},' '"osd_sum":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54568, '"kb_used_data":' 816, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660632, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692487168, '"internally_reserved":' 0, '"allocated":' 835584, '"data_stored":' 312647, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 288, '"apply_latency_ms":' 288, '"commit_latency_ns":' 288000000, '"apply_latency_ns":' 288000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '},' '"osd_sum_by_class":' '{' '"hdd":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54568, '"kb_used_data":' 816, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660632, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692487168, '"internally_reserved":' 0, '"allocated":' 835584, '"data_stored":' 312647, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 288, '"apply_latency_ms":' 288, '"commit_latency_ns":' 288000000, '"apply_latency_ns":' 288000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '}' '},' '"pool_stats":' '[' '{' '"poolid":' 2, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '},' '{' '"poolid":' 1, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '}' '],' '"osd_stats":' '[' '{' '"osd":' 0, '"seq":' 21474836516 '},' '{' '"osd":' 1, '"seq":' 42949672988 '},' '{' '"osd":' 2, '"seq":' 0 '}' '],' '"num_pg_by_state":' '[' '{' '"state":' '"active+undersized",' '"num":' 64 '}' '],' '"num_pg_by_osd":' '[' '{' '"osd":' 2, '"num_primary_pg":' 0, '"num_acting_pg":' 0, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 0, '"num_primary_pg":' 28, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 1, '"num_primary_pg":' 36, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '}' '],' '"purged_snaps":' '[' '{' '"pool":' 1, '"purged_snaps":' '{}' '},' '{' '"pool":' 2, '"purged_snaps":' '{}' '}' '],' '"servicemap":' '{' '"epoch":' 5, '"modified":' '"2024-09-16T03:25:38.422788+0000",' '"services":' '{}' '},' '"mgrstat_first_committed":' 77, '"mgrstat_last_committed":' 82, '"logm_first_committed":' 1, '"logm_last_committed":' 358, '"paxos":' '{' '"first_committed":' 1, '"last_committed":' 536, '"last_pn":' 0, '"accepted_pn":' 0 '}' '}' 2024-09-16T03:25:54.718 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:134: get_fc_lc_diff: osdm_lc=80 2024-09-16T03:25:54.718 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:136: get_fc_lc_diff: echo 52 2024-09-16T03:25:54.718 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:240: TEST_mon_last_clean_epoch: post_map_diff=52 2024-09-16T03:25:54.718 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:241: TEST_mon_last_clean_epoch: [[ 52 -gt 2 ]] 2024-09-16T03:25:54.718 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:243: TEST_mon_last_clean_epoch: validate_fc 2024-09-16T03:25:54.718 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:119: validate_fc: ceph report 2024-09-16T03:25:55.223 INFO:tasks.workunit.client.0.smithi096.stderr:report 1768016595 2024-09-16T03:25:55.239 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:119: validate_fc: report='{ 2024-09-16T03:25:55.239 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_fingerprint": "fda2fc64-07ed-4add-8224-2e527e11d427", 2024-09-16T03:25:55.240 INFO:tasks.workunit.client.0.smithi096.stderr: "version": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:25:55.240 INFO:tasks.workunit.client.0.smithi096.stderr: "commit": "fc3e0bff7468fd55478adbae7f75508b749124b6", 2024-09-16T03:25:55.240 INFO:tasks.workunit.client.0.smithi096.stderr: "timestamp": "2024-09-16T03:25:55.224366+0000", 2024-09-16T03:25:55.240 INFO:tasks.workunit.client.0.smithi096.stderr: "tag": "", 2024-09-16T03:25:55.240 INFO:tasks.workunit.client.0.smithi096.stderr: "health": { 2024-09-16T03:25:55.240 INFO:tasks.workunit.client.0.smithi096.stderr: "status": "HEALTH_OK", 2024-09-16T03:25:55.240 INFO:tasks.workunit.client.0.smithi096.stderr: "checks": {}, 2024-09-16T03:25:55.240 INFO:tasks.workunit.client.0.smithi096.stderr: "mutes": [] 2024-09-16T03:25:55.240 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.240 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap_first_committed": 1, 2024-09-16T03:25:55.240 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap_last_committed": 1, 2024-09-16T03:25:55.240 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap": { 2024-09-16T03:25:55.241 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 1, 2024-09-16T03:25:55.241 INFO:tasks.workunit.client.0.smithi096.stderr: "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", 2024-09-16T03:25:55.241 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:22:45.872880Z", 2024-09-16T03:25:55.241 INFO:tasks.workunit.client.0.smithi096.stderr: "created": "2024-09-16T03:22:45.872880Z", 2024-09-16T03:25:55.241 INFO:tasks.workunit.client.0.smithi096.stderr: "min_mon_release": 19, 2024-09-16T03:25:55.241 INFO:tasks.workunit.client.0.smithi096.stderr: "min_mon_release_name": "squid", 2024-09-16T03:25:55.241 INFO:tasks.workunit.client.0.smithi096.stderr: "election_strategy": 1, 2024-09-16T03:25:55.241 INFO:tasks.workunit.client.0.smithi096.stderr: "disallowed_leaders: ": "", 2024-09-16T03:25:55.241 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode": false, 2024-09-16T03:25:55.241 INFO:tasks.workunit.client.0.smithi096.stderr: "tiebreaker_mon": "", 2024-09-16T03:25:55.241 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_ranks: ": "", 2024-09-16T03:25:55.241 INFO:tasks.workunit.client.0.smithi096.stderr: "features": { 2024-09-16T03:25:55.241 INFO:tasks.workunit.client.0.smithi096.stderr: "persistent": [ 2024-09-16T03:25:55.242 INFO:tasks.workunit.client.0.smithi096.stderr: "kraken", 2024-09-16T03:25:55.242 INFO:tasks.workunit.client.0.smithi096.stderr: "luminous", 2024-09-16T03:25:55.242 INFO:tasks.workunit.client.0.smithi096.stderr: "mimic", 2024-09-16T03:25:55.242 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap-prune", 2024-09-16T03:25:55.242 INFO:tasks.workunit.client.0.smithi096.stderr: "nautilus", 2024-09-16T03:25:55.242 INFO:tasks.workunit.client.0.smithi096.stderr: "octopus", 2024-09-16T03:25:55.242 INFO:tasks.workunit.client.0.smithi096.stderr: "pacific", 2024-09-16T03:25:55.242 INFO:tasks.workunit.client.0.smithi096.stderr: "elector-pinging", 2024-09-16T03:25:55.243 INFO:tasks.workunit.client.0.smithi096.stderr: "quincy", 2024-09-16T03:25:55.243 INFO:tasks.workunit.client.0.smithi096.stderr: "reef", 2024-09-16T03:25:55.243 INFO:tasks.workunit.client.0.smithi096.stderr: "squid" 2024-09-16T03:25:55.243 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:55.243 INFO:tasks.workunit.client.0.smithi096.stderr: "optional": [] 2024-09-16T03:25:55.243 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.243 INFO:tasks.workunit.client.0.smithi096.stderr: "mons": [ 2024-09-16T03:25:55.243 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.243 INFO:tasks.workunit.client.0.smithi096.stderr: "rank": 0, 2024-09-16T03:25:55.243 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "a", 2024-09-16T03:25:55.243 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:25:55.243 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:55.243 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.244 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:55.244 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:7302", 2024-09-16T03:25:55.244 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 0 2024-09-16T03:25:55.244 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:55.244 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:55.244 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.244 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:7302/0", 2024-09-16T03:25:55.244 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:7302/0", 2024-09-16T03:25:55.244 INFO:tasks.workunit.client.0.smithi096.stderr: "priority": 0, 2024-09-16T03:25:55.244 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 0, 2024-09-16T03:25:55.244 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_location": "{}" 2024-09-16T03:25:55.245 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:55.245 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:55.245 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.245 INFO:tasks.workunit.client.0.smithi096.stderr: "quorum": [ 2024-09-16T03:25:55.245 INFO:tasks.workunit.client.0.smithi096.stderr: 0 2024-09-16T03:25:55.245 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:55.245 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap": { 2024-09-16T03:25:55.245 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 80, 2024-09-16T03:25:55.245 INFO:tasks.workunit.client.0.smithi096.stderr: "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", 2024-09-16T03:25:55.245 INFO:tasks.workunit.client.0.smithi096.stderr: "created": "2024-09-16T03:22:46.906117+0000", 2024-09-16T03:25:55.245 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:25:52.948673+0000", 2024-09-16T03:25:55.245 INFO:tasks.workunit.client.0.smithi096.stderr: "last_up_change": "2024-09-16T03:25:08.513363+0000", 2024-09-16T03:25:55.246 INFO:tasks.workunit.client.0.smithi096.stderr: "last_in_change": "2024-09-16T03:25:09.839444+0000", 2024-09-16T03:25:55.246 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-16T03:25:55.246 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_num": 5799936, 2024-09-16T03:25:55.246 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_set": [ 2024-09-16T03:25:55.246 INFO:tasks.workunit.client.0.smithi096.stderr: "pglog_hardlimit", 2024-09-16T03:25:55.246 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snapdirs", 2024-09-16T03:25:55.246 INFO:tasks.workunit.client.0.smithi096.stderr: "recovery_deletes", 2024-09-16T03:25:55.246 INFO:tasks.workunit.client.0.smithi096.stderr: "sortbitwise" 2024-09-16T03:25:55.246 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:55.246 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_version": 7, 2024-09-16T03:25:55.246 INFO:tasks.workunit.client.0.smithi096.stderr: "full_ratio": 0.97000002861022949, 2024-09-16T03:25:55.246 INFO:tasks.workunit.client.0.smithi096.stderr: "backfillfull_ratio": 0.97000002861022949, 2024-09-16T03:25:55.246 INFO:tasks.workunit.client.0.smithi096.stderr: "nearfull_ratio": 0.85000002384185791, 2024-09-16T03:25:55.247 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_snapshot": "", 2024-09-16T03:25:55.247 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_max": 2, 2024-09-16T03:25:55.247 INFO:tasks.workunit.client.0.smithi096.stderr: "max_osd": 3, 2024-09-16T03:25:55.247 INFO:tasks.workunit.client.0.smithi096.stderr: "require_min_compat_client": "luminous", 2024-09-16T03:25:55.247 INFO:tasks.workunit.client.0.smithi096.stderr: "min_compat_client": "jewel", 2024-09-16T03:25:55.247 INFO:tasks.workunit.client.0.smithi096.stderr: "require_osd_release": "squid", 2024-09-16T03:25:55.247 INFO:tasks.workunit.client.0.smithi096.stderr: "allow_crimson": false, 2024-09-16T03:25:55.247 INFO:tasks.workunit.client.0.smithi096.stderr: "pools": [ 2024-09-16T03:25:55.247 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.247 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 1, 2024-09-16T03:25:55.247 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_name": "foo", 2024-09-16T03:25:55.247 INFO:tasks.workunit.client.0.smithi096.stderr: "create_time": "2024-09-16T03:24:44.525189+0000", 2024-09-16T03:25:55.247 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": 1, 2024-09-16T03:25:55.247 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_names": "hashpspool", 2024-09-16T03:25:55.247 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:25:55.248 INFO:tasks.workunit.client.0.smithi096.stderr: "size": 3, 2024-09-16T03:25:55.248 INFO:tasks.workunit.client.0.smithi096.stderr: "min_size": 2, 2024-09-16T03:25:55.248 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_rule": 0, 2024-09-16T03:25:55.248 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_count": 0, 2024-09-16T03:25:55.248 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_target": 0, 2024-09-16T03:25:55.248 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_barrier": 0, 2024-09-16T03:25:55.248 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-16T03:25:55.248 INFO:tasks.workunit.client.0.smithi096.stderr: "is_stretch_pool": false, 2024-09-16T03:25:55.248 INFO:tasks.workunit.client.0.smithi096.stderr: "object_hash": 2, 2024-09-16T03:25:55.248 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_autoscale_mode": "off", 2024-09-16T03:25:55.248 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num": 32, 2024-09-16T03:25:55.248 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num": 32, 2024-09-16T03:25:55.248 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num_target": 32, 2024-09-16T03:25:55.249 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_target": 32, 2024-09-16T03:25:55.249 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_pending": 32, 2024-09-16T03:25:55.249 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pg_merge_meta": { 2024-09-16T03:25:55.249 INFO:tasks.workunit.client.0.smithi096.stderr: "source_pgid": "0.0", 2024-09-16T03:25:55.249 INFO:tasks.workunit.client.0.smithi096.stderr: "ready_epoch": 0, 2024-09-16T03:25:55.249 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_started": 0, 2024-09-16T03:25:55.249 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": 0, 2024-09-16T03:25:55.249 INFO:tasks.workunit.client.0.smithi096.stderr: "source_version": "0'\''0", 2024-09-16T03:25:55.249 INFO:tasks.workunit.client.0.smithi096.stderr: "target_version": "0'\''0" 2024-09-16T03:25:55.249 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.249 INFO:tasks.workunit.client.0.smithi096.stderr: "last_change": "30", 2024-09-16T03:25:55.249 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend": "0", 2024-09-16T03:25:55.249 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_prenautilus": "0", 2024-09-16T03:25:55.250 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_preluminous": "0", 2024-09-16T03:25:55.250 INFO:tasks.workunit.client.0.smithi096.stderr: "auid": 0, 2024-09-16T03:25:55.250 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_mode": "selfmanaged", 2024-09-16T03:25:55.250 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_seq": 0, 2024-09-16T03:25:55.250 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_epoch": 0, 2024-09-16T03:25:55.250 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_snaps": [], 2024-09-16T03:25:55.250 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps": "[]", 2024-09-16T03:25:55.250 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_bytes": 0, 2024-09-16T03:25:55.250 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_objects": 0, 2024-09-16T03:25:55.250 INFO:tasks.workunit.client.0.smithi096.stderr: "tiers": [], 2024-09-16T03:25:55.250 INFO:tasks.workunit.client.0.smithi096.stderr: "tier_of": -1, 2024-09-16T03:25:55.250 INFO:tasks.workunit.client.0.smithi096.stderr: "read_tier": -1, 2024-09-16T03:25:55.250 INFO:tasks.workunit.client.0.smithi096.stderr: "write_tier": -1, 2024-09-16T03:25:55.251 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_mode": "none", 2024-09-16T03:25:55.251 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_bytes": 0, 2024-09-16T03:25:55.251 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_objects": 0, 2024-09-16T03:25:55.251 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_ratio_micro": 400000, 2024-09-16T03:25:55.251 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-16T03:25:55.251 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_full_ratio_micro": 800000, 2024-09-16T03:25:55.251 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_flush_age": 0, 2024-09-16T03:25:55.251 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_evict_age": 0, 2024-09-16T03:25:55.251 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profile": "", 2024-09-16T03:25:55.251 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_params": { 2024-09-16T03:25:55.251 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "none" 2024-09-16T03:25:55.251 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.251 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_period": 0, 2024-09-16T03:25:55.252 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_count": 0, 2024-09-16T03:25:55.252 INFO:tasks.workunit.client.0.smithi096.stderr: "use_gmt_hitset": true, 2024-09-16T03:25:55.252 INFO:tasks.workunit.client.0.smithi096.stderr: "min_read_recency_for_promote": 0, 2024-09-16T03:25:55.252 INFO:tasks.workunit.client.0.smithi096.stderr: "min_write_recency_for_promote": 0, 2024-09-16T03:25:55.252 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_grade_decay_rate": 0, 2024-09-16T03:25:55.252 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_search_last_n": 0, 2024-09-16T03:25:55.252 INFO:tasks.workunit.client.0.smithi096.stderr: "grade_table": [], 2024-09-16T03:25:55.252 INFO:tasks.workunit.client.0.smithi096.stderr: "stripe_width": 0, 2024-09-16T03:25:55.252 INFO:tasks.workunit.client.0.smithi096.stderr: "expected_num_objects": 0, 2024-09-16T03:25:55.252 INFO:tasks.workunit.client.0.smithi096.stderr: "fast_read": false, 2024-09-16T03:25:55.253 INFO:tasks.workunit.client.0.smithi096.stderr: "options": {}, 2024-09-16T03:25:55.253 INFO:tasks.workunit.client.0.smithi096.stderr: "application_metadata": {}, 2024-09-16T03:25:55.253 INFO:tasks.workunit.client.0.smithi096.stderr: "read_balance": { 2024-09-16T03:25:55.253 INFO:tasks.workunit.client.0.smithi096.stderr: "score_type": "Fair distribution", 2024-09-16T03:25:55.253 INFO:tasks.workunit.client.0.smithi096.stderr: "score_acting": 1.8700000047683716, 2024-09-16T03:25:55.253 INFO:tasks.workunit.client.0.smithi096.stderr: "score_stable": 1.8700000047683716, 2024-09-16T03:25:55.253 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_score": 0.67000001668930054, 2024-09-16T03:25:55.253 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_acting": 1.25, 2024-09-16T03:25:55.253 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_stable": 1.25, 2024-09-16T03:25:55.253 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity_weighted": 1, 2024-09-16T03:25:55.254 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity": 1, 2024-09-16T03:25:55.254 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity_weighted": 1 2024-09-16T03:25:55.254 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:55.254 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.254 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.254 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 2, 2024-09-16T03:25:55.254 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_name": "bar", 2024-09-16T03:25:55.254 INFO:tasks.workunit.client.0.smithi096.stderr: "create_time": "2024-09-16T03:24:46.226575+0000", 2024-09-16T03:25:55.254 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": 1, 2024-09-16T03:25:55.254 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_names": "hashpspool", 2024-09-16T03:25:55.254 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:25:55.254 INFO:tasks.workunit.client.0.smithi096.stderr: "size": 3, 2024-09-16T03:25:55.254 INFO:tasks.workunit.client.0.smithi096.stderr: "min_size": 2, 2024-09-16T03:25:55.255 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_rule": 0, 2024-09-16T03:25:55.255 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_count": 0, 2024-09-16T03:25:55.255 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_target": 0, 2024-09-16T03:25:55.255 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_barrier": 0, 2024-09-16T03:25:55.255 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-16T03:25:55.255 INFO:tasks.workunit.client.0.smithi096.stderr: "is_stretch_pool": false, 2024-09-16T03:25:55.255 INFO:tasks.workunit.client.0.smithi096.stderr: "object_hash": 2, 2024-09-16T03:25:55.255 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_autoscale_mode": "off", 2024-09-16T03:25:55.255 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num": 32, 2024-09-16T03:25:55.255 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num": 32, 2024-09-16T03:25:55.255 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num_target": 32, 2024-09-16T03:25:55.255 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_target": 32, 2024-09-16T03:25:55.255 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_pending": 32, 2024-09-16T03:25:55.255 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pg_merge_meta": { 2024-09-16T03:25:55.256 INFO:tasks.workunit.client.0.smithi096.stderr: "source_pgid": "0.0", 2024-09-16T03:25:55.256 INFO:tasks.workunit.client.0.smithi096.stderr: "ready_epoch": 0, 2024-09-16T03:25:55.256 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_started": 0, 2024-09-16T03:25:55.256 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": 0, 2024-09-16T03:25:55.256 INFO:tasks.workunit.client.0.smithi096.stderr: "source_version": "0'\''0", 2024-09-16T03:25:55.256 INFO:tasks.workunit.client.0.smithi096.stderr: "target_version": "0'\''0" 2024-09-16T03:25:55.256 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.256 INFO:tasks.workunit.client.0.smithi096.stderr: "last_change": "32", 2024-09-16T03:25:55.256 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend": "0", 2024-09-16T03:25:55.256 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_prenautilus": "0", 2024-09-16T03:25:55.256 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_preluminous": "0", 2024-09-16T03:25:55.256 INFO:tasks.workunit.client.0.smithi096.stderr: "auid": 0, 2024-09-16T03:25:55.256 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_mode": "selfmanaged", 2024-09-16T03:25:55.256 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_seq": 0, 2024-09-16T03:25:55.257 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_epoch": 0, 2024-09-16T03:25:55.257 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_snaps": [], 2024-09-16T03:25:55.257 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps": "[]", 2024-09-16T03:25:55.257 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_bytes": 0, 2024-09-16T03:25:55.257 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_objects": 0, 2024-09-16T03:25:55.257 INFO:tasks.workunit.client.0.smithi096.stderr: "tiers": [], 2024-09-16T03:25:55.257 INFO:tasks.workunit.client.0.smithi096.stderr: "tier_of": -1, 2024-09-16T03:25:55.257 INFO:tasks.workunit.client.0.smithi096.stderr: "read_tier": -1, 2024-09-16T03:25:55.257 INFO:tasks.workunit.client.0.smithi096.stderr: "write_tier": -1, 2024-09-16T03:25:55.257 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_mode": "none", 2024-09-16T03:25:55.257 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_bytes": 0, 2024-09-16T03:25:55.257 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_objects": 0, 2024-09-16T03:25:55.257 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_ratio_micro": 400000, 2024-09-16T03:25:55.258 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-16T03:25:55.258 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_full_ratio_micro": 800000, 2024-09-16T03:25:55.258 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_flush_age": 0, 2024-09-16T03:25:55.258 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_evict_age": 0, 2024-09-16T03:25:55.258 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profile": "", 2024-09-16T03:25:55.258 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_params": { 2024-09-16T03:25:55.258 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "none" 2024-09-16T03:25:55.258 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.258 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_period": 0, 2024-09-16T03:25:55.258 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_count": 0, 2024-09-16T03:25:55.258 INFO:tasks.workunit.client.0.smithi096.stderr: "use_gmt_hitset": true, 2024-09-16T03:25:55.258 INFO:tasks.workunit.client.0.smithi096.stderr: "min_read_recency_for_promote": 0, 2024-09-16T03:25:55.258 INFO:tasks.workunit.client.0.smithi096.stderr: "min_write_recency_for_promote": 0, 2024-09-16T03:25:55.258 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_grade_decay_rate": 0, 2024-09-16T03:25:55.259 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_search_last_n": 0, 2024-09-16T03:25:55.259 INFO:tasks.workunit.client.0.smithi096.stderr: "grade_table": [], 2024-09-16T03:25:55.259 INFO:tasks.workunit.client.0.smithi096.stderr: "stripe_width": 0, 2024-09-16T03:25:55.259 INFO:tasks.workunit.client.0.smithi096.stderr: "expected_num_objects": 0, 2024-09-16T03:25:55.259 INFO:tasks.workunit.client.0.smithi096.stderr: "fast_read": false, 2024-09-16T03:25:55.259 INFO:tasks.workunit.client.0.smithi096.stderr: "options": {}, 2024-09-16T03:25:55.259 INFO:tasks.workunit.client.0.smithi096.stderr: "application_metadata": {}, 2024-09-16T03:25:55.259 INFO:tasks.workunit.client.0.smithi096.stderr: "read_balance": { 2024-09-16T03:25:55.259 INFO:tasks.workunit.client.0.smithi096.stderr: "score_type": "Fair distribution", 2024-09-16T03:25:55.259 INFO:tasks.workunit.client.0.smithi096.stderr: "score_acting": 1.4900000095367432, 2024-09-16T03:25:55.260 INFO:tasks.workunit.client.0.smithi096.stderr: "score_stable": 1.4900000095367432, 2024-09-16T03:25:55.260 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_score": 0.67000001668930054, 2024-09-16T03:25:55.260 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_acting": 1, 2024-09-16T03:25:55.260 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_stable": 1, 2024-09-16T03:25:55.260 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity_weighted": 1, 2024-09-16T03:25:55.260 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity": 1, 2024-09-16T03:25:55.260 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity_weighted": 1 2024-09-16T03:25:55.260 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:55.260 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:55.260 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:55.260 INFO:tasks.workunit.client.0.smithi096.stderr: "osds": [ 2024-09-16T03:25:55.260 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.260 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:25:55.261 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6", 2024-09-16T03:25:55.261 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:25:55.261 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:25:55.261 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:25:55.261 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:25:55.261 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:25:55.261 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:25:55.261 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 5, 2024-09-16T03:25:55.261 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 33, 2024-09-16T03:25:55.261 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:25:55.261 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:25:55.261 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:25:55.261 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:55.262 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.262 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:55.262 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6802", 2024-09-16T03:25:55.262 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:55.262 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.262 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.262 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:55.262 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6803", 2024-09-16T03:25:55.262 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:55.262 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:55.262 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:55.262 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.263 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:25:55.263 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:55.263 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.263 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:55.263 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6804", 2024-09-16T03:25:55.263 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:55.263 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.263 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.263 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:55.264 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6805", 2024-09-16T03:25:55.264 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:55.264 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:55.264 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:55.264 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.264 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:25:55.264 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:55.264 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.264 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:55.264 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6808", 2024-09-16T03:25:55.264 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:55.265 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.265 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.265 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:55.265 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6809", 2024-09-16T03:25:55.265 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:55.265 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:55.265 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:55.265 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.265 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:25:55.265 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:55.265 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.265 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:55.266 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6806", 2024-09-16T03:25:55.266 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:55.266 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.266 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.266 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:55.266 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6807", 2024-09-16T03:25:55.266 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:55.266 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:55.266 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:55.266 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.266 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6803/3375787448", 2024-09-16T03:25:55.266 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6805/3375787448", 2024-09-16T03:25:55.266 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6809/3375787448", 2024-09-16T03:25:55.267 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6807/3375787448", 2024-09-16T03:25:55.267 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:25:55.267 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:25:55.267 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:25:55.267 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:55.267 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.267 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.267 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:25:55.267 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "74b26727-75c9-444d-8782-719e4197a382", 2024-09-16T03:25:55.267 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:25:55.267 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:25:55.267 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:25:55.267 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:25:55.268 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:25:55.268 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:25:55.268 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 10, 2024-09-16T03:25:55.268 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 33, 2024-09-16T03:25:55.268 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:25:55.268 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:25:55.268 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:25:55.268 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:55.268 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.268 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:55.268 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6810", 2024-09-16T03:25:55.268 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:55.268 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.269 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.269 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:55.269 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6811", 2024-09-16T03:25:55.269 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:55.269 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:55.269 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:55.269 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.269 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:25:55.269 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:55.269 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.269 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:55.269 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6812", 2024-09-16T03:25:55.270 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:55.270 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.270 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.270 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:55.270 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6813", 2024-09-16T03:25:55.270 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:55.270 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:55.270 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:55.270 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.270 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:25:55.270 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:55.270 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.271 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:55.271 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6816", 2024-09-16T03:25:55.271 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:55.271 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.271 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.271 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:55.271 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6817", 2024-09-16T03:25:55.271 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:55.271 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:55.271 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:55.271 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.271 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:25:55.272 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:55.272 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.272 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:55.272 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6814", 2024-09-16T03:25:55.272 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:55.272 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.272 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.272 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:55.272 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6815", 2024-09-16T03:25:55.272 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:55.273 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:55.273 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:55.273 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.273 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6811/3733255132", 2024-09-16T03:25:55.273 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6813/3733255132", 2024-09-16T03:25:55.273 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6817/3733255132", 2024-09-16T03:25:55.273 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6815/3733255132", 2024-09-16T03:25:55.273 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:25:55.273 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:25:55.273 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:25:55.273 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:55.273 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.274 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.274 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:25:55.274 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "143da3a7-dad9-4b1e-966b-76cf5bdd3c82", 2024-09-16T03:25:55.274 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 0, 2024-09-16T03:25:55.274 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 0, 2024-09-16T03:25:55.274 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 0, 2024-09-16T03:25:55.274 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:25:55.274 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:25:55.274 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:25:55.275 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 15, 2024-09-16T03:25:55.275 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 21, 2024-09-16T03:25:55.275 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 33, 2024-09-16T03:25:55.275 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:25:55.275 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:25:55.275 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:55.275 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.275 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:55.275 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6818", 2024-09-16T03:25:55.275 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:55.275 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.275 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.275 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:55.276 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6819", 2024-09-16T03:25:55.276 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:55.276 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:55.276 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:55.276 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.276 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:25:55.276 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:55.276 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.276 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:55.276 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6820", 2024-09-16T03:25:55.276 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:55.277 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.277 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.277 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:55.277 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6821", 2024-09-16T03:25:55.277 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:55.277 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:55.277 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:55.277 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.277 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:25:55.277 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:55.277 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.277 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:55.278 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6824", 2024-09-16T03:25:55.278 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:55.278 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.278 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.278 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:55.278 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6825", 2024-09-16T03:25:55.278 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:55.278 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:55.278 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:55.278 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.278 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:25:55.278 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:55.278 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.279 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:55.279 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6822", 2024-09-16T03:25:55.279 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:55.279 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.279 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.279 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:55.279 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6823", 2024-09-16T03:25:55.279 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:55.279 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:55.279 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:55.279 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.279 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6819/963814857", 2024-09-16T03:25:55.280 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6821/963814857", 2024-09-16T03:25:55.280 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6825/963814857", 2024-09-16T03:25:55.280 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6823/963814857", 2024-09-16T03:25:55.280 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:25:55.280 INFO:tasks.workunit.client.0.smithi096.stderr: "exists" 2024-09-16T03:25:55.280 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:55.280 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:55.280 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:55.280 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_xinfo": [ 2024-09-16T03:25:55.280 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.280 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:25:55.280 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:25:55.280 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:25:55.281 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:25:55.281 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:25:55.281 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:25:55.281 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:23:22.481942+0000", 2024-09-16T03:25:55.281 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:25:55.281 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.281 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.281 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:25:55.281 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:25:55.281 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:25:55.281 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:25:55.281 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:25:55.281 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:25:55.282 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:23:59.663703+0000", 2024-09-16T03:25:55.282 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:25:55.282 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.282 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.282 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:25:55.282 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:25:55.282 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:25:55.282 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:25:55.282 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:25:55.282 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 65536, 2024-09-16T03:25:55.283 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:24:37.320822+0000", 2024-09-16T03:25:55.283 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 32 2024-09-16T03:25:55.283 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:55.283 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:55.283 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap": [], 2024-09-16T03:25:55.283 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap_items": [], 2024-09-16T03:25:55.283 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap_primaries": [], 2024-09-16T03:25:55.283 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_temp": [], 2024-09-16T03:25:55.283 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_temp": [], 2024-09-16T03:25:55.283 INFO:tasks.workunit.client.0.smithi096.stderr: "blocklist": {}, 2024-09-16T03:25:55.283 INFO:tasks.workunit.client.0.smithi096.stderr: "range_blocklist": {}, 2024-09-16T03:25:55.283 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profiles": { 2024-09-16T03:25:55.283 INFO:tasks.workunit.client.0.smithi096.stderr: "default": { 2024-09-16T03:25:55.283 INFO:tasks.workunit.client.0.smithi096.stderr: "k": "2", 2024-09-16T03:25:55.284 INFO:tasks.workunit.client.0.smithi096.stderr: "m": "2", 2024-09-16T03:25:55.284 INFO:tasks.workunit.client.0.smithi096.stderr: "plugin": "jerasure", 2024-09-16T03:25:55.284 INFO:tasks.workunit.client.0.smithi096.stderr: "technique": "reed_sol_van" 2024-09-16T03:25:55.284 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:55.284 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.284 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps_queue": [], 2024-09-16T03:25:55.284 INFO:tasks.workunit.client.0.smithi096.stderr: "new_removed_snaps": [], 2024-09-16T03:25:55.284 INFO:tasks.workunit.client.0.smithi096.stderr: "new_purged_snaps": [], 2024-09-16T03:25:55.284 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_node_flags": {}, 2024-09-16T03:25:55.284 INFO:tasks.workunit.client.0.smithi096.stderr: "device_class_flags": {}, 2024-09-16T03:25:55.285 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode": { 2024-09-16T03:25:55.285 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode_enabled": false, 2024-09-16T03:25:55.285 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_bucket_count": 0, 2024-09-16T03:25:55.285 INFO:tasks.workunit.client.0.smithi096.stderr: "degraded_stretch_mode": 0, 2024-09-16T03:25:55.285 INFO:tasks.workunit.client.0.smithi096.stderr: "recovering_stretch_mode": 0, 2024-09-16T03:25:55.285 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode_bucket": 0 2024-09-16T03:25:55.285 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:55.285 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.285 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_metadata": [ 2024-09-16T03:25:55.285 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.285 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:25:55.286 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:25:55.286 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]", 2024-09-16T03:25:55.286 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:25:55.286 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:25:55.286 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:25:55.286 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:25:55.286 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:25:55.286 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:25:55.286 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:25:55.286 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:25:55.286 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:25:55.286 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:25:55.286 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:25:55.286 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/0/block", 2024-09-16T03:25:55.287 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:25:55.287 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:25:55.287 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:25:55.287 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:25:55.287 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:25:55.287 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:25:55.287 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:25:55.287 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:25:55.287 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:25:55.287 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:25:55.287 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:22:53.662571Z", 2024-09-16T03:25:55.287 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:25:55.287 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:25:55.288 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:25:55.288 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:25:55.288 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:25:55.288 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:25:55.288 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:25:55.288 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]", 2024-09-16T03:25:55.288 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:25:55.288 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]", 2024-09-16T03:25:55.288 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]", 2024-09-16T03:25:55.288 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:25:55.288 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:25:55.288 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:25:55.288 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:25:55.289 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:25:55.289 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:25:55.289 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:25:55.289 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:25:55.289 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:25:55.289 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/0", 2024-09-16T03:25:55.289 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:25:55.289 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:25:55.289 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:25:55.289 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.289 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.289 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:25:55.289 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:25:55.290 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]", 2024-09-16T03:25:55.290 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:25:55.290 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:25:55.290 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:25:55.290 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:25:55.290 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:25:55.290 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:25:55.290 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:25:55.290 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:25:55.290 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:25:55.290 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:25:55.290 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:25:55.290 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/1/block", 2024-09-16T03:25:55.291 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:25:55.291 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:25:55.291 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:25:55.291 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:25:55.291 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:25:55.291 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:25:55.291 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:25:55.291 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:25:55.291 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:25:55.291 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:25:55.291 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:23:30.129885Z", 2024-09-16T03:25:55.291 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:25:55.291 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:25:55.291 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:25:55.292 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:25:55.292 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:25:55.292 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:25:55.292 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:25:55.292 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]", 2024-09-16T03:25:55.292 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:25:55.292 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]", 2024-09-16T03:25:55.292 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]", 2024-09-16T03:25:55.292 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:25:55.292 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:25:55.292 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:25:55.292 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:25:55.292 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:25:55.293 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:25:55.293 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:25:55.293 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:25:55.293 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:25:55.293 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/1", 2024-09-16T03:25:55.293 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:25:55.293 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:25:55.293 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:25:55.293 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.293 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.293 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:25:55.293 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:25:55.294 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]", 2024-09-16T03:25:55.294 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:25:55.294 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:25:55.294 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:25:55.294 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:25:55.294 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:25:55.294 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:25:55.294 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:25:55.294 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:25:55.294 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:25:55.294 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:25:55.294 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:25:55.294 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/2/block", 2024-09-16T03:25:55.294 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:25:55.295 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:25:55.295 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:25:55.295 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:25:55.295 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:25:55.295 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:25:55.295 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:25:55.295 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:25:55.295 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:25:55.296 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:25:55.296 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:24:07.764502Z", 2024-09-16T03:25:55.296 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:25:55.296 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:25:55.296 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:25:55.296 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:25:55.296 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:25:55.296 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:25:55.296 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:25:55.296 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]", 2024-09-16T03:25:55.296 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:25:55.296 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]", 2024-09-16T03:25:55.296 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]", 2024-09-16T03:25:55.297 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:25:55.297 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:25:55.297 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:25:55.297 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:25:55.297 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:25:55.297 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:25:55.297 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:25:55.297 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:25:55.297 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:25:55.297 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/2", 2024-09-16T03:25:55.297 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:25:55.297 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:25:55.297 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:25:55.298 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:55.298 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:55.298 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_clean_epochs": { 2024-09-16T03:25:55.298 INFO:tasks.workunit.client.0.smithi096.stderr: "min_last_epoch_clean": 28, 2024-09-16T03:25:55.298 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": { 2024-09-16T03:25:55.298 INFO:tasks.workunit.client.0.smithi096.stderr: "per_pool": [ 2024-09-16T03:25:55.298 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.298 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 1, 2024-09-16T03:25:55.298 INFO:tasks.workunit.client.0.smithi096.stderr: "floor": 28 2024-09-16T03:25:55.298 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.298 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.298 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 2, 2024-09-16T03:25:55.298 INFO:tasks.workunit.client.0.smithi096.stderr: "floor": 28 2024-09-16T03:25:55.298 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:55.299 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:55.299 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.299 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_epochs": [ 2024-09-16T03:25:55.299 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.299 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:25:55.299 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 78 2024-09-16T03:25:55.299 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.299 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.299 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:25:55.299 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 80 2024-09-16T03:25:55.299 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:55.299 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:55.299 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.300 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_first_committed": 28, 2024-09-16T03:25:55.300 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_last_committed": 80, 2024-09-16T03:25:55.300 INFO:tasks.workunit.client.0.smithi096.stderr: "crushmap": { 2024-09-16T03:25:55.300 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": [ 2024-09-16T03:25:55.300 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.300 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:25:55.300 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.0", 2024-09-16T03:25:55.300 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:25:55.300 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.300 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.300 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:25:55.300 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.1", 2024-09-16T03:25:55.300 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:25:55.300 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.301 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.301 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:25:55.301 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.2", 2024-09-16T03:25:55.301 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:25:55.301 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:55.301 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:55.301 INFO:tasks.workunit.client.0.smithi096.stderr: "types": [ 2024-09-16T03:25:55.301 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.301 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 0, 2024-09-16T03:25:55.301 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd" 2024-09-16T03:25:55.301 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.301 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.301 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:25:55.302 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "host" 2024-09-16T03:25:55.302 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.302 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.302 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 2, 2024-09-16T03:25:55.302 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "chassis" 2024-09-16T03:25:55.302 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.302 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.302 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 3, 2024-09-16T03:25:55.302 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "rack" 2024-09-16T03:25:55.302 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.302 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.302 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 4, 2024-09-16T03:25:55.302 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "row" 2024-09-16T03:25:55.303 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.303 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.303 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 5, 2024-09-16T03:25:55.303 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "pdu" 2024-09-16T03:25:55.303 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.303 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.303 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 6, 2024-09-16T03:25:55.303 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "pod" 2024-09-16T03:25:55.303 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.303 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.303 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 7, 2024-09-16T03:25:55.303 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "room" 2024-09-16T03:25:55.303 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.303 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.304 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 8, 2024-09-16T03:25:55.304 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "datacenter" 2024-09-16T03:25:55.304 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.304 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.304 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 9, 2024-09-16T03:25:55.304 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "zone" 2024-09-16T03:25:55.304 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.304 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.304 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 10, 2024-09-16T03:25:55.304 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "region" 2024-09-16T03:25:55.304 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.304 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.304 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:25:55.305 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "root" 2024-09-16T03:25:55.305 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:55.305 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:55.305 INFO:tasks.workunit.client.0.smithi096.stderr: "buckets": [ 2024-09-16T03:25:55.305 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.305 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -1, 2024-09-16T03:25:55.305 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "default", 2024-09-16T03:25:55.305 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:25:55.305 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "root", 2024-09-16T03:25:55.305 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:25:55.306 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:25:55.306 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:25:55.306 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:25:55.306 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.306 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -3, 2024-09-16T03:25:55.306 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:25:55.306 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:25:55.306 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:55.306 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:55.307 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.307 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.307 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -2, 2024-09-16T03:25:55.307 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "default~hdd", 2024-09-16T03:25:55.307 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:25:55.307 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "root", 2024-09-16T03:25:55.307 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:25:55.307 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:25:55.307 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:25:55.307 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:25:55.307 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.307 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -4, 2024-09-16T03:25:55.307 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:25:55.307 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:25:55.308 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:55.308 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:55.308 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.308 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.308 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -3, 2024-09-16T03:25:55.308 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "smithi096", 2024-09-16T03:25:55.308 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:25:55.308 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "host", 2024-09-16T03:25:55.308 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:25:55.308 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:25:55.308 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:25:55.308 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:25:55.309 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.309 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:25:55.309 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:25:55.309 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:25:55.309 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.309 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.309 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:25:55.309 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:25:55.309 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 1 2024-09-16T03:25:55.309 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.309 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.309 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:25:55.309 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:25:55.310 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 2 2024-09-16T03:25:55.310 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:55.310 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:55.310 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.310 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.310 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -4, 2024-09-16T03:25:55.310 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "smithi096~hdd", 2024-09-16T03:25:55.310 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:25:55.310 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "host", 2024-09-16T03:25:55.310 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:25:55.310 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:25:55.310 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:25:55.310 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:25:55.310 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.311 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:25:55.311 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:25:55.311 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:25:55.311 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.311 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.311 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:25:55.311 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:25:55.311 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 1 2024-09-16T03:25:55.311 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.311 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.311 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:25:55.311 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:25:55.311 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 2 2024-09-16T03:25:55.311 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:55.312 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:55.312 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:55.312 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:55.312 INFO:tasks.workunit.client.0.smithi096.stderr: "rules": [ 2024-09-16T03:25:55.312 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.312 INFO:tasks.workunit.client.0.smithi096.stderr: "rule_id": 0, 2024-09-16T03:25:55.312 INFO:tasks.workunit.client.0.smithi096.stderr: "rule_name": "replicated_rule", 2024-09-16T03:25:55.312 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:25:55.312 INFO:tasks.workunit.client.0.smithi096.stderr: "steps": [ 2024-09-16T03:25:55.312 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.312 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "take", 2024-09-16T03:25:55.312 INFO:tasks.workunit.client.0.smithi096.stderr: "item": -1, 2024-09-16T03:25:55.313 INFO:tasks.workunit.client.0.smithi096.stderr: "item_name": "default" 2024-09-16T03:25:55.313 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.313 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.313 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "choose_firstn", 2024-09-16T03:25:55.313 INFO:tasks.workunit.client.0.smithi096.stderr: "num": 0, 2024-09-16T03:25:55.316 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "osd" 2024-09-16T03:25:55.316 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.316 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.317 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "emit" 2024-09-16T03:25:55.317 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:55.317 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:55.317 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:55.317 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:55.317 INFO:tasks.workunit.client.0.smithi096.stderr: "tunables": { 2024-09-16T03:25:55.317 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_local_tries": 0, 2024-09-16T03:25:55.317 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_local_fallback_tries": 0, 2024-09-16T03:25:55.317 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_total_tries": 50, 2024-09-16T03:25:55.317 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_descend_once": 1, 2024-09-16T03:25:55.317 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_vary_r": 1, 2024-09-16T03:25:55.317 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_stable": 1, 2024-09-16T03:25:55.318 INFO:tasks.workunit.client.0.smithi096.stderr: "msr_descents": 100, 2024-09-16T03:25:55.318 INFO:tasks.workunit.client.0.smithi096.stderr: "msr_collision_tries": 100, 2024-09-16T03:25:55.318 INFO:tasks.workunit.client.0.smithi096.stderr: "straw_calc_version": 1, 2024-09-16T03:25:55.318 INFO:tasks.workunit.client.0.smithi096.stderr: "allowed_bucket_algs": 54, 2024-09-16T03:25:55.318 INFO:tasks.workunit.client.0.smithi096.stderr: "profile": "jewel", 2024-09-16T03:25:55.318 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_tunables": 1, 2024-09-16T03:25:55.319 INFO:tasks.workunit.client.0.smithi096.stderr: "legacy_tunables": 0, 2024-09-16T03:25:55.319 INFO:tasks.workunit.client.0.smithi096.stderr: "minimum_required_version": "jewel", 2024-09-16T03:25:55.319 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables": 1, 2024-09-16T03:25:55.319 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables2": 1, 2024-09-16T03:25:55.319 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v2_rules": 0, 2024-09-16T03:25:55.319 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables3": 1, 2024-09-16T03:25:55.319 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v3_rules": 0, 2024-09-16T03:25:55.319 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v4_buckets": 1, 2024-09-16T03:25:55.319 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables5": 1, 2024-09-16T03:25:55.319 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v5_rules": 0, 2024-09-16T03:25:55.319 INFO:tasks.workunit.client.0.smithi096.stderr: "has_msr_rules": 0 2024-09-16T03:25:55.319 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.319 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_args": {} 2024-09-16T03:25:55.319 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.320 INFO:tasks.workunit.client.0.smithi096.stderr: "fsmap": { 2024-09-16T03:25:55.320 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 1, 2024-09-16T03:25:55.320 INFO:tasks.workunit.client.0.smithi096.stderr: "btime": "2024-09-16T03:22:46:882186+0000", 2024-09-16T03:25:55.320 INFO:tasks.workunit.client.0.smithi096.stderr: "default_fscid": -1, 2024-09-16T03:25:55.320 INFO:tasks.workunit.client.0.smithi096.stderr: "compat": { 2024-09-16T03:25:55.320 INFO:tasks.workunit.client.0.smithi096.stderr: "compat": {}, 2024-09-16T03:25:55.320 INFO:tasks.workunit.client.0.smithi096.stderr: "ro_compat": {}, 2024-09-16T03:25:55.320 INFO:tasks.workunit.client.0.smithi096.stderr: "incompat": { 2024-09-16T03:25:55.320 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_1": "base v0.20", 2024-09-16T03:25:55.320 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_2": "client writeable ranges", 2024-09-16T03:25:55.320 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_3": "default file layouts on dirs", 2024-09-16T03:25:55.320 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_4": "dir inode in separate object", 2024-09-16T03:25:55.320 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_5": "mds uses versioned encoding", 2024-09-16T03:25:55.321 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_6": "dirfrag is stored in omap", 2024-09-16T03:25:55.321 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_8": "no anchor table", 2024-09-16T03:25:55.321 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_9": "file layout v2", 2024-09-16T03:25:55.321 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_10": "snaprealm v2", 2024-09-16T03:25:55.321 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_11": "minor log segments", 2024-09-16T03:25:55.321 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_12": "quiesce subvolumes" 2024-09-16T03:25:55.321 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:55.321 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.321 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_flags": { 2024-09-16T03:25:55.321 INFO:tasks.workunit.client.0.smithi096.stderr: "enable_multiple": true, 2024-09-16T03:25:55.321 INFO:tasks.workunit.client.0.smithi096.stderr: "ever_enabled_multiple": true 2024-09-16T03:25:55.321 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.322 INFO:tasks.workunit.client.0.smithi096.stderr: "standbys": [], 2024-09-16T03:25:55.322 INFO:tasks.workunit.client.0.smithi096.stderr: "filesystems": [] 2024-09-16T03:25:55.322 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.322 INFO:tasks.workunit.client.0.smithi096.stderr: "mdsmap_first_committed": 1, 2024-09-16T03:25:55.322 INFO:tasks.workunit.client.0.smithi096.stderr: "mdsmap_last_committed": 1, 2024-09-16T03:25:55.322 INFO:tasks.workunit.client.0.smithi096.stderr: "auth": { 2024-09-16T03:25:55.322 INFO:tasks.workunit.client.0.smithi096.stderr: "first_committed": 1, 2024-09-16T03:25:55.322 INFO:tasks.workunit.client.0.smithi096.stderr: "last_committed": 5, 2024-09-16T03:25:55.322 INFO:tasks.workunit.client.0.smithi096.stderr: "num_secrets": 3 2024-09-16T03:25:55.322 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.322 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 64, 2024-09-16T03:25:55.322 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_active": 64, 2024-09-16T03:25:55.322 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_unknown": 0, 2024-09-16T03:25:55.323 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osd": 3, 2024-09-16T03:25:55.323 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_sum": { 2024-09-16T03:25:55.323 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:25:55.323 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:25:55.323 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:25:55.323 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:25:55.323 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:25:55.323 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:25:55.323 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:25:55.323 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:25:55.323 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:25:55.323 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:25:55.323 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:25:55.323 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:25:55.324 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:25:55.324 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:25:55.324 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:25:55.324 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:25:55.324 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:25:55.324 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:25:55.324 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:25:55.324 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:25:55.324 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:25:55.324 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:25:55.324 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:25:55.325 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:25:55.325 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:25:55.325 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:25:55.325 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:25:55.325 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:25:55.325 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:25:55.325 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:25:55.325 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:25:55.325 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:25:55.325 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:25:55.325 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:25:55.325 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:25:55.325 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:25:55.326 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:25:55.326 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:25:55.326 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:25:55.326 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:25:55.326 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:25:55.326 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.326 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:25:55.326 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:25:55.326 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:25:55.326 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:25:55.326 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:25:55.326 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:25:55.326 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:25:55.326 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:25:55.327 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:25:55.327 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:25:55.327 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:25:55.327 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.327 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:25:55.327 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:25:55.327 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 128, 2024-09-16T03:25:55.327 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 128, 2024-09-16T03:25:55.328 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 0 2024-09-16T03:25:55.328 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.328 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_sum": { 2024-09-16T03:25:55.328 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 0, 2024-09-16T03:25:55.328 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 0, 2024-09-16T03:25:55.328 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pgs": 128, 2024-09-16T03:25:55.328 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osds": 2, 2024-09-16T03:25:55.328 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_osds": 2, 2024-09-16T03:25:55.328 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_omap_osds": 2, 2024-09-16T03:25:55.328 INFO:tasks.workunit.client.0.smithi096.stderr: "kb": 209715200, 2024-09-16T03:25:55.328 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used": 54560, 2024-09-16T03:25:55.328 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_data": 832, 2024-09-16T03:25:55.329 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_omap": 3, 2024-09-16T03:25:55.329 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_meta": 53628, 2024-09-16T03:25:55.329 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_avail": 209660640, 2024-09-16T03:25:55.329 INFO:tasks.workunit.client.0.smithi096.stderr: "statfs": { 2024-09-16T03:25:55.329 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 214748364800, 2024-09-16T03:25:55.329 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 214692495360, 2024-09-16T03:25:55.329 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:25:55.329 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 851968, 2024-09-16T03:25:55.329 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 318404, 2024-09-16T03:25:55.330 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:25:55.330 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:25:55.330 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:25:55.330 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 3190, 2024-09-16T03:25:55.330 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 54915978 2024-09-16T03:25:55.330 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.330 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_peers": [], 2024-09-16T03:25:55.330 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_trim_queue_len": 0, 2024-09-16T03:25:55.330 INFO:tasks.workunit.client.0.smithi096.stderr: "num_snap_trimming": 0, 2024-09-16T03:25:55.331 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shards_repaired": 0, 2024-09-16T03:25:55.331 INFO:tasks.workunit.client.0.smithi096.stderr: "op_queue_age_hist": { 2024-09-16T03:25:55.331 INFO:tasks.workunit.client.0.smithi096.stderr: "histogram": [], 2024-09-16T03:25:55.331 INFO:tasks.workunit.client.0.smithi096.stderr: "upper_bound": 1 2024-09-16T03:25:55.331 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.331 INFO:tasks.workunit.client.0.smithi096.stderr: "perf_stat": { 2024-09-16T03:25:55.331 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ms": 256, 2024-09-16T03:25:55.331 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ms": 256, 2024-09-16T03:25:55.331 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ns": 256000000, 2024-09-16T03:25:55.331 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ns": 256000000 2024-09-16T03:25:55.331 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.331 INFO:tasks.workunit.client.0.smithi096.stderr: "alerts": [], 2024-09-16T03:25:55.331 INFO:tasks.workunit.client.0.smithi096.stderr: "network_ping_times": [] 2024-09-16T03:25:55.332 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.332 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_sum_by_class": { 2024-09-16T03:25:55.332 INFO:tasks.workunit.client.0.smithi096.stderr: "hdd": { 2024-09-16T03:25:55.332 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 0, 2024-09-16T03:25:55.332 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 0, 2024-09-16T03:25:55.332 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pgs": 128, 2024-09-16T03:25:55.332 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osds": 2, 2024-09-16T03:25:55.332 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_osds": 2, 2024-09-16T03:25:55.332 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_omap_osds": 2, 2024-09-16T03:25:55.332 INFO:tasks.workunit.client.0.smithi096.stderr: "kb": 209715200, 2024-09-16T03:25:55.332 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used": 54560, 2024-09-16T03:25:55.332 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_data": 832, 2024-09-16T03:25:55.332 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_omap": 3, 2024-09-16T03:25:55.333 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_meta": 53628, 2024-09-16T03:25:55.333 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_avail": 209660640, 2024-09-16T03:25:55.333 INFO:tasks.workunit.client.0.smithi096.stderr: "statfs": { 2024-09-16T03:25:55.333 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 214748364800, 2024-09-16T03:25:55.333 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 214692495360, 2024-09-16T03:25:55.333 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:25:55.333 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 851968, 2024-09-16T03:25:55.333 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 318404, 2024-09-16T03:25:55.333 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:25:55.333 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:25:55.333 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:25:55.333 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 3190, 2024-09-16T03:25:55.333 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 54915978 2024-09-16T03:25:55.333 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.334 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_peers": [], 2024-09-16T03:25:55.334 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_trim_queue_len": 0, 2024-09-16T03:25:55.334 INFO:tasks.workunit.client.0.smithi096.stderr: "num_snap_trimming": 0, 2024-09-16T03:25:55.334 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shards_repaired": 0, 2024-09-16T03:25:55.334 INFO:tasks.workunit.client.0.smithi096.stderr: "op_queue_age_hist": { 2024-09-16T03:25:55.334 INFO:tasks.workunit.client.0.smithi096.stderr: "histogram": [], 2024-09-16T03:25:55.334 INFO:tasks.workunit.client.0.smithi096.stderr: "upper_bound": 1 2024-09-16T03:25:55.334 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.334 INFO:tasks.workunit.client.0.smithi096.stderr: "perf_stat": { 2024-09-16T03:25:55.334 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ms": 256, 2024-09-16T03:25:55.334 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ms": 256, 2024-09-16T03:25:55.334 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ns": 256000000, 2024-09-16T03:25:55.334 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ns": 256000000 2024-09-16T03:25:55.334 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.335 INFO:tasks.workunit.client.0.smithi096.stderr: "alerts": [], 2024-09-16T03:25:55.335 INFO:tasks.workunit.client.0.smithi096.stderr: "network_ping_times": [] 2024-09-16T03:25:55.335 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:55.335 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.335 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_stats": [ 2024-09-16T03:25:55.335 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.335 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 2, 2024-09-16T03:25:55.335 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 32, 2024-09-16T03:25:55.335 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:25:55.335 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:25:55.335 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:25:55.335 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:25:55.335 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:25:55.335 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:25:55.336 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:25:55.336 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:25:55.336 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:25:55.336 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:25:55.336 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:25:55.336 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:25:55.336 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:25:55.336 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:25:55.336 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:25:55.336 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:25:55.336 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:25:55.336 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:25:55.336 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:25:55.337 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:25:55.337 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:25:55.337 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:25:55.337 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:25:55.337 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:25:55.337 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:25:55.337 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:25:55.337 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:25:55.337 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:25:55.337 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:25:55.337 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:25:55.337 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:25:55.338 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:25:55.338 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:25:55.338 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:25:55.338 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:25:55.338 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:25:55.338 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:25:55.338 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:25:55.338 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:25:55.338 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:25:55.338 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:25:55.339 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.339 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:25:55.339 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:25:55.339 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:25:55.339 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:25:55.339 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:25:55.339 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:25:55.339 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:25:55.339 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:25:55.340 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:25:55.340 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:25:55.340 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:25:55.340 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.340 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:25:55.340 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:25:55.340 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 64, 2024-09-16T03:25:55.340 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 64, 2024-09-16T03:25:55.340 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 3 2024-09-16T03:25:55.340 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.340 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.340 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 1, 2024-09-16T03:25:55.340 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 32, 2024-09-16T03:25:55.340 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:25:55.341 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:25:55.341 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:25:55.341 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:25:55.341 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:25:55.341 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:25:55.341 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:25:55.341 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:25:55.341 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:25:55.341 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:25:55.341 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:25:55.341 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:25:55.341 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:25:55.342 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:25:55.342 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:25:55.342 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:25:55.342 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:25:55.342 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:25:55.342 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:25:55.342 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:25:55.342 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:25:55.342 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:25:55.342 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:25:55.342 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:25:55.342 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:25:55.342 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:25:55.342 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:25:55.343 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:25:55.343 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:25:55.343 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:25:55.343 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:25:55.343 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:25:55.343 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:25:55.343 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:25:55.343 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:25:55.343 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:25:55.343 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:25:55.343 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:25:55.343 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:25:55.343 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:25:55.343 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:25:55.344 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.344 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:25:55.344 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:25:55.344 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:25:55.344 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:25:55.344 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:25:55.344 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:25:55.344 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:25:55.344 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:25:55.344 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:25:55.344 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:25:55.344 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:25:55.345 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.345 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:25:55.345 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:25:55.345 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 64, 2024-09-16T03:25:55.345 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 64, 2024-09-16T03:25:55.345 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 3 2024-09-16T03:25:55.345 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:55.345 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:55.345 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_stats": [ 2024-09-16T03:25:55.345 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.345 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:25:55.345 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 21474836517 2024-09-16T03:25:55.346 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.346 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.346 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:25:55.346 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 42949672988 2024-09-16T03:25:55.346 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.346 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.346 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:25:55.346 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 0 2024-09-16T03:25:55.346 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:55.346 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:55.346 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_by_state": [ 2024-09-16T03:25:55.346 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.346 INFO:tasks.workunit.client.0.smithi096.stderr: "state": "active+undersized", 2024-09-16T03:25:55.346 INFO:tasks.workunit.client.0.smithi096.stderr: "num": 64 2024-09-16T03:25:55.347 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:55.347 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:55.347 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_by_osd": [ 2024-09-16T03:25:55.347 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.347 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:25:55.347 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 0, 2024-09-16T03:25:55.347 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 0, 2024-09-16T03:25:55.347 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:25:55.347 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.347 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.347 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:25:55.347 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 28, 2024-09-16T03:25:55.347 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 64, 2024-09-16T03:25:55.348 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:25:55.348 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.348 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.348 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:25:55.348 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 36, 2024-09-16T03:25:55.348 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 64, 2024-09-16T03:25:55.348 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:25:55.348 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:55.348 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:55.348 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": [ 2024-09-16T03:25:55.349 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.349 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 1, 2024-09-16T03:25:55.349 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": {} 2024-09-16T03:25:55.349 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.349 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.349 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 2, 2024-09-16T03:25:55.349 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": {} 2024-09-16T03:25:55.349 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:55.349 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:55.349 INFO:tasks.workunit.client.0.smithi096.stderr: "servicemap": { 2024-09-16T03:25:55.350 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 5, 2024-09-16T03:25:55.350 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:25:38.422788+0000", 2024-09-16T03:25:55.350 INFO:tasks.workunit.client.0.smithi096.stderr: "services": {} 2024-09-16T03:25:55.350 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.350 INFO:tasks.workunit.client.0.smithi096.stderr: "mgrstat_first_committed": 77, 2024-09-16T03:25:55.350 INFO:tasks.workunit.client.0.smithi096.stderr: "mgrstat_last_committed": 83, 2024-09-16T03:25:55.350 INFO:tasks.workunit.client.0.smithi096.stderr: "logm_first_committed": 1, 2024-09-16T03:25:55.350 INFO:tasks.workunit.client.0.smithi096.stderr: "logm_last_committed": 361, 2024-09-16T03:25:55.350 INFO:tasks.workunit.client.0.smithi096.stderr: "paxos": { 2024-09-16T03:25:55.350 INFO:tasks.workunit.client.0.smithi096.stderr: "first_committed": 1, 2024-09-16T03:25:55.350 INFO:tasks.workunit.client.0.smithi096.stderr: "last_committed": 540, 2024-09-16T03:25:55.351 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pn": 0, 2024-09-16T03:25:55.351 INFO:tasks.workunit.client.0.smithi096.stderr: "accepted_pn": 0 2024-09-16T03:25:55.351 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:55.351 INFO:tasks.workunit.client.0.smithi096.stderr:}' 2024-09-16T03:25:55.354 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:121: validate_fc: jq .osdmap_clean_epochs.min_last_epoch_clean 2024-09-16T03:25:55.354 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:121: validate_fc: echo '{' '"cluster_fingerprint":' '"fda2fc64-07ed-4add-8224-2e527e11d427",' '"version":' '"19.3.0-4930-gfc3e0bff",' '"commit":' '"fc3e0bff7468fd55478adbae7f75508b749124b6",' '"timestamp":' '"2024-09-16T03:25:55.224366+0000",' '"tag":' '"",' '"health":' '{' '"status":' '"HEALTH_OK",' '"checks":' '{},' '"mutes":' '[]' '},' '"monmap_first_committed":' 1, '"monmap_last_committed":' 1, '"monmap":' '{' '"epoch":' 1, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"modified":' '"2024-09-16T03:22:45.872880Z",' '"created":' '"2024-09-16T03:22:45.872880Z",' '"min_mon_release":' 19, '"min_mon_release_name":' '"squid",' '"election_strategy":' 1, '"disallowed_leaders:' '":' '"",' '"stretch_mode":' false, '"tiebreaker_mon":' '"",' '"removed_ranks:' '":' '"",' '"features":' '{' '"persistent":' '[' '"kraken",' '"luminous",' '"mimic",' '"osdmap-prune",' '"nautilus",' '"octopus",' '"pacific",' '"elector-pinging",' '"quincy",' '"reef",' '"squid"' '],' '"optional":' '[]' '},' '"mons":' '[' '{' '"rank":' 0, '"name":' '"a",' '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:7302",' '"nonce":' 0 '}' ']' '},' '"addr":' '"127.0.0.1:7302/0",' '"public_addr":' '"127.0.0.1:7302/0",' '"priority":' 0, '"weight":' 0, '"crush_location":' '"{}"' '}' ']' '},' '"quorum":' '[' 0 '],' '"osdmap":' '{' '"epoch":' 80, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"created":' '"2024-09-16T03:22:46.906117+0000",' '"modified":' '"2024-09-16T03:25:52.948673+0000",' '"last_up_change":' '"2024-09-16T03:25:08.513363+0000",' '"last_in_change":' '"2024-09-16T03:25:09.839444+0000",' '"flags":' '"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit",' '"flags_num":' 5799936, '"flags_set":' '[' '"pglog_hardlimit",' '"purged_snapdirs",' '"recovery_deletes",' '"sortbitwise"' '],' '"crush_version":' 7, '"full_ratio":' 0.97000002861022949, '"backfillfull_ratio":' 0.97000002861022949, '"nearfull_ratio":' 0.85000002384185791, '"cluster_snapshot":' '"",' '"pool_max":' 2, '"max_osd":' 3, '"require_min_compat_client":' '"luminous",' '"min_compat_client":' '"jewel",' '"require_osd_release":' '"squid",' '"allow_crimson":' false, '"pools":' '[' '{' '"pool":' 1, '"pool_name":' '"foo",' '"create_time":' '"2024-09-16T03:24:44.525189+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"30",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.8700000047683716, '"score_stable":' 1.8700000047683716, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1.25, '"raw_score_stable":' 1.25, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '},' '{' '"pool":' 2, '"pool_name":' '"bar",' '"create_time":' '"2024-09-16T03:24:46.226575+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"32",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.4900000095367432, '"score_stable":' 1.4900000095367432, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1, '"raw_score_stable":' 1, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '}' '],' '"osds":' '[' '{' '"osd":' 0, '"uuid":' '"64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 5, '"up_thru":' 33, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6802",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6803",' '"nonce":' 3375787448 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6804",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6805",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6808",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6809",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6806",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6807",' '"nonce":' 3375787448 '}' ']' '},' '"public_addr":' '"127.0.0.1:6803/3375787448",' '"cluster_addr":' '"127.0.0.1:6805/3375787448",' '"heartbeat_back_addr":' '"127.0.0.1:6809/3375787448",' '"heartbeat_front_addr":' '"127.0.0.1:6807/3375787448",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 1, '"uuid":' '"74b26727-75c9-444d-8782-719e4197a382",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 10, '"up_thru":' 33, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6810",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6811",' '"nonce":' 3733255132 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6812",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6813",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6816",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6817",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6814",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6815",' '"nonce":' 3733255132 '}' ']' '},' '"public_addr":' '"127.0.0.1:6811/3733255132",' '"cluster_addr":' '"127.0.0.1:6813/3733255132",' '"heartbeat_back_addr":' '"127.0.0.1:6817/3733255132",' '"heartbeat_front_addr":' '"127.0.0.1:6815/3733255132",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 2, '"uuid":' '"143da3a7-dad9-4b1e-966b-76cf5bdd3c82",' '"up":' 0, '"in":' 0, '"weight":' 0, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 15, '"up_thru":' 21, '"down_at":' 33, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6818",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6819",' '"nonce":' 963814857 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6820",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6821",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6824",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6825",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6822",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6823",' '"nonce":' 963814857 '}' ']' '},' '"public_addr":' '"127.0.0.1:6819/963814857",' '"cluster_addr":' '"127.0.0.1:6821/963814857",' '"heartbeat_back_addr":' '"127.0.0.1:6825/963814857",' '"heartbeat_front_addr":' '"127.0.0.1:6823/963814857",' '"state":' '[' '"exists"' ']' '}' '],' '"osd_xinfo":' '[' '{' '"osd":' 0, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:22.481942+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 1, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:59.663703+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 2, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 65536, '"last_purged_snaps_scrub":' '"2024-09-16T03:24:37.320822+0000",' '"dead_epoch":' 32 '}' '],' '"pg_upmap":' '[],' '"pg_upmap_items":' '[],' '"pg_upmap_primaries":' '[],' '"pg_temp":' '[],' '"primary_temp":' '[],' '"blocklist":' '{},' '"range_blocklist":' '{},' '"erasure_code_profiles":' '{' '"default":' '{' '"k":' '"2",' '"m":' '"2",' '"plugin":' '"jerasure",' '"technique":' '"reed_sol_van"' '}' '},' '"removed_snaps_queue":' '[],' '"new_removed_snaps":' '[],' '"new_purged_snaps":' '[],' '"crush_node_flags":' '{},' '"device_class_flags":' '{},' '"stretch_mode":' '{' '"stretch_mode_enabled":' false, '"stretch_bucket_count":' 0, '"degraded_stretch_mode":' 0, '"recovering_stretch_mode":' 0, '"stretch_mode_bucket":' 0 '}' '},' '"osd_metadata":' '[' '{' '"id":' 0, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/0/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:22:53.662571Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]",' '"hb_front_addr":' '"[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/0",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 1, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/1/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:23:30.129885Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]",' '"hb_front_addr":' '"[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/1",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 2, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/2/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:24:07.764502Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]",' '"hb_front_addr":' '"[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/2",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '}' '],' '"osdmap_clean_epochs":' '{' '"min_last_epoch_clean":' 28, '"last_epoch_clean":' '{' '"per_pool":' '[' '{' '"poolid":' 1, '"floor":' 28 '},' '{' '"poolid":' 2, '"floor":' 28 '}' ']' '},' '"osd_epochs":' '[' '{' '"id":' 0, '"epoch":' 78 '},' '{' '"id":' 1, '"epoch":' 80 '}' ']' '},' '"osdmap_first_committed":' 28, '"osdmap_last_committed":' 80, '"crushmap":' '{' '"devices":' '[' '{' '"id":' 0, '"name":' '"osd.0",' '"class":' '"hdd"' '},' '{' '"id":' 1, '"name":' '"osd.1",' '"class":' '"hdd"' '},' '{' '"id":' 2, '"name":' '"osd.2",' '"class":' '"hdd"' '}' '],' '"types":' '[' '{' '"type_id":' 0, '"name":' '"osd"' '},' '{' '"type_id":' 1, '"name":' '"host"' '},' '{' '"type_id":' 2, '"name":' '"chassis"' '},' '{' '"type_id":' 3, '"name":' '"rack"' '},' '{' '"type_id":' 4, '"name":' '"row"' '},' '{' '"type_id":' 5, '"name":' '"pdu"' '},' '{' '"type_id":' 6, '"name":' '"pod"' '},' '{' '"type_id":' 7, '"name":' '"room"' '},' '{' '"type_id":' 8, '"name":' '"datacenter"' '},' '{' '"type_id":' 9, '"name":' '"zone"' '},' '{' '"type_id":' 10, '"name":' '"region"' '},' '{' '"type_id":' 11, '"name":' '"root"' '}' '],' '"buckets":' '[' '{' '"id":' -1, '"name":' '"default",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -3, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -2, '"name":' '"default~hdd",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -4, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -3, '"name":' '"smithi096",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '},' '{' '"id":' -4, '"name":' '"smithi096~hdd",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '}' '],' '"rules":' '[' '{' '"rule_id":' 0, '"rule_name":' '"replicated_rule",' '"type":' 1, '"steps":' '[' '{' '"op":' '"take",' '"item":' -1, '"item_name":' '"default"' '},' '{' '"op":' '"choose_firstn",' '"num":' 0, '"type":' '"osd"' '},' '{' '"op":' '"emit"' '}' ']' '}' '],' '"tunables":' '{' '"choose_local_tries":' 0, '"choose_local_fallback_tries":' 0, '"choose_total_tries":' 50, '"chooseleaf_descend_once":' 1, '"chooseleaf_vary_r":' 1, '"chooseleaf_stable":' 1, '"msr_descents":' 100, '"msr_collision_tries":' 100, '"straw_calc_version":' 1, '"allowed_bucket_algs":' 54, '"profile":' '"jewel",' '"optimal_tunables":' 1, '"legacy_tunables":' 0, '"minimum_required_version":' '"jewel",' '"require_feature_tunables":' 1, '"require_feature_tunables2":' 1, '"has_v2_rules":' 0, '"require_feature_tunables3":' 1, '"has_v3_rules":' 0, '"has_v4_buckets":' 1, '"require_feature_tunables5":' 1, '"has_v5_rules":' 0, '"has_msr_rules":' 0 '},' '"choose_args":' '{}' '},' '"fsmap":' '{' '"epoch":' 1, '"btime":' '"2024-09-16T03:22:46:882186+0000",' '"default_fscid":' -1, '"compat":' '{' '"compat":' '{},' '"ro_compat":' '{},' '"incompat":' '{' '"feature_1":' '"base' 'v0.20",' '"feature_2":' '"client' writeable 'ranges",' '"feature_3":' '"default' file layouts on 'dirs",' '"feature_4":' '"dir' inode in separate 'object",' '"feature_5":' '"mds' uses versioned 'encoding",' '"feature_6":' '"dirfrag' is stored in 'omap",' '"feature_8":' '"no' anchor 'table",' '"feature_9":' '"file' layout 'v2",' '"feature_10":' '"snaprealm' 'v2",' '"feature_11":' '"minor' log 'segments",' '"feature_12":' '"quiesce' 'subvolumes"' '}' '},' '"feature_flags":' '{' '"enable_multiple":' true, '"ever_enabled_multiple":' true '},' '"standbys":' '[],' '"filesystems":' '[]' '},' '"mdsmap_first_committed":' 1, '"mdsmap_last_committed":' 1, '"auth":' '{' '"first_committed":' 1, '"last_committed":' 5, '"num_secrets":' 3 '},' '"num_pg":' 64, '"num_pg_active":' 64, '"num_pg_unknown":' 0, '"num_osd":' 3, '"pool_sum":' '{' '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 128, '"acting":' 128, '"num_store_stats":' 0 '},' '"osd_sum":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54560, '"kb_used_data":' 832, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660640, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692495360, '"internally_reserved":' 0, '"allocated":' 851968, '"data_stored":' 318404, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 256, '"apply_latency_ms":' 256, '"commit_latency_ns":' 256000000, '"apply_latency_ns":' 256000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '},' '"osd_sum_by_class":' '{' '"hdd":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54560, '"kb_used_data":' 832, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660640, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692495360, '"internally_reserved":' 0, '"allocated":' 851968, '"data_stored":' 318404, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 256, '"apply_latency_ms":' 256, '"commit_latency_ns":' 256000000, '"apply_latency_ns":' 256000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '}' '},' '"pool_stats":' '[' '{' '"poolid":' 2, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '},' '{' '"poolid":' 1, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '}' '],' '"osd_stats":' '[' '{' '"osd":' 0, '"seq":' 21474836517 '},' '{' '"osd":' 1, '"seq":' 42949672988 '},' '{' '"osd":' 2, '"seq":' 0 '}' '],' '"num_pg_by_state":' '[' '{' '"state":' '"active+undersized",' '"num":' 64 '}' '],' '"num_pg_by_osd":' '[' '{' '"osd":' 2, '"num_primary_pg":' 0, '"num_acting_pg":' 0, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 0, '"num_primary_pg":' 28, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 1, '"num_primary_pg":' 36, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '}' '],' '"purged_snaps":' '[' '{' '"pool":' 1, '"purged_snaps":' '{}' '},' '{' '"pool":' 2, '"purged_snaps":' '{}' '}' '],' '"servicemap":' '{' '"epoch":' 5, '"modified":' '"2024-09-16T03:25:38.422788+0000",' '"services":' '{}' '},' '"mgrstat_first_committed":' 77, '"mgrstat_last_committed":' 83, '"logm_first_committed":' 1, '"logm_last_committed":' 361, '"paxos":' '{' '"first_committed":' 1, '"last_committed":' 540, '"last_pn":' 0, '"accepted_pn":' 0 '}' '}' 2024-09-16T03:25:55.355 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:121: validate_fc: lec=28 2024-09-16T03:25:55.355 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:123: validate_fc: jq .osdmap_first_committed 2024-09-16T03:25:55.355 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:123: validate_fc: echo '{' '"cluster_fingerprint":' '"fda2fc64-07ed-4add-8224-2e527e11d427",' '"version":' '"19.3.0-4930-gfc3e0bff",' '"commit":' '"fc3e0bff7468fd55478adbae7f75508b749124b6",' '"timestamp":' '"2024-09-16T03:25:55.224366+0000",' '"tag":' '"",' '"health":' '{' '"status":' '"HEALTH_OK",' '"checks":' '{},' '"mutes":' '[]' '},' '"monmap_first_committed":' 1, '"monmap_last_committed":' 1, '"monmap":' '{' '"epoch":' 1, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"modified":' '"2024-09-16T03:22:45.872880Z",' '"created":' '"2024-09-16T03:22:45.872880Z",' '"min_mon_release":' 19, '"min_mon_release_name":' '"squid",' '"election_strategy":' 1, '"disallowed_leaders:' '":' '"",' '"stretch_mode":' false, '"tiebreaker_mon":' '"",' '"removed_ranks:' '":' '"",' '"features":' '{' '"persistent":' '[' '"kraken",' '"luminous",' '"mimic",' '"osdmap-prune",' '"nautilus",' '"octopus",' '"pacific",' '"elector-pinging",' '"quincy",' '"reef",' '"squid"' '],' '"optional":' '[]' '},' '"mons":' '[' '{' '"rank":' 0, '"name":' '"a",' '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:7302",' '"nonce":' 0 '}' ']' '},' '"addr":' '"127.0.0.1:7302/0",' '"public_addr":' '"127.0.0.1:7302/0",' '"priority":' 0, '"weight":' 0, '"crush_location":' '"{}"' '}' ']' '},' '"quorum":' '[' 0 '],' '"osdmap":' '{' '"epoch":' 80, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"created":' '"2024-09-16T03:22:46.906117+0000",' '"modified":' '"2024-09-16T03:25:52.948673+0000",' '"last_up_change":' '"2024-09-16T03:25:08.513363+0000",' '"last_in_change":' '"2024-09-16T03:25:09.839444+0000",' '"flags":' '"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit",' '"flags_num":' 5799936, '"flags_set":' '[' '"pglog_hardlimit",' '"purged_snapdirs",' '"recovery_deletes",' '"sortbitwise"' '],' '"crush_version":' 7, '"full_ratio":' 0.97000002861022949, '"backfillfull_ratio":' 0.97000002861022949, '"nearfull_ratio":' 0.85000002384185791, '"cluster_snapshot":' '"",' '"pool_max":' 2, '"max_osd":' 3, '"require_min_compat_client":' '"luminous",' '"min_compat_client":' '"jewel",' '"require_osd_release":' '"squid",' '"allow_crimson":' false, '"pools":' '[' '{' '"pool":' 1, '"pool_name":' '"foo",' '"create_time":' '"2024-09-16T03:24:44.525189+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"30",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.8700000047683716, '"score_stable":' 1.8700000047683716, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1.25, '"raw_score_stable":' 1.25, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '},' '{' '"pool":' 2, '"pool_name":' '"bar",' '"create_time":' '"2024-09-16T03:24:46.226575+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"32",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.4900000095367432, '"score_stable":' 1.4900000095367432, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1, '"raw_score_stable":' 1, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '}' '],' '"osds":' '[' '{' '"osd":' 0, '"uuid":' '"64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 5, '"up_thru":' 33, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6802",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6803",' '"nonce":' 3375787448 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6804",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6805",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6808",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6809",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6806",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6807",' '"nonce":' 3375787448 '}' ']' '},' '"public_addr":' '"127.0.0.1:6803/3375787448",' '"cluster_addr":' '"127.0.0.1:6805/3375787448",' '"heartbeat_back_addr":' '"127.0.0.1:6809/3375787448",' '"heartbeat_front_addr":' '"127.0.0.1:6807/3375787448",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 1, '"uuid":' '"74b26727-75c9-444d-8782-719e4197a382",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 10, '"up_thru":' 33, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6810",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6811",' '"nonce":' 3733255132 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6812",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6813",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6816",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6817",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6814",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6815",' '"nonce":' 3733255132 '}' ']' '},' '"public_addr":' '"127.0.0.1:6811/3733255132",' '"cluster_addr":' '"127.0.0.1:6813/3733255132",' '"heartbeat_back_addr":' '"127.0.0.1:6817/3733255132",' '"heartbeat_front_addr":' '"127.0.0.1:6815/3733255132",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 2, '"uuid":' '"143da3a7-dad9-4b1e-966b-76cf5bdd3c82",' '"up":' 0, '"in":' 0, '"weight":' 0, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 15, '"up_thru":' 21, '"down_at":' 33, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6818",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6819",' '"nonce":' 963814857 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6820",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6821",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6824",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6825",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6822",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6823",' '"nonce":' 963814857 '}' ']' '},' '"public_addr":' '"127.0.0.1:6819/963814857",' '"cluster_addr":' '"127.0.0.1:6821/963814857",' '"heartbeat_back_addr":' '"127.0.0.1:6825/963814857",' '"heartbeat_front_addr":' '"127.0.0.1:6823/963814857",' '"state":' '[' '"exists"' ']' '}' '],' '"osd_xinfo":' '[' '{' '"osd":' 0, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:22.481942+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 1, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:59.663703+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 2, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 65536, '"last_purged_snaps_scrub":' '"2024-09-16T03:24:37.320822+0000",' '"dead_epoch":' 32 '}' '],' '"pg_upmap":' '[],' '"pg_upmap_items":' '[],' '"pg_upmap_primaries":' '[],' '"pg_temp":' '[],' '"primary_temp":' '[],' '"blocklist":' '{},' '"range_blocklist":' '{},' '"erasure_code_profiles":' '{' '"default":' '{' '"k":' '"2",' '"m":' '"2",' '"plugin":' '"jerasure",' '"technique":' '"reed_sol_van"' '}' '},' '"removed_snaps_queue":' '[],' '"new_removed_snaps":' '[],' '"new_purged_snaps":' '[],' '"crush_node_flags":' '{},' '"device_class_flags":' '{},' '"stretch_mode":' '{' '"stretch_mode_enabled":' false, '"stretch_bucket_count":' 0, '"degraded_stretch_mode":' 0, '"recovering_stretch_mode":' 0, '"stretch_mode_bucket":' 0 '}' '},' '"osd_metadata":' '[' '{' '"id":' 0, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/0/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:22:53.662571Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]",' '"hb_front_addr":' '"[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/0",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 1, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/1/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:23:30.129885Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]",' '"hb_front_addr":' '"[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/1",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 2, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/2/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:24:07.764502Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]",' '"hb_front_addr":' '"[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/2",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '}' '],' '"osdmap_clean_epochs":' '{' '"min_last_epoch_clean":' 28, '"last_epoch_clean":' '{' '"per_pool":' '[' '{' '"poolid":' 1, '"floor":' 28 '},' '{' '"poolid":' 2, '"floor":' 28 '}' ']' '},' '"osd_epochs":' '[' '{' '"id":' 0, '"epoch":' 78 '},' '{' '"id":' 1, '"epoch":' 80 '}' ']' '},' '"osdmap_first_committed":' 28, '"osdmap_last_committed":' 80, '"crushmap":' '{' '"devices":' '[' '{' '"id":' 0, '"name":' '"osd.0",' '"class":' '"hdd"' '},' '{' '"id":' 1, '"name":' '"osd.1",' '"class":' '"hdd"' '},' '{' '"id":' 2, '"name":' '"osd.2",' '"class":' '"hdd"' '}' '],' '"types":' '[' '{' '"type_id":' 0, '"name":' '"osd"' '},' '{' '"type_id":' 1, '"name":' '"host"' '},' '{' '"type_id":' 2, '"name":' '"chassis"' '},' '{' '"type_id":' 3, '"name":' '"rack"' '},' '{' '"type_id":' 4, '"name":' '"row"' '},' '{' '"type_id":' 5, '"name":' '"pdu"' '},' '{' '"type_id":' 6, '"name":' '"pod"' '},' '{' '"type_id":' 7, '"name":' '"room"' '},' '{' '"type_id":' 8, '"name":' '"datacenter"' '},' '{' '"type_id":' 9, '"name":' '"zone"' '},' '{' '"type_id":' 10, '"name":' '"region"' '},' '{' '"type_id":' 11, '"name":' '"root"' '}' '],' '"buckets":' '[' '{' '"id":' -1, '"name":' '"default",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -3, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -2, '"name":' '"default~hdd",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -4, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -3, '"name":' '"smithi096",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '},' '{' '"id":' -4, '"name":' '"smithi096~hdd",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '}' '],' '"rules":' '[' '{' '"rule_id":' 0, '"rule_name":' '"replicated_rule",' '"type":' 1, '"steps":' '[' '{' '"op":' '"take",' '"item":' -1, '"item_name":' '"default"' '},' '{' '"op":' '"choose_firstn",' '"num":' 0, '"type":' '"osd"' '},' '{' '"op":' '"emit"' '}' ']' '}' '],' '"tunables":' '{' '"choose_local_tries":' 0, '"choose_local_fallback_tries":' 0, '"choose_total_tries":' 50, '"chooseleaf_descend_once":' 1, '"chooseleaf_vary_r":' 1, '"chooseleaf_stable":' 1, '"msr_descents":' 100, '"msr_collision_tries":' 100, '"straw_calc_version":' 1, '"allowed_bucket_algs":' 54, '"profile":' '"jewel",' '"optimal_tunables":' 1, '"legacy_tunables":' 0, '"minimum_required_version":' '"jewel",' '"require_feature_tunables":' 1, '"require_feature_tunables2":' 1, '"has_v2_rules":' 0, '"require_feature_tunables3":' 1, '"has_v3_rules":' 0, '"has_v4_buckets":' 1, '"require_feature_tunables5":' 1, '"has_v5_rules":' 0, '"has_msr_rules":' 0 '},' '"choose_args":' '{}' '},' '"fsmap":' '{' '"epoch":' 1, '"btime":' '"2024-09-16T03:22:46:882186+0000",' '"default_fscid":' -1, '"compat":' '{' '"compat":' '{},' '"ro_compat":' '{},' '"incompat":' '{' '"feature_1":' '"base' 'v0.20",' '"feature_2":' '"client' writeable 'ranges",' '"feature_3":' '"default' file layouts on 'dirs",' '"feature_4":' '"dir' inode in separate 'object",' '"feature_5":' '"mds' uses versioned 'encoding",' '"feature_6":' '"dirfrag' is stored in 'omap",' '"feature_8":' '"no' anchor 'table",' '"feature_9":' '"file' layout 'v2",' '"feature_10":' '"snaprealm' 'v2",' '"feature_11":' '"minor' log 'segments",' '"feature_12":' '"quiesce' 'subvolumes"' '}' '},' '"feature_flags":' '{' '"enable_multiple":' true, '"ever_enabled_multiple":' true '},' '"standbys":' '[],' '"filesystems":' '[]' '},' '"mdsmap_first_committed":' 1, '"mdsmap_last_committed":' 1, '"auth":' '{' '"first_committed":' 1, '"last_committed":' 5, '"num_secrets":' 3 '},' '"num_pg":' 64, '"num_pg_active":' 64, '"num_pg_unknown":' 0, '"num_osd":' 3, '"pool_sum":' '{' '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 128, '"acting":' 128, '"num_store_stats":' 0 '},' '"osd_sum":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54560, '"kb_used_data":' 832, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660640, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692495360, '"internally_reserved":' 0, '"allocated":' 851968, '"data_stored":' 318404, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 256, '"apply_latency_ms":' 256, '"commit_latency_ns":' 256000000, '"apply_latency_ns":' 256000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '},' '"osd_sum_by_class":' '{' '"hdd":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54560, '"kb_used_data":' 832, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660640, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692495360, '"internally_reserved":' 0, '"allocated":' 851968, '"data_stored":' 318404, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 256, '"apply_latency_ms":' 256, '"commit_latency_ns":' 256000000, '"apply_latency_ns":' 256000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '}' '},' '"pool_stats":' '[' '{' '"poolid":' 2, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '},' '{' '"poolid":' 1, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '}' '],' '"osd_stats":' '[' '{' '"osd":' 0, '"seq":' 21474836517 '},' '{' '"osd":' 1, '"seq":' 42949672988 '},' '{' '"osd":' 2, '"seq":' 0 '}' '],' '"num_pg_by_state":' '[' '{' '"state":' '"active+undersized",' '"num":' 64 '}' '],' '"num_pg_by_osd":' '[' '{' '"osd":' 2, '"num_primary_pg":' 0, '"num_acting_pg":' 0, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 0, '"num_primary_pg":' 28, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 1, '"num_primary_pg":' 36, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '}' '],' '"purged_snaps":' '[' '{' '"pool":' 1, '"purged_snaps":' '{}' '},' '{' '"pool":' 2, '"purged_snaps":' '{}' '}' '],' '"servicemap":' '{' '"epoch":' 5, '"modified":' '"2024-09-16T03:25:38.422788+0000",' '"services":' '{}' '},' '"mgrstat_first_committed":' 77, '"mgrstat_last_committed":' 83, '"logm_first_committed":' 1, '"logm_last_committed":' 361, '"paxos":' '{' '"first_committed":' 1, '"last_committed":' 540, '"last_pn":' 0, '"accepted_pn":' 0 '}' '}' 2024-09-16T03:25:55.355 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:123: validate_fc: osdm_fc=28 2024-09-16T03:25:55.355 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:125: validate_fc: [[ 28 -eq 28 ]] 2024-09-16T03:25:55.355 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:126: validate_fc: return 0 2024-09-16T03:25:55.356 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:244: TEST_mon_last_clean_epoch: check_lec_equals_pools 2024-09-16T03:25:55.356 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:26: check_lec_equals_pools: local pool_id= 2024-09-16T03:25:55.356 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:28: check_lec_equals_pools: ceph report 2024-09-16T03:25:55.839 INFO:tasks.workunit.client.0.smithi096.stderr:report 2273165111 2024-09-16T03:25:55.855 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:28: check_lec_equals_pools: report='{ 2024-09-16T03:25:55.855 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_fingerprint": "fda2fc64-07ed-4add-8224-2e527e11d427", 2024-09-16T03:25:55.855 INFO:tasks.workunit.client.0.smithi096.stderr: "version": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:25:55.855 INFO:tasks.workunit.client.0.smithi096.stderr: "commit": "fc3e0bff7468fd55478adbae7f75508b749124b6", 2024-09-16T03:25:55.856 INFO:tasks.workunit.client.0.smithi096.stderr: "timestamp": "2024-09-16T03:25:55.835988+0000", 2024-09-16T03:25:55.856 INFO:tasks.workunit.client.0.smithi096.stderr: "tag": "", 2024-09-16T03:25:55.856 INFO:tasks.workunit.client.0.smithi096.stderr: "health": { 2024-09-16T03:25:55.856 INFO:tasks.workunit.client.0.smithi096.stderr: "status": "HEALTH_OK", 2024-09-16T03:25:55.856 INFO:tasks.workunit.client.0.smithi096.stderr: "checks": {}, 2024-09-16T03:25:55.856 INFO:tasks.workunit.client.0.smithi096.stderr: "mutes": [] 2024-09-16T03:25:55.856 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.856 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap_first_committed": 1, 2024-09-16T03:25:55.856 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap_last_committed": 1, 2024-09-16T03:25:55.856 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap": { 2024-09-16T03:25:55.856 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 1, 2024-09-16T03:25:55.856 INFO:tasks.workunit.client.0.smithi096.stderr: "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", 2024-09-16T03:25:55.857 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:22:45.872880Z", 2024-09-16T03:25:55.857 INFO:tasks.workunit.client.0.smithi096.stderr: "created": "2024-09-16T03:22:45.872880Z", 2024-09-16T03:25:55.857 INFO:tasks.workunit.client.0.smithi096.stderr: "min_mon_release": 19, 2024-09-16T03:25:55.857 INFO:tasks.workunit.client.0.smithi096.stderr: "min_mon_release_name": "squid", 2024-09-16T03:25:55.857 INFO:tasks.workunit.client.0.smithi096.stderr: "election_strategy": 1, 2024-09-16T03:25:55.857 INFO:tasks.workunit.client.0.smithi096.stderr: "disallowed_leaders: ": "", 2024-09-16T03:25:55.857 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode": false, 2024-09-16T03:25:55.857 INFO:tasks.workunit.client.0.smithi096.stderr: "tiebreaker_mon": "", 2024-09-16T03:25:55.857 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_ranks: ": "", 2024-09-16T03:25:55.857 INFO:tasks.workunit.client.0.smithi096.stderr: "features": { 2024-09-16T03:25:55.857 INFO:tasks.workunit.client.0.smithi096.stderr: "persistent": [ 2024-09-16T03:25:55.857 INFO:tasks.workunit.client.0.smithi096.stderr: "kraken", 2024-09-16T03:25:55.857 INFO:tasks.workunit.client.0.smithi096.stderr: "luminous", 2024-09-16T03:25:55.857 INFO:tasks.workunit.client.0.smithi096.stderr: "mimic", 2024-09-16T03:25:55.858 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap-prune", 2024-09-16T03:25:55.858 INFO:tasks.workunit.client.0.smithi096.stderr: "nautilus", 2024-09-16T03:25:55.858 INFO:tasks.workunit.client.0.smithi096.stderr: "octopus", 2024-09-16T03:25:55.858 INFO:tasks.workunit.client.0.smithi096.stderr: "pacific", 2024-09-16T03:25:55.858 INFO:tasks.workunit.client.0.smithi096.stderr: "elector-pinging", 2024-09-16T03:25:55.858 INFO:tasks.workunit.client.0.smithi096.stderr: "quincy", 2024-09-16T03:25:55.858 INFO:tasks.workunit.client.0.smithi096.stderr: "reef", 2024-09-16T03:25:55.858 INFO:tasks.workunit.client.0.smithi096.stderr: "squid" 2024-09-16T03:25:55.858 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:55.858 INFO:tasks.workunit.client.0.smithi096.stderr: "optional": [] 2024-09-16T03:25:55.858 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.858 INFO:tasks.workunit.client.0.smithi096.stderr: "mons": [ 2024-09-16T03:25:55.858 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.859 INFO:tasks.workunit.client.0.smithi096.stderr: "rank": 0, 2024-09-16T03:25:55.859 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "a", 2024-09-16T03:25:55.859 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:25:55.859 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:55.859 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.859 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:55.859 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:7302", 2024-09-16T03:25:55.859 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 0 2024-09-16T03:25:55.859 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:55.859 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:55.859 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.859 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:7302/0", 2024-09-16T03:25:55.859 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:7302/0", 2024-09-16T03:25:55.859 INFO:tasks.workunit.client.0.smithi096.stderr: "priority": 0, 2024-09-16T03:25:55.860 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 0, 2024-09-16T03:25:55.860 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_location": "{}" 2024-09-16T03:25:55.860 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:55.860 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:55.860 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.860 INFO:tasks.workunit.client.0.smithi096.stderr: "quorum": [ 2024-09-16T03:25:55.860 INFO:tasks.workunit.client.0.smithi096.stderr: 0 2024-09-16T03:25:55.860 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:55.860 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap": { 2024-09-16T03:25:55.860 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 80, 2024-09-16T03:25:55.860 INFO:tasks.workunit.client.0.smithi096.stderr: "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", 2024-09-16T03:25:55.860 INFO:tasks.workunit.client.0.smithi096.stderr: "created": "2024-09-16T03:22:46.906117+0000", 2024-09-16T03:25:55.860 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:25:52.948673+0000", 2024-09-16T03:25:55.861 INFO:tasks.workunit.client.0.smithi096.stderr: "last_up_change": "2024-09-16T03:25:08.513363+0000", 2024-09-16T03:25:55.861 INFO:tasks.workunit.client.0.smithi096.stderr: "last_in_change": "2024-09-16T03:25:09.839444+0000", 2024-09-16T03:25:55.861 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-16T03:25:55.861 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_num": 5799936, 2024-09-16T03:25:55.861 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_set": [ 2024-09-16T03:25:55.861 INFO:tasks.workunit.client.0.smithi096.stderr: "pglog_hardlimit", 2024-09-16T03:25:55.861 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snapdirs", 2024-09-16T03:25:55.861 INFO:tasks.workunit.client.0.smithi096.stderr: "recovery_deletes", 2024-09-16T03:25:55.861 INFO:tasks.workunit.client.0.smithi096.stderr: "sortbitwise" 2024-09-16T03:25:55.861 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:55.861 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_version": 7, 2024-09-16T03:25:55.861 INFO:tasks.workunit.client.0.smithi096.stderr: "full_ratio": 0.97000002861022949, 2024-09-16T03:25:55.861 INFO:tasks.workunit.client.0.smithi096.stderr: "backfillfull_ratio": 0.97000002861022949, 2024-09-16T03:25:55.862 INFO:tasks.workunit.client.0.smithi096.stderr: "nearfull_ratio": 0.85000002384185791, 2024-09-16T03:25:55.862 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_snapshot": "", 2024-09-16T03:25:55.862 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_max": 2, 2024-09-16T03:25:55.862 INFO:tasks.workunit.client.0.smithi096.stderr: "max_osd": 3, 2024-09-16T03:25:55.862 INFO:tasks.workunit.client.0.smithi096.stderr: "require_min_compat_client": "luminous", 2024-09-16T03:25:55.862 INFO:tasks.workunit.client.0.smithi096.stderr: "min_compat_client": "jewel", 2024-09-16T03:25:55.862 INFO:tasks.workunit.client.0.smithi096.stderr: "require_osd_release": "squid", 2024-09-16T03:25:55.862 INFO:tasks.workunit.client.0.smithi096.stderr: "allow_crimson": false, 2024-09-16T03:25:55.862 INFO:tasks.workunit.client.0.smithi096.stderr: "pools": [ 2024-09-16T03:25:55.862 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.862 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 1, 2024-09-16T03:25:55.862 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_name": "foo", 2024-09-16T03:25:55.862 INFO:tasks.workunit.client.0.smithi096.stderr: "create_time": "2024-09-16T03:24:44.525189+0000", 2024-09-16T03:25:55.863 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": 1, 2024-09-16T03:25:55.863 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_names": "hashpspool", 2024-09-16T03:25:55.863 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:25:55.863 INFO:tasks.workunit.client.0.smithi096.stderr: "size": 3, 2024-09-16T03:25:55.863 INFO:tasks.workunit.client.0.smithi096.stderr: "min_size": 2, 2024-09-16T03:25:55.863 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_rule": 0, 2024-09-16T03:25:55.863 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_count": 0, 2024-09-16T03:25:55.863 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_target": 0, 2024-09-16T03:25:55.863 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_barrier": 0, 2024-09-16T03:25:55.863 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-16T03:25:55.863 INFO:tasks.workunit.client.0.smithi096.stderr: "is_stretch_pool": false, 2024-09-16T03:25:55.863 INFO:tasks.workunit.client.0.smithi096.stderr: "object_hash": 2, 2024-09-16T03:25:55.863 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_autoscale_mode": "off", 2024-09-16T03:25:55.864 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num": 32, 2024-09-16T03:25:55.864 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num": 32, 2024-09-16T03:25:55.864 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num_target": 32, 2024-09-16T03:25:55.864 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_target": 32, 2024-09-16T03:25:55.864 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_pending": 32, 2024-09-16T03:25:55.864 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pg_merge_meta": { 2024-09-16T03:25:55.864 INFO:tasks.workunit.client.0.smithi096.stderr: "source_pgid": "0.0", 2024-09-16T03:25:55.864 INFO:tasks.workunit.client.0.smithi096.stderr: "ready_epoch": 0, 2024-09-16T03:25:55.864 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_started": 0, 2024-09-16T03:25:55.864 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": 0, 2024-09-16T03:25:55.864 INFO:tasks.workunit.client.0.smithi096.stderr: "source_version": "0'\''0", 2024-09-16T03:25:55.864 INFO:tasks.workunit.client.0.smithi096.stderr: "target_version": "0'\''0" 2024-09-16T03:25:55.865 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.865 INFO:tasks.workunit.client.0.smithi096.stderr: "last_change": "30", 2024-09-16T03:25:55.865 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend": "0", 2024-09-16T03:25:55.865 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_prenautilus": "0", 2024-09-16T03:25:55.865 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_preluminous": "0", 2024-09-16T03:25:55.865 INFO:tasks.workunit.client.0.smithi096.stderr: "auid": 0, 2024-09-16T03:25:55.865 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_mode": "selfmanaged", 2024-09-16T03:25:55.865 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_seq": 0, 2024-09-16T03:25:55.865 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_epoch": 0, 2024-09-16T03:25:55.865 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_snaps": [], 2024-09-16T03:25:55.865 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps": "[]", 2024-09-16T03:25:55.865 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_bytes": 0, 2024-09-16T03:25:55.866 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_objects": 0, 2024-09-16T03:25:55.866 INFO:tasks.workunit.client.0.smithi096.stderr: "tiers": [], 2024-09-16T03:25:55.866 INFO:tasks.workunit.client.0.smithi096.stderr: "tier_of": -1, 2024-09-16T03:25:55.866 INFO:tasks.workunit.client.0.smithi096.stderr: "read_tier": -1, 2024-09-16T03:25:55.866 INFO:tasks.workunit.client.0.smithi096.stderr: "write_tier": -1, 2024-09-16T03:25:55.866 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_mode": "none", 2024-09-16T03:25:55.866 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_bytes": 0, 2024-09-16T03:25:55.866 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_objects": 0, 2024-09-16T03:25:55.866 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_ratio_micro": 400000, 2024-09-16T03:25:55.866 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-16T03:25:55.866 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_full_ratio_micro": 800000, 2024-09-16T03:25:55.866 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_flush_age": 0, 2024-09-16T03:25:55.866 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_evict_age": 0, 2024-09-16T03:25:55.867 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profile": "", 2024-09-16T03:25:55.867 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_params": { 2024-09-16T03:25:55.867 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "none" 2024-09-16T03:25:55.867 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.867 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_period": 0, 2024-09-16T03:25:55.867 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_count": 0, 2024-09-16T03:25:55.867 INFO:tasks.workunit.client.0.smithi096.stderr: "use_gmt_hitset": true, 2024-09-16T03:25:55.867 INFO:tasks.workunit.client.0.smithi096.stderr: "min_read_recency_for_promote": 0, 2024-09-16T03:25:55.867 INFO:tasks.workunit.client.0.smithi096.stderr: "min_write_recency_for_promote": 0, 2024-09-16T03:25:55.867 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_grade_decay_rate": 0, 2024-09-16T03:25:55.867 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_search_last_n": 0, 2024-09-16T03:25:55.867 INFO:tasks.workunit.client.0.smithi096.stderr: "grade_table": [], 2024-09-16T03:25:55.867 INFO:tasks.workunit.client.0.smithi096.stderr: "stripe_width": 0, 2024-09-16T03:25:55.867 INFO:tasks.workunit.client.0.smithi096.stderr: "expected_num_objects": 0, 2024-09-16T03:25:55.868 INFO:tasks.workunit.client.0.smithi096.stderr: "fast_read": false, 2024-09-16T03:25:55.868 INFO:tasks.workunit.client.0.smithi096.stderr: "options": {}, 2024-09-16T03:25:55.868 INFO:tasks.workunit.client.0.smithi096.stderr: "application_metadata": {}, 2024-09-16T03:25:55.868 INFO:tasks.workunit.client.0.smithi096.stderr: "read_balance": { 2024-09-16T03:25:55.868 INFO:tasks.workunit.client.0.smithi096.stderr: "score_type": "Fair distribution", 2024-09-16T03:25:55.868 INFO:tasks.workunit.client.0.smithi096.stderr: "score_acting": 1.8700000047683716, 2024-09-16T03:25:55.868 INFO:tasks.workunit.client.0.smithi096.stderr: "score_stable": 1.8700000047683716, 2024-09-16T03:25:55.868 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_score": 0.67000001668930054, 2024-09-16T03:25:55.868 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_acting": 1.25, 2024-09-16T03:25:55.868 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_stable": 1.25, 2024-09-16T03:25:55.868 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity_weighted": 1, 2024-09-16T03:25:55.868 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity": 1, 2024-09-16T03:25:55.868 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity_weighted": 1 2024-09-16T03:25:55.868 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:55.869 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.869 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.869 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 2, 2024-09-16T03:25:55.869 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_name": "bar", 2024-09-16T03:25:55.869 INFO:tasks.workunit.client.0.smithi096.stderr: "create_time": "2024-09-16T03:24:46.226575+0000", 2024-09-16T03:25:55.869 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": 1, 2024-09-16T03:25:55.869 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_names": "hashpspool", 2024-09-16T03:25:55.869 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:25:55.869 INFO:tasks.workunit.client.0.smithi096.stderr: "size": 3, 2024-09-16T03:25:55.869 INFO:tasks.workunit.client.0.smithi096.stderr: "min_size": 2, 2024-09-16T03:25:55.869 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_rule": 0, 2024-09-16T03:25:55.869 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_count": 0, 2024-09-16T03:25:55.869 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_target": 0, 2024-09-16T03:25:55.870 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_barrier": 0, 2024-09-16T03:25:55.870 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-16T03:25:55.870 INFO:tasks.workunit.client.0.smithi096.stderr: "is_stretch_pool": false, 2024-09-16T03:25:55.870 INFO:tasks.workunit.client.0.smithi096.stderr: "object_hash": 2, 2024-09-16T03:25:55.870 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_autoscale_mode": "off", 2024-09-16T03:25:55.870 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num": 32, 2024-09-16T03:25:55.870 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num": 32, 2024-09-16T03:25:55.870 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num_target": 32, 2024-09-16T03:25:55.870 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_target": 32, 2024-09-16T03:25:55.870 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_pending": 32, 2024-09-16T03:25:55.870 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pg_merge_meta": { 2024-09-16T03:25:55.870 INFO:tasks.workunit.client.0.smithi096.stderr: "source_pgid": "0.0", 2024-09-16T03:25:55.870 INFO:tasks.workunit.client.0.smithi096.stderr: "ready_epoch": 0, 2024-09-16T03:25:55.870 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_started": 0, 2024-09-16T03:25:55.871 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": 0, 2024-09-16T03:25:55.871 INFO:tasks.workunit.client.0.smithi096.stderr: "source_version": "0'\''0", 2024-09-16T03:25:55.871 INFO:tasks.workunit.client.0.smithi096.stderr: "target_version": "0'\''0" 2024-09-16T03:25:55.871 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.871 INFO:tasks.workunit.client.0.smithi096.stderr: "last_change": "32", 2024-09-16T03:25:55.871 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend": "0", 2024-09-16T03:25:55.871 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_prenautilus": "0", 2024-09-16T03:25:55.871 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_preluminous": "0", 2024-09-16T03:25:55.871 INFO:tasks.workunit.client.0.smithi096.stderr: "auid": 0, 2024-09-16T03:25:55.871 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_mode": "selfmanaged", 2024-09-16T03:25:55.871 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_seq": 0, 2024-09-16T03:25:55.871 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_epoch": 0, 2024-09-16T03:25:55.871 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_snaps": [], 2024-09-16T03:25:55.871 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps": "[]", 2024-09-16T03:25:55.871 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_bytes": 0, 2024-09-16T03:25:55.872 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_objects": 0, 2024-09-16T03:25:55.872 INFO:tasks.workunit.client.0.smithi096.stderr: "tiers": [], 2024-09-16T03:25:55.872 INFO:tasks.workunit.client.0.smithi096.stderr: "tier_of": -1, 2024-09-16T03:25:55.872 INFO:tasks.workunit.client.0.smithi096.stderr: "read_tier": -1, 2024-09-16T03:25:55.872 INFO:tasks.workunit.client.0.smithi096.stderr: "write_tier": -1, 2024-09-16T03:25:55.872 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_mode": "none", 2024-09-16T03:25:55.872 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_bytes": 0, 2024-09-16T03:25:55.872 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_objects": 0, 2024-09-16T03:25:55.872 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_ratio_micro": 400000, 2024-09-16T03:25:55.872 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-16T03:25:55.872 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_full_ratio_micro": 800000, 2024-09-16T03:25:55.872 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_flush_age": 0, 2024-09-16T03:25:55.873 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_evict_age": 0, 2024-09-16T03:25:55.873 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profile": "", 2024-09-16T03:25:55.873 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_params": { 2024-09-16T03:25:55.873 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "none" 2024-09-16T03:25:55.873 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.873 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_period": 0, 2024-09-16T03:25:55.873 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_count": 0, 2024-09-16T03:25:55.873 INFO:tasks.workunit.client.0.smithi096.stderr: "use_gmt_hitset": true, 2024-09-16T03:25:55.873 INFO:tasks.workunit.client.0.smithi096.stderr: "min_read_recency_for_promote": 0, 2024-09-16T03:25:55.873 INFO:tasks.workunit.client.0.smithi096.stderr: "min_write_recency_for_promote": 0, 2024-09-16T03:25:55.873 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_grade_decay_rate": 0, 2024-09-16T03:25:55.873 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_search_last_n": 0, 2024-09-16T03:25:55.873 INFO:tasks.workunit.client.0.smithi096.stderr: "grade_table": [], 2024-09-16T03:25:55.873 INFO:tasks.workunit.client.0.smithi096.stderr: "stripe_width": 0, 2024-09-16T03:25:55.874 INFO:tasks.workunit.client.0.smithi096.stderr: "expected_num_objects": 0, 2024-09-16T03:25:55.874 INFO:tasks.workunit.client.0.smithi096.stderr: "fast_read": false, 2024-09-16T03:25:55.874 INFO:tasks.workunit.client.0.smithi096.stderr: "options": {}, 2024-09-16T03:25:55.874 INFO:tasks.workunit.client.0.smithi096.stderr: "application_metadata": {}, 2024-09-16T03:25:55.874 INFO:tasks.workunit.client.0.smithi096.stderr: "read_balance": { 2024-09-16T03:25:55.874 INFO:tasks.workunit.client.0.smithi096.stderr: "score_type": "Fair distribution", 2024-09-16T03:25:55.874 INFO:tasks.workunit.client.0.smithi096.stderr: "score_acting": 1.4900000095367432, 2024-09-16T03:25:55.874 INFO:tasks.workunit.client.0.smithi096.stderr: "score_stable": 1.4900000095367432, 2024-09-16T03:25:55.874 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_score": 0.67000001668930054, 2024-09-16T03:25:55.874 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_acting": 1, 2024-09-16T03:25:55.874 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_stable": 1, 2024-09-16T03:25:55.874 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity_weighted": 1, 2024-09-16T03:25:55.874 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity": 1, 2024-09-16T03:25:55.875 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity_weighted": 1 2024-09-16T03:25:55.875 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:55.875 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:55.875 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:55.875 INFO:tasks.workunit.client.0.smithi096.stderr: "osds": [ 2024-09-16T03:25:55.875 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.875 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:25:55.875 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6", 2024-09-16T03:25:55.875 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:25:55.875 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:25:55.875 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:25:55.875 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:25:55.875 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:25:55.875 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:25:55.875 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 5, 2024-09-16T03:25:55.876 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 33, 2024-09-16T03:25:55.876 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:25:55.876 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:25:55.876 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:25:55.876 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:55.876 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.876 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:55.876 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6802", 2024-09-16T03:25:55.876 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:55.876 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.876 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.876 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:55.876 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6803", 2024-09-16T03:25:55.877 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:55.877 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:55.877 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:55.877 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.877 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:25:55.877 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:55.877 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.877 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:55.877 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6804", 2024-09-16T03:25:55.877 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:55.877 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.877 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.877 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:55.878 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6805", 2024-09-16T03:25:55.878 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:55.878 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:55.878 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:55.878 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.878 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:25:55.878 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:55.878 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.878 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:55.878 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6808", 2024-09-16T03:25:55.878 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:55.878 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.878 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.878 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:55.879 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6809", 2024-09-16T03:25:55.879 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:55.879 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:55.879 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:55.879 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.879 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:25:55.879 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:55.879 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.879 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:55.879 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6806", 2024-09-16T03:25:55.879 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:55.879 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.879 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.879 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:55.880 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6807", 2024-09-16T03:25:55.880 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:55.880 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:55.880 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:55.880 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.880 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6803/3375787448", 2024-09-16T03:25:55.880 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6805/3375787448", 2024-09-16T03:25:55.880 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6809/3375787448", 2024-09-16T03:25:55.880 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6807/3375787448", 2024-09-16T03:25:55.880 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:25:55.880 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:25:55.880 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:25:55.880 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:55.880 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.881 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.881 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:25:55.881 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "74b26727-75c9-444d-8782-719e4197a382", 2024-09-16T03:25:55.881 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:25:55.881 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:25:55.881 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:25:55.881 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:25:55.881 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:25:55.881 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:25:55.881 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 10, 2024-09-16T03:25:55.881 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 33, 2024-09-16T03:25:55.881 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:25:55.881 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:25:55.882 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:25:55.882 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:55.882 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.882 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:55.882 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6810", 2024-09-16T03:25:55.882 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:55.882 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.882 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.882 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:55.882 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6811", 2024-09-16T03:25:55.882 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:55.882 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:55.882 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:55.883 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.883 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:25:55.883 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:55.883 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.883 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:55.883 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6812", 2024-09-16T03:25:55.883 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:55.883 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.883 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.883 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:55.883 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6813", 2024-09-16T03:25:55.883 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:55.883 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:55.883 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:55.884 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.884 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:25:55.884 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:55.884 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.884 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:55.884 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6816", 2024-09-16T03:25:55.884 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:55.884 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.884 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.884 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:55.884 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6817", 2024-09-16T03:25:55.884 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:55.884 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:55.884 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:55.885 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.885 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:25:55.885 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:55.885 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.885 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:55.885 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6814", 2024-09-16T03:25:55.885 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:55.885 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.885 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.885 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:55.885 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6815", 2024-09-16T03:25:55.885 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:55.885 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:55.886 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:55.886 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.886 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6811/3733255132", 2024-09-16T03:25:55.886 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6813/3733255132", 2024-09-16T03:25:55.886 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6817/3733255132", 2024-09-16T03:25:55.886 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6815/3733255132", 2024-09-16T03:25:55.886 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:25:55.886 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:25:55.886 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:25:55.886 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:55.886 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.886 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.886 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:25:55.887 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "143da3a7-dad9-4b1e-966b-76cf5bdd3c82", 2024-09-16T03:25:55.887 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 0, 2024-09-16T03:25:55.887 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 0, 2024-09-16T03:25:55.887 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 0, 2024-09-16T03:25:55.887 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:25:55.887 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:25:55.887 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:25:55.887 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 15, 2024-09-16T03:25:55.887 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 21, 2024-09-16T03:25:55.887 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 33, 2024-09-16T03:25:55.887 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:25:55.887 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:25:55.887 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:55.887 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.888 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:55.888 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6818", 2024-09-16T03:25:55.888 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:55.888 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.888 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.888 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:55.888 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6819", 2024-09-16T03:25:55.888 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:55.888 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:55.888 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:55.888 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.888 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:25:55.888 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:55.889 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.889 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:55.889 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6820", 2024-09-16T03:25:55.889 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:55.889 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.889 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.889 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:55.889 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6821", 2024-09-16T03:25:55.889 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:55.889 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:55.890 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:55.890 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.890 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:25:55.890 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:55.890 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.890 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:55.890 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6824", 2024-09-16T03:25:55.890 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:55.890 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.890 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.890 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:55.890 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6825", 2024-09-16T03:25:55.890 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:55.891 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:55.891 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:55.891 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.891 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:25:55.891 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:55.891 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.891 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:55.891 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6822", 2024-09-16T03:25:55.891 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:55.891 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.891 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.891 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:55.891 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6823", 2024-09-16T03:25:55.891 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:55.891 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:55.892 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:55.892 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.892 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6819/963814857", 2024-09-16T03:25:55.892 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6821/963814857", 2024-09-16T03:25:55.892 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6825/963814857", 2024-09-16T03:25:55.892 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6823/963814857", 2024-09-16T03:25:55.892 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:25:55.892 INFO:tasks.workunit.client.0.smithi096.stderr: "exists" 2024-09-16T03:25:55.892 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:55.892 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:55.892 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:55.892 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_xinfo": [ 2024-09-16T03:25:55.892 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.893 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:25:55.893 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:25:55.893 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:25:55.893 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:25:55.893 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:25:55.893 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:25:55.893 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:23:22.481942+0000", 2024-09-16T03:25:55.893 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:25:55.893 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.893 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.893 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:25:55.893 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:25:55.893 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:25:55.894 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:25:55.894 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:25:55.894 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:25:55.894 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:23:59.663703+0000", 2024-09-16T03:25:55.894 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:25:55.894 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.894 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.894 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:25:55.894 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:25:55.894 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:25:55.894 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:25:55.894 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:25:55.894 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 65536, 2024-09-16T03:25:55.894 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:24:37.320822+0000", 2024-09-16T03:25:55.895 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 32 2024-09-16T03:25:55.895 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:55.895 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:55.895 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap": [], 2024-09-16T03:25:55.895 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap_items": [], 2024-09-16T03:25:55.895 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap_primaries": [], 2024-09-16T03:25:55.895 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_temp": [], 2024-09-16T03:25:55.895 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_temp": [], 2024-09-16T03:25:55.895 INFO:tasks.workunit.client.0.smithi096.stderr: "blocklist": {}, 2024-09-16T03:25:55.895 INFO:tasks.workunit.client.0.smithi096.stderr: "range_blocklist": {}, 2024-09-16T03:25:55.895 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profiles": { 2024-09-16T03:25:55.895 INFO:tasks.workunit.client.0.smithi096.stderr: "default": { 2024-09-16T03:25:55.895 INFO:tasks.workunit.client.0.smithi096.stderr: "k": "2", 2024-09-16T03:25:55.895 INFO:tasks.workunit.client.0.smithi096.stderr: "m": "2", 2024-09-16T03:25:55.896 INFO:tasks.workunit.client.0.smithi096.stderr: "plugin": "jerasure", 2024-09-16T03:25:55.896 INFO:tasks.workunit.client.0.smithi096.stderr: "technique": "reed_sol_van" 2024-09-16T03:25:55.896 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:55.896 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.896 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps_queue": [], 2024-09-16T03:25:55.896 INFO:tasks.workunit.client.0.smithi096.stderr: "new_removed_snaps": [], 2024-09-16T03:25:55.896 INFO:tasks.workunit.client.0.smithi096.stderr: "new_purged_snaps": [], 2024-09-16T03:25:55.896 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_node_flags": {}, 2024-09-16T03:25:55.896 INFO:tasks.workunit.client.0.smithi096.stderr: "device_class_flags": {}, 2024-09-16T03:25:55.896 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode": { 2024-09-16T03:25:55.896 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode_enabled": false, 2024-09-16T03:25:55.896 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_bucket_count": 0, 2024-09-16T03:25:55.896 INFO:tasks.workunit.client.0.smithi096.stderr: "degraded_stretch_mode": 0, 2024-09-16T03:25:55.896 INFO:tasks.workunit.client.0.smithi096.stderr: "recovering_stretch_mode": 0, 2024-09-16T03:25:55.897 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode_bucket": 0 2024-09-16T03:25:55.897 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:55.897 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.897 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_metadata": [ 2024-09-16T03:25:55.897 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.897 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:25:55.897 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:25:55.897 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]", 2024-09-16T03:25:55.897 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:25:55.897 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:25:55.897 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:25:55.897 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:25:55.897 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:25:55.898 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:25:55.898 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:25:55.898 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:25:55.898 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:25:55.898 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:25:55.898 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:25:55.898 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/0/block", 2024-09-16T03:25:55.898 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:25:55.898 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:25:55.898 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:25:55.898 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:25:55.898 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:25:55.898 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:25:55.899 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:25:55.899 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:25:55.899 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:25:55.899 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:25:55.899 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:22:53.662571Z", 2024-09-16T03:25:55.899 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:25:55.899 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:25:55.899 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:25:55.899 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:25:55.899 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:25:55.899 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:25:55.899 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:25:55.899 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]", 2024-09-16T03:25:55.899 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:25:55.900 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]", 2024-09-16T03:25:55.900 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]", 2024-09-16T03:25:55.900 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:25:55.900 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:25:55.900 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:25:55.900 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:25:55.900 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:25:55.900 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:25:55.900 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:25:55.900 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:25:55.900 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:25:55.900 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/0", 2024-09-16T03:25:55.900 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:25:55.901 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:25:55.901 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:25:55.901 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.901 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.901 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:25:55.901 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:25:55.901 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]", 2024-09-16T03:25:55.901 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:25:55.901 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:25:55.901 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:25:55.901 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:25:55.901 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:25:55.902 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:25:55.902 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:25:55.902 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:25:55.902 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:25:55.902 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:25:55.902 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:25:55.902 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/1/block", 2024-09-16T03:25:55.902 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:25:55.902 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:25:55.902 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:25:55.903 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:25:55.903 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:25:55.903 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:25:55.903 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:25:55.903 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:25:55.903 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:25:55.903 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:25:55.903 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:23:30.129885Z", 2024-09-16T03:25:55.903 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:25:55.903 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:25:55.903 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:25:55.903 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:25:55.903 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:25:55.903 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:25:55.904 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:25:55.904 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]", 2024-09-16T03:25:55.904 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:25:55.904 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]", 2024-09-16T03:25:55.904 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]", 2024-09-16T03:25:55.904 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:25:55.904 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:25:55.904 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:25:55.904 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:25:55.904 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:25:55.904 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:25:55.905 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:25:55.905 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:25:55.905 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:25:55.905 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/1", 2024-09-16T03:25:55.905 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:25:55.905 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:25:55.905 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:25:55.905 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.905 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.905 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:25:55.905 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:25:55.905 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]", 2024-09-16T03:25:55.905 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:25:55.906 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:25:55.906 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:25:55.906 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:25:55.906 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:25:55.906 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:25:55.906 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:25:55.906 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:25:55.906 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:25:55.906 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:25:55.906 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:25:55.906 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/2/block", 2024-09-16T03:25:55.906 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:25:55.906 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:25:55.907 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:25:55.907 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:25:55.907 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:25:55.907 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:25:55.907 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:25:55.907 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:25:55.907 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:25:55.907 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:25:55.907 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:24:07.764502Z", 2024-09-16T03:25:55.907 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:25:55.907 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:25:55.907 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:25:55.907 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:25:55.908 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:25:55.908 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:25:55.908 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:25:55.908 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]", 2024-09-16T03:25:55.908 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:25:55.908 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]", 2024-09-16T03:25:55.908 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]", 2024-09-16T03:25:55.908 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:25:55.908 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:25:55.908 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:25:55.908 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:25:55.908 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:25:55.908 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:25:55.909 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:25:55.909 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:25:55.909 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:25:55.909 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/2", 2024-09-16T03:25:55.909 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:25:55.909 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:25:55.909 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:25:55.909 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:55.909 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:55.909 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_clean_epochs": { 2024-09-16T03:25:55.909 INFO:tasks.workunit.client.0.smithi096.stderr: "min_last_epoch_clean": 28, 2024-09-16T03:25:55.909 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": { 2024-09-16T03:25:55.909 INFO:tasks.workunit.client.0.smithi096.stderr: "per_pool": [ 2024-09-16T03:25:55.909 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.910 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 1, 2024-09-16T03:25:55.910 INFO:tasks.workunit.client.0.smithi096.stderr: "floor": 28 2024-09-16T03:25:55.910 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.910 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.910 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 2, 2024-09-16T03:25:55.910 INFO:tasks.workunit.client.0.smithi096.stderr: "floor": 28 2024-09-16T03:25:55.910 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:55.910 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:55.910 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.910 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_epochs": [ 2024-09-16T03:25:55.910 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.910 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:25:55.910 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 78 2024-09-16T03:25:55.910 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.911 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.911 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:25:55.911 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 80 2024-09-16T03:25:55.911 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:55.911 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:55.911 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.911 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_first_committed": 28, 2024-09-16T03:25:55.911 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_last_committed": 80, 2024-09-16T03:25:55.911 INFO:tasks.workunit.client.0.smithi096.stderr: "crushmap": { 2024-09-16T03:25:55.911 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": [ 2024-09-16T03:25:55.911 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.911 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:25:55.911 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.0", 2024-09-16T03:25:55.911 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:25:55.912 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.912 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.912 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:25:55.912 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.1", 2024-09-16T03:25:55.912 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:25:55.912 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.912 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.912 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:25:55.912 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.2", 2024-09-16T03:25:55.912 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:25:55.912 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:55.912 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:55.912 INFO:tasks.workunit.client.0.smithi096.stderr: "types": [ 2024-09-16T03:25:55.913 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.913 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 0, 2024-09-16T03:25:55.913 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd" 2024-09-16T03:25:55.913 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.913 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.913 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:25:55.913 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "host" 2024-09-16T03:25:55.913 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.913 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.913 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 2, 2024-09-16T03:25:55.913 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "chassis" 2024-09-16T03:25:55.913 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.913 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.913 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 3, 2024-09-16T03:25:55.914 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "rack" 2024-09-16T03:25:55.914 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.914 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.914 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 4, 2024-09-16T03:25:55.914 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "row" 2024-09-16T03:25:55.914 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.914 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.914 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 5, 2024-09-16T03:25:55.914 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "pdu" 2024-09-16T03:25:55.914 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.914 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.914 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 6, 2024-09-16T03:25:55.914 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "pod" 2024-09-16T03:25:55.914 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.915 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.915 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 7, 2024-09-16T03:25:55.915 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "room" 2024-09-16T03:25:55.915 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.915 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.915 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 8, 2024-09-16T03:25:55.915 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "datacenter" 2024-09-16T03:25:55.915 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.915 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.915 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 9, 2024-09-16T03:25:55.915 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "zone" 2024-09-16T03:25:55.915 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.915 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.916 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 10, 2024-09-16T03:25:55.916 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "region" 2024-09-16T03:25:55.916 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.916 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.916 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:25:55.916 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "root" 2024-09-16T03:25:55.916 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:55.916 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:55.916 INFO:tasks.workunit.client.0.smithi096.stderr: "buckets": [ 2024-09-16T03:25:55.916 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.916 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -1, 2024-09-16T03:25:55.916 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "default", 2024-09-16T03:25:55.916 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:25:55.916 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "root", 2024-09-16T03:25:55.916 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:25:55.917 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:25:55.917 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:25:55.917 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:25:55.917 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.917 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -3, 2024-09-16T03:25:55.917 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:25:55.917 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:25:55.917 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:55.917 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:55.917 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.917 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.917 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -2, 2024-09-16T03:25:55.918 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "default~hdd", 2024-09-16T03:25:55.918 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:25:55.918 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "root", 2024-09-16T03:25:55.918 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:25:55.918 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:25:55.918 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:25:55.918 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:25:55.918 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.918 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -4, 2024-09-16T03:25:55.918 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:25:55.918 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:25:55.918 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:55.918 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:55.918 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.919 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.919 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -3, 2024-09-16T03:25:55.919 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "smithi096", 2024-09-16T03:25:55.919 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:25:55.919 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "host", 2024-09-16T03:25:55.919 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:25:55.919 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:25:55.919 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:25:55.919 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:25:55.919 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.919 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:25:55.919 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:25:55.919 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:25:55.919 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.919 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.920 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:25:55.920 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:25:55.920 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 1 2024-09-16T03:25:55.920 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.920 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.920 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:25:55.920 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:25:55.920 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 2 2024-09-16T03:25:55.920 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:55.920 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:55.920 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.920 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.920 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -4, 2024-09-16T03:25:55.921 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "smithi096~hdd", 2024-09-16T03:25:55.921 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:25:55.921 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "host", 2024-09-16T03:25:55.921 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:25:55.921 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:25:55.921 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:25:55.921 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:25:55.921 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.921 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:25:55.921 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:25:55.921 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:25:55.921 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.921 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.922 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:25:55.922 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:25:55.922 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 1 2024-09-16T03:25:55.922 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.922 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.922 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:25:55.922 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:25:55.922 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 2 2024-09-16T03:25:55.922 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:55.922 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:55.922 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:55.922 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:55.922 INFO:tasks.workunit.client.0.smithi096.stderr: "rules": [ 2024-09-16T03:25:55.923 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.923 INFO:tasks.workunit.client.0.smithi096.stderr: "rule_id": 0, 2024-09-16T03:25:55.923 INFO:tasks.workunit.client.0.smithi096.stderr: "rule_name": "replicated_rule", 2024-09-16T03:25:55.923 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:25:55.923 INFO:tasks.workunit.client.0.smithi096.stderr: "steps": [ 2024-09-16T03:25:55.923 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.923 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "take", 2024-09-16T03:25:55.923 INFO:tasks.workunit.client.0.smithi096.stderr: "item": -1, 2024-09-16T03:25:55.923 INFO:tasks.workunit.client.0.smithi096.stderr: "item_name": "default" 2024-09-16T03:25:55.923 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.923 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.923 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "choose_firstn", 2024-09-16T03:25:55.923 INFO:tasks.workunit.client.0.smithi096.stderr: "num": 0, 2024-09-16T03:25:55.924 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "osd" 2024-09-16T03:25:55.924 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.924 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.924 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "emit" 2024-09-16T03:25:55.924 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:55.924 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:55.924 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:55.924 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:55.924 INFO:tasks.workunit.client.0.smithi096.stderr: "tunables": { 2024-09-16T03:25:55.924 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_local_tries": 0, 2024-09-16T03:25:55.924 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_local_fallback_tries": 0, 2024-09-16T03:25:55.924 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_total_tries": 50, 2024-09-16T03:25:55.924 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_descend_once": 1, 2024-09-16T03:25:55.924 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_vary_r": 1, 2024-09-16T03:25:55.925 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_stable": 1, 2024-09-16T03:25:55.925 INFO:tasks.workunit.client.0.smithi096.stderr: "msr_descents": 100, 2024-09-16T03:25:55.925 INFO:tasks.workunit.client.0.smithi096.stderr: "msr_collision_tries": 100, 2024-09-16T03:25:55.925 INFO:tasks.workunit.client.0.smithi096.stderr: "straw_calc_version": 1, 2024-09-16T03:25:55.925 INFO:tasks.workunit.client.0.smithi096.stderr: "allowed_bucket_algs": 54, 2024-09-16T03:25:55.925 INFO:tasks.workunit.client.0.smithi096.stderr: "profile": "jewel", 2024-09-16T03:25:55.925 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_tunables": 1, 2024-09-16T03:25:55.925 INFO:tasks.workunit.client.0.smithi096.stderr: "legacy_tunables": 0, 2024-09-16T03:25:55.925 INFO:tasks.workunit.client.0.smithi096.stderr: "minimum_required_version": "jewel", 2024-09-16T03:25:55.925 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables": 1, 2024-09-16T03:25:55.925 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables2": 1, 2024-09-16T03:25:55.925 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v2_rules": 0, 2024-09-16T03:25:55.925 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables3": 1, 2024-09-16T03:25:55.926 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v3_rules": 0, 2024-09-16T03:25:55.926 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v4_buckets": 1, 2024-09-16T03:25:55.926 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables5": 1, 2024-09-16T03:25:55.926 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v5_rules": 0, 2024-09-16T03:25:55.926 INFO:tasks.workunit.client.0.smithi096.stderr: "has_msr_rules": 0 2024-09-16T03:25:55.926 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.926 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_args": {} 2024-09-16T03:25:55.926 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.926 INFO:tasks.workunit.client.0.smithi096.stderr: "fsmap": { 2024-09-16T03:25:55.926 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 1, 2024-09-16T03:25:55.926 INFO:tasks.workunit.client.0.smithi096.stderr: "btime": "2024-09-16T03:22:46:882186+0000", 2024-09-16T03:25:55.926 INFO:tasks.workunit.client.0.smithi096.stderr: "default_fscid": -1, 2024-09-16T03:25:55.926 INFO:tasks.workunit.client.0.smithi096.stderr: "compat": { 2024-09-16T03:25:55.927 INFO:tasks.workunit.client.0.smithi096.stderr: "compat": {}, 2024-09-16T03:25:55.927 INFO:tasks.workunit.client.0.smithi096.stderr: "ro_compat": {}, 2024-09-16T03:25:55.927 INFO:tasks.workunit.client.0.smithi096.stderr: "incompat": { 2024-09-16T03:25:55.927 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_1": "base v0.20", 2024-09-16T03:25:55.927 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_2": "client writeable ranges", 2024-09-16T03:25:55.927 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_3": "default file layouts on dirs", 2024-09-16T03:25:55.927 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_4": "dir inode in separate object", 2024-09-16T03:25:55.927 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_5": "mds uses versioned encoding", 2024-09-16T03:25:55.927 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_6": "dirfrag is stored in omap", 2024-09-16T03:25:55.927 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_8": "no anchor table", 2024-09-16T03:25:55.927 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_9": "file layout v2", 2024-09-16T03:25:55.927 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_10": "snaprealm v2", 2024-09-16T03:25:55.927 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_11": "minor log segments", 2024-09-16T03:25:55.927 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_12": "quiesce subvolumes" 2024-09-16T03:25:55.928 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:55.928 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.928 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_flags": { 2024-09-16T03:25:55.928 INFO:tasks.workunit.client.0.smithi096.stderr: "enable_multiple": true, 2024-09-16T03:25:55.928 INFO:tasks.workunit.client.0.smithi096.stderr: "ever_enabled_multiple": true 2024-09-16T03:25:55.928 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.928 INFO:tasks.workunit.client.0.smithi096.stderr: "standbys": [], 2024-09-16T03:25:55.928 INFO:tasks.workunit.client.0.smithi096.stderr: "filesystems": [] 2024-09-16T03:25:55.928 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.928 INFO:tasks.workunit.client.0.smithi096.stderr: "mdsmap_first_committed": 1, 2024-09-16T03:25:55.928 INFO:tasks.workunit.client.0.smithi096.stderr: "mdsmap_last_committed": 1, 2024-09-16T03:25:55.928 INFO:tasks.workunit.client.0.smithi096.stderr: "auth": { 2024-09-16T03:25:55.928 INFO:tasks.workunit.client.0.smithi096.stderr: "first_committed": 1, 2024-09-16T03:25:55.929 INFO:tasks.workunit.client.0.smithi096.stderr: "last_committed": 5, 2024-09-16T03:25:55.929 INFO:tasks.workunit.client.0.smithi096.stderr: "num_secrets": 3 2024-09-16T03:25:55.929 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.929 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 64, 2024-09-16T03:25:55.929 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_active": 64, 2024-09-16T03:25:55.929 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_unknown": 0, 2024-09-16T03:25:55.929 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osd": 3, 2024-09-16T03:25:55.929 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_sum": { 2024-09-16T03:25:55.929 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:25:55.929 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:25:55.929 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:25:55.929 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:25:55.929 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:25:55.930 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:25:55.930 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:25:55.930 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:25:55.930 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:25:55.930 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:25:55.930 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:25:55.930 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:25:55.930 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:25:55.930 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:25:55.930 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:25:55.930 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:25:55.930 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:25:55.930 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:25:55.930 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:25:55.931 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:25:55.931 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:25:55.931 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:25:55.931 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:25:55.931 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:25:55.931 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:25:55.931 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:25:55.931 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:25:55.931 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:25:55.931 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:25:55.931 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:25:55.931 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:25:55.931 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:25:55.931 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:25:55.932 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:25:55.932 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:25:55.932 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:25:55.932 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:25:55.932 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:25:55.932 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:25:55.932 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:25:55.932 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:25:55.932 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.932 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:25:55.932 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:25:55.932 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:25:55.932 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:25:55.933 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:25:55.933 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:25:55.933 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:25:55.933 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:25:55.933 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:25:55.933 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:25:55.933 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:25:55.933 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.933 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:25:55.933 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:25:55.933 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 128, 2024-09-16T03:25:55.933 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 128, 2024-09-16T03:25:55.933 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 0 2024-09-16T03:25:55.933 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.934 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_sum": { 2024-09-16T03:25:55.934 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 0, 2024-09-16T03:25:55.934 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 0, 2024-09-16T03:25:55.934 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pgs": 128, 2024-09-16T03:25:55.934 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osds": 2, 2024-09-16T03:25:55.934 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_osds": 2, 2024-09-16T03:25:55.934 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_omap_osds": 2, 2024-09-16T03:25:55.934 INFO:tasks.workunit.client.0.smithi096.stderr: "kb": 209715200, 2024-09-16T03:25:55.934 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used": 54560, 2024-09-16T03:25:55.934 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_data": 832, 2024-09-16T03:25:55.934 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_omap": 3, 2024-09-16T03:25:55.934 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_meta": 53628, 2024-09-16T03:25:55.934 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_avail": 209660640, 2024-09-16T03:25:55.935 INFO:tasks.workunit.client.0.smithi096.stderr: "statfs": { 2024-09-16T03:25:55.935 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 214748364800, 2024-09-16T03:25:55.935 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 214692495360, 2024-09-16T03:25:55.935 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:25:55.935 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 851968, 2024-09-16T03:25:55.935 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 318404, 2024-09-16T03:25:55.935 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:25:55.935 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:25:55.935 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:25:55.935 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 3190, 2024-09-16T03:25:55.935 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 54915978 2024-09-16T03:25:55.935 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.935 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_peers": [], 2024-09-16T03:25:55.935 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_trim_queue_len": 0, 2024-09-16T03:25:55.936 INFO:tasks.workunit.client.0.smithi096.stderr: "num_snap_trimming": 0, 2024-09-16T03:25:55.936 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shards_repaired": 0, 2024-09-16T03:25:55.936 INFO:tasks.workunit.client.0.smithi096.stderr: "op_queue_age_hist": { 2024-09-16T03:25:55.936 INFO:tasks.workunit.client.0.smithi096.stderr: "histogram": [], 2024-09-16T03:25:55.936 INFO:tasks.workunit.client.0.smithi096.stderr: "upper_bound": 1 2024-09-16T03:25:55.936 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.936 INFO:tasks.workunit.client.0.smithi096.stderr: "perf_stat": { 2024-09-16T03:25:55.936 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ms": 256, 2024-09-16T03:25:55.936 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ms": 256, 2024-09-16T03:25:55.936 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ns": 256000000, 2024-09-16T03:25:55.936 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ns": 256000000 2024-09-16T03:25:55.936 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.936 INFO:tasks.workunit.client.0.smithi096.stderr: "alerts": [], 2024-09-16T03:25:55.937 INFO:tasks.workunit.client.0.smithi096.stderr: "network_ping_times": [] 2024-09-16T03:25:55.937 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.937 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_sum_by_class": { 2024-09-16T03:25:55.937 INFO:tasks.workunit.client.0.smithi096.stderr: "hdd": { 2024-09-16T03:25:55.937 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 0, 2024-09-16T03:25:55.937 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 0, 2024-09-16T03:25:55.937 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pgs": 128, 2024-09-16T03:25:55.937 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osds": 2, 2024-09-16T03:25:55.937 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_osds": 2, 2024-09-16T03:25:55.937 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_omap_osds": 2, 2024-09-16T03:25:55.937 INFO:tasks.workunit.client.0.smithi096.stderr: "kb": 209715200, 2024-09-16T03:25:55.937 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used": 54560, 2024-09-16T03:25:55.937 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_data": 832, 2024-09-16T03:25:55.937 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_omap": 3, 2024-09-16T03:25:55.938 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_meta": 53628, 2024-09-16T03:25:55.938 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_avail": 209660640, 2024-09-16T03:25:55.938 INFO:tasks.workunit.client.0.smithi096.stderr: "statfs": { 2024-09-16T03:25:55.938 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 214748364800, 2024-09-16T03:25:55.938 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 214692495360, 2024-09-16T03:25:55.938 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:25:55.938 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 851968, 2024-09-16T03:25:55.938 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 318404, 2024-09-16T03:25:55.938 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:25:55.938 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:25:55.938 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:25:55.938 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 3190, 2024-09-16T03:25:55.938 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 54915978 2024-09-16T03:25:55.938 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.939 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_peers": [], 2024-09-16T03:25:55.939 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_trim_queue_len": 0, 2024-09-16T03:25:55.939 INFO:tasks.workunit.client.0.smithi096.stderr: "num_snap_trimming": 0, 2024-09-16T03:25:55.939 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shards_repaired": 0, 2024-09-16T03:25:55.939 INFO:tasks.workunit.client.0.smithi096.stderr: "op_queue_age_hist": { 2024-09-16T03:25:55.939 INFO:tasks.workunit.client.0.smithi096.stderr: "histogram": [], 2024-09-16T03:25:55.939 INFO:tasks.workunit.client.0.smithi096.stderr: "upper_bound": 1 2024-09-16T03:25:55.939 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.939 INFO:tasks.workunit.client.0.smithi096.stderr: "perf_stat": { 2024-09-16T03:25:55.939 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ms": 256, 2024-09-16T03:25:55.939 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ms": 256, 2024-09-16T03:25:55.939 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ns": 256000000, 2024-09-16T03:25:55.939 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ns": 256000000 2024-09-16T03:25:55.939 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.940 INFO:tasks.workunit.client.0.smithi096.stderr: "alerts": [], 2024-09-16T03:25:55.940 INFO:tasks.workunit.client.0.smithi096.stderr: "network_ping_times": [] 2024-09-16T03:25:55.940 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:55.940 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.940 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_stats": [ 2024-09-16T03:25:55.940 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.940 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 2, 2024-09-16T03:25:55.940 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 32, 2024-09-16T03:25:55.940 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:25:55.940 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:25:55.940 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:25:55.940 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:25:55.940 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:25:55.941 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:25:55.941 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:25:55.941 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:25:55.941 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:25:55.941 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:25:55.941 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:25:55.941 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:25:55.941 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:25:55.941 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:25:55.941 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:25:55.941 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:25:55.941 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:25:55.941 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:25:55.941 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:25:55.942 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:25:55.942 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:25:55.942 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:25:55.942 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:25:55.942 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:25:55.942 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:25:55.942 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:25:55.942 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:25:55.942 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:25:55.942 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:25:55.942 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:25:55.942 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:25:55.942 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:25:55.942 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:25:55.942 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:25:55.943 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:25:55.943 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:25:55.943 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:25:55.943 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:25:55.943 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:25:55.943 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:25:55.943 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:25:55.943 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.943 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:25:55.943 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:25:55.943 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:25:55.943 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:25:55.943 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:25:55.943 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:25:55.943 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:25:55.944 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:25:55.944 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:25:55.944 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:25:55.944 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:25:55.944 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.944 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:25:55.944 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:25:55.944 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 64, 2024-09-16T03:25:55.944 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 64, 2024-09-16T03:25:55.944 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 3 2024-09-16T03:25:55.944 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.944 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.944 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 1, 2024-09-16T03:25:55.944 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 32, 2024-09-16T03:25:55.945 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:25:55.945 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:25:55.945 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:25:55.945 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:25:55.945 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:25:55.945 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:25:55.945 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:25:55.945 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:25:55.945 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:25:55.945 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:25:55.945 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:25:55.945 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:25:55.945 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:25:55.945 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:25:55.946 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:25:55.946 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:25:55.946 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:25:55.946 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:25:55.946 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:25:55.946 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:25:55.946 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:25:55.946 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:25:55.946 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:25:55.946 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:25:55.946 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:25:55.946 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:25:55.946 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:25:55.947 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:25:55.947 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:25:55.947 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:25:55.947 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:25:55.947 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:25:55.947 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:25:55.947 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:25:55.947 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:25:55.947 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:25:55.947 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:25:55.947 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:25:55.947 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:25:55.947 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:25:55.948 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:25:55.948 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.948 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:25:55.948 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:25:55.948 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:25:55.949 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:25:55.949 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:25:55.949 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:25:55.949 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:25:55.949 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:25:55.949 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:25:55.949 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:25:55.949 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:25:55.949 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.949 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:25:55.949 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:25:55.949 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 64, 2024-09-16T03:25:55.949 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 64, 2024-09-16T03:25:55.950 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 3 2024-09-16T03:25:55.950 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:55.950 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:55.950 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_stats": [ 2024-09-16T03:25:55.950 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.950 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:25:55.950 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 21474836517 2024-09-16T03:25:55.950 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.950 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.950 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:25:55.950 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 42949672988 2024-09-16T03:25:55.950 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.950 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.951 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:25:55.951 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 0 2024-09-16T03:25:55.951 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:55.951 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:55.951 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_by_state": [ 2024-09-16T03:25:55.951 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.951 INFO:tasks.workunit.client.0.smithi096.stderr: "state": "active+undersized", 2024-09-16T03:25:55.951 INFO:tasks.workunit.client.0.smithi096.stderr: "num": 64 2024-09-16T03:25:55.951 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:55.951 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:55.951 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_by_osd": [ 2024-09-16T03:25:55.951 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.951 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:25:55.951 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 0, 2024-09-16T03:25:55.952 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 0, 2024-09-16T03:25:55.952 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:25:55.952 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.952 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.952 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:25:55.952 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 28, 2024-09-16T03:25:55.952 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 64, 2024-09-16T03:25:55.952 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:25:55.952 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.952 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.952 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:25:55.952 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 36, 2024-09-16T03:25:55.952 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 64, 2024-09-16T03:25:55.952 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:25:55.953 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:55.953 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:55.953 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": [ 2024-09-16T03:25:55.953 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.953 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 1, 2024-09-16T03:25:55.953 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": {} 2024-09-16T03:25:55.953 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.953 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:55.953 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 2, 2024-09-16T03:25:55.953 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": {} 2024-09-16T03:25:55.953 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:55.953 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:55.953 INFO:tasks.workunit.client.0.smithi096.stderr: "servicemap": { 2024-09-16T03:25:55.953 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 5, 2024-09-16T03:25:55.954 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:25:38.422788+0000", 2024-09-16T03:25:55.954 INFO:tasks.workunit.client.0.smithi096.stderr: "services": {} 2024-09-16T03:25:55.954 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:55.954 INFO:tasks.workunit.client.0.smithi096.stderr: "mgrstat_first_committed": 77, 2024-09-16T03:25:55.954 INFO:tasks.workunit.client.0.smithi096.stderr: "mgrstat_last_committed": 83, 2024-09-16T03:25:55.954 INFO:tasks.workunit.client.0.smithi096.stderr: "logm_first_committed": 1, 2024-09-16T03:25:55.954 INFO:tasks.workunit.client.0.smithi096.stderr: "logm_last_committed": 363, 2024-09-16T03:25:55.954 INFO:tasks.workunit.client.0.smithi096.stderr: "paxos": { 2024-09-16T03:25:55.954 INFO:tasks.workunit.client.0.smithi096.stderr: "first_committed": 1, 2024-09-16T03:25:55.954 INFO:tasks.workunit.client.0.smithi096.stderr: "last_committed": 542, 2024-09-16T03:25:55.954 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pn": 0, 2024-09-16T03:25:55.954 INFO:tasks.workunit.client.0.smithi096.stderr: "accepted_pn": 0 2024-09-16T03:25:55.954 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:55.954 INFO:tasks.workunit.client.0.smithi096.stderr:}' 2024-09-16T03:25:55.958 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:30: check_lec_equals_pools: jq .osdmap_clean_epochs.min_last_epoch_clean 2024-09-16T03:25:55.959 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:30: check_lec_equals_pools: echo '{' '"cluster_fingerprint":' '"fda2fc64-07ed-4add-8224-2e527e11d427",' '"version":' '"19.3.0-4930-gfc3e0bff",' '"commit":' '"fc3e0bff7468fd55478adbae7f75508b749124b6",' '"timestamp":' '"2024-09-16T03:25:55.835988+0000",' '"tag":' '"",' '"health":' '{' '"status":' '"HEALTH_OK",' '"checks":' '{},' '"mutes":' '[]' '},' '"monmap_first_committed":' 1, '"monmap_last_committed":' 1, '"monmap":' '{' '"epoch":' 1, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"modified":' '"2024-09-16T03:22:45.872880Z",' '"created":' '"2024-09-16T03:22:45.872880Z",' '"min_mon_release":' 19, '"min_mon_release_name":' '"squid",' '"election_strategy":' 1, '"disallowed_leaders:' '":' '"",' '"stretch_mode":' false, '"tiebreaker_mon":' '"",' '"removed_ranks:' '":' '"",' '"features":' '{' '"persistent":' '[' '"kraken",' '"luminous",' '"mimic",' '"osdmap-prune",' '"nautilus",' '"octopus",' '"pacific",' '"elector-pinging",' '"quincy",' '"reef",' '"squid"' '],' '"optional":' '[]' '},' '"mons":' '[' '{' '"rank":' 0, '"name":' '"a",' '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:7302",' '"nonce":' 0 '}' ']' '},' '"addr":' '"127.0.0.1:7302/0",' '"public_addr":' '"127.0.0.1:7302/0",' '"priority":' 0, '"weight":' 0, '"crush_location":' '"{}"' '}' ']' '},' '"quorum":' '[' 0 '],' '"osdmap":' '{' '"epoch":' 80, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"created":' '"2024-09-16T03:22:46.906117+0000",' '"modified":' '"2024-09-16T03:25:52.948673+0000",' '"last_up_change":' '"2024-09-16T03:25:08.513363+0000",' '"last_in_change":' '"2024-09-16T03:25:09.839444+0000",' '"flags":' '"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit",' '"flags_num":' 5799936, '"flags_set":' '[' '"pglog_hardlimit",' '"purged_snapdirs",' '"recovery_deletes",' '"sortbitwise"' '],' '"crush_version":' 7, '"full_ratio":' 0.97000002861022949, '"backfillfull_ratio":' 0.97000002861022949, '"nearfull_ratio":' 0.85000002384185791, '"cluster_snapshot":' '"",' '"pool_max":' 2, '"max_osd":' 3, '"require_min_compat_client":' '"luminous",' '"min_compat_client":' '"jewel",' '"require_osd_release":' '"squid",' '"allow_crimson":' false, '"pools":' '[' '{' '"pool":' 1, '"pool_name":' '"foo",' '"create_time":' '"2024-09-16T03:24:44.525189+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"30",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.8700000047683716, '"score_stable":' 1.8700000047683716, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1.25, '"raw_score_stable":' 1.25, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '},' '{' '"pool":' 2, '"pool_name":' '"bar",' '"create_time":' '"2024-09-16T03:24:46.226575+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"32",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.4900000095367432, '"score_stable":' 1.4900000095367432, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1, '"raw_score_stable":' 1, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '}' '],' '"osds":' '[' '{' '"osd":' 0, '"uuid":' '"64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 5, '"up_thru":' 33, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6802",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6803",' '"nonce":' 3375787448 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6804",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6805",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6808",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6809",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6806",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6807",' '"nonce":' 3375787448 '}' ']' '},' '"public_addr":' '"127.0.0.1:6803/3375787448",' '"cluster_addr":' '"127.0.0.1:6805/3375787448",' '"heartbeat_back_addr":' '"127.0.0.1:6809/3375787448",' '"heartbeat_front_addr":' '"127.0.0.1:6807/3375787448",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 1, '"uuid":' '"74b26727-75c9-444d-8782-719e4197a382",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 10, '"up_thru":' 33, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6810",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6811",' '"nonce":' 3733255132 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6812",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6813",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6816",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6817",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6814",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6815",' '"nonce":' 3733255132 '}' ']' '},' '"public_addr":' '"127.0.0.1:6811/3733255132",' '"cluster_addr":' '"127.0.0.1:6813/3733255132",' '"heartbeat_back_addr":' '"127.0.0.1:6817/3733255132",' '"heartbeat_front_addr":' '"127.0.0.1:6815/3733255132",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 2, '"uuid":' '"143da3a7-dad9-4b1e-966b-76cf5bdd3c82",' '"up":' 0, '"in":' 0, '"weight":' 0, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 15, '"up_thru":' 21, '"down_at":' 33, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6818",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6819",' '"nonce":' 963814857 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6820",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6821",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6824",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6825",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6822",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6823",' '"nonce":' 963814857 '}' ']' '},' '"public_addr":' '"127.0.0.1:6819/963814857",' '"cluster_addr":' '"127.0.0.1:6821/963814857",' '"heartbeat_back_addr":' '"127.0.0.1:6825/963814857",' '"heartbeat_front_addr":' '"127.0.0.1:6823/963814857",' '"state":' '[' '"exists"' ']' '}' '],' '"osd_xinfo":' '[' '{' '"osd":' 0, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:22.481942+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 1, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:59.663703+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 2, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 65536, '"last_purged_snaps_scrub":' '"2024-09-16T03:24:37.320822+0000",' '"dead_epoch":' 32 '}' '],' '"pg_upmap":' '[],' '"pg_upmap_items":' '[],' '"pg_upmap_primaries":' '[],' '"pg_temp":' '[],' '"primary_temp":' '[],' '"blocklist":' '{},' '"range_blocklist":' '{},' '"erasure_code_profiles":' '{' '"default":' '{' '"k":' '"2",' '"m":' '"2",' '"plugin":' '"jerasure",' '"technique":' '"reed_sol_van"' '}' '},' '"removed_snaps_queue":' '[],' '"new_removed_snaps":' '[],' '"new_purged_snaps":' '[],' '"crush_node_flags":' '{},' '"device_class_flags":' '{},' '"stretch_mode":' '{' '"stretch_mode_enabled":' false, '"stretch_bucket_count":' 0, '"degraded_stretch_mode":' 0, '"recovering_stretch_mode":' 0, '"stretch_mode_bucket":' 0 '}' '},' '"osd_metadata":' '[' '{' '"id":' 0, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/0/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:22:53.662571Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]",' '"hb_front_addr":' '"[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/0",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 1, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/1/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:23:30.129885Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]",' '"hb_front_addr":' '"[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/1",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 2, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/2/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:24:07.764502Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]",' '"hb_front_addr":' '"[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/2",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '}' '],' '"osdmap_clean_epochs":' '{' '"min_last_epoch_clean":' 28, '"last_epoch_clean":' '{' '"per_pool":' '[' '{' '"poolid":' 1, '"floor":' 28 '},' '{' '"poolid":' 2, '"floor":' 28 '}' ']' '},' '"osd_epochs":' '[' '{' '"id":' 0, '"epoch":' 78 '},' '{' '"id":' 1, '"epoch":' 80 '}' ']' '},' '"osdmap_first_committed":' 28, '"osdmap_last_committed":' 80, '"crushmap":' '{' '"devices":' '[' '{' '"id":' 0, '"name":' '"osd.0",' '"class":' '"hdd"' '},' '{' '"id":' 1, '"name":' '"osd.1",' '"class":' '"hdd"' '},' '{' '"id":' 2, '"name":' '"osd.2",' '"class":' '"hdd"' '}' '],' '"types":' '[' '{' '"type_id":' 0, '"name":' '"osd"' '},' '{' '"type_id":' 1, '"name":' '"host"' '},' '{' '"type_id":' 2, '"name":' '"chassis"' '},' '{' '"type_id":' 3, '"name":' '"rack"' '},' '{' '"type_id":' 4, '"name":' '"row"' '},' '{' '"type_id":' 5, '"name":' '"pdu"' '},' '{' '"type_id":' 6, '"name":' '"pod"' '},' '{' '"type_id":' 7, '"name":' '"room"' '},' '{' '"type_id":' 8, '"name":' '"datacenter"' '},' '{' '"type_id":' 9, '"name":' '"zone"' '},' '{' '"type_id":' 10, '"name":' '"region"' '},' '{' '"type_id":' 11, '"name":' '"root"' '}' '],' '"buckets":' '[' '{' '"id":' -1, '"name":' '"default",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -3, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -2, '"name":' '"default~hdd",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -4, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -3, '"name":' '"smithi096",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '},' '{' '"id":' -4, '"name":' '"smithi096~hdd",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '}' '],' '"rules":' '[' '{' '"rule_id":' 0, '"rule_name":' '"replicated_rule",' '"type":' 1, '"steps":' '[' '{' '"op":' '"take",' '"item":' -1, '"item_name":' '"default"' '},' '{' '"op":' '"choose_firstn",' '"num":' 0, '"type":' '"osd"' '},' '{' '"op":' '"emit"' '}' ']' '}' '],' '"tunables":' '{' '"choose_local_tries":' 0, '"choose_local_fallback_tries":' 0, '"choose_total_tries":' 50, '"chooseleaf_descend_once":' 1, '"chooseleaf_vary_r":' 1, '"chooseleaf_stable":' 1, '"msr_descents":' 100, '"msr_collision_tries":' 100, '"straw_calc_version":' 1, '"allowed_bucket_algs":' 54, '"profile":' '"jewel",' '"optimal_tunables":' 1, '"legacy_tunables":' 0, '"minimum_required_version":' '"jewel",' '"require_feature_tunables":' 1, '"require_feature_tunables2":' 1, '"has_v2_rules":' 0, '"require_feature_tunables3":' 1, '"has_v3_rules":' 0, '"has_v4_buckets":' 1, '"require_feature_tunables5":' 1, '"has_v5_rules":' 0, '"has_msr_rules":' 0 '},' '"choose_args":' '{}' '},' '"fsmap":' '{' '"epoch":' 1, '"btime":' '"2024-09-16T03:22:46:882186+0000",' '"default_fscid":' -1, '"compat":' '{' '"compat":' '{},' '"ro_compat":' '{},' '"incompat":' '{' '"feature_1":' '"base' 'v0.20",' '"feature_2":' '"client' writeable 'ranges",' '"feature_3":' '"default' file layouts on 'dirs",' '"feature_4":' '"dir' inode in separate 'object",' '"feature_5":' '"mds' uses versioned 'encoding",' '"feature_6":' '"dirfrag' is stored in 'omap",' '"feature_8":' '"no' anchor 'table",' '"feature_9":' '"file' layout 'v2",' '"feature_10":' '"snaprealm' 'v2",' '"feature_11":' '"minor' log 'segments",' '"feature_12":' '"quiesce' 'subvolumes"' '}' '},' '"feature_flags":' '{' '"enable_multiple":' true, '"ever_enabled_multiple":' true '},' '"standbys":' '[],' '"filesystems":' '[]' '},' '"mdsmap_first_committed":' 1, '"mdsmap_last_committed":' 1, '"auth":' '{' '"first_committed":' 1, '"last_committed":' 5, '"num_secrets":' 3 '},' '"num_pg":' 64, '"num_pg_active":' 64, '"num_pg_unknown":' 0, '"num_osd":' 3, '"pool_sum":' '{' '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 128, '"acting":' 128, '"num_store_stats":' 0 '},' '"osd_sum":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54560, '"kb_used_data":' 832, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660640, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692495360, '"internally_reserved":' 0, '"allocated":' 851968, '"data_stored":' 318404, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 256, '"apply_latency_ms":' 256, '"commit_latency_ns":' 256000000, '"apply_latency_ns":' 256000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '},' '"osd_sum_by_class":' '{' '"hdd":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54560, '"kb_used_data":' 832, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660640, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692495360, '"internally_reserved":' 0, '"allocated":' 851968, '"data_stored":' 318404, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 256, '"apply_latency_ms":' 256, '"commit_latency_ns":' 256000000, '"apply_latency_ns":' 256000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '}' '},' '"pool_stats":' '[' '{' '"poolid":' 2, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '},' '{' '"poolid":' 1, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '}' '],' '"osd_stats":' '[' '{' '"osd":' 0, '"seq":' 21474836517 '},' '{' '"osd":' 1, '"seq":' 42949672988 '},' '{' '"osd":' 2, '"seq":' 0 '}' '],' '"num_pg_by_state":' '[' '{' '"state":' '"active+undersized",' '"num":' 64 '}' '],' '"num_pg_by_osd":' '[' '{' '"osd":' 2, '"num_primary_pg":' 0, '"num_acting_pg":' 0, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 0, '"num_primary_pg":' 28, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 1, '"num_primary_pg":' 36, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '}' '],' '"purged_snaps":' '[' '{' '"pool":' 1, '"purged_snaps":' '{}' '},' '{' '"pool":' 2, '"purged_snaps":' '{}' '}' '],' '"servicemap":' '{' '"epoch":' 5, '"modified":' '"2024-09-16T03:25:38.422788+0000",' '"services":' '{}' '},' '"mgrstat_first_committed":' 77, '"mgrstat_last_committed":' 83, '"logm_first_committed":' 1, '"logm_last_committed":' 363, '"paxos":' '{' '"first_committed":' 1, '"last_committed":' 542, '"last_pn":' 0, '"accepted_pn":' 0 '}' '}' 2024-09-16T03:25:55.959 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:30: check_lec_equals_pools: lec=28 2024-09-16T03:25:55.959 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:32: check_lec_equals_pools: [[ -z '' ]] 2024-09-16T03:25:55.959 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:36: check_lec_equals_pools: pools=($(echo $report | jq ".osdmap_clean_epochs.last_epoch_clean.per_pool[] |" " select(.floor == $lec) | .poolid")) 2024-09-16T03:25:55.959 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:36: check_lec_equals_pools: jq '.osdmap_clean_epochs.last_epoch_clean.per_pool[] |' ' select(.floor == 28) | .poolid' 2024-09-16T03:25:55.959 INFO:tasks.workunit.client.0.smithi096.stderr:jq: error: syntax error, unexpected $end (Unix shell quoting issues?) at , line 1: 2024-09-16T03:25:55.959 INFO:tasks.workunit.client.0.smithi096.stderr:.osdmap_clean_epochs.last_epoch_clean.per_pool[] | 2024-09-16T03:25:55.959 INFO:tasks.workunit.client.0.smithi096.stderr:jq: 1 compile error 2024-09-16T03:25:55.959 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:36: check_lec_equals_pools: echo '{' '"cluster_fingerprint":' '"fda2fc64-07ed-4add-8224-2e527e11d427",' '"version":' '"19.3.0-4930-gfc3e0bff",' '"commit":' '"fc3e0bff7468fd55478adbae7f75508b749124b6",' '"timestamp":' '"2024-09-16T03:25:55.835988+0000",' '"tag":' '"",' '"health":' '{' '"status":' '"HEALTH_OK",' '"checks":' '{},' '"mutes":' '[]' '},' '"monmap_first_committed":' 1, '"monmap_last_committed":' 1, '"monmap":' '{' '"epoch":' 1, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"modified":' '"2024-09-16T03:22:45.872880Z",' '"created":' '"2024-09-16T03:22:45.872880Z",' '"min_mon_release":' 19, '"min_mon_release_name":' '"squid",' '"election_strategy":' 1, '"disallowed_leaders:' '":' '"",' '"stretch_mode":' false, '"tiebreaker_mon":' '"",' '"removed_ranks:' '":' '"",' '"features":' '{' '"persistent":' '[' '"kraken",' '"luminous",' '"mimic",' '"osdmap-prune",' '"nautilus",' '"octopus",' '"pacific",' '"elector-pinging",' '"quincy",' '"reef",' '"squid"' '],' '"optional":' '[]' '},' '"mons":' '[' '{' '"rank":' 0, '"name":' '"a",' '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:7302",' '"nonce":' 0 '}' ']' '},' '"addr":' '"127.0.0.1:7302/0",' '"public_addr":' '"127.0.0.1:7302/0",' '"priority":' 0, '"weight":' 0, '"crush_location":' '"{}"' '}' ']' '},' '"quorum":' '[' 0 '],' '"osdmap":' '{' '"epoch":' 80, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"created":' '"2024-09-16T03:22:46.906117+0000",' '"modified":' '"2024-09-16T03:25:52.948673+0000",' '"last_up_change":' '"2024-09-16T03:25:08.513363+0000",' '"last_in_change":' '"2024-09-16T03:25:09.839444+0000",' '"flags":' '"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit",' '"flags_num":' 5799936, '"flags_set":' '[' '"pglog_hardlimit",' '"purged_snapdirs",' '"recovery_deletes",' '"sortbitwise"' '],' '"crush_version":' 7, '"full_ratio":' 0.97000002861022949, '"backfillfull_ratio":' 0.97000002861022949, '"nearfull_ratio":' 0.85000002384185791, '"cluster_snapshot":' '"",' '"pool_max":' 2, '"max_osd":' 3, '"require_min_compat_client":' '"luminous",' '"min_compat_client":' '"jewel",' '"require_osd_release":' '"squid",' '"allow_crimson":' false, '"pools":' '[' '{' '"pool":' 1, '"pool_name":' '"foo",' '"create_time":' '"2024-09-16T03:24:44.525189+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"30",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.8700000047683716, '"score_stable":' 1.8700000047683716, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1.25, '"raw_score_stable":' 1.25, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '},' '{' '"pool":' 2, '"pool_name":' '"bar",' '"create_time":' '"2024-09-16T03:24:46.226575+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"32",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.4900000095367432, '"score_stable":' 1.4900000095367432, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1, '"raw_score_stable":' 1, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '}' '],' '"osds":' '[' '{' '"osd":' 0, '"uuid":' '"64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 5, '"up_thru":' 33, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6802",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6803",' '"nonce":' 3375787448 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6804",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6805",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6808",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6809",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6806",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6807",' '"nonce":' 3375787448 '}' ']' '},' '"public_addr":' '"127.0.0.1:6803/3375787448",' '"cluster_addr":' '"127.0.0.1:6805/3375787448",' '"heartbeat_back_addr":' '"127.0.0.1:6809/3375787448",' '"heartbeat_front_addr":' '"127.0.0.1:6807/3375787448",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 1, '"uuid":' '"74b26727-75c9-444d-8782-719e4197a382",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 10, '"up_thru":' 33, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6810",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6811",' '"nonce":' 3733255132 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6812",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6813",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6816",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6817",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6814",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6815",' '"nonce":' 3733255132 '}' ']' '},' '"public_addr":' '"127.0.0.1:6811/3733255132",' '"cluster_addr":' '"127.0.0.1:6813/3733255132",' '"heartbeat_back_addr":' '"127.0.0.1:6817/3733255132",' '"heartbeat_front_addr":' '"127.0.0.1:6815/3733255132",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 2, '"uuid":' '"143da3a7-dad9-4b1e-966b-76cf5bdd3c82",' '"up":' 0, '"in":' 0, '"weight":' 0, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 15, '"up_thru":' 21, '"down_at":' 33, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6818",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6819",' '"nonce":' 963814857 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6820",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6821",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6824",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6825",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6822",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6823",' '"nonce":' 963814857 '}' ']' '},' '"public_addr":' '"127.0.0.1:6819/963814857",' '"cluster_addr":' '"127.0.0.1:6821/963814857",' '"heartbeat_back_addr":' '"127.0.0.1:6825/963814857",' '"heartbeat_front_addr":' '"127.0.0.1:6823/963814857",' '"state":' '[' '"exists"' ']' '}' '],' '"osd_xinfo":' '[' '{' '"osd":' 0, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:22.481942+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 1, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:59.663703+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 2, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 65536, '"last_purged_snaps_scrub":' '"2024-09-16T03:24:37.320822+0000",' '"dead_epoch":' 32 '}' '],' '"pg_upmap":' '[],' '"pg_upmap_items":' '[],' '"pg_upmap_primaries":' '[],' '"pg_temp":' '[],' '"primary_temp":' '[],' '"blocklist":' '{},' '"range_blocklist":' '{},' '"erasure_code_profiles":' '{' '"default":' '{' '"k":' '"2",' '"m":' '"2",' '"plugin":' '"jerasure",' '"technique":' '"reed_sol_van"' '}' '},' '"removed_snaps_queue":' '[],' '"new_removed_snaps":' '[],' '"new_purged_snaps":' '[],' '"crush_node_flags":' '{},' '"device_class_flags":' '{},' '"stretch_mode":' '{' '"stretch_mode_enabled":' false, '"stretch_bucket_count":' 0, '"degraded_stretch_mode":' 0, '"recovering_stretch_mode":' 0, '"stretch_mode_bucket":' 0 '}' '},' '"osd_metadata":' '[' '{' '"id":' 0, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/0/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:22:53.662571Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]",' '"hb_front_addr":' '"[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/0",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 1, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/1/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:23:30.129885Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]",' '"hb_front_addr":' '"[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/1",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 2, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/2/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:24:07.764502Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]",' '"hb_front_addr":' '"[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/2",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '}' '],' '"osdmap_clean_epochs":' '{' '"min_last_epoch_clean":' 28, '"last_epoch_clean":' '{' '"per_pool":' '[' '{' '"poolid":' 1, '"floor":' 28 '},' '{' '"poolid":' 2, '"floor":' 28 '}' ']' '},' '"osd_epochs":' '[' '{' '"id":' 0, '"epoch":' 78 '},' '{' '"id":' 1, '"epoch":' 80 '}' ']' '},' '"osdmap_first_committed":' 28, '"osdmap_last_committed":' 80, '"crushmap":' '{' '"devices":' '[' '{' '"id":' 0, '"name":' '"osd.0",' '"class":' '"hdd"' '},' '{' '"id":' 1, '"name":' '"osd.1",' '"class":' '"hdd"' '},' '{' '"id":' 2, '"name":' '"osd.2",' '"class":' '"hdd"' '}' '],' '"types":' '[' '{' '"type_id":' 0, '"name":' '"osd"' '},' '{' '"type_id":' 1, '"name":' '"host"' '},' '{' '"type_id":' 2, '"name":' '"chassis"' '},' '{' '"type_id":' 3, '"name":' '"rack"' '},' '{' '"type_id":' 4, '"name":' '"row"' '},' '{' '"type_id":' 5, '"name":' '"pdu"' '},' '{' '"type_id":' 6, '"name":' '"pod"' '},' '{' '"type_id":' 7, '"name":' '"room"' '},' '{' '"type_id":' 8, '"name":' '"datacenter"' '},' '{' '"type_id":' 9, '"name":' '"zone"' '},' '{' '"type_id":' 10, '"name":' '"region"' '},' '{' '"type_id":' 11, '"name":' '"root"' '}' '],' '"buckets":' '[' '{' '"id":' -1, '"name":' '"default",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -3, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -2, '"name":' '"default~hdd",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -4, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -3, '"name":' '"smithi096",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '},' '{' '"id":' -4, '"name":' '"smithi096~hdd",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '}' '],' '"rules":' '[' '{' '"rule_id":' 0, '"rule_name":' '"replicated_rule",' '"type":' 1, '"steps":' '[' '{' '"op":' '"take",' '"item":' -1, '"item_name":' '"default"' '},' '{' '"op":' '"choose_firstn",' '"num":' 0, '"type":' '"osd"' '},' '{' '"op":' '"emit"' '}' ']' '}' '],' '"tunables":' '{' '"choose_local_tries":' 0, '"choose_local_fallback_tries":' 0, '"choose_total_tries":' 50, '"chooseleaf_descend_once":' 1, '"chooseleaf_vary_r":' 1, '"chooseleaf_stable":' 1, '"msr_descents":' 100, '"msr_collision_tries":' 100, '"straw_calc_version":' 1, '"allowed_bucket_algs":' 54, '"profile":' '"jewel",' '"optimal_tunables":' 1, '"legacy_tunables":' 0, '"minimum_required_version":' '"jewel",' '"require_feature_tunables":' 1, '"require_feature_tunables2":' 1, '"has_v2_rules":' 0, '"require_feature_tunables3":' 1, '"has_v3_rules":' 0, '"has_v4_buckets":' 1, '"require_feature_tunables5":' 1, '"has_v5_rules":' 0, '"has_msr_rules":' 0 '},' '"choose_args":' '{}' '},' '"fsmap":' '{' '"epoch":' 1, '"btime":' '"2024-09-16T03:22:46:882186+0000",' '"default_fscid":' -1, '"compat":' '{' '"compat":' '{},' '"ro_compat":' '{},' '"incompat":' '{' '"feature_1":' '"base' 'v0.20",' '"feature_2":' '"client' writeable 'ranges",' '"feature_3":' '"default' file layouts on 'dirs",' '"feature_4":' '"dir' inode in separate 'object",' '"feature_5":' '"mds' uses versioned 'encoding",' '"feature_6":' '"dirfrag' is stored in 'omap",' '"feature_8":' '"no' anchor 'table",' '"feature_9":' '"file' layout 'v2",' '"feature_10":' '"snaprealm' 'v2",' '"feature_11":' '"minor' log 'segments",' '"feature_12":' '"quiesce' 'subvolumes"' '}' '},' '"feature_flags":' '{' '"enable_multiple":' true, '"ever_enabled_multiple":' true '},' '"standbys":' '[],' '"filesystems":' '[]' '},' '"mdsmap_first_committed":' 1, '"mdsmap_last_committed":' 1, '"auth":' '{' '"first_committed":' 1, '"last_committed":' 5, '"num_secrets":' 3 '},' '"num_pg":' 64, '"num_pg_active":' 64, '"num_pg_unknown":' 0, '"num_osd":' 3, '"pool_sum":' '{' '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 128, '"acting":' 128, '"num_store_stats":' 0 '},' '"osd_sum":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54560, '"kb_used_data":' 832, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660640, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692495360, '"internally_reserved":' 0, '"allocated":' 851968, '"data_stored":' 318404, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 256, '"apply_latency_ms":' 256, '"commit_latency_ns":' 256000000, '"apply_latency_ns":' 256000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '},' '"osd_sum_by_class":' '{' '"hdd":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54560, '"kb_used_data":' 832, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660640, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692495360, '"internally_reserved":' 0, '"allocated":' 851968, '"data_stored":' 318404, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 256, '"apply_latency_ms":' 256, '"commit_latency_ns":' 256000000, '"apply_latency_ns":' 256000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '}' '},' '"pool_stats":' '[' '{' '"poolid":' 2, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '},' '{' '"poolid":' 1, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '}' '],' '"osd_stats":' '[' '{' '"osd":' 0, '"seq":' 21474836517 '},' '{' '"osd":' 1, '"seq":' 42949672988 '},' '{' '"osd":' 2, '"seq":' 0 '}' '],' '"num_pg_by_state":' '[' '{' '"state":' '"active+undersized",' '"num":' 64 '}' '],' '"num_pg_by_osd":' '[' '{' '"osd":' 2, '"num_primary_pg":' 0, '"num_acting_pg":' 0, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 0, '"num_primary_pg":' 28, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 1, '"num_primary_pg":' 36, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '}' '],' '"purged_snaps":' '[' '{' '"pool":' 1, '"purged_snaps":' '{}' '},' '{' '"pool":' 2, '"purged_snaps":' '{}' '}' '],' '"servicemap":' '{' '"epoch":' 5, '"modified":' '"2024-09-16T03:25:38.422788+0000",' '"services":' '{}' '},' '"mgrstat_first_committed":' 77, '"mgrstat_last_committed":' 83, '"logm_first_committed":' 1, '"logm_last_committed":' 363, '"paxos":' '{' '"first_committed":' 1, '"last_committed":' 542, '"last_pn":' 0, '"accepted_pn":' 0 '}' '}' 2024-09-16T03:25:55.959 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:38: check_lec_equals_pools: [[ 0 -eq 2 ]] 2024-09-16T03:25:55.960 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:38: check_lec_equals_pools: echo '{' '"cluster_fingerprint":' '"fda2fc64-07ed-4add-8224-2e527e11d427",' '"version":' '"19.3.0-4930-gfc3e0bff",' '"commit":' '"fc3e0bff7468fd55478adbae7f75508b749124b6",' '"timestamp":' '"2024-09-16T03:25:55.835988+0000",' '"tag":' '"",' '"health":' '{' '"status":' '"HEALTH_OK",' '"checks":' '{},' '"mutes":' '[]' '},' '"monmap_first_committed":' 1, '"monmap_last_committed":' 1, '"monmap":' '{' '"epoch":' 1, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"modified":' '"2024-09-16T03:22:45.872880Z",' '"created":' '"2024-09-16T03:22:45.872880Z",' '"min_mon_release":' 19, '"min_mon_release_name":' '"squid",' '"election_strategy":' 1, '"disallowed_leaders:' '":' '"",' '"stretch_mode":' false, '"tiebreaker_mon":' '"",' '"removed_ranks:' '":' '"",' '"features":' '{' '"persistent":' '[' '"kraken",' '"luminous",' '"mimic",' '"osdmap-prune",' '"nautilus",' '"octopus",' '"pacific",' '"elector-pinging",' '"quincy",' '"reef",' '"squid"' '],' '"optional":' '[]' '},' '"mons":' '[' '{' '"rank":' 0, '"name":' '"a",' '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:7302",' '"nonce":' 0 '}' ']' '},' '"addr":' '"127.0.0.1:7302/0",' '"public_addr":' '"127.0.0.1:7302/0",' '"priority":' 0, '"weight":' 0, '"crush_location":' '"{}"' '}' ']' '},' '"quorum":' '[' 0 '],' '"osdmap":' '{' '"epoch":' 80, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"created":' '"2024-09-16T03:22:46.906117+0000",' '"modified":' '"2024-09-16T03:25:52.948673+0000",' '"last_up_change":' '"2024-09-16T03:25:08.513363+0000",' '"last_in_change":' '"2024-09-16T03:25:09.839444+0000",' '"flags":' '"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit",' '"flags_num":' 5799936, '"flags_set":' '[' '"pglog_hardlimit",' '"purged_snapdirs",' '"recovery_deletes",' '"sortbitwise"' '],' '"crush_version":' 7, '"full_ratio":' 0.97000002861022949, '"backfillfull_ratio":' 0.97000002861022949, '"nearfull_ratio":' 0.85000002384185791, '"cluster_snapshot":' '"",' '"pool_max":' 2, '"max_osd":' 3, '"require_min_compat_client":' '"luminous",' '"min_compat_client":' '"jewel",' '"require_osd_release":' '"squid",' '"allow_crimson":' false, '"pools":' '[' '{' '"pool":' 1, '"pool_name":' '"foo",' '"create_time":' '"2024-09-16T03:24:44.525189+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"30",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.8700000047683716, '"score_stable":' 1.8700000047683716, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1.25, '"raw_score_stable":' 1.25, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '},' '{' '"pool":' 2, '"pool_name":' '"bar",' '"create_time":' '"2024-09-16T03:24:46.226575+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"32",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.4900000095367432, '"score_stable":' 1.4900000095367432, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1, '"raw_score_stable":' 1, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '}' '],' '"osds":' '[' '{' '"osd":' 0, '"uuid":' '"64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 5, '"up_thru":' 33, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6802",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6803",' '"nonce":' 3375787448 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6804",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6805",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6808",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6809",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6806",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6807",' '"nonce":' 3375787448 '}' ']' '},' '"public_addr":' '"127.0.0.1:6803/3375787448",' '"cluster_addr":' '"127.0.0.1:6805/3375787448",' '"heartbeat_back_addr":' '"127.0.0.1:6809/3375787448",' '"heartbeat_front_addr":' '"127.0.0.1:6807/3375787448",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 1, '"uuid":' '"74b26727-75c9-444d-8782-719e4197a382",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 10, '"up_thru":' 33, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6810",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6811",' '"nonce":' 3733255132 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6812",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6813",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6816",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6817",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6814",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6815",' '"nonce":' 3733255132 '}' ']' '},' '"public_addr":' '"127.0.0.1:6811/3733255132",' '"cluster_addr":' '"127.0.0.1:6813/3733255132",' '"heartbeat_back_addr":' '"127.0.0.1:6817/3733255132",' '"heartbeat_front_addr":' '"127.0.0.1:6815/3733255132",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 2, '"uuid":' '"143da3a7-dad9-4b1e-966b-76cf5bdd3c82",' '"up":' 0, '"in":' 0, '"weight":' 0, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 15, '"up_thru":' 21, '"down_at":' 33, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6818",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6819",' '"nonce":' 963814857 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6820",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6821",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6824",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6825",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6822",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6823",' '"nonce":' 963814857 '}' ']' '},' '"public_addr":' '"127.0.0.1:6819/963814857",' '"cluster_addr":' '"127.0.0.1:6821/963814857",' '"heartbeat_back_addr":' '"127.0.0.1:6825/963814857",' '"heartbeat_front_addr":' '"127.0.0.1:6823/963814857",' '"state":' '[' '"exists"' ']' '}' '],' '"osd_xinfo":' '[' '{' '"osd":' 0, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:22.481942+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 1, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:59.663703+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 2, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 65536, '"last_purged_snaps_scrub":' '"2024-09-16T03:24:37.320822+0000",' '"dead_epoch":' 32 '}' '],' '"pg_upmap":' '[],' '"pg_upmap_items":' '[],' '"pg_upmap_primaries":' '[],' '"pg_temp":' '[],' '"primary_temp":' '[],' '"blocklist":' '{},' '"range_blocklist":' '{},' '"erasure_code_profiles":' '{' '"default":' '{' '"k":' '"2",' '"m":' '"2",' '"plugin":' '"jerasure",' '"technique":' '"reed_sol_van"' '}' '},' '"removed_snaps_queue":' '[],' '"new_removed_snaps":' '[],' '"new_purged_snaps":' '[],' '"crush_node_flags":' '{},' '"device_class_flags":' '{},' '"stretch_mode":' '{' '"stretch_mode_enabled":' false, '"stretch_bucket_count":' 0, '"degraded_stretch_mode":' 0, '"recovering_stretch_mode":' 0, '"stretch_mode_bucket":' 0 '}' '},' '"osd_metadata":' '[' '{' '"id":' 0, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/0/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:22:53.662571Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]",' '"hb_front_addr":' '"[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/0",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 1, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/1/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:23:30.129885Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]",' '"hb_front_addr":' '"[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/1",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 2, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/2/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:24:07.764502Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]",' '"hb_front_addr":' '"[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/2",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '}' '],' '"osdmap_clean_epochs":' '{' '"min_last_epoch_clean":' 28, '"last_epoch_clean":' '{' '"per_pool":' '[' '{' '"poolid":' 1, '"floor":' 28 '},' '{' '"poolid":' 2, '"floor":' 28 '}' ']' '},' '"osd_epochs":' '[' '{' '"id":' 0, '"epoch":' 78 '},' '{' '"id":' 1, '"epoch":' 80 '}' ']' '},' '"osdmap_first_committed":' 28, '"osdmap_last_committed":' 80, '"crushmap":' '{' '"devices":' '[' '{' '"id":' 0, '"name":' '"osd.0",' '"class":' '"hdd"' '},' '{' '"id":' 1, '"name":' '"osd.1",' '"class":' '"hdd"' '},' '{' '"id":' 2, '"name":' '"osd.2",' '"class":' '"hdd"' '}' '],' '"types":' '[' '{' '"type_id":' 0, '"name":' '"osd"' '},' '{' '"type_id":' 1, '"name":' '"host"' '},' '{' '"type_id":' 2, '"name":' '"chassis"' '},' '{' '"type_id":' 3, '"name":' '"rack"' '},' '{' '"type_id":' 4, '"name":' '"row"' '},' '{' '"type_id":' 5, '"name":' '"pdu"' '},' '{' '"type_id":' 6, '"name":' '"pod"' '},' '{' '"type_id":' 7, '"name":' '"room"' '},' '{' '"type_id":' 8, '"name":' '"datacenter"' '},' '{' '"type_id":' 9, '"name":' '"zone"' '},' '{' '"type_id":' 10, '"name":' '"region"' '},' '{' '"type_id":' 11, '"name":' '"root"' '}' '],' '"buckets":' '[' '{' '"id":' -1, '"name":' '"default",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -3, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -2, '"name":' '"default~hdd",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -4, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -3, '"name":' '"smithi096",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '},' '{' '"id":' -4, '"name":' '"smithi096~hdd",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '}' '],' '"rules":' '[' '{' '"rule_id":' 0, '"rule_name":' '"replicated_rule",' '"type":' 1, '"steps":' '[' '{' '"op":' '"take",' '"item":' -1, '"item_name":' '"default"' '},' '{' '"op":' '"choose_firstn",' '"num":' 0, '"type":' '"osd"' '},' '{' '"op":' '"emit"' '}' ']' '}' '],' '"tunables":' '{' '"choose_local_tries":' 0, '"choose_local_fallback_tries":' 0, '"choose_total_tries":' 50, '"chooseleaf_descend_once":' 1, '"chooseleaf_vary_r":' 1, '"chooseleaf_stable":' 1, '"msr_descents":' 100, '"msr_collision_tries":' 100, '"straw_calc_version":' 1, '"allowed_bucket_algs":' 54, '"profile":' '"jewel",' '"optimal_tunables":' 1, '"legacy_tunables":' 0, '"minimum_required_version":' '"jewel",' '"require_feature_tunables":' 1, '"require_feature_tunables2":' 1, '"has_v2_rules":' 0, '"require_feature_tunables3":' 1, '"has_v3_rules":' 0, '"has_v4_buckets":' 1, '"require_feature_tunables5":' 1, '"has_v5_rules":' 0, '"has_msr_rules":' 0 '},' '"choose_args":' '{}' '},' '"fsmap":' '{' '"epoch":' 1, '"btime":' '"2024-09-16T03:22:46:882186+0000",' '"default_fscid":' -1, '"compat":' '{' '"compat":' '{},' '"ro_compat":' '{},' '"incompat":' '{' '"feature_1":' '"base' 'v0.20",' '"feature_2":' '"client' writeable 'ranges",' '"feature_3":' '"default' file layouts on 'dirs",' '"feature_4":' '"dir' inode in separate 'object",' '"feature_5":' '"mds' uses versioned 'encoding",' '"feature_6":' '"dirfrag' is stored in 'omap",' '"feature_8":' '"no' anchor 'table",' '"feature_9":' '"file' layout 'v2",' '"feature_10":' '"snaprealm' 'v2",' '"feature_11":' '"minor' log 'segments",' '"feature_12":' '"quiesce' 'subvolumes"' '}' '},' '"feature_flags":' '{' '"enable_multiple":' true, '"ever_enabled_multiple":' true '},' '"standbys":' '[],' '"filesystems":' '[]' '},' '"mdsmap_first_committed":' 1, '"mdsmap_last_committed":' 1, '"auth":' '{' '"first_committed":' 1, '"last_committed":' 5, '"num_secrets":' 3 '},' '"num_pg":' 64, '"num_pg_active":' 64, '"num_pg_unknown":' 0, '"num_osd":' 3, '"pool_sum":' '{' '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 128, '"acting":' 128, '"num_store_stats":' 0 '},' '"osd_sum":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54560, '"kb_used_data":' 832, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660640, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692495360, '"internally_reserved":' 0, '"allocated":' 851968, '"data_stored":' 318404, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 256, '"apply_latency_ms":' 256, '"commit_latency_ns":' 256000000, '"apply_latency_ns":' 256000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '},' '"osd_sum_by_class":' '{' '"hdd":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54560, '"kb_used_data":' 832, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660640, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692495360, '"internally_reserved":' 0, '"allocated":' 851968, '"data_stored":' 318404, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 256, '"apply_latency_ms":' 256, '"commit_latency_ns":' 256000000, '"apply_latency_ns":' 256000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '}' '},' '"pool_stats":' '[' '{' '"poolid":' 2, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '},' '{' '"poolid":' 1, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '}' '],' '"osd_stats":' '[' '{' '"osd":' 0, '"seq":' 21474836517 '},' '{' '"osd":' 1, '"seq":' 42949672988 '},' '{' '"osd":' 2, '"seq":' 0 '}' '],' '"num_pg_by_state":' '[' '{' '"state":' '"active+undersized",' '"num":' 64 '}' '],' '"num_pg_by_osd":' '[' '{' '"osd":' 2, '"num_primary_pg":' 0, '"num_acting_pg":' 0, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 0, '"num_primary_pg":' 28, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 1, '"num_primary_pg":' 36, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '}' '],' '"purged_snaps":' '[' '{' '"pool":' 1, '"purged_snaps":' '{}' '},' '{' '"pool":' 2, '"purged_snaps":' '{}' '}' '],' '"servicemap":' '{' '"epoch":' 5, '"modified":' '"2024-09-16T03:25:38.422788+0000",' '"services":' '{}' '},' '"mgrstat_first_committed":' 77, '"mgrstat_last_committed":' 83, '"logm_first_committed":' 1, '"logm_last_committed":' 363, '"paxos":' '{' '"first_committed":' 1, '"last_committed":' 542, '"last_pn":' 0, '"accepted_pn":' 0 '}' '}' 2024-09-16T03:25:55.961 INFO:tasks.workunit.client.0.smithi096.stdout:{ "cluster_fingerprint": "fda2fc64-07ed-4add-8224-2e527e11d427", "version": "19.3.0-4930-gfc3e0bff", "commit": "fc3e0bff7468fd55478adbae7f75508b749124b6", "timestamp": "2024-09-16T03:25:55.835988+0000", "tag": "", "health": { "status": "HEALTH_OK", "checks": {}, "mutes": [] }, "monmap_first_committed": 1, "monmap_last_committed": 1, "monmap": { "epoch": 1, "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", "modified": "2024-09-16T03:22:45.872880Z", "created": "2024-09-16T03:22:45.872880Z", "min_mon_release": 19, "min_mon_release_name": "squid", "election_strategy": 1, "disallowed_leaders: ": "", "stretch_mode": false, "tiebreaker_mon": "", "removed_ranks: ": "", "features": { "persistent": [ "kraken", "luminous", "mimic", "osdmap-prune", "nautilus", "octopus", "pacific", "elector-pinging", "quincy", "reef", "squid" ], "optional": [] }, "mons": [ { "rank": 0, "name": "a", "public_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:7302", "nonce": 0 } ] }, "addr": "127.0.0.1:7302/0", "public_addr": "127.0.0.1:7302/0", "priority": 0, "weight": 0, "crush_location": "{}" } ] }, "quorum": [ 0 ], "osdmap": { "epoch": 80, "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", "created": "2024-09-16T03:22:46.906117+0000", "modified": "2024-09-16T03:25:52.948673+0000", "last_up_change": "2024-09-16T03:25:08.513363+0000", "last_in_change": "2024-09-16T03:25:09.839444+0000", "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", "flags_num": 5799936, "flags_set": [ "pglog_hardlimit", "purged_snapdirs", "recovery_deletes", "sortbitwise" ], "crush_version": 7, "full_ratio": 0.97000002861022949, "backfillfull_ratio": 0.97000002861022949, "nearfull_ratio": 0.85000002384185791, "cluster_snapshot": "", "pool_max": 2, "max_osd": 3, "require_min_compat_client": "luminous", "min_compat_client": "jewel", "require_osd_release": "squid", "allow_crimson": false, "pools": [ { "pool": 1, "pool_name": "foo", "create_time": "2024-09-16T03:24:44.525189+0000", "flags": 1, "flags_names": "hashpspool", "type": 1, "size": 3, "min_size": 2, "crush_rule": 0, "peering_crush_bucket_count": 0, "peering_crush_bucket_target": 0, "peering_crush_bucket_barrier": 0, "peering_crush_bucket_mandatory_member": 2147483647, "is_stretch_pool": false, "object_hash": 2, "pg_autoscale_mode": "off", "pg_num": 32, "pg_placement_num": 32, "pg_placement_num_target": 32, "pg_num_target": 32, "pg_num_pending": 32, "last_pg_merge_meta": { "source_pgid": "0.0", "ready_epoch": 0, "last_epoch_started": 0, "last_epoch_clean": 0, "source_version": "0'0", "target_version": "0'0" }, "last_change": "30", "last_force_op_resend": "0", "last_force_op_resend_prenautilus": "0", "last_force_op_resend_preluminous": "0", "auid": 0, "snap_mode": "selfmanaged", "snap_seq": 0, "snap_epoch": 0, "pool_snaps": [], "removed_snaps": "[]", "quota_max_bytes": 0, "quota_max_objects": 0, "tiers": [], "tier_of": -1, "read_tier": -1, "write_tier": -1, "cache_mode": "none", "target_max_bytes": 0, "target_max_objects": 0, "cache_target_dirty_ratio_micro": 400000, "cache_target_dirty_high_ratio_micro": 600000, "cache_target_full_ratio_micro": 800000, "cache_min_flush_age": 0, "cache_min_evict_age": 0, "erasure_code_profile": "", "hit_set_params": { "type": "none" }, "hit_set_period": 0, "hit_set_count": 0, "use_gmt_hitset": true, "min_read_recency_for_promote": 0, "min_write_recency_for_promote": 0, "hit_set_grade_decay_rate": 0, "hit_set_search_last_n": 0, "grade_table": [], "stripe_width": 0, "expected_num_objects": 0, "fast_read": false, "options": {}, "application_metadata": {}, "read_balance": { "score_type": "Fair distribution", "score_acting": 1.8700000047683716, "score_stable": 1.8700000047683716, "optimal_score": 0.67000001668930054, "raw_score_acting": 1.25, "raw_score_stable": 1.25, "primary_affinity_weighted": 1, "average_primary_affinity": 1, "average_primary_affinity_weighted": 1 } }, { "pool": 2, "pool_name": "bar", "create_time": "2024-09-16T03:24:46.226575+0000", "flags": 1, "flags_names": "hashpspool", "type": 1, "size": 3, "min_size": 2, "crush_rule": 0, "peering_crush_bucket_count": 0, "peering_crush_bucket_target": 0, "peering_crush_bucket_barrier": 0, "peering_crush_bucket_mandatory_member": 2147483647, "is_stretch_pool": false, "object_hash": 2, "pg_autoscale_mode": "off", "pg_num": 32, "pg_placement_num": 32, "pg_placement_num_target": 32, "pg_num_target": 32, "pg_num_pending": 32, "last_pg_merge_meta": { "source_pgid": "0.0", "ready_epoch": 0, "last_epoch_started": 0, "last_epoch_clean": 0, "source_version": "0'0", "target_version": "0'0" }, "last_change": "32", "last_force_op_resend": "0", "last_force_op_resend_prenautilus": "0", "last_force_op_resend_preluminous": "0", "auid": 0, "snap_mode": "selfmanaged", "snap_seq": 0, "snap_epoch": 0, "pool_snaps": [], "removed_snaps": "[]", "quota_max_bytes": 0, "quota_max_objects": 0, "tiers": [], "tier_of": -1, "read_tier": -1, "write_tier": -1, "cache_mode": "none", "target_max_bytes": 0, "target_max_objects": 0, "cache_target_dirty_ratio_micro": 400000, "cache_target_dirty_high_ratio_micro": 600000, "cache_target_full_ratio_micro": 800000, "cache_min_flush_age": 0, "cache_min_evict_age": 0, "erasure_code_profile": "", "hit_set_params": { "type": "none" }, "hit_set_period": 0, "hit_set_count": 0, "use_gmt_hitset": true, "min_read_recency_for_promote": 0, "min_write_recency_for_promote": 0, "hit_set_grade_decay_rate": 0, "hit_set_search_last_n": 0, "grade_table": [], "stripe_width": 0, "expected_num_objects": 0, "fast_read": false, "options": {}, "application_metadata": {}, "read_balance": { "score_type": "Fair distribution", "score_acting": 1.4900000095367432, "score_stable": 1.4900000095367432, "optimal_score": 0.67000001668930054, "raw_score_acting": 1, "raw_score_stable": 1, "primary_affinity_weighted": 1, "average_primary_affinity": 1, "average_primary_affinity_weighted": 1 } } ], "osds": [ { "osd": 0, "uuid": "64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6", "up": 1, "in": 1, "weight": 1, "primary_affinity": 1, "last_clean_begin": 0, "last_clean_end": 0, "up_from": 5, "up_thru": 33, "down_at": 0, "lost_at": 0, "public_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6802", "nonce": 3375787448 }, { "type": "v1", "addr": "127.0.0.1:6803", "nonce": 3375787448 } ] }, "cluster_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6804", "nonce": 3375787448 }, { "type": "v1", "addr": "127.0.0.1:6805", "nonce": 3375787448 } ] }, "heartbeat_back_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6808", "nonce": 3375787448 }, { "type": "v1", "addr": "127.0.0.1:6809", "nonce": 3375787448 } ] }, "heartbeat_front_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6806", "nonce": 3375787448 }, { "type": "v1", "addr": "127.0.0.1:6807", "nonce": 3375787448 } ] }, "public_addr": "127.0.0.1:6803/3375787448", "cluster_addr": "127.0.0.1:6805/3375787448", "heartbeat_back_addr": "127.0.0.1:6809/3375787448", "heartbeat_front_addr": "127.0.0.1:6807/3375787448", "state": [ "exists", "up" ] }, { "osd": 1, "uuid": "74b26727-75c9-444d-8782-719e4197a382", "up": 1, "in": 1, "weight": 1, "primary_affinity": 1, "last_clean_begin": 0, "last_clean_end": 0, "up_from": 10, "up_thru": 33, "down_at": 0, "lost_at": 0, "public_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6810", "nonce": 3733255132 }, { "type": "v1", "addr": "127.0.0.1:6811", "nonce": 3733255132 } ] }, "cluster_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6812", "nonce": 3733255132 }, { "type": "v1", "addr": "127.0.0.1:6813", "nonce": 3733255132 } ] }, "heartbeat_back_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6816", "nonce": 3733255132 }, { "type": "v1", "addr": "127.0.0.1:6817", "nonce": 3733255132 } ] }, "heartbeat_front_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6814", "nonce": 3733255132 }, { "type": "v1", "addr": "127.0.0.1:6815", "nonce": 3733255132 } ] }, "public_addr": "127.0.0.1:6811/3733255132", "cluster_addr": "127.0.0.1:6813/3733255132", "heartbeat_back_addr": "127.0.0.1:6817/3733255132", "heartbeat_front_addr": "127.0.0.1:6815/3733255132", "state": [ "exists", "up" ] }, { "osd": 2, "uuid": "143da3a7-dad9-4b1e-966b-76cf5bdd3c82", "up": 0, "in": 0, "weight": 0, "primary_affinity": 1, "last_clean_begin": 0, "last_clean_end": 0, "up_from": 15, "up_thru": 21, "down_at": 33, "lost_at": 0, "public_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6818", "nonce": 963814857 }, { "type": "v1", "addr": "127.0.0.1:6819", "nonce": 963814857 } ] }, "cluster_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6820", "nonce": 963814857 }, { "type": "v1", "addr": "127.0.0.1:6821", "nonce": 963814857 } ] }, "heartbeat_back_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6824", "nonce": 963814857 }, { "type": "v1", "addr": "127.0.0.1:6825", "nonce": 963814857 } ] }, "heartbeat_front_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6822", "nonce": 963814857 }, { "type": "v1", "addr": "127.0.0.1:6823", "nonce": 963814857 } ] }, "public_addr": "127.0.0.1:6819/963814857", "cluster_addr": "127.0.0.1:6821/963814857", "heartbeat_back_addr": "127.0.0.1:6825/963814857", "heartbeat_front_addr": "127.0.0.1:6823/963814857", "state": [ "exists" ] } ], "osd_xinfo": [ { "osd": 0, "down_stamp": "0.000000", "laggy_probability": 0, "laggy_interval": 0, "features": 4540719139924082687, "old_weight": 0, "last_purged_snaps_scrub": "2024-09-16T03:23:22.481942+0000", "dead_epoch": 0 }, { "osd": 1, "down_stamp": "0.000000", "laggy_probability": 0, "laggy_interval": 0, "features": 4540719139924082687, "old_weight": 0, "last_purged_snaps_scrub": "2024-09-16T03:23:59.663703+0000", "dead_epoch": 0 }, { "osd": 2, "down_stamp": "0.000000", "laggy_probability": 0, "laggy_interval": 0, "features": 4540719139924082687, "old_weight": 65536, "last_purged_snaps_scrub": "2024-09-16T03:24:37.320822+0000", "dead_epoch": 32 } ], "pg_upmap": [], "pg_upmap_items": [], "pg_upmap_primaries": [], "pg_temp": [], "primary_temp": [], "blocklist": {}, "range_blocklist": {}, "erasure_code_profiles": { "default": { "k": "2", "m": "2", "plugin": "jerasure", "technique": "reed_sol_van" } }, "removed_snaps_queue": [], "new_removed_snaps": [], "new_purged_snaps": [], "crush_node_flags": {}, "device_class_flags": {}, "stretch_mode": { "stretch_mode_enabled": false, "stretch_bucket_count": 0, "degraded_stretch_mode": 0, "recovering_stretch_mode": 0, "stretch_mode_bucket": 0 } }, "osd_metadata": [ { "id": 0, "arch": "x86_64", "back_addr": "[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]", "back_iface": "", "bluefs": "1", "bluefs_dedicated_db": "0", "bluefs_dedicated_wal": "0", "bluefs_single_shared_device": "1", "bluestore_allocation_from_file": "0", "bluestore_bdev_access_mode": "file", "bluestore_bdev_block_size": "4096", "bluestore_bdev_devices": "sda", "bluestore_bdev_driver": "KernelDevice", "bluestore_bdev_optimal_io_size": "0", "bluestore_bdev_path": "td/mon-last-clean-epoch/0/block", "bluestore_bdev_rotational": "1", "bluestore_bdev_size": "107374182400", "bluestore_bdev_support_discard": "0", "bluestore_bdev_type": "hdd", "bluestore_min_alloc_size": "4096", "ceph_release": "squid", "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", "ceph_version_short": "19.3.0-4930-gfc3e0bff", "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", "created_at": "2024-09-16T03:22:53.662571Z", "default_device_class": "hdd", "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", "devices": "sda", "distro": "ubuntu", "distro_description": "Ubuntu 22.04.1 LTS", "distro_version": "22.04", "front_addr": "[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]", "front_iface": "", "hb_back_addr": "[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]", "hb_front_addr": "[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]", "hostname": "smithi096", "journal_rotational": "1", "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", "kernel_version": "5.15.0-121-generic", "mem_swap_kb": "2097148", "mem_total_kb": "32746824", "network_numa_unknown_ifaces": "back_iface,front_iface", "objectstore_numa_unknown_devices": "sda", "os": "Linux", "osd_data": "td/mon-last-clean-epoch/0", "osd_objectstore": "bluestore", "osdspec_affinity": "", "rotational": "1" }, { "id": 1, "arch": "x86_64", "back_addr": "[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]", "back_iface": "", "bluefs": "1", "bluefs_dedicated_db": "0", "bluefs_dedicated_wal": "0", "bluefs_single_shared_device": "1", "bluestore_allocation_from_file": "0", "bluestore_bdev_access_mode": "file", "bluestore_bdev_block_size": "4096", "bluestore_bdev_devices": "sda", "bluestore_bdev_driver": "KernelDevice", "bluestore_bdev_optimal_io_size": "0", "bluestore_bdev_path": "td/mon-last-clean-epoch/1/block", "bluestore_bdev_rotational": "1", "bluestore_bdev_size": "107374182400", "bluestore_bdev_support_discard": "0", "bluestore_bdev_type": "hdd", "bluestore_min_alloc_size": "4096", "ceph_release": "squid", "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", "ceph_version_short": "19.3.0-4930-gfc3e0bff", "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", "created_at": "2024-09-16T03:23:30.129885Z", "default_device_class": "hdd", "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", "devices": "sda", "distro": "ubuntu", "distro_description": "Ubuntu 22.04.1 LTS", "distro_version": "22.04", "front_addr": "[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]", "front_iface": "", "hb_back_addr": "[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]", "hb_front_addr": "[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]", "hostname": "smithi096", "journal_rotational": "1", "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", "kernel_version": "5.15.0-121-generic", "mem_swap_kb": "2097148", "mem_total_kb": "32746824", "network_numa_unknown_ifaces": "back_iface,front_iface", "objectstore_numa_unknown_devices": "sda", "os": "Linux", "osd_data": "td/mon-last-clean-epoch/1", "osd_objectstore": "bluestore", "osdspec_affinity": "", "rotational": "1" }, { "id": 2, "arch": "x86_64", "back_addr": "[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]", "back_iface": "", "bluefs": "1", "bluefs_dedicated_db": "0", "bluefs_dedicated_wal": "0", "bluefs_single_shared_device": "1", "bluestore_allocation_from_file": "0", "bluestore_bdev_access_mode": "file", "bluestore_bdev_block_size": "4096", "bluestore_bdev_devices": "sda", "bluestore_bdev_driver": "KernelDevice", "bluestore_bdev_optimal_io_size": "0", "bluestore_bdev_path": "td/mon-last-clean-epoch/2/block", "bluestore_bdev_rotational": "1", "bluestore_bdev_size": "107374182400", "bluestore_bdev_support_discard": "0", "bluestore_bdev_type": "hdd", "bluestore_min_alloc_size": "4096", "ceph_release": "squid", "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", "ceph_version_short": "19.3.0-4930-gfc3e0bff", "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", "created_at": "2024-09-16T03:24:07.764502Z", "default_device_class": "hdd", "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", "devices": "sda", "distro": "ubuntu", "distro_description": "Ubuntu 22.04.1 LTS", "distro_version": "22.04", "front_addr": "[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]", "front_iface": "", "hb_back_addr": "[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]", "hb_front_addr": "[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]", "hostname": "smithi096", "journal_rotational": "1", "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", "kernel_version": "5.15.0-121-generic", "mem_swap_kb": "2097148", "mem_total_kb": "32746824", "network_numa_unknown_ifaces": "back_iface,front_iface", "objectstore_numa_unknown_devices": "sda", "os": "Linux", "osd_data": "td/mon-last-clean-epoch/2", "osd_objectstore": "bluestore", "osdspec_affinity": "", "rotational": "1" } ], "osdmap_clean_epochs": { "min_last_epoch_clean": 28, "last_epoch_clean": { "per_pool": [ { "poolid": 1, "floor": 28 }, { "poolid": 2, "floor": 28 } ] }, "osd_epochs": [ { "id": 0, "epoch": 78 }, { "id": 1, "epoch": 80 } ] }, "osdmap_first_committed": 28, "osdmap_last_committed": 80, "crushmap": { "devices": [ { "id": 0, "name": "osd.0", "class": "hdd" }, { "id": 1, "name": "osd.1", "class": "hdd" }, { "id": 2, "name": "osd.2", "class": "hdd" } ], "types": [ { "type_id": 0, "name": "osd" }, { "type_id": 1, "name": "host" }, { "type_id": 2, "name": "chassis" }, { "type_id": 3, "name": "rack" }, { "type_id": 4, "name": "row" }, { "type_id": 5, "name": "pdu" }, { "type_id": 6, "name": "pod" }, { "type_id": 7, "name": "room" }, { "type_id": 8, "name": "datacenter" }, { "type_id": 9, "name": "zone" }, { "type_id": 10, "name": "region" }, { "type_id": 11, "name": "root" } ], "buckets": [ { "id": -1, "name": "default", "type_id": 11, "type_name": "root", "weight": 19206, "alg": "straw2", "hash": "rjenkins1", "items": [ { "id": -3, "weight": 19206, "pos": 0 } ] }, { "id": -2, "name": "default~hdd", "type_id": 11, "type_name": "root", "weight": 19206, "alg": "straw2", "hash": "rjenkins1", "items": [ { "id": -4, "weight": 19206, "pos": 0 } ] }, { "id": -3, "name": "smithi096", "type_id": 1, "type_name": "host", "weight": 19206, "alg": "straw2", "hash": "rjenkins1", "items": [ { "id": 0, "weight": 6402, "pos": 0 }, { "id": 1, "weight": 6402, "pos": 1 }, { "id": 2, "weight": 6402, "pos": 2 } ] }, { "id": -4, "name": "smithi096~hdd", "type_id": 1, "type_name": "host", "weight": 19206, "alg": "straw2", "hash": "rjenkins1", "items": [ { "id": 0, "weight": 6402, "pos": 0 }, { "id": 1, "weight": 6402, "pos": 1 }, { "id": 2, "weight": 6402, "pos": 2 } ] } ], "rules": [ { "rule_id": 0, "rule_name": "replicated_rule", "type": 1, "steps": [ { "op": "take", "item": -1, "item_name": "default" }, { "op": "choose_firstn", "num": 0, "type": "osd" }, { "op": "emit" } ] } ], "tunables": { "choose_local_tries": 0, "choose_local_fallback_tries": 0, "choose_total_tries": 50, "chooseleaf_descend_once": 1, "chooseleaf_vary_r": 1, "chooseleaf_stable": 1, "msr_descents": 100, "msr_collision_tries": 100, "straw_calc_version": 1, "allowed_bucket_algs": 54, "profile": "jewel", "optimal_tunables": 1, "legacy_tunables": 0, "minimum_required_version": "jewel", "require_feature_tunables": 1, "require_feature_tunables2": 1, "has_v2_rules": 0, "require_feature_tunables3": 1, "has_v3_rules": 0, "has_v4_buckets": 1, "require_feature_tunables5": 1, "has_v5_rules": 0, "has_msr_rules": 0 }, "choose_args": {} }, "fsmap": { "epoch": 1, "btime": "2024-09-16T03:22:46:882186+0000", "default_fscid": -1, "compat": { "compat": {}, "ro_compat": {}, "incompat": { "feature_1": "base v0.20", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes" } }, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "standbys": [], "filesystems": [] }, "mdsmap_first_committed": 1, "mdsmap_last_committed": 1, "auth": { "first_committed": 1, "last_committed": 5, "num_secrets": 3 }, "num_pg": 64, "num_pg_active": 64, "num_pg_unknown": 0, "num_osd": 3, "pool_sum": { "stat_sum": { "num_bytes": 0, "num_objects": 0, "num_object_clones": 0, "num_object_copies": 0, "num_objects_missing_on_primary": 0, "num_objects_missing": 0, "num_objects_degraded": 0, "num_objects_misplaced": 0, "num_objects_unfound": 0, "num_objects_dirty": 0, "num_whiteouts": 0, "num_read": 0, "num_read_kb": 0, "num_write": 0, "num_write_kb": 0, "num_scrub_errors": 0, "num_shallow_scrub_errors": 0, "num_deep_scrub_errors": 0, "num_objects_recovered": 0, "num_bytes_recovered": 0, "num_keys_recovered": 0, "num_objects_omap": 0, "num_objects_hit_set_archive": 0, "num_bytes_hit_set_archive": 0, "num_flush": 0, "num_flush_kb": 0, "num_evict": 0, "num_evict_kb": 0, "num_promote": 0, "num_flush_mode_high": 0, "num_flush_mode_low": 0, "num_evict_mode_some": 0, "num_evict_mode_full": 0, "num_objects_pinned": 0, "num_legacy_snapsets": 0, "num_large_omap_objects": 0, "num_objects_manifest": 0, "num_omap_bytes": 0, "num_omap_keys": 0, "num_objects_repaired": 0 }, "store_stats": { "total": 0, "available": 0, "internally_reserved": 0, "allocated": 0, "data_stored": 0, "data_compressed": 0, "data_compressed_allocated": 0, "data_compressed_original": 0, "omap_allocated": 0, "internal_metadata": 0 }, "log_size": 0, "ondisk_log_size": 0, "up": 128, "acting": 128, "num_store_stats": 0 }, "osd_sum": { "up_from": 0, "seq": 0, "num_pgs": 128, "num_osds": 2, "num_per_pool_osds": 2, "num_per_pool_omap_osds": 2, "kb": 209715200, "kb_used": 54560, "kb_used_data": 832, "kb_used_omap": 3, "kb_used_meta": 53628, "kb_avail": 209660640, "statfs": { "total": 214748364800, "available": 214692495360, "internally_reserved": 0, "allocated": 851968, "data_stored": 318404, "data_compressed": 0, "data_compressed_allocated": 0, "data_compressed_original": 0, "omap_allocated": 3190, "internal_metadata": 54915978 }, "hb_peers": [], "snap_trim_queue_len": 0, "num_snap_trimming": 0, "num_shards_repaired": 0, "op_queue_age_hist": { "histogram": [], "upper_bound": 1 }, "perf_stat": { "commit_latency_ms": 256, "apply_latency_ms": 256, "commit_latency_ns": 256000000, "apply_latency_ns": 256000000 }, "alerts": [], "network_ping_times": [] }, "osd_sum_by_class": { "hdd": { "up_from": 0, "seq": 0, "num_pgs": 128, "num_osds": 2, "num_per_pool_osds": 2, "num_per_pool_omap_osds": 2, "kb": 209715200, "kb_used": 54560, "kb_used_data": 832, "kb_used_omap": 3, "kb_used_meta": 53628, "kb_avail": 209660640, "statfs": { "total": 214748364800, "available": 214692495360, "internally_reserved": 0, "allocated": 851968, "data_stored": 318404, "data_compressed": 0, "data_compressed_allocated": 0, "data_compressed_original": 0, "omap_allocated": 3190, "internal_metadata": 54915978 }, "hb_peers": [], "snap_trim_queue_len": 0, "num_snap_trimming": 0, "num_shards_repaired": 0, "op_queue_age_hist": { "histogram": [], "upper_bound": 1 }, "perf_stat": { "commit_latency_ms": 256, "apply_latency_ms": 256, "commit_latency_ns": 256000000, "apply_latency_ns": 256000000 }, "alerts": [], "network_ping_times": [] } }, "pool_stats": [ { "poolid": 2, "num_pg": 32, "stat_sum": { "num_bytes": 0, "num_objects": 0, "num_object_clones": 0, "num_object_copies": 0, "num_objects_missing_on_primary": 0, "num_objects_missing": 0, "num_objects_degraded": 0, "num_objects_misplaced": 0, "num_objects_unfound": 0, "num_objects_dirty": 0, "num_whiteouts": 0, "num_read": 0, "num_read_kb": 0, "num_write": 0, "num_write_kb": 0, "num_scrub_errors": 0, "num_shallow_scrub_errors": 0, "num_deep_scrub_errors": 0, "num_objects_recovered": 0, "num_bytes_recovered": 0, "num_keys_recovered": 0, "num_objects_omap": 0, "num_objects_hit_set_archive": 0, "num_bytes_hit_set_archive": 0, "num_flush": 0, "num_flush_kb": 0, "num_evict": 0, "num_evict_kb": 0, "num_promote": 0, "num_flush_mode_high": 0, "num_flush_mode_low": 0, "num_evict_mode_some": 0, "num_evict_mode_full": 0, "num_objects_pinned": 0, "num_legacy_snapsets": 0, "num_large_omap_objects": 0, "num_objects_manifest": 0, "num_omap_bytes": 0, "num_omap_keys": 0, "num_objects_repaired": 0 }, "store_stats": { "total": 0, "available": 0, "internally_reserved": 0, "allocated": 0, "data_stored": 0, "data_compressed": 0, "data_compressed_allocated": 0, "data_compressed_original": 0, "omap_allocated": 0, "internal_metadata": 0 }, "log_size": 0, "ondisk_log_size": 0, "up": 64, "acting": 64, "num_store_stats": 3 }, { "poolid": 1, "num_pg": 32, "stat_sum": { "num_bytes": 0, "num_objects": 0, "num_object_clones": 0, "num_object_copies": 0, "num_objects_missing_on_primary": 0, "num_objects_missing": 0, "num_objects_degraded": 0, "num_objects_misplaced": 0, "num_objects_unfound": 0, "num_objects_dirty": 0, "num_whiteouts": 0, "num_read": 0, "num_read_kb": 0, "num_write": 0, "num_write_kb": 0, "num_scrub_errors": 0, "num_shallow_scrub_errors": 0, "num_deep_scrub_errors": 0, "num_objects_recovered": 0, "num_bytes_recovered": 0, "num_keys_recovered": 0, "num_objects_omap": 0, "num_objects_hit_set_archive": 0, "num_bytes_hit_set_archive": 0, "num_flush": 0, "num_flush_kb": 0, "num_evict": 0, "num_evict_kb": 0, "num_promote": 0, "num_flush_mode_high": 0, "num_flush_mode_low": 0, "num_evict_mode_some": 0, "num_evict_mode_full": 0, "num_objects_pinned": 0, "num_legacy_snapsets": 0, "num_large_omap_objects": 0, "num_objects_manifest": 0, "num_omap_bytes": 0, "num_omap_keys": 0, "num_objects_repaired": 0 }, "store_stats": { "total": 0, "available": 0, "internally_reserved": 0, "allocated": 0, "data_stored": 0, "data_compressed": 0, "data_compressed_allocated": 0, "data_compressed_original": 0, "omap_allocated": 0, "internal_metadata": 0 }, "log_size": 0, "ondisk_log_size": 0, "up": 64, "acting": 64, "num_store_stats": 3 } ], "osd_stats": [ { "osd": 0, "seq": 21474836517 }, { "osd": 1, "seq": 42949672988 }, { "osd": 2, "seq": 0 } ], "num_pg_by_state": [ { "state": "active+undersized", "num": 64 } ], "num_pg_by_osd": [ { "osd": 2, "num_primary_pg": 0, "num_acting_pg": 0, "num_up_not_acting_pg": 0 }, { "osd": 0, "num_primary_pg": 28, "num_acting_pg": 64, "num_up_not_acting_pg": 0 }, { "osd": 1, "num_primary_pg": 36, "num_acting_pg": 64, "num_up_not_acting_pg": 0 } ], "purged_snaps": [ { "pool": 1, "purged_snaps": {} }, { "pool": 2, "purged_snaps": {} } ], "servicemap": { "epoch": 5, "modified": "2024-09-16T03:25:38.422788+0000", "services": {} }, "mgrstat_first_committed": 77, "mgrstat_last_committed": 83, "logm_first_committed": 1, "logm_last_committed": 363, "paxos": { "first_committed": 1, "last_committed": 542, "last_pn": 0, "accepted_pn": 0 } } 2024-09-16T03:25:55.961 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:38: check_lec_equals_pools: return 1 2024-09-16T03:25:55.962 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:47: check_lec_equals_pools: return 0 2024-09-16T03:25:55.962 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:245: TEST_mon_last_clean_epoch: check_lec_honours_osd 2 2024-09-16T03:25:55.962 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:93: check_lec_honours_osd: local osd=2 2024-09-16T03:25:55.962 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:95: check_lec_honours_osd: ceph report 2024-09-16T03:25:56.407 INFO:tasks.workunit.client.0.smithi096.stderr:report 3959650897 2024-09-16T03:25:56.423 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:95: check_lec_honours_osd: report='{ 2024-09-16T03:25:56.423 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_fingerprint": "fda2fc64-07ed-4add-8224-2e527e11d427", 2024-09-16T03:25:56.423 INFO:tasks.workunit.client.0.smithi096.stderr: "version": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:25:56.424 INFO:tasks.workunit.client.0.smithi096.stderr: "commit": "fc3e0bff7468fd55478adbae7f75508b749124b6", 2024-09-16T03:25:56.424 INFO:tasks.workunit.client.0.smithi096.stderr: "timestamp": "2024-09-16T03:25:56.404611+0000", 2024-09-16T03:25:56.424 INFO:tasks.workunit.client.0.smithi096.stderr: "tag": "", 2024-09-16T03:25:56.424 INFO:tasks.workunit.client.0.smithi096.stderr: "health": { 2024-09-16T03:25:56.424 INFO:tasks.workunit.client.0.smithi096.stderr: "status": "HEALTH_OK", 2024-09-16T03:25:56.424 INFO:tasks.workunit.client.0.smithi096.stderr: "checks": {}, 2024-09-16T03:25:56.424 INFO:tasks.workunit.client.0.smithi096.stderr: "mutes": [] 2024-09-16T03:25:56.424 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.424 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap_first_committed": 1, 2024-09-16T03:25:56.424 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap_last_committed": 1, 2024-09-16T03:25:56.424 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap": { 2024-09-16T03:25:56.424 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 1, 2024-09-16T03:25:56.424 INFO:tasks.workunit.client.0.smithi096.stderr: "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", 2024-09-16T03:25:56.425 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:22:45.872880Z", 2024-09-16T03:25:56.425 INFO:tasks.workunit.client.0.smithi096.stderr: "created": "2024-09-16T03:22:45.872880Z", 2024-09-16T03:25:56.425 INFO:tasks.workunit.client.0.smithi096.stderr: "min_mon_release": 19, 2024-09-16T03:25:56.425 INFO:tasks.workunit.client.0.smithi096.stderr: "min_mon_release_name": "squid", 2024-09-16T03:25:56.425 INFO:tasks.workunit.client.0.smithi096.stderr: "election_strategy": 1, 2024-09-16T03:25:56.425 INFO:tasks.workunit.client.0.smithi096.stderr: "disallowed_leaders: ": "", 2024-09-16T03:25:56.425 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode": false, 2024-09-16T03:25:56.425 INFO:tasks.workunit.client.0.smithi096.stderr: "tiebreaker_mon": "", 2024-09-16T03:25:56.425 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_ranks: ": "", 2024-09-16T03:25:56.425 INFO:tasks.workunit.client.0.smithi096.stderr: "features": { 2024-09-16T03:25:56.425 INFO:tasks.workunit.client.0.smithi096.stderr: "persistent": [ 2024-09-16T03:25:56.425 INFO:tasks.workunit.client.0.smithi096.stderr: "kraken", 2024-09-16T03:25:56.425 INFO:tasks.workunit.client.0.smithi096.stderr: "luminous", 2024-09-16T03:25:56.425 INFO:tasks.workunit.client.0.smithi096.stderr: "mimic", 2024-09-16T03:25:56.426 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap-prune", 2024-09-16T03:25:56.426 INFO:tasks.workunit.client.0.smithi096.stderr: "nautilus", 2024-09-16T03:25:56.426 INFO:tasks.workunit.client.0.smithi096.stderr: "octopus", 2024-09-16T03:25:56.426 INFO:tasks.workunit.client.0.smithi096.stderr: "pacific", 2024-09-16T03:25:56.426 INFO:tasks.workunit.client.0.smithi096.stderr: "elector-pinging", 2024-09-16T03:25:56.426 INFO:tasks.workunit.client.0.smithi096.stderr: "quincy", 2024-09-16T03:25:56.426 INFO:tasks.workunit.client.0.smithi096.stderr: "reef", 2024-09-16T03:25:56.426 INFO:tasks.workunit.client.0.smithi096.stderr: "squid" 2024-09-16T03:25:56.426 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:56.426 INFO:tasks.workunit.client.0.smithi096.stderr: "optional": [] 2024-09-16T03:25:56.426 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.426 INFO:tasks.workunit.client.0.smithi096.stderr: "mons": [ 2024-09-16T03:25:56.426 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:56.427 INFO:tasks.workunit.client.0.smithi096.stderr: "rank": 0, 2024-09-16T03:25:56.427 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "a", 2024-09-16T03:25:56.427 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:25:56.427 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:56.427 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:56.427 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:56.427 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:7302", 2024-09-16T03:25:56.427 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 0 2024-09-16T03:25:56.427 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:56.427 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:56.427 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.427 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:7302/0", 2024-09-16T03:25:56.427 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:7302/0", 2024-09-16T03:25:56.427 INFO:tasks.workunit.client.0.smithi096.stderr: "priority": 0, 2024-09-16T03:25:56.427 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 0, 2024-09-16T03:25:56.428 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_location": "{}" 2024-09-16T03:25:56.428 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:56.428 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:56.428 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.428 INFO:tasks.workunit.client.0.smithi096.stderr: "quorum": [ 2024-09-16T03:25:56.428 INFO:tasks.workunit.client.0.smithi096.stderr: 0 2024-09-16T03:25:56.428 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:56.428 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap": { 2024-09-16T03:25:56.428 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 80, 2024-09-16T03:25:56.428 INFO:tasks.workunit.client.0.smithi096.stderr: "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", 2024-09-16T03:25:56.428 INFO:tasks.workunit.client.0.smithi096.stderr: "created": "2024-09-16T03:22:46.906117+0000", 2024-09-16T03:25:56.428 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:25:52.948673+0000", 2024-09-16T03:25:56.428 INFO:tasks.workunit.client.0.smithi096.stderr: "last_up_change": "2024-09-16T03:25:08.513363+0000", 2024-09-16T03:25:56.429 INFO:tasks.workunit.client.0.smithi096.stderr: "last_in_change": "2024-09-16T03:25:09.839444+0000", 2024-09-16T03:25:56.429 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-16T03:25:56.429 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_num": 5799936, 2024-09-16T03:25:56.429 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_set": [ 2024-09-16T03:25:56.429 INFO:tasks.workunit.client.0.smithi096.stderr: "pglog_hardlimit", 2024-09-16T03:25:56.429 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snapdirs", 2024-09-16T03:25:56.429 INFO:tasks.workunit.client.0.smithi096.stderr: "recovery_deletes", 2024-09-16T03:25:56.429 INFO:tasks.workunit.client.0.smithi096.stderr: "sortbitwise" 2024-09-16T03:25:56.429 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:56.429 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_version": 7, 2024-09-16T03:25:56.429 INFO:tasks.workunit.client.0.smithi096.stderr: "full_ratio": 0.97000002861022949, 2024-09-16T03:25:56.429 INFO:tasks.workunit.client.0.smithi096.stderr: "backfillfull_ratio": 0.97000002861022949, 2024-09-16T03:25:56.429 INFO:tasks.workunit.client.0.smithi096.stderr: "nearfull_ratio": 0.85000002384185791, 2024-09-16T03:25:56.429 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_snapshot": "", 2024-09-16T03:25:56.430 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_max": 2, 2024-09-16T03:25:56.430 INFO:tasks.workunit.client.0.smithi096.stderr: "max_osd": 3, 2024-09-16T03:25:56.430 INFO:tasks.workunit.client.0.smithi096.stderr: "require_min_compat_client": "luminous", 2024-09-16T03:25:56.430 INFO:tasks.workunit.client.0.smithi096.stderr: "min_compat_client": "jewel", 2024-09-16T03:25:56.430 INFO:tasks.workunit.client.0.smithi096.stderr: "require_osd_release": "squid", 2024-09-16T03:25:56.430 INFO:tasks.workunit.client.0.smithi096.stderr: "allow_crimson": false, 2024-09-16T03:25:56.430 INFO:tasks.workunit.client.0.smithi096.stderr: "pools": [ 2024-09-16T03:25:56.430 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:56.430 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 1, 2024-09-16T03:25:56.430 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_name": "foo", 2024-09-16T03:25:56.430 INFO:tasks.workunit.client.0.smithi096.stderr: "create_time": "2024-09-16T03:24:44.525189+0000", 2024-09-16T03:25:56.430 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": 1, 2024-09-16T03:25:56.430 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_names": "hashpspool", 2024-09-16T03:25:56.431 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:25:56.431 INFO:tasks.workunit.client.0.smithi096.stderr: "size": 3, 2024-09-16T03:25:56.431 INFO:tasks.workunit.client.0.smithi096.stderr: "min_size": 2, 2024-09-16T03:25:56.431 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_rule": 0, 2024-09-16T03:25:56.431 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_count": 0, 2024-09-16T03:25:56.431 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_target": 0, 2024-09-16T03:25:56.431 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_barrier": 0, 2024-09-16T03:25:56.431 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-16T03:25:56.431 INFO:tasks.workunit.client.0.smithi096.stderr: "is_stretch_pool": false, 2024-09-16T03:25:56.431 INFO:tasks.workunit.client.0.smithi096.stderr: "object_hash": 2, 2024-09-16T03:25:56.431 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_autoscale_mode": "off", 2024-09-16T03:25:56.431 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num": 32, 2024-09-16T03:25:56.431 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num": 32, 2024-09-16T03:25:56.431 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num_target": 32, 2024-09-16T03:25:56.432 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_target": 32, 2024-09-16T03:25:56.432 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_pending": 32, 2024-09-16T03:25:56.432 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pg_merge_meta": { 2024-09-16T03:25:56.432 INFO:tasks.workunit.client.0.smithi096.stderr: "source_pgid": "0.0", 2024-09-16T03:25:56.432 INFO:tasks.workunit.client.0.smithi096.stderr: "ready_epoch": 0, 2024-09-16T03:25:56.432 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_started": 0, 2024-09-16T03:25:56.432 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": 0, 2024-09-16T03:25:56.432 INFO:tasks.workunit.client.0.smithi096.stderr: "source_version": "0'\''0", 2024-09-16T03:25:56.432 INFO:tasks.workunit.client.0.smithi096.stderr: "target_version": "0'\''0" 2024-09-16T03:25:56.432 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.432 INFO:tasks.workunit.client.0.smithi096.stderr: "last_change": "30", 2024-09-16T03:25:56.432 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend": "0", 2024-09-16T03:25:56.432 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_prenautilus": "0", 2024-09-16T03:25:56.433 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_preluminous": "0", 2024-09-16T03:25:56.433 INFO:tasks.workunit.client.0.smithi096.stderr: "auid": 0, 2024-09-16T03:25:56.433 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_mode": "selfmanaged", 2024-09-16T03:25:56.433 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_seq": 0, 2024-09-16T03:25:56.433 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_epoch": 0, 2024-09-16T03:25:56.433 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_snaps": [], 2024-09-16T03:25:56.433 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps": "[]", 2024-09-16T03:25:56.433 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_bytes": 0, 2024-09-16T03:25:56.433 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_objects": 0, 2024-09-16T03:25:56.433 INFO:tasks.workunit.client.0.smithi096.stderr: "tiers": [], 2024-09-16T03:25:56.433 INFO:tasks.workunit.client.0.smithi096.stderr: "tier_of": -1, 2024-09-16T03:25:56.433 INFO:tasks.workunit.client.0.smithi096.stderr: "read_tier": -1, 2024-09-16T03:25:56.433 INFO:tasks.workunit.client.0.smithi096.stderr: "write_tier": -1, 2024-09-16T03:25:56.434 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_mode": "none", 2024-09-16T03:25:56.434 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_bytes": 0, 2024-09-16T03:25:56.434 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_objects": 0, 2024-09-16T03:25:56.434 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_ratio_micro": 400000, 2024-09-16T03:25:56.434 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-16T03:25:56.434 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_full_ratio_micro": 800000, 2024-09-16T03:25:56.434 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_flush_age": 0, 2024-09-16T03:25:56.434 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_evict_age": 0, 2024-09-16T03:25:56.434 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profile": "", 2024-09-16T03:25:56.434 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_params": { 2024-09-16T03:25:56.434 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "none" 2024-09-16T03:25:56.434 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.434 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_period": 0, 2024-09-16T03:25:56.434 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_count": 0, 2024-09-16T03:25:56.435 INFO:tasks.workunit.client.0.smithi096.stderr: "use_gmt_hitset": true, 2024-09-16T03:25:56.435 INFO:tasks.workunit.client.0.smithi096.stderr: "min_read_recency_for_promote": 0, 2024-09-16T03:25:56.435 INFO:tasks.workunit.client.0.smithi096.stderr: "min_write_recency_for_promote": 0, 2024-09-16T03:25:56.435 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_grade_decay_rate": 0, 2024-09-16T03:25:56.435 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_search_last_n": 0, 2024-09-16T03:25:56.435 INFO:tasks.workunit.client.0.smithi096.stderr: "grade_table": [], 2024-09-16T03:25:56.435 INFO:tasks.workunit.client.0.smithi096.stderr: "stripe_width": 0, 2024-09-16T03:25:56.435 INFO:tasks.workunit.client.0.smithi096.stderr: "expected_num_objects": 0, 2024-09-16T03:25:56.435 INFO:tasks.workunit.client.0.smithi096.stderr: "fast_read": false, 2024-09-16T03:25:56.435 INFO:tasks.workunit.client.0.smithi096.stderr: "options": {}, 2024-09-16T03:25:56.435 INFO:tasks.workunit.client.0.smithi096.stderr: "application_metadata": {}, 2024-09-16T03:25:56.435 INFO:tasks.workunit.client.0.smithi096.stderr: "read_balance": { 2024-09-16T03:25:56.435 INFO:tasks.workunit.client.0.smithi096.stderr: "score_type": "Fair distribution", 2024-09-16T03:25:56.435 INFO:tasks.workunit.client.0.smithi096.stderr: "score_acting": 1.8700000047683716, 2024-09-16T03:25:56.435 INFO:tasks.workunit.client.0.smithi096.stderr: "score_stable": 1.8700000047683716, 2024-09-16T03:25:56.436 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_score": 0.67000001668930054, 2024-09-16T03:25:56.436 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_acting": 1.25, 2024-09-16T03:25:56.436 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_stable": 1.25, 2024-09-16T03:25:56.436 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity_weighted": 1, 2024-09-16T03:25:56.436 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity": 1, 2024-09-16T03:25:56.436 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity_weighted": 1 2024-09-16T03:25:56.436 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:56.436 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.436 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:56.436 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 2, 2024-09-16T03:25:56.436 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_name": "bar", 2024-09-16T03:25:56.436 INFO:tasks.workunit.client.0.smithi096.stderr: "create_time": "2024-09-16T03:24:46.226575+0000", 2024-09-16T03:25:56.436 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": 1, 2024-09-16T03:25:56.436 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_names": "hashpspool", 2024-09-16T03:25:56.437 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:25:56.437 INFO:tasks.workunit.client.0.smithi096.stderr: "size": 3, 2024-09-16T03:25:56.437 INFO:tasks.workunit.client.0.smithi096.stderr: "min_size": 2, 2024-09-16T03:25:56.437 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_rule": 0, 2024-09-16T03:25:56.437 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_count": 0, 2024-09-16T03:25:56.437 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_target": 0, 2024-09-16T03:25:56.437 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_barrier": 0, 2024-09-16T03:25:56.437 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-16T03:25:56.438 INFO:tasks.workunit.client.0.smithi096.stderr: "is_stretch_pool": false, 2024-09-16T03:25:56.438 INFO:tasks.workunit.client.0.smithi096.stderr: "object_hash": 2, 2024-09-16T03:25:56.438 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_autoscale_mode": "off", 2024-09-16T03:25:56.438 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num": 32, 2024-09-16T03:25:56.438 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num": 32, 2024-09-16T03:25:56.438 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num_target": 32, 2024-09-16T03:25:56.438 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_target": 32, 2024-09-16T03:25:56.438 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_pending": 32, 2024-09-16T03:25:56.438 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pg_merge_meta": { 2024-09-16T03:25:56.438 INFO:tasks.workunit.client.0.smithi096.stderr: "source_pgid": "0.0", 2024-09-16T03:25:56.438 INFO:tasks.workunit.client.0.smithi096.stderr: "ready_epoch": 0, 2024-09-16T03:25:56.438 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_started": 0, 2024-09-16T03:25:56.438 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": 0, 2024-09-16T03:25:56.439 INFO:tasks.workunit.client.0.smithi096.stderr: "source_version": "0'\''0", 2024-09-16T03:25:56.439 INFO:tasks.workunit.client.0.smithi096.stderr: "target_version": "0'\''0" 2024-09-16T03:25:56.439 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.439 INFO:tasks.workunit.client.0.smithi096.stderr: "last_change": "32", 2024-09-16T03:25:56.439 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend": "0", 2024-09-16T03:25:56.439 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_prenautilus": "0", 2024-09-16T03:25:56.439 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_preluminous": "0", 2024-09-16T03:25:56.439 INFO:tasks.workunit.client.0.smithi096.stderr: "auid": 0, 2024-09-16T03:25:56.439 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_mode": "selfmanaged", 2024-09-16T03:25:56.439 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_seq": 0, 2024-09-16T03:25:56.439 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_epoch": 0, 2024-09-16T03:25:56.439 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_snaps": [], 2024-09-16T03:25:56.439 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps": "[]", 2024-09-16T03:25:56.439 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_bytes": 0, 2024-09-16T03:25:56.440 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_objects": 0, 2024-09-16T03:25:56.440 INFO:tasks.workunit.client.0.smithi096.stderr: "tiers": [], 2024-09-16T03:25:56.440 INFO:tasks.workunit.client.0.smithi096.stderr: "tier_of": -1, 2024-09-16T03:25:56.440 INFO:tasks.workunit.client.0.smithi096.stderr: "read_tier": -1, 2024-09-16T03:25:56.440 INFO:tasks.workunit.client.0.smithi096.stderr: "write_tier": -1, 2024-09-16T03:25:56.440 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_mode": "none", 2024-09-16T03:25:56.440 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_bytes": 0, 2024-09-16T03:25:56.440 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_objects": 0, 2024-09-16T03:25:56.440 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_ratio_micro": 400000, 2024-09-16T03:25:56.440 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-16T03:25:56.440 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_full_ratio_micro": 800000, 2024-09-16T03:25:56.440 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_flush_age": 0, 2024-09-16T03:25:56.440 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_evict_age": 0, 2024-09-16T03:25:56.441 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profile": "", 2024-09-16T03:25:56.441 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_params": { 2024-09-16T03:25:56.441 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "none" 2024-09-16T03:25:56.441 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.441 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_period": 0, 2024-09-16T03:25:56.441 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_count": 0, 2024-09-16T03:25:56.441 INFO:tasks.workunit.client.0.smithi096.stderr: "use_gmt_hitset": true, 2024-09-16T03:25:56.441 INFO:tasks.workunit.client.0.smithi096.stderr: "min_read_recency_for_promote": 0, 2024-09-16T03:25:56.441 INFO:tasks.workunit.client.0.smithi096.stderr: "min_write_recency_for_promote": 0, 2024-09-16T03:25:56.441 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_grade_decay_rate": 0, 2024-09-16T03:25:56.441 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_search_last_n": 0, 2024-09-16T03:25:56.441 INFO:tasks.workunit.client.0.smithi096.stderr: "grade_table": [], 2024-09-16T03:25:56.441 INFO:tasks.workunit.client.0.smithi096.stderr: "stripe_width": 0, 2024-09-16T03:25:56.441 INFO:tasks.workunit.client.0.smithi096.stderr: "expected_num_objects": 0, 2024-09-16T03:25:56.441 INFO:tasks.workunit.client.0.smithi096.stderr: "fast_read": false, 2024-09-16T03:25:56.442 INFO:tasks.workunit.client.0.smithi096.stderr: "options": {}, 2024-09-16T03:25:56.442 INFO:tasks.workunit.client.0.smithi096.stderr: "application_metadata": {}, 2024-09-16T03:25:56.442 INFO:tasks.workunit.client.0.smithi096.stderr: "read_balance": { 2024-09-16T03:25:56.442 INFO:tasks.workunit.client.0.smithi096.stderr: "score_type": "Fair distribution", 2024-09-16T03:25:56.442 INFO:tasks.workunit.client.0.smithi096.stderr: "score_acting": 1.4900000095367432, 2024-09-16T03:25:56.442 INFO:tasks.workunit.client.0.smithi096.stderr: "score_stable": 1.4900000095367432, 2024-09-16T03:25:56.442 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_score": 0.67000001668930054, 2024-09-16T03:25:56.442 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_acting": 1, 2024-09-16T03:25:56.442 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_stable": 1, 2024-09-16T03:25:56.442 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity_weighted": 1, 2024-09-16T03:25:56.442 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity": 1, 2024-09-16T03:25:56.442 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity_weighted": 1 2024-09-16T03:25:56.442 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:56.442 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:56.443 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:56.443 INFO:tasks.workunit.client.0.smithi096.stderr: "osds": [ 2024-09-16T03:25:56.443 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:56.443 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:25:56.443 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6", 2024-09-16T03:25:56.443 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:25:56.443 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:25:56.443 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:25:56.443 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:25:56.443 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:25:56.443 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:25:56.443 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 5, 2024-09-16T03:25:56.443 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 33, 2024-09-16T03:25:56.443 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:25:56.444 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:25:56.444 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:25:56.444 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:56.444 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:56.444 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:56.444 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6802", 2024-09-16T03:25:56.444 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:56.444 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.444 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:56.444 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:56.444 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6803", 2024-09-16T03:25:56.444 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:56.444 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:56.444 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:56.445 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.445 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:25:56.445 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:56.445 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:56.445 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:56.445 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6804", 2024-09-16T03:25:56.445 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:56.445 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.445 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:56.445 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:56.445 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6805", 2024-09-16T03:25:56.445 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:56.445 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:56.445 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:56.446 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.446 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:25:56.446 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:56.446 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:56.446 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:56.446 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6808", 2024-09-16T03:25:56.446 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:56.446 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.446 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:56.446 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:56.446 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6809", 2024-09-16T03:25:56.446 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:56.446 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:56.446 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:56.447 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.447 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:25:56.447 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:56.447 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:56.447 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:56.447 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6806", 2024-09-16T03:25:56.447 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:56.447 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.447 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:56.447 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:56.447 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6807", 2024-09-16T03:25:56.447 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:56.447 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:56.448 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:56.448 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.448 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6803/3375787448", 2024-09-16T03:25:56.448 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6805/3375787448", 2024-09-16T03:25:56.448 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6809/3375787448", 2024-09-16T03:25:56.448 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6807/3375787448", 2024-09-16T03:25:56.448 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:25:56.448 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:25:56.448 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:25:56.448 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:56.448 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.448 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:56.448 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:25:56.449 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "74b26727-75c9-444d-8782-719e4197a382", 2024-09-16T03:25:56.449 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:25:56.449 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:25:56.449 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:25:56.449 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:25:56.449 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:25:56.449 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:25:56.449 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 10, 2024-09-16T03:25:56.449 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 33, 2024-09-16T03:25:56.449 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:25:56.449 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:25:56.449 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:25:56.449 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:56.450 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:56.450 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:56.450 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6810", 2024-09-16T03:25:56.450 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:56.450 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.450 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:56.450 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:56.450 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6811", 2024-09-16T03:25:56.450 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:56.450 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:56.450 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:56.450 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.450 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:25:56.450 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:56.451 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:56.451 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:56.451 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6812", 2024-09-16T03:25:56.451 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:56.451 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.451 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:56.451 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:56.451 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6813", 2024-09-16T03:25:56.451 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:56.451 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:56.451 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:56.451 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.451 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:25:56.452 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:56.452 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:56.452 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:56.452 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6816", 2024-09-16T03:25:56.452 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:56.452 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.452 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:56.452 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:56.452 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6817", 2024-09-16T03:25:56.452 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:56.452 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:56.452 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:56.452 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.452 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:25:56.453 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:56.453 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:56.453 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:56.453 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6814", 2024-09-16T03:25:56.453 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:56.453 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.453 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:56.453 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:56.453 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6815", 2024-09-16T03:25:56.453 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:56.453 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:56.453 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:56.453 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.453 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6811/3733255132", 2024-09-16T03:25:56.454 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6813/3733255132", 2024-09-16T03:25:56.454 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6817/3733255132", 2024-09-16T03:25:56.454 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6815/3733255132", 2024-09-16T03:25:56.454 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:25:56.454 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:25:56.454 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:25:56.454 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:56.454 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.454 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:56.454 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:25:56.454 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "143da3a7-dad9-4b1e-966b-76cf5bdd3c82", 2024-09-16T03:25:56.454 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 0, 2024-09-16T03:25:56.454 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 0, 2024-09-16T03:25:56.454 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 0, 2024-09-16T03:25:56.455 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:25:56.455 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:25:56.455 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:25:56.455 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 15, 2024-09-16T03:25:56.455 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 21, 2024-09-16T03:25:56.455 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 33, 2024-09-16T03:25:56.455 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:25:56.455 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:25:56.455 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:56.455 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:56.455 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:56.455 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6818", 2024-09-16T03:25:56.455 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:56.455 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.455 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:56.456 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:56.456 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6819", 2024-09-16T03:25:56.456 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:56.456 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:56.456 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:56.456 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.456 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:25:56.456 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:56.456 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:56.456 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:56.456 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6820", 2024-09-16T03:25:56.456 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:56.456 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.457 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:56.457 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:56.457 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6821", 2024-09-16T03:25:56.457 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:56.457 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:56.457 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:56.457 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.457 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:25:56.457 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:56.457 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:56.457 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:56.457 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6824", 2024-09-16T03:25:56.457 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:56.457 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.458 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:56.458 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:56.458 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6825", 2024-09-16T03:25:56.458 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:56.458 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:56.458 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:56.458 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.458 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:25:56.458 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:56.458 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:56.458 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:56.458 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6822", 2024-09-16T03:25:56.458 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:56.458 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.459 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:56.459 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:56.459 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6823", 2024-09-16T03:25:56.459 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:56.459 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:56.459 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:56.459 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.459 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6819/963814857", 2024-09-16T03:25:56.459 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6821/963814857", 2024-09-16T03:25:56.459 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6825/963814857", 2024-09-16T03:25:56.459 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6823/963814857", 2024-09-16T03:25:56.459 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:25:56.459 INFO:tasks.workunit.client.0.smithi096.stderr: "exists" 2024-09-16T03:25:56.459 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:56.460 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:56.460 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:56.460 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_xinfo": [ 2024-09-16T03:25:56.460 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:56.460 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:25:56.460 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:25:56.460 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:25:56.460 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:25:56.460 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:25:56.460 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:25:56.460 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:23:22.481942+0000", 2024-09-16T03:25:56.460 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:25:56.460 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.460 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:56.461 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:25:56.461 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:25:56.461 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:25:56.461 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:25:56.461 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:25:56.461 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:25:56.461 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:23:59.663703+0000", 2024-09-16T03:25:56.461 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:25:56.461 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.461 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:56.461 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:25:56.461 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:25:56.461 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:25:56.461 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:25:56.462 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:25:56.462 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 65536, 2024-09-16T03:25:56.462 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:24:37.320822+0000", 2024-09-16T03:25:56.462 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 32 2024-09-16T03:25:56.462 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:56.462 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:56.462 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap": [], 2024-09-16T03:25:56.462 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap_items": [], 2024-09-16T03:25:56.462 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap_primaries": [], 2024-09-16T03:25:56.462 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_temp": [], 2024-09-16T03:25:56.462 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_temp": [], 2024-09-16T03:25:56.462 INFO:tasks.workunit.client.0.smithi096.stderr: "blocklist": {}, 2024-09-16T03:25:56.462 INFO:tasks.workunit.client.0.smithi096.stderr: "range_blocklist": {}, 2024-09-16T03:25:56.462 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profiles": { 2024-09-16T03:25:56.463 INFO:tasks.workunit.client.0.smithi096.stderr: "default": { 2024-09-16T03:25:56.463 INFO:tasks.workunit.client.0.smithi096.stderr: "k": "2", 2024-09-16T03:25:56.463 INFO:tasks.workunit.client.0.smithi096.stderr: "m": "2", 2024-09-16T03:25:56.463 INFO:tasks.workunit.client.0.smithi096.stderr: "plugin": "jerasure", 2024-09-16T03:25:56.463 INFO:tasks.workunit.client.0.smithi096.stderr: "technique": "reed_sol_van" 2024-09-16T03:25:56.463 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:56.463 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.463 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps_queue": [], 2024-09-16T03:25:56.463 INFO:tasks.workunit.client.0.smithi096.stderr: "new_removed_snaps": [], 2024-09-16T03:25:56.463 INFO:tasks.workunit.client.0.smithi096.stderr: "new_purged_snaps": [], 2024-09-16T03:25:56.463 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_node_flags": {}, 2024-09-16T03:25:56.463 INFO:tasks.workunit.client.0.smithi096.stderr: "device_class_flags": {}, 2024-09-16T03:25:56.463 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode": { 2024-09-16T03:25:56.463 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode_enabled": false, 2024-09-16T03:25:56.464 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_bucket_count": 0, 2024-09-16T03:25:56.464 INFO:tasks.workunit.client.0.smithi096.stderr: "degraded_stretch_mode": 0, 2024-09-16T03:25:56.464 INFO:tasks.workunit.client.0.smithi096.stderr: "recovering_stretch_mode": 0, 2024-09-16T03:25:56.464 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode_bucket": 0 2024-09-16T03:25:56.464 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:56.464 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.464 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_metadata": [ 2024-09-16T03:25:56.464 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:56.464 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:25:56.464 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:25:56.464 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]", 2024-09-16T03:25:56.464 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:25:56.464 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:25:56.464 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:25:56.465 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:25:56.465 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:25:56.465 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:25:56.465 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:25:56.465 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:25:56.465 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:25:56.465 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:25:56.465 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:25:56.465 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/0/block", 2024-09-16T03:25:56.465 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:25:56.465 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:25:56.465 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:25:56.465 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:25:56.465 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:25:56.466 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:25:56.466 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:25:56.466 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:25:56.466 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:25:56.466 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:25:56.466 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:22:53.662571Z", 2024-09-16T03:25:56.466 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:25:56.466 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:25:56.466 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:25:56.466 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:25:56.466 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:25:56.466 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:25:56.466 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:25:56.466 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]", 2024-09-16T03:25:56.467 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:25:56.467 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]", 2024-09-16T03:25:56.467 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]", 2024-09-16T03:25:56.467 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:25:56.467 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:25:56.467 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:25:56.467 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:25:56.467 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:25:56.467 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:25:56.467 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:25:56.467 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:25:56.467 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:25:56.467 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/0", 2024-09-16T03:25:56.467 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:25:56.468 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:25:56.468 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:25:56.468 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.468 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:56.468 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:25:56.468 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:25:56.468 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]", 2024-09-16T03:25:56.468 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:25:56.468 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:25:56.468 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:25:56.468 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:25:56.468 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:25:56.468 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:25:56.468 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:25:56.469 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:25:56.469 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:25:56.469 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:25:56.469 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:25:56.469 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/1/block", 2024-09-16T03:25:56.469 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:25:56.469 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:25:56.469 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:25:56.469 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:25:56.469 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:25:56.469 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:25:56.469 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:25:56.469 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:25:56.469 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:25:56.470 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:25:56.470 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:23:30.129885Z", 2024-09-16T03:25:56.470 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:25:56.470 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:25:56.470 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:25:56.470 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:25:56.470 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:25:56.470 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:25:56.470 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:25:56.470 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]", 2024-09-16T03:25:56.470 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:25:56.470 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]", 2024-09-16T03:25:56.470 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]", 2024-09-16T03:25:56.471 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:25:56.471 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:25:56.471 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:25:56.471 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:25:56.471 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:25:56.471 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:25:56.471 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:25:56.471 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:25:56.471 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:25:56.471 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/1", 2024-09-16T03:25:56.471 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:25:56.471 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:25:56.471 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:25:56.471 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.472 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:56.472 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:25:56.472 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:25:56.472 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]", 2024-09-16T03:25:56.472 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:25:56.472 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:25:56.472 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:25:56.472 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:25:56.472 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:25:56.472 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:25:56.472 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:25:56.472 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:25:56.472 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:25:56.472 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:25:56.473 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:25:56.473 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/2/block", 2024-09-16T03:25:56.473 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:25:56.473 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:25:56.473 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:25:56.473 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:25:56.473 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:25:56.473 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:25:56.473 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:25:56.473 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:25:56.473 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:25:56.473 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:25:56.474 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:24:07.764502Z", 2024-09-16T03:25:56.474 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:25:56.474 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:25:56.474 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:25:56.474 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:25:56.474 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:25:56.474 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:25:56.474 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:25:56.474 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]", 2024-09-16T03:25:56.474 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:25:56.474 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]", 2024-09-16T03:25:56.474 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]", 2024-09-16T03:25:56.475 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:25:56.475 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:25:56.475 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:25:56.475 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:25:56.475 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:25:56.475 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:25:56.475 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:25:56.475 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:25:56.475 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:25:56.475 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/2", 2024-09-16T03:25:56.475 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:25:56.475 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:25:56.475 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:25:56.475 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:56.476 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:56.476 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_clean_epochs": { 2024-09-16T03:25:56.476 INFO:tasks.workunit.client.0.smithi096.stderr: "min_last_epoch_clean": 28, 2024-09-16T03:25:56.476 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": { 2024-09-16T03:25:56.476 INFO:tasks.workunit.client.0.smithi096.stderr: "per_pool": [ 2024-09-16T03:25:56.476 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:56.476 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 1, 2024-09-16T03:25:56.476 INFO:tasks.workunit.client.0.smithi096.stderr: "floor": 28 2024-09-16T03:25:56.476 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.476 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:56.476 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 2, 2024-09-16T03:25:56.476 INFO:tasks.workunit.client.0.smithi096.stderr: "floor": 28 2024-09-16T03:25:56.476 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:56.476 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:56.477 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.477 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_epochs": [ 2024-09-16T03:25:56.477 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:56.477 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:25:56.477 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 78 2024-09-16T03:25:56.477 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.477 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:56.477 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:25:56.477 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 80 2024-09-16T03:25:56.477 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:56.477 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:56.477 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.477 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_first_committed": 28, 2024-09-16T03:25:56.477 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_last_committed": 80, 2024-09-16T03:25:56.477 INFO:tasks.workunit.client.0.smithi096.stderr: "crushmap": { 2024-09-16T03:25:56.478 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": [ 2024-09-16T03:25:56.478 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:56.478 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:25:56.478 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.0", 2024-09-16T03:25:56.478 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:25:56.478 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.478 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:56.478 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:25:56.478 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.1", 2024-09-16T03:25:56.478 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:25:56.478 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.478 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:56.478 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:25:56.478 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.2", 2024-09-16T03:25:56.479 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:25:56.479 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:56.479 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:56.479 INFO:tasks.workunit.client.0.smithi096.stderr: "types": [ 2024-09-16T03:25:56.479 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:56.479 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 0, 2024-09-16T03:25:56.479 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd" 2024-09-16T03:25:56.479 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.479 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:56.479 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:25:56.479 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "host" 2024-09-16T03:25:56.479 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.479 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:56.479 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 2, 2024-09-16T03:25:56.480 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "chassis" 2024-09-16T03:25:56.480 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.480 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:56.480 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 3, 2024-09-16T03:25:56.480 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "rack" 2024-09-16T03:25:56.480 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.480 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:56.480 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 4, 2024-09-16T03:25:56.480 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "row" 2024-09-16T03:25:56.480 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.480 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:56.480 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 5, 2024-09-16T03:25:56.480 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "pdu" 2024-09-16T03:25:56.481 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.481 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:56.481 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 6, 2024-09-16T03:25:56.481 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "pod" 2024-09-16T03:25:56.481 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.481 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:56.481 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 7, 2024-09-16T03:25:56.481 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "room" 2024-09-16T03:25:56.481 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.481 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:56.481 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 8, 2024-09-16T03:25:56.481 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "datacenter" 2024-09-16T03:25:56.481 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.481 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:56.481 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 9, 2024-09-16T03:25:56.482 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "zone" 2024-09-16T03:25:56.482 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.482 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:56.482 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 10, 2024-09-16T03:25:56.482 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "region" 2024-09-16T03:25:56.482 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.482 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:56.482 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:25:56.482 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "root" 2024-09-16T03:25:56.482 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:56.482 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:56.482 INFO:tasks.workunit.client.0.smithi096.stderr: "buckets": [ 2024-09-16T03:25:56.482 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:56.482 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -1, 2024-09-16T03:25:56.483 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "default", 2024-09-16T03:25:56.483 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:25:56.483 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "root", 2024-09-16T03:25:56.483 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:25:56.483 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:25:56.483 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:25:56.483 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:25:56.483 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:56.483 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -3, 2024-09-16T03:25:56.483 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:25:56.483 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:25:56.483 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:56.483 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:56.483 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.484 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:56.484 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -2, 2024-09-16T03:25:56.484 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "default~hdd", 2024-09-16T03:25:56.484 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:25:56.484 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "root", 2024-09-16T03:25:56.484 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:25:56.484 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:25:56.484 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:25:56.484 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:25:56.484 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:56.484 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -4, 2024-09-16T03:25:56.484 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:25:56.484 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:25:56.484 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:56.485 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:56.485 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.485 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:56.485 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -3, 2024-09-16T03:25:56.485 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "smithi096", 2024-09-16T03:25:56.485 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:25:56.485 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "host", 2024-09-16T03:25:56.485 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:25:56.485 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:25:56.485 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:25:56.485 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:25:56.485 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:56.485 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:25:56.485 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:25:56.486 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:25:56.486 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.486 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:56.486 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:25:56.486 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:25:56.486 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 1 2024-09-16T03:25:56.486 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.486 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:56.486 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:25:56.486 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:25:56.486 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 2 2024-09-16T03:25:56.486 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:56.486 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:56.486 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.486 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:56.487 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -4, 2024-09-16T03:25:56.487 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "smithi096~hdd", 2024-09-16T03:25:56.487 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:25:56.487 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "host", 2024-09-16T03:25:56.487 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:25:56.487 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:25:56.487 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:25:56.487 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:25:56.487 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:56.487 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:25:56.487 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:25:56.487 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:25:56.487 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.487 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:56.488 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:25:56.488 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:25:56.488 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 1 2024-09-16T03:25:56.488 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.488 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:56.488 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:25:56.488 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:25:56.488 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 2 2024-09-16T03:25:56.488 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:56.488 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:56.488 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:56.488 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:56.488 INFO:tasks.workunit.client.0.smithi096.stderr: "rules": [ 2024-09-16T03:25:56.488 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:56.489 INFO:tasks.workunit.client.0.smithi096.stderr: "rule_id": 0, 2024-09-16T03:25:56.489 INFO:tasks.workunit.client.0.smithi096.stderr: "rule_name": "replicated_rule", 2024-09-16T03:25:56.489 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:25:56.489 INFO:tasks.workunit.client.0.smithi096.stderr: "steps": [ 2024-09-16T03:25:56.489 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:56.489 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "take", 2024-09-16T03:25:56.489 INFO:tasks.workunit.client.0.smithi096.stderr: "item": -1, 2024-09-16T03:25:56.489 INFO:tasks.workunit.client.0.smithi096.stderr: "item_name": "default" 2024-09-16T03:25:56.489 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.489 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:56.489 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "choose_firstn", 2024-09-16T03:25:56.489 INFO:tasks.workunit.client.0.smithi096.stderr: "num": 0, 2024-09-16T03:25:56.489 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "osd" 2024-09-16T03:25:56.490 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.490 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:56.490 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "emit" 2024-09-16T03:25:56.490 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:56.490 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:56.490 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:56.490 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:56.490 INFO:tasks.workunit.client.0.smithi096.stderr: "tunables": { 2024-09-16T03:25:56.490 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_local_tries": 0, 2024-09-16T03:25:56.490 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_local_fallback_tries": 0, 2024-09-16T03:25:56.490 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_total_tries": 50, 2024-09-16T03:25:56.490 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_descend_once": 1, 2024-09-16T03:25:56.490 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_vary_r": 1, 2024-09-16T03:25:56.490 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_stable": 1, 2024-09-16T03:25:56.491 INFO:tasks.workunit.client.0.smithi096.stderr: "msr_descents": 100, 2024-09-16T03:25:56.491 INFO:tasks.workunit.client.0.smithi096.stderr: "msr_collision_tries": 100, 2024-09-16T03:25:56.491 INFO:tasks.workunit.client.0.smithi096.stderr: "straw_calc_version": 1, 2024-09-16T03:25:56.491 INFO:tasks.workunit.client.0.smithi096.stderr: "allowed_bucket_algs": 54, 2024-09-16T03:25:56.491 INFO:tasks.workunit.client.0.smithi096.stderr: "profile": "jewel", 2024-09-16T03:25:56.491 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_tunables": 1, 2024-09-16T03:25:56.491 INFO:tasks.workunit.client.0.smithi096.stderr: "legacy_tunables": 0, 2024-09-16T03:25:56.491 INFO:tasks.workunit.client.0.smithi096.stderr: "minimum_required_version": "jewel", 2024-09-16T03:25:56.491 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables": 1, 2024-09-16T03:25:56.491 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables2": 1, 2024-09-16T03:25:56.491 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v2_rules": 0, 2024-09-16T03:25:56.491 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables3": 1, 2024-09-16T03:25:56.491 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v3_rules": 0, 2024-09-16T03:25:56.491 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v4_buckets": 1, 2024-09-16T03:25:56.491 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables5": 1, 2024-09-16T03:25:56.492 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v5_rules": 0, 2024-09-16T03:25:56.492 INFO:tasks.workunit.client.0.smithi096.stderr: "has_msr_rules": 0 2024-09-16T03:25:56.492 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.492 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_args": {} 2024-09-16T03:25:56.492 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.492 INFO:tasks.workunit.client.0.smithi096.stderr: "fsmap": { 2024-09-16T03:25:56.492 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 1, 2024-09-16T03:25:56.492 INFO:tasks.workunit.client.0.smithi096.stderr: "btime": "2024-09-16T03:22:46:882186+0000", 2024-09-16T03:25:56.492 INFO:tasks.workunit.client.0.smithi096.stderr: "default_fscid": -1, 2024-09-16T03:25:56.492 INFO:tasks.workunit.client.0.smithi096.stderr: "compat": { 2024-09-16T03:25:56.492 INFO:tasks.workunit.client.0.smithi096.stderr: "compat": {}, 2024-09-16T03:25:56.492 INFO:tasks.workunit.client.0.smithi096.stderr: "ro_compat": {}, 2024-09-16T03:25:56.492 INFO:tasks.workunit.client.0.smithi096.stderr: "incompat": { 2024-09-16T03:25:56.492 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_1": "base v0.20", 2024-09-16T03:25:56.493 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_2": "client writeable ranges", 2024-09-16T03:25:56.493 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_3": "default file layouts on dirs", 2024-09-16T03:25:56.493 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_4": "dir inode in separate object", 2024-09-16T03:25:56.493 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_5": "mds uses versioned encoding", 2024-09-16T03:25:56.493 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_6": "dirfrag is stored in omap", 2024-09-16T03:25:56.493 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_8": "no anchor table", 2024-09-16T03:25:56.493 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_9": "file layout v2", 2024-09-16T03:25:56.493 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_10": "snaprealm v2", 2024-09-16T03:25:56.493 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_11": "minor log segments", 2024-09-16T03:25:56.493 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_12": "quiesce subvolumes" 2024-09-16T03:25:56.493 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:56.493 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.493 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_flags": { 2024-09-16T03:25:56.493 INFO:tasks.workunit.client.0.smithi096.stderr: "enable_multiple": true, 2024-09-16T03:25:56.494 INFO:tasks.workunit.client.0.smithi096.stderr: "ever_enabled_multiple": true 2024-09-16T03:25:56.494 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.494 INFO:tasks.workunit.client.0.smithi096.stderr: "standbys": [], 2024-09-16T03:25:56.494 INFO:tasks.workunit.client.0.smithi096.stderr: "filesystems": [] 2024-09-16T03:25:56.494 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.494 INFO:tasks.workunit.client.0.smithi096.stderr: "mdsmap_first_committed": 1, 2024-09-16T03:25:56.494 INFO:tasks.workunit.client.0.smithi096.stderr: "mdsmap_last_committed": 1, 2024-09-16T03:25:56.494 INFO:tasks.workunit.client.0.smithi096.stderr: "auth": { 2024-09-16T03:25:56.494 INFO:tasks.workunit.client.0.smithi096.stderr: "first_committed": 1, 2024-09-16T03:25:56.494 INFO:tasks.workunit.client.0.smithi096.stderr: "last_committed": 5, 2024-09-16T03:25:56.494 INFO:tasks.workunit.client.0.smithi096.stderr: "num_secrets": 3 2024-09-16T03:25:56.494 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.494 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 64, 2024-09-16T03:25:56.494 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_active": 64, 2024-09-16T03:25:56.495 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_unknown": 0, 2024-09-16T03:25:56.495 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osd": 3, 2024-09-16T03:25:56.495 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_sum": { 2024-09-16T03:25:56.495 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:25:56.495 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:25:56.495 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:25:56.495 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:25:56.495 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:25:56.495 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:25:56.495 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:25:56.495 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:25:56.495 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:25:56.495 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:25:56.495 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:25:56.496 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:25:56.496 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:25:56.496 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:25:56.496 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:25:56.496 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:25:56.496 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:25:56.496 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:25:56.496 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:25:56.496 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:25:56.496 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:25:56.496 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:25:56.496 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:25:56.496 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:25:56.496 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:25:56.497 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:25:56.497 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:25:56.497 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:25:56.497 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:25:56.497 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:25:56.497 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:25:56.497 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:25:56.497 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:25:56.497 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:25:56.497 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:25:56.497 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:25:56.497 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:25:56.497 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:25:56.497 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:25:56.498 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:25:56.498 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:25:56.498 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.498 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:25:56.498 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:25:56.498 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:25:56.498 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:25:56.498 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:25:56.498 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:25:56.498 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:25:56.498 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:25:56.498 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:25:56.498 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:25:56.498 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:25:56.499 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.499 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:25:56.499 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:25:56.499 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 128, 2024-09-16T03:25:56.499 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 128, 2024-09-16T03:25:56.499 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 0 2024-09-16T03:25:56.499 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.499 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_sum": { 2024-09-16T03:25:56.499 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 0, 2024-09-16T03:25:56.499 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 0, 2024-09-16T03:25:56.499 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pgs": 128, 2024-09-16T03:25:56.499 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osds": 2, 2024-09-16T03:25:56.499 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_osds": 2, 2024-09-16T03:25:56.499 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_omap_osds": 2, 2024-09-16T03:25:56.499 INFO:tasks.workunit.client.0.smithi096.stderr: "kb": 209715200, 2024-09-16T03:25:56.500 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used": 54560, 2024-09-16T03:25:56.500 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_data": 832, 2024-09-16T03:25:56.500 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_omap": 3, 2024-09-16T03:25:56.500 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_meta": 53628, 2024-09-16T03:25:56.500 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_avail": 209660640, 2024-09-16T03:25:56.500 INFO:tasks.workunit.client.0.smithi096.stderr: "statfs": { 2024-09-16T03:25:56.500 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 214748364800, 2024-09-16T03:25:56.500 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 214692495360, 2024-09-16T03:25:56.500 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:25:56.500 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 851968, 2024-09-16T03:25:56.500 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 318404, 2024-09-16T03:25:56.500 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:25:56.500 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:25:56.501 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:25:56.501 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 3190, 2024-09-16T03:25:56.501 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 54915978 2024-09-16T03:25:56.501 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.501 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_peers": [], 2024-09-16T03:25:56.501 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_trim_queue_len": 0, 2024-09-16T03:25:56.501 INFO:tasks.workunit.client.0.smithi096.stderr: "num_snap_trimming": 0, 2024-09-16T03:25:56.501 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shards_repaired": 0, 2024-09-16T03:25:56.501 INFO:tasks.workunit.client.0.smithi096.stderr: "op_queue_age_hist": { 2024-09-16T03:25:56.501 INFO:tasks.workunit.client.0.smithi096.stderr: "histogram": [], 2024-09-16T03:25:56.501 INFO:tasks.workunit.client.0.smithi096.stderr: "upper_bound": 1 2024-09-16T03:25:56.501 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.501 INFO:tasks.workunit.client.0.smithi096.stderr: "perf_stat": { 2024-09-16T03:25:56.501 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ms": 256, 2024-09-16T03:25:56.502 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ms": 256, 2024-09-16T03:25:56.502 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ns": 256000000, 2024-09-16T03:25:56.502 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ns": 256000000 2024-09-16T03:25:56.502 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.502 INFO:tasks.workunit.client.0.smithi096.stderr: "alerts": [], 2024-09-16T03:25:56.502 INFO:tasks.workunit.client.0.smithi096.stderr: "network_ping_times": [] 2024-09-16T03:25:56.502 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.502 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_sum_by_class": { 2024-09-16T03:25:56.502 INFO:tasks.workunit.client.0.smithi096.stderr: "hdd": { 2024-09-16T03:25:56.502 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 0, 2024-09-16T03:25:56.502 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 0, 2024-09-16T03:25:56.502 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pgs": 128, 2024-09-16T03:25:56.502 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osds": 2, 2024-09-16T03:25:56.502 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_osds": 2, 2024-09-16T03:25:56.502 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_omap_osds": 2, 2024-09-16T03:25:56.503 INFO:tasks.workunit.client.0.smithi096.stderr: "kb": 209715200, 2024-09-16T03:25:56.503 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used": 54560, 2024-09-16T03:25:56.503 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_data": 832, 2024-09-16T03:25:56.503 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_omap": 3, 2024-09-16T03:25:56.503 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_meta": 53628, 2024-09-16T03:25:56.503 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_avail": 209660640, 2024-09-16T03:25:56.503 INFO:tasks.workunit.client.0.smithi096.stderr: "statfs": { 2024-09-16T03:25:56.503 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 214748364800, 2024-09-16T03:25:56.503 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 214692495360, 2024-09-16T03:25:56.503 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:25:56.503 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 851968, 2024-09-16T03:25:56.503 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 318404, 2024-09-16T03:25:56.503 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:25:56.503 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:25:56.504 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:25:56.504 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 3190, 2024-09-16T03:25:56.504 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 54915978 2024-09-16T03:25:56.504 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.504 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_peers": [], 2024-09-16T03:25:56.504 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_trim_queue_len": 0, 2024-09-16T03:25:56.504 INFO:tasks.workunit.client.0.smithi096.stderr: "num_snap_trimming": 0, 2024-09-16T03:25:56.504 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shards_repaired": 0, 2024-09-16T03:25:56.504 INFO:tasks.workunit.client.0.smithi096.stderr: "op_queue_age_hist": { 2024-09-16T03:25:56.504 INFO:tasks.workunit.client.0.smithi096.stderr: "histogram": [], 2024-09-16T03:25:56.504 INFO:tasks.workunit.client.0.smithi096.stderr: "upper_bound": 1 2024-09-16T03:25:56.504 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.504 INFO:tasks.workunit.client.0.smithi096.stderr: "perf_stat": { 2024-09-16T03:25:56.505 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ms": 256, 2024-09-16T03:25:56.505 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ms": 256, 2024-09-16T03:25:56.505 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ns": 256000000, 2024-09-16T03:25:56.505 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ns": 256000000 2024-09-16T03:25:56.505 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.505 INFO:tasks.workunit.client.0.smithi096.stderr: "alerts": [], 2024-09-16T03:25:56.505 INFO:tasks.workunit.client.0.smithi096.stderr: "network_ping_times": [] 2024-09-16T03:25:56.505 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:56.505 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.505 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_stats": [ 2024-09-16T03:25:56.505 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:56.505 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 2, 2024-09-16T03:25:56.505 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 32, 2024-09-16T03:25:56.505 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:25:56.506 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:25:56.506 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:25:56.506 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:25:56.506 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:25:56.506 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:25:56.506 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:25:56.506 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:25:56.506 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:25:56.506 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:25:56.506 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:25:56.506 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:25:56.506 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:25:56.506 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:25:56.506 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:25:56.507 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:25:56.507 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:25:56.507 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:25:56.507 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:25:56.507 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:25:56.507 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:25:56.507 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:25:56.507 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:25:56.507 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:25:56.507 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:25:56.507 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:25:56.507 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:25:56.507 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:25:56.508 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:25:56.508 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:25:56.508 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:25:56.508 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:25:56.508 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:25:56.508 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:25:56.508 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:25:56.508 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:25:56.508 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:25:56.508 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:25:56.508 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:25:56.508 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:25:56.508 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:25:56.508 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.509 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:25:56.509 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:25:56.509 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:25:56.509 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:25:56.509 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:25:56.509 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:25:56.509 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:25:56.509 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:25:56.509 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:25:56.509 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:25:56.509 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:25:56.509 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.509 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:25:56.509 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:25:56.510 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 64, 2024-09-16T03:25:56.510 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 64, 2024-09-16T03:25:56.510 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 3 2024-09-16T03:25:56.510 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.510 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:56.510 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 1, 2024-09-16T03:25:56.510 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 32, 2024-09-16T03:25:56.510 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:25:56.510 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:25:56.510 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:25:56.510 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:25:56.510 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:25:56.510 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:25:56.510 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:25:56.511 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:25:56.511 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:25:56.511 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:25:56.511 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:25:56.511 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:25:56.511 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:25:56.511 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:25:56.511 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:25:56.511 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:25:56.511 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:25:56.511 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:25:56.511 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:25:56.511 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:25:56.511 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:25:56.512 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:25:56.512 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:25:56.512 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:25:56.512 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:25:56.512 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:25:56.512 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:25:56.512 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:25:56.512 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:25:56.512 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:25:56.513 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:25:56.513 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:25:56.513 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:25:56.513 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:25:56.513 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:25:56.513 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:25:56.513 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:25:56.513 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:25:56.513 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:25:56.513 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:25:56.513 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:25:56.513 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.514 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:25:56.514 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:25:56.514 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:25:56.514 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:25:56.514 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:25:56.514 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:25:56.514 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:25:56.514 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:25:56.514 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:25:56.514 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:25:56.514 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:25:56.514 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.514 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:25:56.515 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:25:56.515 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 64, 2024-09-16T03:25:56.515 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 64, 2024-09-16T03:25:56.515 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 3 2024-09-16T03:25:56.515 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:56.515 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:56.515 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_stats": [ 2024-09-16T03:25:56.515 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:56.515 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:25:56.515 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 21474836517 2024-09-16T03:25:56.515 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.515 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:56.515 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:25:56.515 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 42949672988 2024-09-16T03:25:56.516 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.516 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:56.516 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:25:56.516 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 0 2024-09-16T03:25:56.516 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:56.516 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:56.516 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_by_state": [ 2024-09-16T03:25:56.516 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:56.516 INFO:tasks.workunit.client.0.smithi096.stderr: "state": "active+undersized", 2024-09-16T03:25:56.516 INFO:tasks.workunit.client.0.smithi096.stderr: "num": 64 2024-09-16T03:25:56.516 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:56.516 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:56.516 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_by_osd": [ 2024-09-16T03:25:56.516 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:56.517 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:25:56.517 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 0, 2024-09-16T03:25:56.517 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 0, 2024-09-16T03:25:56.517 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:25:56.517 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.517 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:56.517 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:25:56.517 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 28, 2024-09-16T03:25:56.517 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 64, 2024-09-16T03:25:56.517 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:25:56.517 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.517 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:56.517 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:25:56.517 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 36, 2024-09-16T03:25:56.517 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 64, 2024-09-16T03:25:56.518 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:25:56.518 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:56.518 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:56.518 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": [ 2024-09-16T03:25:56.518 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:56.518 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 1, 2024-09-16T03:25:56.518 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": {} 2024-09-16T03:25:56.518 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.518 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:56.518 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 2, 2024-09-16T03:25:56.518 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": {} 2024-09-16T03:25:56.518 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:56.518 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:56.518 INFO:tasks.workunit.client.0.smithi096.stderr: "servicemap": { 2024-09-16T03:25:56.519 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 5, 2024-09-16T03:25:56.519 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:25:38.422788+0000", 2024-09-16T03:25:56.519 INFO:tasks.workunit.client.0.smithi096.stderr: "services": {} 2024-09-16T03:25:56.519 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:56.519 INFO:tasks.workunit.client.0.smithi096.stderr: "mgrstat_first_committed": 77, 2024-09-16T03:25:56.519 INFO:tasks.workunit.client.0.smithi096.stderr: "mgrstat_last_committed": 83, 2024-09-16T03:25:56.519 INFO:tasks.workunit.client.0.smithi096.stderr: "logm_first_committed": 1, 2024-09-16T03:25:56.519 INFO:tasks.workunit.client.0.smithi096.stderr: "logm_last_committed": 365, 2024-09-16T03:25:56.519 INFO:tasks.workunit.client.0.smithi096.stderr: "paxos": { 2024-09-16T03:25:56.519 INFO:tasks.workunit.client.0.smithi096.stderr: "first_committed": 1, 2024-09-16T03:25:56.519 INFO:tasks.workunit.client.0.smithi096.stderr: "last_committed": 544, 2024-09-16T03:25:56.519 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pn": 0, 2024-09-16T03:25:56.519 INFO:tasks.workunit.client.0.smithi096.stderr: "accepted_pn": 0 2024-09-16T03:25:56.519 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:56.519 INFO:tasks.workunit.client.0.smithi096.stderr:}' 2024-09-16T03:25:56.523 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:97: check_lec_honours_osd: jq .osdmap_clean_epochs.min_last_epoch_clean 2024-09-16T03:25:56.523 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:97: check_lec_honours_osd: echo '{' '"cluster_fingerprint":' '"fda2fc64-07ed-4add-8224-2e527e11d427",' '"version":' '"19.3.0-4930-gfc3e0bff",' '"commit":' '"fc3e0bff7468fd55478adbae7f75508b749124b6",' '"timestamp":' '"2024-09-16T03:25:56.404611+0000",' '"tag":' '"",' '"health":' '{' '"status":' '"HEALTH_OK",' '"checks":' '{},' '"mutes":' '[]' '},' '"monmap_first_committed":' 1, '"monmap_last_committed":' 1, '"monmap":' '{' '"epoch":' 1, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"modified":' '"2024-09-16T03:22:45.872880Z",' '"created":' '"2024-09-16T03:22:45.872880Z",' '"min_mon_release":' 19, '"min_mon_release_name":' '"squid",' '"election_strategy":' 1, '"disallowed_leaders:' '":' '"",' '"stretch_mode":' false, '"tiebreaker_mon":' '"",' '"removed_ranks:' '":' '"",' '"features":' '{' '"persistent":' '[' '"kraken",' '"luminous",' '"mimic",' '"osdmap-prune",' '"nautilus",' '"octopus",' '"pacific",' '"elector-pinging",' '"quincy",' '"reef",' '"squid"' '],' '"optional":' '[]' '},' '"mons":' '[' '{' '"rank":' 0, '"name":' '"a",' '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:7302",' '"nonce":' 0 '}' ']' '},' '"addr":' '"127.0.0.1:7302/0",' '"public_addr":' '"127.0.0.1:7302/0",' '"priority":' 0, '"weight":' 0, '"crush_location":' '"{}"' '}' ']' '},' '"quorum":' '[' 0 '],' '"osdmap":' '{' '"epoch":' 80, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"created":' '"2024-09-16T03:22:46.906117+0000",' '"modified":' '"2024-09-16T03:25:52.948673+0000",' '"last_up_change":' '"2024-09-16T03:25:08.513363+0000",' '"last_in_change":' '"2024-09-16T03:25:09.839444+0000",' '"flags":' '"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit",' '"flags_num":' 5799936, '"flags_set":' '[' '"pglog_hardlimit",' '"purged_snapdirs",' '"recovery_deletes",' '"sortbitwise"' '],' '"crush_version":' 7, '"full_ratio":' 0.97000002861022949, '"backfillfull_ratio":' 0.97000002861022949, '"nearfull_ratio":' 0.85000002384185791, '"cluster_snapshot":' '"",' '"pool_max":' 2, '"max_osd":' 3, '"require_min_compat_client":' '"luminous",' '"min_compat_client":' '"jewel",' '"require_osd_release":' '"squid",' '"allow_crimson":' false, '"pools":' '[' '{' '"pool":' 1, '"pool_name":' '"foo",' '"create_time":' '"2024-09-16T03:24:44.525189+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"30",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.8700000047683716, '"score_stable":' 1.8700000047683716, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1.25, '"raw_score_stable":' 1.25, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '},' '{' '"pool":' 2, '"pool_name":' '"bar",' '"create_time":' '"2024-09-16T03:24:46.226575+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"32",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.4900000095367432, '"score_stable":' 1.4900000095367432, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1, '"raw_score_stable":' 1, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '}' '],' '"osds":' '[' '{' '"osd":' 0, '"uuid":' '"64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 5, '"up_thru":' 33, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6802",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6803",' '"nonce":' 3375787448 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6804",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6805",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6808",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6809",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6806",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6807",' '"nonce":' 3375787448 '}' ']' '},' '"public_addr":' '"127.0.0.1:6803/3375787448",' '"cluster_addr":' '"127.0.0.1:6805/3375787448",' '"heartbeat_back_addr":' '"127.0.0.1:6809/3375787448",' '"heartbeat_front_addr":' '"127.0.0.1:6807/3375787448",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 1, '"uuid":' '"74b26727-75c9-444d-8782-719e4197a382",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 10, '"up_thru":' 33, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6810",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6811",' '"nonce":' 3733255132 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6812",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6813",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6816",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6817",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6814",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6815",' '"nonce":' 3733255132 '}' ']' '},' '"public_addr":' '"127.0.0.1:6811/3733255132",' '"cluster_addr":' '"127.0.0.1:6813/3733255132",' '"heartbeat_back_addr":' '"127.0.0.1:6817/3733255132",' '"heartbeat_front_addr":' '"127.0.0.1:6815/3733255132",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 2, '"uuid":' '"143da3a7-dad9-4b1e-966b-76cf5bdd3c82",' '"up":' 0, '"in":' 0, '"weight":' 0, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 15, '"up_thru":' 21, '"down_at":' 33, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6818",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6819",' '"nonce":' 963814857 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6820",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6821",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6824",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6825",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6822",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6823",' '"nonce":' 963814857 '}' ']' '},' '"public_addr":' '"127.0.0.1:6819/963814857",' '"cluster_addr":' '"127.0.0.1:6821/963814857",' '"heartbeat_back_addr":' '"127.0.0.1:6825/963814857",' '"heartbeat_front_addr":' '"127.0.0.1:6823/963814857",' '"state":' '[' '"exists"' ']' '}' '],' '"osd_xinfo":' '[' '{' '"osd":' 0, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:22.481942+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 1, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:59.663703+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 2, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 65536, '"last_purged_snaps_scrub":' '"2024-09-16T03:24:37.320822+0000",' '"dead_epoch":' 32 '}' '],' '"pg_upmap":' '[],' '"pg_upmap_items":' '[],' '"pg_upmap_primaries":' '[],' '"pg_temp":' '[],' '"primary_temp":' '[],' '"blocklist":' '{},' '"range_blocklist":' '{},' '"erasure_code_profiles":' '{' '"default":' '{' '"k":' '"2",' '"m":' '"2",' '"plugin":' '"jerasure",' '"technique":' '"reed_sol_van"' '}' '},' '"removed_snaps_queue":' '[],' '"new_removed_snaps":' '[],' '"new_purged_snaps":' '[],' '"crush_node_flags":' '{},' '"device_class_flags":' '{},' '"stretch_mode":' '{' '"stretch_mode_enabled":' false, '"stretch_bucket_count":' 0, '"degraded_stretch_mode":' 0, '"recovering_stretch_mode":' 0, '"stretch_mode_bucket":' 0 '}' '},' '"osd_metadata":' '[' '{' '"id":' 0, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/0/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:22:53.662571Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]",' '"hb_front_addr":' '"[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/0",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 1, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/1/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:23:30.129885Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]",' '"hb_front_addr":' '"[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/1",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 2, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/2/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:24:07.764502Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]",' '"hb_front_addr":' '"[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/2",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '}' '],' '"osdmap_clean_epochs":' '{' '"min_last_epoch_clean":' 28, '"last_epoch_clean":' '{' '"per_pool":' '[' '{' '"poolid":' 1, '"floor":' 28 '},' '{' '"poolid":' 2, '"floor":' 28 '}' ']' '},' '"osd_epochs":' '[' '{' '"id":' 0, '"epoch":' 78 '},' '{' '"id":' 1, '"epoch":' 80 '}' ']' '},' '"osdmap_first_committed":' 28, '"osdmap_last_committed":' 80, '"crushmap":' '{' '"devices":' '[' '{' '"id":' 0, '"name":' '"osd.0",' '"class":' '"hdd"' '},' '{' '"id":' 1, '"name":' '"osd.1",' '"class":' '"hdd"' '},' '{' '"id":' 2, '"name":' '"osd.2",' '"class":' '"hdd"' '}' '],' '"types":' '[' '{' '"type_id":' 0, '"name":' '"osd"' '},' '{' '"type_id":' 1, '"name":' '"host"' '},' '{' '"type_id":' 2, '"name":' '"chassis"' '},' '{' '"type_id":' 3, '"name":' '"rack"' '},' '{' '"type_id":' 4, '"name":' '"row"' '},' '{' '"type_id":' 5, '"name":' '"pdu"' '},' '{' '"type_id":' 6, '"name":' '"pod"' '},' '{' '"type_id":' 7, '"name":' '"room"' '},' '{' '"type_id":' 8, '"name":' '"datacenter"' '},' '{' '"type_id":' 9, '"name":' '"zone"' '},' '{' '"type_id":' 10, '"name":' '"region"' '},' '{' '"type_id":' 11, '"name":' '"root"' '}' '],' '"buckets":' '[' '{' '"id":' -1, '"name":' '"default",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -3, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -2, '"name":' '"default~hdd",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -4, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -3, '"name":' '"smithi096",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '},' '{' '"id":' -4, '"name":' '"smithi096~hdd",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '}' '],' '"rules":' '[' '{' '"rule_id":' 0, '"rule_name":' '"replicated_rule",' '"type":' 1, '"steps":' '[' '{' '"op":' '"take",' '"item":' -1, '"item_name":' '"default"' '},' '{' '"op":' '"choose_firstn",' '"num":' 0, '"type":' '"osd"' '},' '{' '"op":' '"emit"' '}' ']' '}' '],' '"tunables":' '{' '"choose_local_tries":' 0, '"choose_local_fallback_tries":' 0, '"choose_total_tries":' 50, '"chooseleaf_descend_once":' 1, '"chooseleaf_vary_r":' 1, '"chooseleaf_stable":' 1, '"msr_descents":' 100, '"msr_collision_tries":' 100, '"straw_calc_version":' 1, '"allowed_bucket_algs":' 54, '"profile":' '"jewel",' '"optimal_tunables":' 1, '"legacy_tunables":' 0, '"minimum_required_version":' '"jewel",' '"require_feature_tunables":' 1, '"require_feature_tunables2":' 1, '"has_v2_rules":' 0, '"require_feature_tunables3":' 1, '"has_v3_rules":' 0, '"has_v4_buckets":' 1, '"require_feature_tunables5":' 1, '"has_v5_rules":' 0, '"has_msr_rules":' 0 '},' '"choose_args":' '{}' '},' '"fsmap":' '{' '"epoch":' 1, '"btime":' '"2024-09-16T03:22:46:882186+0000",' '"default_fscid":' -1, '"compat":' '{' '"compat":' '{},' '"ro_compat":' '{},' '"incompat":' '{' '"feature_1":' '"base' 'v0.20",' '"feature_2":' '"client' writeable 'ranges",' '"feature_3":' '"default' file layouts on 'dirs",' '"feature_4":' '"dir' inode in separate 'object",' '"feature_5":' '"mds' uses versioned 'encoding",' '"feature_6":' '"dirfrag' is stored in 'omap",' '"feature_8":' '"no' anchor 'table",' '"feature_9":' '"file' layout 'v2",' '"feature_10":' '"snaprealm' 'v2",' '"feature_11":' '"minor' log 'segments",' '"feature_12":' '"quiesce' 'subvolumes"' '}' '},' '"feature_flags":' '{' '"enable_multiple":' true, '"ever_enabled_multiple":' true '},' '"standbys":' '[],' '"filesystems":' '[]' '},' '"mdsmap_first_committed":' 1, '"mdsmap_last_committed":' 1, '"auth":' '{' '"first_committed":' 1, '"last_committed":' 5, '"num_secrets":' 3 '},' '"num_pg":' 64, '"num_pg_active":' 64, '"num_pg_unknown":' 0, '"num_osd":' 3, '"pool_sum":' '{' '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 128, '"acting":' 128, '"num_store_stats":' 0 '},' '"osd_sum":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54560, '"kb_used_data":' 832, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660640, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692495360, '"internally_reserved":' 0, '"allocated":' 851968, '"data_stored":' 318404, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 256, '"apply_latency_ms":' 256, '"commit_latency_ns":' 256000000, '"apply_latency_ns":' 256000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '},' '"osd_sum_by_class":' '{' '"hdd":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54560, '"kb_used_data":' 832, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660640, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692495360, '"internally_reserved":' 0, '"allocated":' 851968, '"data_stored":' 318404, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 256, '"apply_latency_ms":' 256, '"commit_latency_ns":' 256000000, '"apply_latency_ns":' 256000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '}' '},' '"pool_stats":' '[' '{' '"poolid":' 2, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '},' '{' '"poolid":' 1, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '}' '],' '"osd_stats":' '[' '{' '"osd":' 0, '"seq":' 21474836517 '},' '{' '"osd":' 1, '"seq":' 42949672988 '},' '{' '"osd":' 2, '"seq":' 0 '}' '],' '"num_pg_by_state":' '[' '{' '"state":' '"active+undersized",' '"num":' 64 '}' '],' '"num_pg_by_osd":' '[' '{' '"osd":' 2, '"num_primary_pg":' 0, '"num_acting_pg":' 0, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 0, '"num_primary_pg":' 28, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 1, '"num_primary_pg":' 36, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '}' '],' '"purged_snaps":' '[' '{' '"pool":' 1, '"purged_snaps":' '{}' '},' '{' '"pool":' 2, '"purged_snaps":' '{}' '}' '],' '"servicemap":' '{' '"epoch":' 5, '"modified":' '"2024-09-16T03:25:38.422788+0000",' '"services":' '{}' '},' '"mgrstat_first_committed":' 77, '"mgrstat_last_committed":' 83, '"logm_first_committed":' 1, '"logm_last_committed":' 365, '"paxos":' '{' '"first_committed":' 1, '"last_committed":' 544, '"last_pn":' 0, '"accepted_pn":' 0 '}' '}' 2024-09-16T03:25:56.523 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:97: check_lec_honours_osd: lec=28 2024-09-16T03:25:56.524 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:99: check_lec_honours_osd: [[ -z 2 ]] 2024-09-16T03:25:56.524 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:110: check_lec_honours_osd: epoch=($(echo $report | jq ".osdmap_clean_epochs.osd_epochs[] |" " select(.id == $id) | .epoch")) 2024-09-16T03:25:56.524 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:110: check_lec_honours_osd: jq '.osdmap_clean_epochs.osd_epochs[] |' ' select(.id == ) | .epoch' 2024-09-16T03:25:56.524 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:110: check_lec_honours_osd: echo '{' '"cluster_fingerprint":' '"fda2fc64-07ed-4add-8224-2e527e11d427",' '"version":' '"19.3.0-4930-gfc3e0bff",' '"commit":' '"fc3e0bff7468fd55478adbae7f75508b749124b6",' '"timestamp":' '"2024-09-16T03:25:56.404611+0000",' '"tag":' '"",' '"health":' '{' '"status":' '"HEALTH_OK",' '"checks":' '{},' '"mutes":' '[]' '},' '"monmap_first_committed":' 1, '"monmap_last_committed":' 1, '"monmap":' '{' '"epoch":' 1, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"modified":' '"2024-09-16T03:22:45.872880Z",' '"created":' '"2024-09-16T03:22:45.872880Z",' '"min_mon_release":' 19, '"min_mon_release_name":' '"squid",' '"election_strategy":' 1, '"disallowed_leaders:' '":' '"",' '"stretch_mode":' false, '"tiebreaker_mon":' '"",' '"removed_ranks:' '":' '"",' '"features":' '{' '"persistent":' '[' '"kraken",' '"luminous",' '"mimic",' '"osdmap-prune",' '"nautilus",' '"octopus",' '"pacific",' '"elector-pinging",' '"quincy",' '"reef",' '"squid"' '],' '"optional":' '[]' '},' '"mons":' '[' '{' '"rank":' 0, '"name":' '"a",' '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:7302",' '"nonce":' 0 '}' ']' '},' '"addr":' '"127.0.0.1:7302/0",' '"public_addr":' '"127.0.0.1:7302/0",' '"priority":' 0, '"weight":' 0, '"crush_location":' '"{}"' '}' ']' '},' '"quorum":' '[' 0 '],' '"osdmap":' '{' '"epoch":' 80, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"created":' '"2024-09-16T03:22:46.906117+0000",' '"modified":' '"2024-09-16T03:25:52.948673+0000",' '"last_up_change":' '"2024-09-16T03:25:08.513363+0000",' '"last_in_change":' '"2024-09-16T03:25:09.839444+0000",' '"flags":' '"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit",' '"flags_num":' 5799936, '"flags_set":' '[' '"pglog_hardlimit",' '"purged_snapdirs",' '"recovery_deletes",' '"sortbitwise"' '],' '"crush_version":' 7, '"full_ratio":' 0.97000002861022949, '"backfillfull_ratio":' 0.97000002861022949, '"nearfull_ratio":' 0.85000002384185791, '"cluster_snapshot":' '"",' '"pool_max":' 2, '"max_osd":' 3, '"require_min_compat_client":' '"luminous",' '"min_compat_client":' '"jewel",' '"require_osd_release":' '"squid",' '"allow_crimson":' false, '"pools":' '[' '{' '"pool":' 1, '"pool_name":' '"foo",' '"create_time":' '"2024-09-16T03:24:44.525189+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"30",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.8700000047683716, '"score_stable":' 1.8700000047683716, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1.25, '"raw_score_stable":' 1.25, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '},' '{' '"pool":' 2, '"pool_name":' '"bar",' '"create_time":' '"2024-09-16T03:24:46.226575+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"32",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.4900000095367432, '"score_stable":' 1.4900000095367432, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1, '"raw_score_stable":' 1, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '}' '],' '"osds":' '[' '{' '"osd":' 0, '"uuid":' '"64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 5, '"up_thru":' 33, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6802",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6803",' '"nonce":' 3375787448 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6804",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6805",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6808",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6809",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6806",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6807",' '"nonce":' 3375787448 '}' ']' '},' '"public_addr":' '"127.0.0.1:6803/3375787448",' '"cluster_addr":' '"127.0.0.1:6805/3375787448",' '"heartbeat_back_addr":' '"127.0.0.1:6809/3375787448",' '"heartbeat_front_addr":' '"127.0.0.1:6807/3375787448",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 1, '"uuid":' '"74b26727-75c9-444d-8782-719e4197a382",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 10, '"up_thru":' 33, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6810",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6811",' '"nonce":' 3733255132 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6812",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6813",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6816",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6817",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6814",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6815",' '"nonce":' 3733255132 '}' ']' '},' '"public_addr":' '"127.0.0.1:6811/3733255132",' '"cluster_addr":' '"127.0.0.1:6813/3733255132",' '"heartbeat_back_addr":' '"127.0.0.1:6817/3733255132",' '"heartbeat_front_addr":' '"127.0.0.1:6815/3733255132",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 2, '"uuid":' '"143da3a7-dad9-4b1e-966b-76cf5bdd3c82",' '"up":' 0, '"in":' 0, '"weight":' 0, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 15, '"up_thru":' 21, '"down_at":' 33, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6818",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6819",' '"nonce":' 963814857 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6820",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6821",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6824",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6825",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6822",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6823",' '"nonce":' 963814857 '}' ']' '},' '"public_addr":' '"127.0.0.1:6819/963814857",' '"cluster_addr":' '"127.0.0.1:6821/963814857",' '"heartbeat_back_addr":' '"127.0.0.1:6825/963814857",' '"heartbeat_front_addr":' '"127.0.0.1:6823/963814857",' '"state":' '[' '"exists"' ']' '}' '],' '"osd_xinfo":' '[' '{' '"osd":' 0, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:22.481942+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 1, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:59.663703+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 2, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 65536, '"last_purged_snaps_scrub":' '"2024-09-16T03:24:37.320822+0000",' '"dead_epoch":' 32 '}' '],' '"pg_upmap":' '[],' '"pg_upmap_items":' '[],' '"pg_upmap_primaries":' '[],' '"pg_temp":' '[],' '"primary_temp":' '[],' '"blocklist":' '{},' '"range_blocklist":' '{},' '"erasure_code_profiles":' '{' '"default":' '{' '"k":' '"2",' '"m":' '"2",' '"plugin":' '"jerasure",' '"technique":' '"reed_sol_van"' '}' '},' '"removed_snaps_queue":' '[],' '"new_removed_snaps":' '[],' '"new_purged_snaps":' '[],' '"crush_node_flags":' '{},' '"device_class_flags":' '{},' '"stretch_mode":' '{' '"stretch_mode_enabled":' false, '"stretch_bucket_count":' 0, '"degraded_stretch_mode":' 0, '"recovering_stretch_mode":' 0, '"stretch_mode_bucket":' 0 '}' '},' '"osd_metadata":' '[' '{' '"id":' 0, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/0/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:22:53.662571Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]",' '"hb_front_addr":' '"[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/0",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 1, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/1/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:23:30.129885Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]",' '"hb_front_addr":' '"[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/1",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 2, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/2/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:24:07.764502Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]",' '"hb_front_addr":' '"[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/2",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '}' '],' '"osdmap_clean_epochs":' '{' '"min_last_epoch_clean":' 28, '"last_epoch_clean":' '{' '"per_pool":' '[' '{' '"poolid":' 1, '"floor":' 28 '},' '{' '"poolid":' 2, '"floor":' 28 '}' ']' '},' '"osd_epochs":' '[' '{' '"id":' 0, '"epoch":' 78 '},' '{' '"id":' 1, '"epoch":' 80 '}' ']' '},' '"osdmap_first_committed":' 28, '"osdmap_last_committed":' 80, '"crushmap":' '{' '"devices":' '[' '{' '"id":' 0, '"name":' '"osd.0",' '"class":' '"hdd"' '},' '{' '"id":' 1, '"name":' '"osd.1",' '"class":' '"hdd"' '},' '{' '"id":' 2, '"name":' '"osd.2",' '"class":' '"hdd"' '}' '],' '"types":' '[' '{' '"type_id":' 0, '"name":' '"osd"' '},' '{' '"type_id":' 1, '"name":' '"host"' '},' '{' '"type_id":' 2, '"name":' '"chassis"' '},' '{' '"type_id":' 3, '"name":' '"rack"' '},' '{' '"type_id":' 4, '"name":' '"row"' '},' '{' '"type_id":' 5, '"name":' '"pdu"' '},' '{' '"type_id":' 6, '"name":' '"pod"' '},' '{' '"type_id":' 7, '"name":' '"room"' '},' '{' '"type_id":' 8, '"name":' '"datacenter"' '},' '{' '"type_id":' 9, '"name":' '"zone"' '},' '{' '"type_id":' 10, '"name":' '"region"' '},' '{' '"type_id":' 11, '"name":' '"root"' '}' '],' '"buckets":' '[' '{' '"id":' -1, '"name":' '"default",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -3, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -2, '"name":' '"default~hdd",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -4, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -3, '"name":' '"smithi096",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '},' '{' '"id":' -4, '"name":' '"smithi096~hdd",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '}' '],' '"rules":' '[' '{' '"rule_id":' 0, '"rule_name":' '"replicated_rule",' '"type":' 1, '"steps":' '[' '{' '"op":' '"take",' '"item":' -1, '"item_name":' '"default"' '},' '{' '"op":' '"choose_firstn",' '"num":' 0, '"type":' '"osd"' '},' '{' '"op":' '"emit"' '}' ']' '}' '],' '"tunables":' '{' '"choose_local_tries":' 0, '"choose_local_fallback_tries":' 0, '"choose_total_tries":' 50, '"chooseleaf_descend_once":' 1, '"chooseleaf_vary_r":' 1, '"chooseleaf_stable":' 1, '"msr_descents":' 100, '"msr_collision_tries":' 100, '"straw_calc_version":' 1, '"allowed_bucket_algs":' 54, '"profile":' '"jewel",' '"optimal_tunables":' 1, '"legacy_tunables":' 0, '"minimum_required_version":' '"jewel",' '"require_feature_tunables":' 1, '"require_feature_tunables2":' 1, '"has_v2_rules":' 0, '"require_feature_tunables3":' 1, '"has_v3_rules":' 0, '"has_v4_buckets":' 1, '"require_feature_tunables5":' 1, '"has_v5_rules":' 0, '"has_msr_rules":' 0 '},' '"choose_args":' '{}' '},' '"fsmap":' '{' '"epoch":' 1, '"btime":' '"2024-09-16T03:22:46:882186+0000",' '"default_fscid":' -1, '"compat":' '{' '"compat":' '{},' '"ro_compat":' '{},' '"incompat":' '{' '"feature_1":' '"base' 'v0.20",' '"feature_2":' '"client' writeable 'ranges",' '"feature_3":' '"default' file layouts on 'dirs",' '"feature_4":' '"dir' inode in separate 'object",' '"feature_5":' '"mds' uses versioned 'encoding",' '"feature_6":' '"dirfrag' is stored in 'omap",' '"feature_8":' '"no' anchor 'table",' '"feature_9":' '"file' layout 'v2",' '"feature_10":' '"snaprealm' 'v2",' '"feature_11":' '"minor' log 'segments",' '"feature_12":' '"quiesce' 'subvolumes"' '}' '},' '"feature_flags":' '{' '"enable_multiple":' true, '"ever_enabled_multiple":' true '},' '"standbys":' '[],' '"filesystems":' '[]' '},' '"mdsmap_first_committed":' 1, '"mdsmap_last_committed":' 1, '"auth":' '{' '"first_committed":' 1, '"last_committed":' 5, '"num_secrets":' 3 '},' '"num_pg":' 64, '"num_pg_active":' 64, '"num_pg_unknown":' 0, '"num_osd":' 3, '"pool_sum":' '{' '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 128, '"acting":' 128, '"num_store_stats":' 0 '},' '"osd_sum":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54560, '"kb_used_data":' 832, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660640, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692495360, '"internally_reserved":' 0, '"allocated":' 851968, '"data_stored":' 318404, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 256, '"apply_latency_ms":' 256, '"commit_latency_ns":' 256000000, '"apply_latency_ns":' 256000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '},' '"osd_sum_by_class":' '{' '"hdd":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54560, '"kb_used_data":' 832, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660640, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692495360, '"internally_reserved":' 0, '"allocated":' 851968, '"data_stored":' 318404, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 256, '"apply_latency_ms":' 256, '"commit_latency_ns":' 256000000, '"apply_latency_ns":' 256000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '}' '},' '"pool_stats":' '[' '{' '"poolid":' 2, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '},' '{' '"poolid":' 1, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '}' '],' '"osd_stats":' '[' '{' '"osd":' 0, '"seq":' 21474836517 '},' '{' '"osd":' 1, '"seq":' 42949672988 '},' '{' '"osd":' 2, '"seq":' 0 '}' '],' '"num_pg_by_state":' '[' '{' '"state":' '"active+undersized",' '"num":' 64 '}' '],' '"num_pg_by_osd":' '[' '{' '"osd":' 2, '"num_primary_pg":' 0, '"num_acting_pg":' 0, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 0, '"num_primary_pg":' 28, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 1, '"num_primary_pg":' 36, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '}' '],' '"purged_snaps":' '[' '{' '"pool":' 1, '"purged_snaps":' '{}' '},' '{' '"pool":' 2, '"purged_snaps":' '{}' '}' '],' '"servicemap":' '{' '"epoch":' 5, '"modified":' '"2024-09-16T03:25:38.422788+0000",' '"services":' '{}' '},' '"mgrstat_first_committed":' 77, '"mgrstat_last_committed":' 83, '"logm_first_committed":' 1, '"logm_last_committed":' 365, '"paxos":' '{' '"first_committed":' 1, '"last_committed":' 544, '"last_pn":' 0, '"accepted_pn":' 0 '}' '}' 2024-09-16T03:25:56.524 INFO:tasks.workunit.client.0.smithi096.stderr:jq: error: syntax error, unexpected $end (Unix shell quoting issues?) at , line 1: 2024-09-16T03:25:56.524 INFO:tasks.workunit.client.0.smithi096.stderr:.osdmap_clean_epochs.osd_epochs[] | 2024-09-16T03:25:56.524 INFO:tasks.workunit.client.0.smithi096.stderr:jq: 1 compile error 2024-09-16T03:25:56.524 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:111: check_lec_honours_osd: [[ 0 -eq 1 ]] 2024-09-16T03:25:56.524 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:111: check_lec_honours_osd: echo '{' '"cluster_fingerprint":' '"fda2fc64-07ed-4add-8224-2e527e11d427",' '"version":' '"19.3.0-4930-gfc3e0bff",' '"commit":' '"fc3e0bff7468fd55478adbae7f75508b749124b6",' '"timestamp":' '"2024-09-16T03:25:56.404611+0000",' '"tag":' '"",' '"health":' '{' '"status":' '"HEALTH_OK",' '"checks":' '{},' '"mutes":' '[]' '},' '"monmap_first_committed":' 1, '"monmap_last_committed":' 1, '"monmap":' '{' '"epoch":' 1, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"modified":' '"2024-09-16T03:22:45.872880Z",' '"created":' '"2024-09-16T03:22:45.872880Z",' '"min_mon_release":' 19, '"min_mon_release_name":' '"squid",' '"election_strategy":' 1, '"disallowed_leaders:' '":' '"",' '"stretch_mode":' false, '"tiebreaker_mon":' '"",' '"removed_ranks:' '":' '"",' '"features":' '{' '"persistent":' '[' '"kraken",' '"luminous",' '"mimic",' '"osdmap-prune",' '"nautilus",' '"octopus",' '"pacific",' '"elector-pinging",' '"quincy",' '"reef",' '"squid"' '],' '"optional":' '[]' '},' '"mons":' '[' '{' '"rank":' 0, '"name":' '"a",' '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:7302",' '"nonce":' 0 '}' ']' '},' '"addr":' '"127.0.0.1:7302/0",' '"public_addr":' '"127.0.0.1:7302/0",' '"priority":' 0, '"weight":' 0, '"crush_location":' '"{}"' '}' ']' '},' '"quorum":' '[' 0 '],' '"osdmap":' '{' '"epoch":' 80, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"created":' '"2024-09-16T03:22:46.906117+0000",' '"modified":' '"2024-09-16T03:25:52.948673+0000",' '"last_up_change":' '"2024-09-16T03:25:08.513363+0000",' '"last_in_change":' '"2024-09-16T03:25:09.839444+0000",' '"flags":' '"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit",' '"flags_num":' 5799936, '"flags_set":' '[' '"pglog_hardlimit",' '"purged_snapdirs",' '"recovery_deletes",' '"sortbitwise"' '],' '"crush_version":' 7, '"full_ratio":' 0.97000002861022949, '"backfillfull_ratio":' 0.97000002861022949, '"nearfull_ratio":' 0.85000002384185791, '"cluster_snapshot":' '"",' '"pool_max":' 2, '"max_osd":' 3, '"require_min_compat_client":' '"luminous",' '"min_compat_client":' '"jewel",' '"require_osd_release":' '"squid",' '"allow_crimson":' false, '"pools":' '[' '{' '"pool":' 1, '"pool_name":' '"foo",' '"create_time":' '"2024-09-16T03:24:44.525189+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"30",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.8700000047683716, '"score_stable":' 1.8700000047683716, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1.25, '"raw_score_stable":' 1.25, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '},' '{' '"pool":' 2, '"pool_name":' '"bar",' '"create_time":' '"2024-09-16T03:24:46.226575+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"32",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.4900000095367432, '"score_stable":' 1.4900000095367432, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1, '"raw_score_stable":' 1, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '}' '],' '"osds":' '[' '{' '"osd":' 0, '"uuid":' '"64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 5, '"up_thru":' 33, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6802",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6803",' '"nonce":' 3375787448 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6804",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6805",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6808",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6809",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6806",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6807",' '"nonce":' 3375787448 '}' ']' '},' '"public_addr":' '"127.0.0.1:6803/3375787448",' '"cluster_addr":' '"127.0.0.1:6805/3375787448",' '"heartbeat_back_addr":' '"127.0.0.1:6809/3375787448",' '"heartbeat_front_addr":' '"127.0.0.1:6807/3375787448",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 1, '"uuid":' '"74b26727-75c9-444d-8782-719e4197a382",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 10, '"up_thru":' 33, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6810",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6811",' '"nonce":' 3733255132 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6812",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6813",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6816",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6817",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6814",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6815",' '"nonce":' 3733255132 '}' ']' '},' '"public_addr":' '"127.0.0.1:6811/3733255132",' '"cluster_addr":' '"127.0.0.1:6813/3733255132",' '"heartbeat_back_addr":' '"127.0.0.1:6817/3733255132",' '"heartbeat_front_addr":' '"127.0.0.1:6815/3733255132",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 2, '"uuid":' '"143da3a7-dad9-4b1e-966b-76cf5bdd3c82",' '"up":' 0, '"in":' 0, '"weight":' 0, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 15, '"up_thru":' 21, '"down_at":' 33, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6818",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6819",' '"nonce":' 963814857 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6820",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6821",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6824",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6825",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6822",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6823",' '"nonce":' 963814857 '}' ']' '},' '"public_addr":' '"127.0.0.1:6819/963814857",' '"cluster_addr":' '"127.0.0.1:6821/963814857",' '"heartbeat_back_addr":' '"127.0.0.1:6825/963814857",' '"heartbeat_front_addr":' '"127.0.0.1:6823/963814857",' '"state":' '[' '"exists"' ']' '}' '],' '"osd_xinfo":' '[' '{' '"osd":' 0, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:22.481942+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 1, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:59.663703+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 2, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 65536, '"last_purged_snaps_scrub":' '"2024-09-16T03:24:37.320822+0000",' '"dead_epoch":' 32 '}' '],' '"pg_upmap":' '[],' '"pg_upmap_items":' '[],' '"pg_upmap_primaries":' '[],' '"pg_temp":' '[],' '"primary_temp":' '[],' '"blocklist":' '{},' '"range_blocklist":' '{},' '"erasure_code_profiles":' '{' '"default":' '{' '"k":' '"2",' '"m":' '"2",' '"plugin":' '"jerasure",' '"technique":' '"reed_sol_van"' '}' '},' '"removed_snaps_queue":' '[],' '"new_removed_snaps":' '[],' '"new_purged_snaps":' '[],' '"crush_node_flags":' '{},' '"device_class_flags":' '{},' '"stretch_mode":' '{' '"stretch_mode_enabled":' false, '"stretch_bucket_count":' 0, '"degraded_stretch_mode":' 0, '"recovering_stretch_mode":' 0, '"stretch_mode_bucket":' 0 '}' '},' '"osd_metadata":' '[' '{' '"id":' 0, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/0/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:22:53.662571Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]",' '"hb_front_addr":' '"[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/0",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 1, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/1/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:23:30.129885Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]",' '"hb_front_addr":' '"[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/1",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 2, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/2/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:24:07.764502Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]",' '"hb_front_addr":' '"[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/2",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '}' '],' '"osdmap_clean_epochs":' '{' '"min_last_epoch_clean":' 28, '"last_epoch_clean":' '{' '"per_pool":' '[' '{' '"poolid":' 1, '"floor":' 28 '},' '{' '"poolid":' 2, '"floor":' 28 '}' ']' '},' '"osd_epochs":' '[' '{' '"id":' 0, '"epoch":' 78 '},' '{' '"id":' 1, '"epoch":' 80 '}' ']' '},' '"osdmap_first_committed":' 28, '"osdmap_last_committed":' 80, '"crushmap":' '{' '"devices":' '[' '{' '"id":' 0, '"name":' '"osd.0",' '"class":' '"hdd"' '},' '{' '"id":' 1, '"name":' '"osd.1",' '"class":' '"hdd"' '},' '{' '"id":' 2, '"name":' '"osd.2",' '"class":' '"hdd"' '}' '],' '"types":' '[' '{' '"type_id":' 0, '"name":' '"osd"' '},' '{' '"type_id":' 1, '"name":' '"host"' '},' '{' '"type_id":' 2, '"name":' '"chassis"' '},' '{' '"type_id":' 3, '"name":' '"rack"' '},' '{' '"type_id":' 4, '"name":' '"row"' '},' '{' '"type_id":' 5, '"name":' '"pdu"' '},' '{' '"type_id":' 6, '"name":' '"pod"' '},' '{' '"type_id":' 7, '"name":' '"room"' '},' '{' '"type_id":' 8, '"name":' '"datacenter"' '},' '{' '"type_id":' 9, '"name":' '"zone"' '},' '{' '"type_id":' 10, '"name":' '"region"' '},' '{' '"type_id":' 11, '"name":' '"root"' '}' '],' '"buckets":' '[' '{' '"id":' -1, '"name":' '"default",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -3, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -2, '"name":' '"default~hdd",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -4, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -3, '"name":' '"smithi096",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '},' '{' '"id":' -4, '"name":' '"smithi096~hdd",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '}' '],' '"rules":' '[' '{' '"rule_id":' 0, '"rule_name":' '"replicated_rule",' '"type":' 1, '"steps":' '[' '{' '"op":' '"take",' '"item":' -1, '"item_name":' '"default"' '},' '{' '"op":' '"choose_firstn",' '"num":' 0, '"type":' '"osd"' '},' '{' '"op":' '"emit"' '}' ']' '}' '],' '"tunables":' '{' '"choose_local_tries":' 0, '"choose_local_fallback_tries":' 0, '"choose_total_tries":' 50, '"chooseleaf_descend_once":' 1, '"chooseleaf_vary_r":' 1, '"chooseleaf_stable":' 1, '"msr_descents":' 100, '"msr_collision_tries":' 100, '"straw_calc_version":' 1, '"allowed_bucket_algs":' 54, '"profile":' '"jewel",' '"optimal_tunables":' 1, '"legacy_tunables":' 0, '"minimum_required_version":' '"jewel",' '"require_feature_tunables":' 1, '"require_feature_tunables2":' 1, '"has_v2_rules":' 0, '"require_feature_tunables3":' 1, '"has_v3_rules":' 0, '"has_v4_buckets":' 1, '"require_feature_tunables5":' 1, '"has_v5_rules":' 0, '"has_msr_rules":' 0 '},' '"choose_args":' '{}' '},' '"fsmap":' '{' '"epoch":' 1, '"btime":' '"2024-09-16T03:22:46:882186+0000",' '"default_fscid":' -1, '"compat":' '{' '"compat":' '{},' '"ro_compat":' '{},' '"incompat":' '{' '"feature_1":' '"base' 'v0.20",' '"feature_2":' '"client' writeable 'ranges",' '"feature_3":' '"default' file layouts on 'dirs",' '"feature_4":' '"dir' inode in separate 'object",' '"feature_5":' '"mds' uses versioned 'encoding",' '"feature_6":' '"dirfrag' is stored in 'omap",' '"feature_8":' '"no' anchor 'table",' '"feature_9":' '"file' layout 'v2",' '"feature_10":' '"snaprealm' 'v2",' '"feature_11":' '"minor' log 'segments",' '"feature_12":' '"quiesce' 'subvolumes"' '}' '},' '"feature_flags":' '{' '"enable_multiple":' true, '"ever_enabled_multiple":' true '},' '"standbys":' '[],' '"filesystems":' '[]' '},' '"mdsmap_first_committed":' 1, '"mdsmap_last_committed":' 1, '"auth":' '{' '"first_committed":' 1, '"last_committed":' 5, '"num_secrets":' 3 '},' '"num_pg":' 64, '"num_pg_active":' 64, '"num_pg_unknown":' 0, '"num_osd":' 3, '"pool_sum":' '{' '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 128, '"acting":' 128, '"num_store_stats":' 0 '},' '"osd_sum":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54560, '"kb_used_data":' 832, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660640, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692495360, '"internally_reserved":' 0, '"allocated":' 851968, '"data_stored":' 318404, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 256, '"apply_latency_ms":' 256, '"commit_latency_ns":' 256000000, '"apply_latency_ns":' 256000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '},' '"osd_sum_by_class":' '{' '"hdd":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54560, '"kb_used_data":' 832, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660640, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692495360, '"internally_reserved":' 0, '"allocated":' 851968, '"data_stored":' 318404, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 256, '"apply_latency_ms":' 256, '"commit_latency_ns":' 256000000, '"apply_latency_ns":' 256000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '}' '},' '"pool_stats":' '[' '{' '"poolid":' 2, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '},' '{' '"poolid":' 1, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '}' '],' '"osd_stats":' '[' '{' '"osd":' 0, '"seq":' 21474836517 '},' '{' '"osd":' 1, '"seq":' 42949672988 '},' '{' '"osd":' 2, '"seq":' 0 '}' '],' '"num_pg_by_state":' '[' '{' '"state":' '"active+undersized",' '"num":' 64 '}' '],' '"num_pg_by_osd":' '[' '{' '"osd":' 2, '"num_primary_pg":' 0, '"num_acting_pg":' 0, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 0, '"num_primary_pg":' 28, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 1, '"num_primary_pg":' 36, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '}' '],' '"purged_snaps":' '[' '{' '"pool":' 1, '"purged_snaps":' '{}' '},' '{' '"pool":' 2, '"purged_snaps":' '{}' '}' '],' '"servicemap":' '{' '"epoch":' 5, '"modified":' '"2024-09-16T03:25:38.422788+0000",' '"services":' '{}' '},' '"mgrstat_first_committed":' 77, '"mgrstat_last_committed":' 83, '"logm_first_committed":' 1, '"logm_last_committed":' 365, '"paxos":' '{' '"first_committed":' 1, '"last_committed":' 544, '"last_pn":' 0, '"accepted_pn":' 0 '}' '}' 2024-09-16T03:25:56.525 INFO:tasks.workunit.client.0.smithi096.stdout:{ "cluster_fingerprint": "fda2fc64-07ed-4add-8224-2e527e11d427", "version": "19.3.0-4930-gfc3e0bff", "commit": "fc3e0bff7468fd55478adbae7f75508b749124b6", "timestamp": "2024-09-16T03:25:56.404611+0000", "tag": "", "health": { "status": "HEALTH_OK", "checks": {}, "mutes": [] }, "monmap_first_committed": 1, "monmap_last_committed": 1, "monmap": { "epoch": 1, "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", "modified": "2024-09-16T03:22:45.872880Z", "created": "2024-09-16T03:22:45.872880Z", "min_mon_release": 19, "min_mon_release_name": "squid", "election_strategy": 1, "disallowed_leaders: ": "", "stretch_mode": false, "tiebreaker_mon": "", "removed_ranks: ": "", "features": { "persistent": [ "kraken", "luminous", "mimic", "osdmap-prune", "nautilus", "octopus", "pacific", "elector-pinging", "quincy", "reef", "squid" ], "optional": [] }, "mons": [ { "rank": 0, "name": "a", "public_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:7302", "nonce": 0 } ] }, "addr": "127.0.0.1:7302/0", "public_addr": "127.0.0.1:7302/0", "priority": 0, "weight": 0, "crush_location": "{}" } ] }, "quorum": [ 0 ], "osdmap": { "epoch": 80, "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", "created": "2024-09-16T03:22:46.906117+0000", "modified": "2024-09-16T03:25:52.948673+0000", "last_up_change": "2024-09-16T03:25:08.513363+0000", "last_in_change": "2024-09-16T03:25:09.839444+0000", "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", "flags_num": 5799936, "flags_set": [ "pglog_hardlimit", "purged_snapdirs", "recovery_deletes", "sortbitwise" ], "crush_version": 7, "full_ratio": 0.97000002861022949, "backfillfull_ratio": 0.97000002861022949, "nearfull_ratio": 0.85000002384185791, "cluster_snapshot": "", "pool_max": 2, "max_osd": 3, "require_min_compat_client": "luminous", "min_compat_client": "jewel", "require_osd_release": "squid", "allow_crimson": false, "pools": [ { "pool": 1, "pool_name": "foo", "create_time": "2024-09-16T03:24:44.525189+0000", "flags": 1, "flags_names": "hashpspool", "type": 1, "size": 3, "min_size": 2, "crush_rule": 0, "peering_crush_bucket_count": 0, "peering_crush_bucket_target": 0, "peering_crush_bucket_barrier": 0, "peering_crush_bucket_mandatory_member": 2147483647, "is_stretch_pool": false, "object_hash": 2, "pg_autoscale_mode": "off", "pg_num": 32, "pg_placement_num": 32, "pg_placement_num_target": 32, "pg_num_target": 32, "pg_num_pending": 32, "last_pg_merge_meta": { "source_pgid": "0.0", "ready_epoch": 0, "last_epoch_started": 0, "last_epoch_clean": 0, "source_version": "0'0", "target_version": "0'0" }, "last_change": "30", "last_force_op_resend": "0", "last_force_op_resend_prenautilus": "0", "last_force_op_resend_preluminous": "0", "auid": 0, "snap_mode": "selfmanaged", "snap_seq": 0, "snap_epoch": 0, "pool_snaps": [], "removed_snaps": "[]", "quota_max_bytes": 0, "quota_max_objects": 0, "tiers": [], "tier_of": -1, "read_tier": -1, "write_tier": -1, "cache_mode": "none", "target_max_bytes": 0, "target_max_objects": 0, "cache_target_dirty_ratio_micro": 400000, "cache_target_dirty_high_ratio_micro": 600000, "cache_target_full_ratio_micro": 800000, "cache_min_flush_age": 0, "cache_min_evict_age": 0, "erasure_code_profile": "", "hit_set_params": { "type": "none" }, "hit_set_period": 0, "hit_set_count": 0, "use_gmt_hitset": true, "min_read_recency_for_promote": 0, "min_write_recency_for_promote": 0, "hit_set_grade_decay_rate": 0, "hit_set_search_last_n": 0, "grade_table": [], "stripe_width": 0, "expected_num_objects": 0, "fast_read": false, "options": {}, "application_metadata": {}, "read_balance": { "score_type": "Fair distribution", "score_acting": 1.8700000047683716, "score_stable": 1.8700000047683716, "optimal_score": 0.67000001668930054, "raw_score_acting": 1.25, "raw_score_stable": 1.25, "primary_affinity_weighted": 1, "average_primary_affinity": 1, "average_primary_affinity_weighted": 1 } }, { "pool": 2, "pool_name": "bar", "create_time": "2024-09-16T03:24:46.226575+0000", "flags": 1, "flags_names": "hashpspool", "type": 1, "size": 3, "min_size": 2, "crush_rule": 0, "peering_crush_bucket_count": 0, "peering_crush_bucket_target": 0, "peering_crush_bucket_barrier": 0, "peering_crush_bucket_mandatory_member": 2147483647, "is_stretch_pool": false, "object_hash": 2, "pg_autoscale_mode": "off", "pg_num": 32, "pg_placement_num": 32, "pg_placement_num_target": 32, "pg_num_target": 32, "pg_num_pending": 32, "last_pg_merge_meta": { "source_pgid": "0.0", "ready_epoch": 0, "last_epoch_started": 0, "last_epoch_clean": 0, "source_version": "0'0", "target_version": "0'0" }, "last_change": "32", "last_force_op_resend": "0", "last_force_op_resend_prenautilus": "0", "last_force_op_resend_preluminous": "0", "auid": 0, "snap_mode": "selfmanaged", "snap_seq": 0, "snap_epoch": 0, "pool_snaps": [], "removed_snaps": "[]", "quota_max_bytes": 0, "quota_max_objects": 0, "tiers": [], "tier_of": -1, "read_tier": -1, "write_tier": -1, "cache_mode": "none", "target_max_bytes": 0, "target_max_objects": 0, "cache_target_dirty_ratio_micro": 400000, "cache_target_dirty_high_ratio_micro": 600000, "cache_target_full_ratio_micro": 800000, "cache_min_flush_age": 0, "cache_min_evict_age": 0, "erasure_code_profile": "", "hit_set_params": { "type": "none" }, "hit_set_period": 0, "hit_set_count": 0, "use_gmt_hitset": true, "min_read_recency_for_promote": 0, "min_write_recency_for_promote": 0, "hit_set_grade_decay_rate": 0, "hit_set_search_last_n": 0, "grade_table": [], "stripe_width": 0, "expected_num_objects": 0, "fast_read": false, "options": {}, "application_metadata": {}, "read_balance": { "score_type": "Fair distribution", "score_acting": 1.4900000095367432, "score_stable": 1.4900000095367432, "optimal_score": 0.67000001668930054, "raw_score_acting": 1, "raw_score_stable": 1, "primary_affinity_weighted": 1, "average_primary_affinity": 1, "average_primary_affinity_weighted": 1 } } ], "osds": [ { "osd": 0, "uuid": "64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6", "up": 1, "in": 1, "weight": 1, "primary_affinity": 1, "last_clean_begin": 0, "last_clean_end": 0, "up_from": 5, "up_thru": 33, "down_at": 0, "lost_at": 0, "public_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6802", "nonce": 3375787448 }, { "type": "v1", "addr": "127.0.0.1:6803", "nonce": 3375787448 } ] }, "cluster_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6804", "nonce": 3375787448 }, { "type": "v1", "addr": "127.0.0.1:6805", "nonce": 3375787448 } ] }, "heartbeat_back_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6808", "nonce": 3375787448 }, { "type": "v1", "addr": "127.0.0.1:6809", "nonce": 3375787448 } ] }, "heartbeat_front_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6806", "nonce": 3375787448 }, { "type": "v1", "addr": "127.0.0.1:6807", "nonce": 3375787448 } ] }, "public_addr": "127.0.0.1:6803/3375787448", "cluster_addr": "127.0.0.1:6805/3375787448", "heartbeat_back_addr": "127.0.0.1:6809/3375787448", "heartbeat_front_addr": "127.0.0.1:6807/3375787448", "state": [ "exists", "up" ] }, { "osd": 1, "uuid": "74b26727-75c9-444d-8782-719e4197a382", "up": 1, "in": 1, "weight": 1, "primary_affinity": 1, "last_clean_begin": 0, "last_clean_end": 0, "up_from": 10, "up_thru": 33, "down_at": 0, "lost_at": 0, "public_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6810", "nonce": 3733255132 }, { "type": "v1", "addr": "127.0.0.1:6811", "nonce": 3733255132 } ] }, "cluster_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6812", "nonce": 3733255132 }, { "type": "v1", "addr": "127.0.0.1:6813", "nonce": 3733255132 } ] }, "heartbeat_back_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6816", "nonce": 3733255132 }, { "type": "v1", "addr": "127.0.0.1:6817", "nonce": 3733255132 } ] }, "heartbeat_front_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6814", "nonce": 3733255132 }, { "type": "v1", "addr": "127.0.0.1:6815", "nonce": 3733255132 } ] }, "public_addr": "127.0.0.1:6811/3733255132", "cluster_addr": "127.0.0.1:6813/3733255132", "heartbeat_back_addr": "127.0.0.1:6817/3733255132", "heartbeat_front_addr": "127.0.0.1:6815/3733255132", "state": [ "exists", "up" ] }, { "osd": 2, "uuid": "143da3a7-dad9-4b1e-966b-76cf5bdd3c82", "up": 0, "in": 0, "weight": 0, "primary_affinity": 1, "last_clean_begin": 0, "last_clean_end": 0, "up_from": 15, "up_thru": 21, "down_at": 33, "lost_at": 0, "public_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6818", "nonce": 963814857 }, { "type": "v1", "addr": "127.0.0.1:6819", "nonce": 963814857 } ] }, "cluster_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6820", "nonce": 963814857 }, { "type": "v1", "addr": "127.0.0.1:6821", "nonce": 963814857 } ] }, "heartbeat_back_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6824", "nonce": 963814857 }, { "type": "v1", "addr": "127.0.0.1:6825", "nonce": 963814857 } ] }, "heartbeat_front_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6822", "nonce": 963814857 }, { "type": "v1", "addr": "127.0.0.1:6823", "nonce": 963814857 } ] }, "public_addr": "127.0.0.1:6819/963814857", "cluster_addr": "127.0.0.1:6821/963814857", "heartbeat_back_addr": "127.0.0.1:6825/963814857", "heartbeat_front_addr": "127.0.0.1:6823/963814857", "state": [ "exists" ] } ], "osd_xinfo": [ { "osd": 0, "down_stamp": "0.000000", "laggy_probability": 0, "laggy_interval": 0, "features": 4540719139924082687, "old_weight": 0, "last_purged_snaps_scrub": "2024-09-16T03:23:22.481942+0000", "dead_epoch": 0 }, { "osd": 1, "down_stamp": "0.000000", "laggy_probability": 0, "laggy_interval": 0, "features": 4540719139924082687, "old_weight": 0, "last_purged_snaps_scrub": "2024-09-16T03:23:59.663703+0000", "dead_epoch": 0 }, { "osd": 2, "down_stamp": "0.000000", "laggy_probability": 0, "laggy_interval": 0, "features": 4540719139924082687, "old_weight": 65536, "last_purged_snaps_scrub": "2024-09-16T03:24:37.320822+0000", "dead_epoch": 32 } ], "pg_upmap": [], "pg_upmap_items": [], "pg_upmap_primaries": [], "pg_temp": [], "primary_temp": [], "blocklist": {}, "range_blocklist": {}, "erasure_code_profiles": { "default": { "k": "2", "m": "2", "plugin": "jerasure", "technique": "reed_sol_van" } }, "removed_snaps_queue": [], "new_removed_snaps": [], "new_purged_snaps": [], "crush_node_flags": {}, "device_class_flags": {}, "stretch_mode": { "stretch_mode_enabled": false, "stretch_bucket_count": 0, "degraded_stretch_mode": 0, "recovering_stretch_mode": 0, "stretch_mode_bucket": 0 } }, "osd_metadata": [ { "id": 0, "arch": "x86_64", "back_addr": "[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]", "back_iface": "", "bluefs": "1", "bluefs_dedicated_db": "0", "bluefs_dedicated_wal": "0", "bluefs_single_shared_device": "1", "bluestore_allocation_from_file": "0", "bluestore_bdev_access_mode": "file", "bluestore_bdev_block_size": "4096", "bluestore_bdev_devices": "sda", "bluestore_bdev_driver": "KernelDevice", "bluestore_bdev_optimal_io_size": "0", "bluestore_bdev_path": "td/mon-last-clean-epoch/0/block", "bluestore_bdev_rotational": "1", "bluestore_bdev_size": "107374182400", "bluestore_bdev_support_discard": "0", "bluestore_bdev_type": "hdd", "bluestore_min_alloc_size": "4096", "ceph_release": "squid", "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", "ceph_version_short": "19.3.0-4930-gfc3e0bff", "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", "created_at": "2024-09-16T03:22:53.662571Z", "default_device_class": "hdd", "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", "devices": "sda", "distro": "ubuntu", "distro_description": "Ubuntu 22.04.1 LTS", "distro_version": "22.04", "front_addr": "[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]", "front_iface": "", "hb_back_addr": "[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]", "hb_front_addr": "[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]", "hostname": "smithi096", "journal_rotational": "1", "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", "kernel_version": "5.15.0-121-generic", "mem_swap_kb": "2097148", "mem_total_kb": "32746824", "network_numa_unknown_ifaces": "back_iface,front_iface", "objectstore_numa_unknown_devices": "sda", "os": "Linux", "osd_data": "td/mon-last-clean-epoch/0", "osd_objectstore": "bluestore", "osdspec_affinity": "", "rotational": "1" }, { "id": 1, "arch": "x86_64", "back_addr": "[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]", "back_iface": "", "bluefs": "1", "bluefs_dedicated_db": "0", "bluefs_dedicated_wal": "0", "bluefs_single_shared_device": "1", "bluestore_allocation_from_file": "0", "bluestore_bdev_access_mode": "file", "bluestore_bdev_block_size": "4096", "bluestore_bdev_devices": "sda", "bluestore_bdev_driver": "KernelDevice", "bluestore_bdev_optimal_io_size": "0", "bluestore_bdev_path": "td/mon-last-clean-epoch/1/block", "bluestore_bdev_rotational": "1", "bluestore_bdev_size": "107374182400", "bluestore_bdev_support_discard": "0", "bluestore_bdev_type": "hdd", "bluestore_min_alloc_size": "4096", "ceph_release": "squid", "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", "ceph_version_short": "19.3.0-4930-gfc3e0bff", "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", "created_at": "2024-09-16T03:23:30.129885Z", "default_device_class": "hdd", "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", "devices": "sda", "distro": "ubuntu", "distro_description": "Ubuntu 22.04.1 LTS", "distro_version": "22.04", "front_addr": "[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]", "front_iface": "", "hb_back_addr": "[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]", "hb_front_addr": "[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]", "hostname": "smithi096", "journal_rotational": "1", "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", "kernel_version": "5.15.0-121-generic", "mem_swap_kb": "2097148", "mem_total_kb": "32746824", "network_numa_unknown_ifaces": "back_iface,front_iface", "objectstore_numa_unknown_devices": "sda", "os": "Linux", "osd_data": "td/mon-last-clean-epoch/1", "osd_objectstore": "bluestore", "osdspec_affinity": "", "rotational": "1" }, { "id": 2, "arch": "x86_64", "back_addr": "[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]", "back_iface": "", "bluefs": "1", "bluefs_dedicated_db": "0", "bluefs_dedicated_wal": "0", "bluefs_single_shared_device": "1", "bluestore_allocation_from_file": "0", "bluestore_bdev_access_mode": "file", "bluestore_bdev_block_size": "4096", "bluestore_bdev_devices": "sda", "bluestore_bdev_driver": "KernelDevice", "bluestore_bdev_optimal_io_size": "0", "bluestore_bdev_path": "td/mon-last-clean-epoch/2/block", "bluestore_bdev_rotational": "1", "bluestore_bdev_size": "107374182400", "bluestore_bdev_support_discard": "0", "bluestore_bdev_type": "hdd", "bluestore_min_alloc_size": "4096", "ceph_release": "squid", "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", "ceph_version_short": "19.3.0-4930-gfc3e0bff", "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", "created_at": "2024-09-16T03:24:07.764502Z", "default_device_class": "hdd", "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", "devices": "sda", "distro": "ubuntu", "distro_description": "Ubuntu 22.04.1 LTS", "distro_version": "22.04", "front_addr": "[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]", "front_iface": "", "hb_back_addr": "[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]", "hb_front_addr": "[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]", "hostname": "smithi096", "journal_rotational": "1", "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", "kernel_version": "5.15.0-121-generic", "mem_swap_kb": "2097148", "mem_total_kb": "32746824", "network_numa_unknown_ifaces": "back_iface,front_iface", "objectstore_numa_unknown_devices": "sda", "os": "Linux", "osd_data": "td/mon-last-clean-epoch/2", "osd_objectstore": "bluestore", "osdspec_affinity": "", "rotational": "1" } ], "osdmap_clean_epochs": { "min_last_epoch_clean": 28, "last_epoch_clean": { "per_pool": [ { "poolid": 1, "floor": 28 }, { "poolid": 2, "floor": 28 } ] }, "osd_epochs": [ { "id": 0, "epoch": 78 }, { "id": 1, "epoch": 80 } ] }, "osdmap_first_committed": 28, "osdmap_last_committed": 80, "crushmap": { "devices": [ { "id": 0, "name": "osd.0", "class": "hdd" }, { "id": 1, "name": "osd.1", "class": "hdd" }, { "id": 2, "name": "osd.2", "class": "hdd" } ], "types": [ { "type_id": 0, "name": "osd" }, { "type_id": 1, "name": "host" }, { "type_id": 2, "name": "chassis" }, { "type_id": 3, "name": "rack" }, { "type_id": 4, "name": "row" }, { "type_id": 5, "name": "pdu" }, { "type_id": 6, "name": "pod" }, { "type_id": 7, "name": "room" }, { "type_id": 8, "name": "datacenter" }, { "type_id": 9, "name": "zone" }, { "type_id": 10, "name": "region" }, { "type_id": 11, "name": "root" } ], "buckets": [ { "id": -1, "name": "default", "type_id": 11, "type_name": "root", "weight": 19206, "alg": "straw2", "hash": "rjenkins1", "items": [ { "id": -3, "weight": 19206, "pos": 0 } ] }, { "id": -2, "name": "default~hdd", "type_id": 11, "type_name": "root", "weight": 19206, "alg": "straw2", "hash": "rjenkins1", "items": [ { "id": -4, "weight": 19206, "pos": 0 } ] }, { "id": -3, "name": "smithi096", "type_id": 1, "type_name": "host", "weight": 19206, "alg": "straw2", "hash": "rjenkins1", "items": [ { "id": 0, "weight": 6402, "pos": 0 }, { "id": 1, "weight": 6402, "pos": 1 }, { "id": 2, "weight": 6402, "pos": 2 } ] }, { "id": -4, "name": "smithi096~hdd", "type_id": 1, "type_name": "host", "weight": 19206, "alg": "straw2", "hash": "rjenkins1", "items": [ { "id": 0, "weight": 6402, "pos": 0 }, { "id": 1, "weight": 6402, "pos": 1 }, { "id": 2, "weight": 6402, "pos": 2 } ] } ], "rules": [ { "rule_id": 0, "rule_name": "replicated_rule", "type": 1, "steps": [ { "op": "take", "item": -1, "item_name": "default" }, { "op": "choose_firstn", "num": 0, "type": "osd" }, { "op": "emit" } ] } ], "tunables": { "choose_local_tries": 0, "choose_local_fallback_tries": 0, "choose_total_tries": 50, "chooseleaf_descend_once": 1, "chooseleaf_vary_r": 1, "chooseleaf_stable": 1, "msr_descents": 100, "msr_collision_tries": 100, "straw_calc_version": 1, "allowed_bucket_algs": 54, "profile": "jewel", "optimal_tunables": 1, "legacy_tunables": 0, "minimum_required_version": "jewel", "require_feature_tunables": 1, "require_feature_tunables2": 1, "has_v2_rules": 0, "require_feature_tunables3": 1, "has_v3_rules": 0, "has_v4_buckets": 1, "require_feature_tunables5": 1, "has_v5_rules": 0, "has_msr_rules": 0 }, "choose_args": {} }, "fsmap": { "epoch": 1, "btime": "2024-09-16T03:22:46:882186+0000", "default_fscid": -1, "compat": { "compat": {}, "ro_compat": {}, "incompat": { "feature_1": "base v0.20", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes" } }, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "standbys": [], "filesystems": [] }, "mdsmap_first_committed": 1, "mdsmap_last_committed": 1, "auth": { "first_committed": 1, "last_committed": 5, "num_secrets": 3 }, "num_pg": 64, "num_pg_active": 64, "num_pg_unknown": 0, "num_osd": 3, "pool_sum": { "stat_sum": { "num_bytes": 0, "num_objects": 0, "num_object_clones": 0, "num_object_copies": 0, "num_objects_missing_on_primary": 0, "num_objects_missing": 0, "num_objects_degraded": 0, "num_objects_misplaced": 0, "num_objects_unfound": 0, "num_objects_dirty": 0, "num_whiteouts": 0, "num_read": 0, "num_read_kb": 0, "num_write": 0, "num_write_kb": 0, "num_scrub_errors": 0, "num_shallow_scrub_errors": 0, "num_deep_scrub_errors": 0, "num_objects_recovered": 0, "num_bytes_recovered": 0, "num_keys_recovered": 0, "num_objects_omap": 0, "num_objects_hit_set_archive": 0, "num_bytes_hit_set_archive": 0, "num_flush": 0, "num_flush_kb": 0, "num_evict": 0, "num_evict_kb": 0, "num_promote": 0, "num_flush_mode_high": 0, "num_flush_mode_low": 0, "num_evict_mode_some": 0, "num_evict_mode_full": 0, "num_objects_pinned": 0, "num_legacy_snapsets": 0, "num_large_omap_objects": 0, "num_objects_manifest": 0, "num_omap_bytes": 0, "num_omap_keys": 0, "num_objects_repaired": 0 }, "store_stats": { "total": 0, "available": 0, "internally_reserved": 0, "allocated": 0, "data_stored": 0, "data_compressed": 0, "data_compressed_allocated": 0, "data_compressed_original": 0, "omap_allocated": 0, "internal_metadata": 0 }, "log_size": 0, "ondisk_log_size": 0, "up": 128, "acting": 128, "num_store_stats": 0 }, "osd_sum": { "up_from": 0, "seq": 0, "num_pgs": 128, "num_osds": 2, "num_per_pool_osds": 2, "num_per_pool_omap_osds": 2, "kb": 209715200, "kb_used": 54560, "kb_used_data": 832, "kb_used_omap": 3, "kb_used_meta": 53628, "kb_avail": 209660640, "statfs": { "total": 214748364800, "available": 214692495360, "internally_reserved": 0, "allocated": 851968, "data_stored": 318404, "data_compressed": 0, "data_compressed_allocated": 0, "data_compressed_original": 0, "omap_allocated": 3190, "internal_metadata": 54915978 }, "hb_peers": [], "snap_trim_queue_len": 0, "num_snap_trimming": 0, "num_shards_repaired": 0, "op_queue_age_hist": { "histogram": [], "upper_bound": 1 }, "perf_stat": { "commit_latency_ms": 256, "apply_latency_ms": 256, "commit_latency_ns": 256000000, "apply_latency_ns": 256000000 }, "alerts": [], "network_ping_times": [] }, "osd_sum_by_class": { "hdd": { "up_from": 0, "seq": 0, "num_pgs": 128, "num_osds": 2, "num_per_pool_osds": 2, "num_per_pool_omap_osds": 2, "kb": 209715200, "kb_used": 54560, "kb_used_data": 832, "kb_used_omap": 3, "kb_used_meta": 53628, "kb_avail": 209660640, "statfs": { "total": 214748364800, "available": 214692495360, "internally_reserved": 0, "allocated": 851968, "data_stored": 318404, "data_compressed": 0, "data_compressed_allocated": 0, "data_compressed_original": 0, "omap_allocated": 3190, "internal_metadata": 54915978 }, "hb_peers": [], "snap_trim_queue_len": 0, "num_snap_trimming": 0, "num_shards_repaired": 0, "op_queue_age_hist": { "histogram": [], "upper_bound": 1 }, "perf_stat": { "commit_latency_ms": 256, "apply_latency_ms": 256, "commit_latency_ns": 256000000, "apply_latency_ns": 256000000 }, "alerts": [], "network_ping_times": [] } }, "pool_stats": [ { "poolid": 2, "num_pg": 32, "stat_sum": { "num_bytes": 0, "num_objects": 0, "num_object_clones": 0, "num_object_copies": 0, "num_objects_missing_on_primary": 0, "num_objects_missing": 0, "num_objects_degraded": 0, "num_objects_misplaced": 0, "num_objects_unfound": 0, "num_objects_dirty": 0, "num_whiteouts": 0, "num_read": 0, "num_read_kb": 0, "num_write": 0, "num_write_kb": 0, "num_scrub_errors": 0, "num_shallow_scrub_errors": 0, "num_deep_scrub_errors": 0, "num_objects_recovered": 0, "num_bytes_recovered": 0, "num_keys_recovered": 0, "num_objects_omap": 0, "num_objects_hit_set_archive": 0, "num_bytes_hit_set_archive": 0, "num_flush": 0, "num_flush_kb": 0, "num_evict": 0, "num_evict_kb": 0, "num_promote": 0, "num_flush_mode_high": 0, "num_flush_mode_low": 0, "num_evict_mode_some": 0, "num_evict_mode_full": 0, "num_objects_pinned": 0, "num_legacy_snapsets": 0, "num_large_omap_objects": 0, "num_objects_manifest": 0, "num_omap_bytes": 0, "num_omap_keys": 0, "num_objects_repaired": 0 }, "store_stats": { "total": 0, "available": 0, "internally_reserved": 0, "allocated": 0, "data_stored": 0, "data_compressed": 0, "data_compressed_allocated": 0, "data_compressed_original": 0, "omap_allocated": 0, "internal_metadata": 0 }, "log_size": 0, "ondisk_log_size": 0, "up": 64, "acting": 64, "num_store_stats": 3 }, { "poolid": 1, "num_pg": 32, "stat_sum": { "num_bytes": 0, "num_objects": 0, "num_object_clones": 0, "num_object_copies": 0, "num_objects_missing_on_primary": 0, "num_objects_missing": 0, "num_objects_degraded": 0, "num_objects_misplaced": 0, "num_objects_unfound": 0, "num_objects_dirty": 0, "num_whiteouts": 0, "num_read": 0, "num_read_kb": 0, "num_write": 0, "num_write_kb": 0, "num_scrub_errors": 0, "num_shallow_scrub_errors": 0, "num_deep_scrub_errors": 0, "num_objects_recovered": 0, "num_bytes_recovered": 0, "num_keys_recovered": 0, "num_objects_omap": 0, "num_objects_hit_set_archive": 0, "num_bytes_hit_set_archive": 0, "num_flush": 0, "num_flush_kb": 0, "num_evict": 0, "num_evict_kb": 0, "num_promote": 0, "num_flush_mode_high": 0, "num_flush_mode_low": 0, "num_evict_mode_some": 0, "num_evict_mode_full": 0, "num_objects_pinned": 0, "num_legacy_snapsets": 0, "num_large_omap_objects": 0, "num_objects_manifest": 0, "num_omap_bytes": 0, "num_omap_keys": 0, "num_objects_repaired": 0 }, "store_stats": { "total": 0, "available": 0, "internally_reserved": 0, "allocated": 0, "data_stored": 0, "data_compressed": 0, "data_compressed_allocated": 0, "data_compressed_original": 0, "omap_allocated": 0, "internal_metadata": 0 }, "log_size": 0, "ondisk_log_size": 0, "up": 64, "acting": 64, "num_store_stats": 3 } ], "osd_stats": [ { "osd": 0, "seq": 21474836517 }, { "osd": 1, "seq": 42949672988 }, { "osd": 2, "seq": 0 } ], "num_pg_by_state": [ { "state": "active+undersized", "num": 64 } ], "num_pg_by_osd": [ { "osd": 2, "num_primary_pg": 0, "num_acting_pg": 0, "num_up_not_acting_pg": 0 }, { "osd": 0, "num_primary_pg": 28, "num_acting_pg": 64, "num_up_not_acting_pg": 0 }, { "osd": 1, "num_primary_pg": 36, "num_acting_pg": 64, "num_up_not_acting_pg": 0 } ], "purged_snaps": [ { "pool": 1, "purged_snaps": {} }, { "pool": 2, "purged_snaps": {} } ], "servicemap": { "epoch": 5, "modified": "2024-09-16T03:25:38.422788+0000", "services": {} }, "mgrstat_first_committed": 77, "mgrstat_last_committed": 83, "logm_first_committed": 1, "logm_last_committed": 365, "paxos": { "first_committed": 1, "last_committed": 544, "last_pn": 0, "accepted_pn": 0 } } 2024-09-16T03:25:56.527 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:111: check_lec_honours_osd: return 1 2024-09-16T03:25:56.527 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:112: check_lec_honours_osd: [[ '' -ge 28 ]] 2024-09-16T03:25:56.527 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:112: check_lec_honours_osd: echo '{' '"cluster_fingerprint":' '"fda2fc64-07ed-4add-8224-2e527e11d427",' '"version":' '"19.3.0-4930-gfc3e0bff",' '"commit":' '"fc3e0bff7468fd55478adbae7f75508b749124b6",' '"timestamp":' '"2024-09-16T03:25:56.404611+0000",' '"tag":' '"",' '"health":' '{' '"status":' '"HEALTH_OK",' '"checks":' '{},' '"mutes":' '[]' '},' '"monmap_first_committed":' 1, '"monmap_last_committed":' 1, '"monmap":' '{' '"epoch":' 1, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"modified":' '"2024-09-16T03:22:45.872880Z",' '"created":' '"2024-09-16T03:22:45.872880Z",' '"min_mon_release":' 19, '"min_mon_release_name":' '"squid",' '"election_strategy":' 1, '"disallowed_leaders:' '":' '"",' '"stretch_mode":' false, '"tiebreaker_mon":' '"",' '"removed_ranks:' '":' '"",' '"features":' '{' '"persistent":' '[' '"kraken",' '"luminous",' '"mimic",' '"osdmap-prune",' '"nautilus",' '"octopus",' '"pacific",' '"elector-pinging",' '"quincy",' '"reef",' '"squid"' '],' '"optional":' '[]' '},' '"mons":' '[' '{' '"rank":' 0, '"name":' '"a",' '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:7302",' '"nonce":' 0 '}' ']' '},' '"addr":' '"127.0.0.1:7302/0",' '"public_addr":' '"127.0.0.1:7302/0",' '"priority":' 0, '"weight":' 0, '"crush_location":' '"{}"' '}' ']' '},' '"quorum":' '[' 0 '],' '"osdmap":' '{' '"epoch":' 80, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"created":' '"2024-09-16T03:22:46.906117+0000",' '"modified":' '"2024-09-16T03:25:52.948673+0000",' '"last_up_change":' '"2024-09-16T03:25:08.513363+0000",' '"last_in_change":' '"2024-09-16T03:25:09.839444+0000",' '"flags":' '"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit",' '"flags_num":' 5799936, '"flags_set":' '[' '"pglog_hardlimit",' '"purged_snapdirs",' '"recovery_deletes",' '"sortbitwise"' '],' '"crush_version":' 7, '"full_ratio":' 0.97000002861022949, '"backfillfull_ratio":' 0.97000002861022949, '"nearfull_ratio":' 0.85000002384185791, '"cluster_snapshot":' '"",' '"pool_max":' 2, '"max_osd":' 3, '"require_min_compat_client":' '"luminous",' '"min_compat_client":' '"jewel",' '"require_osd_release":' '"squid",' '"allow_crimson":' false, '"pools":' '[' '{' '"pool":' 1, '"pool_name":' '"foo",' '"create_time":' '"2024-09-16T03:24:44.525189+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"30",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.8700000047683716, '"score_stable":' 1.8700000047683716, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1.25, '"raw_score_stable":' 1.25, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '},' '{' '"pool":' 2, '"pool_name":' '"bar",' '"create_time":' '"2024-09-16T03:24:46.226575+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"32",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.4900000095367432, '"score_stable":' 1.4900000095367432, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1, '"raw_score_stable":' 1, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '}' '],' '"osds":' '[' '{' '"osd":' 0, '"uuid":' '"64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 5, '"up_thru":' 33, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6802",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6803",' '"nonce":' 3375787448 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6804",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6805",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6808",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6809",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6806",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6807",' '"nonce":' 3375787448 '}' ']' '},' '"public_addr":' '"127.0.0.1:6803/3375787448",' '"cluster_addr":' '"127.0.0.1:6805/3375787448",' '"heartbeat_back_addr":' '"127.0.0.1:6809/3375787448",' '"heartbeat_front_addr":' '"127.0.0.1:6807/3375787448",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 1, '"uuid":' '"74b26727-75c9-444d-8782-719e4197a382",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 10, '"up_thru":' 33, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6810",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6811",' '"nonce":' 3733255132 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6812",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6813",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6816",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6817",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6814",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6815",' '"nonce":' 3733255132 '}' ']' '},' '"public_addr":' '"127.0.0.1:6811/3733255132",' '"cluster_addr":' '"127.0.0.1:6813/3733255132",' '"heartbeat_back_addr":' '"127.0.0.1:6817/3733255132",' '"heartbeat_front_addr":' '"127.0.0.1:6815/3733255132",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 2, '"uuid":' '"143da3a7-dad9-4b1e-966b-76cf5bdd3c82",' '"up":' 0, '"in":' 0, '"weight":' 0, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 15, '"up_thru":' 21, '"down_at":' 33, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6818",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6819",' '"nonce":' 963814857 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6820",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6821",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6824",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6825",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6822",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6823",' '"nonce":' 963814857 '}' ']' '},' '"public_addr":' '"127.0.0.1:6819/963814857",' '"cluster_addr":' '"127.0.0.1:6821/963814857",' '"heartbeat_back_addr":' '"127.0.0.1:6825/963814857",' '"heartbeat_front_addr":' '"127.0.0.1:6823/963814857",' '"state":' '[' '"exists"' ']' '}' '],' '"osd_xinfo":' '[' '{' '"osd":' 0, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:22.481942+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 1, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:59.663703+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 2, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 65536, '"last_purged_snaps_scrub":' '"2024-09-16T03:24:37.320822+0000",' '"dead_epoch":' 32 '}' '],' '"pg_upmap":' '[],' '"pg_upmap_items":' '[],' '"pg_upmap_primaries":' '[],' '"pg_temp":' '[],' '"primary_temp":' '[],' '"blocklist":' '{},' '"range_blocklist":' '{},' '"erasure_code_profiles":' '{' '"default":' '{' '"k":' '"2",' '"m":' '"2",' '"plugin":' '"jerasure",' '"technique":' '"reed_sol_van"' '}' '},' '"removed_snaps_queue":' '[],' '"new_removed_snaps":' '[],' '"new_purged_snaps":' '[],' '"crush_node_flags":' '{},' '"device_class_flags":' '{},' '"stretch_mode":' '{' '"stretch_mode_enabled":' false, '"stretch_bucket_count":' 0, '"degraded_stretch_mode":' 0, '"recovering_stretch_mode":' 0, '"stretch_mode_bucket":' 0 '}' '},' '"osd_metadata":' '[' '{' '"id":' 0, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/0/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:22:53.662571Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]",' '"hb_front_addr":' '"[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/0",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 1, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/1/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:23:30.129885Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]",' '"hb_front_addr":' '"[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/1",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 2, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/2/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:24:07.764502Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]",' '"hb_front_addr":' '"[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/2",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '}' '],' '"osdmap_clean_epochs":' '{' '"min_last_epoch_clean":' 28, '"last_epoch_clean":' '{' '"per_pool":' '[' '{' '"poolid":' 1, '"floor":' 28 '},' '{' '"poolid":' 2, '"floor":' 28 '}' ']' '},' '"osd_epochs":' '[' '{' '"id":' 0, '"epoch":' 78 '},' '{' '"id":' 1, '"epoch":' 80 '}' ']' '},' '"osdmap_first_committed":' 28, '"osdmap_last_committed":' 80, '"crushmap":' '{' '"devices":' '[' '{' '"id":' 0, '"name":' '"osd.0",' '"class":' '"hdd"' '},' '{' '"id":' 1, '"name":' '"osd.1",' '"class":' '"hdd"' '},' '{' '"id":' 2, '"name":' '"osd.2",' '"class":' '"hdd"' '}' '],' '"types":' '[' '{' '"type_id":' 0, '"name":' '"osd"' '},' '{' '"type_id":' 1, '"name":' '"host"' '},' '{' '"type_id":' 2, '"name":' '"chassis"' '},' '{' '"type_id":' 3, '"name":' '"rack"' '},' '{' '"type_id":' 4, '"name":' '"row"' '},' '{' '"type_id":' 5, '"name":' '"pdu"' '},' '{' '"type_id":' 6, '"name":' '"pod"' '},' '{' '"type_id":' 7, '"name":' '"room"' '},' '{' '"type_id":' 8, '"name":' '"datacenter"' '},' '{' '"type_id":' 9, '"name":' '"zone"' '},' '{' '"type_id":' 10, '"name":' '"region"' '},' '{' '"type_id":' 11, '"name":' '"root"' '}' '],' '"buckets":' '[' '{' '"id":' -1, '"name":' '"default",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -3, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -2, '"name":' '"default~hdd",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -4, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -3, '"name":' '"smithi096",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '},' '{' '"id":' -4, '"name":' '"smithi096~hdd",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '}' '],' '"rules":' '[' '{' '"rule_id":' 0, '"rule_name":' '"replicated_rule",' '"type":' 1, '"steps":' '[' '{' '"op":' '"take",' '"item":' -1, '"item_name":' '"default"' '},' '{' '"op":' '"choose_firstn",' '"num":' 0, '"type":' '"osd"' '},' '{' '"op":' '"emit"' '}' ']' '}' '],' '"tunables":' '{' '"choose_local_tries":' 0, '"choose_local_fallback_tries":' 0, '"choose_total_tries":' 50, '"chooseleaf_descend_once":' 1, '"chooseleaf_vary_r":' 1, '"chooseleaf_stable":' 1, '"msr_descents":' 100, '"msr_collision_tries":' 100, '"straw_calc_version":' 1, '"allowed_bucket_algs":' 54, '"profile":' '"jewel",' '"optimal_tunables":' 1, '"legacy_tunables":' 0, '"minimum_required_version":' '"jewel",' '"require_feature_tunables":' 1, '"require_feature_tunables2":' 1, '"has_v2_rules":' 0, '"require_feature_tunables3":' 1, '"has_v3_rules":' 0, '"has_v4_buckets":' 1, '"require_feature_tunables5":' 1, '"has_v5_rules":' 0, '"has_msr_rules":' 0 '},' '"choose_args":' '{}' '},' '"fsmap":' '{' '"epoch":' 1, '"btime":' '"2024-09-16T03:22:46:882186+0000",' '"default_fscid":' -1, '"compat":' '{' '"compat":' '{},' '"ro_compat":' '{},' '"incompat":' '{' '"feature_1":' '"base' 'v0.20",' '"feature_2":' '"client' writeable 'ranges",' '"feature_3":' '"default' file layouts on 'dirs",' '"feature_4":' '"dir' inode in separate 'object",' '"feature_5":' '"mds' uses versioned 'encoding",' '"feature_6":' '"dirfrag' is stored in 'omap",' '"feature_8":' '"no' anchor 'table",' '"feature_9":' '"file' layout 'v2",' '"feature_10":' '"snaprealm' 'v2",' '"feature_11":' '"minor' log 'segments",' '"feature_12":' '"quiesce' 'subvolumes"' '}' '},' '"feature_flags":' '{' '"enable_multiple":' true, '"ever_enabled_multiple":' true '},' '"standbys":' '[],' '"filesystems":' '[]' '},' '"mdsmap_first_committed":' 1, '"mdsmap_last_committed":' 1, '"auth":' '{' '"first_committed":' 1, '"last_committed":' 5, '"num_secrets":' 3 '},' '"num_pg":' 64, '"num_pg_active":' 64, '"num_pg_unknown":' 0, '"num_osd":' 3, '"pool_sum":' '{' '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 128, '"acting":' 128, '"num_store_stats":' 0 '},' '"osd_sum":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54560, '"kb_used_data":' 832, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660640, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692495360, '"internally_reserved":' 0, '"allocated":' 851968, '"data_stored":' 318404, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 256, '"apply_latency_ms":' 256, '"commit_latency_ns":' 256000000, '"apply_latency_ns":' 256000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '},' '"osd_sum_by_class":' '{' '"hdd":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54560, '"kb_used_data":' 832, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660640, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692495360, '"internally_reserved":' 0, '"allocated":' 851968, '"data_stored":' 318404, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 256, '"apply_latency_ms":' 256, '"commit_latency_ns":' 256000000, '"apply_latency_ns":' 256000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '}' '},' '"pool_stats":' '[' '{' '"poolid":' 2, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '},' '{' '"poolid":' 1, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '}' '],' '"osd_stats":' '[' '{' '"osd":' 0, '"seq":' 21474836517 '},' '{' '"osd":' 1, '"seq":' 42949672988 '},' '{' '"osd":' 2, '"seq":' 0 '}' '],' '"num_pg_by_state":' '[' '{' '"state":' '"active+undersized",' '"num":' 64 '}' '],' '"num_pg_by_osd":' '[' '{' '"osd":' 2, '"num_primary_pg":' 0, '"num_acting_pg":' 0, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 0, '"num_primary_pg":' 28, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 1, '"num_primary_pg":' 36, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '}' '],' '"purged_snaps":' '[' '{' '"pool":' 1, '"purged_snaps":' '{}' '},' '{' '"pool":' 2, '"purged_snaps":' '{}' '}' '],' '"servicemap":' '{' '"epoch":' 5, '"modified":' '"2024-09-16T03:25:38.422788+0000",' '"services":' '{}' '},' '"mgrstat_first_committed":' 77, '"mgrstat_last_committed":' 83, '"logm_first_committed":' 1, '"logm_last_committed":' 365, '"paxos":' '{' '"first_committed":' 1, '"last_committed":' 544, '"last_pn":' 0, '"accepted_pn":' 0 '}' '}' 2024-09-16T03:25:56.528 INFO:tasks.workunit.client.0.smithi096.stdout:{ "cluster_fingerprint": "fda2fc64-07ed-4add-8224-2e527e11d427", "version": "19.3.0-4930-gfc3e0bff", "commit": "fc3e0bff7468fd55478adbae7f75508b749124b6", "timestamp": "2024-09-16T03:25:56.404611+0000", "tag": "", "health": { "status": "HEALTH_OK", "checks": {}, "mutes": [] }, "monmap_first_committed": 1, "monmap_last_committed": 1, "monmap": { "epoch": 1, "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", "modified": "2024-09-16T03:22:45.872880Z", "created": "2024-09-16T03:22:45.872880Z", "min_mon_release": 19, "min_mon_release_name": "squid", "election_strategy": 1, "disallowed_leaders: ": "", "stretch_mode": false, "tiebreaker_mon": "", "removed_ranks: ": "", "features": { "persistent": [ "kraken", "luminous", "mimic", "osdmap-prune", "nautilus", "octopus", "pacific", "elector-pinging", "quincy", "reef", "squid" ], "optional": [] }, "mons": [ { "rank": 0, "name": "a", "public_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:7302", "nonce": 0 } ] }, "addr": "127.0.0.1:7302/0", "public_addr": "127.0.0.1:7302/0", "priority": 0, "weight": 0, "crush_location": "{}" } ] }, "quorum": [ 0 ], "osdmap": { "epoch": 80, "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", "created": "2024-09-16T03:22:46.906117+0000", "modified": "2024-09-16T03:25:52.948673+0000", "last_up_change": "2024-09-16T03:25:08.513363+0000", "last_in_change": "2024-09-16T03:25:09.839444+0000", "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", "flags_num": 5799936, "flags_set": [ "pglog_hardlimit", "purged_snapdirs", "recovery_deletes", "sortbitwise" ], "crush_version": 7, "full_ratio": 0.97000002861022949, "backfillfull_ratio": 0.97000002861022949, "nearfull_ratio": 0.85000002384185791, "cluster_snapshot": "", "pool_max": 2, "max_osd": 3, "require_min_compat_client": "luminous", "min_compat_client": "jewel", "require_osd_release": "squid", "allow_crimson": false, "pools": [ { "pool": 1, "pool_name": "foo", "create_time": "2024-09-16T03:24:44.525189+0000", "flags": 1, "flags_names": "hashpspool", "type": 1, "size": 3, "min_size": 2, "crush_rule": 0, "peering_crush_bucket_count": 0, "peering_crush_bucket_target": 0, "peering_crush_bucket_barrier": 0, "peering_crush_bucket_mandatory_member": 2147483647, "is_stretch_pool": false, "object_hash": 2, "pg_autoscale_mode": "off", "pg_num": 32, "pg_placement_num": 32, "pg_placement_num_target": 32, "pg_num_target": 32, "pg_num_pending": 32, "last_pg_merge_meta": { "source_pgid": "0.0", "ready_epoch": 0, "last_epoch_started": 0, "last_epoch_clean": 0, "source_version": "0'0", "target_version": "0'0" }, "last_change": "30", "last_force_op_resend": "0", "last_force_op_resend_prenautilus": "0", "last_force_op_resend_preluminous": "0", "auid": 0, "snap_mode": "selfmanaged", "snap_seq": 0, "snap_epoch": 0, "pool_snaps": [], "removed_snaps": "[]", "quota_max_bytes": 0, "quota_max_objects": 0, "tiers": [], "tier_of": -1, "read_tier": -1, "write_tier": -1, "cache_mode": "none", "target_max_bytes": 0, "target_max_objects": 0, "cache_target_dirty_ratio_micro": 400000, "cache_target_dirty_high_ratio_micro": 600000, "cache_target_full_ratio_micro": 800000, "cache_min_flush_age": 0, "cache_min_evict_age": 0, "erasure_code_profile": "", "hit_set_params": { "type": "none" }, "hit_set_period": 0, "hit_set_count": 0, "use_gmt_hitset": true, "min_read_recency_for_promote": 0, "min_write_recency_for_promote": 0, "hit_set_grade_decay_rate": 0, "hit_set_search_last_n": 0, "grade_table": [], "stripe_width": 0, "expected_num_objects": 0, "fast_read": false, "options": {}, "application_metadata": {}, "read_balance": { "score_type": "Fair distribution", "score_acting": 1.8700000047683716, "score_stable": 1.8700000047683716, "optimal_score": 0.67000001668930054, "raw_score_acting": 1.25, "raw_score_stable": 1.25, "primary_affinity_weighted": 1, "average_primary_affinity": 1, "average_primary_affinity_weighted": 1 } }, { "pool": 2, "pool_name": "bar", "create_time": "2024-09-16T03:24:46.226575+0000", "flags": 1, "flags_names": "hashpspool", "type": 1, "size": 3, "min_size": 2, "crush_rule": 0, "peering_crush_bucket_count": 0, "peering_crush_bucket_target": 0, "peering_crush_bucket_barrier": 0, "peering_crush_bucket_mandatory_member": 2147483647, "is_stretch_pool": false, "object_hash": 2, "pg_autoscale_mode": "off", "pg_num": 32, "pg_placement_num": 32, "pg_placement_num_target": 32, "pg_num_target": 32, "pg_num_pending": 32, "last_pg_merge_meta": { "source_pgid": "0.0", "ready_epoch": 0, "last_epoch_started": 0, "last_epoch_clean": 0, "source_version": "0'0", "target_version": "0'0" }, "last_change": "32", "last_force_op_resend": "0", "last_force_op_resend_prenautilus": "0", "last_force_op_resend_preluminous": "0", "auid": 0, "snap_mode": "selfmanaged", "snap_seq": 0, "snap_epoch": 0, "pool_snaps": [], "removed_snaps": "[]", "quota_max_bytes": 0, "quota_max_objects": 0, "tiers": [], "tier_of": -1, "read_tier": -1, "write_tier": -1, "cache_mode": "none", "target_max_bytes": 0, "target_max_objects": 0, "cache_target_dirty_ratio_micro": 400000, "cache_target_dirty_high_ratio_micro": 600000, "cache_target_full_ratio_micro": 800000, "cache_min_flush_age": 0, "cache_min_evict_age": 0, "erasure_code_profile": "", "hit_set_params": { "type": "none" }, "hit_set_period": 0, "hit_set_count": 0, "use_gmt_hitset": true, "min_read_recency_for_promote": 0, "min_write_recency_for_promote": 0, "hit_set_grade_decay_rate": 0, "hit_set_search_last_n": 0, "grade_table": [], "stripe_width": 0, "expected_num_objects": 0, "fast_read": false, "options": {}, "application_metadata": {}, "read_balance": { "score_type": "Fair distribution", "score_acting": 1.4900000095367432, "score_stable": 1.4900000095367432, "optimal_score": 0.67000001668930054, "raw_score_acting": 1, "raw_score_stable": 1, "primary_affinity_weighted": 1, "average_primary_affinity": 1, "average_primary_affinity_weighted": 1 } } ], "osds": [ { "osd": 0, "uuid": "64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6", "up": 1, "in": 1, "weight": 1, "primary_affinity": 1, "last_clean_begin": 0, "last_clean_end": 0, "up_from": 5, "up_thru": 33, "down_at": 0, "lost_at": 0, "public_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6802", "nonce": 3375787448 }, { "type": "v1", "addr": "127.0.0.1:6803", "nonce": 3375787448 } ] }, "cluster_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6804", "nonce": 3375787448 }, { "type": "v1", "addr": "127.0.0.1:6805", "nonce": 3375787448 } ] }, "heartbeat_back_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6808", "nonce": 3375787448 }, { "type": "v1", "addr": "127.0.0.1:6809", "nonce": 3375787448 } ] }, "heartbeat_front_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6806", "nonce": 3375787448 }, { "type": "v1", "addr": "127.0.0.1:6807", "nonce": 3375787448 } ] }, "public_addr": "127.0.0.1:6803/3375787448", "cluster_addr": "127.0.0.1:6805/3375787448", "heartbeat_back_addr": "127.0.0.1:6809/3375787448", "heartbeat_front_addr": "127.0.0.1:6807/3375787448", "state": [ "exists", "up" ] }, { "osd": 1, "uuid": "74b26727-75c9-444d-8782-719e4197a382", "up": 1, "in": 1, "weight": 1, "primary_affinity": 1, "last_clean_begin": 0, "last_clean_end": 0, "up_from": 10, "up_thru": 33, "down_at": 0, "lost_at": 0, "public_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6810", "nonce": 3733255132 }, { "type": "v1", "addr": "127.0.0.1:6811", "nonce": 3733255132 } ] }, "cluster_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6812", "nonce": 3733255132 }, { "type": "v1", "addr": "127.0.0.1:6813", "nonce": 3733255132 } ] }, "heartbeat_back_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6816", "nonce": 3733255132 }, { "type": "v1", "addr": "127.0.0.1:6817", "nonce": 3733255132 } ] }, "heartbeat_front_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6814", "nonce": 3733255132 }, { "type": "v1", "addr": "127.0.0.1:6815", "nonce": 3733255132 } ] }, "public_addr": "127.0.0.1:6811/3733255132", "cluster_addr": "127.0.0.1:6813/3733255132", "heartbeat_back_addr": "127.0.0.1:6817/3733255132", "heartbeat_front_addr": "127.0.0.1:6815/3733255132", "state": [ "exists", "up" ] }, { "osd": 2, "uuid": "143da3a7-dad9-4b1e-966b-76cf5bdd3c82", "up": 0, "in": 0, "weight": 0, "primary_affinity": 1, "last_clean_begin": 0, "last_clean_end": 0, "up_from": 15, "up_thru": 21, "down_at": 33, "lost_at": 0, "public_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6818", "nonce": 963814857 }, { "type": "v1", "addr": "127.0.0.1:6819", "nonce": 963814857 } ] }, "cluster_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6820", "nonce": 963814857 }, { "type": "v1", "addr": "127.0.0.1:6821", "nonce": 963814857 } ] }, "heartbeat_back_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6824", "nonce": 963814857 }, { "type": "v1", "addr": "127.0.0.1:6825", "nonce": 963814857 } ] }, "heartbeat_front_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6822", "nonce": 963814857 }, { "type": "v1", "addr": "127.0.0.1:6823", "nonce": 963814857 } ] }, "public_addr": "127.0.0.1:6819/963814857", "cluster_addr": "127.0.0.1:6821/963814857", "heartbeat_back_addr": "127.0.0.1:6825/963814857", "heartbeat_front_addr": "127.0.0.1:6823/963814857", "state": [ "exists" ] } ], "osd_xinfo": [ { "osd": 0, "down_stamp": "0.000000", "laggy_probability": 0, "laggy_interval": 0, "features": 4540719139924082687, "old_weight": 0, "last_purged_snaps_scrub": "2024-09-16T03:23:22.481942+0000", "dead_epoch": 0 }, { "osd": 1, "down_stamp": "0.000000", "laggy_probability": 0, "laggy_interval": 0, "features": 4540719139924082687, "old_weight": 0, "last_purged_snaps_scrub": "2024-09-16T03:23:59.663703+0000", "dead_epoch": 0 }, { "osd": 2, "down_stamp": "0.000000", "laggy_probability": 0, "laggy_interval": 0, "features": 4540719139924082687, "old_weight": 65536, "last_purged_snaps_scrub": "2024-09-16T03:24:37.320822+0000", "dead_epoch": 32 } ], "pg_upmap": [], "pg_upmap_items": [], "pg_upmap_primaries": [], "pg_temp": [], "primary_temp": [], "blocklist": {}, "range_blocklist": {}, "erasure_code_profiles": { "default": { "k": "2", "m": "2", "plugin": "jerasure", "technique": "reed_sol_van" } }, "removed_snaps_queue": [], "new_removed_snaps": [], "new_purged_snaps": [], "crush_node_flags": {}, "device_class_flags": {}, "stretch_mode": { "stretch_mode_enabled": false, "stretch_bucket_count": 0, "degraded_stretch_mode": 0, "recovering_stretch_mode": 0, "stretch_mode_bucket": 0 } }, "osd_metadata": [ { "id": 0, "arch": "x86_64", "back_addr": "[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]", "back_iface": "", "bluefs": "1", "bluefs_dedicated_db": "0", "bluefs_dedicated_wal": "0", "bluefs_single_shared_device": "1", "bluestore_allocation_from_file": "0", "bluestore_bdev_access_mode": "file", "bluestore_bdev_block_size": "4096", "bluestore_bdev_devices": "sda", "bluestore_bdev_driver": "KernelDevice", "bluestore_bdev_optimal_io_size": "0", "bluestore_bdev_path": "td/mon-last-clean-epoch/0/block", "bluestore_bdev_rotational": "1", "bluestore_bdev_size": "107374182400", "bluestore_bdev_support_discard": "0", "bluestore_bdev_type": "hdd", "bluestore_min_alloc_size": "4096", "ceph_release": "squid", "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", "ceph_version_short": "19.3.0-4930-gfc3e0bff", "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", "created_at": "2024-09-16T03:22:53.662571Z", "default_device_class": "hdd", "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", "devices": "sda", "distro": "ubuntu", "distro_description": "Ubuntu 22.04.1 LTS", "distro_version": "22.04", "front_addr": "[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]", "front_iface": "", "hb_back_addr": "[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]", "hb_front_addr": "[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]", "hostname": "smithi096", "journal_rotational": "1", "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", "kernel_version": "5.15.0-121-generic", "mem_swap_kb": "2097148", "mem_total_kb": "32746824", "network_numa_unknown_ifaces": "back_iface,front_iface", "objectstore_numa_unknown_devices": "sda", "os": "Linux", "osd_data": "td/mon-last-clean-epoch/0", "osd_objectstore": "bluestore", "osdspec_affinity": "", "rotational": "1" }, { "id": 1, "arch": "x86_64", "back_addr": "[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]", "back_iface": "", "bluefs": "1", "bluefs_dedicated_db": "0", "bluefs_dedicated_wal": "0", "bluefs_single_shared_device": "1", "bluestore_allocation_from_file": "0", "bluestore_bdev_access_mode": "file", "bluestore_bdev_block_size": "4096", "bluestore_bdev_devices": "sda", "bluestore_bdev_driver": "KernelDevice", "bluestore_bdev_optimal_io_size": "0", "bluestore_bdev_path": "td/mon-last-clean-epoch/1/block", "bluestore_bdev_rotational": "1", "bluestore_bdev_size": "107374182400", "bluestore_bdev_support_discard": "0", "bluestore_bdev_type": "hdd", "bluestore_min_alloc_size": "4096", "ceph_release": "squid", "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", "ceph_version_short": "19.3.0-4930-gfc3e0bff", "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", "created_at": "2024-09-16T03:23:30.129885Z", "default_device_class": "hdd", "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", "devices": "sda", "distro": "ubuntu", "distro_description": "Ubuntu 22.04.1 LTS", "distro_version": "22.04", "front_addr": "[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]", "front_iface": "", "hb_back_addr": "[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]", "hb_front_addr": "[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]", "hostname": "smithi096", "journal_rotational": "1", "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", "kernel_version": "5.15.0-121-generic", "mem_swap_kb": "2097148", "mem_total_kb": "32746824", "network_numa_unknown_ifaces": "back_iface,front_iface", "objectstore_numa_unknown_devices": "sda", "os": "Linux", "osd_data": "td/mon-last-clean-epoch/1", "osd_objectstore": "bluestore", "osdspec_affinity": "", "rotational": "1" }, { "id": 2, "arch": "x86_64", "back_addr": "[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]", "back_iface": "", "bluefs": "1", "bluefs_dedicated_db": "0", "bluefs_dedicated_wal": "0", "bluefs_single_shared_device": "1", "bluestore_allocation_from_file": "0", "bluestore_bdev_access_mode": "file", "bluestore_bdev_block_size": "4096", "bluestore_bdev_devices": "sda", "bluestore_bdev_driver": "KernelDevice", "bluestore_bdev_optimal_io_size": "0", "bluestore_bdev_path": "td/mon-last-clean-epoch/2/block", "bluestore_bdev_rotational": "1", "bluestore_bdev_size": "107374182400", "bluestore_bdev_support_discard": "0", "bluestore_bdev_type": "hdd", "bluestore_min_alloc_size": "4096", "ceph_release": "squid", "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", "ceph_version_short": "19.3.0-4930-gfc3e0bff", "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", "created_at": "2024-09-16T03:24:07.764502Z", "default_device_class": "hdd", "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", "devices": "sda", "distro": "ubuntu", "distro_description": "Ubuntu 22.04.1 LTS", "distro_version": "22.04", "front_addr": "[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]", "front_iface": "", "hb_back_addr": "[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]", "hb_front_addr": "[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]", "hostname": "smithi096", "journal_rotational": "1", "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", "kernel_version": "5.15.0-121-generic", "mem_swap_kb": "2097148", "mem_total_kb": "32746824", "network_numa_unknown_ifaces": "back_iface,front_iface", "objectstore_numa_unknown_devices": "sda", "os": "Linux", "osd_data": "td/mon-last-clean-epoch/2", "osd_objectstore": "bluestore", "osdspec_affinity": "", "rotational": "1" } ], "osdmap_clean_epochs": { "min_last_epoch_clean": 28, "last_epoch_clean": { "per_pool": [ { "poolid": 1, "floor": 28 }, { "poolid": 2, "floor": 28 } ] }, "osd_epochs": [ { "id": 0, "epoch": 78 }, { "id": 1, "epoch": 80 } ] }, "osdmap_first_committed": 28, "osdmap_last_committed": 80, "crushmap": { "devices": [ { "id": 0, "name": "osd.0", "class": "hdd" }, { "id": 1, "name": "osd.1", "class": "hdd" }, { "id": 2, "name": "osd.2", "class": "hdd" } ], "types": [ { "type_id": 0, "name": "osd" }, { "type_id": 1, "name": "host" }, { "type_id": 2, "name": "chassis" }, { "type_id": 3, "name": "rack" }, { "type_id": 4, "name": "row" }, { "type_id": 5, "name": "pdu" }, { "type_id": 6, "name": "pod" }, { "type_id": 7, "name": "room" }, { "type_id": 8, "name": "datacenter" }, { "type_id": 9, "name": "zone" }, { "type_id": 10, "name": "region" }, { "type_id": 11, "name": "root" } ], "buckets": [ { "id": -1, "name": "default", "type_id": 11, "type_name": "root", "weight": 19206, "alg": "straw2", "hash": "rjenkins1", "items": [ { "id": -3, "weight": 19206, "pos": 0 } ] }, { "id": -2, "name": "default~hdd", "type_id": 11, "type_name": "root", "weight": 19206, "alg": "straw2", "hash": "rjenkins1", "items": [ { "id": -4, "weight": 19206, "pos": 0 } ] }, { "id": -3, "name": "smithi096", "type_id": 1, "type_name": "host", "weight": 19206, "alg": "straw2", "hash": "rjenkins1", "items": [ { "id": 0, "weight": 6402, "pos": 0 }, { "id": 1, "weight": 6402, "pos": 1 }, { "id": 2, "weight": 6402, "pos": 2 } ] }, { "id": -4, "name": "smithi096~hdd", "type_id": 1, "type_name": "host", "weight": 19206, "alg": "straw2", "hash": "rjenkins1", "items": [ { "id": 0, "weight": 6402, "pos": 0 }, { "id": 1, "weight": 6402, "pos": 1 }, { "id": 2, "weight": 6402, "pos": 2 } ] } ], "rules": [ { "rule_id": 0, "rule_name": "replicated_rule", "type": 1, "steps": [ { "op": "take", "item": -1, "item_name": "default" }, { "op": "choose_firstn", "num": 0, "type": "osd" }, { "op": "emit" } ] } ], "tunables": { "choose_local_tries": 0, "choose_local_fallback_tries": 0, "choose_total_tries": 50, "chooseleaf_descend_once": 1, "chooseleaf_vary_r": 1, "chooseleaf_stable": 1, "msr_descents": 100, "msr_collision_tries": 100, "straw_calc_version": 1, "allowed_bucket_algs": 54, "profile": "jewel", "optimal_tunables": 1, "legacy_tunables": 0, "minimum_required_version": "jewel", "require_feature_tunables": 1, "require_feature_tunables2": 1, "has_v2_rules": 0, "require_feature_tunables3": 1, "has_v3_rules": 0, "has_v4_buckets": 1, "require_feature_tunables5": 1, "has_v5_rules": 0, "has_msr_rules": 0 }, "choose_args": {} }, "fsmap": { "epoch": 1, "btime": "2024-09-16T03:22:46:882186+0000", "default_fscid": -1, "compat": { "compat": {}, "ro_compat": {}, "incompat": { "feature_1": "base v0.20", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes" } }, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "standbys": [], "filesystems": [] }, "mdsmap_first_committed": 1, "mdsmap_last_committed": 1, "auth": { "first_committed": 1, "last_committed": 5, "num_secrets": 3 }, "num_pg": 64, "num_pg_active": 64, "num_pg_unknown": 0, "num_osd": 3, "pool_sum": { "stat_sum": { "num_bytes": 0, "num_objects": 0, "num_object_clones": 0, "num_object_copies": 0, "num_objects_missing_on_primary": 0, "num_objects_missing": 0, "num_objects_degraded": 0, "num_objects_misplaced": 0, "num_objects_unfound": 0, "num_objects_dirty": 0, "num_whiteouts": 0, "num_read": 0, "num_read_kb": 0, "num_write": 0, "num_write_kb": 0, "num_scrub_errors": 0, "num_shallow_scrub_errors": 0, "num_deep_scrub_errors": 0, "num_objects_recovered": 0, "num_bytes_recovered": 0, "num_keys_recovered": 0, "num_objects_omap": 0, "num_objects_hit_set_archive": 0, "num_bytes_hit_set_archive": 0, "num_flush": 0, "num_flush_kb": 0, "num_evict": 0, "num_evict_kb": 0, "num_promote": 0, "num_flush_mode_high": 0, "num_flush_mode_low": 0, "num_evict_mode_some": 0, "num_evict_mode_full": 0, "num_objects_pinned": 0, "num_legacy_snapsets": 0, "num_large_omap_objects": 0, "num_objects_manifest": 0, "num_omap_bytes": 0, "num_omap_keys": 0, "num_objects_repaired": 0 }, "store_stats": { "total": 0, "available": 0, "internally_reserved": 0, "allocated": 0, "data_stored": 0, "data_compressed": 0, "data_compressed_allocated": 0, "data_compressed_original": 0, "omap_allocated": 0, "internal_metadata": 0 }, "log_size": 0, "ondisk_log_size": 0, "up": 128, "acting": 128, "num_store_stats": 0 }, "osd_sum": { "up_from": 0, "seq": 0, "num_pgs": 128, "num_osds": 2, "num_per_pool_osds": 2, "num_per_pool_omap_osds": 2, "kb": 209715200, "kb_used": 54560, "kb_used_data": 832, "kb_used_omap": 3, "kb_used_meta": 53628, "kb_avail": 209660640, "statfs": { "total": 214748364800, "available": 214692495360, "internally_reserved": 0, "allocated": 851968, "data_stored": 318404, "data_compressed": 0, "data_compressed_allocated": 0, "data_compressed_original": 0, "omap_allocated": 3190, "internal_metadata": 54915978 }, "hb_peers": [], "snap_trim_queue_len": 0, "num_snap_trimming": 0, "num_shards_repaired": 0, "op_queue_age_hist": { "histogram": [], "upper_bound": 1 }, "perf_stat": { "commit_latency_ms": 256, "apply_latency_ms": 256, "commit_latency_ns": 256000000, "apply_latency_ns": 256000000 }, "alerts": [], "network_ping_times": [] }, "osd_sum_by_class": { "hdd": { "up_from": 0, "seq": 0, "num_pgs": 128, "num_osds": 2, "num_per_pool_osds": 2, "num_per_pool_omap_osds": 2, "kb": 209715200, "kb_used": 54560, "kb_used_data": 832, "kb_used_omap": 3, "kb_used_meta": 53628, "kb_avail": 209660640, "statfs": { "total": 214748364800, "available": 214692495360, "internally_reserved": 0, "allocated": 851968, "data_stored": 318404, "data_compressed": 0, "data_compressed_allocated": 0, "data_compressed_original": 0, "omap_allocated": 3190, "internal_metadata": 54915978 }, "hb_peers": [], "snap_trim_queue_len": 0, "num_snap_trimming": 0, "num_shards_repaired": 0, "op_queue_age_hist": { "histogram": [], "upper_bound": 1 }, "perf_stat": { "commit_latency_ms": 256, "apply_latency_ms": 256, "commit_latency_ns": 256000000, "apply_latency_ns": 256000000 }, "alerts": [], "network_ping_times": [] } }, "pool_stats": [ { "poolid": 2, "num_pg": 32, "stat_sum": { "num_bytes": 0, "num_objects": 0, "num_object_clones": 0, "num_object_copies": 0, "num_objects_missing_on_primary": 0, "num_objects_missing": 0, "num_objects_degraded": 0, "num_objects_misplaced": 0, "num_objects_unfound": 0, "num_objects_dirty": 0, "num_whiteouts": 0, "num_read": 0, "num_read_kb": 0, "num_write": 0, "num_write_kb": 0, "num_scrub_errors": 0, "num_shallow_scrub_errors": 0, "num_deep_scrub_errors": 0, "num_objects_recovered": 0, "num_bytes_recovered": 0, "num_keys_recovered": 0, "num_objects_omap": 0, "num_objects_hit_set_archive": 0, "num_bytes_hit_set_archive": 0, "num_flush": 0, "num_flush_kb": 0, "num_evict": 0, "num_evict_kb": 0, "num_promote": 0, "num_flush_mode_high": 0, "num_flush_mode_low": 0, "num_evict_mode_some": 0, "num_evict_mode_full": 0, "num_objects_pinned": 0, "num_legacy_snapsets": 0, "num_large_omap_objects": 0, "num_objects_manifest": 0, "num_omap_bytes": 0, "num_omap_keys": 0, "num_objects_repaired": 0 }, "store_stats": { "total": 0, "available": 0, "internally_reserved": 0, "allocated": 0, "data_stored": 0, "data_compressed": 0, "data_compressed_allocated": 0, "data_compressed_original": 0, "omap_allocated": 0, "internal_metadata": 0 }, "log_size": 0, "ondisk_log_size": 0, "up": 64, "acting": 64, "num_store_stats": 3 }, { "poolid": 1, "num_pg": 32, "stat_sum": { "num_bytes": 0, "num_objects": 0, "num_object_clones": 0, "num_object_copies": 0, "num_objects_missing_on_primary": 0, "num_objects_missing": 0, "num_objects_degraded": 0, "num_objects_misplaced": 0, "num_objects_unfound": 0, "num_objects_dirty": 0, "num_whiteouts": 0, "num_read": 0, "num_read_kb": 0, "num_write": 0, "num_write_kb": 0, "num_scrub_errors": 0, "num_shallow_scrub_errors": 0, "num_deep_scrub_errors": 0, "num_objects_recovered": 0, "num_bytes_recovered": 0, "num_keys_recovered": 0, "num_objects_omap": 0, "num_objects_hit_set_archive": 0, "num_bytes_hit_set_archive": 0, "num_flush": 0, "num_flush_kb": 0, "num_evict": 0, "num_evict_kb": 0, "num_promote": 0, "num_flush_mode_high": 0, "num_flush_mode_low": 0, "num_evict_mode_some": 0, "num_evict_mode_full": 0, "num_objects_pinned": 0, "num_legacy_snapsets": 0, "num_large_omap_objects": 0, "num_objects_manifest": 0, "num_omap_bytes": 0, "num_omap_keys": 0, "num_objects_repaired": 0 }, "store_stats": { "total": 0, "available": 0, "internally_reserved": 0, "allocated": 0, "data_stored": 0, "data_compressed": 0, "data_compressed_allocated": 0, "data_compressed_original": 0, "omap_allocated": 0, "internal_metadata": 0 }, "log_size": 0, "ondisk_log_size": 0, "up": 64, "acting": 64, "num_store_stats": 3 } ], "osd_stats": [ { "osd": 0, "seq": 21474836517 }, { "osd": 1, "seq": 42949672988 }, { "osd": 2, "seq": 0 } ], "num_pg_by_state": [ { "state": "active+undersized", "num": 64 } ], "num_pg_by_osd": [ { "osd": 2, "num_primary_pg": 0, "num_acting_pg": 0, "num_up_not_acting_pg": 0 }, { "osd": 0, "num_primary_pg": 28, "num_acting_pg": 64, "num_up_not_acting_pg": 0 }, { "osd": 1, "num_primary_pg": 36, "num_acting_pg": 64, "num_up_not_acting_pg": 0 } ], "purged_snaps": [ { "pool": 1, "purged_snaps": {} }, { "pool": 2, "purged_snaps": {} } ], "servicemap": { "epoch": 5, "modified": "2024-09-16T03:25:38.422788+0000", "services": {} }, "mgrstat_first_committed": 77, "mgrstat_last_committed": 83, "logm_first_committed": 1, "logm_last_committed": 365, "paxos": { "first_committed": 1, "last_committed": 544, "last_pn": 0, "accepted_pn": 0 } } 2024-09-16T03:25:56.528 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:112: check_lec_honours_osd: return 1 2024-09-16T03:25:56.528 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:115: check_lec_honours_osd: return 0 2024-09-16T03:25:56.529 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:253: TEST_mon_last_clean_epoch: ceph osd pool set bar size 2 2024-09-16T03:25:57.571 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 2 size to 2 2024-09-16T03:25:57.594 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:255: TEST_mon_last_clean_epoch: get_fc_lc_diff 2024-09-16T03:25:57.594 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:130: get_fc_lc_diff: ceph report 2024-09-16T03:25:58.194 INFO:tasks.workunit.client.0.smithi096.stderr:report 1132420380 2024-09-16T03:25:58.211 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:130: get_fc_lc_diff: report='{ 2024-09-16T03:25:58.211 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_fingerprint": "fda2fc64-07ed-4add-8224-2e527e11d427", 2024-09-16T03:25:58.211 INFO:tasks.workunit.client.0.smithi096.stderr: "version": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:25:58.211 INFO:tasks.workunit.client.0.smithi096.stderr: "commit": "fc3e0bff7468fd55478adbae7f75508b749124b6", 2024-09-16T03:25:58.211 INFO:tasks.workunit.client.0.smithi096.stderr: "timestamp": "2024-09-16T03:25:58.193170+0000", 2024-09-16T03:25:58.212 INFO:tasks.workunit.client.0.smithi096.stderr: "tag": "", 2024-09-16T03:25:58.212 INFO:tasks.workunit.client.0.smithi096.stderr: "health": { 2024-09-16T03:25:58.212 INFO:tasks.workunit.client.0.smithi096.stderr: "status": "HEALTH_OK", 2024-09-16T03:25:58.212 INFO:tasks.workunit.client.0.smithi096.stderr: "checks": {}, 2024-09-16T03:25:58.212 INFO:tasks.workunit.client.0.smithi096.stderr: "mutes": [] 2024-09-16T03:25:58.212 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.212 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap_first_committed": 1, 2024-09-16T03:25:58.212 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap_last_committed": 1, 2024-09-16T03:25:58.212 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap": { 2024-09-16T03:25:58.212 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 1, 2024-09-16T03:25:58.212 INFO:tasks.workunit.client.0.smithi096.stderr: "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", 2024-09-16T03:25:58.212 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:22:45.872880Z", 2024-09-16T03:25:58.212 INFO:tasks.workunit.client.0.smithi096.stderr: "created": "2024-09-16T03:22:45.872880Z", 2024-09-16T03:25:58.213 INFO:tasks.workunit.client.0.smithi096.stderr: "min_mon_release": 19, 2024-09-16T03:25:58.213 INFO:tasks.workunit.client.0.smithi096.stderr: "min_mon_release_name": "squid", 2024-09-16T03:25:58.213 INFO:tasks.workunit.client.0.smithi096.stderr: "election_strategy": 1, 2024-09-16T03:25:58.213 INFO:tasks.workunit.client.0.smithi096.stderr: "disallowed_leaders: ": "", 2024-09-16T03:25:58.213 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode": false, 2024-09-16T03:25:58.213 INFO:tasks.workunit.client.0.smithi096.stderr: "tiebreaker_mon": "", 2024-09-16T03:25:58.213 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_ranks: ": "", 2024-09-16T03:25:58.213 INFO:tasks.workunit.client.0.smithi096.stderr: "features": { 2024-09-16T03:25:58.213 INFO:tasks.workunit.client.0.smithi096.stderr: "persistent": [ 2024-09-16T03:25:58.213 INFO:tasks.workunit.client.0.smithi096.stderr: "kraken", 2024-09-16T03:25:58.213 INFO:tasks.workunit.client.0.smithi096.stderr: "luminous", 2024-09-16T03:25:58.213 INFO:tasks.workunit.client.0.smithi096.stderr: "mimic", 2024-09-16T03:25:58.213 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap-prune", 2024-09-16T03:25:58.213 INFO:tasks.workunit.client.0.smithi096.stderr: "nautilus", 2024-09-16T03:25:58.214 INFO:tasks.workunit.client.0.smithi096.stderr: "octopus", 2024-09-16T03:25:58.214 INFO:tasks.workunit.client.0.smithi096.stderr: "pacific", 2024-09-16T03:25:58.214 INFO:tasks.workunit.client.0.smithi096.stderr: "elector-pinging", 2024-09-16T03:25:58.214 INFO:tasks.workunit.client.0.smithi096.stderr: "quincy", 2024-09-16T03:25:58.214 INFO:tasks.workunit.client.0.smithi096.stderr: "reef", 2024-09-16T03:25:58.214 INFO:tasks.workunit.client.0.smithi096.stderr: "squid" 2024-09-16T03:25:58.214 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:58.214 INFO:tasks.workunit.client.0.smithi096.stderr: "optional": [] 2024-09-16T03:25:58.214 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.214 INFO:tasks.workunit.client.0.smithi096.stderr: "mons": [ 2024-09-16T03:25:58.214 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.214 INFO:tasks.workunit.client.0.smithi096.stderr: "rank": 0, 2024-09-16T03:25:58.214 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "a", 2024-09-16T03:25:58.214 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:25:58.215 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:58.215 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.215 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:58.215 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:7302", 2024-09-16T03:25:58.215 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 0 2024-09-16T03:25:58.215 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:58.215 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:58.215 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.215 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:7302/0", 2024-09-16T03:25:58.216 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:7302/0", 2024-09-16T03:25:58.216 INFO:tasks.workunit.client.0.smithi096.stderr: "priority": 0, 2024-09-16T03:25:58.216 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 0, 2024-09-16T03:25:58.216 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_location": "{}" 2024-09-16T03:25:58.216 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:58.216 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:58.216 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.216 INFO:tasks.workunit.client.0.smithi096.stderr: "quorum": [ 2024-09-16T03:25:58.216 INFO:tasks.workunit.client.0.smithi096.stderr: 0 2024-09-16T03:25:58.216 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:58.216 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap": { 2024-09-16T03:25:58.216 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 83, 2024-09-16T03:25:58.216 INFO:tasks.workunit.client.0.smithi096.stderr: "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", 2024-09-16T03:25:58.217 INFO:tasks.workunit.client.0.smithi096.stderr: "created": "2024-09-16T03:22:46.906117+0000", 2024-09-16T03:25:58.217 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:25:57.328949+0000", 2024-09-16T03:25:58.217 INFO:tasks.workunit.client.0.smithi096.stderr: "last_up_change": "2024-09-16T03:25:08.513363+0000", 2024-09-16T03:25:58.217 INFO:tasks.workunit.client.0.smithi096.stderr: "last_in_change": "2024-09-16T03:25:09.839444+0000", 2024-09-16T03:25:58.217 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-16T03:25:58.217 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_num": 5799936, 2024-09-16T03:25:58.217 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_set": [ 2024-09-16T03:25:58.217 INFO:tasks.workunit.client.0.smithi096.stderr: "pglog_hardlimit", 2024-09-16T03:25:58.217 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snapdirs", 2024-09-16T03:25:58.217 INFO:tasks.workunit.client.0.smithi096.stderr: "recovery_deletes", 2024-09-16T03:25:58.217 INFO:tasks.workunit.client.0.smithi096.stderr: "sortbitwise" 2024-09-16T03:25:58.217 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:58.217 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_version": 7, 2024-09-16T03:25:58.218 INFO:tasks.workunit.client.0.smithi096.stderr: "full_ratio": 0.97000002861022949, 2024-09-16T03:25:58.218 INFO:tasks.workunit.client.0.smithi096.stderr: "backfillfull_ratio": 0.97000002861022949, 2024-09-16T03:25:58.218 INFO:tasks.workunit.client.0.smithi096.stderr: "nearfull_ratio": 0.85000002384185791, 2024-09-16T03:25:58.218 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_snapshot": "", 2024-09-16T03:25:58.218 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_max": 2, 2024-09-16T03:25:58.218 INFO:tasks.workunit.client.0.smithi096.stderr: "max_osd": 3, 2024-09-16T03:25:58.218 INFO:tasks.workunit.client.0.smithi096.stderr: "require_min_compat_client": "luminous", 2024-09-16T03:25:58.218 INFO:tasks.workunit.client.0.smithi096.stderr: "min_compat_client": "jewel", 2024-09-16T03:25:58.218 INFO:tasks.workunit.client.0.smithi096.stderr: "require_osd_release": "squid", 2024-09-16T03:25:58.218 INFO:tasks.workunit.client.0.smithi096.stderr: "allow_crimson": false, 2024-09-16T03:25:58.218 INFO:tasks.workunit.client.0.smithi096.stderr: "pools": [ 2024-09-16T03:25:58.218 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.218 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 1, 2024-09-16T03:25:58.218 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_name": "foo", 2024-09-16T03:25:58.219 INFO:tasks.workunit.client.0.smithi096.stderr: "create_time": "2024-09-16T03:24:44.525189+0000", 2024-09-16T03:25:58.219 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": 1, 2024-09-16T03:25:58.219 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_names": "hashpspool", 2024-09-16T03:25:58.219 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:25:58.219 INFO:tasks.workunit.client.0.smithi096.stderr: "size": 3, 2024-09-16T03:25:58.219 INFO:tasks.workunit.client.0.smithi096.stderr: "min_size": 2, 2024-09-16T03:25:58.219 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_rule": 0, 2024-09-16T03:25:58.219 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_count": 0, 2024-09-16T03:25:58.219 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_target": 0, 2024-09-16T03:25:58.219 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_barrier": 0, 2024-09-16T03:25:58.219 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-16T03:25:58.219 INFO:tasks.workunit.client.0.smithi096.stderr: "is_stretch_pool": false, 2024-09-16T03:25:58.219 INFO:tasks.workunit.client.0.smithi096.stderr: "object_hash": 2, 2024-09-16T03:25:58.219 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_autoscale_mode": "off", 2024-09-16T03:25:58.220 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num": 32, 2024-09-16T03:25:58.220 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num": 32, 2024-09-16T03:25:58.220 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num_target": 32, 2024-09-16T03:25:58.220 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_target": 32, 2024-09-16T03:25:58.220 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_pending": 32, 2024-09-16T03:25:58.220 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pg_merge_meta": { 2024-09-16T03:25:58.220 INFO:tasks.workunit.client.0.smithi096.stderr: "source_pgid": "0.0", 2024-09-16T03:25:58.220 INFO:tasks.workunit.client.0.smithi096.stderr: "ready_epoch": 0, 2024-09-16T03:25:58.220 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_started": 0, 2024-09-16T03:25:58.220 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": 0, 2024-09-16T03:25:58.220 INFO:tasks.workunit.client.0.smithi096.stderr: "source_version": "0'\''0", 2024-09-16T03:25:58.220 INFO:tasks.workunit.client.0.smithi096.stderr: "target_version": "0'\''0" 2024-09-16T03:25:58.220 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.221 INFO:tasks.workunit.client.0.smithi096.stderr: "last_change": "30", 2024-09-16T03:25:58.221 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend": "0", 2024-09-16T03:25:58.221 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_prenautilus": "0", 2024-09-16T03:25:58.221 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_preluminous": "0", 2024-09-16T03:25:58.221 INFO:tasks.workunit.client.0.smithi096.stderr: "auid": 0, 2024-09-16T03:25:58.221 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_mode": "selfmanaged", 2024-09-16T03:25:58.221 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_seq": 0, 2024-09-16T03:25:58.221 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_epoch": 0, 2024-09-16T03:25:58.221 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_snaps": [], 2024-09-16T03:25:58.221 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps": "[]", 2024-09-16T03:25:58.221 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_bytes": 0, 2024-09-16T03:25:58.221 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_objects": 0, 2024-09-16T03:25:58.221 INFO:tasks.workunit.client.0.smithi096.stderr: "tiers": [], 2024-09-16T03:25:58.221 INFO:tasks.workunit.client.0.smithi096.stderr: "tier_of": -1, 2024-09-16T03:25:58.222 INFO:tasks.workunit.client.0.smithi096.stderr: "read_tier": -1, 2024-09-16T03:25:58.222 INFO:tasks.workunit.client.0.smithi096.stderr: "write_tier": -1, 2024-09-16T03:25:58.222 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_mode": "none", 2024-09-16T03:25:58.222 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_bytes": 0, 2024-09-16T03:25:58.222 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_objects": 0, 2024-09-16T03:25:58.222 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_ratio_micro": 400000, 2024-09-16T03:25:58.222 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-16T03:25:58.222 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_full_ratio_micro": 800000, 2024-09-16T03:25:58.222 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_flush_age": 0, 2024-09-16T03:25:58.222 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_evict_age": 0, 2024-09-16T03:25:58.222 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profile": "", 2024-09-16T03:25:58.222 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_params": { 2024-09-16T03:25:58.222 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "none" 2024-09-16T03:25:58.222 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.223 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_period": 0, 2024-09-16T03:25:58.223 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_count": 0, 2024-09-16T03:25:58.223 INFO:tasks.workunit.client.0.smithi096.stderr: "use_gmt_hitset": true, 2024-09-16T03:25:58.223 INFO:tasks.workunit.client.0.smithi096.stderr: "min_read_recency_for_promote": 0, 2024-09-16T03:25:58.223 INFO:tasks.workunit.client.0.smithi096.stderr: "min_write_recency_for_promote": 0, 2024-09-16T03:25:58.223 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_grade_decay_rate": 0, 2024-09-16T03:25:58.223 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_search_last_n": 0, 2024-09-16T03:25:58.223 INFO:tasks.workunit.client.0.smithi096.stderr: "grade_table": [], 2024-09-16T03:25:58.223 INFO:tasks.workunit.client.0.smithi096.stderr: "stripe_width": 0, 2024-09-16T03:25:58.223 INFO:tasks.workunit.client.0.smithi096.stderr: "expected_num_objects": 0, 2024-09-16T03:25:58.223 INFO:tasks.workunit.client.0.smithi096.stderr: "fast_read": false, 2024-09-16T03:25:58.223 INFO:tasks.workunit.client.0.smithi096.stderr: "options": {}, 2024-09-16T03:25:58.223 INFO:tasks.workunit.client.0.smithi096.stderr: "application_metadata": {}, 2024-09-16T03:25:58.224 INFO:tasks.workunit.client.0.smithi096.stderr: "read_balance": { 2024-09-16T03:25:58.224 INFO:tasks.workunit.client.0.smithi096.stderr: "score_type": "Fair distribution", 2024-09-16T03:25:58.224 INFO:tasks.workunit.client.0.smithi096.stderr: "score_acting": 1.8700000047683716, 2024-09-16T03:25:58.224 INFO:tasks.workunit.client.0.smithi096.stderr: "score_stable": 1.8700000047683716, 2024-09-16T03:25:58.224 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_score": 0.67000001668930054, 2024-09-16T03:25:58.224 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_acting": 1.25, 2024-09-16T03:25:58.224 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_stable": 1.25, 2024-09-16T03:25:58.224 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity_weighted": 1, 2024-09-16T03:25:58.224 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity": 1, 2024-09-16T03:25:58.224 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity_weighted": 1 2024-09-16T03:25:58.224 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:58.224 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.224 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.224 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 2, 2024-09-16T03:25:58.225 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_name": "bar", 2024-09-16T03:25:58.225 INFO:tasks.workunit.client.0.smithi096.stderr: "create_time": "2024-09-16T03:24:46.226575+0000", 2024-09-16T03:25:58.225 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": 1, 2024-09-16T03:25:58.225 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_names": "hashpspool", 2024-09-16T03:25:58.225 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:25:58.225 INFO:tasks.workunit.client.0.smithi096.stderr: "size": 2, 2024-09-16T03:25:58.225 INFO:tasks.workunit.client.0.smithi096.stderr: "min_size": 1, 2024-09-16T03:25:58.225 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_rule": 0, 2024-09-16T03:25:58.225 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_count": 0, 2024-09-16T03:25:58.225 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_target": 0, 2024-09-16T03:25:58.225 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_barrier": 0, 2024-09-16T03:25:58.225 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-16T03:25:58.225 INFO:tasks.workunit.client.0.smithi096.stderr: "is_stretch_pool": false, 2024-09-16T03:25:58.225 INFO:tasks.workunit.client.0.smithi096.stderr: "object_hash": 2, 2024-09-16T03:25:58.226 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_autoscale_mode": "off", 2024-09-16T03:25:58.226 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num": 32, 2024-09-16T03:25:58.226 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num": 32, 2024-09-16T03:25:58.226 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num_target": 32, 2024-09-16T03:25:58.226 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_target": 32, 2024-09-16T03:25:58.226 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_pending": 32, 2024-09-16T03:25:58.226 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pg_merge_meta": { 2024-09-16T03:25:58.226 INFO:tasks.workunit.client.0.smithi096.stderr: "source_pgid": "0.0", 2024-09-16T03:25:58.226 INFO:tasks.workunit.client.0.smithi096.stderr: "ready_epoch": 0, 2024-09-16T03:25:58.226 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_started": 0, 2024-09-16T03:25:58.226 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": 0, 2024-09-16T03:25:58.226 INFO:tasks.workunit.client.0.smithi096.stderr: "source_version": "0'\''0", 2024-09-16T03:25:58.226 INFO:tasks.workunit.client.0.smithi096.stderr: "target_version": "0'\''0" 2024-09-16T03:25:58.226 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.227 INFO:tasks.workunit.client.0.smithi096.stderr: "last_change": "83", 2024-09-16T03:25:58.227 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend": "0", 2024-09-16T03:25:58.227 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_prenautilus": "0", 2024-09-16T03:25:58.227 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_preluminous": "0", 2024-09-16T03:25:58.227 INFO:tasks.workunit.client.0.smithi096.stderr: "auid": 0, 2024-09-16T03:25:58.227 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_mode": "selfmanaged", 2024-09-16T03:25:58.227 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_seq": 0, 2024-09-16T03:25:58.227 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_epoch": 0, 2024-09-16T03:25:58.227 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_snaps": [], 2024-09-16T03:25:58.227 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps": "[]", 2024-09-16T03:25:58.227 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_bytes": 0, 2024-09-16T03:25:58.227 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_objects": 0, 2024-09-16T03:25:58.227 INFO:tasks.workunit.client.0.smithi096.stderr: "tiers": [], 2024-09-16T03:25:58.227 INFO:tasks.workunit.client.0.smithi096.stderr: "tier_of": -1, 2024-09-16T03:25:58.228 INFO:tasks.workunit.client.0.smithi096.stderr: "read_tier": -1, 2024-09-16T03:25:58.228 INFO:tasks.workunit.client.0.smithi096.stderr: "write_tier": -1, 2024-09-16T03:25:58.228 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_mode": "none", 2024-09-16T03:25:58.228 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_bytes": 0, 2024-09-16T03:25:58.228 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_objects": 0, 2024-09-16T03:25:58.228 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_ratio_micro": 400000, 2024-09-16T03:25:58.228 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-16T03:25:58.228 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_full_ratio_micro": 800000, 2024-09-16T03:25:58.228 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_flush_age": 0, 2024-09-16T03:25:58.228 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_evict_age": 0, 2024-09-16T03:25:58.228 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profile": "", 2024-09-16T03:25:58.228 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_params": { 2024-09-16T03:25:58.228 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "none" 2024-09-16T03:25:58.229 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.229 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_period": 0, 2024-09-16T03:25:58.229 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_count": 0, 2024-09-16T03:25:58.229 INFO:tasks.workunit.client.0.smithi096.stderr: "use_gmt_hitset": true, 2024-09-16T03:25:58.229 INFO:tasks.workunit.client.0.smithi096.stderr: "min_read_recency_for_promote": 0, 2024-09-16T03:25:58.229 INFO:tasks.workunit.client.0.smithi096.stderr: "min_write_recency_for_promote": 0, 2024-09-16T03:25:58.229 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_grade_decay_rate": 0, 2024-09-16T03:25:58.229 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_search_last_n": 0, 2024-09-16T03:25:58.229 INFO:tasks.workunit.client.0.smithi096.stderr: "grade_table": [], 2024-09-16T03:25:58.229 INFO:tasks.workunit.client.0.smithi096.stderr: "stripe_width": 0, 2024-09-16T03:25:58.229 INFO:tasks.workunit.client.0.smithi096.stderr: "expected_num_objects": 0, 2024-09-16T03:25:58.229 INFO:tasks.workunit.client.0.smithi096.stderr: "fast_read": false, 2024-09-16T03:25:58.229 INFO:tasks.workunit.client.0.smithi096.stderr: "options": {}, 2024-09-16T03:25:58.230 INFO:tasks.workunit.client.0.smithi096.stderr: "application_metadata": {}, 2024-09-16T03:25:58.230 INFO:tasks.workunit.client.0.smithi096.stderr: "read_balance": { 2024-09-16T03:25:58.230 INFO:tasks.workunit.client.0.smithi096.stderr: "score_type": "Fair distribution", 2024-09-16T03:25:58.230 INFO:tasks.workunit.client.0.smithi096.stderr: "score_acting": 1.4900000095367432, 2024-09-16T03:25:58.230 INFO:tasks.workunit.client.0.smithi096.stderr: "score_stable": 1.4900000095367432, 2024-09-16T03:25:58.230 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_score": 0.67000001668930054, 2024-09-16T03:25:58.230 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_acting": 1, 2024-09-16T03:25:58.230 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_stable": 1, 2024-09-16T03:25:58.230 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity_weighted": 1, 2024-09-16T03:25:58.230 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity": 1, 2024-09-16T03:25:58.230 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity_weighted": 1 2024-09-16T03:25:58.230 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:58.230 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:58.230 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:58.231 INFO:tasks.workunit.client.0.smithi096.stderr: "osds": [ 2024-09-16T03:25:58.231 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.231 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:25:58.231 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6", 2024-09-16T03:25:58.231 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:25:58.231 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:25:58.231 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:25:58.231 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:25:58.231 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:25:58.231 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:25:58.231 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 5, 2024-09-16T03:25:58.231 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 81, 2024-09-16T03:25:58.231 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:25:58.232 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:25:58.232 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:25:58.232 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:58.232 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.232 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:58.232 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6802", 2024-09-16T03:25:58.232 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:58.232 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.232 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.232 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:58.232 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6803", 2024-09-16T03:25:58.232 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:58.232 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:58.233 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:58.233 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.233 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:25:58.233 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:58.233 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.233 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:58.233 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6804", 2024-09-16T03:25:58.233 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:58.233 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.233 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.233 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:58.233 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6805", 2024-09-16T03:25:58.233 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:58.233 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:58.234 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:58.234 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.234 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:25:58.234 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:58.234 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.234 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:58.234 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6808", 2024-09-16T03:25:58.234 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:58.234 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.234 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.234 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:58.234 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6809", 2024-09-16T03:25:58.234 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:58.234 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:58.235 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:58.235 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.235 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:25:58.235 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:58.235 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.235 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:58.235 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6806", 2024-09-16T03:25:58.235 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:58.235 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.235 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.235 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:58.235 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6807", 2024-09-16T03:25:58.235 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:58.235 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:58.236 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:58.236 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.236 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6803/3375787448", 2024-09-16T03:25:58.236 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6805/3375787448", 2024-09-16T03:25:58.236 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6809/3375787448", 2024-09-16T03:25:58.236 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6807/3375787448", 2024-09-16T03:25:58.236 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:25:58.236 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:25:58.236 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:25:58.236 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:58.236 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.236 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.236 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:25:58.237 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "74b26727-75c9-444d-8782-719e4197a382", 2024-09-16T03:25:58.237 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:25:58.237 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:25:58.237 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:25:58.237 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:25:58.237 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:25:58.237 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:25:58.237 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 10, 2024-09-16T03:25:58.237 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 81, 2024-09-16T03:25:58.237 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:25:58.237 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:25:58.237 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:25:58.237 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:58.238 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.238 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:58.238 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6810", 2024-09-16T03:25:58.238 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:58.238 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.238 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.238 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:58.238 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6811", 2024-09-16T03:25:58.238 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:58.238 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:58.238 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:58.238 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.238 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:25:58.239 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:58.239 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.239 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:58.239 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6812", 2024-09-16T03:25:58.239 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:58.239 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.239 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.239 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:58.239 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6813", 2024-09-16T03:25:58.239 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:58.239 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:58.239 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:58.239 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.239 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:25:58.240 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:58.240 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.240 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:58.240 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6816", 2024-09-16T03:25:58.240 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:58.240 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.240 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.240 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:58.240 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6817", 2024-09-16T03:25:58.240 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:58.240 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:58.240 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:58.240 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.241 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:25:58.241 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:58.241 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.241 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:58.241 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6814", 2024-09-16T03:25:58.241 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:58.241 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.241 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.241 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:58.241 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6815", 2024-09-16T03:25:58.241 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:58.241 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:58.241 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:58.241 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.241 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6811/3733255132", 2024-09-16T03:25:58.242 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6813/3733255132", 2024-09-16T03:25:58.242 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6817/3733255132", 2024-09-16T03:25:58.242 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6815/3733255132", 2024-09-16T03:25:58.242 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:25:58.242 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:25:58.242 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:25:58.242 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:58.242 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.242 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.242 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:25:58.242 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "143da3a7-dad9-4b1e-966b-76cf5bdd3c82", 2024-09-16T03:25:58.242 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 0, 2024-09-16T03:25:58.242 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 0, 2024-09-16T03:25:58.242 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 0, 2024-09-16T03:25:58.242 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:25:58.243 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:25:58.243 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:25:58.243 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 15, 2024-09-16T03:25:58.243 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 21, 2024-09-16T03:25:58.243 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 33, 2024-09-16T03:25:58.243 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:25:58.243 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:25:58.243 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:58.243 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.243 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:58.243 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6818", 2024-09-16T03:25:58.243 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:58.243 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.243 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.244 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:58.244 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6819", 2024-09-16T03:25:58.244 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:58.244 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:58.244 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:58.244 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.244 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:25:58.244 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:58.244 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.244 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:58.244 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6820", 2024-09-16T03:25:58.244 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:58.244 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.245 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.245 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:58.245 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6821", 2024-09-16T03:25:58.245 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:58.245 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:58.245 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:58.245 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.245 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:25:58.245 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:58.245 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.245 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:58.245 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6824", 2024-09-16T03:25:58.245 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:58.246 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.246 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.246 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:58.246 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6825", 2024-09-16T03:25:58.246 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:58.246 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:58.246 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:58.246 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.246 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:25:58.246 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:58.246 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.246 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:58.246 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6822", 2024-09-16T03:25:58.247 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:58.247 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.247 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.247 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:58.247 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6823", 2024-09-16T03:25:58.247 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:58.247 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:58.247 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:58.247 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.247 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6819/963814857", 2024-09-16T03:25:58.247 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6821/963814857", 2024-09-16T03:25:58.247 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6825/963814857", 2024-09-16T03:25:58.247 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6823/963814857", 2024-09-16T03:25:58.247 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:25:58.248 INFO:tasks.workunit.client.0.smithi096.stderr: "exists" 2024-09-16T03:25:58.248 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:58.248 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:58.248 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:58.248 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_xinfo": [ 2024-09-16T03:25:58.248 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.248 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:25:58.248 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:25:58.248 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:25:58.248 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:25:58.248 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:25:58.248 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:25:58.248 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:23:22.481942+0000", 2024-09-16T03:25:58.249 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:25:58.249 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.249 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.249 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:25:58.249 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:25:58.249 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:25:58.249 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:25:58.249 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:25:58.249 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:25:58.249 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:23:59.663703+0000", 2024-09-16T03:25:58.249 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:25:58.249 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.249 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.249 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:25:58.250 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:25:58.250 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:25:58.250 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:25:58.250 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:25:58.250 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 65536, 2024-09-16T03:25:58.250 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:24:37.320822+0000", 2024-09-16T03:25:58.250 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 32 2024-09-16T03:25:58.250 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:58.250 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:58.250 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap": [], 2024-09-16T03:25:58.250 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap_items": [], 2024-09-16T03:25:58.250 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap_primaries": [], 2024-09-16T03:25:58.250 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_temp": [], 2024-09-16T03:25:58.250 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_temp": [], 2024-09-16T03:25:58.251 INFO:tasks.workunit.client.0.smithi096.stderr: "blocklist": {}, 2024-09-16T03:25:58.251 INFO:tasks.workunit.client.0.smithi096.stderr: "range_blocklist": {}, 2024-09-16T03:25:58.251 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profiles": { 2024-09-16T03:25:58.251 INFO:tasks.workunit.client.0.smithi096.stderr: "default": { 2024-09-16T03:25:58.251 INFO:tasks.workunit.client.0.smithi096.stderr: "k": "2", 2024-09-16T03:25:58.251 INFO:tasks.workunit.client.0.smithi096.stderr: "m": "2", 2024-09-16T03:25:58.251 INFO:tasks.workunit.client.0.smithi096.stderr: "plugin": "jerasure", 2024-09-16T03:25:58.251 INFO:tasks.workunit.client.0.smithi096.stderr: "technique": "reed_sol_van" 2024-09-16T03:25:58.251 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:58.251 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.251 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps_queue": [], 2024-09-16T03:25:58.251 INFO:tasks.workunit.client.0.smithi096.stderr: "new_removed_snaps": [], 2024-09-16T03:25:58.251 INFO:tasks.workunit.client.0.smithi096.stderr: "new_purged_snaps": [], 2024-09-16T03:25:58.251 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_node_flags": {}, 2024-09-16T03:25:58.252 INFO:tasks.workunit.client.0.smithi096.stderr: "device_class_flags": {}, 2024-09-16T03:25:58.252 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode": { 2024-09-16T03:25:58.252 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode_enabled": false, 2024-09-16T03:25:58.252 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_bucket_count": 0, 2024-09-16T03:25:58.252 INFO:tasks.workunit.client.0.smithi096.stderr: "degraded_stretch_mode": 0, 2024-09-16T03:25:58.252 INFO:tasks.workunit.client.0.smithi096.stderr: "recovering_stretch_mode": 0, 2024-09-16T03:25:58.252 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode_bucket": 0 2024-09-16T03:25:58.252 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:58.252 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.252 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_metadata": [ 2024-09-16T03:25:58.252 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.252 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:25:58.253 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:25:58.253 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]", 2024-09-16T03:25:58.253 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:25:58.253 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:25:58.253 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:25:58.253 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:25:58.253 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:25:58.253 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:25:58.253 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:25:58.253 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:25:58.253 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:25:58.254 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:25:58.254 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:25:58.254 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/0/block", 2024-09-16T03:25:58.254 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:25:58.254 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:25:58.254 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:25:58.254 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:25:58.254 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:25:58.254 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:25:58.254 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:25:58.254 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:25:58.254 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:25:58.254 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:25:58.255 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:22:53.662571Z", 2024-09-16T03:25:58.255 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:25:58.255 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:25:58.255 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:25:58.255 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:25:58.255 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:25:58.255 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:25:58.255 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:25:58.255 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]", 2024-09-16T03:25:58.255 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:25:58.255 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]", 2024-09-16T03:25:58.255 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]", 2024-09-16T03:25:58.255 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:25:58.255 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:25:58.256 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:25:58.256 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:25:58.256 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:25:58.256 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:25:58.256 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:25:58.256 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:25:58.256 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:25:58.256 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/0", 2024-09-16T03:25:58.256 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:25:58.256 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:25:58.256 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:25:58.256 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.256 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.256 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:25:58.257 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:25:58.257 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]", 2024-09-16T03:25:58.257 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:25:58.257 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:25:58.257 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:25:58.257 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:25:58.257 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:25:58.257 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:25:58.257 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:25:58.257 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:25:58.257 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:25:58.257 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:25:58.257 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:25:58.258 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/1/block", 2024-09-16T03:25:58.258 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:25:58.258 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:25:58.258 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:25:58.258 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:25:58.258 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:25:58.258 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:25:58.258 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:25:58.258 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:25:58.258 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:25:58.258 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:25:58.258 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:23:30.129885Z", 2024-09-16T03:25:58.258 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:25:58.258 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:25:58.258 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:25:58.259 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:25:58.259 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:25:58.259 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:25:58.259 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:25:58.259 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]", 2024-09-16T03:25:58.259 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:25:58.259 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]", 2024-09-16T03:25:58.259 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]", 2024-09-16T03:25:58.259 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:25:58.259 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:25:58.259 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:25:58.259 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:25:58.260 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:25:58.260 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:25:58.260 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:25:58.260 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:25:58.260 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:25:58.260 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/1", 2024-09-16T03:25:58.260 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:25:58.260 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:25:58.260 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:25:58.260 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.260 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.260 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:25:58.260 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:25:58.260 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]", 2024-09-16T03:25:58.261 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:25:58.261 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:25:58.261 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:25:58.261 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:25:58.261 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:25:58.261 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:25:58.261 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:25:58.261 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:25:58.261 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:25:58.261 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:25:58.261 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:25:58.261 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/2/block", 2024-09-16T03:25:58.261 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:25:58.262 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:25:58.262 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:25:58.262 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:25:58.262 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:25:58.262 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:25:58.262 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:25:58.262 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:25:58.262 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:25:58.262 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:25:58.262 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:24:07.764502Z", 2024-09-16T03:25:58.262 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:25:58.262 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:25:58.262 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:25:58.262 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:25:58.263 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:25:58.263 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:25:58.263 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:25:58.263 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]", 2024-09-16T03:25:58.263 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:25:58.263 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]", 2024-09-16T03:25:58.263 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]", 2024-09-16T03:25:58.263 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:25:58.263 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:25:58.263 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:25:58.263 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:25:58.263 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:25:58.263 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:25:58.263 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:25:58.264 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:25:58.264 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:25:58.264 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/2", 2024-09-16T03:25:58.264 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:25:58.264 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:25:58.264 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:25:58.264 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:58.264 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:58.264 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_clean_epochs": { 2024-09-16T03:25:58.264 INFO:tasks.workunit.client.0.smithi096.stderr: "min_last_epoch_clean": 28, 2024-09-16T03:25:58.264 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": { 2024-09-16T03:25:58.264 INFO:tasks.workunit.client.0.smithi096.stderr: "per_pool": [ 2024-09-16T03:25:58.265 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.265 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 1, 2024-09-16T03:25:58.265 INFO:tasks.workunit.client.0.smithi096.stderr: "floor": 28 2024-09-16T03:25:58.265 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.265 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.265 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 2, 2024-09-16T03:25:58.265 INFO:tasks.workunit.client.0.smithi096.stderr: "floor": 28 2024-09-16T03:25:58.265 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:58.265 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:58.265 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.265 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_epochs": [ 2024-09-16T03:25:58.265 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.265 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:25:58.265 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 78 2024-09-16T03:25:58.266 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.266 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.266 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:25:58.266 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 80 2024-09-16T03:25:58.266 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:58.266 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:58.266 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.266 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_first_committed": 28, 2024-09-16T03:25:58.266 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_last_committed": 83, 2024-09-16T03:25:58.266 INFO:tasks.workunit.client.0.smithi096.stderr: "crushmap": { 2024-09-16T03:25:58.266 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": [ 2024-09-16T03:25:58.266 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.266 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:25:58.266 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.0", 2024-09-16T03:25:58.267 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:25:58.267 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.267 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.267 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:25:58.267 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.1", 2024-09-16T03:25:58.267 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:25:58.267 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.267 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.267 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:25:58.267 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.2", 2024-09-16T03:25:58.267 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:25:58.267 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:58.267 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:58.268 INFO:tasks.workunit.client.0.smithi096.stderr: "types": [ 2024-09-16T03:25:58.268 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.268 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 0, 2024-09-16T03:25:58.268 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd" 2024-09-16T03:25:58.268 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.268 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.268 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:25:58.268 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "host" 2024-09-16T03:25:58.268 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.268 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.268 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 2, 2024-09-16T03:25:58.268 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "chassis" 2024-09-16T03:25:58.268 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.268 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.269 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 3, 2024-09-16T03:25:58.269 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "rack" 2024-09-16T03:25:58.269 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.269 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.269 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 4, 2024-09-16T03:25:58.269 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "row" 2024-09-16T03:25:58.269 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.269 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.269 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 5, 2024-09-16T03:25:58.269 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "pdu" 2024-09-16T03:25:58.269 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.269 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.269 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 6, 2024-09-16T03:25:58.269 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "pod" 2024-09-16T03:25:58.270 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.270 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.270 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 7, 2024-09-16T03:25:58.270 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "room" 2024-09-16T03:25:58.270 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.270 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.270 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 8, 2024-09-16T03:25:58.270 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "datacenter" 2024-09-16T03:25:58.270 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.270 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.270 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 9, 2024-09-16T03:25:58.270 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "zone" 2024-09-16T03:25:58.270 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.271 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.271 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 10, 2024-09-16T03:25:58.271 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "region" 2024-09-16T03:25:58.271 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.271 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.271 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:25:58.271 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "root" 2024-09-16T03:25:58.271 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:58.271 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:58.271 INFO:tasks.workunit.client.0.smithi096.stderr: "buckets": [ 2024-09-16T03:25:58.271 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.271 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -1, 2024-09-16T03:25:58.271 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "default", 2024-09-16T03:25:58.272 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:25:58.272 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "root", 2024-09-16T03:25:58.272 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:25:58.272 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:25:58.272 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:25:58.272 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:25:58.272 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.272 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -3, 2024-09-16T03:25:58.272 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:25:58.272 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:25:58.272 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:58.272 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:58.272 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.273 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.273 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -2, 2024-09-16T03:25:58.273 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "default~hdd", 2024-09-16T03:25:58.273 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:25:58.273 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "root", 2024-09-16T03:25:58.273 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:25:58.273 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:25:58.273 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:25:58.273 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:25:58.273 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.273 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -4, 2024-09-16T03:25:58.273 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:25:58.273 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:25:58.274 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:58.274 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:58.274 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.274 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.274 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -3, 2024-09-16T03:25:58.274 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "smithi096", 2024-09-16T03:25:58.274 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:25:58.274 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "host", 2024-09-16T03:25:58.274 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:25:58.274 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:25:58.274 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:25:58.274 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:25:58.274 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.274 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:25:58.275 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:25:58.275 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:25:58.275 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.275 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.275 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:25:58.275 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:25:58.275 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 1 2024-09-16T03:25:58.275 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.275 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.275 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:25:58.275 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:25:58.275 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 2 2024-09-16T03:25:58.275 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:58.275 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:58.275 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.276 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.276 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -4, 2024-09-16T03:25:58.276 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "smithi096~hdd", 2024-09-16T03:25:58.276 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:25:58.276 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "host", 2024-09-16T03:25:58.276 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:25:58.276 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:25:58.276 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:25:58.276 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:25:58.276 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.276 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:25:58.276 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:25:58.276 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:25:58.276 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.277 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.277 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:25:58.277 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:25:58.277 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 1 2024-09-16T03:25:58.277 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.277 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.277 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:25:58.277 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:25:58.277 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 2 2024-09-16T03:25:58.277 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:58.277 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:58.277 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:58.277 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:58.278 INFO:tasks.workunit.client.0.smithi096.stderr: "rules": [ 2024-09-16T03:25:58.278 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.278 INFO:tasks.workunit.client.0.smithi096.stderr: "rule_id": 0, 2024-09-16T03:25:58.278 INFO:tasks.workunit.client.0.smithi096.stderr: "rule_name": "replicated_rule", 2024-09-16T03:25:58.278 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:25:58.278 INFO:tasks.workunit.client.0.smithi096.stderr: "steps": [ 2024-09-16T03:25:58.278 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.278 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "take", 2024-09-16T03:25:58.278 INFO:tasks.workunit.client.0.smithi096.stderr: "item": -1, 2024-09-16T03:25:58.278 INFO:tasks.workunit.client.0.smithi096.stderr: "item_name": "default" 2024-09-16T03:25:58.278 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.278 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.279 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "choose_firstn", 2024-09-16T03:25:58.279 INFO:tasks.workunit.client.0.smithi096.stderr: "num": 0, 2024-09-16T03:25:58.279 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "osd" 2024-09-16T03:25:58.279 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.279 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.279 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "emit" 2024-09-16T03:25:58.279 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:58.279 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:58.279 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:58.279 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:58.279 INFO:tasks.workunit.client.0.smithi096.stderr: "tunables": { 2024-09-16T03:25:58.280 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_local_tries": 0, 2024-09-16T03:25:58.280 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_local_fallback_tries": 0, 2024-09-16T03:25:58.280 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_total_tries": 50, 2024-09-16T03:25:58.280 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_descend_once": 1, 2024-09-16T03:25:58.280 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_vary_r": 1, 2024-09-16T03:25:58.280 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_stable": 1, 2024-09-16T03:25:58.280 INFO:tasks.workunit.client.0.smithi096.stderr: "msr_descents": 100, 2024-09-16T03:25:58.280 INFO:tasks.workunit.client.0.smithi096.stderr: "msr_collision_tries": 100, 2024-09-16T03:25:58.280 INFO:tasks.workunit.client.0.smithi096.stderr: "straw_calc_version": 1, 2024-09-16T03:25:58.280 INFO:tasks.workunit.client.0.smithi096.stderr: "allowed_bucket_algs": 54, 2024-09-16T03:25:58.280 INFO:tasks.workunit.client.0.smithi096.stderr: "profile": "jewel", 2024-09-16T03:25:58.281 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_tunables": 1, 2024-09-16T03:25:58.281 INFO:tasks.workunit.client.0.smithi096.stderr: "legacy_tunables": 0, 2024-09-16T03:25:58.281 INFO:tasks.workunit.client.0.smithi096.stderr: "minimum_required_version": "jewel", 2024-09-16T03:25:58.281 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables": 1, 2024-09-16T03:25:58.281 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables2": 1, 2024-09-16T03:25:58.281 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v2_rules": 0, 2024-09-16T03:25:58.281 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables3": 1, 2024-09-16T03:25:58.281 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v3_rules": 0, 2024-09-16T03:25:58.281 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v4_buckets": 1, 2024-09-16T03:25:58.281 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables5": 1, 2024-09-16T03:25:58.281 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v5_rules": 0, 2024-09-16T03:25:58.281 INFO:tasks.workunit.client.0.smithi096.stderr: "has_msr_rules": 0 2024-09-16T03:25:58.282 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.282 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_args": {} 2024-09-16T03:25:58.282 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.282 INFO:tasks.workunit.client.0.smithi096.stderr: "fsmap": { 2024-09-16T03:25:58.282 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 1, 2024-09-16T03:25:58.282 INFO:tasks.workunit.client.0.smithi096.stderr: "btime": "2024-09-16T03:22:46:882186+0000", 2024-09-16T03:25:58.282 INFO:tasks.workunit.client.0.smithi096.stderr: "default_fscid": -1, 2024-09-16T03:25:58.282 INFO:tasks.workunit.client.0.smithi096.stderr: "compat": { 2024-09-16T03:25:58.282 INFO:tasks.workunit.client.0.smithi096.stderr: "compat": {}, 2024-09-16T03:25:58.282 INFO:tasks.workunit.client.0.smithi096.stderr: "ro_compat": {}, 2024-09-16T03:25:58.282 INFO:tasks.workunit.client.0.smithi096.stderr: "incompat": { 2024-09-16T03:25:58.282 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_1": "base v0.20", 2024-09-16T03:25:58.282 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_2": "client writeable ranges", 2024-09-16T03:25:58.283 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_3": "default file layouts on dirs", 2024-09-16T03:25:58.283 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_4": "dir inode in separate object", 2024-09-16T03:25:58.283 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_5": "mds uses versioned encoding", 2024-09-16T03:25:58.283 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_6": "dirfrag is stored in omap", 2024-09-16T03:25:58.283 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_8": "no anchor table", 2024-09-16T03:25:58.283 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_9": "file layout v2", 2024-09-16T03:25:58.283 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_10": "snaprealm v2", 2024-09-16T03:25:58.283 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_11": "minor log segments", 2024-09-16T03:25:58.283 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_12": "quiesce subvolumes" 2024-09-16T03:25:58.283 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:58.283 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.283 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_flags": { 2024-09-16T03:25:58.283 INFO:tasks.workunit.client.0.smithi096.stderr: "enable_multiple": true, 2024-09-16T03:25:58.284 INFO:tasks.workunit.client.0.smithi096.stderr: "ever_enabled_multiple": true 2024-09-16T03:25:58.284 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.284 INFO:tasks.workunit.client.0.smithi096.stderr: "standbys": [], 2024-09-16T03:25:58.284 INFO:tasks.workunit.client.0.smithi096.stderr: "filesystems": [] 2024-09-16T03:25:58.284 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.284 INFO:tasks.workunit.client.0.smithi096.stderr: "mdsmap_first_committed": 1, 2024-09-16T03:25:58.284 INFO:tasks.workunit.client.0.smithi096.stderr: "mdsmap_last_committed": 1, 2024-09-16T03:25:58.284 INFO:tasks.workunit.client.0.smithi096.stderr: "auth": { 2024-09-16T03:25:58.284 INFO:tasks.workunit.client.0.smithi096.stderr: "first_committed": 1, 2024-09-16T03:25:58.284 INFO:tasks.workunit.client.0.smithi096.stderr: "last_committed": 5, 2024-09-16T03:25:58.284 INFO:tasks.workunit.client.0.smithi096.stderr: "num_secrets": 3 2024-09-16T03:25:58.284 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.284 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 64, 2024-09-16T03:25:58.284 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_active": 64, 2024-09-16T03:25:58.285 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_unknown": 0, 2024-09-16T03:25:58.285 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osd": 3, 2024-09-16T03:25:58.285 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_sum": { 2024-09-16T03:25:58.285 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:25:58.285 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:25:58.285 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:25:58.285 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:25:58.285 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:25:58.285 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:25:58.285 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:25:58.285 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:25:58.285 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:25:58.285 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:25:58.285 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:25:58.286 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:25:58.286 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:25:58.286 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:25:58.286 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:25:58.286 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:25:58.286 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:25:58.286 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:25:58.286 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:25:58.286 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:25:58.286 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:25:58.286 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:25:58.286 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:25:58.286 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:25:58.287 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:25:58.287 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:25:58.287 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:25:58.287 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:25:58.287 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:25:58.287 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:25:58.287 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:25:58.287 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:25:58.287 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:25:58.287 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:25:58.287 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:25:58.287 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:25:58.287 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:25:58.287 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:25:58.288 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:25:58.288 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:25:58.288 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:25:58.288 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.288 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:25:58.288 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:25:58.288 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:25:58.288 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:25:58.288 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:25:58.288 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:25:58.288 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:25:58.288 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:25:58.288 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:25:58.288 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:25:58.289 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:25:58.289 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.289 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:25:58.289 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:25:58.289 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 128, 2024-09-16T03:25:58.289 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 128, 2024-09-16T03:25:58.289 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 0 2024-09-16T03:25:58.289 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.289 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_sum": { 2024-09-16T03:25:58.289 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 0, 2024-09-16T03:25:58.289 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 0, 2024-09-16T03:25:58.289 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pgs": 128, 2024-09-16T03:25:58.289 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osds": 2, 2024-09-16T03:25:58.290 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_osds": 2, 2024-09-16T03:25:58.290 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_omap_osds": 2, 2024-09-16T03:25:58.290 INFO:tasks.workunit.client.0.smithi096.stderr: "kb": 209715200, 2024-09-16T03:25:58.290 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used": 54568, 2024-09-16T03:25:58.290 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_data": 856, 2024-09-16T03:25:58.290 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_omap": 3, 2024-09-16T03:25:58.290 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_meta": 53628, 2024-09-16T03:25:58.290 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_avail": 209660632, 2024-09-16T03:25:58.290 INFO:tasks.workunit.client.0.smithi096.stderr: "statfs": { 2024-09-16T03:25:58.290 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 214748364800, 2024-09-16T03:25:58.290 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 214692487168, 2024-09-16T03:25:58.290 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:25:58.291 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 876544, 2024-09-16T03:25:58.291 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 327566, 2024-09-16T03:25:58.291 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:25:58.291 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:25:58.291 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:25:58.291 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 3190, 2024-09-16T03:25:58.291 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 54915978 2024-09-16T03:25:58.291 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.291 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_peers": [], 2024-09-16T03:25:58.291 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_trim_queue_len": 0, 2024-09-16T03:25:58.291 INFO:tasks.workunit.client.0.smithi096.stderr: "num_snap_trimming": 0, 2024-09-16T03:25:58.291 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shards_repaired": 0, 2024-09-16T03:25:58.291 INFO:tasks.workunit.client.0.smithi096.stderr: "op_queue_age_hist": { 2024-09-16T03:25:58.291 INFO:tasks.workunit.client.0.smithi096.stderr: "histogram": [], 2024-09-16T03:25:58.292 INFO:tasks.workunit.client.0.smithi096.stderr: "upper_bound": 1 2024-09-16T03:25:58.292 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.292 INFO:tasks.workunit.client.0.smithi096.stderr: "perf_stat": { 2024-09-16T03:25:58.292 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ms": 219, 2024-09-16T03:25:58.292 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ms": 219, 2024-09-16T03:25:58.292 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ns": 219000000, 2024-09-16T03:25:58.292 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ns": 219000000 2024-09-16T03:25:58.292 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.292 INFO:tasks.workunit.client.0.smithi096.stderr: "alerts": [], 2024-09-16T03:25:58.292 INFO:tasks.workunit.client.0.smithi096.stderr: "network_ping_times": [] 2024-09-16T03:25:58.292 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.292 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_sum_by_class": { 2024-09-16T03:25:58.292 INFO:tasks.workunit.client.0.smithi096.stderr: "hdd": { 2024-09-16T03:25:58.292 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 0, 2024-09-16T03:25:58.293 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 0, 2024-09-16T03:25:58.293 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pgs": 128, 2024-09-16T03:25:58.293 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osds": 2, 2024-09-16T03:25:58.293 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_osds": 2, 2024-09-16T03:25:58.293 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_omap_osds": 2, 2024-09-16T03:25:58.293 INFO:tasks.workunit.client.0.smithi096.stderr: "kb": 209715200, 2024-09-16T03:25:58.293 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used": 54568, 2024-09-16T03:25:58.293 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_data": 856, 2024-09-16T03:25:58.293 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_omap": 3, 2024-09-16T03:25:58.293 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_meta": 53628, 2024-09-16T03:25:58.293 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_avail": 209660632, 2024-09-16T03:25:58.293 INFO:tasks.workunit.client.0.smithi096.stderr: "statfs": { 2024-09-16T03:25:58.294 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 214748364800, 2024-09-16T03:25:58.294 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 214692487168, 2024-09-16T03:25:58.294 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:25:58.294 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 876544, 2024-09-16T03:25:58.294 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 327566, 2024-09-16T03:25:58.294 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:25:58.294 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:25:58.294 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:25:58.294 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 3190, 2024-09-16T03:25:58.294 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 54915978 2024-09-16T03:25:58.294 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.294 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_peers": [], 2024-09-16T03:25:58.294 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_trim_queue_len": 0, 2024-09-16T03:25:58.295 INFO:tasks.workunit.client.0.smithi096.stderr: "num_snap_trimming": 0, 2024-09-16T03:25:58.295 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shards_repaired": 0, 2024-09-16T03:25:58.295 INFO:tasks.workunit.client.0.smithi096.stderr: "op_queue_age_hist": { 2024-09-16T03:25:58.295 INFO:tasks.workunit.client.0.smithi096.stderr: "histogram": [], 2024-09-16T03:25:58.295 INFO:tasks.workunit.client.0.smithi096.stderr: "upper_bound": 1 2024-09-16T03:25:58.295 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.295 INFO:tasks.workunit.client.0.smithi096.stderr: "perf_stat": { 2024-09-16T03:25:58.295 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ms": 219, 2024-09-16T03:25:58.295 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ms": 219, 2024-09-16T03:25:58.295 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ns": 219000000, 2024-09-16T03:25:58.295 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ns": 219000000 2024-09-16T03:25:58.295 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.295 INFO:tasks.workunit.client.0.smithi096.stderr: "alerts": [], 2024-09-16T03:25:58.295 INFO:tasks.workunit.client.0.smithi096.stderr: "network_ping_times": [] 2024-09-16T03:25:58.296 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:58.296 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.296 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_stats": [ 2024-09-16T03:25:58.296 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.296 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 2, 2024-09-16T03:25:58.296 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 32, 2024-09-16T03:25:58.296 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:25:58.296 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:25:58.296 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:25:58.296 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:25:58.296 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:25:58.296 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:25:58.296 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:25:58.296 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:25:58.297 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:25:58.297 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:25:58.297 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:25:58.297 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:25:58.297 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:25:58.297 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:25:58.297 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:25:58.297 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:25:58.297 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:25:58.297 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:25:58.297 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:25:58.297 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:25:58.297 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:25:58.298 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:25:58.298 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:25:58.298 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:25:58.298 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:25:58.298 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:25:58.298 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:25:58.298 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:25:58.298 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:25:58.298 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:25:58.298 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:25:58.298 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:25:58.298 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:25:58.298 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:25:58.298 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:25:58.299 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:25:58.299 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:25:58.299 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:25:58.299 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:25:58.299 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:25:58.299 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:25:58.299 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.299 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:25:58.299 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:25:58.299 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:25:58.299 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:25:58.299 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:25:58.299 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:25:58.299 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:25:58.300 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:25:58.300 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:25:58.300 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:25:58.300 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:25:58.300 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.300 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:25:58.300 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:25:58.300 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 64, 2024-09-16T03:25:58.300 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 64, 2024-09-16T03:25:58.300 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 3 2024-09-16T03:25:58.300 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.300 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.300 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 1, 2024-09-16T03:25:58.301 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 32, 2024-09-16T03:25:58.301 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:25:58.301 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:25:58.301 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:25:58.301 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:25:58.301 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:25:58.302 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:25:58.302 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:25:58.302 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:25:58.302 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:25:58.302 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:25:58.302 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:25:58.302 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:25:58.302 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:25:58.302 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:25:58.302 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:25:58.302 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:25:58.302 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:25:58.303 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:25:58.303 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:25:58.303 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:25:58.303 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:25:58.303 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:25:58.303 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:25:58.303 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:25:58.303 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:25:58.303 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:25:58.303 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:25:58.303 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:25:58.304 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:25:58.304 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:25:58.304 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:25:58.304 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:25:58.304 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:25:58.304 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:25:58.304 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:25:58.304 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:25:58.304 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:25:58.304 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:25:58.304 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:25:58.305 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:25:58.305 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:25:58.305 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.305 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:25:58.305 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:25:58.305 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:25:58.305 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:25:58.305 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:25:58.305 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:25:58.305 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:25:58.305 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:25:58.305 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:25:58.306 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:25:58.306 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:25:58.306 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.306 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:25:58.306 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:25:58.306 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 64, 2024-09-16T03:25:58.306 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 64, 2024-09-16T03:25:58.306 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 3 2024-09-16T03:25:58.306 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:58.306 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:58.306 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_stats": [ 2024-09-16T03:25:58.306 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.306 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:25:58.306 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 21474836517 2024-09-16T03:25:58.307 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.307 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.307 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:25:58.307 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 42949672989 2024-09-16T03:25:58.307 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.307 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.307 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:25:58.307 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 0 2024-09-16T03:25:58.307 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:58.307 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:58.307 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_by_state": [ 2024-09-16T03:25:58.307 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.307 INFO:tasks.workunit.client.0.smithi096.stderr: "state": "active+undersized", 2024-09-16T03:25:58.308 INFO:tasks.workunit.client.0.smithi096.stderr: "num": 64 2024-09-16T03:25:58.308 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:58.308 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:58.308 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_by_osd": [ 2024-09-16T03:25:58.308 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.308 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:25:58.308 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 0, 2024-09-16T03:25:58.308 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 0, 2024-09-16T03:25:58.308 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:25:58.308 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.308 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.308 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:25:58.308 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 28, 2024-09-16T03:25:58.309 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 64, 2024-09-16T03:25:58.309 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:25:58.309 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.309 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.309 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:25:58.309 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 36, 2024-09-16T03:25:58.309 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 64, 2024-09-16T03:25:58.309 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:25:58.309 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:58.309 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:58.309 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": [ 2024-09-16T03:25:58.309 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.309 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 1, 2024-09-16T03:25:58.309 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": {} 2024-09-16T03:25:58.310 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.310 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.310 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 2, 2024-09-16T03:25:58.310 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": {} 2024-09-16T03:25:58.310 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:58.310 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:58.310 INFO:tasks.workunit.client.0.smithi096.stderr: "servicemap": { 2024-09-16T03:25:58.310 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 5, 2024-09-16T03:25:58.310 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:25:38.422788+0000", 2024-09-16T03:25:58.310 INFO:tasks.workunit.client.0.smithi096.stderr: "services": {} 2024-09-16T03:25:58.310 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.310 INFO:tasks.workunit.client.0.smithi096.stderr: "mgrstat_first_committed": 79, 2024-09-16T03:25:58.310 INFO:tasks.workunit.client.0.smithi096.stderr: "mgrstat_last_committed": 84, 2024-09-16T03:25:58.310 INFO:tasks.workunit.client.0.smithi096.stderr: "logm_first_committed": 1, 2024-09-16T03:25:58.311 INFO:tasks.workunit.client.0.smithi096.stderr: "logm_last_committed": 370, 2024-09-16T03:25:58.311 INFO:tasks.workunit.client.0.smithi096.stderr: "paxos": { 2024-09-16T03:25:58.311 INFO:tasks.workunit.client.0.smithi096.stderr: "first_committed": 1, 2024-09-16T03:25:58.311 INFO:tasks.workunit.client.0.smithi096.stderr: "last_committed": 553, 2024-09-16T03:25:58.311 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pn": 0, 2024-09-16T03:25:58.312 INFO:tasks.workunit.client.0.smithi096.stderr: "accepted_pn": 0 2024-09-16T03:25:58.312 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:58.312 INFO:tasks.workunit.client.0.smithi096.stderr:}' 2024-09-16T03:25:58.312 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:132: get_fc_lc_diff: jq .osdmap_first_committed 2024-09-16T03:25:58.315 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:132: get_fc_lc_diff: echo '{' '"cluster_fingerprint":' '"fda2fc64-07ed-4add-8224-2e527e11d427",' '"version":' '"19.3.0-4930-gfc3e0bff",' '"commit":' '"fc3e0bff7468fd55478adbae7f75508b749124b6",' '"timestamp":' '"2024-09-16T03:25:58.193170+0000",' '"tag":' '"",' '"health":' '{' '"status":' '"HEALTH_OK",' '"checks":' '{},' '"mutes":' '[]' '},' '"monmap_first_committed":' 1, '"monmap_last_committed":' 1, '"monmap":' '{' '"epoch":' 1, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"modified":' '"2024-09-16T03:22:45.872880Z",' '"created":' '"2024-09-16T03:22:45.872880Z",' '"min_mon_release":' 19, '"min_mon_release_name":' '"squid",' '"election_strategy":' 1, '"disallowed_leaders:' '":' '"",' '"stretch_mode":' false, '"tiebreaker_mon":' '"",' '"removed_ranks:' '":' '"",' '"features":' '{' '"persistent":' '[' '"kraken",' '"luminous",' '"mimic",' '"osdmap-prune",' '"nautilus",' '"octopus",' '"pacific",' '"elector-pinging",' '"quincy",' '"reef",' '"squid"' '],' '"optional":' '[]' '},' '"mons":' '[' '{' '"rank":' 0, '"name":' '"a",' '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:7302",' '"nonce":' 0 '}' ']' '},' '"addr":' '"127.0.0.1:7302/0",' '"public_addr":' '"127.0.0.1:7302/0",' '"priority":' 0, '"weight":' 0, '"crush_location":' '"{}"' '}' ']' '},' '"quorum":' '[' 0 '],' '"osdmap":' '{' '"epoch":' 83, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"created":' '"2024-09-16T03:22:46.906117+0000",' '"modified":' '"2024-09-16T03:25:57.328949+0000",' '"last_up_change":' '"2024-09-16T03:25:08.513363+0000",' '"last_in_change":' '"2024-09-16T03:25:09.839444+0000",' '"flags":' '"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit",' '"flags_num":' 5799936, '"flags_set":' '[' '"pglog_hardlimit",' '"purged_snapdirs",' '"recovery_deletes",' '"sortbitwise"' '],' '"crush_version":' 7, '"full_ratio":' 0.97000002861022949, '"backfillfull_ratio":' 0.97000002861022949, '"nearfull_ratio":' 0.85000002384185791, '"cluster_snapshot":' '"",' '"pool_max":' 2, '"max_osd":' 3, '"require_min_compat_client":' '"luminous",' '"min_compat_client":' '"jewel",' '"require_osd_release":' '"squid",' '"allow_crimson":' false, '"pools":' '[' '{' '"pool":' 1, '"pool_name":' '"foo",' '"create_time":' '"2024-09-16T03:24:44.525189+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"30",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.8700000047683716, '"score_stable":' 1.8700000047683716, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1.25, '"raw_score_stable":' 1.25, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '},' '{' '"pool":' 2, '"pool_name":' '"bar",' '"create_time":' '"2024-09-16T03:24:46.226575+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 2, '"min_size":' 1, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"83",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.4900000095367432, '"score_stable":' 1.4900000095367432, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1, '"raw_score_stable":' 1, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '}' '],' '"osds":' '[' '{' '"osd":' 0, '"uuid":' '"64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 5, '"up_thru":' 81, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6802",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6803",' '"nonce":' 3375787448 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6804",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6805",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6808",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6809",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6806",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6807",' '"nonce":' 3375787448 '}' ']' '},' '"public_addr":' '"127.0.0.1:6803/3375787448",' '"cluster_addr":' '"127.0.0.1:6805/3375787448",' '"heartbeat_back_addr":' '"127.0.0.1:6809/3375787448",' '"heartbeat_front_addr":' '"127.0.0.1:6807/3375787448",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 1, '"uuid":' '"74b26727-75c9-444d-8782-719e4197a382",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 10, '"up_thru":' 81, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6810",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6811",' '"nonce":' 3733255132 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6812",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6813",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6816",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6817",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6814",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6815",' '"nonce":' 3733255132 '}' ']' '},' '"public_addr":' '"127.0.0.1:6811/3733255132",' '"cluster_addr":' '"127.0.0.1:6813/3733255132",' '"heartbeat_back_addr":' '"127.0.0.1:6817/3733255132",' '"heartbeat_front_addr":' '"127.0.0.1:6815/3733255132",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 2, '"uuid":' '"143da3a7-dad9-4b1e-966b-76cf5bdd3c82",' '"up":' 0, '"in":' 0, '"weight":' 0, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 15, '"up_thru":' 21, '"down_at":' 33, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6818",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6819",' '"nonce":' 963814857 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6820",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6821",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6824",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6825",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6822",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6823",' '"nonce":' 963814857 '}' ']' '},' '"public_addr":' '"127.0.0.1:6819/963814857",' '"cluster_addr":' '"127.0.0.1:6821/963814857",' '"heartbeat_back_addr":' '"127.0.0.1:6825/963814857",' '"heartbeat_front_addr":' '"127.0.0.1:6823/963814857",' '"state":' '[' '"exists"' ']' '}' '],' '"osd_xinfo":' '[' '{' '"osd":' 0, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:22.481942+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 1, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:59.663703+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 2, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 65536, '"last_purged_snaps_scrub":' '"2024-09-16T03:24:37.320822+0000",' '"dead_epoch":' 32 '}' '],' '"pg_upmap":' '[],' '"pg_upmap_items":' '[],' '"pg_upmap_primaries":' '[],' '"pg_temp":' '[],' '"primary_temp":' '[],' '"blocklist":' '{},' '"range_blocklist":' '{},' '"erasure_code_profiles":' '{' '"default":' '{' '"k":' '"2",' '"m":' '"2",' '"plugin":' '"jerasure",' '"technique":' '"reed_sol_van"' '}' '},' '"removed_snaps_queue":' '[],' '"new_removed_snaps":' '[],' '"new_purged_snaps":' '[],' '"crush_node_flags":' '{},' '"device_class_flags":' '{},' '"stretch_mode":' '{' '"stretch_mode_enabled":' false, '"stretch_bucket_count":' 0, '"degraded_stretch_mode":' 0, '"recovering_stretch_mode":' 0, '"stretch_mode_bucket":' 0 '}' '},' '"osd_metadata":' '[' '{' '"id":' 0, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/0/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:22:53.662571Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]",' '"hb_front_addr":' '"[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/0",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 1, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/1/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:23:30.129885Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]",' '"hb_front_addr":' '"[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/1",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 2, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/2/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:24:07.764502Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]",' '"hb_front_addr":' '"[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/2",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '}' '],' '"osdmap_clean_epochs":' '{' '"min_last_epoch_clean":' 28, '"last_epoch_clean":' '{' '"per_pool":' '[' '{' '"poolid":' 1, '"floor":' 28 '},' '{' '"poolid":' 2, '"floor":' 28 '}' ']' '},' '"osd_epochs":' '[' '{' '"id":' 0, '"epoch":' 78 '},' '{' '"id":' 1, '"epoch":' 80 '}' ']' '},' '"osdmap_first_committed":' 28, '"osdmap_last_committed":' 83, '"crushmap":' '{' '"devices":' '[' '{' '"id":' 0, '"name":' '"osd.0",' '"class":' '"hdd"' '},' '{' '"id":' 1, '"name":' '"osd.1",' '"class":' '"hdd"' '},' '{' '"id":' 2, '"name":' '"osd.2",' '"class":' '"hdd"' '}' '],' '"types":' '[' '{' '"type_id":' 0, '"name":' '"osd"' '},' '{' '"type_id":' 1, '"name":' '"host"' '},' '{' '"type_id":' 2, '"name":' '"chassis"' '},' '{' '"type_id":' 3, '"name":' '"rack"' '},' '{' '"type_id":' 4, '"name":' '"row"' '},' '{' '"type_id":' 5, '"name":' '"pdu"' '},' '{' '"type_id":' 6, '"name":' '"pod"' '},' '{' '"type_id":' 7, '"name":' '"room"' '},' '{' '"type_id":' 8, '"name":' '"datacenter"' '},' '{' '"type_id":' 9, '"name":' '"zone"' '},' '{' '"type_id":' 10, '"name":' '"region"' '},' '{' '"type_id":' 11, '"name":' '"root"' '}' '],' '"buckets":' '[' '{' '"id":' -1, '"name":' '"default",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -3, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -2, '"name":' '"default~hdd",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -4, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -3, '"name":' '"smithi096",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '},' '{' '"id":' -4, '"name":' '"smithi096~hdd",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '}' '],' '"rules":' '[' '{' '"rule_id":' 0, '"rule_name":' '"replicated_rule",' '"type":' 1, '"steps":' '[' '{' '"op":' '"take",' '"item":' -1, '"item_name":' '"default"' '},' '{' '"op":' '"choose_firstn",' '"num":' 0, '"type":' '"osd"' '},' '{' '"op":' '"emit"' '}' ']' '}' '],' '"tunables":' '{' '"choose_local_tries":' 0, '"choose_local_fallback_tries":' 0, '"choose_total_tries":' 50, '"chooseleaf_descend_once":' 1, '"chooseleaf_vary_r":' 1, '"chooseleaf_stable":' 1, '"msr_descents":' 100, '"msr_collision_tries":' 100, '"straw_calc_version":' 1, '"allowed_bucket_algs":' 54, '"profile":' '"jewel",' '"optimal_tunables":' 1, '"legacy_tunables":' 0, '"minimum_required_version":' '"jewel",' '"require_feature_tunables":' 1, '"require_feature_tunables2":' 1, '"has_v2_rules":' 0, '"require_feature_tunables3":' 1, '"has_v3_rules":' 0, '"has_v4_buckets":' 1, '"require_feature_tunables5":' 1, '"has_v5_rules":' 0, '"has_msr_rules":' 0 '},' '"choose_args":' '{}' '},' '"fsmap":' '{' '"epoch":' 1, '"btime":' '"2024-09-16T03:22:46:882186+0000",' '"default_fscid":' -1, '"compat":' '{' '"compat":' '{},' '"ro_compat":' '{},' '"incompat":' '{' '"feature_1":' '"base' 'v0.20",' '"feature_2":' '"client' writeable 'ranges",' '"feature_3":' '"default' file layouts on 'dirs",' '"feature_4":' '"dir' inode in separate 'object",' '"feature_5":' '"mds' uses versioned 'encoding",' '"feature_6":' '"dirfrag' is stored in 'omap",' '"feature_8":' '"no' anchor 'table",' '"feature_9":' '"file' layout 'v2",' '"feature_10":' '"snaprealm' 'v2",' '"feature_11":' '"minor' log 'segments",' '"feature_12":' '"quiesce' 'subvolumes"' '}' '},' '"feature_flags":' '{' '"enable_multiple":' true, '"ever_enabled_multiple":' true '},' '"standbys":' '[],' '"filesystems":' '[]' '},' '"mdsmap_first_committed":' 1, '"mdsmap_last_committed":' 1, '"auth":' '{' '"first_committed":' 1, '"last_committed":' 5, '"num_secrets":' 3 '},' '"num_pg":' 64, '"num_pg_active":' 64, '"num_pg_unknown":' 0, '"num_osd":' 3, '"pool_sum":' '{' '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 128, '"acting":' 128, '"num_store_stats":' 0 '},' '"osd_sum":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54568, '"kb_used_data":' 856, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660632, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692487168, '"internally_reserved":' 0, '"allocated":' 876544, '"data_stored":' 327566, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 219, '"apply_latency_ms":' 219, '"commit_latency_ns":' 219000000, '"apply_latency_ns":' 219000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '},' '"osd_sum_by_class":' '{' '"hdd":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54568, '"kb_used_data":' 856, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660632, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692487168, '"internally_reserved":' 0, '"allocated":' 876544, '"data_stored":' 327566, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 219, '"apply_latency_ms":' 219, '"commit_latency_ns":' 219000000, '"apply_latency_ns":' 219000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '}' '},' '"pool_stats":' '[' '{' '"poolid":' 2, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '},' '{' '"poolid":' 1, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '}' '],' '"osd_stats":' '[' '{' '"osd":' 0, '"seq":' 21474836517 '},' '{' '"osd":' 1, '"seq":' 42949672989 '},' '{' '"osd":' 2, '"seq":' 0 '}' '],' '"num_pg_by_state":' '[' '{' '"state":' '"active+undersized",' '"num":' 64 '}' '],' '"num_pg_by_osd":' '[' '{' '"osd":' 2, '"num_primary_pg":' 0, '"num_acting_pg":' 0, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 0, '"num_primary_pg":' 28, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 1, '"num_primary_pg":' 36, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '}' '],' '"purged_snaps":' '[' '{' '"pool":' 1, '"purged_snaps":' '{}' '},' '{' '"pool":' 2, '"purged_snaps":' '{}' '}' '],' '"servicemap":' '{' '"epoch":' 5, '"modified":' '"2024-09-16T03:25:38.422788+0000",' '"services":' '{}' '},' '"mgrstat_first_committed":' 79, '"mgrstat_last_committed":' 84, '"logm_first_committed":' 1, '"logm_last_committed":' 370, '"paxos":' '{' '"first_committed":' 1, '"last_committed":' 553, '"last_pn":' 0, '"accepted_pn":' 0 '}' '}' 2024-09-16T03:25:58.315 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:132: get_fc_lc_diff: osdm_fc=28 2024-09-16T03:25:58.315 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:134: get_fc_lc_diff: jq .osdmap_last_committed 2024-09-16T03:25:58.315 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:134: get_fc_lc_diff: echo '{' '"cluster_fingerprint":' '"fda2fc64-07ed-4add-8224-2e527e11d427",' '"version":' '"19.3.0-4930-gfc3e0bff",' '"commit":' '"fc3e0bff7468fd55478adbae7f75508b749124b6",' '"timestamp":' '"2024-09-16T03:25:58.193170+0000",' '"tag":' '"",' '"health":' '{' '"status":' '"HEALTH_OK",' '"checks":' '{},' '"mutes":' '[]' '},' '"monmap_first_committed":' 1, '"monmap_last_committed":' 1, '"monmap":' '{' '"epoch":' 1, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"modified":' '"2024-09-16T03:22:45.872880Z",' '"created":' '"2024-09-16T03:22:45.872880Z",' '"min_mon_release":' 19, '"min_mon_release_name":' '"squid",' '"election_strategy":' 1, '"disallowed_leaders:' '":' '"",' '"stretch_mode":' false, '"tiebreaker_mon":' '"",' '"removed_ranks:' '":' '"",' '"features":' '{' '"persistent":' '[' '"kraken",' '"luminous",' '"mimic",' '"osdmap-prune",' '"nautilus",' '"octopus",' '"pacific",' '"elector-pinging",' '"quincy",' '"reef",' '"squid"' '],' '"optional":' '[]' '},' '"mons":' '[' '{' '"rank":' 0, '"name":' '"a",' '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:7302",' '"nonce":' 0 '}' ']' '},' '"addr":' '"127.0.0.1:7302/0",' '"public_addr":' '"127.0.0.1:7302/0",' '"priority":' 0, '"weight":' 0, '"crush_location":' '"{}"' '}' ']' '},' '"quorum":' '[' 0 '],' '"osdmap":' '{' '"epoch":' 83, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"created":' '"2024-09-16T03:22:46.906117+0000",' '"modified":' '"2024-09-16T03:25:57.328949+0000",' '"last_up_change":' '"2024-09-16T03:25:08.513363+0000",' '"last_in_change":' '"2024-09-16T03:25:09.839444+0000",' '"flags":' '"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit",' '"flags_num":' 5799936, '"flags_set":' '[' '"pglog_hardlimit",' '"purged_snapdirs",' '"recovery_deletes",' '"sortbitwise"' '],' '"crush_version":' 7, '"full_ratio":' 0.97000002861022949, '"backfillfull_ratio":' 0.97000002861022949, '"nearfull_ratio":' 0.85000002384185791, '"cluster_snapshot":' '"",' '"pool_max":' 2, '"max_osd":' 3, '"require_min_compat_client":' '"luminous",' '"min_compat_client":' '"jewel",' '"require_osd_release":' '"squid",' '"allow_crimson":' false, '"pools":' '[' '{' '"pool":' 1, '"pool_name":' '"foo",' '"create_time":' '"2024-09-16T03:24:44.525189+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"30",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.8700000047683716, '"score_stable":' 1.8700000047683716, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1.25, '"raw_score_stable":' 1.25, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '},' '{' '"pool":' 2, '"pool_name":' '"bar",' '"create_time":' '"2024-09-16T03:24:46.226575+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 2, '"min_size":' 1, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"83",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.4900000095367432, '"score_stable":' 1.4900000095367432, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1, '"raw_score_stable":' 1, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '}' '],' '"osds":' '[' '{' '"osd":' 0, '"uuid":' '"64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 5, '"up_thru":' 81, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6802",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6803",' '"nonce":' 3375787448 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6804",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6805",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6808",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6809",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6806",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6807",' '"nonce":' 3375787448 '}' ']' '},' '"public_addr":' '"127.0.0.1:6803/3375787448",' '"cluster_addr":' '"127.0.0.1:6805/3375787448",' '"heartbeat_back_addr":' '"127.0.0.1:6809/3375787448",' '"heartbeat_front_addr":' '"127.0.0.1:6807/3375787448",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 1, '"uuid":' '"74b26727-75c9-444d-8782-719e4197a382",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 10, '"up_thru":' 81, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6810",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6811",' '"nonce":' 3733255132 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6812",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6813",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6816",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6817",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6814",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6815",' '"nonce":' 3733255132 '}' ']' '},' '"public_addr":' '"127.0.0.1:6811/3733255132",' '"cluster_addr":' '"127.0.0.1:6813/3733255132",' '"heartbeat_back_addr":' '"127.0.0.1:6817/3733255132",' '"heartbeat_front_addr":' '"127.0.0.1:6815/3733255132",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 2, '"uuid":' '"143da3a7-dad9-4b1e-966b-76cf5bdd3c82",' '"up":' 0, '"in":' 0, '"weight":' 0, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 15, '"up_thru":' 21, '"down_at":' 33, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6818",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6819",' '"nonce":' 963814857 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6820",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6821",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6824",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6825",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6822",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6823",' '"nonce":' 963814857 '}' ']' '},' '"public_addr":' '"127.0.0.1:6819/963814857",' '"cluster_addr":' '"127.0.0.1:6821/963814857",' '"heartbeat_back_addr":' '"127.0.0.1:6825/963814857",' '"heartbeat_front_addr":' '"127.0.0.1:6823/963814857",' '"state":' '[' '"exists"' ']' '}' '],' '"osd_xinfo":' '[' '{' '"osd":' 0, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:22.481942+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 1, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:59.663703+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 2, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 65536, '"last_purged_snaps_scrub":' '"2024-09-16T03:24:37.320822+0000",' '"dead_epoch":' 32 '}' '],' '"pg_upmap":' '[],' '"pg_upmap_items":' '[],' '"pg_upmap_primaries":' '[],' '"pg_temp":' '[],' '"primary_temp":' '[],' '"blocklist":' '{},' '"range_blocklist":' '{},' '"erasure_code_profiles":' '{' '"default":' '{' '"k":' '"2",' '"m":' '"2",' '"plugin":' '"jerasure",' '"technique":' '"reed_sol_van"' '}' '},' '"removed_snaps_queue":' '[],' '"new_removed_snaps":' '[],' '"new_purged_snaps":' '[],' '"crush_node_flags":' '{},' '"device_class_flags":' '{},' '"stretch_mode":' '{' '"stretch_mode_enabled":' false, '"stretch_bucket_count":' 0, '"degraded_stretch_mode":' 0, '"recovering_stretch_mode":' 0, '"stretch_mode_bucket":' 0 '}' '},' '"osd_metadata":' '[' '{' '"id":' 0, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/0/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:22:53.662571Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]",' '"hb_front_addr":' '"[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/0",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 1, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/1/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:23:30.129885Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]",' '"hb_front_addr":' '"[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/1",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 2, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/2/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:24:07.764502Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]",' '"hb_front_addr":' '"[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/2",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '}' '],' '"osdmap_clean_epochs":' '{' '"min_last_epoch_clean":' 28, '"last_epoch_clean":' '{' '"per_pool":' '[' '{' '"poolid":' 1, '"floor":' 28 '},' '{' '"poolid":' 2, '"floor":' 28 '}' ']' '},' '"osd_epochs":' '[' '{' '"id":' 0, '"epoch":' 78 '},' '{' '"id":' 1, '"epoch":' 80 '}' ']' '},' '"osdmap_first_committed":' 28, '"osdmap_last_committed":' 83, '"crushmap":' '{' '"devices":' '[' '{' '"id":' 0, '"name":' '"osd.0",' '"class":' '"hdd"' '},' '{' '"id":' 1, '"name":' '"osd.1",' '"class":' '"hdd"' '},' '{' '"id":' 2, '"name":' '"osd.2",' '"class":' '"hdd"' '}' '],' '"types":' '[' '{' '"type_id":' 0, '"name":' '"osd"' '},' '{' '"type_id":' 1, '"name":' '"host"' '},' '{' '"type_id":' 2, '"name":' '"chassis"' '},' '{' '"type_id":' 3, '"name":' '"rack"' '},' '{' '"type_id":' 4, '"name":' '"row"' '},' '{' '"type_id":' 5, '"name":' '"pdu"' '},' '{' '"type_id":' 6, '"name":' '"pod"' '},' '{' '"type_id":' 7, '"name":' '"room"' '},' '{' '"type_id":' 8, '"name":' '"datacenter"' '},' '{' '"type_id":' 9, '"name":' '"zone"' '},' '{' '"type_id":' 10, '"name":' '"region"' '},' '{' '"type_id":' 11, '"name":' '"root"' '}' '],' '"buckets":' '[' '{' '"id":' -1, '"name":' '"default",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -3, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -2, '"name":' '"default~hdd",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -4, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -3, '"name":' '"smithi096",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '},' '{' '"id":' -4, '"name":' '"smithi096~hdd",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '}' '],' '"rules":' '[' '{' '"rule_id":' 0, '"rule_name":' '"replicated_rule",' '"type":' 1, '"steps":' '[' '{' '"op":' '"take",' '"item":' -1, '"item_name":' '"default"' '},' '{' '"op":' '"choose_firstn",' '"num":' 0, '"type":' '"osd"' '},' '{' '"op":' '"emit"' '}' ']' '}' '],' '"tunables":' '{' '"choose_local_tries":' 0, '"choose_local_fallback_tries":' 0, '"choose_total_tries":' 50, '"chooseleaf_descend_once":' 1, '"chooseleaf_vary_r":' 1, '"chooseleaf_stable":' 1, '"msr_descents":' 100, '"msr_collision_tries":' 100, '"straw_calc_version":' 1, '"allowed_bucket_algs":' 54, '"profile":' '"jewel",' '"optimal_tunables":' 1, '"legacy_tunables":' 0, '"minimum_required_version":' '"jewel",' '"require_feature_tunables":' 1, '"require_feature_tunables2":' 1, '"has_v2_rules":' 0, '"require_feature_tunables3":' 1, '"has_v3_rules":' 0, '"has_v4_buckets":' 1, '"require_feature_tunables5":' 1, '"has_v5_rules":' 0, '"has_msr_rules":' 0 '},' '"choose_args":' '{}' '},' '"fsmap":' '{' '"epoch":' 1, '"btime":' '"2024-09-16T03:22:46:882186+0000",' '"default_fscid":' -1, '"compat":' '{' '"compat":' '{},' '"ro_compat":' '{},' '"incompat":' '{' '"feature_1":' '"base' 'v0.20",' '"feature_2":' '"client' writeable 'ranges",' '"feature_3":' '"default' file layouts on 'dirs",' '"feature_4":' '"dir' inode in separate 'object",' '"feature_5":' '"mds' uses versioned 'encoding",' '"feature_6":' '"dirfrag' is stored in 'omap",' '"feature_8":' '"no' anchor 'table",' '"feature_9":' '"file' layout 'v2",' '"feature_10":' '"snaprealm' 'v2",' '"feature_11":' '"minor' log 'segments",' '"feature_12":' '"quiesce' 'subvolumes"' '}' '},' '"feature_flags":' '{' '"enable_multiple":' true, '"ever_enabled_multiple":' true '},' '"standbys":' '[],' '"filesystems":' '[]' '},' '"mdsmap_first_committed":' 1, '"mdsmap_last_committed":' 1, '"auth":' '{' '"first_committed":' 1, '"last_committed":' 5, '"num_secrets":' 3 '},' '"num_pg":' 64, '"num_pg_active":' 64, '"num_pg_unknown":' 0, '"num_osd":' 3, '"pool_sum":' '{' '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 128, '"acting":' 128, '"num_store_stats":' 0 '},' '"osd_sum":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54568, '"kb_used_data":' 856, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660632, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692487168, '"internally_reserved":' 0, '"allocated":' 876544, '"data_stored":' 327566, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 219, '"apply_latency_ms":' 219, '"commit_latency_ns":' 219000000, '"apply_latency_ns":' 219000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '},' '"osd_sum_by_class":' '{' '"hdd":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54568, '"kb_used_data":' 856, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660632, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692487168, '"internally_reserved":' 0, '"allocated":' 876544, '"data_stored":' 327566, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 219, '"apply_latency_ms":' 219, '"commit_latency_ns":' 219000000, '"apply_latency_ns":' 219000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '}' '},' '"pool_stats":' '[' '{' '"poolid":' 2, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '},' '{' '"poolid":' 1, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '}' '],' '"osd_stats":' '[' '{' '"osd":' 0, '"seq":' 21474836517 '},' '{' '"osd":' 1, '"seq":' 42949672989 '},' '{' '"osd":' 2, '"seq":' 0 '}' '],' '"num_pg_by_state":' '[' '{' '"state":' '"active+undersized",' '"num":' 64 '}' '],' '"num_pg_by_osd":' '[' '{' '"osd":' 2, '"num_primary_pg":' 0, '"num_acting_pg":' 0, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 0, '"num_primary_pg":' 28, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 1, '"num_primary_pg":' 36, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '}' '],' '"purged_snaps":' '[' '{' '"pool":' 1, '"purged_snaps":' '{}' '},' '{' '"pool":' 2, '"purged_snaps":' '{}' '}' '],' '"servicemap":' '{' '"epoch":' 5, '"modified":' '"2024-09-16T03:25:38.422788+0000",' '"services":' '{}' '},' '"mgrstat_first_committed":' 79, '"mgrstat_last_committed":' 84, '"logm_first_committed":' 1, '"logm_last_committed":' 370, '"paxos":' '{' '"first_committed":' 1, '"last_committed":' 553, '"last_pn":' 0, '"accepted_pn":' 0 '}' '}' 2024-09-16T03:25:58.315 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:134: get_fc_lc_diff: osdm_lc=83 2024-09-16T03:25:58.315 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:136: get_fc_lc_diff: echo 55 2024-09-16T03:25:58.315 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:255: TEST_mon_last_clean_epoch: diff_ver=55 2024-09-16T03:25:58.315 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:256: TEST_mon_last_clean_epoch: [[ 55 -gt 2 ]] 2024-09-16T03:25:58.316 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:258: TEST_mon_last_clean_epoch: validate_fc 2024-09-16T03:25:58.316 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:119: validate_fc: ceph report 2024-09-16T03:25:58.826 INFO:tasks.workunit.client.0.smithi096.stderr:report 616868836 2024-09-16T03:25:58.841 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:119: validate_fc: report='{ 2024-09-16T03:25:58.841 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_fingerprint": "fda2fc64-07ed-4add-8224-2e527e11d427", 2024-09-16T03:25:58.842 INFO:tasks.workunit.client.0.smithi096.stderr: "version": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:25:58.842 INFO:tasks.workunit.client.0.smithi096.stderr: "commit": "fc3e0bff7468fd55478adbae7f75508b749124b6", 2024-09-16T03:25:58.842 INFO:tasks.workunit.client.0.smithi096.stderr: "timestamp": "2024-09-16T03:25:58.826084+0000", 2024-09-16T03:25:58.842 INFO:tasks.workunit.client.0.smithi096.stderr: "tag": "", 2024-09-16T03:25:58.842 INFO:tasks.workunit.client.0.smithi096.stderr: "health": { 2024-09-16T03:25:58.842 INFO:tasks.workunit.client.0.smithi096.stderr: "status": "HEALTH_OK", 2024-09-16T03:25:58.842 INFO:tasks.workunit.client.0.smithi096.stderr: "checks": {}, 2024-09-16T03:25:58.842 INFO:tasks.workunit.client.0.smithi096.stderr: "mutes": [] 2024-09-16T03:25:58.842 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.842 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap_first_committed": 1, 2024-09-16T03:25:58.842 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap_last_committed": 1, 2024-09-16T03:25:58.842 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap": { 2024-09-16T03:25:58.842 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 1, 2024-09-16T03:25:58.842 INFO:tasks.workunit.client.0.smithi096.stderr: "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", 2024-09-16T03:25:58.843 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:22:45.872880Z", 2024-09-16T03:25:58.843 INFO:tasks.workunit.client.0.smithi096.stderr: "created": "2024-09-16T03:22:45.872880Z", 2024-09-16T03:25:58.843 INFO:tasks.workunit.client.0.smithi096.stderr: "min_mon_release": 19, 2024-09-16T03:25:58.843 INFO:tasks.workunit.client.0.smithi096.stderr: "min_mon_release_name": "squid", 2024-09-16T03:25:58.843 INFO:tasks.workunit.client.0.smithi096.stderr: "election_strategy": 1, 2024-09-16T03:25:58.843 INFO:tasks.workunit.client.0.smithi096.stderr: "disallowed_leaders: ": "", 2024-09-16T03:25:58.843 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode": false, 2024-09-16T03:25:58.843 INFO:tasks.workunit.client.0.smithi096.stderr: "tiebreaker_mon": "", 2024-09-16T03:25:58.843 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_ranks: ": "", 2024-09-16T03:25:58.843 INFO:tasks.workunit.client.0.smithi096.stderr: "features": { 2024-09-16T03:25:58.843 INFO:tasks.workunit.client.0.smithi096.stderr: "persistent": [ 2024-09-16T03:25:58.843 INFO:tasks.workunit.client.0.smithi096.stderr: "kraken", 2024-09-16T03:25:58.843 INFO:tasks.workunit.client.0.smithi096.stderr: "luminous", 2024-09-16T03:25:58.843 INFO:tasks.workunit.client.0.smithi096.stderr: "mimic", 2024-09-16T03:25:58.844 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap-prune", 2024-09-16T03:25:58.844 INFO:tasks.workunit.client.0.smithi096.stderr: "nautilus", 2024-09-16T03:25:58.844 INFO:tasks.workunit.client.0.smithi096.stderr: "octopus", 2024-09-16T03:25:58.844 INFO:tasks.workunit.client.0.smithi096.stderr: "pacific", 2024-09-16T03:25:58.844 INFO:tasks.workunit.client.0.smithi096.stderr: "elector-pinging", 2024-09-16T03:25:58.844 INFO:tasks.workunit.client.0.smithi096.stderr: "quincy", 2024-09-16T03:25:58.844 INFO:tasks.workunit.client.0.smithi096.stderr: "reef", 2024-09-16T03:25:58.844 INFO:tasks.workunit.client.0.smithi096.stderr: "squid" 2024-09-16T03:25:58.844 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:58.844 INFO:tasks.workunit.client.0.smithi096.stderr: "optional": [] 2024-09-16T03:25:58.844 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.844 INFO:tasks.workunit.client.0.smithi096.stderr: "mons": [ 2024-09-16T03:25:58.844 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.844 INFO:tasks.workunit.client.0.smithi096.stderr: "rank": 0, 2024-09-16T03:25:58.845 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "a", 2024-09-16T03:25:58.845 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:25:58.845 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:58.845 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.845 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:58.845 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:7302", 2024-09-16T03:25:58.845 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 0 2024-09-16T03:25:58.845 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:58.845 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:58.845 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.845 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:7302/0", 2024-09-16T03:25:58.845 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:7302/0", 2024-09-16T03:25:58.845 INFO:tasks.workunit.client.0.smithi096.stderr: "priority": 0, 2024-09-16T03:25:58.845 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 0, 2024-09-16T03:25:58.846 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_location": "{}" 2024-09-16T03:25:58.846 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:58.846 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:58.846 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.846 INFO:tasks.workunit.client.0.smithi096.stderr: "quorum": [ 2024-09-16T03:25:58.846 INFO:tasks.workunit.client.0.smithi096.stderr: 0 2024-09-16T03:25:58.846 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:58.846 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap": { 2024-09-16T03:25:58.846 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 83, 2024-09-16T03:25:58.846 INFO:tasks.workunit.client.0.smithi096.stderr: "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", 2024-09-16T03:25:58.846 INFO:tasks.workunit.client.0.smithi096.stderr: "created": "2024-09-16T03:22:46.906117+0000", 2024-09-16T03:25:58.846 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:25:57.328949+0000", 2024-09-16T03:25:58.846 INFO:tasks.workunit.client.0.smithi096.stderr: "last_up_change": "2024-09-16T03:25:08.513363+0000", 2024-09-16T03:25:58.846 INFO:tasks.workunit.client.0.smithi096.stderr: "last_in_change": "2024-09-16T03:25:09.839444+0000", 2024-09-16T03:25:58.847 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-16T03:25:58.847 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_num": 5799936, 2024-09-16T03:25:58.847 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_set": [ 2024-09-16T03:25:58.847 INFO:tasks.workunit.client.0.smithi096.stderr: "pglog_hardlimit", 2024-09-16T03:25:58.847 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snapdirs", 2024-09-16T03:25:58.847 INFO:tasks.workunit.client.0.smithi096.stderr: "recovery_deletes", 2024-09-16T03:25:58.847 INFO:tasks.workunit.client.0.smithi096.stderr: "sortbitwise" 2024-09-16T03:25:58.847 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:58.847 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_version": 7, 2024-09-16T03:25:58.847 INFO:tasks.workunit.client.0.smithi096.stderr: "full_ratio": 0.97000002861022949, 2024-09-16T03:25:58.847 INFO:tasks.workunit.client.0.smithi096.stderr: "backfillfull_ratio": 0.97000002861022949, 2024-09-16T03:25:58.847 INFO:tasks.workunit.client.0.smithi096.stderr: "nearfull_ratio": 0.85000002384185791, 2024-09-16T03:25:58.847 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_snapshot": "", 2024-09-16T03:25:58.847 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_max": 2, 2024-09-16T03:25:58.848 INFO:tasks.workunit.client.0.smithi096.stderr: "max_osd": 3, 2024-09-16T03:25:58.848 INFO:tasks.workunit.client.0.smithi096.stderr: "require_min_compat_client": "luminous", 2024-09-16T03:25:58.848 INFO:tasks.workunit.client.0.smithi096.stderr: "min_compat_client": "jewel", 2024-09-16T03:25:58.848 INFO:tasks.workunit.client.0.smithi096.stderr: "require_osd_release": "squid", 2024-09-16T03:25:58.848 INFO:tasks.workunit.client.0.smithi096.stderr: "allow_crimson": false, 2024-09-16T03:25:58.848 INFO:tasks.workunit.client.0.smithi096.stderr: "pools": [ 2024-09-16T03:25:58.848 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.848 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 1, 2024-09-16T03:25:58.848 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_name": "foo", 2024-09-16T03:25:58.848 INFO:tasks.workunit.client.0.smithi096.stderr: "create_time": "2024-09-16T03:24:44.525189+0000", 2024-09-16T03:25:58.848 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": 1, 2024-09-16T03:25:58.848 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_names": "hashpspool", 2024-09-16T03:25:58.848 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:25:58.848 INFO:tasks.workunit.client.0.smithi096.stderr: "size": 3, 2024-09-16T03:25:58.849 INFO:tasks.workunit.client.0.smithi096.stderr: "min_size": 2, 2024-09-16T03:25:58.849 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_rule": 0, 2024-09-16T03:25:58.849 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_count": 0, 2024-09-16T03:25:58.849 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_target": 0, 2024-09-16T03:25:58.849 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_barrier": 0, 2024-09-16T03:25:58.849 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-16T03:25:58.849 INFO:tasks.workunit.client.0.smithi096.stderr: "is_stretch_pool": false, 2024-09-16T03:25:58.849 INFO:tasks.workunit.client.0.smithi096.stderr: "object_hash": 2, 2024-09-16T03:25:58.849 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_autoscale_mode": "off", 2024-09-16T03:25:58.849 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num": 32, 2024-09-16T03:25:58.849 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num": 32, 2024-09-16T03:25:58.849 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num_target": 32, 2024-09-16T03:25:58.849 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_target": 32, 2024-09-16T03:25:58.849 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_pending": 32, 2024-09-16T03:25:58.850 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pg_merge_meta": { 2024-09-16T03:25:58.850 INFO:tasks.workunit.client.0.smithi096.stderr: "source_pgid": "0.0", 2024-09-16T03:25:58.850 INFO:tasks.workunit.client.0.smithi096.stderr: "ready_epoch": 0, 2024-09-16T03:25:58.850 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_started": 0, 2024-09-16T03:25:58.850 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": 0, 2024-09-16T03:25:58.850 INFO:tasks.workunit.client.0.smithi096.stderr: "source_version": "0'\''0", 2024-09-16T03:25:58.850 INFO:tasks.workunit.client.0.smithi096.stderr: "target_version": "0'\''0" 2024-09-16T03:25:58.850 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.850 INFO:tasks.workunit.client.0.smithi096.stderr: "last_change": "30", 2024-09-16T03:25:58.850 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend": "0", 2024-09-16T03:25:58.850 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_prenautilus": "0", 2024-09-16T03:25:58.850 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_preluminous": "0", 2024-09-16T03:25:58.850 INFO:tasks.workunit.client.0.smithi096.stderr: "auid": 0, 2024-09-16T03:25:58.850 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_mode": "selfmanaged", 2024-09-16T03:25:58.851 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_seq": 0, 2024-09-16T03:25:58.851 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_epoch": 0, 2024-09-16T03:25:58.851 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_snaps": [], 2024-09-16T03:25:58.851 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps": "[]", 2024-09-16T03:25:58.851 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_bytes": 0, 2024-09-16T03:25:58.851 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_objects": 0, 2024-09-16T03:25:58.851 INFO:tasks.workunit.client.0.smithi096.stderr: "tiers": [], 2024-09-16T03:25:58.851 INFO:tasks.workunit.client.0.smithi096.stderr: "tier_of": -1, 2024-09-16T03:25:58.851 INFO:tasks.workunit.client.0.smithi096.stderr: "read_tier": -1, 2024-09-16T03:25:58.851 INFO:tasks.workunit.client.0.smithi096.stderr: "write_tier": -1, 2024-09-16T03:25:58.851 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_mode": "none", 2024-09-16T03:25:58.851 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_bytes": 0, 2024-09-16T03:25:58.851 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_objects": 0, 2024-09-16T03:25:58.851 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_ratio_micro": 400000, 2024-09-16T03:25:58.852 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-16T03:25:58.852 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_full_ratio_micro": 800000, 2024-09-16T03:25:58.852 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_flush_age": 0, 2024-09-16T03:25:58.852 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_evict_age": 0, 2024-09-16T03:25:58.852 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profile": "", 2024-09-16T03:25:58.852 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_params": { 2024-09-16T03:25:58.852 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "none" 2024-09-16T03:25:58.852 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.852 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_period": 0, 2024-09-16T03:25:58.852 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_count": 0, 2024-09-16T03:25:58.852 INFO:tasks.workunit.client.0.smithi096.stderr: "use_gmt_hitset": true, 2024-09-16T03:25:58.852 INFO:tasks.workunit.client.0.smithi096.stderr: "min_read_recency_for_promote": 0, 2024-09-16T03:25:58.852 INFO:tasks.workunit.client.0.smithi096.stderr: "min_write_recency_for_promote": 0, 2024-09-16T03:25:58.852 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_grade_decay_rate": 0, 2024-09-16T03:25:58.853 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_search_last_n": 0, 2024-09-16T03:25:58.853 INFO:tasks.workunit.client.0.smithi096.stderr: "grade_table": [], 2024-09-16T03:25:58.853 INFO:tasks.workunit.client.0.smithi096.stderr: "stripe_width": 0, 2024-09-16T03:25:58.853 INFO:tasks.workunit.client.0.smithi096.stderr: "expected_num_objects": 0, 2024-09-16T03:25:58.853 INFO:tasks.workunit.client.0.smithi096.stderr: "fast_read": false, 2024-09-16T03:25:58.853 INFO:tasks.workunit.client.0.smithi096.stderr: "options": {}, 2024-09-16T03:25:58.853 INFO:tasks.workunit.client.0.smithi096.stderr: "application_metadata": {}, 2024-09-16T03:25:58.853 INFO:tasks.workunit.client.0.smithi096.stderr: "read_balance": { 2024-09-16T03:25:58.853 INFO:tasks.workunit.client.0.smithi096.stderr: "score_type": "Fair distribution", 2024-09-16T03:25:58.853 INFO:tasks.workunit.client.0.smithi096.stderr: "score_acting": 1.8700000047683716, 2024-09-16T03:25:58.853 INFO:tasks.workunit.client.0.smithi096.stderr: "score_stable": 1.8700000047683716, 2024-09-16T03:25:58.853 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_score": 0.67000001668930054, 2024-09-16T03:25:58.853 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_acting": 1.25, 2024-09-16T03:25:58.853 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_stable": 1.25, 2024-09-16T03:25:58.854 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity_weighted": 1, 2024-09-16T03:25:58.854 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity": 1, 2024-09-16T03:25:58.854 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity_weighted": 1 2024-09-16T03:25:58.854 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:58.854 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.854 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.854 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 2, 2024-09-16T03:25:58.854 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_name": "bar", 2024-09-16T03:25:58.854 INFO:tasks.workunit.client.0.smithi096.stderr: "create_time": "2024-09-16T03:24:46.226575+0000", 2024-09-16T03:25:58.854 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": 1, 2024-09-16T03:25:58.854 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_names": "hashpspool", 2024-09-16T03:25:58.854 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:25:58.854 INFO:tasks.workunit.client.0.smithi096.stderr: "size": 2, 2024-09-16T03:25:58.854 INFO:tasks.workunit.client.0.smithi096.stderr: "min_size": 1, 2024-09-16T03:25:58.855 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_rule": 0, 2024-09-16T03:25:58.855 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_count": 0, 2024-09-16T03:25:58.855 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_target": 0, 2024-09-16T03:25:58.855 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_barrier": 0, 2024-09-16T03:25:58.855 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-16T03:25:58.855 INFO:tasks.workunit.client.0.smithi096.stderr: "is_stretch_pool": false, 2024-09-16T03:25:58.855 INFO:tasks.workunit.client.0.smithi096.stderr: "object_hash": 2, 2024-09-16T03:25:58.855 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_autoscale_mode": "off", 2024-09-16T03:25:58.855 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num": 32, 2024-09-16T03:25:58.855 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num": 32, 2024-09-16T03:25:58.855 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num_target": 32, 2024-09-16T03:25:58.855 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_target": 32, 2024-09-16T03:25:58.855 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_pending": 32, 2024-09-16T03:25:58.855 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pg_merge_meta": { 2024-09-16T03:25:58.855 INFO:tasks.workunit.client.0.smithi096.stderr: "source_pgid": "0.0", 2024-09-16T03:25:58.856 INFO:tasks.workunit.client.0.smithi096.stderr: "ready_epoch": 0, 2024-09-16T03:25:58.856 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_started": 0, 2024-09-16T03:25:58.856 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": 0, 2024-09-16T03:25:58.856 INFO:tasks.workunit.client.0.smithi096.stderr: "source_version": "0'\''0", 2024-09-16T03:25:58.856 INFO:tasks.workunit.client.0.smithi096.stderr: "target_version": "0'\''0" 2024-09-16T03:25:58.856 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.856 INFO:tasks.workunit.client.0.smithi096.stderr: "last_change": "83", 2024-09-16T03:25:58.856 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend": "0", 2024-09-16T03:25:58.856 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_prenautilus": "0", 2024-09-16T03:25:58.856 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_preluminous": "0", 2024-09-16T03:25:58.856 INFO:tasks.workunit.client.0.smithi096.stderr: "auid": 0, 2024-09-16T03:25:58.856 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_mode": "selfmanaged", 2024-09-16T03:25:58.856 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_seq": 0, 2024-09-16T03:25:58.856 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_epoch": 0, 2024-09-16T03:25:58.857 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_snaps": [], 2024-09-16T03:25:58.857 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps": "[]", 2024-09-16T03:25:58.857 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_bytes": 0, 2024-09-16T03:25:58.857 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_objects": 0, 2024-09-16T03:25:58.857 INFO:tasks.workunit.client.0.smithi096.stderr: "tiers": [], 2024-09-16T03:25:58.857 INFO:tasks.workunit.client.0.smithi096.stderr: "tier_of": -1, 2024-09-16T03:25:58.857 INFO:tasks.workunit.client.0.smithi096.stderr: "read_tier": -1, 2024-09-16T03:25:58.857 INFO:tasks.workunit.client.0.smithi096.stderr: "write_tier": -1, 2024-09-16T03:25:58.857 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_mode": "none", 2024-09-16T03:25:58.857 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_bytes": 0, 2024-09-16T03:25:58.857 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_objects": 0, 2024-09-16T03:25:58.857 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_ratio_micro": 400000, 2024-09-16T03:25:58.857 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-16T03:25:58.857 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_full_ratio_micro": 800000, 2024-09-16T03:25:58.858 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_flush_age": 0, 2024-09-16T03:25:58.858 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_evict_age": 0, 2024-09-16T03:25:58.858 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profile": "", 2024-09-16T03:25:58.858 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_params": { 2024-09-16T03:25:58.858 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "none" 2024-09-16T03:25:58.858 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.858 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_period": 0, 2024-09-16T03:25:58.858 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_count": 0, 2024-09-16T03:25:58.858 INFO:tasks.workunit.client.0.smithi096.stderr: "use_gmt_hitset": true, 2024-09-16T03:25:58.858 INFO:tasks.workunit.client.0.smithi096.stderr: "min_read_recency_for_promote": 0, 2024-09-16T03:25:58.858 INFO:tasks.workunit.client.0.smithi096.stderr: "min_write_recency_for_promote": 0, 2024-09-16T03:25:58.858 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_grade_decay_rate": 0, 2024-09-16T03:25:58.858 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_search_last_n": 0, 2024-09-16T03:25:58.858 INFO:tasks.workunit.client.0.smithi096.stderr: "grade_table": [], 2024-09-16T03:25:58.859 INFO:tasks.workunit.client.0.smithi096.stderr: "stripe_width": 0, 2024-09-16T03:25:58.859 INFO:tasks.workunit.client.0.smithi096.stderr: "expected_num_objects": 0, 2024-09-16T03:25:58.859 INFO:tasks.workunit.client.0.smithi096.stderr: "fast_read": false, 2024-09-16T03:25:58.859 INFO:tasks.workunit.client.0.smithi096.stderr: "options": {}, 2024-09-16T03:25:58.859 INFO:tasks.workunit.client.0.smithi096.stderr: "application_metadata": {}, 2024-09-16T03:25:58.859 INFO:tasks.workunit.client.0.smithi096.stderr: "read_balance": { 2024-09-16T03:25:58.859 INFO:tasks.workunit.client.0.smithi096.stderr: "score_type": "Fair distribution", 2024-09-16T03:25:58.859 INFO:tasks.workunit.client.0.smithi096.stderr: "score_acting": 1.4900000095367432, 2024-09-16T03:25:58.859 INFO:tasks.workunit.client.0.smithi096.stderr: "score_stable": 1.4900000095367432, 2024-09-16T03:25:58.859 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_score": 0.67000001668930054, 2024-09-16T03:25:58.859 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_acting": 1, 2024-09-16T03:25:58.859 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_stable": 1, 2024-09-16T03:25:58.859 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity_weighted": 1, 2024-09-16T03:25:58.859 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity": 1, 2024-09-16T03:25:58.859 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity_weighted": 1 2024-09-16T03:25:58.860 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:58.860 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:58.860 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:58.860 INFO:tasks.workunit.client.0.smithi096.stderr: "osds": [ 2024-09-16T03:25:58.860 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.860 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:25:58.860 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6", 2024-09-16T03:25:58.860 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:25:58.860 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:25:58.860 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:25:58.860 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:25:58.860 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:25:58.860 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:25:58.860 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 5, 2024-09-16T03:25:58.861 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 81, 2024-09-16T03:25:58.861 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:25:58.861 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:25:58.861 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:25:58.861 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:58.861 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.861 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:58.861 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6802", 2024-09-16T03:25:58.861 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:58.861 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.861 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.861 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:58.861 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6803", 2024-09-16T03:25:58.861 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:58.862 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:58.862 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:58.862 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.862 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:25:58.862 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:58.862 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.862 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:58.862 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6804", 2024-09-16T03:25:58.862 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:58.862 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.862 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.862 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:58.862 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6805", 2024-09-16T03:25:58.862 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:58.862 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:58.863 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:58.863 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.863 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:25:58.863 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:58.863 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.863 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:58.863 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6808", 2024-09-16T03:25:58.863 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:58.863 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.863 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.863 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:58.863 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6809", 2024-09-16T03:25:58.863 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:58.863 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:58.864 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:58.864 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.864 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:25:58.864 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:58.864 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.864 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:58.864 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6806", 2024-09-16T03:25:58.864 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:58.864 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.864 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.864 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:58.864 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6807", 2024-09-16T03:25:58.864 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:58.864 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:58.864 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:58.865 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.865 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6803/3375787448", 2024-09-16T03:25:58.865 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6805/3375787448", 2024-09-16T03:25:58.865 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6809/3375787448", 2024-09-16T03:25:58.865 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6807/3375787448", 2024-09-16T03:25:58.865 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:25:58.865 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:25:58.865 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:25:58.865 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:58.865 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.865 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.865 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:25:58.865 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "74b26727-75c9-444d-8782-719e4197a382", 2024-09-16T03:25:58.865 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:25:58.866 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:25:58.866 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:25:58.866 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:25:58.866 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:25:58.866 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:25:58.866 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 10, 2024-09-16T03:25:58.866 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 81, 2024-09-16T03:25:58.866 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:25:58.866 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:25:58.866 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:25:58.866 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:58.866 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.866 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:58.866 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6810", 2024-09-16T03:25:58.866 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:58.867 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.867 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.867 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:58.867 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6811", 2024-09-16T03:25:58.867 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:58.867 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:58.867 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:58.867 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.867 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:25:58.867 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:58.867 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.867 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:58.867 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6812", 2024-09-16T03:25:58.867 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:58.868 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.868 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.868 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:58.868 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6813", 2024-09-16T03:25:58.868 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:58.868 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:58.868 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:58.868 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.868 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:25:58.868 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:58.868 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.868 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:58.868 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6816", 2024-09-16T03:25:58.868 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:58.869 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.869 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.869 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:58.869 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6817", 2024-09-16T03:25:58.869 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:58.869 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:58.869 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:58.869 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.869 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:25:58.869 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:58.869 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.869 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:58.869 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6814", 2024-09-16T03:25:58.869 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:58.870 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.870 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.870 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:58.870 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6815", 2024-09-16T03:25:58.870 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:58.870 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:58.870 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:58.870 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.870 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6811/3733255132", 2024-09-16T03:25:58.870 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6813/3733255132", 2024-09-16T03:25:58.870 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6817/3733255132", 2024-09-16T03:25:58.870 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6815/3733255132", 2024-09-16T03:25:58.870 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:25:58.870 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:25:58.871 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:25:58.871 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:58.871 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.871 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.871 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:25:58.871 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "143da3a7-dad9-4b1e-966b-76cf5bdd3c82", 2024-09-16T03:25:58.871 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 0, 2024-09-16T03:25:58.871 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 0, 2024-09-16T03:25:58.871 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 0, 2024-09-16T03:25:58.871 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:25:58.872 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:25:58.872 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:25:58.872 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 15, 2024-09-16T03:25:58.872 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 21, 2024-09-16T03:25:58.872 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 33, 2024-09-16T03:25:58.872 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:25:58.872 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:25:58.872 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:58.872 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.872 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:58.872 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6818", 2024-09-16T03:25:58.872 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:58.872 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.872 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.873 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:58.873 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6819", 2024-09-16T03:25:58.873 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:58.873 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:58.873 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:58.873 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.873 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:25:58.873 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:58.873 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.873 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:58.873 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6820", 2024-09-16T03:25:58.873 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:58.873 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.873 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.874 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:58.874 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6821", 2024-09-16T03:25:58.874 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:58.874 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:58.874 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:58.874 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.874 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:25:58.874 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:58.874 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.874 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:58.874 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6824", 2024-09-16T03:25:58.874 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:58.874 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.874 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.875 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:58.875 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6825", 2024-09-16T03:25:58.875 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:58.875 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:58.875 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:58.875 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.875 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:25:58.875 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:58.875 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.875 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:58.875 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6822", 2024-09-16T03:25:58.875 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:58.875 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.875 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.876 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:58.876 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6823", 2024-09-16T03:25:58.876 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:58.876 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:58.876 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:58.876 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.876 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6819/963814857", 2024-09-16T03:25:58.876 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6821/963814857", 2024-09-16T03:25:58.876 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6825/963814857", 2024-09-16T03:25:58.876 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6823/963814857", 2024-09-16T03:25:58.876 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:25:58.876 INFO:tasks.workunit.client.0.smithi096.stderr: "exists" 2024-09-16T03:25:58.876 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:58.876 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:58.877 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:58.877 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_xinfo": [ 2024-09-16T03:25:58.877 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.877 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:25:58.877 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:25:58.877 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:25:58.877 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:25:58.877 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:25:58.877 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:25:58.877 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:23:22.481942+0000", 2024-09-16T03:25:58.877 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:25:58.877 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.877 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.877 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:25:58.878 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:25:58.878 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:25:58.878 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:25:58.878 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:25:58.878 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:25:58.878 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:23:59.663703+0000", 2024-09-16T03:25:58.878 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:25:58.878 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.878 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.878 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:25:58.878 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:25:58.878 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:25:58.878 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:25:58.878 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:25:58.878 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 65536, 2024-09-16T03:25:58.879 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:24:37.320822+0000", 2024-09-16T03:25:58.879 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 32 2024-09-16T03:25:58.879 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:58.879 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:58.879 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap": [], 2024-09-16T03:25:58.879 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap_items": [], 2024-09-16T03:25:58.879 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap_primaries": [], 2024-09-16T03:25:58.879 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_temp": [], 2024-09-16T03:25:58.879 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_temp": [], 2024-09-16T03:25:58.879 INFO:tasks.workunit.client.0.smithi096.stderr: "blocklist": {}, 2024-09-16T03:25:58.879 INFO:tasks.workunit.client.0.smithi096.stderr: "range_blocklist": {}, 2024-09-16T03:25:58.879 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profiles": { 2024-09-16T03:25:58.879 INFO:tasks.workunit.client.0.smithi096.stderr: "default": { 2024-09-16T03:25:58.879 INFO:tasks.workunit.client.0.smithi096.stderr: "k": "2", 2024-09-16T03:25:58.880 INFO:tasks.workunit.client.0.smithi096.stderr: "m": "2", 2024-09-16T03:25:58.880 INFO:tasks.workunit.client.0.smithi096.stderr: "plugin": "jerasure", 2024-09-16T03:25:58.880 INFO:tasks.workunit.client.0.smithi096.stderr: "technique": "reed_sol_van" 2024-09-16T03:25:58.880 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:58.880 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.880 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps_queue": [], 2024-09-16T03:25:58.880 INFO:tasks.workunit.client.0.smithi096.stderr: "new_removed_snaps": [], 2024-09-16T03:25:58.880 INFO:tasks.workunit.client.0.smithi096.stderr: "new_purged_snaps": [], 2024-09-16T03:25:58.880 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_node_flags": {}, 2024-09-16T03:25:58.880 INFO:tasks.workunit.client.0.smithi096.stderr: "device_class_flags": {}, 2024-09-16T03:25:58.880 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode": { 2024-09-16T03:25:58.880 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode_enabled": false, 2024-09-16T03:25:58.880 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_bucket_count": 0, 2024-09-16T03:25:58.881 INFO:tasks.workunit.client.0.smithi096.stderr: "degraded_stretch_mode": 0, 2024-09-16T03:25:58.881 INFO:tasks.workunit.client.0.smithi096.stderr: "recovering_stretch_mode": 0, 2024-09-16T03:25:58.881 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode_bucket": 0 2024-09-16T03:25:58.881 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:58.881 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.881 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_metadata": [ 2024-09-16T03:25:58.881 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.881 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:25:58.881 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:25:58.881 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]", 2024-09-16T03:25:58.881 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:25:58.881 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:25:58.881 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:25:58.881 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:25:58.881 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:25:58.882 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:25:58.882 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:25:58.882 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:25:58.882 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:25:58.882 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:25:58.882 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:25:58.882 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/0/block", 2024-09-16T03:25:58.882 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:25:58.882 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:25:58.882 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:25:58.882 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:25:58.882 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:25:58.882 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:25:58.883 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:25:58.883 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:25:58.883 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:25:58.883 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:25:58.883 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:22:53.662571Z", 2024-09-16T03:25:58.883 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:25:58.883 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:25:58.883 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:25:58.883 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:25:58.883 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:25:58.883 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:25:58.883 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:25:58.883 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]", 2024-09-16T03:25:58.883 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:25:58.884 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]", 2024-09-16T03:25:58.884 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]", 2024-09-16T03:25:58.884 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:25:58.884 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:25:58.884 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:25:58.884 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:25:58.884 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:25:58.884 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:25:58.884 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:25:58.884 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:25:58.884 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:25:58.884 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/0", 2024-09-16T03:25:58.884 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:25:58.885 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:25:58.885 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:25:58.885 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.885 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.885 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:25:58.885 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:25:58.885 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]", 2024-09-16T03:25:58.885 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:25:58.885 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:25:58.885 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:25:58.885 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:25:58.885 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:25:58.885 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:25:58.885 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:25:58.885 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:25:58.886 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:25:58.886 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:25:58.886 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:25:58.886 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/1/block", 2024-09-16T03:25:58.886 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:25:58.886 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:25:58.886 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:25:58.886 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:25:58.886 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:25:58.886 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:25:58.886 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:25:58.886 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:25:58.886 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:25:58.886 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:25:58.887 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:23:30.129885Z", 2024-09-16T03:25:58.887 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:25:58.887 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:25:58.887 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:25:58.887 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:25:58.887 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:25:58.887 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:25:58.887 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:25:58.887 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]", 2024-09-16T03:25:58.887 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:25:58.887 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]", 2024-09-16T03:25:58.887 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]", 2024-09-16T03:25:58.887 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:25:58.888 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:25:58.888 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:25:58.888 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:25:58.888 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:25:58.888 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:25:58.888 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:25:58.888 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:25:58.888 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:25:58.888 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/1", 2024-09-16T03:25:58.888 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:25:58.888 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:25:58.888 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:25:58.888 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.888 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.889 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:25:58.889 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:25:58.889 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]", 2024-09-16T03:25:58.889 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:25:58.889 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:25:58.889 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:25:58.889 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:25:58.889 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:25:58.889 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:25:58.889 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:25:58.889 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:25:58.889 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:25:58.889 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:25:58.889 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:25:58.890 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/2/block", 2024-09-16T03:25:58.890 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:25:58.890 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:25:58.890 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:25:58.890 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:25:58.890 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:25:58.890 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:25:58.890 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:25:58.890 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:25:58.890 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:25:58.890 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:25:58.890 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:24:07.764502Z", 2024-09-16T03:25:58.890 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:25:58.890 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:25:58.890 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:25:58.891 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:25:58.891 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:25:58.891 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:25:58.891 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:25:58.891 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]", 2024-09-16T03:25:58.891 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:25:58.891 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]", 2024-09-16T03:25:58.891 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]", 2024-09-16T03:25:58.891 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:25:58.891 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:25:58.891 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:25:58.891 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:25:58.891 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:25:58.891 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:25:58.892 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:25:58.892 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:25:58.892 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:25:58.892 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/2", 2024-09-16T03:25:58.892 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:25:58.892 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:25:58.892 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:25:58.892 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:58.892 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:58.892 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_clean_epochs": { 2024-09-16T03:25:58.892 INFO:tasks.workunit.client.0.smithi096.stderr: "min_last_epoch_clean": 28, 2024-09-16T03:25:58.892 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": { 2024-09-16T03:25:58.892 INFO:tasks.workunit.client.0.smithi096.stderr: "per_pool": [ 2024-09-16T03:25:58.892 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.892 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 1, 2024-09-16T03:25:58.893 INFO:tasks.workunit.client.0.smithi096.stderr: "floor": 28 2024-09-16T03:25:58.893 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.893 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.893 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 2, 2024-09-16T03:25:58.893 INFO:tasks.workunit.client.0.smithi096.stderr: "floor": 28 2024-09-16T03:25:58.893 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:58.893 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:58.893 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.893 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_epochs": [ 2024-09-16T03:25:58.893 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.893 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:25:58.893 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 78 2024-09-16T03:25:58.893 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.893 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.893 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:25:58.894 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 80 2024-09-16T03:25:58.894 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:58.894 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:58.894 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.894 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_first_committed": 28, 2024-09-16T03:25:58.894 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_last_committed": 83, 2024-09-16T03:25:58.894 INFO:tasks.workunit.client.0.smithi096.stderr: "crushmap": { 2024-09-16T03:25:58.894 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": [ 2024-09-16T03:25:58.894 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.894 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:25:58.894 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.0", 2024-09-16T03:25:58.894 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:25:58.894 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.894 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.895 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:25:58.895 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.1", 2024-09-16T03:25:58.895 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:25:58.895 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.895 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.895 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:25:58.895 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.2", 2024-09-16T03:25:58.895 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:25:58.895 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:58.895 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:58.895 INFO:tasks.workunit.client.0.smithi096.stderr: "types": [ 2024-09-16T03:25:58.895 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.895 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 0, 2024-09-16T03:25:58.895 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd" 2024-09-16T03:25:58.896 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.896 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.896 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:25:58.896 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "host" 2024-09-16T03:25:58.896 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.896 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.896 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 2, 2024-09-16T03:25:58.896 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "chassis" 2024-09-16T03:25:58.896 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.896 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.896 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 3, 2024-09-16T03:25:58.896 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "rack" 2024-09-16T03:25:58.896 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.896 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.896 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 4, 2024-09-16T03:25:58.897 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "row" 2024-09-16T03:25:58.897 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.897 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.897 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 5, 2024-09-16T03:25:58.897 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "pdu" 2024-09-16T03:25:58.897 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.897 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.897 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 6, 2024-09-16T03:25:58.897 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "pod" 2024-09-16T03:25:58.897 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.897 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.897 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 7, 2024-09-16T03:25:58.897 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "room" 2024-09-16T03:25:58.897 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.898 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.898 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 8, 2024-09-16T03:25:58.898 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "datacenter" 2024-09-16T03:25:58.898 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.898 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.898 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 9, 2024-09-16T03:25:58.898 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "zone" 2024-09-16T03:25:58.898 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.898 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.898 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 10, 2024-09-16T03:25:58.898 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "region" 2024-09-16T03:25:58.898 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.898 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.898 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:25:58.899 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "root" 2024-09-16T03:25:58.899 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:58.899 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:58.899 INFO:tasks.workunit.client.0.smithi096.stderr: "buckets": [ 2024-09-16T03:25:58.899 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.899 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -1, 2024-09-16T03:25:58.899 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "default", 2024-09-16T03:25:58.899 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:25:58.899 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "root", 2024-09-16T03:25:58.899 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:25:58.899 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:25:58.899 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:25:58.899 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:25:58.899 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.899 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -3, 2024-09-16T03:25:58.900 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:25:58.900 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:25:58.900 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:58.900 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:58.900 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.900 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.900 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -2, 2024-09-16T03:25:58.900 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "default~hdd", 2024-09-16T03:25:58.900 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:25:58.900 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "root", 2024-09-16T03:25:58.900 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:25:58.900 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:25:58.900 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:25:58.901 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:25:58.901 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.901 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -4, 2024-09-16T03:25:58.901 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:25:58.901 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:25:58.901 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:58.901 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:58.901 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.901 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.901 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -3, 2024-09-16T03:25:58.901 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "smithi096", 2024-09-16T03:25:58.901 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:25:58.901 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "host", 2024-09-16T03:25:58.901 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:25:58.901 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:25:58.902 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:25:58.902 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:25:58.902 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.902 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:25:58.902 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:25:58.902 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:25:58.902 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.902 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.902 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:25:58.902 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:25:58.902 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 1 2024-09-16T03:25:58.902 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.902 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.902 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:25:58.903 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:25:58.903 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 2 2024-09-16T03:25:58.903 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:58.903 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:58.903 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.903 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.903 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -4, 2024-09-16T03:25:58.903 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "smithi096~hdd", 2024-09-16T03:25:58.903 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:25:58.903 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "host", 2024-09-16T03:25:58.903 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:25:58.903 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:25:58.903 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:25:58.903 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:25:58.903 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.904 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:25:58.904 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:25:58.904 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:25:58.904 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.904 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.904 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:25:58.904 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:25:58.904 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 1 2024-09-16T03:25:58.904 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.904 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.904 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:25:58.904 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:25:58.904 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 2 2024-09-16T03:25:58.904 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:58.905 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:58.905 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:58.905 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:58.905 INFO:tasks.workunit.client.0.smithi096.stderr: "rules": [ 2024-09-16T03:25:58.905 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.905 INFO:tasks.workunit.client.0.smithi096.stderr: "rule_id": 0, 2024-09-16T03:25:58.905 INFO:tasks.workunit.client.0.smithi096.stderr: "rule_name": "replicated_rule", 2024-09-16T03:25:58.905 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:25:58.905 INFO:tasks.workunit.client.0.smithi096.stderr: "steps": [ 2024-09-16T03:25:58.905 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.905 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "take", 2024-09-16T03:25:58.905 INFO:tasks.workunit.client.0.smithi096.stderr: "item": -1, 2024-09-16T03:25:58.905 INFO:tasks.workunit.client.0.smithi096.stderr: "item_name": "default" 2024-09-16T03:25:58.905 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.906 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.906 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "choose_firstn", 2024-09-16T03:25:58.906 INFO:tasks.workunit.client.0.smithi096.stderr: "num": 0, 2024-09-16T03:25:58.906 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "osd" 2024-09-16T03:25:58.906 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.906 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.906 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "emit" 2024-09-16T03:25:58.906 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:58.906 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:58.906 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:58.906 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:58.906 INFO:tasks.workunit.client.0.smithi096.stderr: "tunables": { 2024-09-16T03:25:58.906 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_local_tries": 0, 2024-09-16T03:25:58.906 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_local_fallback_tries": 0, 2024-09-16T03:25:58.907 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_total_tries": 50, 2024-09-16T03:25:58.907 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_descend_once": 1, 2024-09-16T03:25:58.907 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_vary_r": 1, 2024-09-16T03:25:58.907 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_stable": 1, 2024-09-16T03:25:58.907 INFO:tasks.workunit.client.0.smithi096.stderr: "msr_descents": 100, 2024-09-16T03:25:58.907 INFO:tasks.workunit.client.0.smithi096.stderr: "msr_collision_tries": 100, 2024-09-16T03:25:58.907 INFO:tasks.workunit.client.0.smithi096.stderr: "straw_calc_version": 1, 2024-09-16T03:25:58.907 INFO:tasks.workunit.client.0.smithi096.stderr: "allowed_bucket_algs": 54, 2024-09-16T03:25:58.907 INFO:tasks.workunit.client.0.smithi096.stderr: "profile": "jewel", 2024-09-16T03:25:58.907 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_tunables": 1, 2024-09-16T03:25:58.907 INFO:tasks.workunit.client.0.smithi096.stderr: "legacy_tunables": 0, 2024-09-16T03:25:58.907 INFO:tasks.workunit.client.0.smithi096.stderr: "minimum_required_version": "jewel", 2024-09-16T03:25:58.907 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables": 1, 2024-09-16T03:25:58.907 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables2": 1, 2024-09-16T03:25:58.908 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v2_rules": 0, 2024-09-16T03:25:58.908 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables3": 1, 2024-09-16T03:25:58.908 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v3_rules": 0, 2024-09-16T03:25:58.908 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v4_buckets": 1, 2024-09-16T03:25:58.908 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables5": 1, 2024-09-16T03:25:58.908 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v5_rules": 0, 2024-09-16T03:25:58.908 INFO:tasks.workunit.client.0.smithi096.stderr: "has_msr_rules": 0 2024-09-16T03:25:58.908 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.908 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_args": {} 2024-09-16T03:25:58.908 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.908 INFO:tasks.workunit.client.0.smithi096.stderr: "fsmap": { 2024-09-16T03:25:58.908 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 1, 2024-09-16T03:25:58.908 INFO:tasks.workunit.client.0.smithi096.stderr: "btime": "2024-09-16T03:22:46:882186+0000", 2024-09-16T03:25:58.908 INFO:tasks.workunit.client.0.smithi096.stderr: "default_fscid": -1, 2024-09-16T03:25:58.908 INFO:tasks.workunit.client.0.smithi096.stderr: "compat": { 2024-09-16T03:25:58.909 INFO:tasks.workunit.client.0.smithi096.stderr: "compat": {}, 2024-09-16T03:25:58.909 INFO:tasks.workunit.client.0.smithi096.stderr: "ro_compat": {}, 2024-09-16T03:25:58.909 INFO:tasks.workunit.client.0.smithi096.stderr: "incompat": { 2024-09-16T03:25:58.909 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_1": "base v0.20", 2024-09-16T03:25:58.909 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_2": "client writeable ranges", 2024-09-16T03:25:58.909 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_3": "default file layouts on dirs", 2024-09-16T03:25:58.909 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_4": "dir inode in separate object", 2024-09-16T03:25:58.909 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_5": "mds uses versioned encoding", 2024-09-16T03:25:58.909 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_6": "dirfrag is stored in omap", 2024-09-16T03:25:58.909 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_8": "no anchor table", 2024-09-16T03:25:58.909 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_9": "file layout v2", 2024-09-16T03:25:58.909 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_10": "snaprealm v2", 2024-09-16T03:25:58.909 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_11": "minor log segments", 2024-09-16T03:25:58.909 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_12": "quiesce subvolumes" 2024-09-16T03:25:58.910 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:58.910 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.910 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_flags": { 2024-09-16T03:25:58.910 INFO:tasks.workunit.client.0.smithi096.stderr: "enable_multiple": true, 2024-09-16T03:25:58.910 INFO:tasks.workunit.client.0.smithi096.stderr: "ever_enabled_multiple": true 2024-09-16T03:25:58.910 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.910 INFO:tasks.workunit.client.0.smithi096.stderr: "standbys": [], 2024-09-16T03:25:58.910 INFO:tasks.workunit.client.0.smithi096.stderr: "filesystems": [] 2024-09-16T03:25:58.910 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.910 INFO:tasks.workunit.client.0.smithi096.stderr: "mdsmap_first_committed": 1, 2024-09-16T03:25:58.910 INFO:tasks.workunit.client.0.smithi096.stderr: "mdsmap_last_committed": 1, 2024-09-16T03:25:58.910 INFO:tasks.workunit.client.0.smithi096.stderr: "auth": { 2024-09-16T03:25:58.910 INFO:tasks.workunit.client.0.smithi096.stderr: "first_committed": 1, 2024-09-16T03:25:58.910 INFO:tasks.workunit.client.0.smithi096.stderr: "last_committed": 5, 2024-09-16T03:25:58.911 INFO:tasks.workunit.client.0.smithi096.stderr: "num_secrets": 3 2024-09-16T03:25:58.911 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.911 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 64, 2024-09-16T03:25:58.911 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_active": 64, 2024-09-16T03:25:58.911 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_unknown": 0, 2024-09-16T03:25:58.911 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osd": 3, 2024-09-16T03:25:58.911 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_sum": { 2024-09-16T03:25:58.911 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:25:58.911 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:25:58.911 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:25:58.911 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:25:58.911 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:25:58.911 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:25:58.911 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:25:58.911 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:25:58.912 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:25:58.912 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:25:58.912 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:25:58.912 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:25:58.912 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:25:58.912 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:25:58.912 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:25:58.912 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:25:58.912 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:25:58.912 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:25:58.912 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:25:58.912 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:25:58.912 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:25:58.913 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:25:58.913 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:25:58.913 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:25:58.913 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:25:58.913 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:25:58.913 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:25:58.913 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:25:58.913 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:25:58.913 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:25:58.913 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:25:58.913 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:25:58.913 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:25:58.913 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:25:58.913 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:25:58.913 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:25:58.914 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:25:58.914 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:25:58.914 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:25:58.914 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:25:58.914 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:25:58.914 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.914 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:25:58.914 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:25:58.914 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:25:58.914 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:25:58.914 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:25:58.914 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:25:58.914 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:25:58.915 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:25:58.915 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:25:58.915 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:25:58.915 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:25:58.915 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.915 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:25:58.915 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:25:58.915 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 128, 2024-09-16T03:25:58.915 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 128, 2024-09-16T03:25:58.915 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 0 2024-09-16T03:25:58.915 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.915 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_sum": { 2024-09-16T03:25:58.915 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 0, 2024-09-16T03:25:58.915 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 0, 2024-09-16T03:25:58.915 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pgs": 128, 2024-09-16T03:25:58.916 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osds": 2, 2024-09-16T03:25:58.916 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_osds": 2, 2024-09-16T03:25:58.916 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_omap_osds": 2, 2024-09-16T03:25:58.916 INFO:tasks.workunit.client.0.smithi096.stderr: "kb": 209715200, 2024-09-16T03:25:58.916 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used": 54568, 2024-09-16T03:25:58.916 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_data": 856, 2024-09-16T03:25:58.916 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_omap": 3, 2024-09-16T03:25:58.916 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_meta": 53628, 2024-09-16T03:25:58.916 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_avail": 209660632, 2024-09-16T03:25:58.916 INFO:tasks.workunit.client.0.smithi096.stderr: "statfs": { 2024-09-16T03:25:58.916 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 214748364800, 2024-09-16T03:25:58.916 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 214692487168, 2024-09-16T03:25:58.916 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:25:58.916 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 876544, 2024-09-16T03:25:58.917 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 327566, 2024-09-16T03:25:58.917 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:25:58.917 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:25:58.917 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:25:58.917 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 3190, 2024-09-16T03:25:58.917 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 54915978 2024-09-16T03:25:58.917 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.917 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_peers": [], 2024-09-16T03:25:58.917 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_trim_queue_len": 0, 2024-09-16T03:25:58.917 INFO:tasks.workunit.client.0.smithi096.stderr: "num_snap_trimming": 0, 2024-09-16T03:25:58.917 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shards_repaired": 0, 2024-09-16T03:25:58.917 INFO:tasks.workunit.client.0.smithi096.stderr: "op_queue_age_hist": { 2024-09-16T03:25:58.917 INFO:tasks.workunit.client.0.smithi096.stderr: "histogram": [], 2024-09-16T03:25:58.918 INFO:tasks.workunit.client.0.smithi096.stderr: "upper_bound": 1 2024-09-16T03:25:58.918 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.918 INFO:tasks.workunit.client.0.smithi096.stderr: "perf_stat": { 2024-09-16T03:25:58.918 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ms": 219, 2024-09-16T03:25:58.918 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ms": 219, 2024-09-16T03:25:58.918 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ns": 219000000, 2024-09-16T03:25:58.918 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ns": 219000000 2024-09-16T03:25:58.918 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.918 INFO:tasks.workunit.client.0.smithi096.stderr: "alerts": [], 2024-09-16T03:25:58.918 INFO:tasks.workunit.client.0.smithi096.stderr: "network_ping_times": [] 2024-09-16T03:25:58.918 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.918 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_sum_by_class": { 2024-09-16T03:25:58.918 INFO:tasks.workunit.client.0.smithi096.stderr: "hdd": { 2024-09-16T03:25:58.918 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 0, 2024-09-16T03:25:58.919 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 0, 2024-09-16T03:25:58.919 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pgs": 128, 2024-09-16T03:25:58.919 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osds": 2, 2024-09-16T03:25:58.919 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_osds": 2, 2024-09-16T03:25:58.919 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_omap_osds": 2, 2024-09-16T03:25:58.919 INFO:tasks.workunit.client.0.smithi096.stderr: "kb": 209715200, 2024-09-16T03:25:58.919 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used": 54568, 2024-09-16T03:25:58.919 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_data": 856, 2024-09-16T03:25:58.919 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_omap": 3, 2024-09-16T03:25:58.919 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_meta": 53628, 2024-09-16T03:25:58.919 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_avail": 209660632, 2024-09-16T03:25:58.919 INFO:tasks.workunit.client.0.smithi096.stderr: "statfs": { 2024-09-16T03:25:58.919 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 214748364800, 2024-09-16T03:25:58.919 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 214692487168, 2024-09-16T03:25:58.920 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:25:58.920 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 876544, 2024-09-16T03:25:58.920 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 327566, 2024-09-16T03:25:58.920 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:25:58.920 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:25:58.920 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:25:58.920 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 3190, 2024-09-16T03:25:58.920 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 54915978 2024-09-16T03:25:58.920 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.920 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_peers": [], 2024-09-16T03:25:58.920 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_trim_queue_len": 0, 2024-09-16T03:25:58.920 INFO:tasks.workunit.client.0.smithi096.stderr: "num_snap_trimming": 0, 2024-09-16T03:25:58.920 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shards_repaired": 0, 2024-09-16T03:25:58.920 INFO:tasks.workunit.client.0.smithi096.stderr: "op_queue_age_hist": { 2024-09-16T03:25:58.921 INFO:tasks.workunit.client.0.smithi096.stderr: "histogram": [], 2024-09-16T03:25:58.921 INFO:tasks.workunit.client.0.smithi096.stderr: "upper_bound": 1 2024-09-16T03:25:58.921 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.921 INFO:tasks.workunit.client.0.smithi096.stderr: "perf_stat": { 2024-09-16T03:25:58.921 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ms": 219, 2024-09-16T03:25:58.921 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ms": 219, 2024-09-16T03:25:58.921 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ns": 219000000, 2024-09-16T03:25:58.921 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ns": 219000000 2024-09-16T03:25:58.921 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.921 INFO:tasks.workunit.client.0.smithi096.stderr: "alerts": [], 2024-09-16T03:25:58.921 INFO:tasks.workunit.client.0.smithi096.stderr: "network_ping_times": [] 2024-09-16T03:25:58.921 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:58.921 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.921 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_stats": [ 2024-09-16T03:25:58.921 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.922 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 2, 2024-09-16T03:25:58.922 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 32, 2024-09-16T03:25:58.922 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:25:58.922 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:25:58.922 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:25:58.922 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:25:58.922 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:25:58.922 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:25:58.922 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:25:58.922 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:25:58.922 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:25:58.922 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:25:58.922 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:25:58.922 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:25:58.923 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:25:58.923 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:25:58.923 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:25:58.923 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:25:58.923 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:25:58.923 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:25:58.923 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:25:58.923 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:25:58.923 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:25:58.923 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:25:58.923 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:25:58.923 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:25:58.923 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:25:58.923 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:25:58.924 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:25:58.924 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:25:58.924 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:25:58.924 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:25:58.924 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:25:58.924 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:25:58.924 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:25:58.924 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:25:58.924 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:25:58.924 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:25:58.924 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:25:58.924 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:25:58.924 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:25:58.924 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:25:58.925 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:25:58.925 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.925 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:25:58.925 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:25:58.925 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:25:58.925 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:25:58.925 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:25:58.925 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:25:58.925 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:25:58.925 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:25:58.925 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:25:58.925 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:25:58.925 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:25:58.925 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.925 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:25:58.926 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:25:58.926 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 64, 2024-09-16T03:25:58.926 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 64, 2024-09-16T03:25:58.926 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 3 2024-09-16T03:25:58.926 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.926 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.926 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 1, 2024-09-16T03:25:58.926 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 32, 2024-09-16T03:25:58.926 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:25:58.926 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:25:58.926 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:25:58.926 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:25:58.926 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:25:58.926 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:25:58.927 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:25:58.927 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:25:58.927 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:25:58.927 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:25:58.927 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:25:58.927 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:25:58.927 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:25:58.927 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:25:58.927 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:25:58.927 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:25:58.927 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:25:58.927 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:25:58.927 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:25:58.927 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:25:58.928 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:25:58.928 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:25:58.928 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:25:58.928 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:25:58.928 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:25:58.928 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:25:58.928 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:25:58.928 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:25:58.928 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:25:58.928 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:25:58.928 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:25:58.928 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:25:58.928 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:25:58.928 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:25:58.929 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:25:58.929 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:25:58.929 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:25:58.929 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:25:58.929 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:25:58.929 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:25:58.929 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:25:58.929 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.929 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:25:58.929 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:25:58.929 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:25:58.929 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:25:58.929 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:25:58.929 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:25:58.930 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:25:58.930 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:25:58.930 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:25:58.930 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:25:58.930 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:25:58.930 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.930 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:25:58.930 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:25:58.930 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 64, 2024-09-16T03:25:58.930 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 64, 2024-09-16T03:25:58.930 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 3 2024-09-16T03:25:58.930 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:58.930 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:58.930 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_stats": [ 2024-09-16T03:25:58.931 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.931 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:25:58.931 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 21474836517 2024-09-16T03:25:58.931 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.931 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.931 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:25:58.931 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 42949672989 2024-09-16T03:25:58.931 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.931 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.931 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:25:58.931 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 0 2024-09-16T03:25:58.931 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:58.931 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:58.931 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_by_state": [ 2024-09-16T03:25:58.932 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.932 INFO:tasks.workunit.client.0.smithi096.stderr: "state": "active+undersized", 2024-09-16T03:25:58.932 INFO:tasks.workunit.client.0.smithi096.stderr: "num": 64 2024-09-16T03:25:58.932 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:58.932 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:58.932 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_by_osd": [ 2024-09-16T03:25:58.932 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.932 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:25:58.932 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 0, 2024-09-16T03:25:58.932 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 0, 2024-09-16T03:25:58.932 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:25:58.932 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.932 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.932 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:25:58.933 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 28, 2024-09-16T03:25:58.933 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 64, 2024-09-16T03:25:58.933 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:25:58.933 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.933 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.933 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:25:58.933 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 36, 2024-09-16T03:25:58.933 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 64, 2024-09-16T03:25:58.933 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:25:58.933 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:58.933 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:58.933 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": [ 2024-09-16T03:25:58.933 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.933 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 1, 2024-09-16T03:25:58.933 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": {} 2024-09-16T03:25:58.934 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.934 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:58.934 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 2, 2024-09-16T03:25:58.934 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": {} 2024-09-16T03:25:58.934 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:58.934 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:58.934 INFO:tasks.workunit.client.0.smithi096.stderr: "servicemap": { 2024-09-16T03:25:58.934 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 5, 2024-09-16T03:25:58.934 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:25:38.422788+0000", 2024-09-16T03:25:58.934 INFO:tasks.workunit.client.0.smithi096.stderr: "services": {} 2024-09-16T03:25:58.934 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:58.934 INFO:tasks.workunit.client.0.smithi096.stderr: "mgrstat_first_committed": 79, 2024-09-16T03:25:58.934 INFO:tasks.workunit.client.0.smithi096.stderr: "mgrstat_last_committed": 85, 2024-09-16T03:25:58.934 INFO:tasks.workunit.client.0.smithi096.stderr: "logm_first_committed": 1, 2024-09-16T03:25:58.935 INFO:tasks.workunit.client.0.smithi096.stderr: "logm_last_committed": 372, 2024-09-16T03:25:58.935 INFO:tasks.workunit.client.0.smithi096.stderr: "paxos": { 2024-09-16T03:25:58.935 INFO:tasks.workunit.client.0.smithi096.stderr: "first_committed": 1, 2024-09-16T03:25:58.935 INFO:tasks.workunit.client.0.smithi096.stderr: "last_committed": 557, 2024-09-16T03:25:58.935 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pn": 0, 2024-09-16T03:25:58.935 INFO:tasks.workunit.client.0.smithi096.stderr: "accepted_pn": 0 2024-09-16T03:25:58.935 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:58.935 INFO:tasks.workunit.client.0.smithi096.stderr:}' 2024-09-16T03:25:58.938 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:121: validate_fc: jq .osdmap_clean_epochs.min_last_epoch_clean 2024-09-16T03:25:58.938 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:121: validate_fc: echo '{' '"cluster_fingerprint":' '"fda2fc64-07ed-4add-8224-2e527e11d427",' '"version":' '"19.3.0-4930-gfc3e0bff",' '"commit":' '"fc3e0bff7468fd55478adbae7f75508b749124b6",' '"timestamp":' '"2024-09-16T03:25:58.826084+0000",' '"tag":' '"",' '"health":' '{' '"status":' '"HEALTH_OK",' '"checks":' '{},' '"mutes":' '[]' '},' '"monmap_first_committed":' 1, '"monmap_last_committed":' 1, '"monmap":' '{' '"epoch":' 1, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"modified":' '"2024-09-16T03:22:45.872880Z",' '"created":' '"2024-09-16T03:22:45.872880Z",' '"min_mon_release":' 19, '"min_mon_release_name":' '"squid",' '"election_strategy":' 1, '"disallowed_leaders:' '":' '"",' '"stretch_mode":' false, '"tiebreaker_mon":' '"",' '"removed_ranks:' '":' '"",' '"features":' '{' '"persistent":' '[' '"kraken",' '"luminous",' '"mimic",' '"osdmap-prune",' '"nautilus",' '"octopus",' '"pacific",' '"elector-pinging",' '"quincy",' '"reef",' '"squid"' '],' '"optional":' '[]' '},' '"mons":' '[' '{' '"rank":' 0, '"name":' '"a",' '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:7302",' '"nonce":' 0 '}' ']' '},' '"addr":' '"127.0.0.1:7302/0",' '"public_addr":' '"127.0.0.1:7302/0",' '"priority":' 0, '"weight":' 0, '"crush_location":' '"{}"' '}' ']' '},' '"quorum":' '[' 0 '],' '"osdmap":' '{' '"epoch":' 83, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"created":' '"2024-09-16T03:22:46.906117+0000",' '"modified":' '"2024-09-16T03:25:57.328949+0000",' '"last_up_change":' '"2024-09-16T03:25:08.513363+0000",' '"last_in_change":' '"2024-09-16T03:25:09.839444+0000",' '"flags":' '"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit",' '"flags_num":' 5799936, '"flags_set":' '[' '"pglog_hardlimit",' '"purged_snapdirs",' '"recovery_deletes",' '"sortbitwise"' '],' '"crush_version":' 7, '"full_ratio":' 0.97000002861022949, '"backfillfull_ratio":' 0.97000002861022949, '"nearfull_ratio":' 0.85000002384185791, '"cluster_snapshot":' '"",' '"pool_max":' 2, '"max_osd":' 3, '"require_min_compat_client":' '"luminous",' '"min_compat_client":' '"jewel",' '"require_osd_release":' '"squid",' '"allow_crimson":' false, '"pools":' '[' '{' '"pool":' 1, '"pool_name":' '"foo",' '"create_time":' '"2024-09-16T03:24:44.525189+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"30",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.8700000047683716, '"score_stable":' 1.8700000047683716, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1.25, '"raw_score_stable":' 1.25, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '},' '{' '"pool":' 2, '"pool_name":' '"bar",' '"create_time":' '"2024-09-16T03:24:46.226575+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 2, '"min_size":' 1, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"83",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.4900000095367432, '"score_stable":' 1.4900000095367432, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1, '"raw_score_stable":' 1, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '}' '],' '"osds":' '[' '{' '"osd":' 0, '"uuid":' '"64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 5, '"up_thru":' 81, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6802",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6803",' '"nonce":' 3375787448 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6804",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6805",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6808",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6809",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6806",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6807",' '"nonce":' 3375787448 '}' ']' '},' '"public_addr":' '"127.0.0.1:6803/3375787448",' '"cluster_addr":' '"127.0.0.1:6805/3375787448",' '"heartbeat_back_addr":' '"127.0.0.1:6809/3375787448",' '"heartbeat_front_addr":' '"127.0.0.1:6807/3375787448",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 1, '"uuid":' '"74b26727-75c9-444d-8782-719e4197a382",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 10, '"up_thru":' 81, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6810",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6811",' '"nonce":' 3733255132 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6812",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6813",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6816",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6817",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6814",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6815",' '"nonce":' 3733255132 '}' ']' '},' '"public_addr":' '"127.0.0.1:6811/3733255132",' '"cluster_addr":' '"127.0.0.1:6813/3733255132",' '"heartbeat_back_addr":' '"127.0.0.1:6817/3733255132",' '"heartbeat_front_addr":' '"127.0.0.1:6815/3733255132",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 2, '"uuid":' '"143da3a7-dad9-4b1e-966b-76cf5bdd3c82",' '"up":' 0, '"in":' 0, '"weight":' 0, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 15, '"up_thru":' 21, '"down_at":' 33, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6818",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6819",' '"nonce":' 963814857 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6820",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6821",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6824",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6825",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6822",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6823",' '"nonce":' 963814857 '}' ']' '},' '"public_addr":' '"127.0.0.1:6819/963814857",' '"cluster_addr":' '"127.0.0.1:6821/963814857",' '"heartbeat_back_addr":' '"127.0.0.1:6825/963814857",' '"heartbeat_front_addr":' '"127.0.0.1:6823/963814857",' '"state":' '[' '"exists"' ']' '}' '],' '"osd_xinfo":' '[' '{' '"osd":' 0, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:22.481942+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 1, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:59.663703+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 2, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 65536, '"last_purged_snaps_scrub":' '"2024-09-16T03:24:37.320822+0000",' '"dead_epoch":' 32 '}' '],' '"pg_upmap":' '[],' '"pg_upmap_items":' '[],' '"pg_upmap_primaries":' '[],' '"pg_temp":' '[],' '"primary_temp":' '[],' '"blocklist":' '{},' '"range_blocklist":' '{},' '"erasure_code_profiles":' '{' '"default":' '{' '"k":' '"2",' '"m":' '"2",' '"plugin":' '"jerasure",' '"technique":' '"reed_sol_van"' '}' '},' '"removed_snaps_queue":' '[],' '"new_removed_snaps":' '[],' '"new_purged_snaps":' '[],' '"crush_node_flags":' '{},' '"device_class_flags":' '{},' '"stretch_mode":' '{' '"stretch_mode_enabled":' false, '"stretch_bucket_count":' 0, '"degraded_stretch_mode":' 0, '"recovering_stretch_mode":' 0, '"stretch_mode_bucket":' 0 '}' '},' '"osd_metadata":' '[' '{' '"id":' 0, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/0/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:22:53.662571Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]",' '"hb_front_addr":' '"[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/0",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 1, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/1/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:23:30.129885Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]",' '"hb_front_addr":' '"[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/1",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 2, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/2/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:24:07.764502Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]",' '"hb_front_addr":' '"[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/2",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '}' '],' '"osdmap_clean_epochs":' '{' '"min_last_epoch_clean":' 28, '"last_epoch_clean":' '{' '"per_pool":' '[' '{' '"poolid":' 1, '"floor":' 28 '},' '{' '"poolid":' 2, '"floor":' 28 '}' ']' '},' '"osd_epochs":' '[' '{' '"id":' 0, '"epoch":' 78 '},' '{' '"id":' 1, '"epoch":' 80 '}' ']' '},' '"osdmap_first_committed":' 28, '"osdmap_last_committed":' 83, '"crushmap":' '{' '"devices":' '[' '{' '"id":' 0, '"name":' '"osd.0",' '"class":' '"hdd"' '},' '{' '"id":' 1, '"name":' '"osd.1",' '"class":' '"hdd"' '},' '{' '"id":' 2, '"name":' '"osd.2",' '"class":' '"hdd"' '}' '],' '"types":' '[' '{' '"type_id":' 0, '"name":' '"osd"' '},' '{' '"type_id":' 1, '"name":' '"host"' '},' '{' '"type_id":' 2, '"name":' '"chassis"' '},' '{' '"type_id":' 3, '"name":' '"rack"' '},' '{' '"type_id":' 4, '"name":' '"row"' '},' '{' '"type_id":' 5, '"name":' '"pdu"' '},' '{' '"type_id":' 6, '"name":' '"pod"' '},' '{' '"type_id":' 7, '"name":' '"room"' '},' '{' '"type_id":' 8, '"name":' '"datacenter"' '},' '{' '"type_id":' 9, '"name":' '"zone"' '},' '{' '"type_id":' 10, '"name":' '"region"' '},' '{' '"type_id":' 11, '"name":' '"root"' '}' '],' '"buckets":' '[' '{' '"id":' -1, '"name":' '"default",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -3, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -2, '"name":' '"default~hdd",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -4, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -3, '"name":' '"smithi096",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '},' '{' '"id":' -4, '"name":' '"smithi096~hdd",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '}' '],' '"rules":' '[' '{' '"rule_id":' 0, '"rule_name":' '"replicated_rule",' '"type":' 1, '"steps":' '[' '{' '"op":' '"take",' '"item":' -1, '"item_name":' '"default"' '},' '{' '"op":' '"choose_firstn",' '"num":' 0, '"type":' '"osd"' '},' '{' '"op":' '"emit"' '}' ']' '}' '],' '"tunables":' '{' '"choose_local_tries":' 0, '"choose_local_fallback_tries":' 0, '"choose_total_tries":' 50, '"chooseleaf_descend_once":' 1, '"chooseleaf_vary_r":' 1, '"chooseleaf_stable":' 1, '"msr_descents":' 100, '"msr_collision_tries":' 100, '"straw_calc_version":' 1, '"allowed_bucket_algs":' 54, '"profile":' '"jewel",' '"optimal_tunables":' 1, '"legacy_tunables":' 0, '"minimum_required_version":' '"jewel",' '"require_feature_tunables":' 1, '"require_feature_tunables2":' 1, '"has_v2_rules":' 0, '"require_feature_tunables3":' 1, '"has_v3_rules":' 0, '"has_v4_buckets":' 1, '"require_feature_tunables5":' 1, '"has_v5_rules":' 0, '"has_msr_rules":' 0 '},' '"choose_args":' '{}' '},' '"fsmap":' '{' '"epoch":' 1, '"btime":' '"2024-09-16T03:22:46:882186+0000",' '"default_fscid":' -1, '"compat":' '{' '"compat":' '{},' '"ro_compat":' '{},' '"incompat":' '{' '"feature_1":' '"base' 'v0.20",' '"feature_2":' '"client' writeable 'ranges",' '"feature_3":' '"default' file layouts on 'dirs",' '"feature_4":' '"dir' inode in separate 'object",' '"feature_5":' '"mds' uses versioned 'encoding",' '"feature_6":' '"dirfrag' is stored in 'omap",' '"feature_8":' '"no' anchor 'table",' '"feature_9":' '"file' layout 'v2",' '"feature_10":' '"snaprealm' 'v2",' '"feature_11":' '"minor' log 'segments",' '"feature_12":' '"quiesce' 'subvolumes"' '}' '},' '"feature_flags":' '{' '"enable_multiple":' true, '"ever_enabled_multiple":' true '},' '"standbys":' '[],' '"filesystems":' '[]' '},' '"mdsmap_first_committed":' 1, '"mdsmap_last_committed":' 1, '"auth":' '{' '"first_committed":' 1, '"last_committed":' 5, '"num_secrets":' 3 '},' '"num_pg":' 64, '"num_pg_active":' 64, '"num_pg_unknown":' 0, '"num_osd":' 3, '"pool_sum":' '{' '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 128, '"acting":' 128, '"num_store_stats":' 0 '},' '"osd_sum":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54568, '"kb_used_data":' 856, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660632, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692487168, '"internally_reserved":' 0, '"allocated":' 876544, '"data_stored":' 327566, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 219, '"apply_latency_ms":' 219, '"commit_latency_ns":' 219000000, '"apply_latency_ns":' 219000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '},' '"osd_sum_by_class":' '{' '"hdd":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54568, '"kb_used_data":' 856, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660632, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692487168, '"internally_reserved":' 0, '"allocated":' 876544, '"data_stored":' 327566, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 219, '"apply_latency_ms":' 219, '"commit_latency_ns":' 219000000, '"apply_latency_ns":' 219000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '}' '},' '"pool_stats":' '[' '{' '"poolid":' 2, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '},' '{' '"poolid":' 1, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '}' '],' '"osd_stats":' '[' '{' '"osd":' 0, '"seq":' 21474836517 '},' '{' '"osd":' 1, '"seq":' 42949672989 '},' '{' '"osd":' 2, '"seq":' 0 '}' '],' '"num_pg_by_state":' '[' '{' '"state":' '"active+undersized",' '"num":' 64 '}' '],' '"num_pg_by_osd":' '[' '{' '"osd":' 2, '"num_primary_pg":' 0, '"num_acting_pg":' 0, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 0, '"num_primary_pg":' 28, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 1, '"num_primary_pg":' 36, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '}' '],' '"purged_snaps":' '[' '{' '"pool":' 1, '"purged_snaps":' '{}' '},' '{' '"pool":' 2, '"purged_snaps":' '{}' '}' '],' '"servicemap":' '{' '"epoch":' 5, '"modified":' '"2024-09-16T03:25:38.422788+0000",' '"services":' '{}' '},' '"mgrstat_first_committed":' 79, '"mgrstat_last_committed":' 85, '"logm_first_committed":' 1, '"logm_last_committed":' 372, '"paxos":' '{' '"first_committed":' 1, '"last_committed":' 557, '"last_pn":' 0, '"accepted_pn":' 0 '}' '}' 2024-09-16T03:25:58.938 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:121: validate_fc: lec=28 2024-09-16T03:25:58.938 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:123: validate_fc: jq .osdmap_first_committed 2024-09-16T03:25:58.938 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:123: validate_fc: echo '{' '"cluster_fingerprint":' '"fda2fc64-07ed-4add-8224-2e527e11d427",' '"version":' '"19.3.0-4930-gfc3e0bff",' '"commit":' '"fc3e0bff7468fd55478adbae7f75508b749124b6",' '"timestamp":' '"2024-09-16T03:25:58.826084+0000",' '"tag":' '"",' '"health":' '{' '"status":' '"HEALTH_OK",' '"checks":' '{},' '"mutes":' '[]' '},' '"monmap_first_committed":' 1, '"monmap_last_committed":' 1, '"monmap":' '{' '"epoch":' 1, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"modified":' '"2024-09-16T03:22:45.872880Z",' '"created":' '"2024-09-16T03:22:45.872880Z",' '"min_mon_release":' 19, '"min_mon_release_name":' '"squid",' '"election_strategy":' 1, '"disallowed_leaders:' '":' '"",' '"stretch_mode":' false, '"tiebreaker_mon":' '"",' '"removed_ranks:' '":' '"",' '"features":' '{' '"persistent":' '[' '"kraken",' '"luminous",' '"mimic",' '"osdmap-prune",' '"nautilus",' '"octopus",' '"pacific",' '"elector-pinging",' '"quincy",' '"reef",' '"squid"' '],' '"optional":' '[]' '},' '"mons":' '[' '{' '"rank":' 0, '"name":' '"a",' '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:7302",' '"nonce":' 0 '}' ']' '},' '"addr":' '"127.0.0.1:7302/0",' '"public_addr":' '"127.0.0.1:7302/0",' '"priority":' 0, '"weight":' 0, '"crush_location":' '"{}"' '}' ']' '},' '"quorum":' '[' 0 '],' '"osdmap":' '{' '"epoch":' 83, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"created":' '"2024-09-16T03:22:46.906117+0000",' '"modified":' '"2024-09-16T03:25:57.328949+0000",' '"last_up_change":' '"2024-09-16T03:25:08.513363+0000",' '"last_in_change":' '"2024-09-16T03:25:09.839444+0000",' '"flags":' '"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit",' '"flags_num":' 5799936, '"flags_set":' '[' '"pglog_hardlimit",' '"purged_snapdirs",' '"recovery_deletes",' '"sortbitwise"' '],' '"crush_version":' 7, '"full_ratio":' 0.97000002861022949, '"backfillfull_ratio":' 0.97000002861022949, '"nearfull_ratio":' 0.85000002384185791, '"cluster_snapshot":' '"",' '"pool_max":' 2, '"max_osd":' 3, '"require_min_compat_client":' '"luminous",' '"min_compat_client":' '"jewel",' '"require_osd_release":' '"squid",' '"allow_crimson":' false, '"pools":' '[' '{' '"pool":' 1, '"pool_name":' '"foo",' '"create_time":' '"2024-09-16T03:24:44.525189+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"30",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.8700000047683716, '"score_stable":' 1.8700000047683716, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1.25, '"raw_score_stable":' 1.25, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '},' '{' '"pool":' 2, '"pool_name":' '"bar",' '"create_time":' '"2024-09-16T03:24:46.226575+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 2, '"min_size":' 1, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"83",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.4900000095367432, '"score_stable":' 1.4900000095367432, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1, '"raw_score_stable":' 1, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '}' '],' '"osds":' '[' '{' '"osd":' 0, '"uuid":' '"64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 5, '"up_thru":' 81, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6802",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6803",' '"nonce":' 3375787448 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6804",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6805",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6808",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6809",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6806",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6807",' '"nonce":' 3375787448 '}' ']' '},' '"public_addr":' '"127.0.0.1:6803/3375787448",' '"cluster_addr":' '"127.0.0.1:6805/3375787448",' '"heartbeat_back_addr":' '"127.0.0.1:6809/3375787448",' '"heartbeat_front_addr":' '"127.0.0.1:6807/3375787448",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 1, '"uuid":' '"74b26727-75c9-444d-8782-719e4197a382",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 10, '"up_thru":' 81, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6810",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6811",' '"nonce":' 3733255132 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6812",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6813",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6816",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6817",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6814",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6815",' '"nonce":' 3733255132 '}' ']' '},' '"public_addr":' '"127.0.0.1:6811/3733255132",' '"cluster_addr":' '"127.0.0.1:6813/3733255132",' '"heartbeat_back_addr":' '"127.0.0.1:6817/3733255132",' '"heartbeat_front_addr":' '"127.0.0.1:6815/3733255132",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 2, '"uuid":' '"143da3a7-dad9-4b1e-966b-76cf5bdd3c82",' '"up":' 0, '"in":' 0, '"weight":' 0, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 15, '"up_thru":' 21, '"down_at":' 33, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6818",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6819",' '"nonce":' 963814857 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6820",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6821",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6824",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6825",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6822",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6823",' '"nonce":' 963814857 '}' ']' '},' '"public_addr":' '"127.0.0.1:6819/963814857",' '"cluster_addr":' '"127.0.0.1:6821/963814857",' '"heartbeat_back_addr":' '"127.0.0.1:6825/963814857",' '"heartbeat_front_addr":' '"127.0.0.1:6823/963814857",' '"state":' '[' '"exists"' ']' '}' '],' '"osd_xinfo":' '[' '{' '"osd":' 0, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:22.481942+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 1, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:59.663703+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 2, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 65536, '"last_purged_snaps_scrub":' '"2024-09-16T03:24:37.320822+0000",' '"dead_epoch":' 32 '}' '],' '"pg_upmap":' '[],' '"pg_upmap_items":' '[],' '"pg_upmap_primaries":' '[],' '"pg_temp":' '[],' '"primary_temp":' '[],' '"blocklist":' '{},' '"range_blocklist":' '{},' '"erasure_code_profiles":' '{' '"default":' '{' '"k":' '"2",' '"m":' '"2",' '"plugin":' '"jerasure",' '"technique":' '"reed_sol_van"' '}' '},' '"removed_snaps_queue":' '[],' '"new_removed_snaps":' '[],' '"new_purged_snaps":' '[],' '"crush_node_flags":' '{},' '"device_class_flags":' '{},' '"stretch_mode":' '{' '"stretch_mode_enabled":' false, '"stretch_bucket_count":' 0, '"degraded_stretch_mode":' 0, '"recovering_stretch_mode":' 0, '"stretch_mode_bucket":' 0 '}' '},' '"osd_metadata":' '[' '{' '"id":' 0, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/0/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:22:53.662571Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]",' '"hb_front_addr":' '"[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/0",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 1, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/1/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:23:30.129885Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]",' '"hb_front_addr":' '"[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/1",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 2, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/2/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:24:07.764502Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]",' '"hb_front_addr":' '"[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/2",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '}' '],' '"osdmap_clean_epochs":' '{' '"min_last_epoch_clean":' 28, '"last_epoch_clean":' '{' '"per_pool":' '[' '{' '"poolid":' 1, '"floor":' 28 '},' '{' '"poolid":' 2, '"floor":' 28 '}' ']' '},' '"osd_epochs":' '[' '{' '"id":' 0, '"epoch":' 78 '},' '{' '"id":' 1, '"epoch":' 80 '}' ']' '},' '"osdmap_first_committed":' 28, '"osdmap_last_committed":' 83, '"crushmap":' '{' '"devices":' '[' '{' '"id":' 0, '"name":' '"osd.0",' '"class":' '"hdd"' '},' '{' '"id":' 1, '"name":' '"osd.1",' '"class":' '"hdd"' '},' '{' '"id":' 2, '"name":' '"osd.2",' '"class":' '"hdd"' '}' '],' '"types":' '[' '{' '"type_id":' 0, '"name":' '"osd"' '},' '{' '"type_id":' 1, '"name":' '"host"' '},' '{' '"type_id":' 2, '"name":' '"chassis"' '},' '{' '"type_id":' 3, '"name":' '"rack"' '},' '{' '"type_id":' 4, '"name":' '"row"' '},' '{' '"type_id":' 5, '"name":' '"pdu"' '},' '{' '"type_id":' 6, '"name":' '"pod"' '},' '{' '"type_id":' 7, '"name":' '"room"' '},' '{' '"type_id":' 8, '"name":' '"datacenter"' '},' '{' '"type_id":' 9, '"name":' '"zone"' '},' '{' '"type_id":' 10, '"name":' '"region"' '},' '{' '"type_id":' 11, '"name":' '"root"' '}' '],' '"buckets":' '[' '{' '"id":' -1, '"name":' '"default",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -3, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -2, '"name":' '"default~hdd",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -4, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -3, '"name":' '"smithi096",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '},' '{' '"id":' -4, '"name":' '"smithi096~hdd",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '}' '],' '"rules":' '[' '{' '"rule_id":' 0, '"rule_name":' '"replicated_rule",' '"type":' 1, '"steps":' '[' '{' '"op":' '"take",' '"item":' -1, '"item_name":' '"default"' '},' '{' '"op":' '"choose_firstn",' '"num":' 0, '"type":' '"osd"' '},' '{' '"op":' '"emit"' '}' ']' '}' '],' '"tunables":' '{' '"choose_local_tries":' 0, '"choose_local_fallback_tries":' 0, '"choose_total_tries":' 50, '"chooseleaf_descend_once":' 1, '"chooseleaf_vary_r":' 1, '"chooseleaf_stable":' 1, '"msr_descents":' 100, '"msr_collision_tries":' 100, '"straw_calc_version":' 1, '"allowed_bucket_algs":' 54, '"profile":' '"jewel",' '"optimal_tunables":' 1, '"legacy_tunables":' 0, '"minimum_required_version":' '"jewel",' '"require_feature_tunables":' 1, '"require_feature_tunables2":' 1, '"has_v2_rules":' 0, '"require_feature_tunables3":' 1, '"has_v3_rules":' 0, '"has_v4_buckets":' 1, '"require_feature_tunables5":' 1, '"has_v5_rules":' 0, '"has_msr_rules":' 0 '},' '"choose_args":' '{}' '},' '"fsmap":' '{' '"epoch":' 1, '"btime":' '"2024-09-16T03:22:46:882186+0000",' '"default_fscid":' -1, '"compat":' '{' '"compat":' '{},' '"ro_compat":' '{},' '"incompat":' '{' '"feature_1":' '"base' 'v0.20",' '"feature_2":' '"client' writeable 'ranges",' '"feature_3":' '"default' file layouts on 'dirs",' '"feature_4":' '"dir' inode in separate 'object",' '"feature_5":' '"mds' uses versioned 'encoding",' '"feature_6":' '"dirfrag' is stored in 'omap",' '"feature_8":' '"no' anchor 'table",' '"feature_9":' '"file' layout 'v2",' '"feature_10":' '"snaprealm' 'v2",' '"feature_11":' '"minor' log 'segments",' '"feature_12":' '"quiesce' 'subvolumes"' '}' '},' '"feature_flags":' '{' '"enable_multiple":' true, '"ever_enabled_multiple":' true '},' '"standbys":' '[],' '"filesystems":' '[]' '},' '"mdsmap_first_committed":' 1, '"mdsmap_last_committed":' 1, '"auth":' '{' '"first_committed":' 1, '"last_committed":' 5, '"num_secrets":' 3 '},' '"num_pg":' 64, '"num_pg_active":' 64, '"num_pg_unknown":' 0, '"num_osd":' 3, '"pool_sum":' '{' '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 128, '"acting":' 128, '"num_store_stats":' 0 '},' '"osd_sum":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54568, '"kb_used_data":' 856, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660632, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692487168, '"internally_reserved":' 0, '"allocated":' 876544, '"data_stored":' 327566, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 219, '"apply_latency_ms":' 219, '"commit_latency_ns":' 219000000, '"apply_latency_ns":' 219000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '},' '"osd_sum_by_class":' '{' '"hdd":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54568, '"kb_used_data":' 856, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660632, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692487168, '"internally_reserved":' 0, '"allocated":' 876544, '"data_stored":' 327566, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 219, '"apply_latency_ms":' 219, '"commit_latency_ns":' 219000000, '"apply_latency_ns":' 219000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '}' '},' '"pool_stats":' '[' '{' '"poolid":' 2, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '},' '{' '"poolid":' 1, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '}' '],' '"osd_stats":' '[' '{' '"osd":' 0, '"seq":' 21474836517 '},' '{' '"osd":' 1, '"seq":' 42949672989 '},' '{' '"osd":' 2, '"seq":' 0 '}' '],' '"num_pg_by_state":' '[' '{' '"state":' '"active+undersized",' '"num":' 64 '}' '],' '"num_pg_by_osd":' '[' '{' '"osd":' 2, '"num_primary_pg":' 0, '"num_acting_pg":' 0, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 0, '"num_primary_pg":' 28, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 1, '"num_primary_pg":' 36, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '}' '],' '"purged_snaps":' '[' '{' '"pool":' 1, '"purged_snaps":' '{}' '},' '{' '"pool":' 2, '"purged_snaps":' '{}' '}' '],' '"servicemap":' '{' '"epoch":' 5, '"modified":' '"2024-09-16T03:25:38.422788+0000",' '"services":' '{}' '},' '"mgrstat_first_committed":' 79, '"mgrstat_last_committed":' 85, '"logm_first_committed":' 1, '"logm_last_committed":' 372, '"paxos":' '{' '"first_committed":' 1, '"last_committed":' 557, '"last_pn":' 0, '"accepted_pn":' 0 '}' '}' 2024-09-16T03:25:58.938 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:123: validate_fc: osdm_fc=28 2024-09-16T03:25:58.939 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:125: validate_fc: [[ 28 -eq 28 ]] 2024-09-16T03:25:58.939 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:126: validate_fc: return 0 2024-09-16T03:25:58.939 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:260: TEST_mon_last_clean_epoch: check_lec_equals_pools 1 2024-09-16T03:25:58.939 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:26: check_lec_equals_pools: local pool_id=1 2024-09-16T03:25:58.939 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:28: check_lec_equals_pools: ceph report 2024-09-16T03:25:59.465 INFO:tasks.workunit.client.0.smithi096.stderr:report 537062539 2024-09-16T03:25:59.481 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:28: check_lec_equals_pools: report='{ 2024-09-16T03:25:59.481 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_fingerprint": "fda2fc64-07ed-4add-8224-2e527e11d427", 2024-09-16T03:25:59.481 INFO:tasks.workunit.client.0.smithi096.stderr: "version": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:25:59.481 INFO:tasks.workunit.client.0.smithi096.stderr: "commit": "fc3e0bff7468fd55478adbae7f75508b749124b6", 2024-09-16T03:25:59.482 INFO:tasks.workunit.client.0.smithi096.stderr: "timestamp": "2024-09-16T03:25:59.465184+0000", 2024-09-16T03:25:59.482 INFO:tasks.workunit.client.0.smithi096.stderr: "tag": "", 2024-09-16T03:25:59.482 INFO:tasks.workunit.client.0.smithi096.stderr: "health": { 2024-09-16T03:25:59.482 INFO:tasks.workunit.client.0.smithi096.stderr: "status": "HEALTH_OK", 2024-09-16T03:25:59.482 INFO:tasks.workunit.client.0.smithi096.stderr: "checks": {}, 2024-09-16T03:25:59.482 INFO:tasks.workunit.client.0.smithi096.stderr: "mutes": [] 2024-09-16T03:25:59.482 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.482 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap_first_committed": 1, 2024-09-16T03:25:59.482 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap_last_committed": 1, 2024-09-16T03:25:59.482 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap": { 2024-09-16T03:25:59.482 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 1, 2024-09-16T03:25:59.482 INFO:tasks.workunit.client.0.smithi096.stderr: "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", 2024-09-16T03:25:59.482 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:22:45.872880Z", 2024-09-16T03:25:59.483 INFO:tasks.workunit.client.0.smithi096.stderr: "created": "2024-09-16T03:22:45.872880Z", 2024-09-16T03:25:59.483 INFO:tasks.workunit.client.0.smithi096.stderr: "min_mon_release": 19, 2024-09-16T03:25:59.483 INFO:tasks.workunit.client.0.smithi096.stderr: "min_mon_release_name": "squid", 2024-09-16T03:25:59.483 INFO:tasks.workunit.client.0.smithi096.stderr: "election_strategy": 1, 2024-09-16T03:25:59.483 INFO:tasks.workunit.client.0.smithi096.stderr: "disallowed_leaders: ": "", 2024-09-16T03:25:59.483 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode": false, 2024-09-16T03:25:59.483 INFO:tasks.workunit.client.0.smithi096.stderr: "tiebreaker_mon": "", 2024-09-16T03:25:59.483 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_ranks: ": "", 2024-09-16T03:25:59.483 INFO:tasks.workunit.client.0.smithi096.stderr: "features": { 2024-09-16T03:25:59.483 INFO:tasks.workunit.client.0.smithi096.stderr: "persistent": [ 2024-09-16T03:25:59.483 INFO:tasks.workunit.client.0.smithi096.stderr: "kraken", 2024-09-16T03:25:59.483 INFO:tasks.workunit.client.0.smithi096.stderr: "luminous", 2024-09-16T03:25:59.484 INFO:tasks.workunit.client.0.smithi096.stderr: "mimic", 2024-09-16T03:25:59.484 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap-prune", 2024-09-16T03:25:59.484 INFO:tasks.workunit.client.0.smithi096.stderr: "nautilus", 2024-09-16T03:25:59.484 INFO:tasks.workunit.client.0.smithi096.stderr: "octopus", 2024-09-16T03:25:59.484 INFO:tasks.workunit.client.0.smithi096.stderr: "pacific", 2024-09-16T03:25:59.484 INFO:tasks.workunit.client.0.smithi096.stderr: "elector-pinging", 2024-09-16T03:25:59.484 INFO:tasks.workunit.client.0.smithi096.stderr: "quincy", 2024-09-16T03:25:59.484 INFO:tasks.workunit.client.0.smithi096.stderr: "reef", 2024-09-16T03:25:59.484 INFO:tasks.workunit.client.0.smithi096.stderr: "squid" 2024-09-16T03:25:59.484 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:59.484 INFO:tasks.workunit.client.0.smithi096.stderr: "optional": [] 2024-09-16T03:25:59.484 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.484 INFO:tasks.workunit.client.0.smithi096.stderr: "mons": [ 2024-09-16T03:25:59.485 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:59.485 INFO:tasks.workunit.client.0.smithi096.stderr: "rank": 0, 2024-09-16T03:25:59.485 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "a", 2024-09-16T03:25:59.485 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:25:59.485 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:59.485 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:59.485 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:59.485 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:7302", 2024-09-16T03:25:59.485 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 0 2024-09-16T03:25:59.485 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:59.485 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:59.485 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.485 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:7302/0", 2024-09-16T03:25:59.486 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:7302/0", 2024-09-16T03:25:59.486 INFO:tasks.workunit.client.0.smithi096.stderr: "priority": 0, 2024-09-16T03:25:59.486 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 0, 2024-09-16T03:25:59.486 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_location": "{}" 2024-09-16T03:25:59.486 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:59.486 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:59.486 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.486 INFO:tasks.workunit.client.0.smithi096.stderr: "quorum": [ 2024-09-16T03:25:59.486 INFO:tasks.workunit.client.0.smithi096.stderr: 0 2024-09-16T03:25:59.486 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:59.486 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap": { 2024-09-16T03:25:59.486 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 83, 2024-09-16T03:25:59.486 INFO:tasks.workunit.client.0.smithi096.stderr: "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", 2024-09-16T03:25:59.487 INFO:tasks.workunit.client.0.smithi096.stderr: "created": "2024-09-16T03:22:46.906117+0000", 2024-09-16T03:25:59.487 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:25:57.328949+0000", 2024-09-16T03:25:59.487 INFO:tasks.workunit.client.0.smithi096.stderr: "last_up_change": "2024-09-16T03:25:08.513363+0000", 2024-09-16T03:25:59.487 INFO:tasks.workunit.client.0.smithi096.stderr: "last_in_change": "2024-09-16T03:25:09.839444+0000", 2024-09-16T03:25:59.487 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-16T03:25:59.487 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_num": 5799936, 2024-09-16T03:25:59.487 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_set": [ 2024-09-16T03:25:59.487 INFO:tasks.workunit.client.0.smithi096.stderr: "pglog_hardlimit", 2024-09-16T03:25:59.487 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snapdirs", 2024-09-16T03:25:59.487 INFO:tasks.workunit.client.0.smithi096.stderr: "recovery_deletes", 2024-09-16T03:25:59.487 INFO:tasks.workunit.client.0.smithi096.stderr: "sortbitwise" 2024-09-16T03:25:59.487 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:59.488 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_version": 7, 2024-09-16T03:25:59.488 INFO:tasks.workunit.client.0.smithi096.stderr: "full_ratio": 0.97000002861022949, 2024-09-16T03:25:59.488 INFO:tasks.workunit.client.0.smithi096.stderr: "backfillfull_ratio": 0.97000002861022949, 2024-09-16T03:25:59.488 INFO:tasks.workunit.client.0.smithi096.stderr: "nearfull_ratio": 0.85000002384185791, 2024-09-16T03:25:59.488 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_snapshot": "", 2024-09-16T03:25:59.488 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_max": 2, 2024-09-16T03:25:59.488 INFO:tasks.workunit.client.0.smithi096.stderr: "max_osd": 3, 2024-09-16T03:25:59.488 INFO:tasks.workunit.client.0.smithi096.stderr: "require_min_compat_client": "luminous", 2024-09-16T03:25:59.488 INFO:tasks.workunit.client.0.smithi096.stderr: "min_compat_client": "jewel", 2024-09-16T03:25:59.488 INFO:tasks.workunit.client.0.smithi096.stderr: "require_osd_release": "squid", 2024-09-16T03:25:59.488 INFO:tasks.workunit.client.0.smithi096.stderr: "allow_crimson": false, 2024-09-16T03:25:59.488 INFO:tasks.workunit.client.0.smithi096.stderr: "pools": [ 2024-09-16T03:25:59.488 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:59.488 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 1, 2024-09-16T03:25:59.489 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_name": "foo", 2024-09-16T03:25:59.489 INFO:tasks.workunit.client.0.smithi096.stderr: "create_time": "2024-09-16T03:24:44.525189+0000", 2024-09-16T03:25:59.489 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": 1, 2024-09-16T03:25:59.489 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_names": "hashpspool", 2024-09-16T03:25:59.489 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:25:59.489 INFO:tasks.workunit.client.0.smithi096.stderr: "size": 3, 2024-09-16T03:25:59.489 INFO:tasks.workunit.client.0.smithi096.stderr: "min_size": 2, 2024-09-16T03:25:59.489 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_rule": 0, 2024-09-16T03:25:59.489 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_count": 0, 2024-09-16T03:25:59.489 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_target": 0, 2024-09-16T03:25:59.489 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_barrier": 0, 2024-09-16T03:25:59.489 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-16T03:25:59.489 INFO:tasks.workunit.client.0.smithi096.stderr: "is_stretch_pool": false, 2024-09-16T03:25:59.490 INFO:tasks.workunit.client.0.smithi096.stderr: "object_hash": 2, 2024-09-16T03:25:59.490 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_autoscale_mode": "off", 2024-09-16T03:25:59.490 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num": 32, 2024-09-16T03:25:59.490 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num": 32, 2024-09-16T03:25:59.490 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num_target": 32, 2024-09-16T03:25:59.490 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_target": 32, 2024-09-16T03:25:59.490 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_pending": 32, 2024-09-16T03:25:59.490 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pg_merge_meta": { 2024-09-16T03:25:59.490 INFO:tasks.workunit.client.0.smithi096.stderr: "source_pgid": "0.0", 2024-09-16T03:25:59.490 INFO:tasks.workunit.client.0.smithi096.stderr: "ready_epoch": 0, 2024-09-16T03:25:59.490 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_started": 0, 2024-09-16T03:25:59.490 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": 0, 2024-09-16T03:25:59.490 INFO:tasks.workunit.client.0.smithi096.stderr: "source_version": "0'\''0", 2024-09-16T03:25:59.491 INFO:tasks.workunit.client.0.smithi096.stderr: "target_version": "0'\''0" 2024-09-16T03:25:59.491 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.491 INFO:tasks.workunit.client.0.smithi096.stderr: "last_change": "30", 2024-09-16T03:25:59.491 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend": "0", 2024-09-16T03:25:59.491 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_prenautilus": "0", 2024-09-16T03:25:59.491 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_preluminous": "0", 2024-09-16T03:25:59.491 INFO:tasks.workunit.client.0.smithi096.stderr: "auid": 0, 2024-09-16T03:25:59.491 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_mode": "selfmanaged", 2024-09-16T03:25:59.491 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_seq": 0, 2024-09-16T03:25:59.491 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_epoch": 0, 2024-09-16T03:25:59.491 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_snaps": [], 2024-09-16T03:25:59.491 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps": "[]", 2024-09-16T03:25:59.491 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_bytes": 0, 2024-09-16T03:25:59.491 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_objects": 0, 2024-09-16T03:25:59.492 INFO:tasks.workunit.client.0.smithi096.stderr: "tiers": [], 2024-09-16T03:25:59.492 INFO:tasks.workunit.client.0.smithi096.stderr: "tier_of": -1, 2024-09-16T03:25:59.492 INFO:tasks.workunit.client.0.smithi096.stderr: "read_tier": -1, 2024-09-16T03:25:59.492 INFO:tasks.workunit.client.0.smithi096.stderr: "write_tier": -1, 2024-09-16T03:25:59.492 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_mode": "none", 2024-09-16T03:25:59.492 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_bytes": 0, 2024-09-16T03:25:59.492 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_objects": 0, 2024-09-16T03:25:59.492 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_ratio_micro": 400000, 2024-09-16T03:25:59.492 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-16T03:25:59.492 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_full_ratio_micro": 800000, 2024-09-16T03:25:59.492 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_flush_age": 0, 2024-09-16T03:25:59.492 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_evict_age": 0, 2024-09-16T03:25:59.492 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profile": "", 2024-09-16T03:25:59.493 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_params": { 2024-09-16T03:25:59.493 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "none" 2024-09-16T03:25:59.493 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.493 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_period": 0, 2024-09-16T03:25:59.493 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_count": 0, 2024-09-16T03:25:59.493 INFO:tasks.workunit.client.0.smithi096.stderr: "use_gmt_hitset": true, 2024-09-16T03:25:59.493 INFO:tasks.workunit.client.0.smithi096.stderr: "min_read_recency_for_promote": 0, 2024-09-16T03:25:59.493 INFO:tasks.workunit.client.0.smithi096.stderr: "min_write_recency_for_promote": 0, 2024-09-16T03:25:59.493 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_grade_decay_rate": 0, 2024-09-16T03:25:59.493 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_search_last_n": 0, 2024-09-16T03:25:59.493 INFO:tasks.workunit.client.0.smithi096.stderr: "grade_table": [], 2024-09-16T03:25:59.493 INFO:tasks.workunit.client.0.smithi096.stderr: "stripe_width": 0, 2024-09-16T03:25:59.493 INFO:tasks.workunit.client.0.smithi096.stderr: "expected_num_objects": 0, 2024-09-16T03:25:59.494 INFO:tasks.workunit.client.0.smithi096.stderr: "fast_read": false, 2024-09-16T03:25:59.494 INFO:tasks.workunit.client.0.smithi096.stderr: "options": {}, 2024-09-16T03:25:59.494 INFO:tasks.workunit.client.0.smithi096.stderr: "application_metadata": {}, 2024-09-16T03:25:59.494 INFO:tasks.workunit.client.0.smithi096.stderr: "read_balance": { 2024-09-16T03:25:59.494 INFO:tasks.workunit.client.0.smithi096.stderr: "score_type": "Fair distribution", 2024-09-16T03:25:59.494 INFO:tasks.workunit.client.0.smithi096.stderr: "score_acting": 1.8700000047683716, 2024-09-16T03:25:59.494 INFO:tasks.workunit.client.0.smithi096.stderr: "score_stable": 1.8700000047683716, 2024-09-16T03:25:59.494 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_score": 0.67000001668930054, 2024-09-16T03:25:59.494 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_acting": 1.25, 2024-09-16T03:25:59.494 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_stable": 1.25, 2024-09-16T03:25:59.494 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity_weighted": 1, 2024-09-16T03:25:59.494 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity": 1, 2024-09-16T03:25:59.494 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity_weighted": 1 2024-09-16T03:25:59.494 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:59.494 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.495 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:59.495 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 2, 2024-09-16T03:25:59.495 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_name": "bar", 2024-09-16T03:25:59.495 INFO:tasks.workunit.client.0.smithi096.stderr: "create_time": "2024-09-16T03:24:46.226575+0000", 2024-09-16T03:25:59.495 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": 1, 2024-09-16T03:25:59.495 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_names": "hashpspool", 2024-09-16T03:25:59.495 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:25:59.495 INFO:tasks.workunit.client.0.smithi096.stderr: "size": 2, 2024-09-16T03:25:59.495 INFO:tasks.workunit.client.0.smithi096.stderr: "min_size": 1, 2024-09-16T03:25:59.495 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_rule": 0, 2024-09-16T03:25:59.495 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_count": 0, 2024-09-16T03:25:59.495 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_target": 0, 2024-09-16T03:25:59.495 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_barrier": 0, 2024-09-16T03:25:59.496 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-16T03:25:59.496 INFO:tasks.workunit.client.0.smithi096.stderr: "is_stretch_pool": false, 2024-09-16T03:25:59.496 INFO:tasks.workunit.client.0.smithi096.stderr: "object_hash": 2, 2024-09-16T03:25:59.496 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_autoscale_mode": "off", 2024-09-16T03:25:59.496 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num": 32, 2024-09-16T03:25:59.496 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num": 32, 2024-09-16T03:25:59.496 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num_target": 32, 2024-09-16T03:25:59.496 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_target": 32, 2024-09-16T03:25:59.496 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_pending": 32, 2024-09-16T03:25:59.496 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pg_merge_meta": { 2024-09-16T03:25:59.496 INFO:tasks.workunit.client.0.smithi096.stderr: "source_pgid": "0.0", 2024-09-16T03:25:59.496 INFO:tasks.workunit.client.0.smithi096.stderr: "ready_epoch": 0, 2024-09-16T03:25:59.496 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_started": 0, 2024-09-16T03:25:59.497 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": 0, 2024-09-16T03:25:59.497 INFO:tasks.workunit.client.0.smithi096.stderr: "source_version": "0'\''0", 2024-09-16T03:25:59.497 INFO:tasks.workunit.client.0.smithi096.stderr: "target_version": "0'\''0" 2024-09-16T03:25:59.497 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.497 INFO:tasks.workunit.client.0.smithi096.stderr: "last_change": "83", 2024-09-16T03:25:59.497 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend": "0", 2024-09-16T03:25:59.497 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_prenautilus": "0", 2024-09-16T03:25:59.497 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_preluminous": "0", 2024-09-16T03:25:59.497 INFO:tasks.workunit.client.0.smithi096.stderr: "auid": 0, 2024-09-16T03:25:59.497 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_mode": "selfmanaged", 2024-09-16T03:25:59.497 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_seq": 0, 2024-09-16T03:25:59.497 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_epoch": 0, 2024-09-16T03:25:59.497 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_snaps": [], 2024-09-16T03:25:59.497 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps": "[]", 2024-09-16T03:25:59.498 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_bytes": 0, 2024-09-16T03:25:59.498 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_objects": 0, 2024-09-16T03:25:59.498 INFO:tasks.workunit.client.0.smithi096.stderr: "tiers": [], 2024-09-16T03:25:59.498 INFO:tasks.workunit.client.0.smithi096.stderr: "tier_of": -1, 2024-09-16T03:25:59.498 INFO:tasks.workunit.client.0.smithi096.stderr: "read_tier": -1, 2024-09-16T03:25:59.498 INFO:tasks.workunit.client.0.smithi096.stderr: "write_tier": -1, 2024-09-16T03:25:59.498 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_mode": "none", 2024-09-16T03:25:59.498 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_bytes": 0, 2024-09-16T03:25:59.498 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_objects": 0, 2024-09-16T03:25:59.498 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_ratio_micro": 400000, 2024-09-16T03:25:59.498 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-16T03:25:59.498 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_full_ratio_micro": 800000, 2024-09-16T03:25:59.499 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_flush_age": 0, 2024-09-16T03:25:59.499 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_evict_age": 0, 2024-09-16T03:25:59.499 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profile": "", 2024-09-16T03:25:59.499 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_params": { 2024-09-16T03:25:59.499 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "none" 2024-09-16T03:25:59.499 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.499 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_period": 0, 2024-09-16T03:25:59.499 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_count": 0, 2024-09-16T03:25:59.499 INFO:tasks.workunit.client.0.smithi096.stderr: "use_gmt_hitset": true, 2024-09-16T03:25:59.499 INFO:tasks.workunit.client.0.smithi096.stderr: "min_read_recency_for_promote": 0, 2024-09-16T03:25:59.499 INFO:tasks.workunit.client.0.smithi096.stderr: "min_write_recency_for_promote": 0, 2024-09-16T03:25:59.499 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_grade_decay_rate": 0, 2024-09-16T03:25:59.499 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_search_last_n": 0, 2024-09-16T03:25:59.500 INFO:tasks.workunit.client.0.smithi096.stderr: "grade_table": [], 2024-09-16T03:25:59.500 INFO:tasks.workunit.client.0.smithi096.stderr: "stripe_width": 0, 2024-09-16T03:25:59.500 INFO:tasks.workunit.client.0.smithi096.stderr: "expected_num_objects": 0, 2024-09-16T03:25:59.500 INFO:tasks.workunit.client.0.smithi096.stderr: "fast_read": false, 2024-09-16T03:25:59.500 INFO:tasks.workunit.client.0.smithi096.stderr: "options": {}, 2024-09-16T03:25:59.500 INFO:tasks.workunit.client.0.smithi096.stderr: "application_metadata": {}, 2024-09-16T03:25:59.500 INFO:tasks.workunit.client.0.smithi096.stderr: "read_balance": { 2024-09-16T03:25:59.500 INFO:tasks.workunit.client.0.smithi096.stderr: "score_type": "Fair distribution", 2024-09-16T03:25:59.500 INFO:tasks.workunit.client.0.smithi096.stderr: "score_acting": 1.4900000095367432, 2024-09-16T03:25:59.500 INFO:tasks.workunit.client.0.smithi096.stderr: "score_stable": 1.4900000095367432, 2024-09-16T03:25:59.500 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_score": 0.67000001668930054, 2024-09-16T03:25:59.500 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_acting": 1, 2024-09-16T03:25:59.500 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_stable": 1, 2024-09-16T03:25:59.500 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity_weighted": 1, 2024-09-16T03:25:59.501 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity": 1, 2024-09-16T03:25:59.501 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity_weighted": 1 2024-09-16T03:25:59.501 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:59.501 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:59.501 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:59.501 INFO:tasks.workunit.client.0.smithi096.stderr: "osds": [ 2024-09-16T03:25:59.501 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:59.501 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:25:59.501 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6", 2024-09-16T03:25:59.501 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:25:59.501 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:25:59.501 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:25:59.501 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:25:59.502 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:25:59.502 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:25:59.502 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 5, 2024-09-16T03:25:59.502 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 81, 2024-09-16T03:25:59.502 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:25:59.502 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:25:59.502 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:25:59.502 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:59.502 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:59.502 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:59.502 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6802", 2024-09-16T03:25:59.502 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:59.502 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.503 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:59.503 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:59.503 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6803", 2024-09-16T03:25:59.503 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:59.503 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:59.503 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:59.503 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.503 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:25:59.503 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:59.503 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:59.503 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:59.503 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6804", 2024-09-16T03:25:59.503 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:59.503 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.504 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:59.504 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:59.504 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6805", 2024-09-16T03:25:59.504 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:59.504 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:59.504 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:59.504 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.504 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:25:59.504 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:59.504 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:59.504 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:59.504 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6808", 2024-09-16T03:25:59.505 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:59.505 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.505 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:59.505 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:59.505 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6809", 2024-09-16T03:25:59.505 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:59.505 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:59.505 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:59.505 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.505 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:25:59.505 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:59.505 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:59.505 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:59.505 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6806", 2024-09-16T03:25:59.506 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:59.506 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.506 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:59.506 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:59.506 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6807", 2024-09-16T03:25:59.506 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:25:59.506 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:59.506 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:59.506 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.506 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6803/3375787448", 2024-09-16T03:25:59.506 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6805/3375787448", 2024-09-16T03:25:59.506 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6809/3375787448", 2024-09-16T03:25:59.506 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6807/3375787448", 2024-09-16T03:25:59.506 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:25:59.506 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:25:59.507 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:25:59.507 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:59.507 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.507 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:59.507 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:25:59.507 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "74b26727-75c9-444d-8782-719e4197a382", 2024-09-16T03:25:59.507 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:25:59.507 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:25:59.507 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:25:59.507 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:25:59.507 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:25:59.507 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:25:59.507 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 10, 2024-09-16T03:25:59.507 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 81, 2024-09-16T03:25:59.508 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:25:59.508 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:25:59.508 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:25:59.508 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:59.508 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:59.508 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:59.508 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6810", 2024-09-16T03:25:59.508 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:59.508 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.508 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:59.508 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:59.508 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6811", 2024-09-16T03:25:59.508 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:59.509 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:59.509 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:59.509 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.509 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:25:59.509 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:59.509 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:59.509 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:59.509 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6812", 2024-09-16T03:25:59.509 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:59.509 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.509 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:59.509 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:59.509 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6813", 2024-09-16T03:25:59.510 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:59.510 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:59.510 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:59.510 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.510 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:25:59.510 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:59.510 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:59.510 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:59.510 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6816", 2024-09-16T03:25:59.510 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:59.510 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.510 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:59.510 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:59.510 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6817", 2024-09-16T03:25:59.510 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:59.511 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:59.511 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:59.511 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.511 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:25:59.511 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:59.511 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:59.511 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:59.511 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6814", 2024-09-16T03:25:59.511 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:59.511 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.511 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:59.511 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:59.511 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6815", 2024-09-16T03:25:59.511 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:25:59.512 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:59.512 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:59.512 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.512 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6811/3733255132", 2024-09-16T03:25:59.512 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6813/3733255132", 2024-09-16T03:25:59.512 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6817/3733255132", 2024-09-16T03:25:59.512 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6815/3733255132", 2024-09-16T03:25:59.512 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:25:59.512 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:25:59.512 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:25:59.512 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:59.512 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.512 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:59.513 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:25:59.513 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "143da3a7-dad9-4b1e-966b-76cf5bdd3c82", 2024-09-16T03:25:59.513 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 0, 2024-09-16T03:25:59.513 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 0, 2024-09-16T03:25:59.513 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 0, 2024-09-16T03:25:59.513 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:25:59.513 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:25:59.513 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:25:59.513 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 15, 2024-09-16T03:25:59.513 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 21, 2024-09-16T03:25:59.513 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 33, 2024-09-16T03:25:59.513 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:25:59.513 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:25:59.513 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:59.514 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:59.514 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:59.514 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6818", 2024-09-16T03:25:59.514 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:59.514 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.514 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:59.514 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:59.514 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6819", 2024-09-16T03:25:59.514 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:59.514 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:59.514 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:59.514 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.514 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:25:59.514 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:59.515 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:59.515 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:59.515 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6820", 2024-09-16T03:25:59.515 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:59.515 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.515 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:59.515 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:59.515 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6821", 2024-09-16T03:25:59.515 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:59.515 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:59.515 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:59.515 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.515 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:25:59.516 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:59.516 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:59.516 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:59.516 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6824", 2024-09-16T03:25:59.516 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:59.516 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.516 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:59.516 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:59.516 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6825", 2024-09-16T03:25:59.516 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:59.516 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:59.516 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:59.516 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.516 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:25:59.517 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:25:59.517 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:59.517 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:25:59.517 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6822", 2024-09-16T03:25:59.517 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:59.517 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.517 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:59.517 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:25:59.517 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6823", 2024-09-16T03:25:59.517 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:25:59.517 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:59.517 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:59.517 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.518 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6819/963814857", 2024-09-16T03:25:59.518 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6821/963814857", 2024-09-16T03:25:59.518 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6825/963814857", 2024-09-16T03:25:59.518 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6823/963814857", 2024-09-16T03:25:59.518 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:25:59.518 INFO:tasks.workunit.client.0.smithi096.stderr: "exists" 2024-09-16T03:25:59.518 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:59.518 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:59.518 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:59.518 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_xinfo": [ 2024-09-16T03:25:59.518 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:59.518 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:25:59.518 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:25:59.519 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:25:59.519 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:25:59.519 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:25:59.519 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:25:59.519 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:23:22.481942+0000", 2024-09-16T03:25:59.519 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:25:59.519 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.519 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:59.519 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:25:59.519 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:25:59.519 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:25:59.519 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:25:59.519 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:25:59.520 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:25:59.520 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:23:59.663703+0000", 2024-09-16T03:25:59.520 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:25:59.520 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.520 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:59.520 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:25:59.520 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:25:59.520 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:25:59.520 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:25:59.520 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:25:59.520 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 65536, 2024-09-16T03:25:59.520 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:24:37.320822+0000", 2024-09-16T03:25:59.520 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 32 2024-09-16T03:25:59.521 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:59.521 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:59.521 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap": [], 2024-09-16T03:25:59.521 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap_items": [], 2024-09-16T03:25:59.521 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap_primaries": [], 2024-09-16T03:25:59.521 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_temp": [], 2024-09-16T03:25:59.521 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_temp": [], 2024-09-16T03:25:59.521 INFO:tasks.workunit.client.0.smithi096.stderr: "blocklist": {}, 2024-09-16T03:25:59.521 INFO:tasks.workunit.client.0.smithi096.stderr: "range_blocklist": {}, 2024-09-16T03:25:59.521 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profiles": { 2024-09-16T03:25:59.521 INFO:tasks.workunit.client.0.smithi096.stderr: "default": { 2024-09-16T03:25:59.521 INFO:tasks.workunit.client.0.smithi096.stderr: "k": "2", 2024-09-16T03:25:59.521 INFO:tasks.workunit.client.0.smithi096.stderr: "m": "2", 2024-09-16T03:25:59.522 INFO:tasks.workunit.client.0.smithi096.stderr: "plugin": "jerasure", 2024-09-16T03:25:59.522 INFO:tasks.workunit.client.0.smithi096.stderr: "technique": "reed_sol_van" 2024-09-16T03:25:59.522 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:59.522 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.522 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps_queue": [], 2024-09-16T03:25:59.522 INFO:tasks.workunit.client.0.smithi096.stderr: "new_removed_snaps": [], 2024-09-16T03:25:59.522 INFO:tasks.workunit.client.0.smithi096.stderr: "new_purged_snaps": [], 2024-09-16T03:25:59.522 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_node_flags": {}, 2024-09-16T03:25:59.522 INFO:tasks.workunit.client.0.smithi096.stderr: "device_class_flags": {}, 2024-09-16T03:25:59.522 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode": { 2024-09-16T03:25:59.522 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode_enabled": false, 2024-09-16T03:25:59.522 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_bucket_count": 0, 2024-09-16T03:25:59.522 INFO:tasks.workunit.client.0.smithi096.stderr: "degraded_stretch_mode": 0, 2024-09-16T03:25:59.522 INFO:tasks.workunit.client.0.smithi096.stderr: "recovering_stretch_mode": 0, 2024-09-16T03:25:59.523 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode_bucket": 0 2024-09-16T03:25:59.523 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:59.523 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.523 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_metadata": [ 2024-09-16T03:25:59.523 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:59.523 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:25:59.523 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:25:59.523 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]", 2024-09-16T03:25:59.523 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:25:59.523 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:25:59.523 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:25:59.523 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:25:59.523 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:25:59.524 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:25:59.524 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:25:59.524 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:25:59.524 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:25:59.524 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:25:59.524 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:25:59.524 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/0/block", 2024-09-16T03:25:59.524 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:25:59.524 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:25:59.524 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:25:59.524 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:25:59.524 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:25:59.525 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:25:59.525 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:25:59.525 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:25:59.525 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:25:59.525 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:25:59.525 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:22:53.662571Z", 2024-09-16T03:25:59.525 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:25:59.525 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:25:59.525 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:25:59.525 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:25:59.525 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:25:59.525 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:25:59.525 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:25:59.525 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]", 2024-09-16T03:25:59.526 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:25:59.526 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]", 2024-09-16T03:25:59.526 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]", 2024-09-16T03:25:59.526 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:25:59.526 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:25:59.526 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:25:59.526 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:25:59.526 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:25:59.526 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:25:59.526 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:25:59.526 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:25:59.526 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:25:59.526 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/0", 2024-09-16T03:25:59.527 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:25:59.527 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:25:59.527 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:25:59.527 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.527 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:59.527 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:25:59.527 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:25:59.527 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]", 2024-09-16T03:25:59.527 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:25:59.527 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:25:59.527 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:25:59.527 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:25:59.527 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:25:59.528 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:25:59.528 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:25:59.528 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:25:59.528 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:25:59.528 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:25:59.528 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:25:59.528 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/1/block", 2024-09-16T03:25:59.528 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:25:59.528 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:25:59.528 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:25:59.528 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:25:59.528 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:25:59.528 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:25:59.528 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:25:59.529 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:25:59.529 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:25:59.529 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:25:59.529 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:23:30.129885Z", 2024-09-16T03:25:59.529 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:25:59.529 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:25:59.529 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:25:59.529 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:25:59.529 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:25:59.529 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:25:59.529 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:25:59.529 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]", 2024-09-16T03:25:59.529 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:25:59.530 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]", 2024-09-16T03:25:59.530 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]", 2024-09-16T03:25:59.530 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:25:59.530 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:25:59.530 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:25:59.530 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:25:59.530 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:25:59.530 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:25:59.530 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:25:59.530 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:25:59.530 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:25:59.530 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/1", 2024-09-16T03:25:59.530 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:25:59.530 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:25:59.531 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:25:59.531 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.531 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:59.531 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:25:59.531 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:25:59.531 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]", 2024-09-16T03:25:59.531 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:25:59.531 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:25:59.531 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:25:59.531 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:25:59.531 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:25:59.531 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:25:59.531 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:25:59.531 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:25:59.532 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:25:59.532 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:25:59.532 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:25:59.532 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/2/block", 2024-09-16T03:25:59.532 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:25:59.532 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:25:59.532 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:25:59.532 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:25:59.532 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:25:59.532 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:25:59.532 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:25:59.532 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:25:59.532 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:25:59.532 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:25:59.533 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:24:07.764502Z", 2024-09-16T03:25:59.533 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:25:59.533 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:25:59.533 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:25:59.533 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:25:59.533 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:25:59.533 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:25:59.533 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:25:59.533 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]", 2024-09-16T03:25:59.533 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:25:59.533 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]", 2024-09-16T03:25:59.533 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]", 2024-09-16T03:25:59.533 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:25:59.533 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:25:59.534 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:25:59.534 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:25:59.534 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:25:59.534 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:25:59.534 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:25:59.534 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:25:59.534 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:25:59.534 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/2", 2024-09-16T03:25:59.534 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:25:59.534 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:25:59.534 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:25:59.534 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:59.534 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:59.534 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_clean_epochs": { 2024-09-16T03:25:59.535 INFO:tasks.workunit.client.0.smithi096.stderr: "min_last_epoch_clean": 28, 2024-09-16T03:25:59.535 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": { 2024-09-16T03:25:59.535 INFO:tasks.workunit.client.0.smithi096.stderr: "per_pool": [ 2024-09-16T03:25:59.535 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:59.535 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 1, 2024-09-16T03:25:59.535 INFO:tasks.workunit.client.0.smithi096.stderr: "floor": 28 2024-09-16T03:25:59.535 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.535 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:59.535 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 2, 2024-09-16T03:25:59.535 INFO:tasks.workunit.client.0.smithi096.stderr: "floor": 28 2024-09-16T03:25:59.535 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:59.535 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:59.535 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.535 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_epochs": [ 2024-09-16T03:25:59.536 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:59.536 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:25:59.536 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 78 2024-09-16T03:25:59.536 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.536 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:59.536 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:25:59.536 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 80 2024-09-16T03:25:59.536 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:59.536 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:59.536 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.536 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_first_committed": 28, 2024-09-16T03:25:59.536 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_last_committed": 83, 2024-09-16T03:25:59.536 INFO:tasks.workunit.client.0.smithi096.stderr: "crushmap": { 2024-09-16T03:25:59.537 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": [ 2024-09-16T03:25:59.537 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:59.537 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:25:59.537 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.0", 2024-09-16T03:25:59.537 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:25:59.537 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.537 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:59.537 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:25:59.537 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.1", 2024-09-16T03:25:59.537 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:25:59.537 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.537 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:59.537 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:25:59.538 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.2", 2024-09-16T03:25:59.538 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:25:59.538 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:59.538 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:59.538 INFO:tasks.workunit.client.0.smithi096.stderr: "types": [ 2024-09-16T03:25:59.538 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:59.538 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 0, 2024-09-16T03:25:59.538 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd" 2024-09-16T03:25:59.538 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.538 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:59.538 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:25:59.538 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "host" 2024-09-16T03:25:59.538 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.538 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:59.539 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 2, 2024-09-16T03:25:59.539 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "chassis" 2024-09-16T03:25:59.539 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.539 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:59.539 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 3, 2024-09-16T03:25:59.539 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "rack" 2024-09-16T03:25:59.539 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.539 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:59.539 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 4, 2024-09-16T03:25:59.539 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "row" 2024-09-16T03:25:59.539 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.539 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:59.539 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 5, 2024-09-16T03:25:59.539 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "pdu" 2024-09-16T03:25:59.540 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.540 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:59.540 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 6, 2024-09-16T03:25:59.540 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "pod" 2024-09-16T03:25:59.540 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.540 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:59.540 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 7, 2024-09-16T03:25:59.540 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "room" 2024-09-16T03:25:59.540 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.540 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:59.540 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 8, 2024-09-16T03:25:59.540 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "datacenter" 2024-09-16T03:25:59.540 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.540 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:59.541 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 9, 2024-09-16T03:25:59.541 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "zone" 2024-09-16T03:25:59.541 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.541 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:59.541 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 10, 2024-09-16T03:25:59.541 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "region" 2024-09-16T03:25:59.541 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.541 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:59.541 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:25:59.541 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "root" 2024-09-16T03:25:59.541 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:59.541 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:59.541 INFO:tasks.workunit.client.0.smithi096.stderr: "buckets": [ 2024-09-16T03:25:59.542 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:59.542 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -1, 2024-09-16T03:25:59.542 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "default", 2024-09-16T03:25:59.542 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:25:59.542 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "root", 2024-09-16T03:25:59.542 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:25:59.542 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:25:59.542 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:25:59.542 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:25:59.542 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:59.542 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -3, 2024-09-16T03:25:59.542 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:25:59.542 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:25:59.543 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:59.543 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:59.543 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.543 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:59.543 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -2, 2024-09-16T03:25:59.543 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "default~hdd", 2024-09-16T03:25:59.543 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:25:59.543 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "root", 2024-09-16T03:25:59.543 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:25:59.543 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:25:59.543 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:25:59.543 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:25:59.543 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:59.544 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -4, 2024-09-16T03:25:59.544 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:25:59.544 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:25:59.544 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:59.544 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:59.544 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.544 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:59.544 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -3, 2024-09-16T03:25:59.544 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "smithi096", 2024-09-16T03:25:59.544 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:25:59.544 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "host", 2024-09-16T03:25:59.544 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:25:59.544 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:25:59.544 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:25:59.545 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:25:59.545 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:59.545 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:25:59.545 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:25:59.545 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:25:59.545 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.545 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:59.545 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:25:59.545 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:25:59.545 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 1 2024-09-16T03:25:59.545 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.545 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:59.545 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:25:59.545 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:25:59.545 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 2 2024-09-16T03:25:59.546 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:59.546 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:59.546 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.546 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:59.546 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -4, 2024-09-16T03:25:59.546 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "smithi096~hdd", 2024-09-16T03:25:59.546 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:25:59.546 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "host", 2024-09-16T03:25:59.546 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:25:59.546 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:25:59.546 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:25:59.546 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:25:59.546 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:59.546 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:25:59.546 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:25:59.547 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:25:59.547 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.547 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:59.547 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:25:59.547 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:25:59.547 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 1 2024-09-16T03:25:59.547 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.547 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:59.547 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:25:59.547 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:25:59.547 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 2 2024-09-16T03:25:59.547 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:59.547 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:59.547 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:59.547 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:59.548 INFO:tasks.workunit.client.0.smithi096.stderr: "rules": [ 2024-09-16T03:25:59.548 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:59.548 INFO:tasks.workunit.client.0.smithi096.stderr: "rule_id": 0, 2024-09-16T03:25:59.548 INFO:tasks.workunit.client.0.smithi096.stderr: "rule_name": "replicated_rule", 2024-09-16T03:25:59.548 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:25:59.548 INFO:tasks.workunit.client.0.smithi096.stderr: "steps": [ 2024-09-16T03:25:59.548 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:59.548 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "take", 2024-09-16T03:25:59.548 INFO:tasks.workunit.client.0.smithi096.stderr: "item": -1, 2024-09-16T03:25:59.548 INFO:tasks.workunit.client.0.smithi096.stderr: "item_name": "default" 2024-09-16T03:25:59.548 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.548 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:59.548 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "choose_firstn", 2024-09-16T03:25:59.549 INFO:tasks.workunit.client.0.smithi096.stderr: "num": 0, 2024-09-16T03:25:59.549 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "osd" 2024-09-16T03:25:59.549 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.549 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:59.549 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "emit" 2024-09-16T03:25:59.549 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:59.549 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:25:59.549 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:59.549 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:59.549 INFO:tasks.workunit.client.0.smithi096.stderr: "tunables": { 2024-09-16T03:25:59.549 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_local_tries": 0, 2024-09-16T03:25:59.549 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_local_fallback_tries": 0, 2024-09-16T03:25:59.549 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_total_tries": 50, 2024-09-16T03:25:59.549 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_descend_once": 1, 2024-09-16T03:25:59.550 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_vary_r": 1, 2024-09-16T03:25:59.550 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_stable": 1, 2024-09-16T03:25:59.550 INFO:tasks.workunit.client.0.smithi096.stderr: "msr_descents": 100, 2024-09-16T03:25:59.550 INFO:tasks.workunit.client.0.smithi096.stderr: "msr_collision_tries": 100, 2024-09-16T03:25:59.550 INFO:tasks.workunit.client.0.smithi096.stderr: "straw_calc_version": 1, 2024-09-16T03:25:59.550 INFO:tasks.workunit.client.0.smithi096.stderr: "allowed_bucket_algs": 54, 2024-09-16T03:25:59.550 INFO:tasks.workunit.client.0.smithi096.stderr: "profile": "jewel", 2024-09-16T03:25:59.550 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_tunables": 1, 2024-09-16T03:25:59.550 INFO:tasks.workunit.client.0.smithi096.stderr: "legacy_tunables": 0, 2024-09-16T03:25:59.550 INFO:tasks.workunit.client.0.smithi096.stderr: "minimum_required_version": "jewel", 2024-09-16T03:25:59.550 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables": 1, 2024-09-16T03:25:59.550 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables2": 1, 2024-09-16T03:25:59.550 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v2_rules": 0, 2024-09-16T03:25:59.550 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables3": 1, 2024-09-16T03:25:59.550 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v3_rules": 0, 2024-09-16T03:25:59.551 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v4_buckets": 1, 2024-09-16T03:25:59.551 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables5": 1, 2024-09-16T03:25:59.551 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v5_rules": 0, 2024-09-16T03:25:59.551 INFO:tasks.workunit.client.0.smithi096.stderr: "has_msr_rules": 0 2024-09-16T03:25:59.551 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.551 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_args": {} 2024-09-16T03:25:59.551 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.551 INFO:tasks.workunit.client.0.smithi096.stderr: "fsmap": { 2024-09-16T03:25:59.551 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 1, 2024-09-16T03:25:59.551 INFO:tasks.workunit.client.0.smithi096.stderr: "btime": "2024-09-16T03:22:46:882186+0000", 2024-09-16T03:25:59.551 INFO:tasks.workunit.client.0.smithi096.stderr: "default_fscid": -1, 2024-09-16T03:25:59.551 INFO:tasks.workunit.client.0.smithi096.stderr: "compat": { 2024-09-16T03:25:59.551 INFO:tasks.workunit.client.0.smithi096.stderr: "compat": {}, 2024-09-16T03:25:59.551 INFO:tasks.workunit.client.0.smithi096.stderr: "ro_compat": {}, 2024-09-16T03:25:59.551 INFO:tasks.workunit.client.0.smithi096.stderr: "incompat": { 2024-09-16T03:25:59.552 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_1": "base v0.20", 2024-09-16T03:25:59.552 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_2": "client writeable ranges", 2024-09-16T03:25:59.552 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_3": "default file layouts on dirs", 2024-09-16T03:25:59.552 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_4": "dir inode in separate object", 2024-09-16T03:25:59.552 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_5": "mds uses versioned encoding", 2024-09-16T03:25:59.552 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_6": "dirfrag is stored in omap", 2024-09-16T03:25:59.552 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_8": "no anchor table", 2024-09-16T03:25:59.552 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_9": "file layout v2", 2024-09-16T03:25:59.552 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_10": "snaprealm v2", 2024-09-16T03:25:59.552 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_11": "minor log segments", 2024-09-16T03:25:59.552 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_12": "quiesce subvolumes" 2024-09-16T03:25:59.552 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:59.552 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.553 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_flags": { 2024-09-16T03:25:59.553 INFO:tasks.workunit.client.0.smithi096.stderr: "enable_multiple": true, 2024-09-16T03:25:59.553 INFO:tasks.workunit.client.0.smithi096.stderr: "ever_enabled_multiple": true 2024-09-16T03:25:59.553 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.553 INFO:tasks.workunit.client.0.smithi096.stderr: "standbys": [], 2024-09-16T03:25:59.553 INFO:tasks.workunit.client.0.smithi096.stderr: "filesystems": [] 2024-09-16T03:25:59.553 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.553 INFO:tasks.workunit.client.0.smithi096.stderr: "mdsmap_first_committed": 1, 2024-09-16T03:25:59.553 INFO:tasks.workunit.client.0.smithi096.stderr: "mdsmap_last_committed": 1, 2024-09-16T03:25:59.553 INFO:tasks.workunit.client.0.smithi096.stderr: "auth": { 2024-09-16T03:25:59.553 INFO:tasks.workunit.client.0.smithi096.stderr: "first_committed": 1, 2024-09-16T03:25:59.553 INFO:tasks.workunit.client.0.smithi096.stderr: "last_committed": 5, 2024-09-16T03:25:59.553 INFO:tasks.workunit.client.0.smithi096.stderr: "num_secrets": 3 2024-09-16T03:25:59.554 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.554 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 64, 2024-09-16T03:25:59.554 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_active": 64, 2024-09-16T03:25:59.554 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_unknown": 0, 2024-09-16T03:25:59.554 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osd": 3, 2024-09-16T03:25:59.554 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_sum": { 2024-09-16T03:25:59.554 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:25:59.554 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:25:59.554 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:25:59.554 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:25:59.554 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:25:59.554 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:25:59.555 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:25:59.555 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:25:59.555 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:25:59.555 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:25:59.555 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:25:59.555 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:25:59.555 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:25:59.555 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:25:59.555 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:25:59.555 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:25:59.555 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:25:59.555 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:25:59.555 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:25:59.556 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:25:59.556 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:25:59.556 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:25:59.556 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:25:59.556 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:25:59.556 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:25:59.556 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:25:59.556 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:25:59.556 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:25:59.556 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:25:59.556 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:25:59.556 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:25:59.556 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:25:59.556 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:25:59.557 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:25:59.557 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:25:59.557 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:25:59.557 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:25:59.557 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:25:59.557 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:25:59.557 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:25:59.557 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:25:59.557 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.557 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:25:59.557 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:25:59.557 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:25:59.557 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:25:59.557 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:25:59.558 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:25:59.558 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:25:59.558 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:25:59.558 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:25:59.558 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:25:59.558 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:25:59.558 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.558 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:25:59.558 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:25:59.558 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 128, 2024-09-16T03:25:59.558 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 128, 2024-09-16T03:25:59.558 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 0 2024-09-16T03:25:59.558 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.559 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_sum": { 2024-09-16T03:25:59.559 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 0, 2024-09-16T03:25:59.559 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 0, 2024-09-16T03:25:59.559 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pgs": 128, 2024-09-16T03:25:59.559 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osds": 2, 2024-09-16T03:25:59.559 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_osds": 2, 2024-09-16T03:25:59.559 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_omap_osds": 2, 2024-09-16T03:25:59.559 INFO:tasks.workunit.client.0.smithi096.stderr: "kb": 209715200, 2024-09-16T03:25:59.559 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used": 54568, 2024-09-16T03:25:59.559 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_data": 856, 2024-09-16T03:25:59.559 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_omap": 3, 2024-09-16T03:25:59.559 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_meta": 53628, 2024-09-16T03:25:59.559 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_avail": 209660632, 2024-09-16T03:25:59.559 INFO:tasks.workunit.client.0.smithi096.stderr: "statfs": { 2024-09-16T03:25:59.560 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 214748364800, 2024-09-16T03:25:59.560 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 214692487168, 2024-09-16T03:25:59.560 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:25:59.560 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 876544, 2024-09-16T03:25:59.560 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 327566, 2024-09-16T03:25:59.560 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:25:59.560 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:25:59.560 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:25:59.560 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 3190, 2024-09-16T03:25:59.560 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 54915978 2024-09-16T03:25:59.560 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.560 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_peers": [], 2024-09-16T03:25:59.560 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_trim_queue_len": 0, 2024-09-16T03:25:59.561 INFO:tasks.workunit.client.0.smithi096.stderr: "num_snap_trimming": 0, 2024-09-16T03:25:59.561 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shards_repaired": 0, 2024-09-16T03:25:59.561 INFO:tasks.workunit.client.0.smithi096.stderr: "op_queue_age_hist": { 2024-09-16T03:25:59.561 INFO:tasks.workunit.client.0.smithi096.stderr: "histogram": [], 2024-09-16T03:25:59.561 INFO:tasks.workunit.client.0.smithi096.stderr: "upper_bound": 1 2024-09-16T03:25:59.561 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.561 INFO:tasks.workunit.client.0.smithi096.stderr: "perf_stat": { 2024-09-16T03:25:59.561 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ms": 219, 2024-09-16T03:25:59.561 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ms": 219, 2024-09-16T03:25:59.561 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ns": 219000000, 2024-09-16T03:25:59.561 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ns": 219000000 2024-09-16T03:25:59.561 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.561 INFO:tasks.workunit.client.0.smithi096.stderr: "alerts": [], 2024-09-16T03:25:59.561 INFO:tasks.workunit.client.0.smithi096.stderr: "network_ping_times": [] 2024-09-16T03:25:59.562 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.562 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_sum_by_class": { 2024-09-16T03:25:59.562 INFO:tasks.workunit.client.0.smithi096.stderr: "hdd": { 2024-09-16T03:25:59.562 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 0, 2024-09-16T03:25:59.562 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 0, 2024-09-16T03:25:59.562 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pgs": 128, 2024-09-16T03:25:59.562 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osds": 2, 2024-09-16T03:25:59.562 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_osds": 2, 2024-09-16T03:25:59.562 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_omap_osds": 2, 2024-09-16T03:25:59.562 INFO:tasks.workunit.client.0.smithi096.stderr: "kb": 209715200, 2024-09-16T03:25:59.562 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used": 54568, 2024-09-16T03:25:59.562 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_data": 856, 2024-09-16T03:25:59.562 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_omap": 3, 2024-09-16T03:25:59.562 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_meta": 53628, 2024-09-16T03:25:59.563 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_avail": 209660632, 2024-09-16T03:25:59.563 INFO:tasks.workunit.client.0.smithi096.stderr: "statfs": { 2024-09-16T03:25:59.563 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 214748364800, 2024-09-16T03:25:59.563 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 214692487168, 2024-09-16T03:25:59.563 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:25:59.563 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 876544, 2024-09-16T03:25:59.563 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 327566, 2024-09-16T03:25:59.563 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:25:59.563 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:25:59.563 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:25:59.563 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 3190, 2024-09-16T03:25:59.563 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 54915978 2024-09-16T03:25:59.563 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.563 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_peers": [], 2024-09-16T03:25:59.564 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_trim_queue_len": 0, 2024-09-16T03:25:59.564 INFO:tasks.workunit.client.0.smithi096.stderr: "num_snap_trimming": 0, 2024-09-16T03:25:59.564 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shards_repaired": 0, 2024-09-16T03:25:59.564 INFO:tasks.workunit.client.0.smithi096.stderr: "op_queue_age_hist": { 2024-09-16T03:25:59.564 INFO:tasks.workunit.client.0.smithi096.stderr: "histogram": [], 2024-09-16T03:25:59.564 INFO:tasks.workunit.client.0.smithi096.stderr: "upper_bound": 1 2024-09-16T03:25:59.564 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.564 INFO:tasks.workunit.client.0.smithi096.stderr: "perf_stat": { 2024-09-16T03:25:59.564 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ms": 219, 2024-09-16T03:25:59.564 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ms": 219, 2024-09-16T03:25:59.564 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ns": 219000000, 2024-09-16T03:25:59.564 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ns": 219000000 2024-09-16T03:25:59.564 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.564 INFO:tasks.workunit.client.0.smithi096.stderr: "alerts": [], 2024-09-16T03:25:59.565 INFO:tasks.workunit.client.0.smithi096.stderr: "network_ping_times": [] 2024-09-16T03:25:59.565 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:59.565 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.565 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_stats": [ 2024-09-16T03:25:59.565 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:59.565 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 2, 2024-09-16T03:25:59.565 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 32, 2024-09-16T03:25:59.565 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:25:59.565 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:25:59.565 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:25:59.565 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:25:59.565 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:25:59.565 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:25:59.565 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:25:59.566 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:25:59.566 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:25:59.566 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:25:59.566 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:25:59.566 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:25:59.566 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:25:59.566 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:25:59.566 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:25:59.566 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:25:59.566 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:25:59.566 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:25:59.566 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:25:59.566 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:25:59.566 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:25:59.567 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:25:59.567 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:25:59.567 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:25:59.567 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:25:59.567 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:25:59.567 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:25:59.567 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:25:59.567 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:25:59.567 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:25:59.567 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:25:59.567 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:25:59.567 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:25:59.567 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:25:59.568 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:25:59.568 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:25:59.568 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:25:59.568 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:25:59.568 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:25:59.568 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:25:59.568 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:25:59.568 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.568 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:25:59.568 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:25:59.568 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:25:59.568 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:25:59.568 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:25:59.568 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:25:59.569 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:25:59.569 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:25:59.569 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:25:59.569 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:25:59.569 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:25:59.569 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.569 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:25:59.569 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:25:59.569 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 64, 2024-09-16T03:25:59.569 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 64, 2024-09-16T03:25:59.569 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 3 2024-09-16T03:25:59.569 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.570 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:59.570 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 1, 2024-09-16T03:25:59.570 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 32, 2024-09-16T03:25:59.570 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:25:59.570 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:25:59.570 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:25:59.570 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:25:59.570 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:25:59.570 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:25:59.570 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:25:59.570 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:25:59.570 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:25:59.570 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:25:59.570 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:25:59.570 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:25:59.571 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:25:59.571 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:25:59.571 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:25:59.571 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:25:59.571 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:25:59.571 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:25:59.571 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:25:59.571 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:25:59.571 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:25:59.571 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:25:59.571 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:25:59.571 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:25:59.572 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:25:59.572 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:25:59.572 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:25:59.572 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:25:59.572 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:25:59.572 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:25:59.572 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:25:59.572 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:25:59.572 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:25:59.572 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:25:59.572 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:25:59.572 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:25:59.572 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:25:59.573 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:25:59.573 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:25:59.573 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:25:59.573 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:25:59.573 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.573 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:25:59.573 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:25:59.573 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:25:59.573 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:25:59.573 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:25:59.573 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:25:59.573 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:25:59.574 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:25:59.574 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:25:59.574 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:25:59.574 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:25:59.574 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.574 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:25:59.574 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:25:59.574 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 64, 2024-09-16T03:25:59.574 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 64, 2024-09-16T03:25:59.574 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 3 2024-09-16T03:25:59.574 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:59.574 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:59.574 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_stats": [ 2024-09-16T03:25:59.574 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:59.575 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:25:59.575 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 21474836517 2024-09-16T03:25:59.575 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.575 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:59.575 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:25:59.575 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 42949672989 2024-09-16T03:25:59.575 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.575 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:59.575 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:25:59.575 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 0 2024-09-16T03:25:59.575 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:59.575 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:59.575 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_by_state": [ 2024-09-16T03:25:59.575 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:59.575 INFO:tasks.workunit.client.0.smithi096.stderr: "state": "active+undersized", 2024-09-16T03:25:59.576 INFO:tasks.workunit.client.0.smithi096.stderr: "num": 64 2024-09-16T03:25:59.576 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:59.576 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:59.576 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_by_osd": [ 2024-09-16T03:25:59.576 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:59.576 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:25:59.576 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 0, 2024-09-16T03:25:59.576 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 0, 2024-09-16T03:25:59.576 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:25:59.576 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.576 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:59.576 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:25:59.576 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 28, 2024-09-16T03:25:59.577 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 64, 2024-09-16T03:25:59.577 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:25:59.577 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.577 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:59.577 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:25:59.577 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 36, 2024-09-16T03:25:59.577 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 64, 2024-09-16T03:25:59.577 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:25:59.577 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:59.577 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:59.577 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": [ 2024-09-16T03:25:59.577 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:59.578 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 1, 2024-09-16T03:25:59.578 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": {} 2024-09-16T03:25:59.578 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.578 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:25:59.578 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 2, 2024-09-16T03:25:59.578 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": {} 2024-09-16T03:25:59.578 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:59.578 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:25:59.578 INFO:tasks.workunit.client.0.smithi096.stderr: "servicemap": { 2024-09-16T03:25:59.578 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 5, 2024-09-16T03:25:59.578 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:25:38.422788+0000", 2024-09-16T03:25:59.578 INFO:tasks.workunit.client.0.smithi096.stderr: "services": {} 2024-09-16T03:25:59.578 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:25:59.578 INFO:tasks.workunit.client.0.smithi096.stderr: "mgrstat_first_committed": 79, 2024-09-16T03:25:59.579 INFO:tasks.workunit.client.0.smithi096.stderr: "mgrstat_last_committed": 85, 2024-09-16T03:25:59.579 INFO:tasks.workunit.client.0.smithi096.stderr: "logm_first_committed": 1, 2024-09-16T03:25:59.579 INFO:tasks.workunit.client.0.smithi096.stderr: "logm_last_committed": 375, 2024-09-16T03:25:59.579 INFO:tasks.workunit.client.0.smithi096.stderr: "paxos": { 2024-09-16T03:25:59.579 INFO:tasks.workunit.client.0.smithi096.stderr: "first_committed": 1, 2024-09-16T03:25:59.579 INFO:tasks.workunit.client.0.smithi096.stderr: "last_committed": 560, 2024-09-16T03:25:59.579 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pn": 0, 2024-09-16T03:25:59.579 INFO:tasks.workunit.client.0.smithi096.stderr: "accepted_pn": 0 2024-09-16T03:25:59.579 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:25:59.579 INFO:tasks.workunit.client.0.smithi096.stderr:}' 2024-09-16T03:25:59.583 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:30: check_lec_equals_pools: jq .osdmap_clean_epochs.min_last_epoch_clean 2024-09-16T03:25:59.583 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:30: check_lec_equals_pools: echo '{' '"cluster_fingerprint":' '"fda2fc64-07ed-4add-8224-2e527e11d427",' '"version":' '"19.3.0-4930-gfc3e0bff",' '"commit":' '"fc3e0bff7468fd55478adbae7f75508b749124b6",' '"timestamp":' '"2024-09-16T03:25:59.465184+0000",' '"tag":' '"",' '"health":' '{' '"status":' '"HEALTH_OK",' '"checks":' '{},' '"mutes":' '[]' '},' '"monmap_first_committed":' 1, '"monmap_last_committed":' 1, '"monmap":' '{' '"epoch":' 1, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"modified":' '"2024-09-16T03:22:45.872880Z",' '"created":' '"2024-09-16T03:22:45.872880Z",' '"min_mon_release":' 19, '"min_mon_release_name":' '"squid",' '"election_strategy":' 1, '"disallowed_leaders:' '":' '"",' '"stretch_mode":' false, '"tiebreaker_mon":' '"",' '"removed_ranks:' '":' '"",' '"features":' '{' '"persistent":' '[' '"kraken",' '"luminous",' '"mimic",' '"osdmap-prune",' '"nautilus",' '"octopus",' '"pacific",' '"elector-pinging",' '"quincy",' '"reef",' '"squid"' '],' '"optional":' '[]' '},' '"mons":' '[' '{' '"rank":' 0, '"name":' '"a",' '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:7302",' '"nonce":' 0 '}' ']' '},' '"addr":' '"127.0.0.1:7302/0",' '"public_addr":' '"127.0.0.1:7302/0",' '"priority":' 0, '"weight":' 0, '"crush_location":' '"{}"' '}' ']' '},' '"quorum":' '[' 0 '],' '"osdmap":' '{' '"epoch":' 83, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"created":' '"2024-09-16T03:22:46.906117+0000",' '"modified":' '"2024-09-16T03:25:57.328949+0000",' '"last_up_change":' '"2024-09-16T03:25:08.513363+0000",' '"last_in_change":' '"2024-09-16T03:25:09.839444+0000",' '"flags":' '"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit",' '"flags_num":' 5799936, '"flags_set":' '[' '"pglog_hardlimit",' '"purged_snapdirs",' '"recovery_deletes",' '"sortbitwise"' '],' '"crush_version":' 7, '"full_ratio":' 0.97000002861022949, '"backfillfull_ratio":' 0.97000002861022949, '"nearfull_ratio":' 0.85000002384185791, '"cluster_snapshot":' '"",' '"pool_max":' 2, '"max_osd":' 3, '"require_min_compat_client":' '"luminous",' '"min_compat_client":' '"jewel",' '"require_osd_release":' '"squid",' '"allow_crimson":' false, '"pools":' '[' '{' '"pool":' 1, '"pool_name":' '"foo",' '"create_time":' '"2024-09-16T03:24:44.525189+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"30",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.8700000047683716, '"score_stable":' 1.8700000047683716, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1.25, '"raw_score_stable":' 1.25, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '},' '{' '"pool":' 2, '"pool_name":' '"bar",' '"create_time":' '"2024-09-16T03:24:46.226575+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 2, '"min_size":' 1, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"83",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.4900000095367432, '"score_stable":' 1.4900000095367432, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1, '"raw_score_stable":' 1, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '}' '],' '"osds":' '[' '{' '"osd":' 0, '"uuid":' '"64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 5, '"up_thru":' 81, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6802",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6803",' '"nonce":' 3375787448 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6804",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6805",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6808",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6809",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6806",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6807",' '"nonce":' 3375787448 '}' ']' '},' '"public_addr":' '"127.0.0.1:6803/3375787448",' '"cluster_addr":' '"127.0.0.1:6805/3375787448",' '"heartbeat_back_addr":' '"127.0.0.1:6809/3375787448",' '"heartbeat_front_addr":' '"127.0.0.1:6807/3375787448",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 1, '"uuid":' '"74b26727-75c9-444d-8782-719e4197a382",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 10, '"up_thru":' 81, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6810",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6811",' '"nonce":' 3733255132 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6812",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6813",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6816",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6817",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6814",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6815",' '"nonce":' 3733255132 '}' ']' '},' '"public_addr":' '"127.0.0.1:6811/3733255132",' '"cluster_addr":' '"127.0.0.1:6813/3733255132",' '"heartbeat_back_addr":' '"127.0.0.1:6817/3733255132",' '"heartbeat_front_addr":' '"127.0.0.1:6815/3733255132",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 2, '"uuid":' '"143da3a7-dad9-4b1e-966b-76cf5bdd3c82",' '"up":' 0, '"in":' 0, '"weight":' 0, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 15, '"up_thru":' 21, '"down_at":' 33, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6818",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6819",' '"nonce":' 963814857 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6820",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6821",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6824",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6825",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6822",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6823",' '"nonce":' 963814857 '}' ']' '},' '"public_addr":' '"127.0.0.1:6819/963814857",' '"cluster_addr":' '"127.0.0.1:6821/963814857",' '"heartbeat_back_addr":' '"127.0.0.1:6825/963814857",' '"heartbeat_front_addr":' '"127.0.0.1:6823/963814857",' '"state":' '[' '"exists"' ']' '}' '],' '"osd_xinfo":' '[' '{' '"osd":' 0, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:22.481942+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 1, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:59.663703+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 2, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 65536, '"last_purged_snaps_scrub":' '"2024-09-16T03:24:37.320822+0000",' '"dead_epoch":' 32 '}' '],' '"pg_upmap":' '[],' '"pg_upmap_items":' '[],' '"pg_upmap_primaries":' '[],' '"pg_temp":' '[],' '"primary_temp":' '[],' '"blocklist":' '{},' '"range_blocklist":' '{},' '"erasure_code_profiles":' '{' '"default":' '{' '"k":' '"2",' '"m":' '"2",' '"plugin":' '"jerasure",' '"technique":' '"reed_sol_van"' '}' '},' '"removed_snaps_queue":' '[],' '"new_removed_snaps":' '[],' '"new_purged_snaps":' '[],' '"crush_node_flags":' '{},' '"device_class_flags":' '{},' '"stretch_mode":' '{' '"stretch_mode_enabled":' false, '"stretch_bucket_count":' 0, '"degraded_stretch_mode":' 0, '"recovering_stretch_mode":' 0, '"stretch_mode_bucket":' 0 '}' '},' '"osd_metadata":' '[' '{' '"id":' 0, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/0/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:22:53.662571Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]",' '"hb_front_addr":' '"[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/0",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 1, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/1/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:23:30.129885Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]",' '"hb_front_addr":' '"[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/1",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 2, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/2/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:24:07.764502Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]",' '"hb_front_addr":' '"[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/2",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '}' '],' '"osdmap_clean_epochs":' '{' '"min_last_epoch_clean":' 28, '"last_epoch_clean":' '{' '"per_pool":' '[' '{' '"poolid":' 1, '"floor":' 28 '},' '{' '"poolid":' 2, '"floor":' 28 '}' ']' '},' '"osd_epochs":' '[' '{' '"id":' 0, '"epoch":' 78 '},' '{' '"id":' 1, '"epoch":' 80 '}' ']' '},' '"osdmap_first_committed":' 28, '"osdmap_last_committed":' 83, '"crushmap":' '{' '"devices":' '[' '{' '"id":' 0, '"name":' '"osd.0",' '"class":' '"hdd"' '},' '{' '"id":' 1, '"name":' '"osd.1",' '"class":' '"hdd"' '},' '{' '"id":' 2, '"name":' '"osd.2",' '"class":' '"hdd"' '}' '],' '"types":' '[' '{' '"type_id":' 0, '"name":' '"osd"' '},' '{' '"type_id":' 1, '"name":' '"host"' '},' '{' '"type_id":' 2, '"name":' '"chassis"' '},' '{' '"type_id":' 3, '"name":' '"rack"' '},' '{' '"type_id":' 4, '"name":' '"row"' '},' '{' '"type_id":' 5, '"name":' '"pdu"' '},' '{' '"type_id":' 6, '"name":' '"pod"' '},' '{' '"type_id":' 7, '"name":' '"room"' '},' '{' '"type_id":' 8, '"name":' '"datacenter"' '},' '{' '"type_id":' 9, '"name":' '"zone"' '},' '{' '"type_id":' 10, '"name":' '"region"' '},' '{' '"type_id":' 11, '"name":' '"root"' '}' '],' '"buckets":' '[' '{' '"id":' -1, '"name":' '"default",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -3, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -2, '"name":' '"default~hdd",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -4, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -3, '"name":' '"smithi096",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '},' '{' '"id":' -4, '"name":' '"smithi096~hdd",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '}' '],' '"rules":' '[' '{' '"rule_id":' 0, '"rule_name":' '"replicated_rule",' '"type":' 1, '"steps":' '[' '{' '"op":' '"take",' '"item":' -1, '"item_name":' '"default"' '},' '{' '"op":' '"choose_firstn",' '"num":' 0, '"type":' '"osd"' '},' '{' '"op":' '"emit"' '}' ']' '}' '],' '"tunables":' '{' '"choose_local_tries":' 0, '"choose_local_fallback_tries":' 0, '"choose_total_tries":' 50, '"chooseleaf_descend_once":' 1, '"chooseleaf_vary_r":' 1, '"chooseleaf_stable":' 1, '"msr_descents":' 100, '"msr_collision_tries":' 100, '"straw_calc_version":' 1, '"allowed_bucket_algs":' 54, '"profile":' '"jewel",' '"optimal_tunables":' 1, '"legacy_tunables":' 0, '"minimum_required_version":' '"jewel",' '"require_feature_tunables":' 1, '"require_feature_tunables2":' 1, '"has_v2_rules":' 0, '"require_feature_tunables3":' 1, '"has_v3_rules":' 0, '"has_v4_buckets":' 1, '"require_feature_tunables5":' 1, '"has_v5_rules":' 0, '"has_msr_rules":' 0 '},' '"choose_args":' '{}' '},' '"fsmap":' '{' '"epoch":' 1, '"btime":' '"2024-09-16T03:22:46:882186+0000",' '"default_fscid":' -1, '"compat":' '{' '"compat":' '{},' '"ro_compat":' '{},' '"incompat":' '{' '"feature_1":' '"base' 'v0.20",' '"feature_2":' '"client' writeable 'ranges",' '"feature_3":' '"default' file layouts on 'dirs",' '"feature_4":' '"dir' inode in separate 'object",' '"feature_5":' '"mds' uses versioned 'encoding",' '"feature_6":' '"dirfrag' is stored in 'omap",' '"feature_8":' '"no' anchor 'table",' '"feature_9":' '"file' layout 'v2",' '"feature_10":' '"snaprealm' 'v2",' '"feature_11":' '"minor' log 'segments",' '"feature_12":' '"quiesce' 'subvolumes"' '}' '},' '"feature_flags":' '{' '"enable_multiple":' true, '"ever_enabled_multiple":' true '},' '"standbys":' '[],' '"filesystems":' '[]' '},' '"mdsmap_first_committed":' 1, '"mdsmap_last_committed":' 1, '"auth":' '{' '"first_committed":' 1, '"last_committed":' 5, '"num_secrets":' 3 '},' '"num_pg":' 64, '"num_pg_active":' 64, '"num_pg_unknown":' 0, '"num_osd":' 3, '"pool_sum":' '{' '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 128, '"acting":' 128, '"num_store_stats":' 0 '},' '"osd_sum":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54568, '"kb_used_data":' 856, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660632, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692487168, '"internally_reserved":' 0, '"allocated":' 876544, '"data_stored":' 327566, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 219, '"apply_latency_ms":' 219, '"commit_latency_ns":' 219000000, '"apply_latency_ns":' 219000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '},' '"osd_sum_by_class":' '{' '"hdd":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54568, '"kb_used_data":' 856, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660632, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692487168, '"internally_reserved":' 0, '"allocated":' 876544, '"data_stored":' 327566, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 219, '"apply_latency_ms":' 219, '"commit_latency_ns":' 219000000, '"apply_latency_ns":' 219000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '}' '},' '"pool_stats":' '[' '{' '"poolid":' 2, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '},' '{' '"poolid":' 1, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '}' '],' '"osd_stats":' '[' '{' '"osd":' 0, '"seq":' 21474836517 '},' '{' '"osd":' 1, '"seq":' 42949672989 '},' '{' '"osd":' 2, '"seq":' 0 '}' '],' '"num_pg_by_state":' '[' '{' '"state":' '"active+undersized",' '"num":' 64 '}' '],' '"num_pg_by_osd":' '[' '{' '"osd":' 2, '"num_primary_pg":' 0, '"num_acting_pg":' 0, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 0, '"num_primary_pg":' 28, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 1, '"num_primary_pg":' 36, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '}' '],' '"purged_snaps":' '[' '{' '"pool":' 1, '"purged_snaps":' '{}' '},' '{' '"pool":' 2, '"purged_snaps":' '{}' '}' '],' '"servicemap":' '{' '"epoch":' 5, '"modified":' '"2024-09-16T03:25:38.422788+0000",' '"services":' '{}' '},' '"mgrstat_first_committed":' 79, '"mgrstat_last_committed":' 85, '"logm_first_committed":' 1, '"logm_last_committed":' 375, '"paxos":' '{' '"first_committed":' 1, '"last_committed":' 560, '"last_pn":' 0, '"accepted_pn":' 0 '}' '}' 2024-09-16T03:25:59.583 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:30: check_lec_equals_pools: lec=28 2024-09-16T03:25:59.583 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:32: check_lec_equals_pools: [[ -z 1 ]] 2024-09-16T03:25:59.584 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:43: check_lec_equals_pools: floor=($(echo $report | jq ".osdmap_clean_epochs.last_epoch_clean.per_pool[] |" " select(.poolid == $pool_id) | .floor")) 2024-09-16T03:25:59.584 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:43: check_lec_equals_pools: jq '.osdmap_clean_epochs.last_epoch_clean.per_pool[] |' ' select(.poolid == 1) | .floor' 2024-09-16T03:25:59.584 INFO:tasks.workunit.client.0.smithi096.stderr:jq: error: syntax error, unexpected $end (Unix shell quoting issues?) at , line 1: 2024-09-16T03:25:59.584 INFO:tasks.workunit.client.0.smithi096.stderr:.osdmap_clean_epochs.last_epoch_clean.per_pool[] | 2024-09-16T03:25:59.584 INFO:tasks.workunit.client.0.smithi096.stderr:jq: 1 compile error 2024-09-16T03:25:59.584 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:43: check_lec_equals_pools: echo '{' '"cluster_fingerprint":' '"fda2fc64-07ed-4add-8224-2e527e11d427",' '"version":' '"19.3.0-4930-gfc3e0bff",' '"commit":' '"fc3e0bff7468fd55478adbae7f75508b749124b6",' '"timestamp":' '"2024-09-16T03:25:59.465184+0000",' '"tag":' '"",' '"health":' '{' '"status":' '"HEALTH_OK",' '"checks":' '{},' '"mutes":' '[]' '},' '"monmap_first_committed":' 1, '"monmap_last_committed":' 1, '"monmap":' '{' '"epoch":' 1, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"modified":' '"2024-09-16T03:22:45.872880Z",' '"created":' '"2024-09-16T03:22:45.872880Z",' '"min_mon_release":' 19, '"min_mon_release_name":' '"squid",' '"election_strategy":' 1, '"disallowed_leaders:' '":' '"",' '"stretch_mode":' false, '"tiebreaker_mon":' '"",' '"removed_ranks:' '":' '"",' '"features":' '{' '"persistent":' '[' '"kraken",' '"luminous",' '"mimic",' '"osdmap-prune",' '"nautilus",' '"octopus",' '"pacific",' '"elector-pinging",' '"quincy",' '"reef",' '"squid"' '],' '"optional":' '[]' '},' '"mons":' '[' '{' '"rank":' 0, '"name":' '"a",' '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:7302",' '"nonce":' 0 '}' ']' '},' '"addr":' '"127.0.0.1:7302/0",' '"public_addr":' '"127.0.0.1:7302/0",' '"priority":' 0, '"weight":' 0, '"crush_location":' '"{}"' '}' ']' '},' '"quorum":' '[' 0 '],' '"osdmap":' '{' '"epoch":' 83, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"created":' '"2024-09-16T03:22:46.906117+0000",' '"modified":' '"2024-09-16T03:25:57.328949+0000",' '"last_up_change":' '"2024-09-16T03:25:08.513363+0000",' '"last_in_change":' '"2024-09-16T03:25:09.839444+0000",' '"flags":' '"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit",' '"flags_num":' 5799936, '"flags_set":' '[' '"pglog_hardlimit",' '"purged_snapdirs",' '"recovery_deletes",' '"sortbitwise"' '],' '"crush_version":' 7, '"full_ratio":' 0.97000002861022949, '"backfillfull_ratio":' 0.97000002861022949, '"nearfull_ratio":' 0.85000002384185791, '"cluster_snapshot":' '"",' '"pool_max":' 2, '"max_osd":' 3, '"require_min_compat_client":' '"luminous",' '"min_compat_client":' '"jewel",' '"require_osd_release":' '"squid",' '"allow_crimson":' false, '"pools":' '[' '{' '"pool":' 1, '"pool_name":' '"foo",' '"create_time":' '"2024-09-16T03:24:44.525189+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"30",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.8700000047683716, '"score_stable":' 1.8700000047683716, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1.25, '"raw_score_stable":' 1.25, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '},' '{' '"pool":' 2, '"pool_name":' '"bar",' '"create_time":' '"2024-09-16T03:24:46.226575+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 2, '"min_size":' 1, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"83",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.4900000095367432, '"score_stable":' 1.4900000095367432, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1, '"raw_score_stable":' 1, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '}' '],' '"osds":' '[' '{' '"osd":' 0, '"uuid":' '"64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 5, '"up_thru":' 81, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6802",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6803",' '"nonce":' 3375787448 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6804",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6805",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6808",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6809",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6806",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6807",' '"nonce":' 3375787448 '}' ']' '},' '"public_addr":' '"127.0.0.1:6803/3375787448",' '"cluster_addr":' '"127.0.0.1:6805/3375787448",' '"heartbeat_back_addr":' '"127.0.0.1:6809/3375787448",' '"heartbeat_front_addr":' '"127.0.0.1:6807/3375787448",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 1, '"uuid":' '"74b26727-75c9-444d-8782-719e4197a382",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 10, '"up_thru":' 81, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6810",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6811",' '"nonce":' 3733255132 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6812",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6813",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6816",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6817",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6814",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6815",' '"nonce":' 3733255132 '}' ']' '},' '"public_addr":' '"127.0.0.1:6811/3733255132",' '"cluster_addr":' '"127.0.0.1:6813/3733255132",' '"heartbeat_back_addr":' '"127.0.0.1:6817/3733255132",' '"heartbeat_front_addr":' '"127.0.0.1:6815/3733255132",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 2, '"uuid":' '"143da3a7-dad9-4b1e-966b-76cf5bdd3c82",' '"up":' 0, '"in":' 0, '"weight":' 0, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 15, '"up_thru":' 21, '"down_at":' 33, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6818",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6819",' '"nonce":' 963814857 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6820",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6821",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6824",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6825",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6822",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6823",' '"nonce":' 963814857 '}' ']' '},' '"public_addr":' '"127.0.0.1:6819/963814857",' '"cluster_addr":' '"127.0.0.1:6821/963814857",' '"heartbeat_back_addr":' '"127.0.0.1:6825/963814857",' '"heartbeat_front_addr":' '"127.0.0.1:6823/963814857",' '"state":' '[' '"exists"' ']' '}' '],' '"osd_xinfo":' '[' '{' '"osd":' 0, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:22.481942+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 1, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:59.663703+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 2, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 65536, '"last_purged_snaps_scrub":' '"2024-09-16T03:24:37.320822+0000",' '"dead_epoch":' 32 '}' '],' '"pg_upmap":' '[],' '"pg_upmap_items":' '[],' '"pg_upmap_primaries":' '[],' '"pg_temp":' '[],' '"primary_temp":' '[],' '"blocklist":' '{},' '"range_blocklist":' '{},' '"erasure_code_profiles":' '{' '"default":' '{' '"k":' '"2",' '"m":' '"2",' '"plugin":' '"jerasure",' '"technique":' '"reed_sol_van"' '}' '},' '"removed_snaps_queue":' '[],' '"new_removed_snaps":' '[],' '"new_purged_snaps":' '[],' '"crush_node_flags":' '{},' '"device_class_flags":' '{},' '"stretch_mode":' '{' '"stretch_mode_enabled":' false, '"stretch_bucket_count":' 0, '"degraded_stretch_mode":' 0, '"recovering_stretch_mode":' 0, '"stretch_mode_bucket":' 0 '}' '},' '"osd_metadata":' '[' '{' '"id":' 0, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/0/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:22:53.662571Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]",' '"hb_front_addr":' '"[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/0",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 1, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/1/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:23:30.129885Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]",' '"hb_front_addr":' '"[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/1",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 2, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/2/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:24:07.764502Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]",' '"hb_front_addr":' '"[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/2",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '}' '],' '"osdmap_clean_epochs":' '{' '"min_last_epoch_clean":' 28, '"last_epoch_clean":' '{' '"per_pool":' '[' '{' '"poolid":' 1, '"floor":' 28 '},' '{' '"poolid":' 2, '"floor":' 28 '}' ']' '},' '"osd_epochs":' '[' '{' '"id":' 0, '"epoch":' 78 '},' '{' '"id":' 1, '"epoch":' 80 '}' ']' '},' '"osdmap_first_committed":' 28, '"osdmap_last_committed":' 83, '"crushmap":' '{' '"devices":' '[' '{' '"id":' 0, '"name":' '"osd.0",' '"class":' '"hdd"' '},' '{' '"id":' 1, '"name":' '"osd.1",' '"class":' '"hdd"' '},' '{' '"id":' 2, '"name":' '"osd.2",' '"class":' '"hdd"' '}' '],' '"types":' '[' '{' '"type_id":' 0, '"name":' '"osd"' '},' '{' '"type_id":' 1, '"name":' '"host"' '},' '{' '"type_id":' 2, '"name":' '"chassis"' '},' '{' '"type_id":' 3, '"name":' '"rack"' '},' '{' '"type_id":' 4, '"name":' '"row"' '},' '{' '"type_id":' 5, '"name":' '"pdu"' '},' '{' '"type_id":' 6, '"name":' '"pod"' '},' '{' '"type_id":' 7, '"name":' '"room"' '},' '{' '"type_id":' 8, '"name":' '"datacenter"' '},' '{' '"type_id":' 9, '"name":' '"zone"' '},' '{' '"type_id":' 10, '"name":' '"region"' '},' '{' '"type_id":' 11, '"name":' '"root"' '}' '],' '"buckets":' '[' '{' '"id":' -1, '"name":' '"default",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -3, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -2, '"name":' '"default~hdd",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -4, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -3, '"name":' '"smithi096",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '},' '{' '"id":' -4, '"name":' '"smithi096~hdd",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '}' '],' '"rules":' '[' '{' '"rule_id":' 0, '"rule_name":' '"replicated_rule",' '"type":' 1, '"steps":' '[' '{' '"op":' '"take",' '"item":' -1, '"item_name":' '"default"' '},' '{' '"op":' '"choose_firstn",' '"num":' 0, '"type":' '"osd"' '},' '{' '"op":' '"emit"' '}' ']' '}' '],' '"tunables":' '{' '"choose_local_tries":' 0, '"choose_local_fallback_tries":' 0, '"choose_total_tries":' 50, '"chooseleaf_descend_once":' 1, '"chooseleaf_vary_r":' 1, '"chooseleaf_stable":' 1, '"msr_descents":' 100, '"msr_collision_tries":' 100, '"straw_calc_version":' 1, '"allowed_bucket_algs":' 54, '"profile":' '"jewel",' '"optimal_tunables":' 1, '"legacy_tunables":' 0, '"minimum_required_version":' '"jewel",' '"require_feature_tunables":' 1, '"require_feature_tunables2":' 1, '"has_v2_rules":' 0, '"require_feature_tunables3":' 1, '"has_v3_rules":' 0, '"has_v4_buckets":' 1, '"require_feature_tunables5":' 1, '"has_v5_rules":' 0, '"has_msr_rules":' 0 '},' '"choose_args":' '{}' '},' '"fsmap":' '{' '"epoch":' 1, '"btime":' '"2024-09-16T03:22:46:882186+0000",' '"default_fscid":' -1, '"compat":' '{' '"compat":' '{},' '"ro_compat":' '{},' '"incompat":' '{' '"feature_1":' '"base' 'v0.20",' '"feature_2":' '"client' writeable 'ranges",' '"feature_3":' '"default' file layouts on 'dirs",' '"feature_4":' '"dir' inode in separate 'object",' '"feature_5":' '"mds' uses versioned 'encoding",' '"feature_6":' '"dirfrag' is stored in 'omap",' '"feature_8":' '"no' anchor 'table",' '"feature_9":' '"file' layout 'v2",' '"feature_10":' '"snaprealm' 'v2",' '"feature_11":' '"minor' log 'segments",' '"feature_12":' '"quiesce' 'subvolumes"' '}' '},' '"feature_flags":' '{' '"enable_multiple":' true, '"ever_enabled_multiple":' true '},' '"standbys":' '[],' '"filesystems":' '[]' '},' '"mdsmap_first_committed":' 1, '"mdsmap_last_committed":' 1, '"auth":' '{' '"first_committed":' 1, '"last_committed":' 5, '"num_secrets":' 3 '},' '"num_pg":' 64, '"num_pg_active":' 64, '"num_pg_unknown":' 0, '"num_osd":' 3, '"pool_sum":' '{' '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 128, '"acting":' 128, '"num_store_stats":' 0 '},' '"osd_sum":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54568, '"kb_used_data":' 856, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660632, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692487168, '"internally_reserved":' 0, '"allocated":' 876544, '"data_stored":' 327566, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 219, '"apply_latency_ms":' 219, '"commit_latency_ns":' 219000000, '"apply_latency_ns":' 219000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '},' '"osd_sum_by_class":' '{' '"hdd":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54568, '"kb_used_data":' 856, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660632, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692487168, '"internally_reserved":' 0, '"allocated":' 876544, '"data_stored":' 327566, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 219, '"apply_latency_ms":' 219, '"commit_latency_ns":' 219000000, '"apply_latency_ns":' 219000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '}' '},' '"pool_stats":' '[' '{' '"poolid":' 2, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '},' '{' '"poolid":' 1, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '}' '],' '"osd_stats":' '[' '{' '"osd":' 0, '"seq":' 21474836517 '},' '{' '"osd":' 1, '"seq":' 42949672989 '},' '{' '"osd":' 2, '"seq":' 0 '}' '],' '"num_pg_by_state":' '[' '{' '"state":' '"active+undersized",' '"num":' 64 '}' '],' '"num_pg_by_osd":' '[' '{' '"osd":' 2, '"num_primary_pg":' 0, '"num_acting_pg":' 0, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 0, '"num_primary_pg":' 28, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 1, '"num_primary_pg":' 36, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '}' '],' '"purged_snaps":' '[' '{' '"pool":' 1, '"purged_snaps":' '{}' '},' '{' '"pool":' 2, '"purged_snaps":' '{}' '}' '],' '"servicemap":' '{' '"epoch":' 5, '"modified":' '"2024-09-16T03:25:38.422788+0000",' '"services":' '{}' '},' '"mgrstat_first_committed":' 79, '"mgrstat_last_committed":' 85, '"logm_first_committed":' 1, '"logm_last_committed":' 375, '"paxos":' '{' '"first_committed":' 1, '"last_committed":' 560, '"last_pn":' 0, '"accepted_pn":' 0 '}' '}' 2024-09-16T03:25:59.584 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:45: check_lec_equals_pools: [[ 28 -eq '' ]] 2024-09-16T03:25:59.584 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:45: check_lec_equals_pools: echo '{' '"cluster_fingerprint":' '"fda2fc64-07ed-4add-8224-2e527e11d427",' '"version":' '"19.3.0-4930-gfc3e0bff",' '"commit":' '"fc3e0bff7468fd55478adbae7f75508b749124b6",' '"timestamp":' '"2024-09-16T03:25:59.465184+0000",' '"tag":' '"",' '"health":' '{' '"status":' '"HEALTH_OK",' '"checks":' '{},' '"mutes":' '[]' '},' '"monmap_first_committed":' 1, '"monmap_last_committed":' 1, '"monmap":' '{' '"epoch":' 1, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"modified":' '"2024-09-16T03:22:45.872880Z",' '"created":' '"2024-09-16T03:22:45.872880Z",' '"min_mon_release":' 19, '"min_mon_release_name":' '"squid",' '"election_strategy":' 1, '"disallowed_leaders:' '":' '"",' '"stretch_mode":' false, '"tiebreaker_mon":' '"",' '"removed_ranks:' '":' '"",' '"features":' '{' '"persistent":' '[' '"kraken",' '"luminous",' '"mimic",' '"osdmap-prune",' '"nautilus",' '"octopus",' '"pacific",' '"elector-pinging",' '"quincy",' '"reef",' '"squid"' '],' '"optional":' '[]' '},' '"mons":' '[' '{' '"rank":' 0, '"name":' '"a",' '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:7302",' '"nonce":' 0 '}' ']' '},' '"addr":' '"127.0.0.1:7302/0",' '"public_addr":' '"127.0.0.1:7302/0",' '"priority":' 0, '"weight":' 0, '"crush_location":' '"{}"' '}' ']' '},' '"quorum":' '[' 0 '],' '"osdmap":' '{' '"epoch":' 83, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"created":' '"2024-09-16T03:22:46.906117+0000",' '"modified":' '"2024-09-16T03:25:57.328949+0000",' '"last_up_change":' '"2024-09-16T03:25:08.513363+0000",' '"last_in_change":' '"2024-09-16T03:25:09.839444+0000",' '"flags":' '"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit",' '"flags_num":' 5799936, '"flags_set":' '[' '"pglog_hardlimit",' '"purged_snapdirs",' '"recovery_deletes",' '"sortbitwise"' '],' '"crush_version":' 7, '"full_ratio":' 0.97000002861022949, '"backfillfull_ratio":' 0.97000002861022949, '"nearfull_ratio":' 0.85000002384185791, '"cluster_snapshot":' '"",' '"pool_max":' 2, '"max_osd":' 3, '"require_min_compat_client":' '"luminous",' '"min_compat_client":' '"jewel",' '"require_osd_release":' '"squid",' '"allow_crimson":' false, '"pools":' '[' '{' '"pool":' 1, '"pool_name":' '"foo",' '"create_time":' '"2024-09-16T03:24:44.525189+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"30",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.8700000047683716, '"score_stable":' 1.8700000047683716, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1.25, '"raw_score_stable":' 1.25, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '},' '{' '"pool":' 2, '"pool_name":' '"bar",' '"create_time":' '"2024-09-16T03:24:46.226575+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 2, '"min_size":' 1, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"83",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.4900000095367432, '"score_stable":' 1.4900000095367432, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1, '"raw_score_stable":' 1, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '}' '],' '"osds":' '[' '{' '"osd":' 0, '"uuid":' '"64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 5, '"up_thru":' 81, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6802",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6803",' '"nonce":' 3375787448 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6804",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6805",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6808",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6809",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6806",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6807",' '"nonce":' 3375787448 '}' ']' '},' '"public_addr":' '"127.0.0.1:6803/3375787448",' '"cluster_addr":' '"127.0.0.1:6805/3375787448",' '"heartbeat_back_addr":' '"127.0.0.1:6809/3375787448",' '"heartbeat_front_addr":' '"127.0.0.1:6807/3375787448",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 1, '"uuid":' '"74b26727-75c9-444d-8782-719e4197a382",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 10, '"up_thru":' 81, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6810",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6811",' '"nonce":' 3733255132 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6812",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6813",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6816",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6817",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6814",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6815",' '"nonce":' 3733255132 '}' ']' '},' '"public_addr":' '"127.0.0.1:6811/3733255132",' '"cluster_addr":' '"127.0.0.1:6813/3733255132",' '"heartbeat_back_addr":' '"127.0.0.1:6817/3733255132",' '"heartbeat_front_addr":' '"127.0.0.1:6815/3733255132",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 2, '"uuid":' '"143da3a7-dad9-4b1e-966b-76cf5bdd3c82",' '"up":' 0, '"in":' 0, '"weight":' 0, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 15, '"up_thru":' 21, '"down_at":' 33, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6818",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6819",' '"nonce":' 963814857 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6820",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6821",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6824",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6825",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6822",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6823",' '"nonce":' 963814857 '}' ']' '},' '"public_addr":' '"127.0.0.1:6819/963814857",' '"cluster_addr":' '"127.0.0.1:6821/963814857",' '"heartbeat_back_addr":' '"127.0.0.1:6825/963814857",' '"heartbeat_front_addr":' '"127.0.0.1:6823/963814857",' '"state":' '[' '"exists"' ']' '}' '],' '"osd_xinfo":' '[' '{' '"osd":' 0, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:22.481942+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 1, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:59.663703+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 2, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 65536, '"last_purged_snaps_scrub":' '"2024-09-16T03:24:37.320822+0000",' '"dead_epoch":' 32 '}' '],' '"pg_upmap":' '[],' '"pg_upmap_items":' '[],' '"pg_upmap_primaries":' '[],' '"pg_temp":' '[],' '"primary_temp":' '[],' '"blocklist":' '{},' '"range_blocklist":' '{},' '"erasure_code_profiles":' '{' '"default":' '{' '"k":' '"2",' '"m":' '"2",' '"plugin":' '"jerasure",' '"technique":' '"reed_sol_van"' '}' '},' '"removed_snaps_queue":' '[],' '"new_removed_snaps":' '[],' '"new_purged_snaps":' '[],' '"crush_node_flags":' '{},' '"device_class_flags":' '{},' '"stretch_mode":' '{' '"stretch_mode_enabled":' false, '"stretch_bucket_count":' 0, '"degraded_stretch_mode":' 0, '"recovering_stretch_mode":' 0, '"stretch_mode_bucket":' 0 '}' '},' '"osd_metadata":' '[' '{' '"id":' 0, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/0/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:22:53.662571Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]",' '"hb_front_addr":' '"[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/0",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 1, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/1/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:23:30.129885Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]",' '"hb_front_addr":' '"[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/1",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 2, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/2/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:24:07.764502Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]",' '"hb_front_addr":' '"[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/2",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '}' '],' '"osdmap_clean_epochs":' '{' '"min_last_epoch_clean":' 28, '"last_epoch_clean":' '{' '"per_pool":' '[' '{' '"poolid":' 1, '"floor":' 28 '},' '{' '"poolid":' 2, '"floor":' 28 '}' ']' '},' '"osd_epochs":' '[' '{' '"id":' 0, '"epoch":' 78 '},' '{' '"id":' 1, '"epoch":' 80 '}' ']' '},' '"osdmap_first_committed":' 28, '"osdmap_last_committed":' 83, '"crushmap":' '{' '"devices":' '[' '{' '"id":' 0, '"name":' '"osd.0",' '"class":' '"hdd"' '},' '{' '"id":' 1, '"name":' '"osd.1",' '"class":' '"hdd"' '},' '{' '"id":' 2, '"name":' '"osd.2",' '"class":' '"hdd"' '}' '],' '"types":' '[' '{' '"type_id":' 0, '"name":' '"osd"' '},' '{' '"type_id":' 1, '"name":' '"host"' '},' '{' '"type_id":' 2, '"name":' '"chassis"' '},' '{' '"type_id":' 3, '"name":' '"rack"' '},' '{' '"type_id":' 4, '"name":' '"row"' '},' '{' '"type_id":' 5, '"name":' '"pdu"' '},' '{' '"type_id":' 6, '"name":' '"pod"' '},' '{' '"type_id":' 7, '"name":' '"room"' '},' '{' '"type_id":' 8, '"name":' '"datacenter"' '},' '{' '"type_id":' 9, '"name":' '"zone"' '},' '{' '"type_id":' 10, '"name":' '"region"' '},' '{' '"type_id":' 11, '"name":' '"root"' '}' '],' '"buckets":' '[' '{' '"id":' -1, '"name":' '"default",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -3, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -2, '"name":' '"default~hdd",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -4, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -3, '"name":' '"smithi096",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '},' '{' '"id":' -4, '"name":' '"smithi096~hdd",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '}' '],' '"rules":' '[' '{' '"rule_id":' 0, '"rule_name":' '"replicated_rule",' '"type":' 1, '"steps":' '[' '{' '"op":' '"take",' '"item":' -1, '"item_name":' '"default"' '},' '{' '"op":' '"choose_firstn",' '"num":' 0, '"type":' '"osd"' '},' '{' '"op":' '"emit"' '}' ']' '}' '],' '"tunables":' '{' '"choose_local_tries":' 0, '"choose_local_fallback_tries":' 0, '"choose_total_tries":' 50, '"chooseleaf_descend_once":' 1, '"chooseleaf_vary_r":' 1, '"chooseleaf_stable":' 1, '"msr_descents":' 100, '"msr_collision_tries":' 100, '"straw_calc_version":' 1, '"allowed_bucket_algs":' 54, '"profile":' '"jewel",' '"optimal_tunables":' 1, '"legacy_tunables":' 0, '"minimum_required_version":' '"jewel",' '"require_feature_tunables":' 1, '"require_feature_tunables2":' 1, '"has_v2_rules":' 0, '"require_feature_tunables3":' 1, '"has_v3_rules":' 0, '"has_v4_buckets":' 1, '"require_feature_tunables5":' 1, '"has_v5_rules":' 0, '"has_msr_rules":' 0 '},' '"choose_args":' '{}' '},' '"fsmap":' '{' '"epoch":' 1, '"btime":' '"2024-09-16T03:22:46:882186+0000",' '"default_fscid":' -1, '"compat":' '{' '"compat":' '{},' '"ro_compat":' '{},' '"incompat":' '{' '"feature_1":' '"base' 'v0.20",' '"feature_2":' '"client' writeable 'ranges",' '"feature_3":' '"default' file layouts on 'dirs",' '"feature_4":' '"dir' inode in separate 'object",' '"feature_5":' '"mds' uses versioned 'encoding",' '"feature_6":' '"dirfrag' is stored in 'omap",' '"feature_8":' '"no' anchor 'table",' '"feature_9":' '"file' layout 'v2",' '"feature_10":' '"snaprealm' 'v2",' '"feature_11":' '"minor' log 'segments",' '"feature_12":' '"quiesce' 'subvolumes"' '}' '},' '"feature_flags":' '{' '"enable_multiple":' true, '"ever_enabled_multiple":' true '},' '"standbys":' '[],' '"filesystems":' '[]' '},' '"mdsmap_first_committed":' 1, '"mdsmap_last_committed":' 1, '"auth":' '{' '"first_committed":' 1, '"last_committed":' 5, '"num_secrets":' 3 '},' '"num_pg":' 64, '"num_pg_active":' 64, '"num_pg_unknown":' 0, '"num_osd":' 3, '"pool_sum":' '{' '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 128, '"acting":' 128, '"num_store_stats":' 0 '},' '"osd_sum":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54568, '"kb_used_data":' 856, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660632, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692487168, '"internally_reserved":' 0, '"allocated":' 876544, '"data_stored":' 327566, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 219, '"apply_latency_ms":' 219, '"commit_latency_ns":' 219000000, '"apply_latency_ns":' 219000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '},' '"osd_sum_by_class":' '{' '"hdd":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54568, '"kb_used_data":' 856, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660632, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692487168, '"internally_reserved":' 0, '"allocated":' 876544, '"data_stored":' 327566, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 219, '"apply_latency_ms":' 219, '"commit_latency_ns":' 219000000, '"apply_latency_ns":' 219000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '}' '},' '"pool_stats":' '[' '{' '"poolid":' 2, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '},' '{' '"poolid":' 1, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '}' '],' '"osd_stats":' '[' '{' '"osd":' 0, '"seq":' 21474836517 '},' '{' '"osd":' 1, '"seq":' 42949672989 '},' '{' '"osd":' 2, '"seq":' 0 '}' '],' '"num_pg_by_state":' '[' '{' '"state":' '"active+undersized",' '"num":' 64 '}' '],' '"num_pg_by_osd":' '[' '{' '"osd":' 2, '"num_primary_pg":' 0, '"num_acting_pg":' 0, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 0, '"num_primary_pg":' 28, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 1, '"num_primary_pg":' 36, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '}' '],' '"purged_snaps":' '[' '{' '"pool":' 1, '"purged_snaps":' '{}' '},' '{' '"pool":' 2, '"purged_snaps":' '{}' '}' '],' '"servicemap":' '{' '"epoch":' 5, '"modified":' '"2024-09-16T03:25:38.422788+0000",' '"services":' '{}' '},' '"mgrstat_first_committed":' 79, '"mgrstat_last_committed":' 85, '"logm_first_committed":' 1, '"logm_last_committed":' 375, '"paxos":' '{' '"first_committed":' 1, '"last_committed":' 560, '"last_pn":' 0, '"accepted_pn":' 0 '}' '}' 2024-09-16T03:25:59.585 INFO:tasks.workunit.client.0.smithi096.stdout:{ "cluster_fingerprint": "fda2fc64-07ed-4add-8224-2e527e11d427", "version": "19.3.0-4930-gfc3e0bff", "commit": "fc3e0bff7468fd55478adbae7f75508b749124b6", "timestamp": "2024-09-16T03:25:59.465184+0000", "tag": "", "health": { "status": "HEALTH_OK", "checks": {}, "mutes": [] }, "monmap_first_committed": 1, "monmap_last_committed": 1, "monmap": { "epoch": 1, "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", "modified": "2024-09-16T03:22:45.872880Z", "created": "2024-09-16T03:22:45.872880Z", "min_mon_release": 19, "min_mon_release_name": "squid", "election_strategy": 1, "disallowed_leaders: ": "", "stretch_mode": false, "tiebreaker_mon": "", "removed_ranks: ": "", "features": { "persistent": [ "kraken", "luminous", "mimic", "osdmap-prune", "nautilus", "octopus", "pacific", "elector-pinging", "quincy", "reef", "squid" ], "optional": [] }, "mons": [ { "rank": 0, "name": "a", "public_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:7302", "nonce": 0 } ] }, "addr": "127.0.0.1:7302/0", "public_addr": "127.0.0.1:7302/0", "priority": 0, "weight": 0, "crush_location": "{}" } ] }, "quorum": [ 0 ], "osdmap": { "epoch": 83, "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", "created": "2024-09-16T03:22:46.906117+0000", "modified": "2024-09-16T03:25:57.328949+0000", "last_up_change": "2024-09-16T03:25:08.513363+0000", "last_in_change": "2024-09-16T03:25:09.839444+0000", "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", "flags_num": 5799936, "flags_set": [ "pglog_hardlimit", "purged_snapdirs", "recovery_deletes", "sortbitwise" ], "crush_version": 7, "full_ratio": 0.97000002861022949, "backfillfull_ratio": 0.97000002861022949, "nearfull_ratio": 0.85000002384185791, "cluster_snapshot": "", "pool_max": 2, "max_osd": 3, "require_min_compat_client": "luminous", "min_compat_client": "jewel", "require_osd_release": "squid", "allow_crimson": false, "pools": [ { "pool": 1, "pool_name": "foo", "create_time": "2024-09-16T03:24:44.525189+0000", "flags": 1, "flags_names": "hashpspool", "type": 1, "size": 3, "min_size": 2, "crush_rule": 0, "peering_crush_bucket_count": 0, "peering_crush_bucket_target": 0, "peering_crush_bucket_barrier": 0, "peering_crush_bucket_mandatory_member": 2147483647, "is_stretch_pool": false, "object_hash": 2, "pg_autoscale_mode": "off", "pg_num": 32, "pg_placement_num": 32, "pg_placement_num_target": 32, "pg_num_target": 32, "pg_num_pending": 32, "last_pg_merge_meta": { "source_pgid": "0.0", "ready_epoch": 0, "last_epoch_started": 0, "last_epoch_clean": 0, "source_version": "0'0", "target_version": "0'0" }, "last_change": "30", "last_force_op_resend": "0", "last_force_op_resend_prenautilus": "0", "last_force_op_resend_preluminous": "0", "auid": 0, "snap_mode": "selfmanaged", "snap_seq": 0, "snap_epoch": 0, "pool_snaps": [], "removed_snaps": "[]", "quota_max_bytes": 0, "quota_max_objects": 0, "tiers": [], "tier_of": -1, "read_tier": -1, "write_tier": -1, "cache_mode": "none", "target_max_bytes": 0, "target_max_objects": 0, "cache_target_dirty_ratio_micro": 400000, "cache_target_dirty_high_ratio_micro": 600000, "cache_target_full_ratio_micro": 800000, "cache_min_flush_age": 0, "cache_min_evict_age": 0, "erasure_code_profile": "", "hit_set_params": { "type": "none" }, "hit_set_period": 0, "hit_set_count": 0, "use_gmt_hitset": true, "min_read_recency_for_promote": 0, "min_write_recency_for_promote": 0, "hit_set_grade_decay_rate": 0, "hit_set_search_last_n": 0, "grade_table": [], "stripe_width": 0, "expected_num_objects": 0, "fast_read": false, "options": {}, "application_metadata": {}, "read_balance": { "score_type": "Fair distribution", "score_acting": 1.8700000047683716, "score_stable": 1.8700000047683716, "optimal_score": 0.67000001668930054, "raw_score_acting": 1.25, "raw_score_stable": 1.25, "primary_affinity_weighted": 1, "average_primary_affinity": 1, "average_primary_affinity_weighted": 1 } }, { "pool": 2, "pool_name": "bar", "create_time": "2024-09-16T03:24:46.226575+0000", "flags": 1, "flags_names": "hashpspool", "type": 1, "size": 2, "min_size": 1, "crush_rule": 0, "peering_crush_bucket_count": 0, "peering_crush_bucket_target": 0, "peering_crush_bucket_barrier": 0, "peering_crush_bucket_mandatory_member": 2147483647, "is_stretch_pool": false, "object_hash": 2, "pg_autoscale_mode": "off", "pg_num": 32, "pg_placement_num": 32, "pg_placement_num_target": 32, "pg_num_target": 32, "pg_num_pending": 32, "last_pg_merge_meta": { "source_pgid": "0.0", "ready_epoch": 0, "last_epoch_started": 0, "last_epoch_clean": 0, "source_version": "0'0", "target_version": "0'0" }, "last_change": "83", "last_force_op_resend": "0", "last_force_op_resend_prenautilus": "0", "last_force_op_resend_preluminous": "0", "auid": 0, "snap_mode": "selfmanaged", "snap_seq": 0, "snap_epoch": 0, "pool_snaps": [], "removed_snaps": "[]", "quota_max_bytes": 0, "quota_max_objects": 0, "tiers": [], "tier_of": -1, "read_tier": -1, "write_tier": -1, "cache_mode": "none", "target_max_bytes": 0, "target_max_objects": 0, "cache_target_dirty_ratio_micro": 400000, "cache_target_dirty_high_ratio_micro": 600000, "cache_target_full_ratio_micro": 800000, "cache_min_flush_age": 0, "cache_min_evict_age": 0, "erasure_code_profile": "", "hit_set_params": { "type": "none" }, "hit_set_period": 0, "hit_set_count": 0, "use_gmt_hitset": true, "min_read_recency_for_promote": 0, "min_write_recency_for_promote": 0, "hit_set_grade_decay_rate": 0, "hit_set_search_last_n": 0, "grade_table": [], "stripe_width": 0, "expected_num_objects": 0, "fast_read": false, "options": {}, "application_metadata": {}, "read_balance": { "score_type": "Fair distribution", "score_acting": 1.4900000095367432, "score_stable": 1.4900000095367432, "optimal_score": 0.67000001668930054, "raw_score_acting": 1, "raw_score_stable": 1, "primary_affinity_weighted": 1, "average_primary_affinity": 1, "average_primary_affinity_weighted": 1 } } ], "osds": [ { "osd": 0, "uuid": "64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6", "up": 1, "in": 1, "weight": 1, "primary_affinity": 1, "last_clean_begin": 0, "last_clean_end": 0, "up_from": 5, "up_thru": 81, "down_at": 0, "lost_at": 0, "public_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6802", "nonce": 3375787448 }, { "type": "v1", "addr": "127.0.0.1:6803", "nonce": 3375787448 } ] }, "cluster_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6804", "nonce": 3375787448 }, { "type": "v1", "addr": "127.0.0.1:6805", "nonce": 3375787448 } ] }, "heartbeat_back_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6808", "nonce": 3375787448 }, { "type": "v1", "addr": "127.0.0.1:6809", "nonce": 3375787448 } ] }, "heartbeat_front_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6806", "nonce": 3375787448 }, { "type": "v1", "addr": "127.0.0.1:6807", "nonce": 3375787448 } ] }, "public_addr": "127.0.0.1:6803/3375787448", "cluster_addr": "127.0.0.1:6805/3375787448", "heartbeat_back_addr": "127.0.0.1:6809/3375787448", "heartbeat_front_addr": "127.0.0.1:6807/3375787448", "state": [ "exists", "up" ] }, { "osd": 1, "uuid": "74b26727-75c9-444d-8782-719e4197a382", "up": 1, "in": 1, "weight": 1, "primary_affinity": 1, "last_clean_begin": 0, "last_clean_end": 0, "up_from": 10, "up_thru": 81, "down_at": 0, "lost_at": 0, "public_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6810", "nonce": 3733255132 }, { "type": "v1", "addr": "127.0.0.1:6811", "nonce": 3733255132 } ] }, "cluster_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6812", "nonce": 3733255132 }, { "type": "v1", "addr": "127.0.0.1:6813", "nonce": 3733255132 } ] }, "heartbeat_back_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6816", "nonce": 3733255132 }, { "type": "v1", "addr": "127.0.0.1:6817", "nonce": 3733255132 } ] }, "heartbeat_front_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6814", "nonce": 3733255132 }, { "type": "v1", "addr": "127.0.0.1:6815", "nonce": 3733255132 } ] }, "public_addr": "127.0.0.1:6811/3733255132", "cluster_addr": "127.0.0.1:6813/3733255132", "heartbeat_back_addr": "127.0.0.1:6817/3733255132", "heartbeat_front_addr": "127.0.0.1:6815/3733255132", "state": [ "exists", "up" ] }, { "osd": 2, "uuid": "143da3a7-dad9-4b1e-966b-76cf5bdd3c82", "up": 0, "in": 0, "weight": 0, "primary_affinity": 1, "last_clean_begin": 0, "last_clean_end": 0, "up_from": 15, "up_thru": 21, "down_at": 33, "lost_at": 0, "public_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6818", "nonce": 963814857 }, { "type": "v1", "addr": "127.0.0.1:6819", "nonce": 963814857 } ] }, "cluster_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6820", "nonce": 963814857 }, { "type": "v1", "addr": "127.0.0.1:6821", "nonce": 963814857 } ] }, "heartbeat_back_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6824", "nonce": 963814857 }, { "type": "v1", "addr": "127.0.0.1:6825", "nonce": 963814857 } ] }, "heartbeat_front_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6822", "nonce": 963814857 }, { "type": "v1", "addr": "127.0.0.1:6823", "nonce": 963814857 } ] }, "public_addr": "127.0.0.1:6819/963814857", "cluster_addr": "127.0.0.1:6821/963814857", "heartbeat_back_addr": "127.0.0.1:6825/963814857", "heartbeat_front_addr": "127.0.0.1:6823/963814857", "state": [ "exists" ] } ], "osd_xinfo": [ { "osd": 0, "down_stamp": "0.000000", "laggy_probability": 0, "laggy_interval": 0, "features": 4540719139924082687, "old_weight": 0, "last_purged_snaps_scrub": "2024-09-16T03:23:22.481942+0000", "dead_epoch": 0 }, { "osd": 1, "down_stamp": "0.000000", "laggy_probability": 0, "laggy_interval": 0, "features": 4540719139924082687, "old_weight": 0, "last_purged_snaps_scrub": "2024-09-16T03:23:59.663703+0000", "dead_epoch": 0 }, { "osd": 2, "down_stamp": "0.000000", "laggy_probability": 0, "laggy_interval": 0, "features": 4540719139924082687, "old_weight": 65536, "last_purged_snaps_scrub": "2024-09-16T03:24:37.320822+0000", "dead_epoch": 32 } ], "pg_upmap": [], "pg_upmap_items": [], "pg_upmap_primaries": [], "pg_temp": [], "primary_temp": [], "blocklist": {}, "range_blocklist": {}, "erasure_code_profiles": { "default": { "k": "2", "m": "2", "plugin": "jerasure", "technique": "reed_sol_van" } }, "removed_snaps_queue": [], "new_removed_snaps": [], "new_purged_snaps": [], "crush_node_flags": {}, "device_class_flags": {}, "stretch_mode": { "stretch_mode_enabled": false, "stretch_bucket_count": 0, "degraded_stretch_mode": 0, "recovering_stretch_mode": 0, "stretch_mode_bucket": 0 } }, "osd_metadata": [ { "id": 0, "arch": "x86_64", "back_addr": "[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]", "back_iface": "", "bluefs": "1", "bluefs_dedicated_db": "0", "bluefs_dedicated_wal": "0", "bluefs_single_shared_device": "1", "bluestore_allocation_from_file": "0", "bluestore_bdev_access_mode": "file", "bluestore_bdev_block_size": "4096", "bluestore_bdev_devices": "sda", "bluestore_bdev_driver": "KernelDevice", "bluestore_bdev_optimal_io_size": "0", "bluestore_bdev_path": "td/mon-last-clean-epoch/0/block", "bluestore_bdev_rotational": "1", "bluestore_bdev_size": "107374182400", "bluestore_bdev_support_discard": "0", "bluestore_bdev_type": "hdd", "bluestore_min_alloc_size": "4096", "ceph_release": "squid", "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", "ceph_version_short": "19.3.0-4930-gfc3e0bff", "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", "created_at": "2024-09-16T03:22:53.662571Z", "default_device_class": "hdd", "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", "devices": "sda", "distro": "ubuntu", "distro_description": "Ubuntu 22.04.1 LTS", "distro_version": "22.04", "front_addr": "[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]", "front_iface": "", "hb_back_addr": "[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]", "hb_front_addr": "[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]", "hostname": "smithi096", "journal_rotational": "1", "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", "kernel_version": "5.15.0-121-generic", "mem_swap_kb": "2097148", "mem_total_kb": "32746824", "network_numa_unknown_ifaces": "back_iface,front_iface", "objectstore_numa_unknown_devices": "sda", "os": "Linux", "osd_data": "td/mon-last-clean-epoch/0", "osd_objectstore": "bluestore", "osdspec_affinity": "", "rotational": "1" }, { "id": 1, "arch": "x86_64", "back_addr": "[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]", "back_iface": "", "bluefs": "1", "bluefs_dedicated_db": "0", "bluefs_dedicated_wal": "0", "bluefs_single_shared_device": "1", "bluestore_allocation_from_file": "0", "bluestore_bdev_access_mode": "file", "bluestore_bdev_block_size": "4096", "bluestore_bdev_devices": "sda", "bluestore_bdev_driver": "KernelDevice", "bluestore_bdev_optimal_io_size": "0", "bluestore_bdev_path": "td/mon-last-clean-epoch/1/block", "bluestore_bdev_rotational": "1", "bluestore_bdev_size": "107374182400", "bluestore_bdev_support_discard": "0", "bluestore_bdev_type": "hdd", "bluestore_min_alloc_size": "4096", "ceph_release": "squid", "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", "ceph_version_short": "19.3.0-4930-gfc3e0bff", "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", "created_at": "2024-09-16T03:23:30.129885Z", "default_device_class": "hdd", "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", "devices": "sda", "distro": "ubuntu", "distro_description": "Ubuntu 22.04.1 LTS", "distro_version": "22.04", "front_addr": "[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]", "front_iface": "", "hb_back_addr": "[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]", "hb_front_addr": "[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]", "hostname": "smithi096", "journal_rotational": "1", "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", "kernel_version": "5.15.0-121-generic", "mem_swap_kb": "2097148", "mem_total_kb": "32746824", "network_numa_unknown_ifaces": "back_iface,front_iface", "objectstore_numa_unknown_devices": "sda", "os": "Linux", "osd_data": "td/mon-last-clean-epoch/1", "osd_objectstore": "bluestore", "osdspec_affinity": "", "rotational": "1" }, { "id": 2, "arch": "x86_64", "back_addr": "[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]", "back_iface": "", "bluefs": "1", "bluefs_dedicated_db": "0", "bluefs_dedicated_wal": "0", "bluefs_single_shared_device": "1", "bluestore_allocation_from_file": "0", "bluestore_bdev_access_mode": "file", "bluestore_bdev_block_size": "4096", "bluestore_bdev_devices": "sda", "bluestore_bdev_driver": "KernelDevice", "bluestore_bdev_optimal_io_size": "0", "bluestore_bdev_path": "td/mon-last-clean-epoch/2/block", "bluestore_bdev_rotational": "1", "bluestore_bdev_size": "107374182400", "bluestore_bdev_support_discard": "0", "bluestore_bdev_type": "hdd", "bluestore_min_alloc_size": "4096", "ceph_release": "squid", "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", "ceph_version_short": "19.3.0-4930-gfc3e0bff", "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", "created_at": "2024-09-16T03:24:07.764502Z", "default_device_class": "hdd", "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", "devices": "sda", "distro": "ubuntu", "distro_description": "Ubuntu 22.04.1 LTS", "distro_version": "22.04", "front_addr": "[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]", "front_iface": "", "hb_back_addr": "[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]", "hb_front_addr": "[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]", "hostname": "smithi096", "journal_rotational": "1", "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", "kernel_version": "5.15.0-121-generic", "mem_swap_kb": "2097148", "mem_total_kb": "32746824", "network_numa_unknown_ifaces": "back_iface,front_iface", "objectstore_numa_unknown_devices": "sda", "os": "Linux", "osd_data": "td/mon-last-clean-epoch/2", "osd_objectstore": "bluestore", "osdspec_affinity": "", "rotational": "1" } ], "osdmap_clean_epochs": { "min_last_epoch_clean": 28, "last_epoch_clean": { "per_pool": [ { "poolid": 1, "floor": 28 }, { "poolid": 2, "floor": 28 } ] }, "osd_epochs": [ { "id": 0, "epoch": 78 }, { "id": 1, "epoch": 80 } ] }, "osdmap_first_committed": 28, "osdmap_last_committed": 83, "crushmap": { "devices": [ { "id": 0, "name": "osd.0", "class": "hdd" }, { "id": 1, "name": "osd.1", "class": "hdd" }, { "id": 2, "name": "osd.2", "class": "hdd" } ], "types": [ { "type_id": 0, "name": "osd" }, { "type_id": 1, "name": "host" }, { "type_id": 2, "name": "chassis" }, { "type_id": 3, "name": "rack" }, { "type_id": 4, "name": "row" }, { "type_id": 5, "name": "pdu" }, { "type_id": 6, "name": "pod" }, { "type_id": 7, "name": "room" }, { "type_id": 8, "name": "datacenter" }, { "type_id": 9, "name": "zone" }, { "type_id": 10, "name": "region" }, { "type_id": 11, "name": "root" } ], "buckets": [ { "id": -1, "name": "default", "type_id": 11, "type_name": "root", "weight": 19206, "alg": "straw2", "hash": "rjenkins1", "items": [ { "id": -3, "weight": 19206, "pos": 0 } ] }, { "id": -2, "name": "default~hdd", "type_id": 11, "type_name": "root", "weight": 19206, "alg": "straw2", "hash": "rjenkins1", "items": [ { "id": -4, "weight": 19206, "pos": 0 } ] }, { "id": -3, "name": "smithi096", "type_id": 1, "type_name": "host", "weight": 19206, "alg": "straw2", "hash": "rjenkins1", "items": [ { "id": 0, "weight": 6402, "pos": 0 }, { "id": 1, "weight": 6402, "pos": 1 }, { "id": 2, "weight": 6402, "pos": 2 } ] }, { "id": -4, "name": "smithi096~hdd", "type_id": 1, "type_name": "host", "weight": 19206, "alg": "straw2", "hash": "rjenkins1", "items": [ { "id": 0, "weight": 6402, "pos": 0 }, { "id": 1, "weight": 6402, "pos": 1 }, { "id": 2, "weight": 6402, "pos": 2 } ] } ], "rules": [ { "rule_id": 0, "rule_name": "replicated_rule", "type": 1, "steps": [ { "op": "take", "item": -1, "item_name": "default" }, { "op": "choose_firstn", "num": 0, "type": "osd" }, { "op": "emit" } ] } ], "tunables": { "choose_local_tries": 0, "choose_local_fallback_tries": 0, "choose_total_tries": 50, "chooseleaf_descend_once": 1, "chooseleaf_vary_r": 1, "chooseleaf_stable": 1, "msr_descents": 100, "msr_collision_tries": 100, "straw_calc_version": 1, "allowed_bucket_algs": 54, "profile": "jewel", "optimal_tunables": 1, "legacy_tunables": 0, "minimum_required_version": "jewel", "require_feature_tunables": 1, "require_feature_tunables2": 1, "has_v2_rules": 0, "require_feature_tunables3": 1, "has_v3_rules": 0, "has_v4_buckets": 1, "require_feature_tunables5": 1, "has_v5_rules": 0, "has_msr_rules": 0 }, "choose_args": {} }, "fsmap": { "epoch": 1, "btime": "2024-09-16T03:22:46:882186+0000", "default_fscid": -1, "compat": { "compat": {}, "ro_compat": {}, "incompat": { "feature_1": "base v0.20", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes" } }, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "standbys": [], "filesystems": [] }, "mdsmap_first_committed": 1, "mdsmap_last_committed": 1, "auth": { "first_committed": 1, "last_committed": 5, "num_secrets": 3 }, "num_pg": 64, "num_pg_active": 64, "num_pg_unknown": 0, "num_osd": 3, "pool_sum": { "stat_sum": { "num_bytes": 0, "num_objects": 0, "num_object_clones": 0, "num_object_copies": 0, "num_objects_missing_on_primary": 0, "num_objects_missing": 0, "num_objects_degraded": 0, "num_objects_misplaced": 0, "num_objects_unfound": 0, "num_objects_dirty": 0, "num_whiteouts": 0, "num_read": 0, "num_read_kb": 0, "num_write": 0, "num_write_kb": 0, "num_scrub_errors": 0, "num_shallow_scrub_errors": 0, "num_deep_scrub_errors": 0, "num_objects_recovered": 0, "num_bytes_recovered": 0, "num_keys_recovered": 0, "num_objects_omap": 0, "num_objects_hit_set_archive": 0, "num_bytes_hit_set_archive": 0, "num_flush": 0, "num_flush_kb": 0, "num_evict": 0, "num_evict_kb": 0, "num_promote": 0, "num_flush_mode_high": 0, "num_flush_mode_low": 0, "num_evict_mode_some": 0, "num_evict_mode_full": 0, "num_objects_pinned": 0, "num_legacy_snapsets": 0, "num_large_omap_objects": 0, "num_objects_manifest": 0, "num_omap_bytes": 0, "num_omap_keys": 0, "num_objects_repaired": 0 }, "store_stats": { "total": 0, "available": 0, "internally_reserved": 0, "allocated": 0, "data_stored": 0, "data_compressed": 0, "data_compressed_allocated": 0, "data_compressed_original": 0, "omap_allocated": 0, "internal_metadata": 0 }, "log_size": 0, "ondisk_log_size": 0, "up": 128, "acting": 128, "num_store_stats": 0 }, "osd_sum": { "up_from": 0, "seq": 0, "num_pgs": 128, "num_osds": 2, "num_per_pool_osds": 2, "num_per_pool_omap_osds": 2, "kb": 209715200, "kb_used": 54568, "kb_used_data": 856, "kb_used_omap": 3, "kb_used_meta": 53628, "kb_avail": 209660632, "statfs": { "total": 214748364800, "available": 214692487168, "internally_reserved": 0, "allocated": 876544, "data_stored": 327566, "data_compressed": 0, "data_compressed_allocated": 0, "data_compressed_original": 0, "omap_allocated": 3190, "internal_metadata": 54915978 }, "hb_peers": [], "snap_trim_queue_len": 0, "num_snap_trimming": 0, "num_shards_repaired": 0, "op_queue_age_hist": { "histogram": [], "upper_bound": 1 }, "perf_stat": { "commit_latency_ms": 219, "apply_latency_ms": 219, "commit_latency_ns": 219000000, "apply_latency_ns": 219000000 }, "alerts": [], "network_ping_times": [] }, "osd_sum_by_class": { "hdd": { "up_from": 0, "seq": 0, "num_pgs": 128, "num_osds": 2, "num_per_pool_osds": 2, "num_per_pool_omap_osds": 2, "kb": 209715200, "kb_used": 54568, "kb_used_data": 856, "kb_used_omap": 3, "kb_used_meta": 53628, "kb_avail": 209660632, "statfs": { "total": 214748364800, "available": 214692487168, "internally_reserved": 0, "allocated": 876544, "data_stored": 327566, "data_compressed": 0, "data_compressed_allocated": 0, "data_compressed_original": 0, "omap_allocated": 3190, "internal_metadata": 54915978 }, "hb_peers": [], "snap_trim_queue_len": 0, "num_snap_trimming": 0, "num_shards_repaired": 0, "op_queue_age_hist": { "histogram": [], "upper_bound": 1 }, "perf_stat": { "commit_latency_ms": 219, "apply_latency_ms": 219, "commit_latency_ns": 219000000, "apply_latency_ns": 219000000 }, "alerts": [], "network_ping_times": [] } }, "pool_stats": [ { "poolid": 2, "num_pg": 32, "stat_sum": { "num_bytes": 0, "num_objects": 0, "num_object_clones": 0, "num_object_copies": 0, "num_objects_missing_on_primary": 0, "num_objects_missing": 0, "num_objects_degraded": 0, "num_objects_misplaced": 0, "num_objects_unfound": 0, "num_objects_dirty": 0, "num_whiteouts": 0, "num_read": 0, "num_read_kb": 0, "num_write": 0, "num_write_kb": 0, "num_scrub_errors": 0, "num_shallow_scrub_errors": 0, "num_deep_scrub_errors": 0, "num_objects_recovered": 0, "num_bytes_recovered": 0, "num_keys_recovered": 0, "num_objects_omap": 0, "num_objects_hit_set_archive": 0, "num_bytes_hit_set_archive": 0, "num_flush": 0, "num_flush_kb": 0, "num_evict": 0, "num_evict_kb": 0, "num_promote": 0, "num_flush_mode_high": 0, "num_flush_mode_low": 0, "num_evict_mode_some": 0, "num_evict_mode_full": 0, "num_objects_pinned": 0, "num_legacy_snapsets": 0, "num_large_omap_objects": 0, "num_objects_manifest": 0, "num_omap_bytes": 0, "num_omap_keys": 0, "num_objects_repaired": 0 }, "store_stats": { "total": 0, "available": 0, "internally_reserved": 0, "allocated": 0, "data_stored": 0, "data_compressed": 0, "data_compressed_allocated": 0, "data_compressed_original": 0, "omap_allocated": 0, "internal_metadata": 0 }, "log_size": 0, "ondisk_log_size": 0, "up": 64, "acting": 64, "num_store_stats": 3 }, { "poolid": 1, "num_pg": 32, "stat_sum": { "num_bytes": 0, "num_objects": 0, "num_object_clones": 0, "num_object_copies": 0, "num_objects_missing_on_primary": 0, "num_objects_missing": 0, "num_objects_degraded": 0, "num_objects_misplaced": 0, "num_objects_unfound": 0, "num_objects_dirty": 0, "num_whiteouts": 0, "num_read": 0, "num_read_kb": 0, "num_write": 0, "num_write_kb": 0, "num_scrub_errors": 0, "num_shallow_scrub_errors": 0, "num_deep_scrub_errors": 0, "num_objects_recovered": 0, "num_bytes_recovered": 0, "num_keys_recovered": 0, "num_objects_omap": 0, "num_objects_hit_set_archive": 0, "num_bytes_hit_set_archive": 0, "num_flush": 0, "num_flush_kb": 0, "num_evict": 0, "num_evict_kb": 0, "num_promote": 0, "num_flush_mode_high": 0, "num_flush_mode_low": 0, "num_evict_mode_some": 0, "num_evict_mode_full": 0, "num_objects_pinned": 0, "num_legacy_snapsets": 0, "num_large_omap_objects": 0, "num_objects_manifest": 0, "num_omap_bytes": 0, "num_omap_keys": 0, "num_objects_repaired": 0 }, "store_stats": { "total": 0, "available": 0, "internally_reserved": 0, "allocated": 0, "data_stored": 0, "data_compressed": 0, "data_compressed_allocated": 0, "data_compressed_original": 0, "omap_allocated": 0, "internal_metadata": 0 }, "log_size": 0, "ondisk_log_size": 0, "up": 64, "acting": 64, "num_store_stats": 3 } ], "osd_stats": [ { "osd": 0, "seq": 21474836517 }, { "osd": 1, "seq": 42949672989 }, { "osd": 2, "seq": 0 } ], "num_pg_by_state": [ { "state": "active+undersized", "num": 64 } ], "num_pg_by_osd": [ { "osd": 2, "num_primary_pg": 0, "num_acting_pg": 0, "num_up_not_acting_pg": 0 }, { "osd": 0, "num_primary_pg": 28, "num_acting_pg": 64, "num_up_not_acting_pg": 0 }, { "osd": 1, "num_primary_pg": 36, "num_acting_pg": 64, "num_up_not_acting_pg": 0 } ], "purged_snaps": [ { "pool": 1, "purged_snaps": {} }, { "pool": 2, "purged_snaps": {} } ], "servicemap": { "epoch": 5, "modified": "2024-09-16T03:25:38.422788+0000", "services": {} }, "mgrstat_first_committed": 79, "mgrstat_last_committed": 85, "logm_first_committed": 1, "logm_last_committed": 375, "paxos": { "first_committed": 1, "last_committed": 560, "last_pn": 0, "accepted_pn": 0 } } 2024-09-16T03:25:59.586 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:45: check_lec_equals_pools: return 1 2024-09-16T03:25:59.586 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:47: check_lec_equals_pools: return 0 2024-09-16T03:25:59.586 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:261: TEST_mon_last_clean_epoch: check_lec_lower_than_pool 2 2024-09-16T03:25:59.587 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:52: check_lec_lower_than_pool: local pool_id=2 2024-09-16T03:25:59.587 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:53: check_lec_lower_than_pool: [[ -z 2 ]] 2024-09-16T03:25:59.587 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:55: check_lec_lower_than_pool: ceph report 2024-09-16T03:26:00.083 INFO:tasks.workunit.client.0.smithi096.stderr:report 987905117 2024-09-16T03:26:00.100 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:55: check_lec_lower_than_pool: report='{ 2024-09-16T03:26:00.100 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_fingerprint": "fda2fc64-07ed-4add-8224-2e527e11d427", 2024-09-16T03:26:00.100 INFO:tasks.workunit.client.0.smithi096.stderr: "version": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:26:00.100 INFO:tasks.workunit.client.0.smithi096.stderr: "commit": "fc3e0bff7468fd55478adbae7f75508b749124b6", 2024-09-16T03:26:00.100 INFO:tasks.workunit.client.0.smithi096.stderr: "timestamp": "2024-09-16T03:26:00.085015+0000", 2024-09-16T03:26:00.100 INFO:tasks.workunit.client.0.smithi096.stderr: "tag": "", 2024-09-16T03:26:00.100 INFO:tasks.workunit.client.0.smithi096.stderr: "health": { 2024-09-16T03:26:00.100 INFO:tasks.workunit.client.0.smithi096.stderr: "status": "HEALTH_OK", 2024-09-16T03:26:00.100 INFO:tasks.workunit.client.0.smithi096.stderr: "checks": {}, 2024-09-16T03:26:00.100 INFO:tasks.workunit.client.0.smithi096.stderr: "mutes": [] 2024-09-16T03:26:00.100 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.101 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap_first_committed": 1, 2024-09-16T03:26:00.101 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap_last_committed": 1, 2024-09-16T03:26:00.101 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap": { 2024-09-16T03:26:00.101 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 1, 2024-09-16T03:26:00.101 INFO:tasks.workunit.client.0.smithi096.stderr: "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", 2024-09-16T03:26:00.101 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:22:45.872880Z", 2024-09-16T03:26:00.101 INFO:tasks.workunit.client.0.smithi096.stderr: "created": "2024-09-16T03:22:45.872880Z", 2024-09-16T03:26:00.101 INFO:tasks.workunit.client.0.smithi096.stderr: "min_mon_release": 19, 2024-09-16T03:26:00.101 INFO:tasks.workunit.client.0.smithi096.stderr: "min_mon_release_name": "squid", 2024-09-16T03:26:00.101 INFO:tasks.workunit.client.0.smithi096.stderr: "election_strategy": 1, 2024-09-16T03:26:00.101 INFO:tasks.workunit.client.0.smithi096.stderr: "disallowed_leaders: ": "", 2024-09-16T03:26:00.101 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode": false, 2024-09-16T03:26:00.101 INFO:tasks.workunit.client.0.smithi096.stderr: "tiebreaker_mon": "", 2024-09-16T03:26:00.102 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_ranks: ": "", 2024-09-16T03:26:00.102 INFO:tasks.workunit.client.0.smithi096.stderr: "features": { 2024-09-16T03:26:00.102 INFO:tasks.workunit.client.0.smithi096.stderr: "persistent": [ 2024-09-16T03:26:00.102 INFO:tasks.workunit.client.0.smithi096.stderr: "kraken", 2024-09-16T03:26:00.102 INFO:tasks.workunit.client.0.smithi096.stderr: "luminous", 2024-09-16T03:26:00.102 INFO:tasks.workunit.client.0.smithi096.stderr: "mimic", 2024-09-16T03:26:00.102 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap-prune", 2024-09-16T03:26:00.102 INFO:tasks.workunit.client.0.smithi096.stderr: "nautilus", 2024-09-16T03:26:00.102 INFO:tasks.workunit.client.0.smithi096.stderr: "octopus", 2024-09-16T03:26:00.102 INFO:tasks.workunit.client.0.smithi096.stderr: "pacific", 2024-09-16T03:26:00.102 INFO:tasks.workunit.client.0.smithi096.stderr: "elector-pinging", 2024-09-16T03:26:00.102 INFO:tasks.workunit.client.0.smithi096.stderr: "quincy", 2024-09-16T03:26:00.102 INFO:tasks.workunit.client.0.smithi096.stderr: "reef", 2024-09-16T03:26:00.103 INFO:tasks.workunit.client.0.smithi096.stderr: "squid" 2024-09-16T03:26:00.103 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:00.103 INFO:tasks.workunit.client.0.smithi096.stderr: "optional": [] 2024-09-16T03:26:00.103 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.103 INFO:tasks.workunit.client.0.smithi096.stderr: "mons": [ 2024-09-16T03:26:00.103 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.103 INFO:tasks.workunit.client.0.smithi096.stderr: "rank": 0, 2024-09-16T03:26:00.103 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "a", 2024-09-16T03:26:00.103 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:26:00.103 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:00.103 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.103 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:00.103 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:7302", 2024-09-16T03:26:00.103 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 0 2024-09-16T03:26:00.104 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:00.104 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:00.104 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.104 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:7302/0", 2024-09-16T03:26:00.104 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:7302/0", 2024-09-16T03:26:00.104 INFO:tasks.workunit.client.0.smithi096.stderr: "priority": 0, 2024-09-16T03:26:00.104 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 0, 2024-09-16T03:26:00.104 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_location": "{}" 2024-09-16T03:26:00.104 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:00.104 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:00.104 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.104 INFO:tasks.workunit.client.0.smithi096.stderr: "quorum": [ 2024-09-16T03:26:00.104 INFO:tasks.workunit.client.0.smithi096.stderr: 0 2024-09-16T03:26:00.105 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:00.105 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap": { 2024-09-16T03:26:00.105 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 83, 2024-09-16T03:26:00.105 INFO:tasks.workunit.client.0.smithi096.stderr: "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", 2024-09-16T03:26:00.105 INFO:tasks.workunit.client.0.smithi096.stderr: "created": "2024-09-16T03:22:46.906117+0000", 2024-09-16T03:26:00.105 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:25:57.328949+0000", 2024-09-16T03:26:00.105 INFO:tasks.workunit.client.0.smithi096.stderr: "last_up_change": "2024-09-16T03:25:08.513363+0000", 2024-09-16T03:26:00.105 INFO:tasks.workunit.client.0.smithi096.stderr: "last_in_change": "2024-09-16T03:25:09.839444+0000", 2024-09-16T03:26:00.105 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-16T03:26:00.105 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_num": 5799936, 2024-09-16T03:26:00.105 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_set": [ 2024-09-16T03:26:00.105 INFO:tasks.workunit.client.0.smithi096.stderr: "pglog_hardlimit", 2024-09-16T03:26:00.105 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snapdirs", 2024-09-16T03:26:00.105 INFO:tasks.workunit.client.0.smithi096.stderr: "recovery_deletes", 2024-09-16T03:26:00.106 INFO:tasks.workunit.client.0.smithi096.stderr: "sortbitwise" 2024-09-16T03:26:00.106 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:00.106 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_version": 7, 2024-09-16T03:26:00.106 INFO:tasks.workunit.client.0.smithi096.stderr: "full_ratio": 0.97000002861022949, 2024-09-16T03:26:00.106 INFO:tasks.workunit.client.0.smithi096.stderr: "backfillfull_ratio": 0.97000002861022949, 2024-09-16T03:26:00.106 INFO:tasks.workunit.client.0.smithi096.stderr: "nearfull_ratio": 0.85000002384185791, 2024-09-16T03:26:00.106 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_snapshot": "", 2024-09-16T03:26:00.106 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_max": 2, 2024-09-16T03:26:00.106 INFO:tasks.workunit.client.0.smithi096.stderr: "max_osd": 3, 2024-09-16T03:26:00.106 INFO:tasks.workunit.client.0.smithi096.stderr: "require_min_compat_client": "luminous", 2024-09-16T03:26:00.106 INFO:tasks.workunit.client.0.smithi096.stderr: "min_compat_client": "jewel", 2024-09-16T03:26:00.106 INFO:tasks.workunit.client.0.smithi096.stderr: "require_osd_release": "squid", 2024-09-16T03:26:00.106 INFO:tasks.workunit.client.0.smithi096.stderr: "allow_crimson": false, 2024-09-16T03:26:00.107 INFO:tasks.workunit.client.0.smithi096.stderr: "pools": [ 2024-09-16T03:26:00.107 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.107 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 1, 2024-09-16T03:26:00.107 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_name": "foo", 2024-09-16T03:26:00.107 INFO:tasks.workunit.client.0.smithi096.stderr: "create_time": "2024-09-16T03:24:44.525189+0000", 2024-09-16T03:26:00.107 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": 1, 2024-09-16T03:26:00.107 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_names": "hashpspool", 2024-09-16T03:26:00.107 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:26:00.107 INFO:tasks.workunit.client.0.smithi096.stderr: "size": 3, 2024-09-16T03:26:00.107 INFO:tasks.workunit.client.0.smithi096.stderr: "min_size": 2, 2024-09-16T03:26:00.107 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_rule": 0, 2024-09-16T03:26:00.107 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_count": 0, 2024-09-16T03:26:00.107 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_target": 0, 2024-09-16T03:26:00.107 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_barrier": 0, 2024-09-16T03:26:00.108 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-16T03:26:00.108 INFO:tasks.workunit.client.0.smithi096.stderr: "is_stretch_pool": false, 2024-09-16T03:26:00.108 INFO:tasks.workunit.client.0.smithi096.stderr: "object_hash": 2, 2024-09-16T03:26:00.108 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_autoscale_mode": "off", 2024-09-16T03:26:00.108 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num": 32, 2024-09-16T03:26:00.108 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num": 32, 2024-09-16T03:26:00.108 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num_target": 32, 2024-09-16T03:26:00.108 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_target": 32, 2024-09-16T03:26:00.108 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_pending": 32, 2024-09-16T03:26:00.108 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pg_merge_meta": { 2024-09-16T03:26:00.108 INFO:tasks.workunit.client.0.smithi096.stderr: "source_pgid": "0.0", 2024-09-16T03:26:00.108 INFO:tasks.workunit.client.0.smithi096.stderr: "ready_epoch": 0, 2024-09-16T03:26:00.108 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_started": 0, 2024-09-16T03:26:00.109 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": 0, 2024-09-16T03:26:00.109 INFO:tasks.workunit.client.0.smithi096.stderr: "source_version": "0'\''0", 2024-09-16T03:26:00.109 INFO:tasks.workunit.client.0.smithi096.stderr: "target_version": "0'\''0" 2024-09-16T03:26:00.109 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.109 INFO:tasks.workunit.client.0.smithi096.stderr: "last_change": "30", 2024-09-16T03:26:00.109 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend": "0", 2024-09-16T03:26:00.109 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_prenautilus": "0", 2024-09-16T03:26:00.109 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_preluminous": "0", 2024-09-16T03:26:00.109 INFO:tasks.workunit.client.0.smithi096.stderr: "auid": 0, 2024-09-16T03:26:00.109 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_mode": "selfmanaged", 2024-09-16T03:26:00.109 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_seq": 0, 2024-09-16T03:26:00.109 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_epoch": 0, 2024-09-16T03:26:00.109 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_snaps": [], 2024-09-16T03:26:00.109 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps": "[]", 2024-09-16T03:26:00.110 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_bytes": 0, 2024-09-16T03:26:00.110 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_objects": 0, 2024-09-16T03:26:00.110 INFO:tasks.workunit.client.0.smithi096.stderr: "tiers": [], 2024-09-16T03:26:00.110 INFO:tasks.workunit.client.0.smithi096.stderr: "tier_of": -1, 2024-09-16T03:26:00.110 INFO:tasks.workunit.client.0.smithi096.stderr: "read_tier": -1, 2024-09-16T03:26:00.110 INFO:tasks.workunit.client.0.smithi096.stderr: "write_tier": -1, 2024-09-16T03:26:00.110 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_mode": "none", 2024-09-16T03:26:00.110 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_bytes": 0, 2024-09-16T03:26:00.110 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_objects": 0, 2024-09-16T03:26:00.110 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_ratio_micro": 400000, 2024-09-16T03:26:00.110 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-16T03:26:00.110 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_full_ratio_micro": 800000, 2024-09-16T03:26:00.110 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_flush_age": 0, 2024-09-16T03:26:00.110 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_evict_age": 0, 2024-09-16T03:26:00.111 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profile": "", 2024-09-16T03:26:00.111 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_params": { 2024-09-16T03:26:00.111 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "none" 2024-09-16T03:26:00.111 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.111 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_period": 0, 2024-09-16T03:26:00.111 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_count": 0, 2024-09-16T03:26:00.111 INFO:tasks.workunit.client.0.smithi096.stderr: "use_gmt_hitset": true, 2024-09-16T03:26:00.111 INFO:tasks.workunit.client.0.smithi096.stderr: "min_read_recency_for_promote": 0, 2024-09-16T03:26:00.111 INFO:tasks.workunit.client.0.smithi096.stderr: "min_write_recency_for_promote": 0, 2024-09-16T03:26:00.111 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_grade_decay_rate": 0, 2024-09-16T03:26:00.111 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_search_last_n": 0, 2024-09-16T03:26:00.111 INFO:tasks.workunit.client.0.smithi096.stderr: "grade_table": [], 2024-09-16T03:26:00.111 INFO:tasks.workunit.client.0.smithi096.stderr: "stripe_width": 0, 2024-09-16T03:26:00.111 INFO:tasks.workunit.client.0.smithi096.stderr: "expected_num_objects": 0, 2024-09-16T03:26:00.111 INFO:tasks.workunit.client.0.smithi096.stderr: "fast_read": false, 2024-09-16T03:26:00.111 INFO:tasks.workunit.client.0.smithi096.stderr: "options": {}, 2024-09-16T03:26:00.112 INFO:tasks.workunit.client.0.smithi096.stderr: "application_metadata": {}, 2024-09-16T03:26:00.112 INFO:tasks.workunit.client.0.smithi096.stderr: "read_balance": { 2024-09-16T03:26:00.112 INFO:tasks.workunit.client.0.smithi096.stderr: "score_type": "Fair distribution", 2024-09-16T03:26:00.112 INFO:tasks.workunit.client.0.smithi096.stderr: "score_acting": 1.8700000047683716, 2024-09-16T03:26:00.112 INFO:tasks.workunit.client.0.smithi096.stderr: "score_stable": 1.8700000047683716, 2024-09-16T03:26:00.112 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_score": 0.67000001668930054, 2024-09-16T03:26:00.112 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_acting": 1.25, 2024-09-16T03:26:00.112 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_stable": 1.25, 2024-09-16T03:26:00.112 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity_weighted": 1, 2024-09-16T03:26:00.112 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity": 1, 2024-09-16T03:26:00.112 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity_weighted": 1 2024-09-16T03:26:00.112 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:00.112 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.112 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.112 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 2, 2024-09-16T03:26:00.113 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_name": "bar", 2024-09-16T03:26:00.113 INFO:tasks.workunit.client.0.smithi096.stderr: "create_time": "2024-09-16T03:24:46.226575+0000", 2024-09-16T03:26:00.113 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": 1, 2024-09-16T03:26:00.113 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_names": "hashpspool", 2024-09-16T03:26:00.113 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:26:00.113 INFO:tasks.workunit.client.0.smithi096.stderr: "size": 2, 2024-09-16T03:26:00.113 INFO:tasks.workunit.client.0.smithi096.stderr: "min_size": 1, 2024-09-16T03:26:00.113 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_rule": 0, 2024-09-16T03:26:00.113 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_count": 0, 2024-09-16T03:26:00.113 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_target": 0, 2024-09-16T03:26:00.113 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_barrier": 0, 2024-09-16T03:26:00.113 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-16T03:26:00.113 INFO:tasks.workunit.client.0.smithi096.stderr: "is_stretch_pool": false, 2024-09-16T03:26:00.113 INFO:tasks.workunit.client.0.smithi096.stderr: "object_hash": 2, 2024-09-16T03:26:00.113 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_autoscale_mode": "off", 2024-09-16T03:26:00.114 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num": 32, 2024-09-16T03:26:00.114 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num": 32, 2024-09-16T03:26:00.114 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num_target": 32, 2024-09-16T03:26:00.114 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_target": 32, 2024-09-16T03:26:00.114 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_pending": 32, 2024-09-16T03:26:00.114 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pg_merge_meta": { 2024-09-16T03:26:00.114 INFO:tasks.workunit.client.0.smithi096.stderr: "source_pgid": "0.0", 2024-09-16T03:26:00.114 INFO:tasks.workunit.client.0.smithi096.stderr: "ready_epoch": 0, 2024-09-16T03:26:00.114 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_started": 0, 2024-09-16T03:26:00.114 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": 0, 2024-09-16T03:26:00.114 INFO:tasks.workunit.client.0.smithi096.stderr: "source_version": "0'\''0", 2024-09-16T03:26:00.114 INFO:tasks.workunit.client.0.smithi096.stderr: "target_version": "0'\''0" 2024-09-16T03:26:00.115 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.115 INFO:tasks.workunit.client.0.smithi096.stderr: "last_change": "83", 2024-09-16T03:26:00.115 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend": "0", 2024-09-16T03:26:00.115 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_prenautilus": "0", 2024-09-16T03:26:00.115 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_preluminous": "0", 2024-09-16T03:26:00.115 INFO:tasks.workunit.client.0.smithi096.stderr: "auid": 0, 2024-09-16T03:26:00.115 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_mode": "selfmanaged", 2024-09-16T03:26:00.115 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_seq": 0, 2024-09-16T03:26:00.115 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_epoch": 0, 2024-09-16T03:26:00.115 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_snaps": [], 2024-09-16T03:26:00.115 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps": "[]", 2024-09-16T03:26:00.115 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_bytes": 0, 2024-09-16T03:26:00.115 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_objects": 0, 2024-09-16T03:26:00.116 INFO:tasks.workunit.client.0.smithi096.stderr: "tiers": [], 2024-09-16T03:26:00.116 INFO:tasks.workunit.client.0.smithi096.stderr: "tier_of": -1, 2024-09-16T03:26:00.116 INFO:tasks.workunit.client.0.smithi096.stderr: "read_tier": -1, 2024-09-16T03:26:00.116 INFO:tasks.workunit.client.0.smithi096.stderr: "write_tier": -1, 2024-09-16T03:26:00.116 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_mode": "none", 2024-09-16T03:26:00.116 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_bytes": 0, 2024-09-16T03:26:00.116 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_objects": 0, 2024-09-16T03:26:00.116 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_ratio_micro": 400000, 2024-09-16T03:26:00.116 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-16T03:26:00.116 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_full_ratio_micro": 800000, 2024-09-16T03:26:00.116 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_flush_age": 0, 2024-09-16T03:26:00.116 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_evict_age": 0, 2024-09-16T03:26:00.116 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profile": "", 2024-09-16T03:26:00.116 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_params": { 2024-09-16T03:26:00.117 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "none" 2024-09-16T03:26:00.117 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.117 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_period": 0, 2024-09-16T03:26:00.117 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_count": 0, 2024-09-16T03:26:00.117 INFO:tasks.workunit.client.0.smithi096.stderr: "use_gmt_hitset": true, 2024-09-16T03:26:00.117 INFO:tasks.workunit.client.0.smithi096.stderr: "min_read_recency_for_promote": 0, 2024-09-16T03:26:00.117 INFO:tasks.workunit.client.0.smithi096.stderr: "min_write_recency_for_promote": 0, 2024-09-16T03:26:00.117 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_grade_decay_rate": 0, 2024-09-16T03:26:00.117 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_search_last_n": 0, 2024-09-16T03:26:00.117 INFO:tasks.workunit.client.0.smithi096.stderr: "grade_table": [], 2024-09-16T03:26:00.117 INFO:tasks.workunit.client.0.smithi096.stderr: "stripe_width": 0, 2024-09-16T03:26:00.117 INFO:tasks.workunit.client.0.smithi096.stderr: "expected_num_objects": 0, 2024-09-16T03:26:00.117 INFO:tasks.workunit.client.0.smithi096.stderr: "fast_read": false, 2024-09-16T03:26:00.117 INFO:tasks.workunit.client.0.smithi096.stderr: "options": {}, 2024-09-16T03:26:00.117 INFO:tasks.workunit.client.0.smithi096.stderr: "application_metadata": {}, 2024-09-16T03:26:00.118 INFO:tasks.workunit.client.0.smithi096.stderr: "read_balance": { 2024-09-16T03:26:00.118 INFO:tasks.workunit.client.0.smithi096.stderr: "score_type": "Fair distribution", 2024-09-16T03:26:00.118 INFO:tasks.workunit.client.0.smithi096.stderr: "score_acting": 1.4900000095367432, 2024-09-16T03:26:00.118 INFO:tasks.workunit.client.0.smithi096.stderr: "score_stable": 1.4900000095367432, 2024-09-16T03:26:00.118 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_score": 0.67000001668930054, 2024-09-16T03:26:00.118 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_acting": 1, 2024-09-16T03:26:00.118 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_stable": 1, 2024-09-16T03:26:00.118 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity_weighted": 1, 2024-09-16T03:26:00.118 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity": 1, 2024-09-16T03:26:00.118 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity_weighted": 1 2024-09-16T03:26:00.118 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:00.118 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:00.118 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:00.118 INFO:tasks.workunit.client.0.smithi096.stderr: "osds": [ 2024-09-16T03:26:00.118 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.119 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:26:00.119 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6", 2024-09-16T03:26:00.119 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:26:00.119 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:26:00.119 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:26:00.119 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:26:00.119 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:26:00.119 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:26:00.119 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 5, 2024-09-16T03:26:00.119 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 81, 2024-09-16T03:26:00.119 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:26:00.119 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:26:00.119 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:26:00.119 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:00.120 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.120 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:00.120 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6802", 2024-09-16T03:26:00.120 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:26:00.120 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.120 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.120 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:00.120 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6803", 2024-09-16T03:26:00.120 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:26:00.120 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:00.120 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:00.120 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.121 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:26:00.121 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:00.121 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.121 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:00.121 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6804", 2024-09-16T03:26:00.121 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:26:00.121 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.121 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.121 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:00.121 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6805", 2024-09-16T03:26:00.121 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:26:00.121 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:00.121 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:00.122 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.122 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:26:00.122 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:00.122 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.122 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:00.122 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6808", 2024-09-16T03:26:00.122 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:26:00.122 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.122 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.122 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:00.122 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6809", 2024-09-16T03:26:00.122 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:26:00.122 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:00.122 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:00.123 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.123 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:26:00.123 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:00.123 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.123 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:00.123 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6806", 2024-09-16T03:26:00.123 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:26:00.123 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.123 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.123 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:00.123 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6807", 2024-09-16T03:26:00.123 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:26:00.123 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:00.123 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:00.124 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.124 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6803/3375787448", 2024-09-16T03:26:00.124 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6805/3375787448", 2024-09-16T03:26:00.124 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6809/3375787448", 2024-09-16T03:26:00.124 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6807/3375787448", 2024-09-16T03:26:00.124 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:26:00.124 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:26:00.124 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:26:00.124 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:00.124 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.124 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.124 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:26:00.124 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "74b26727-75c9-444d-8782-719e4197a382", 2024-09-16T03:26:00.124 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:26:00.124 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:26:00.125 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:26:00.125 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:26:00.125 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:26:00.125 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:26:00.125 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 10, 2024-09-16T03:26:00.125 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 81, 2024-09-16T03:26:00.125 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:26:00.125 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:26:00.125 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:26:00.125 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:00.125 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.125 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:00.125 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6810", 2024-09-16T03:26:00.125 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:26:00.126 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.126 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.126 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:00.126 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6811", 2024-09-16T03:26:00.126 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:26:00.126 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:00.126 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:00.126 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.126 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:26:00.126 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:00.126 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.126 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:00.126 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6812", 2024-09-16T03:26:00.126 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:26:00.126 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.127 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.127 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:00.127 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6813", 2024-09-16T03:26:00.127 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:26:00.127 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:00.127 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:00.127 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.127 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:26:00.127 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:00.127 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.127 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:00.127 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6816", 2024-09-16T03:26:00.127 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:26:00.127 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.128 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.128 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:00.128 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6817", 2024-09-16T03:26:00.128 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:26:00.128 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:00.128 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:00.128 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.128 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:26:00.128 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:00.128 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.128 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:00.128 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6814", 2024-09-16T03:26:00.128 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:26:00.128 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.129 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.129 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:00.129 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6815", 2024-09-16T03:26:00.129 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:26:00.129 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:00.129 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:00.129 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.129 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6811/3733255132", 2024-09-16T03:26:00.129 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6813/3733255132", 2024-09-16T03:26:00.129 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6817/3733255132", 2024-09-16T03:26:00.129 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6815/3733255132", 2024-09-16T03:26:00.129 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:26:00.129 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:26:00.130 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:26:00.130 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:00.130 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.130 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.130 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:26:00.130 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "143da3a7-dad9-4b1e-966b-76cf5bdd3c82", 2024-09-16T03:26:00.130 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 0, 2024-09-16T03:26:00.130 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 0, 2024-09-16T03:26:00.130 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 0, 2024-09-16T03:26:00.130 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:26:00.130 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:26:00.130 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:26:00.130 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 15, 2024-09-16T03:26:00.130 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 21, 2024-09-16T03:26:00.131 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 33, 2024-09-16T03:26:00.131 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:26:00.131 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:26:00.131 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:00.131 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.131 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:00.131 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6818", 2024-09-16T03:26:00.131 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:26:00.131 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.131 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.131 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:00.131 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6819", 2024-09-16T03:26:00.131 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:26:00.131 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:00.132 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:00.132 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.132 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:26:00.132 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:00.132 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.132 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:00.132 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6820", 2024-09-16T03:26:00.132 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:26:00.132 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.132 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.132 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:00.132 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6821", 2024-09-16T03:26:00.132 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:26:00.133 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:00.133 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:00.133 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.133 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:26:00.133 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:00.133 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.133 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:00.133 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6824", 2024-09-16T03:26:00.133 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:26:00.133 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.133 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.133 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:00.133 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6825", 2024-09-16T03:26:00.134 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:26:00.134 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:00.134 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:00.134 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.134 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:26:00.134 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:00.134 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.134 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:00.134 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6822", 2024-09-16T03:26:00.134 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:26:00.134 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.134 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.134 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:00.135 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6823", 2024-09-16T03:26:00.135 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:26:00.135 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:00.135 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:00.135 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.135 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6819/963814857", 2024-09-16T03:26:00.135 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6821/963814857", 2024-09-16T03:26:00.135 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6825/963814857", 2024-09-16T03:26:00.135 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6823/963814857", 2024-09-16T03:26:00.135 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:26:00.135 INFO:tasks.workunit.client.0.smithi096.stderr: "exists" 2024-09-16T03:26:00.136 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:00.136 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:00.136 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:00.136 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_xinfo": [ 2024-09-16T03:26:00.136 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.136 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:26:00.136 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:26:00.136 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:26:00.136 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:26:00.136 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:26:00.136 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:26:00.136 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:23:22.481942+0000", 2024-09-16T03:26:00.137 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:26:00.137 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.137 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.137 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:26:00.137 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:26:00.137 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:26:00.137 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:26:00.137 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:26:00.137 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:26:00.137 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:23:59.663703+0000", 2024-09-16T03:26:00.137 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:26:00.137 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.137 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.138 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:26:00.138 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:26:00.138 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:26:00.138 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:26:00.138 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:26:00.138 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 65536, 2024-09-16T03:26:00.138 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:24:37.320822+0000", 2024-09-16T03:26:00.138 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 32 2024-09-16T03:26:00.138 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:00.138 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:00.138 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap": [], 2024-09-16T03:26:00.138 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap_items": [], 2024-09-16T03:26:00.138 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap_primaries": [], 2024-09-16T03:26:00.139 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_temp": [], 2024-09-16T03:26:00.139 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_temp": [], 2024-09-16T03:26:00.139 INFO:tasks.workunit.client.0.smithi096.stderr: "blocklist": {}, 2024-09-16T03:26:00.139 INFO:tasks.workunit.client.0.smithi096.stderr: "range_blocklist": {}, 2024-09-16T03:26:00.139 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profiles": { 2024-09-16T03:26:00.139 INFO:tasks.workunit.client.0.smithi096.stderr: "default": { 2024-09-16T03:26:00.139 INFO:tasks.workunit.client.0.smithi096.stderr: "k": "2", 2024-09-16T03:26:00.139 INFO:tasks.workunit.client.0.smithi096.stderr: "m": "2", 2024-09-16T03:26:00.139 INFO:tasks.workunit.client.0.smithi096.stderr: "plugin": "jerasure", 2024-09-16T03:26:00.139 INFO:tasks.workunit.client.0.smithi096.stderr: "technique": "reed_sol_van" 2024-09-16T03:26:00.139 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:00.139 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.139 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps_queue": [], 2024-09-16T03:26:00.139 INFO:tasks.workunit.client.0.smithi096.stderr: "new_removed_snaps": [], 2024-09-16T03:26:00.140 INFO:tasks.workunit.client.0.smithi096.stderr: "new_purged_snaps": [], 2024-09-16T03:26:00.140 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_node_flags": {}, 2024-09-16T03:26:00.140 INFO:tasks.workunit.client.0.smithi096.stderr: "device_class_flags": {}, 2024-09-16T03:26:00.140 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode": { 2024-09-16T03:26:00.140 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode_enabled": false, 2024-09-16T03:26:00.140 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_bucket_count": 0, 2024-09-16T03:26:00.140 INFO:tasks.workunit.client.0.smithi096.stderr: "degraded_stretch_mode": 0, 2024-09-16T03:26:00.140 INFO:tasks.workunit.client.0.smithi096.stderr: "recovering_stretch_mode": 0, 2024-09-16T03:26:00.140 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode_bucket": 0 2024-09-16T03:26:00.140 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:00.140 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.140 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_metadata": [ 2024-09-16T03:26:00.140 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.141 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:26:00.141 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:26:00.141 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]", 2024-09-16T03:26:00.141 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:26:00.141 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:26:00.141 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:26:00.141 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:26:00.141 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:26:00.141 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:26:00.141 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:26:00.141 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:26:00.141 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:26:00.141 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:26:00.141 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:26:00.142 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/0/block", 2024-09-16T03:26:00.142 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:26:00.142 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:26:00.142 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:26:00.142 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:26:00.142 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:26:00.142 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:26:00.142 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:26:00.142 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:26:00.142 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:26:00.142 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:26:00.142 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:22:53.662571Z", 2024-09-16T03:26:00.142 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:26:00.143 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:26:00.143 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:26:00.143 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:26:00.143 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:26:00.143 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:26:00.143 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:26:00.143 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]", 2024-09-16T03:26:00.143 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:26:00.143 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]", 2024-09-16T03:26:00.143 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]", 2024-09-16T03:26:00.143 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:26:00.143 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:26:00.143 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:26:00.144 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:26:00.144 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:26:00.144 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:26:00.144 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:26:00.144 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:26:00.144 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:26:00.144 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/0", 2024-09-16T03:26:00.144 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:26:00.144 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:26:00.144 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:26:00.144 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.144 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.144 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:26:00.145 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:26:00.145 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]", 2024-09-16T03:26:00.145 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:26:00.145 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:26:00.145 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:26:00.145 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:26:00.145 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:26:00.145 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:26:00.145 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:26:00.145 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:26:00.145 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:26:00.145 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:26:00.145 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:26:00.145 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/1/block", 2024-09-16T03:26:00.145 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:26:00.146 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:26:00.146 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:26:00.146 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:26:00.146 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:26:00.146 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:26:00.146 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:26:00.146 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:26:00.146 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:26:00.146 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:26:00.146 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:23:30.129885Z", 2024-09-16T03:26:00.146 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:26:00.147 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:26:00.147 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:26:00.147 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:26:00.147 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:26:00.147 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:26:00.147 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:26:00.147 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]", 2024-09-16T03:26:00.147 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:26:00.147 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]", 2024-09-16T03:26:00.147 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]", 2024-09-16T03:26:00.147 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:26:00.147 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:26:00.147 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:26:00.148 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:26:00.148 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:26:00.148 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:26:00.148 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:26:00.148 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:26:00.148 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:26:00.148 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/1", 2024-09-16T03:26:00.148 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:26:00.148 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:26:00.148 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:26:00.148 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.148 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.148 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:26:00.149 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:26:00.149 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]", 2024-09-16T03:26:00.149 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:26:00.149 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:26:00.149 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:26:00.149 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:26:00.149 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:26:00.149 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:26:00.149 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:26:00.149 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:26:00.149 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:26:00.149 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:26:00.149 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:26:00.149 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/2/block", 2024-09-16T03:26:00.150 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:26:00.150 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:26:00.150 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:26:00.150 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:26:00.150 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:26:00.150 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:26:00.150 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:26:00.150 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:26:00.150 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:26:00.150 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:26:00.150 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:24:07.764502Z", 2024-09-16T03:26:00.150 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:26:00.150 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:26:00.150 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:26:00.151 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:26:00.151 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:26:00.151 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:26:00.151 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:26:00.151 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]", 2024-09-16T03:26:00.151 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:26:00.151 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]", 2024-09-16T03:26:00.151 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]", 2024-09-16T03:26:00.151 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:26:00.151 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:26:00.151 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:26:00.151 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:26:00.151 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:26:00.151 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:26:00.152 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:26:00.152 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:26:00.152 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:26:00.152 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/2", 2024-09-16T03:26:00.152 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:26:00.152 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:26:00.152 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:26:00.152 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:00.152 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:00.152 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_clean_epochs": { 2024-09-16T03:26:00.152 INFO:tasks.workunit.client.0.smithi096.stderr: "min_last_epoch_clean": 28, 2024-09-16T03:26:00.152 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": { 2024-09-16T03:26:00.152 INFO:tasks.workunit.client.0.smithi096.stderr: "per_pool": [ 2024-09-16T03:26:00.152 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.153 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 1, 2024-09-16T03:26:00.153 INFO:tasks.workunit.client.0.smithi096.stderr: "floor": 28 2024-09-16T03:26:00.153 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.153 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.153 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 2, 2024-09-16T03:26:00.153 INFO:tasks.workunit.client.0.smithi096.stderr: "floor": 28 2024-09-16T03:26:00.153 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:00.153 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:00.153 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.153 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_epochs": [ 2024-09-16T03:26:00.153 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.153 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:26:00.153 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 78 2024-09-16T03:26:00.154 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.154 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.154 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:26:00.154 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 80 2024-09-16T03:26:00.154 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:00.154 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:00.154 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.154 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_first_committed": 28, 2024-09-16T03:26:00.154 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_last_committed": 83, 2024-09-16T03:26:00.154 INFO:tasks.workunit.client.0.smithi096.stderr: "crushmap": { 2024-09-16T03:26:00.154 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": [ 2024-09-16T03:26:00.154 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.154 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:26:00.155 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.0", 2024-09-16T03:26:00.155 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:26:00.155 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.155 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.155 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:26:00.155 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.1", 2024-09-16T03:26:00.155 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:26:00.155 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.155 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.155 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:26:00.155 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.2", 2024-09-16T03:26:00.156 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:26:00.156 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:00.156 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:00.156 INFO:tasks.workunit.client.0.smithi096.stderr: "types": [ 2024-09-16T03:26:00.156 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.156 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 0, 2024-09-16T03:26:00.156 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd" 2024-09-16T03:26:00.156 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.156 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.156 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:26:00.156 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "host" 2024-09-16T03:26:00.156 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.156 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.157 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 2, 2024-09-16T03:26:00.157 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "chassis" 2024-09-16T03:26:00.157 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.157 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.157 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 3, 2024-09-16T03:26:00.157 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "rack" 2024-09-16T03:26:00.157 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.157 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.157 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 4, 2024-09-16T03:26:00.157 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "row" 2024-09-16T03:26:00.157 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.157 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.157 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 5, 2024-09-16T03:26:00.158 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "pdu" 2024-09-16T03:26:00.158 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.158 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.158 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 6, 2024-09-16T03:26:00.158 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "pod" 2024-09-16T03:26:00.158 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.158 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.158 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 7, 2024-09-16T03:26:00.158 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "room" 2024-09-16T03:26:00.158 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.158 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.158 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 8, 2024-09-16T03:26:00.158 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "datacenter" 2024-09-16T03:26:00.159 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.159 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.159 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 9, 2024-09-16T03:26:00.159 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "zone" 2024-09-16T03:26:00.159 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.159 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.159 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 10, 2024-09-16T03:26:00.159 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "region" 2024-09-16T03:26:00.159 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.159 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.159 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:26:00.159 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "root" 2024-09-16T03:26:00.159 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:00.159 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:00.160 INFO:tasks.workunit.client.0.smithi096.stderr: "buckets": [ 2024-09-16T03:26:00.160 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.160 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -1, 2024-09-16T03:26:00.160 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "default", 2024-09-16T03:26:00.160 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:26:00.160 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "root", 2024-09-16T03:26:00.160 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:26:00.160 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:26:00.160 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:26:00.160 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:26:00.160 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.160 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -3, 2024-09-16T03:26:00.160 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:26:00.161 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:26:00.161 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:00.161 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:00.161 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.161 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.161 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -2, 2024-09-16T03:26:00.161 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "default~hdd", 2024-09-16T03:26:00.161 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:26:00.161 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "root", 2024-09-16T03:26:00.161 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:26:00.161 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:26:00.161 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:26:00.161 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:26:00.161 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.162 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -4, 2024-09-16T03:26:00.162 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:26:00.162 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:26:00.162 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:00.162 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:00.162 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.162 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.162 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -3, 2024-09-16T03:26:00.162 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "smithi096", 2024-09-16T03:26:00.162 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:26:00.162 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "host", 2024-09-16T03:26:00.162 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:26:00.162 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:26:00.162 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:26:00.163 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:26:00.163 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.163 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:26:00.163 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:26:00.163 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:26:00.163 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.163 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.163 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:26:00.163 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:26:00.163 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 1 2024-09-16T03:26:00.163 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.163 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.163 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:26:00.163 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:26:00.164 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 2 2024-09-16T03:26:00.164 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:00.164 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:00.164 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.164 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.164 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -4, 2024-09-16T03:26:00.164 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "smithi096~hdd", 2024-09-16T03:26:00.164 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:26:00.164 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "host", 2024-09-16T03:26:00.164 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:26:00.164 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:26:00.164 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:26:00.164 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:26:00.164 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.165 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:26:00.165 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:26:00.165 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:26:00.165 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.165 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.165 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:26:00.165 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:26:00.165 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 1 2024-09-16T03:26:00.165 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.165 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.165 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:26:00.165 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:26:00.165 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 2 2024-09-16T03:26:00.165 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:00.165 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:00.166 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:00.166 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:00.166 INFO:tasks.workunit.client.0.smithi096.stderr: "rules": [ 2024-09-16T03:26:00.166 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.166 INFO:tasks.workunit.client.0.smithi096.stderr: "rule_id": 0, 2024-09-16T03:26:00.166 INFO:tasks.workunit.client.0.smithi096.stderr: "rule_name": "replicated_rule", 2024-09-16T03:26:00.166 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:26:00.166 INFO:tasks.workunit.client.0.smithi096.stderr: "steps": [ 2024-09-16T03:26:00.166 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.166 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "take", 2024-09-16T03:26:00.166 INFO:tasks.workunit.client.0.smithi096.stderr: "item": -1, 2024-09-16T03:26:00.166 INFO:tasks.workunit.client.0.smithi096.stderr: "item_name": "default" 2024-09-16T03:26:00.166 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.167 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.167 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "choose_firstn", 2024-09-16T03:26:00.167 INFO:tasks.workunit.client.0.smithi096.stderr: "num": 0, 2024-09-16T03:26:00.167 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "osd" 2024-09-16T03:26:00.167 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.167 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.167 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "emit" 2024-09-16T03:26:00.167 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:00.167 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:00.167 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:00.167 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:00.167 INFO:tasks.workunit.client.0.smithi096.stderr: "tunables": { 2024-09-16T03:26:00.167 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_local_tries": 0, 2024-09-16T03:26:00.167 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_local_fallback_tries": 0, 2024-09-16T03:26:00.168 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_total_tries": 50, 2024-09-16T03:26:00.168 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_descend_once": 1, 2024-09-16T03:26:00.168 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_vary_r": 1, 2024-09-16T03:26:00.168 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_stable": 1, 2024-09-16T03:26:00.168 INFO:tasks.workunit.client.0.smithi096.stderr: "msr_descents": 100, 2024-09-16T03:26:00.168 INFO:tasks.workunit.client.0.smithi096.stderr: "msr_collision_tries": 100, 2024-09-16T03:26:00.168 INFO:tasks.workunit.client.0.smithi096.stderr: "straw_calc_version": 1, 2024-09-16T03:26:00.168 INFO:tasks.workunit.client.0.smithi096.stderr: "allowed_bucket_algs": 54, 2024-09-16T03:26:00.168 INFO:tasks.workunit.client.0.smithi096.stderr: "profile": "jewel", 2024-09-16T03:26:00.168 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_tunables": 1, 2024-09-16T03:26:00.168 INFO:tasks.workunit.client.0.smithi096.stderr: "legacy_tunables": 0, 2024-09-16T03:26:00.168 INFO:tasks.workunit.client.0.smithi096.stderr: "minimum_required_version": "jewel", 2024-09-16T03:26:00.168 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables": 1, 2024-09-16T03:26:00.168 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables2": 1, 2024-09-16T03:26:00.169 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v2_rules": 0, 2024-09-16T03:26:00.169 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables3": 1, 2024-09-16T03:26:00.169 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v3_rules": 0, 2024-09-16T03:26:00.169 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v4_buckets": 1, 2024-09-16T03:26:00.169 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables5": 1, 2024-09-16T03:26:00.169 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v5_rules": 0, 2024-09-16T03:26:00.169 INFO:tasks.workunit.client.0.smithi096.stderr: "has_msr_rules": 0 2024-09-16T03:26:00.169 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.169 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_args": {} 2024-09-16T03:26:00.169 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.169 INFO:tasks.workunit.client.0.smithi096.stderr: "fsmap": { 2024-09-16T03:26:00.169 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 1, 2024-09-16T03:26:00.169 INFO:tasks.workunit.client.0.smithi096.stderr: "btime": "2024-09-16T03:22:46:882186+0000", 2024-09-16T03:26:00.169 INFO:tasks.workunit.client.0.smithi096.stderr: "default_fscid": -1, 2024-09-16T03:26:00.170 INFO:tasks.workunit.client.0.smithi096.stderr: "compat": { 2024-09-16T03:26:00.170 INFO:tasks.workunit.client.0.smithi096.stderr: "compat": {}, 2024-09-16T03:26:00.170 INFO:tasks.workunit.client.0.smithi096.stderr: "ro_compat": {}, 2024-09-16T03:26:00.170 INFO:tasks.workunit.client.0.smithi096.stderr: "incompat": { 2024-09-16T03:26:00.170 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_1": "base v0.20", 2024-09-16T03:26:00.170 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_2": "client writeable ranges", 2024-09-16T03:26:00.170 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_3": "default file layouts on dirs", 2024-09-16T03:26:00.170 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_4": "dir inode in separate object", 2024-09-16T03:26:00.170 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_5": "mds uses versioned encoding", 2024-09-16T03:26:00.170 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_6": "dirfrag is stored in omap", 2024-09-16T03:26:00.170 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_8": "no anchor table", 2024-09-16T03:26:00.170 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_9": "file layout v2", 2024-09-16T03:26:00.170 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_10": "snaprealm v2", 2024-09-16T03:26:00.170 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_11": "minor log segments", 2024-09-16T03:26:00.171 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_12": "quiesce subvolumes" 2024-09-16T03:26:00.171 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:00.171 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.171 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_flags": { 2024-09-16T03:26:00.171 INFO:tasks.workunit.client.0.smithi096.stderr: "enable_multiple": true, 2024-09-16T03:26:00.171 INFO:tasks.workunit.client.0.smithi096.stderr: "ever_enabled_multiple": true 2024-09-16T03:26:00.171 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.171 INFO:tasks.workunit.client.0.smithi096.stderr: "standbys": [], 2024-09-16T03:26:00.171 INFO:tasks.workunit.client.0.smithi096.stderr: "filesystems": [] 2024-09-16T03:26:00.171 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.171 INFO:tasks.workunit.client.0.smithi096.stderr: "mdsmap_first_committed": 1, 2024-09-16T03:26:00.171 INFO:tasks.workunit.client.0.smithi096.stderr: "mdsmap_last_committed": 1, 2024-09-16T03:26:00.171 INFO:tasks.workunit.client.0.smithi096.stderr: "auth": { 2024-09-16T03:26:00.171 INFO:tasks.workunit.client.0.smithi096.stderr: "first_committed": 1, 2024-09-16T03:26:00.172 INFO:tasks.workunit.client.0.smithi096.stderr: "last_committed": 5, 2024-09-16T03:26:00.172 INFO:tasks.workunit.client.0.smithi096.stderr: "num_secrets": 3 2024-09-16T03:26:00.172 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.172 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 64, 2024-09-16T03:26:00.172 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_active": 64, 2024-09-16T03:26:00.172 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_unknown": 0, 2024-09-16T03:26:00.172 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osd": 3, 2024-09-16T03:26:00.172 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_sum": { 2024-09-16T03:26:00.172 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:26:00.172 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:26:00.172 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:26:00.172 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:26:00.172 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:26:00.173 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:26:00.173 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:26:00.173 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:26:00.173 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:26:00.173 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:26:00.173 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:26:00.173 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:26:00.173 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:26:00.173 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:26:00.173 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:26:00.173 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:26:00.173 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:26:00.173 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:26:00.174 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:26:00.174 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:26:00.174 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:26:00.174 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:26:00.174 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:26:00.174 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:26:00.174 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:26:00.174 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:26:00.174 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:26:00.174 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:26:00.174 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:26:00.174 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:26:00.175 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:26:00.175 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:26:00.175 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:26:00.175 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:26:00.175 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:26:00.175 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:26:00.175 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:26:00.175 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:26:00.175 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:26:00.175 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:26:00.175 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:26:00.175 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.176 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:26:00.176 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:26:00.176 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:26:00.176 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:26:00.176 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:26:00.176 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:26:00.176 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:26:00.176 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:26:00.176 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:26:00.176 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:26:00.176 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:26:00.176 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.176 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:26:00.176 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:26:00.176 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 128, 2024-09-16T03:26:00.176 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 128, 2024-09-16T03:26:00.177 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 0 2024-09-16T03:26:00.177 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.177 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_sum": { 2024-09-16T03:26:00.177 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 0, 2024-09-16T03:26:00.177 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 0, 2024-09-16T03:26:00.177 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pgs": 128, 2024-09-16T03:26:00.177 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osds": 2, 2024-09-16T03:26:00.177 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_osds": 2, 2024-09-16T03:26:00.177 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_omap_osds": 2, 2024-09-16T03:26:00.177 INFO:tasks.workunit.client.0.smithi096.stderr: "kb": 209715200, 2024-09-16T03:26:00.177 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used": 54568, 2024-09-16T03:26:00.177 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_data": 856, 2024-09-16T03:26:00.177 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_omap": 3, 2024-09-16T03:26:00.177 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_meta": 53628, 2024-09-16T03:26:00.178 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_avail": 209660632, 2024-09-16T03:26:00.178 INFO:tasks.workunit.client.0.smithi096.stderr: "statfs": { 2024-09-16T03:26:00.178 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 214748364800, 2024-09-16T03:26:00.178 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 214692487168, 2024-09-16T03:26:00.178 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:26:00.178 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 876544, 2024-09-16T03:26:00.178 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 327566, 2024-09-16T03:26:00.178 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:26:00.178 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:26:00.178 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:26:00.178 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 3190, 2024-09-16T03:26:00.178 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 54915978 2024-09-16T03:26:00.178 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.178 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_peers": [], 2024-09-16T03:26:00.178 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_trim_queue_len": 0, 2024-09-16T03:26:00.178 INFO:tasks.workunit.client.0.smithi096.stderr: "num_snap_trimming": 0, 2024-09-16T03:26:00.179 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shards_repaired": 0, 2024-09-16T03:26:00.179 INFO:tasks.workunit.client.0.smithi096.stderr: "op_queue_age_hist": { 2024-09-16T03:26:00.179 INFO:tasks.workunit.client.0.smithi096.stderr: "histogram": [], 2024-09-16T03:26:00.179 INFO:tasks.workunit.client.0.smithi096.stderr: "upper_bound": 1 2024-09-16T03:26:00.179 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.179 INFO:tasks.workunit.client.0.smithi096.stderr: "perf_stat": { 2024-09-16T03:26:00.179 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ms": 219, 2024-09-16T03:26:00.179 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ms": 219, 2024-09-16T03:26:00.179 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ns": 219000000, 2024-09-16T03:26:00.179 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ns": 219000000 2024-09-16T03:26:00.179 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.179 INFO:tasks.workunit.client.0.smithi096.stderr: "alerts": [], 2024-09-16T03:26:00.179 INFO:tasks.workunit.client.0.smithi096.stderr: "network_ping_times": [] 2024-09-16T03:26:00.179 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.179 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_sum_by_class": { 2024-09-16T03:26:00.180 INFO:tasks.workunit.client.0.smithi096.stderr: "hdd": { 2024-09-16T03:26:00.180 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 0, 2024-09-16T03:26:00.180 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 0, 2024-09-16T03:26:00.180 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pgs": 128, 2024-09-16T03:26:00.180 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osds": 2, 2024-09-16T03:26:00.180 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_osds": 2, 2024-09-16T03:26:00.180 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_omap_osds": 2, 2024-09-16T03:26:00.180 INFO:tasks.workunit.client.0.smithi096.stderr: "kb": 209715200, 2024-09-16T03:26:00.180 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used": 54568, 2024-09-16T03:26:00.180 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_data": 856, 2024-09-16T03:26:00.180 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_omap": 3, 2024-09-16T03:26:00.180 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_meta": 53628, 2024-09-16T03:26:00.180 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_avail": 209660632, 2024-09-16T03:26:00.180 INFO:tasks.workunit.client.0.smithi096.stderr: "statfs": { 2024-09-16T03:26:00.181 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 214748364800, 2024-09-16T03:26:00.181 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 214692487168, 2024-09-16T03:26:00.181 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:26:00.181 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 876544, 2024-09-16T03:26:00.181 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 327566, 2024-09-16T03:26:00.181 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:26:00.181 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:26:00.181 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:26:00.181 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 3190, 2024-09-16T03:26:00.181 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 54915978 2024-09-16T03:26:00.181 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.181 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_peers": [], 2024-09-16T03:26:00.181 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_trim_queue_len": 0, 2024-09-16T03:26:00.181 INFO:tasks.workunit.client.0.smithi096.stderr: "num_snap_trimming": 0, 2024-09-16T03:26:00.181 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shards_repaired": 0, 2024-09-16T03:26:00.182 INFO:tasks.workunit.client.0.smithi096.stderr: "op_queue_age_hist": { 2024-09-16T03:26:00.182 INFO:tasks.workunit.client.0.smithi096.stderr: "histogram": [], 2024-09-16T03:26:00.182 INFO:tasks.workunit.client.0.smithi096.stderr: "upper_bound": 1 2024-09-16T03:26:00.182 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.182 INFO:tasks.workunit.client.0.smithi096.stderr: "perf_stat": { 2024-09-16T03:26:00.182 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ms": 219, 2024-09-16T03:26:00.182 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ms": 219, 2024-09-16T03:26:00.182 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ns": 219000000, 2024-09-16T03:26:00.182 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ns": 219000000 2024-09-16T03:26:00.182 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.182 INFO:tasks.workunit.client.0.smithi096.stderr: "alerts": [], 2024-09-16T03:26:00.182 INFO:tasks.workunit.client.0.smithi096.stderr: "network_ping_times": [] 2024-09-16T03:26:00.182 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:00.182 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.183 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_stats": [ 2024-09-16T03:26:00.183 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.183 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 2, 2024-09-16T03:26:00.183 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 32, 2024-09-16T03:26:00.183 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:26:00.183 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:26:00.183 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:26:00.183 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:26:00.183 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:26:00.183 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:26:00.183 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:26:00.183 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:26:00.183 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:26:00.184 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:26:00.184 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:26:00.184 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:26:00.184 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:26:00.184 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:26:00.184 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:26:00.184 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:26:00.184 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:26:00.184 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:26:00.184 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:26:00.184 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:26:00.184 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:26:00.185 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:26:00.185 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:26:00.185 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:26:00.185 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:26:00.185 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:26:00.185 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:26:00.185 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:26:00.185 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:26:00.185 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:26:00.185 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:26:00.185 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:26:00.185 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:26:00.185 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:26:00.186 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:26:00.186 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:26:00.186 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:26:00.186 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:26:00.186 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:26:00.186 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:26:00.186 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:26:00.186 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.186 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:26:00.186 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:26:00.186 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:26:00.186 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:26:00.186 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:26:00.186 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:26:00.187 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:26:00.187 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:26:00.187 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:26:00.187 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:26:00.187 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:26:00.187 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.187 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:26:00.187 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:26:00.187 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 64, 2024-09-16T03:26:00.187 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 64, 2024-09-16T03:26:00.187 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 3 2024-09-16T03:26:00.187 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.187 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.188 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 1, 2024-09-16T03:26:00.188 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 32, 2024-09-16T03:26:00.188 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:26:00.188 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:26:00.188 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:26:00.188 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:26:00.188 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:26:00.188 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:26:00.189 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:26:00.189 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:26:00.189 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:26:00.189 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:26:00.189 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:26:00.189 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:26:00.189 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:26:00.189 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:26:00.189 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:26:00.189 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:26:00.189 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:26:00.189 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:26:00.190 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:26:00.190 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:26:00.190 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:26:00.190 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:26:00.190 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:26:00.190 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:26:00.190 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:26:00.190 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:26:00.190 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:26:00.190 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:26:00.190 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:26:00.190 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:26:00.190 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:26:00.190 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:26:00.190 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:26:00.191 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:26:00.191 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:26:00.191 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:26:00.191 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:26:00.191 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:26:00.191 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:26:00.191 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:26:00.191 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:26:00.191 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.191 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:26:00.191 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:26:00.191 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:26:00.191 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:26:00.191 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:26:00.192 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:26:00.192 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:26:00.192 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:26:00.192 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:26:00.192 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:26:00.192 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:26:00.192 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.192 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:26:00.192 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:26:00.192 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 64, 2024-09-16T03:26:00.192 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 64, 2024-09-16T03:26:00.192 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 3 2024-09-16T03:26:00.192 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:00.192 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:00.193 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_stats": [ 2024-09-16T03:26:00.193 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.193 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:26:00.193 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 21474836517 2024-09-16T03:26:00.193 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.193 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.193 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:26:00.193 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 42949672989 2024-09-16T03:26:00.193 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.193 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.193 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:26:00.193 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 0 2024-09-16T03:26:00.193 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:00.193 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:00.194 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_by_state": [ 2024-09-16T03:26:00.194 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.194 INFO:tasks.workunit.client.0.smithi096.stderr: "state": "active+undersized", 2024-09-16T03:26:00.194 INFO:tasks.workunit.client.0.smithi096.stderr: "num": 64 2024-09-16T03:26:00.194 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:00.194 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:00.194 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_by_osd": [ 2024-09-16T03:26:00.194 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.194 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:26:00.194 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 0, 2024-09-16T03:26:00.194 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 0, 2024-09-16T03:26:00.194 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:26:00.194 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.194 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.194 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:26:00.195 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 28, 2024-09-16T03:26:00.195 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 64, 2024-09-16T03:26:00.195 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:26:00.195 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.195 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.195 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:26:00.195 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 36, 2024-09-16T03:26:00.195 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 64, 2024-09-16T03:26:00.195 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:26:00.195 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:00.195 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:00.195 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": [ 2024-09-16T03:26:00.195 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.195 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 1, 2024-09-16T03:26:00.196 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": {} 2024-09-16T03:26:00.196 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.196 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.196 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 2, 2024-09-16T03:26:00.196 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": {} 2024-09-16T03:26:00.196 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:00.196 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:00.196 INFO:tasks.workunit.client.0.smithi096.stderr: "servicemap": { 2024-09-16T03:26:00.196 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 5, 2024-09-16T03:26:00.196 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:25:38.422788+0000", 2024-09-16T03:26:00.196 INFO:tasks.workunit.client.0.smithi096.stderr: "services": {} 2024-09-16T03:26:00.196 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.196 INFO:tasks.workunit.client.0.smithi096.stderr: "mgrstat_first_committed": 79, 2024-09-16T03:26:00.196 INFO:tasks.workunit.client.0.smithi096.stderr: "mgrstat_last_committed": 85, 2024-09-16T03:26:00.196 INFO:tasks.workunit.client.0.smithi096.stderr: "logm_first_committed": 1, 2024-09-16T03:26:00.197 INFO:tasks.workunit.client.0.smithi096.stderr: "logm_last_committed": 377, 2024-09-16T03:26:00.197 INFO:tasks.workunit.client.0.smithi096.stderr: "paxos": { 2024-09-16T03:26:00.197 INFO:tasks.workunit.client.0.smithi096.stderr: "first_committed": 1, 2024-09-16T03:26:00.197 INFO:tasks.workunit.client.0.smithi096.stderr: "last_committed": 562, 2024-09-16T03:26:00.197 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pn": 0, 2024-09-16T03:26:00.197 INFO:tasks.workunit.client.0.smithi096.stderr: "accepted_pn": 0 2024-09-16T03:26:00.197 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:00.197 INFO:tasks.workunit.client.0.smithi096.stderr:}' 2024-09-16T03:26:00.201 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:57: check_lec_lower_than_pool: jq .osdmap_clean_epochs.min_last_epoch_clean 2024-09-16T03:26:00.201 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:57: check_lec_lower_than_pool: echo '{' '"cluster_fingerprint":' '"fda2fc64-07ed-4add-8224-2e527e11d427",' '"version":' '"19.3.0-4930-gfc3e0bff",' '"commit":' '"fc3e0bff7468fd55478adbae7f75508b749124b6",' '"timestamp":' '"2024-09-16T03:26:00.085015+0000",' '"tag":' '"",' '"health":' '{' '"status":' '"HEALTH_OK",' '"checks":' '{},' '"mutes":' '[]' '},' '"monmap_first_committed":' 1, '"monmap_last_committed":' 1, '"monmap":' '{' '"epoch":' 1, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"modified":' '"2024-09-16T03:22:45.872880Z",' '"created":' '"2024-09-16T03:22:45.872880Z",' '"min_mon_release":' 19, '"min_mon_release_name":' '"squid",' '"election_strategy":' 1, '"disallowed_leaders:' '":' '"",' '"stretch_mode":' false, '"tiebreaker_mon":' '"",' '"removed_ranks:' '":' '"",' '"features":' '{' '"persistent":' '[' '"kraken",' '"luminous",' '"mimic",' '"osdmap-prune",' '"nautilus",' '"octopus",' '"pacific",' '"elector-pinging",' '"quincy",' '"reef",' '"squid"' '],' '"optional":' '[]' '},' '"mons":' '[' '{' '"rank":' 0, '"name":' '"a",' '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:7302",' '"nonce":' 0 '}' ']' '},' '"addr":' '"127.0.0.1:7302/0",' '"public_addr":' '"127.0.0.1:7302/0",' '"priority":' 0, '"weight":' 0, '"crush_location":' '"{}"' '}' ']' '},' '"quorum":' '[' 0 '],' '"osdmap":' '{' '"epoch":' 83, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"created":' '"2024-09-16T03:22:46.906117+0000",' '"modified":' '"2024-09-16T03:25:57.328949+0000",' '"last_up_change":' '"2024-09-16T03:25:08.513363+0000",' '"last_in_change":' '"2024-09-16T03:25:09.839444+0000",' '"flags":' '"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit",' '"flags_num":' 5799936, '"flags_set":' '[' '"pglog_hardlimit",' '"purged_snapdirs",' '"recovery_deletes",' '"sortbitwise"' '],' '"crush_version":' 7, '"full_ratio":' 0.97000002861022949, '"backfillfull_ratio":' 0.97000002861022949, '"nearfull_ratio":' 0.85000002384185791, '"cluster_snapshot":' '"",' '"pool_max":' 2, '"max_osd":' 3, '"require_min_compat_client":' '"luminous",' '"min_compat_client":' '"jewel",' '"require_osd_release":' '"squid",' '"allow_crimson":' false, '"pools":' '[' '{' '"pool":' 1, '"pool_name":' '"foo",' '"create_time":' '"2024-09-16T03:24:44.525189+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"30",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.8700000047683716, '"score_stable":' 1.8700000047683716, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1.25, '"raw_score_stable":' 1.25, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '},' '{' '"pool":' 2, '"pool_name":' '"bar",' '"create_time":' '"2024-09-16T03:24:46.226575+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 2, '"min_size":' 1, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"83",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.4900000095367432, '"score_stable":' 1.4900000095367432, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1, '"raw_score_stable":' 1, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '}' '],' '"osds":' '[' '{' '"osd":' 0, '"uuid":' '"64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 5, '"up_thru":' 81, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6802",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6803",' '"nonce":' 3375787448 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6804",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6805",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6808",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6809",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6806",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6807",' '"nonce":' 3375787448 '}' ']' '},' '"public_addr":' '"127.0.0.1:6803/3375787448",' '"cluster_addr":' '"127.0.0.1:6805/3375787448",' '"heartbeat_back_addr":' '"127.0.0.1:6809/3375787448",' '"heartbeat_front_addr":' '"127.0.0.1:6807/3375787448",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 1, '"uuid":' '"74b26727-75c9-444d-8782-719e4197a382",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 10, '"up_thru":' 81, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6810",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6811",' '"nonce":' 3733255132 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6812",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6813",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6816",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6817",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6814",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6815",' '"nonce":' 3733255132 '}' ']' '},' '"public_addr":' '"127.0.0.1:6811/3733255132",' '"cluster_addr":' '"127.0.0.1:6813/3733255132",' '"heartbeat_back_addr":' '"127.0.0.1:6817/3733255132",' '"heartbeat_front_addr":' '"127.0.0.1:6815/3733255132",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 2, '"uuid":' '"143da3a7-dad9-4b1e-966b-76cf5bdd3c82",' '"up":' 0, '"in":' 0, '"weight":' 0, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 15, '"up_thru":' 21, '"down_at":' 33, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6818",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6819",' '"nonce":' 963814857 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6820",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6821",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6824",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6825",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6822",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6823",' '"nonce":' 963814857 '}' ']' '},' '"public_addr":' '"127.0.0.1:6819/963814857",' '"cluster_addr":' '"127.0.0.1:6821/963814857",' '"heartbeat_back_addr":' '"127.0.0.1:6825/963814857",' '"heartbeat_front_addr":' '"127.0.0.1:6823/963814857",' '"state":' '[' '"exists"' ']' '}' '],' '"osd_xinfo":' '[' '{' '"osd":' 0, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:22.481942+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 1, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:59.663703+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 2, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 65536, '"last_purged_snaps_scrub":' '"2024-09-16T03:24:37.320822+0000",' '"dead_epoch":' 32 '}' '],' '"pg_upmap":' '[],' '"pg_upmap_items":' '[],' '"pg_upmap_primaries":' '[],' '"pg_temp":' '[],' '"primary_temp":' '[],' '"blocklist":' '{},' '"range_blocklist":' '{},' '"erasure_code_profiles":' '{' '"default":' '{' '"k":' '"2",' '"m":' '"2",' '"plugin":' '"jerasure",' '"technique":' '"reed_sol_van"' '}' '},' '"removed_snaps_queue":' '[],' '"new_removed_snaps":' '[],' '"new_purged_snaps":' '[],' '"crush_node_flags":' '{},' '"device_class_flags":' '{},' '"stretch_mode":' '{' '"stretch_mode_enabled":' false, '"stretch_bucket_count":' 0, '"degraded_stretch_mode":' 0, '"recovering_stretch_mode":' 0, '"stretch_mode_bucket":' 0 '}' '},' '"osd_metadata":' '[' '{' '"id":' 0, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/0/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:22:53.662571Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]",' '"hb_front_addr":' '"[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/0",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 1, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/1/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:23:30.129885Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]",' '"hb_front_addr":' '"[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/1",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 2, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/2/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:24:07.764502Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]",' '"hb_front_addr":' '"[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/2",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '}' '],' '"osdmap_clean_epochs":' '{' '"min_last_epoch_clean":' 28, '"last_epoch_clean":' '{' '"per_pool":' '[' '{' '"poolid":' 1, '"floor":' 28 '},' '{' '"poolid":' 2, '"floor":' 28 '}' ']' '},' '"osd_epochs":' '[' '{' '"id":' 0, '"epoch":' 78 '},' '{' '"id":' 1, '"epoch":' 80 '}' ']' '},' '"osdmap_first_committed":' 28, '"osdmap_last_committed":' 83, '"crushmap":' '{' '"devices":' '[' '{' '"id":' 0, '"name":' '"osd.0",' '"class":' '"hdd"' '},' '{' '"id":' 1, '"name":' '"osd.1",' '"class":' '"hdd"' '},' '{' '"id":' 2, '"name":' '"osd.2",' '"class":' '"hdd"' '}' '],' '"types":' '[' '{' '"type_id":' 0, '"name":' '"osd"' '},' '{' '"type_id":' 1, '"name":' '"host"' '},' '{' '"type_id":' 2, '"name":' '"chassis"' '},' '{' '"type_id":' 3, '"name":' '"rack"' '},' '{' '"type_id":' 4, '"name":' '"row"' '},' '{' '"type_id":' 5, '"name":' '"pdu"' '},' '{' '"type_id":' 6, '"name":' '"pod"' '},' '{' '"type_id":' 7, '"name":' '"room"' '},' '{' '"type_id":' 8, '"name":' '"datacenter"' '},' '{' '"type_id":' 9, '"name":' '"zone"' '},' '{' '"type_id":' 10, '"name":' '"region"' '},' '{' '"type_id":' 11, '"name":' '"root"' '}' '],' '"buckets":' '[' '{' '"id":' -1, '"name":' '"default",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -3, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -2, '"name":' '"default~hdd",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -4, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -3, '"name":' '"smithi096",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '},' '{' '"id":' -4, '"name":' '"smithi096~hdd",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '}' '],' '"rules":' '[' '{' '"rule_id":' 0, '"rule_name":' '"replicated_rule",' '"type":' 1, '"steps":' '[' '{' '"op":' '"take",' '"item":' -1, '"item_name":' '"default"' '},' '{' '"op":' '"choose_firstn",' '"num":' 0, '"type":' '"osd"' '},' '{' '"op":' '"emit"' '}' ']' '}' '],' '"tunables":' '{' '"choose_local_tries":' 0, '"choose_local_fallback_tries":' 0, '"choose_total_tries":' 50, '"chooseleaf_descend_once":' 1, '"chooseleaf_vary_r":' 1, '"chooseleaf_stable":' 1, '"msr_descents":' 100, '"msr_collision_tries":' 100, '"straw_calc_version":' 1, '"allowed_bucket_algs":' 54, '"profile":' '"jewel",' '"optimal_tunables":' 1, '"legacy_tunables":' 0, '"minimum_required_version":' '"jewel",' '"require_feature_tunables":' 1, '"require_feature_tunables2":' 1, '"has_v2_rules":' 0, '"require_feature_tunables3":' 1, '"has_v3_rules":' 0, '"has_v4_buckets":' 1, '"require_feature_tunables5":' 1, '"has_v5_rules":' 0, '"has_msr_rules":' 0 '},' '"choose_args":' '{}' '},' '"fsmap":' '{' '"epoch":' 1, '"btime":' '"2024-09-16T03:22:46:882186+0000",' '"default_fscid":' -1, '"compat":' '{' '"compat":' '{},' '"ro_compat":' '{},' '"incompat":' '{' '"feature_1":' '"base' 'v0.20",' '"feature_2":' '"client' writeable 'ranges",' '"feature_3":' '"default' file layouts on 'dirs",' '"feature_4":' '"dir' inode in separate 'object",' '"feature_5":' '"mds' uses versioned 'encoding",' '"feature_6":' '"dirfrag' is stored in 'omap",' '"feature_8":' '"no' anchor 'table",' '"feature_9":' '"file' layout 'v2",' '"feature_10":' '"snaprealm' 'v2",' '"feature_11":' '"minor' log 'segments",' '"feature_12":' '"quiesce' 'subvolumes"' '}' '},' '"feature_flags":' '{' '"enable_multiple":' true, '"ever_enabled_multiple":' true '},' '"standbys":' '[],' '"filesystems":' '[]' '},' '"mdsmap_first_committed":' 1, '"mdsmap_last_committed":' 1, '"auth":' '{' '"first_committed":' 1, '"last_committed":' 5, '"num_secrets":' 3 '},' '"num_pg":' 64, '"num_pg_active":' 64, '"num_pg_unknown":' 0, '"num_osd":' 3, '"pool_sum":' '{' '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 128, '"acting":' 128, '"num_store_stats":' 0 '},' '"osd_sum":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54568, '"kb_used_data":' 856, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660632, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692487168, '"internally_reserved":' 0, '"allocated":' 876544, '"data_stored":' 327566, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 219, '"apply_latency_ms":' 219, '"commit_latency_ns":' 219000000, '"apply_latency_ns":' 219000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '},' '"osd_sum_by_class":' '{' '"hdd":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54568, '"kb_used_data":' 856, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660632, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692487168, '"internally_reserved":' 0, '"allocated":' 876544, '"data_stored":' 327566, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 219, '"apply_latency_ms":' 219, '"commit_latency_ns":' 219000000, '"apply_latency_ns":' 219000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '}' '},' '"pool_stats":' '[' '{' '"poolid":' 2, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '},' '{' '"poolid":' 1, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '}' '],' '"osd_stats":' '[' '{' '"osd":' 0, '"seq":' 21474836517 '},' '{' '"osd":' 1, '"seq":' 42949672989 '},' '{' '"osd":' 2, '"seq":' 0 '}' '],' '"num_pg_by_state":' '[' '{' '"state":' '"active+undersized",' '"num":' 64 '}' '],' '"num_pg_by_osd":' '[' '{' '"osd":' 2, '"num_primary_pg":' 0, '"num_acting_pg":' 0, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 0, '"num_primary_pg":' 28, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 1, '"num_primary_pg":' 36, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '}' '],' '"purged_snaps":' '[' '{' '"pool":' 1, '"purged_snaps":' '{}' '},' '{' '"pool":' 2, '"purged_snaps":' '{}' '}' '],' '"servicemap":' '{' '"epoch":' 5, '"modified":' '"2024-09-16T03:25:38.422788+0000",' '"services":' '{}' '},' '"mgrstat_first_committed":' 79, '"mgrstat_last_committed":' 85, '"logm_first_committed":' 1, '"logm_last_committed":' 377, '"paxos":' '{' '"first_committed":' 1, '"last_committed":' 562, '"last_pn":' 0, '"accepted_pn":' 0 '}' '}' 2024-09-16T03:26:00.201 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:57: check_lec_lower_than_pool: lec=28 2024-09-16T03:26:00.201 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:62: check_lec_lower_than_pool: floor=($(echo $report | jq ".osdmap_clean_epochs.last_epoch_clean.per_pool[] |" " select(.poolid == $pool_id) | .floor")) 2024-09-16T03:26:00.201 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:62: check_lec_lower_than_pool: jq '.osdmap_clean_epochs.last_epoch_clean.per_pool[] |' ' select(.poolid == 2) | .floor' 2024-09-16T03:26:00.201 INFO:tasks.workunit.client.0.smithi096.stderr:jq: error: syntax error, unexpected $end (Unix shell quoting issues?) at , line 1: 2024-09-16T03:26:00.201 INFO:tasks.workunit.client.0.smithi096.stderr:.osdmap_clean_epochs.last_epoch_clean.per_pool[] | 2024-09-16T03:26:00.201 INFO:tasks.workunit.client.0.smithi096.stderr:jq: 1 compile error 2024-09-16T03:26:00.202 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:62: check_lec_lower_than_pool: echo '{' '"cluster_fingerprint":' '"fda2fc64-07ed-4add-8224-2e527e11d427",' '"version":' '"19.3.0-4930-gfc3e0bff",' '"commit":' '"fc3e0bff7468fd55478adbae7f75508b749124b6",' '"timestamp":' '"2024-09-16T03:26:00.085015+0000",' '"tag":' '"",' '"health":' '{' '"status":' '"HEALTH_OK",' '"checks":' '{},' '"mutes":' '[]' '},' '"monmap_first_committed":' 1, '"monmap_last_committed":' 1, '"monmap":' '{' '"epoch":' 1, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"modified":' '"2024-09-16T03:22:45.872880Z",' '"created":' '"2024-09-16T03:22:45.872880Z",' '"min_mon_release":' 19, '"min_mon_release_name":' '"squid",' '"election_strategy":' 1, '"disallowed_leaders:' '":' '"",' '"stretch_mode":' false, '"tiebreaker_mon":' '"",' '"removed_ranks:' '":' '"",' '"features":' '{' '"persistent":' '[' '"kraken",' '"luminous",' '"mimic",' '"osdmap-prune",' '"nautilus",' '"octopus",' '"pacific",' '"elector-pinging",' '"quincy",' '"reef",' '"squid"' '],' '"optional":' '[]' '},' '"mons":' '[' '{' '"rank":' 0, '"name":' '"a",' '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:7302",' '"nonce":' 0 '}' ']' '},' '"addr":' '"127.0.0.1:7302/0",' '"public_addr":' '"127.0.0.1:7302/0",' '"priority":' 0, '"weight":' 0, '"crush_location":' '"{}"' '}' ']' '},' '"quorum":' '[' 0 '],' '"osdmap":' '{' '"epoch":' 83, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"created":' '"2024-09-16T03:22:46.906117+0000",' '"modified":' '"2024-09-16T03:25:57.328949+0000",' '"last_up_change":' '"2024-09-16T03:25:08.513363+0000",' '"last_in_change":' '"2024-09-16T03:25:09.839444+0000",' '"flags":' '"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit",' '"flags_num":' 5799936, '"flags_set":' '[' '"pglog_hardlimit",' '"purged_snapdirs",' '"recovery_deletes",' '"sortbitwise"' '],' '"crush_version":' 7, '"full_ratio":' 0.97000002861022949, '"backfillfull_ratio":' 0.97000002861022949, '"nearfull_ratio":' 0.85000002384185791, '"cluster_snapshot":' '"",' '"pool_max":' 2, '"max_osd":' 3, '"require_min_compat_client":' '"luminous",' '"min_compat_client":' '"jewel",' '"require_osd_release":' '"squid",' '"allow_crimson":' false, '"pools":' '[' '{' '"pool":' 1, '"pool_name":' '"foo",' '"create_time":' '"2024-09-16T03:24:44.525189+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"30",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.8700000047683716, '"score_stable":' 1.8700000047683716, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1.25, '"raw_score_stable":' 1.25, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '},' '{' '"pool":' 2, '"pool_name":' '"bar",' '"create_time":' '"2024-09-16T03:24:46.226575+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 2, '"min_size":' 1, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"83",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.4900000095367432, '"score_stable":' 1.4900000095367432, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1, '"raw_score_stable":' 1, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '}' '],' '"osds":' '[' '{' '"osd":' 0, '"uuid":' '"64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 5, '"up_thru":' 81, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6802",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6803",' '"nonce":' 3375787448 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6804",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6805",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6808",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6809",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6806",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6807",' '"nonce":' 3375787448 '}' ']' '},' '"public_addr":' '"127.0.0.1:6803/3375787448",' '"cluster_addr":' '"127.0.0.1:6805/3375787448",' '"heartbeat_back_addr":' '"127.0.0.1:6809/3375787448",' '"heartbeat_front_addr":' '"127.0.0.1:6807/3375787448",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 1, '"uuid":' '"74b26727-75c9-444d-8782-719e4197a382",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 10, '"up_thru":' 81, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6810",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6811",' '"nonce":' 3733255132 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6812",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6813",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6816",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6817",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6814",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6815",' '"nonce":' 3733255132 '}' ']' '},' '"public_addr":' '"127.0.0.1:6811/3733255132",' '"cluster_addr":' '"127.0.0.1:6813/3733255132",' '"heartbeat_back_addr":' '"127.0.0.1:6817/3733255132",' '"heartbeat_front_addr":' '"127.0.0.1:6815/3733255132",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 2, '"uuid":' '"143da3a7-dad9-4b1e-966b-76cf5bdd3c82",' '"up":' 0, '"in":' 0, '"weight":' 0, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 15, '"up_thru":' 21, '"down_at":' 33, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6818",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6819",' '"nonce":' 963814857 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6820",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6821",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6824",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6825",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6822",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6823",' '"nonce":' 963814857 '}' ']' '},' '"public_addr":' '"127.0.0.1:6819/963814857",' '"cluster_addr":' '"127.0.0.1:6821/963814857",' '"heartbeat_back_addr":' '"127.0.0.1:6825/963814857",' '"heartbeat_front_addr":' '"127.0.0.1:6823/963814857",' '"state":' '[' '"exists"' ']' '}' '],' '"osd_xinfo":' '[' '{' '"osd":' 0, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:22.481942+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 1, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:59.663703+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 2, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 65536, '"last_purged_snaps_scrub":' '"2024-09-16T03:24:37.320822+0000",' '"dead_epoch":' 32 '}' '],' '"pg_upmap":' '[],' '"pg_upmap_items":' '[],' '"pg_upmap_primaries":' '[],' '"pg_temp":' '[],' '"primary_temp":' '[],' '"blocklist":' '{},' '"range_blocklist":' '{},' '"erasure_code_profiles":' '{' '"default":' '{' '"k":' '"2",' '"m":' '"2",' '"plugin":' '"jerasure",' '"technique":' '"reed_sol_van"' '}' '},' '"removed_snaps_queue":' '[],' '"new_removed_snaps":' '[],' '"new_purged_snaps":' '[],' '"crush_node_flags":' '{},' '"device_class_flags":' '{},' '"stretch_mode":' '{' '"stretch_mode_enabled":' false, '"stretch_bucket_count":' 0, '"degraded_stretch_mode":' 0, '"recovering_stretch_mode":' 0, '"stretch_mode_bucket":' 0 '}' '},' '"osd_metadata":' '[' '{' '"id":' 0, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/0/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:22:53.662571Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]",' '"hb_front_addr":' '"[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/0",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 1, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/1/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:23:30.129885Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]",' '"hb_front_addr":' '"[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/1",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 2, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/2/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:24:07.764502Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]",' '"hb_front_addr":' '"[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/2",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '}' '],' '"osdmap_clean_epochs":' '{' '"min_last_epoch_clean":' 28, '"last_epoch_clean":' '{' '"per_pool":' '[' '{' '"poolid":' 1, '"floor":' 28 '},' '{' '"poolid":' 2, '"floor":' 28 '}' ']' '},' '"osd_epochs":' '[' '{' '"id":' 0, '"epoch":' 78 '},' '{' '"id":' 1, '"epoch":' 80 '}' ']' '},' '"osdmap_first_committed":' 28, '"osdmap_last_committed":' 83, '"crushmap":' '{' '"devices":' '[' '{' '"id":' 0, '"name":' '"osd.0",' '"class":' '"hdd"' '},' '{' '"id":' 1, '"name":' '"osd.1",' '"class":' '"hdd"' '},' '{' '"id":' 2, '"name":' '"osd.2",' '"class":' '"hdd"' '}' '],' '"types":' '[' '{' '"type_id":' 0, '"name":' '"osd"' '},' '{' '"type_id":' 1, '"name":' '"host"' '},' '{' '"type_id":' 2, '"name":' '"chassis"' '},' '{' '"type_id":' 3, '"name":' '"rack"' '},' '{' '"type_id":' 4, '"name":' '"row"' '},' '{' '"type_id":' 5, '"name":' '"pdu"' '},' '{' '"type_id":' 6, '"name":' '"pod"' '},' '{' '"type_id":' 7, '"name":' '"room"' '},' '{' '"type_id":' 8, '"name":' '"datacenter"' '},' '{' '"type_id":' 9, '"name":' '"zone"' '},' '{' '"type_id":' 10, '"name":' '"region"' '},' '{' '"type_id":' 11, '"name":' '"root"' '}' '],' '"buckets":' '[' '{' '"id":' -1, '"name":' '"default",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -3, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -2, '"name":' '"default~hdd",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -4, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -3, '"name":' '"smithi096",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '},' '{' '"id":' -4, '"name":' '"smithi096~hdd",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '}' '],' '"rules":' '[' '{' '"rule_id":' 0, '"rule_name":' '"replicated_rule",' '"type":' 1, '"steps":' '[' '{' '"op":' '"take",' '"item":' -1, '"item_name":' '"default"' '},' '{' '"op":' '"choose_firstn",' '"num":' 0, '"type":' '"osd"' '},' '{' '"op":' '"emit"' '}' ']' '}' '],' '"tunables":' '{' '"choose_local_tries":' 0, '"choose_local_fallback_tries":' 0, '"choose_total_tries":' 50, '"chooseleaf_descend_once":' 1, '"chooseleaf_vary_r":' 1, '"chooseleaf_stable":' 1, '"msr_descents":' 100, '"msr_collision_tries":' 100, '"straw_calc_version":' 1, '"allowed_bucket_algs":' 54, '"profile":' '"jewel",' '"optimal_tunables":' 1, '"legacy_tunables":' 0, '"minimum_required_version":' '"jewel",' '"require_feature_tunables":' 1, '"require_feature_tunables2":' 1, '"has_v2_rules":' 0, '"require_feature_tunables3":' 1, '"has_v3_rules":' 0, '"has_v4_buckets":' 1, '"require_feature_tunables5":' 1, '"has_v5_rules":' 0, '"has_msr_rules":' 0 '},' '"choose_args":' '{}' '},' '"fsmap":' '{' '"epoch":' 1, '"btime":' '"2024-09-16T03:22:46:882186+0000",' '"default_fscid":' -1, '"compat":' '{' '"compat":' '{},' '"ro_compat":' '{},' '"incompat":' '{' '"feature_1":' '"base' 'v0.20",' '"feature_2":' '"client' writeable 'ranges",' '"feature_3":' '"default' file layouts on 'dirs",' '"feature_4":' '"dir' inode in separate 'object",' '"feature_5":' '"mds' uses versioned 'encoding",' '"feature_6":' '"dirfrag' is stored in 'omap",' '"feature_8":' '"no' anchor 'table",' '"feature_9":' '"file' layout 'v2",' '"feature_10":' '"snaprealm' 'v2",' '"feature_11":' '"minor' log 'segments",' '"feature_12":' '"quiesce' 'subvolumes"' '}' '},' '"feature_flags":' '{' '"enable_multiple":' true, '"ever_enabled_multiple":' true '},' '"standbys":' '[],' '"filesystems":' '[]' '},' '"mdsmap_first_committed":' 1, '"mdsmap_last_committed":' 1, '"auth":' '{' '"first_committed":' 1, '"last_committed":' 5, '"num_secrets":' 3 '},' '"num_pg":' 64, '"num_pg_active":' 64, '"num_pg_unknown":' 0, '"num_osd":' 3, '"pool_sum":' '{' '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 128, '"acting":' 128, '"num_store_stats":' 0 '},' '"osd_sum":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54568, '"kb_used_data":' 856, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660632, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692487168, '"internally_reserved":' 0, '"allocated":' 876544, '"data_stored":' 327566, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 219, '"apply_latency_ms":' 219, '"commit_latency_ns":' 219000000, '"apply_latency_ns":' 219000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '},' '"osd_sum_by_class":' '{' '"hdd":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54568, '"kb_used_data":' 856, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660632, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692487168, '"internally_reserved":' 0, '"allocated":' 876544, '"data_stored":' 327566, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 219, '"apply_latency_ms":' 219, '"commit_latency_ns":' 219000000, '"apply_latency_ns":' 219000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '}' '},' '"pool_stats":' '[' '{' '"poolid":' 2, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '},' '{' '"poolid":' 1, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '}' '],' '"osd_stats":' '[' '{' '"osd":' 0, '"seq":' 21474836517 '},' '{' '"osd":' 1, '"seq":' 42949672989 '},' '{' '"osd":' 2, '"seq":' 0 '}' '],' '"num_pg_by_state":' '[' '{' '"state":' '"active+undersized",' '"num":' 64 '}' '],' '"num_pg_by_osd":' '[' '{' '"osd":' 2, '"num_primary_pg":' 0, '"num_acting_pg":' 0, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 0, '"num_primary_pg":' 28, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 1, '"num_primary_pg":' 36, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '}' '],' '"purged_snaps":' '[' '{' '"pool":' 1, '"purged_snaps":' '{}' '},' '{' '"pool":' 2, '"purged_snaps":' '{}' '}' '],' '"servicemap":' '{' '"epoch":' 5, '"modified":' '"2024-09-16T03:25:38.422788+0000",' '"services":' '{}' '},' '"mgrstat_first_committed":' 79, '"mgrstat_last_committed":' 85, '"logm_first_committed":' 1, '"logm_last_committed":' 377, '"paxos":' '{' '"first_committed":' 1, '"last_committed":' 562, '"last_pn":' 0, '"accepted_pn":' 0 '}' '}' 2024-09-16T03:26:00.202 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:64: check_lec_lower_than_pool: [[ 28 -lt '' ]] 2024-09-16T03:26:00.202 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:64: check_lec_lower_than_pool: echo '{' '"cluster_fingerprint":' '"fda2fc64-07ed-4add-8224-2e527e11d427",' '"version":' '"19.3.0-4930-gfc3e0bff",' '"commit":' '"fc3e0bff7468fd55478adbae7f75508b749124b6",' '"timestamp":' '"2024-09-16T03:26:00.085015+0000",' '"tag":' '"",' '"health":' '{' '"status":' '"HEALTH_OK",' '"checks":' '{},' '"mutes":' '[]' '},' '"monmap_first_committed":' 1, '"monmap_last_committed":' 1, '"monmap":' '{' '"epoch":' 1, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"modified":' '"2024-09-16T03:22:45.872880Z",' '"created":' '"2024-09-16T03:22:45.872880Z",' '"min_mon_release":' 19, '"min_mon_release_name":' '"squid",' '"election_strategy":' 1, '"disallowed_leaders:' '":' '"",' '"stretch_mode":' false, '"tiebreaker_mon":' '"",' '"removed_ranks:' '":' '"",' '"features":' '{' '"persistent":' '[' '"kraken",' '"luminous",' '"mimic",' '"osdmap-prune",' '"nautilus",' '"octopus",' '"pacific",' '"elector-pinging",' '"quincy",' '"reef",' '"squid"' '],' '"optional":' '[]' '},' '"mons":' '[' '{' '"rank":' 0, '"name":' '"a",' '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:7302",' '"nonce":' 0 '}' ']' '},' '"addr":' '"127.0.0.1:7302/0",' '"public_addr":' '"127.0.0.1:7302/0",' '"priority":' 0, '"weight":' 0, '"crush_location":' '"{}"' '}' ']' '},' '"quorum":' '[' 0 '],' '"osdmap":' '{' '"epoch":' 83, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"created":' '"2024-09-16T03:22:46.906117+0000",' '"modified":' '"2024-09-16T03:25:57.328949+0000",' '"last_up_change":' '"2024-09-16T03:25:08.513363+0000",' '"last_in_change":' '"2024-09-16T03:25:09.839444+0000",' '"flags":' '"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit",' '"flags_num":' 5799936, '"flags_set":' '[' '"pglog_hardlimit",' '"purged_snapdirs",' '"recovery_deletes",' '"sortbitwise"' '],' '"crush_version":' 7, '"full_ratio":' 0.97000002861022949, '"backfillfull_ratio":' 0.97000002861022949, '"nearfull_ratio":' 0.85000002384185791, '"cluster_snapshot":' '"",' '"pool_max":' 2, '"max_osd":' 3, '"require_min_compat_client":' '"luminous",' '"min_compat_client":' '"jewel",' '"require_osd_release":' '"squid",' '"allow_crimson":' false, '"pools":' '[' '{' '"pool":' 1, '"pool_name":' '"foo",' '"create_time":' '"2024-09-16T03:24:44.525189+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"30",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.8700000047683716, '"score_stable":' 1.8700000047683716, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1.25, '"raw_score_stable":' 1.25, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '},' '{' '"pool":' 2, '"pool_name":' '"bar",' '"create_time":' '"2024-09-16T03:24:46.226575+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 2, '"min_size":' 1, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"83",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.4900000095367432, '"score_stable":' 1.4900000095367432, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1, '"raw_score_stable":' 1, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '}' '],' '"osds":' '[' '{' '"osd":' 0, '"uuid":' '"64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 5, '"up_thru":' 81, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6802",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6803",' '"nonce":' 3375787448 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6804",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6805",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6808",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6809",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6806",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6807",' '"nonce":' 3375787448 '}' ']' '},' '"public_addr":' '"127.0.0.1:6803/3375787448",' '"cluster_addr":' '"127.0.0.1:6805/3375787448",' '"heartbeat_back_addr":' '"127.0.0.1:6809/3375787448",' '"heartbeat_front_addr":' '"127.0.0.1:6807/3375787448",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 1, '"uuid":' '"74b26727-75c9-444d-8782-719e4197a382",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 10, '"up_thru":' 81, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6810",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6811",' '"nonce":' 3733255132 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6812",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6813",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6816",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6817",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6814",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6815",' '"nonce":' 3733255132 '}' ']' '},' '"public_addr":' '"127.0.0.1:6811/3733255132",' '"cluster_addr":' '"127.0.0.1:6813/3733255132",' '"heartbeat_back_addr":' '"127.0.0.1:6817/3733255132",' '"heartbeat_front_addr":' '"127.0.0.1:6815/3733255132",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 2, '"uuid":' '"143da3a7-dad9-4b1e-966b-76cf5bdd3c82",' '"up":' 0, '"in":' 0, '"weight":' 0, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 15, '"up_thru":' 21, '"down_at":' 33, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6818",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6819",' '"nonce":' 963814857 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6820",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6821",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6824",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6825",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6822",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6823",' '"nonce":' 963814857 '}' ']' '},' '"public_addr":' '"127.0.0.1:6819/963814857",' '"cluster_addr":' '"127.0.0.1:6821/963814857",' '"heartbeat_back_addr":' '"127.0.0.1:6825/963814857",' '"heartbeat_front_addr":' '"127.0.0.1:6823/963814857",' '"state":' '[' '"exists"' ']' '}' '],' '"osd_xinfo":' '[' '{' '"osd":' 0, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:22.481942+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 1, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:59.663703+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 2, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 65536, '"last_purged_snaps_scrub":' '"2024-09-16T03:24:37.320822+0000",' '"dead_epoch":' 32 '}' '],' '"pg_upmap":' '[],' '"pg_upmap_items":' '[],' '"pg_upmap_primaries":' '[],' '"pg_temp":' '[],' '"primary_temp":' '[],' '"blocklist":' '{},' '"range_blocklist":' '{},' '"erasure_code_profiles":' '{' '"default":' '{' '"k":' '"2",' '"m":' '"2",' '"plugin":' '"jerasure",' '"technique":' '"reed_sol_van"' '}' '},' '"removed_snaps_queue":' '[],' '"new_removed_snaps":' '[],' '"new_purged_snaps":' '[],' '"crush_node_flags":' '{},' '"device_class_flags":' '{},' '"stretch_mode":' '{' '"stretch_mode_enabled":' false, '"stretch_bucket_count":' 0, '"degraded_stretch_mode":' 0, '"recovering_stretch_mode":' 0, '"stretch_mode_bucket":' 0 '}' '},' '"osd_metadata":' '[' '{' '"id":' 0, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/0/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:22:53.662571Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]",' '"hb_front_addr":' '"[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/0",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 1, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/1/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:23:30.129885Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]",' '"hb_front_addr":' '"[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/1",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 2, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/2/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:24:07.764502Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]",' '"hb_front_addr":' '"[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/2",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '}' '],' '"osdmap_clean_epochs":' '{' '"min_last_epoch_clean":' 28, '"last_epoch_clean":' '{' '"per_pool":' '[' '{' '"poolid":' 1, '"floor":' 28 '},' '{' '"poolid":' 2, '"floor":' 28 '}' ']' '},' '"osd_epochs":' '[' '{' '"id":' 0, '"epoch":' 78 '},' '{' '"id":' 1, '"epoch":' 80 '}' ']' '},' '"osdmap_first_committed":' 28, '"osdmap_last_committed":' 83, '"crushmap":' '{' '"devices":' '[' '{' '"id":' 0, '"name":' '"osd.0",' '"class":' '"hdd"' '},' '{' '"id":' 1, '"name":' '"osd.1",' '"class":' '"hdd"' '},' '{' '"id":' 2, '"name":' '"osd.2",' '"class":' '"hdd"' '}' '],' '"types":' '[' '{' '"type_id":' 0, '"name":' '"osd"' '},' '{' '"type_id":' 1, '"name":' '"host"' '},' '{' '"type_id":' 2, '"name":' '"chassis"' '},' '{' '"type_id":' 3, '"name":' '"rack"' '},' '{' '"type_id":' 4, '"name":' '"row"' '},' '{' '"type_id":' 5, '"name":' '"pdu"' '},' '{' '"type_id":' 6, '"name":' '"pod"' '},' '{' '"type_id":' 7, '"name":' '"room"' '},' '{' '"type_id":' 8, '"name":' '"datacenter"' '},' '{' '"type_id":' 9, '"name":' '"zone"' '},' '{' '"type_id":' 10, '"name":' '"region"' '},' '{' '"type_id":' 11, '"name":' '"root"' '}' '],' '"buckets":' '[' '{' '"id":' -1, '"name":' '"default",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -3, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -2, '"name":' '"default~hdd",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -4, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -3, '"name":' '"smithi096",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '},' '{' '"id":' -4, '"name":' '"smithi096~hdd",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '}' '],' '"rules":' '[' '{' '"rule_id":' 0, '"rule_name":' '"replicated_rule",' '"type":' 1, '"steps":' '[' '{' '"op":' '"take",' '"item":' -1, '"item_name":' '"default"' '},' '{' '"op":' '"choose_firstn",' '"num":' 0, '"type":' '"osd"' '},' '{' '"op":' '"emit"' '}' ']' '}' '],' '"tunables":' '{' '"choose_local_tries":' 0, '"choose_local_fallback_tries":' 0, '"choose_total_tries":' 50, '"chooseleaf_descend_once":' 1, '"chooseleaf_vary_r":' 1, '"chooseleaf_stable":' 1, '"msr_descents":' 100, '"msr_collision_tries":' 100, '"straw_calc_version":' 1, '"allowed_bucket_algs":' 54, '"profile":' '"jewel",' '"optimal_tunables":' 1, '"legacy_tunables":' 0, '"minimum_required_version":' '"jewel",' '"require_feature_tunables":' 1, '"require_feature_tunables2":' 1, '"has_v2_rules":' 0, '"require_feature_tunables3":' 1, '"has_v3_rules":' 0, '"has_v4_buckets":' 1, '"require_feature_tunables5":' 1, '"has_v5_rules":' 0, '"has_msr_rules":' 0 '},' '"choose_args":' '{}' '},' '"fsmap":' '{' '"epoch":' 1, '"btime":' '"2024-09-16T03:22:46:882186+0000",' '"default_fscid":' -1, '"compat":' '{' '"compat":' '{},' '"ro_compat":' '{},' '"incompat":' '{' '"feature_1":' '"base' 'v0.20",' '"feature_2":' '"client' writeable 'ranges",' '"feature_3":' '"default' file layouts on 'dirs",' '"feature_4":' '"dir' inode in separate 'object",' '"feature_5":' '"mds' uses versioned 'encoding",' '"feature_6":' '"dirfrag' is stored in 'omap",' '"feature_8":' '"no' anchor 'table",' '"feature_9":' '"file' layout 'v2",' '"feature_10":' '"snaprealm' 'v2",' '"feature_11":' '"minor' log 'segments",' '"feature_12":' '"quiesce' 'subvolumes"' '}' '},' '"feature_flags":' '{' '"enable_multiple":' true, '"ever_enabled_multiple":' true '},' '"standbys":' '[],' '"filesystems":' '[]' '},' '"mdsmap_first_committed":' 1, '"mdsmap_last_committed":' 1, '"auth":' '{' '"first_committed":' 1, '"last_committed":' 5, '"num_secrets":' 3 '},' '"num_pg":' 64, '"num_pg_active":' 64, '"num_pg_unknown":' 0, '"num_osd":' 3, '"pool_sum":' '{' '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 128, '"acting":' 128, '"num_store_stats":' 0 '},' '"osd_sum":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54568, '"kb_used_data":' 856, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660632, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692487168, '"internally_reserved":' 0, '"allocated":' 876544, '"data_stored":' 327566, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 219, '"apply_latency_ms":' 219, '"commit_latency_ns":' 219000000, '"apply_latency_ns":' 219000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '},' '"osd_sum_by_class":' '{' '"hdd":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54568, '"kb_used_data":' 856, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660632, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692487168, '"internally_reserved":' 0, '"allocated":' 876544, '"data_stored":' 327566, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 219, '"apply_latency_ms":' 219, '"commit_latency_ns":' 219000000, '"apply_latency_ns":' 219000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '}' '},' '"pool_stats":' '[' '{' '"poolid":' 2, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '},' '{' '"poolid":' 1, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '}' '],' '"osd_stats":' '[' '{' '"osd":' 0, '"seq":' 21474836517 '},' '{' '"osd":' 1, '"seq":' 42949672989 '},' '{' '"osd":' 2, '"seq":' 0 '}' '],' '"num_pg_by_state":' '[' '{' '"state":' '"active+undersized",' '"num":' 64 '}' '],' '"num_pg_by_osd":' '[' '{' '"osd":' 2, '"num_primary_pg":' 0, '"num_acting_pg":' 0, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 0, '"num_primary_pg":' 28, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 1, '"num_primary_pg":' 36, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '}' '],' '"purged_snaps":' '[' '{' '"pool":' 1, '"purged_snaps":' '{}' '},' '{' '"pool":' 2, '"purged_snaps":' '{}' '}' '],' '"servicemap":' '{' '"epoch":' 5, '"modified":' '"2024-09-16T03:25:38.422788+0000",' '"services":' '{}' '},' '"mgrstat_first_committed":' 79, '"mgrstat_last_committed":' 85, '"logm_first_committed":' 1, '"logm_last_committed":' 377, '"paxos":' '{' '"first_committed":' 1, '"last_committed":' 562, '"last_pn":' 0, '"accepted_pn":' 0 '}' '}' 2024-09-16T03:26:00.203 INFO:tasks.workunit.client.0.smithi096.stdout:{ "cluster_fingerprint": "fda2fc64-07ed-4add-8224-2e527e11d427", "version": "19.3.0-4930-gfc3e0bff", "commit": "fc3e0bff7468fd55478adbae7f75508b749124b6", "timestamp": "2024-09-16T03:26:00.085015+0000", "tag": "", "health": { "status": "HEALTH_OK", "checks": {}, "mutes": [] }, "monmap_first_committed": 1, "monmap_last_committed": 1, "monmap": { "epoch": 1, "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", "modified": "2024-09-16T03:22:45.872880Z", "created": "2024-09-16T03:22:45.872880Z", "min_mon_release": 19, "min_mon_release_name": "squid", "election_strategy": 1, "disallowed_leaders: ": "", "stretch_mode": false, "tiebreaker_mon": "", "removed_ranks: ": "", "features": { "persistent": [ "kraken", "luminous", "mimic", "osdmap-prune", "nautilus", "octopus", "pacific", "elector-pinging", "quincy", "reef", "squid" ], "optional": [] }, "mons": [ { "rank": 0, "name": "a", "public_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:7302", "nonce": 0 } ] }, "addr": "127.0.0.1:7302/0", "public_addr": "127.0.0.1:7302/0", "priority": 0, "weight": 0, "crush_location": "{}" } ] }, "quorum": [ 0 ], "osdmap": { "epoch": 83, "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", "created": "2024-09-16T03:22:46.906117+0000", "modified": "2024-09-16T03:25:57.328949+0000", "last_up_change": "2024-09-16T03:25:08.513363+0000", "last_in_change": "2024-09-16T03:25:09.839444+0000", "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", "flags_num": 5799936, "flags_set": [ "pglog_hardlimit", "purged_snapdirs", "recovery_deletes", "sortbitwise" ], "crush_version": 7, "full_ratio": 0.97000002861022949, "backfillfull_ratio": 0.97000002861022949, "nearfull_ratio": 0.85000002384185791, "cluster_snapshot": "", "pool_max": 2, "max_osd": 3, "require_min_compat_client": "luminous", "min_compat_client": "jewel", "require_osd_release": "squid", "allow_crimson": false, "pools": [ { "pool": 1, "pool_name": "foo", "create_time": "2024-09-16T03:24:44.525189+0000", "flags": 1, "flags_names": "hashpspool", "type": 1, "size": 3, "min_size": 2, "crush_rule": 0, "peering_crush_bucket_count": 0, "peering_crush_bucket_target": 0, "peering_crush_bucket_barrier": 0, "peering_crush_bucket_mandatory_member": 2147483647, "is_stretch_pool": false, "object_hash": 2, "pg_autoscale_mode": "off", "pg_num": 32, "pg_placement_num": 32, "pg_placement_num_target": 32, "pg_num_target": 32, "pg_num_pending": 32, "last_pg_merge_meta": { "source_pgid": "0.0", "ready_epoch": 0, "last_epoch_started": 0, "last_epoch_clean": 0, "source_version": "0'0", "target_version": "0'0" }, "last_change": "30", "last_force_op_resend": "0", "last_force_op_resend_prenautilus": "0", "last_force_op_resend_preluminous": "0", "auid": 0, "snap_mode": "selfmanaged", "snap_seq": 0, "snap_epoch": 0, "pool_snaps": [], "removed_snaps": "[]", "quota_max_bytes": 0, "quota_max_objects": 0, "tiers": [], "tier_of": -1, "read_tier": -1, "write_tier": -1, "cache_mode": "none", "target_max_bytes": 0, "target_max_objects": 0, "cache_target_dirty_ratio_micro": 400000, "cache_target_dirty_high_ratio_micro": 600000, "cache_target_full_ratio_micro": 800000, "cache_min_flush_age": 0, "cache_min_evict_age": 0, "erasure_code_profile": "", "hit_set_params": { "type": "none" }, "hit_set_period": 0, "hit_set_count": 0, "use_gmt_hitset": true, "min_read_recency_for_promote": 0, "min_write_recency_for_promote": 0, "hit_set_grade_decay_rate": 0, "hit_set_search_last_n": 0, "grade_table": [], "stripe_width": 0, "expected_num_objects": 0, "fast_read": false, "options": {}, "application_metadata": {}, "read_balance": { "score_type": "Fair distribution", "score_acting": 1.8700000047683716, "score_stable": 1.8700000047683716, "optimal_score": 0.67000001668930054, "raw_score_acting": 1.25, "raw_score_stable": 1.25, "primary_affinity_weighted": 1, "average_primary_affinity": 1, "average_primary_affinity_weighted": 1 } }, { "pool": 2, "pool_name": "bar", "create_time": "2024-09-16T03:24:46.226575+0000", "flags": 1, "flags_names": "hashpspool", "type": 1, "size": 2, "min_size": 1, "crush_rule": 0, "peering_crush_bucket_count": 0, "peering_crush_bucket_target": 0, "peering_crush_bucket_barrier": 0, "peering_crush_bucket_mandatory_member": 2147483647, "is_stretch_pool": false, "object_hash": 2, "pg_autoscale_mode": "off", "pg_num": 32, "pg_placement_num": 32, "pg_placement_num_target": 32, "pg_num_target": 32, "pg_num_pending": 32, "last_pg_merge_meta": { "source_pgid": "0.0", "ready_epoch": 0, "last_epoch_started": 0, "last_epoch_clean": 0, "source_version": "0'0", "target_version": "0'0" }, "last_change": "83", "last_force_op_resend": "0", "last_force_op_resend_prenautilus": "0", "last_force_op_resend_preluminous": "0", "auid": 0, "snap_mode": "selfmanaged", "snap_seq": 0, "snap_epoch": 0, "pool_snaps": [], "removed_snaps": "[]", "quota_max_bytes": 0, "quota_max_objects": 0, "tiers": [], "tier_of": -1, "read_tier": -1, "write_tier": -1, "cache_mode": "none", "target_max_bytes": 0, "target_max_objects": 0, "cache_target_dirty_ratio_micro": 400000, "cache_target_dirty_high_ratio_micro": 600000, "cache_target_full_ratio_micro": 800000, "cache_min_flush_age": 0, "cache_min_evict_age": 0, "erasure_code_profile": "", "hit_set_params": { "type": "none" }, "hit_set_period": 0, "hit_set_count": 0, "use_gmt_hitset": true, "min_read_recency_for_promote": 0, "min_write_recency_for_promote": 0, "hit_set_grade_decay_rate": 0, "hit_set_search_last_n": 0, "grade_table": [], "stripe_width": 0, "expected_num_objects": 0, "fast_read": false, "options": {}, "application_metadata": {}, "read_balance": { "score_type": "Fair distribution", "score_acting": 1.4900000095367432, "score_stable": 1.4900000095367432, "optimal_score": 0.67000001668930054, "raw_score_acting": 1, "raw_score_stable": 1, "primary_affinity_weighted": 1, "average_primary_affinity": 1, "average_primary_affinity_weighted": 1 } } ], "osds": [ { "osd": 0, "uuid": "64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6", "up": 1, "in": 1, "weight": 1, "primary_affinity": 1, "last_clean_begin": 0, "last_clean_end": 0, "up_from": 5, "up_thru": 81, "down_at": 0, "lost_at": 0, "public_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6802", "nonce": 3375787448 }, { "type": "v1", "addr": "127.0.0.1:6803", "nonce": 3375787448 } ] }, "cluster_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6804", "nonce": 3375787448 }, { "type": "v1", "addr": "127.0.0.1:6805", "nonce": 3375787448 } ] }, "heartbeat_back_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6808", "nonce": 3375787448 }, { "type": "v1", "addr": "127.0.0.1:6809", "nonce": 3375787448 } ] }, "heartbeat_front_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6806", "nonce": 3375787448 }, { "type": "v1", "addr": "127.0.0.1:6807", "nonce": 3375787448 } ] }, "public_addr": "127.0.0.1:6803/3375787448", "cluster_addr": "127.0.0.1:6805/3375787448", "heartbeat_back_addr": "127.0.0.1:6809/3375787448", "heartbeat_front_addr": "127.0.0.1:6807/3375787448", "state": [ "exists", "up" ] }, { "osd": 1, "uuid": "74b26727-75c9-444d-8782-719e4197a382", "up": 1, "in": 1, "weight": 1, "primary_affinity": 1, "last_clean_begin": 0, "last_clean_end": 0, "up_from": 10, "up_thru": 81, "down_at": 0, "lost_at": 0, "public_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6810", "nonce": 3733255132 }, { "type": "v1", "addr": "127.0.0.1:6811", "nonce": 3733255132 } ] }, "cluster_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6812", "nonce": 3733255132 }, { "type": "v1", "addr": "127.0.0.1:6813", "nonce": 3733255132 } ] }, "heartbeat_back_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6816", "nonce": 3733255132 }, { "type": "v1", "addr": "127.0.0.1:6817", "nonce": 3733255132 } ] }, "heartbeat_front_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6814", "nonce": 3733255132 }, { "type": "v1", "addr": "127.0.0.1:6815", "nonce": 3733255132 } ] }, "public_addr": "127.0.0.1:6811/3733255132", "cluster_addr": "127.0.0.1:6813/3733255132", "heartbeat_back_addr": "127.0.0.1:6817/3733255132", "heartbeat_front_addr": "127.0.0.1:6815/3733255132", "state": [ "exists", "up" ] }, { "osd": 2, "uuid": "143da3a7-dad9-4b1e-966b-76cf5bdd3c82", "up": 0, "in": 0, "weight": 0, "primary_affinity": 1, "last_clean_begin": 0, "last_clean_end": 0, "up_from": 15, "up_thru": 21, "down_at": 33, "lost_at": 0, "public_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6818", "nonce": 963814857 }, { "type": "v1", "addr": "127.0.0.1:6819", "nonce": 963814857 } ] }, "cluster_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6820", "nonce": 963814857 }, { "type": "v1", "addr": "127.0.0.1:6821", "nonce": 963814857 } ] }, "heartbeat_back_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6824", "nonce": 963814857 }, { "type": "v1", "addr": "127.0.0.1:6825", "nonce": 963814857 } ] }, "heartbeat_front_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6822", "nonce": 963814857 }, { "type": "v1", "addr": "127.0.0.1:6823", "nonce": 963814857 } ] }, "public_addr": "127.0.0.1:6819/963814857", "cluster_addr": "127.0.0.1:6821/963814857", "heartbeat_back_addr": "127.0.0.1:6825/963814857", "heartbeat_front_addr": "127.0.0.1:6823/963814857", "state": [ "exists" ] } ], "osd_xinfo": [ { "osd": 0, "down_stamp": "0.000000", "laggy_probability": 0, "laggy_interval": 0, "features": 4540719139924082687, "old_weight": 0, "last_purged_snaps_scrub": "2024-09-16T03:23:22.481942+0000", "dead_epoch": 0 }, { "osd": 1, "down_stamp": "0.000000", "laggy_probability": 0, "laggy_interval": 0, "features": 4540719139924082687, "old_weight": 0, "last_purged_snaps_scrub": "2024-09-16T03:23:59.663703+0000", "dead_epoch": 0 }, { "osd": 2, "down_stamp": "0.000000", "laggy_probability": 0, "laggy_interval": 0, "features": 4540719139924082687, "old_weight": 65536, "last_purged_snaps_scrub": "2024-09-16T03:24:37.320822+0000", "dead_epoch": 32 } ], "pg_upmap": [], "pg_upmap_items": [], "pg_upmap_primaries": [], "pg_temp": [], "primary_temp": [], "blocklist": {}, "range_blocklist": {}, "erasure_code_profiles": { "default": { "k": "2", "m": "2", "plugin": "jerasure", "technique": "reed_sol_van" } }, "removed_snaps_queue": [], "new_removed_snaps": [], "new_purged_snaps": [], "crush_node_flags": {}, "device_class_flags": {}, "stretch_mode": { "stretch_mode_enabled": false, "stretch_bucket_count": 0, "degraded_stretch_mode": 0, "recovering_stretch_mode": 0, "stretch_mode_bucket": 0 } }, "osd_metadata": [ { "id": 0, "arch": "x86_64", "back_addr": "[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]", "back_iface": "", "bluefs": "1", "bluefs_dedicated_db": "0", "bluefs_dedicated_wal": "0", "bluefs_single_shared_device": "1", "bluestore_allocation_from_file": "0", "bluestore_bdev_access_mode": "file", "bluestore_bdev_block_size": "4096", "bluestore_bdev_devices": "sda", "bluestore_bdev_driver": "KernelDevice", "bluestore_bdev_optimal_io_size": "0", "bluestore_bdev_path": "td/mon-last-clean-epoch/0/block", "bluestore_bdev_rotational": "1", "bluestore_bdev_size": "107374182400", "bluestore_bdev_support_discard": "0", "bluestore_bdev_type": "hdd", "bluestore_min_alloc_size": "4096", "ceph_release": "squid", "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", "ceph_version_short": "19.3.0-4930-gfc3e0bff", "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", "created_at": "2024-09-16T03:22:53.662571Z", "default_device_class": "hdd", "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", "devices": "sda", "distro": "ubuntu", "distro_description": "Ubuntu 22.04.1 LTS", "distro_version": "22.04", "front_addr": "[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]", "front_iface": "", "hb_back_addr": "[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]", "hb_front_addr": "[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]", "hostname": "smithi096", "journal_rotational": "1", "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", "kernel_version": "5.15.0-121-generic", "mem_swap_kb": "2097148", "mem_total_kb": "32746824", "network_numa_unknown_ifaces": "back_iface,front_iface", "objectstore_numa_unknown_devices": "sda", "os": "Linux", "osd_data": "td/mon-last-clean-epoch/0", "osd_objectstore": "bluestore", "osdspec_affinity": "", "rotational": "1" }, { "id": 1, "arch": "x86_64", "back_addr": "[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]", "back_iface": "", "bluefs": "1", "bluefs_dedicated_db": "0", "bluefs_dedicated_wal": "0", "bluefs_single_shared_device": "1", "bluestore_allocation_from_file": "0", "bluestore_bdev_access_mode": "file", "bluestore_bdev_block_size": "4096", "bluestore_bdev_devices": "sda", "bluestore_bdev_driver": "KernelDevice", "bluestore_bdev_optimal_io_size": "0", "bluestore_bdev_path": "td/mon-last-clean-epoch/1/block", "bluestore_bdev_rotational": "1", "bluestore_bdev_size": "107374182400", "bluestore_bdev_support_discard": "0", "bluestore_bdev_type": "hdd", "bluestore_min_alloc_size": "4096", "ceph_release": "squid", "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", "ceph_version_short": "19.3.0-4930-gfc3e0bff", "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", "created_at": "2024-09-16T03:23:30.129885Z", "default_device_class": "hdd", "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", "devices": "sda", "distro": "ubuntu", "distro_description": "Ubuntu 22.04.1 LTS", "distro_version": "22.04", "front_addr": "[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]", "front_iface": "", "hb_back_addr": "[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]", "hb_front_addr": "[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]", "hostname": "smithi096", "journal_rotational": "1", "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", "kernel_version": "5.15.0-121-generic", "mem_swap_kb": "2097148", "mem_total_kb": "32746824", "network_numa_unknown_ifaces": "back_iface,front_iface", "objectstore_numa_unknown_devices": "sda", "os": "Linux", "osd_data": "td/mon-last-clean-epoch/1", "osd_objectstore": "bluestore", "osdspec_affinity": "", "rotational": "1" }, { "id": 2, "arch": "x86_64", "back_addr": "[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]", "back_iface": "", "bluefs": "1", "bluefs_dedicated_db": "0", "bluefs_dedicated_wal": "0", "bluefs_single_shared_device": "1", "bluestore_allocation_from_file": "0", "bluestore_bdev_access_mode": "file", "bluestore_bdev_block_size": "4096", "bluestore_bdev_devices": "sda", "bluestore_bdev_driver": "KernelDevice", "bluestore_bdev_optimal_io_size": "0", "bluestore_bdev_path": "td/mon-last-clean-epoch/2/block", "bluestore_bdev_rotational": "1", "bluestore_bdev_size": "107374182400", "bluestore_bdev_support_discard": "0", "bluestore_bdev_type": "hdd", "bluestore_min_alloc_size": "4096", "ceph_release": "squid", "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", "ceph_version_short": "19.3.0-4930-gfc3e0bff", "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", "created_at": "2024-09-16T03:24:07.764502Z", "default_device_class": "hdd", "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", "devices": "sda", "distro": "ubuntu", "distro_description": "Ubuntu 22.04.1 LTS", "distro_version": "22.04", "front_addr": "[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]", "front_iface": "", "hb_back_addr": "[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]", "hb_front_addr": "[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]", "hostname": "smithi096", "journal_rotational": "1", "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", "kernel_version": "5.15.0-121-generic", "mem_swap_kb": "2097148", "mem_total_kb": "32746824", "network_numa_unknown_ifaces": "back_iface,front_iface", "objectstore_numa_unknown_devices": "sda", "os": "Linux", "osd_data": "td/mon-last-clean-epoch/2", "osd_objectstore": "bluestore", "osdspec_affinity": "", "rotational": "1" } ], "osdmap_clean_epochs": { "min_last_epoch_clean": 28, "last_epoch_clean": { "per_pool": [ { "poolid": 1, "floor": 28 }, { "poolid": 2, "floor": 28 } ] }, "osd_epochs": [ { "id": 0, "epoch": 78 }, { "id": 1, "epoch": 80 } ] }, "osdmap_first_committed": 28, "osdmap_last_committed": 83, "crushmap": { "devices": [ { "id": 0, "name": "osd.0", "class": "hdd" }, { "id": 1, "name": "osd.1", "class": "hdd" }, { "id": 2, "name": "osd.2", "class": "hdd" } ], "types": [ { "type_id": 0, "name": "osd" }, { "type_id": 1, "name": "host" }, { "type_id": 2, "name": "chassis" }, { "type_id": 3, "name": "rack" }, { "type_id": 4, "name": "row" }, { "type_id": 5, "name": "pdu" }, { "type_id": 6, "name": "pod" }, { "type_id": 7, "name": "room" }, { "type_id": 8, "name": "datacenter" }, { "type_id": 9, "name": "zone" }, { "type_id": 10, "name": "region" }, { "type_id": 11, "name": "root" } ], "buckets": [ { "id": -1, "name": "default", "type_id": 11, "type_name": "root", "weight": 19206, "alg": "straw2", "hash": "rjenkins1", "items": [ { "id": -3, "weight": 19206, "pos": 0 } ] }, { "id": -2, "name": "default~hdd", "type_id": 11, "type_name": "root", "weight": 19206, "alg": "straw2", "hash": "rjenkins1", "items": [ { "id": -4, "weight": 19206, "pos": 0 } ] }, { "id": -3, "name": "smithi096", "type_id": 1, "type_name": "host", "weight": 19206, "alg": "straw2", "hash": "rjenkins1", "items": [ { "id": 0, "weight": 6402, "pos": 0 }, { "id": 1, "weight": 6402, "pos": 1 }, { "id": 2, "weight": 6402, "pos": 2 } ] }, { "id": -4, "name": "smithi096~hdd", "type_id": 1, "type_name": "host", "weight": 19206, "alg": "straw2", "hash": "rjenkins1", "items": [ { "id": 0, "weight": 6402, "pos": 0 }, { "id": 1, "weight": 6402, "pos": 1 }, { "id": 2, "weight": 6402, "pos": 2 } ] } ], "rules": [ { "rule_id": 0, "rule_name": "replicated_rule", "type": 1, "steps": [ { "op": "take", "item": -1, "item_name": "default" }, { "op": "choose_firstn", "num": 0, "type": "osd" }, { "op": "emit" } ] } ], "tunables": { "choose_local_tries": 0, "choose_local_fallback_tries": 0, "choose_total_tries": 50, "chooseleaf_descend_once": 1, "chooseleaf_vary_r": 1, "chooseleaf_stable": 1, "msr_descents": 100, "msr_collision_tries": 100, "straw_calc_version": 1, "allowed_bucket_algs": 54, "profile": "jewel", "optimal_tunables": 1, "legacy_tunables": 0, "minimum_required_version": "jewel", "require_feature_tunables": 1, "require_feature_tunables2": 1, "has_v2_rules": 0, "require_feature_tunables3": 1, "has_v3_rules": 0, "has_v4_buckets": 1, "require_feature_tunables5": 1, "has_v5_rules": 0, "has_msr_rules": 0 }, "choose_args": {} }, "fsmap": { "epoch": 1, "btime": "2024-09-16T03:22:46:882186+0000", "default_fscid": -1, "compat": { "compat": {}, "ro_compat": {}, "incompat": { "feature_1": "base v0.20", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes" } }, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "standbys": [], "filesystems": [] }, "mdsmap_first_committed": 1, "mdsmap_last_committed": 1, "auth": { "first_committed": 1, "last_committed": 5, "num_secrets": 3 }, "num_pg": 64, "num_pg_active": 64, "num_pg_unknown": 0, "num_osd": 3, "pool_sum": { "stat_sum": { "num_bytes": 0, "num_objects": 0, "num_object_clones": 0, "num_object_copies": 0, "num_objects_missing_on_primary": 0, "num_objects_missing": 0, "num_objects_degraded": 0, "num_objects_misplaced": 0, "num_objects_unfound": 0, "num_objects_dirty": 0, "num_whiteouts": 0, "num_read": 0, "num_read_kb": 0, "num_write": 0, "num_write_kb": 0, "num_scrub_errors": 0, "num_shallow_scrub_errors": 0, "num_deep_scrub_errors": 0, "num_objects_recovered": 0, "num_bytes_recovered": 0, "num_keys_recovered": 0, "num_objects_omap": 0, "num_objects_hit_set_archive": 0, "num_bytes_hit_set_archive": 0, "num_flush": 0, "num_flush_kb": 0, "num_evict": 0, "num_evict_kb": 0, "num_promote": 0, "num_flush_mode_high": 0, "num_flush_mode_low": 0, "num_evict_mode_some": 0, "num_evict_mode_full": 0, "num_objects_pinned": 0, "num_legacy_snapsets": 0, "num_large_omap_objects": 0, "num_objects_manifest": 0, "num_omap_bytes": 0, "num_omap_keys": 0, "num_objects_repaired": 0 }, "store_stats": { "total": 0, "available": 0, "internally_reserved": 0, "allocated": 0, "data_stored": 0, "data_compressed": 0, "data_compressed_allocated": 0, "data_compressed_original": 0, "omap_allocated": 0, "internal_metadata": 0 }, "log_size": 0, "ondisk_log_size": 0, "up": 128, "acting": 128, "num_store_stats": 0 }, "osd_sum": { "up_from": 0, "seq": 0, "num_pgs": 128, "num_osds": 2, "num_per_pool_osds": 2, "num_per_pool_omap_osds": 2, "kb": 209715200, "kb_used": 54568, "kb_used_data": 856, "kb_used_omap": 3, "kb_used_meta": 53628, "kb_avail": 209660632, "statfs": { "total": 214748364800, "available": 214692487168, "internally_reserved": 0, "allocated": 876544, "data_stored": 327566, "data_compressed": 0, "data_compressed_allocated": 0, "data_compressed_original": 0, "omap_allocated": 3190, "internal_metadata": 54915978 }, "hb_peers": [], "snap_trim_queue_len": 0, "num_snap_trimming": 0, "num_shards_repaired": 0, "op_queue_age_hist": { "histogram": [], "upper_bound": 1 }, "perf_stat": { "commit_latency_ms": 219, "apply_latency_ms": 219, "commit_latency_ns": 219000000, "apply_latency_ns": 219000000 }, "alerts": [], "network_ping_times": [] }, "osd_sum_by_class": { "hdd": { "up_from": 0, "seq": 0, "num_pgs": 128, "num_osds": 2, "num_per_pool_osds": 2, "num_per_pool_omap_osds": 2, "kb": 209715200, "kb_used": 54568, "kb_used_data": 856, "kb_used_omap": 3, "kb_used_meta": 53628, "kb_avail": 209660632, "statfs": { "total": 214748364800, "available": 214692487168, "internally_reserved": 0, "allocated": 876544, "data_stored": 327566, "data_compressed": 0, "data_compressed_allocated": 0, "data_compressed_original": 0, "omap_allocated": 3190, "internal_metadata": 54915978 }, "hb_peers": [], "snap_trim_queue_len": 0, "num_snap_trimming": 0, "num_shards_repaired": 0, "op_queue_age_hist": { "histogram": [], "upper_bound": 1 }, "perf_stat": { "commit_latency_ms": 219, "apply_latency_ms": 219, "commit_latency_ns": 219000000, "apply_latency_ns": 219000000 }, "alerts": [], "network_ping_times": [] } }, "pool_stats": [ { "poolid": 2, "num_pg": 32, "stat_sum": { "num_bytes": 0, "num_objects": 0, "num_object_clones": 0, "num_object_copies": 0, "num_objects_missing_on_primary": 0, "num_objects_missing": 0, "num_objects_degraded": 0, "num_objects_misplaced": 0, "num_objects_unfound": 0, "num_objects_dirty": 0, "num_whiteouts": 0, "num_read": 0, "num_read_kb": 0, "num_write": 0, "num_write_kb": 0, "num_scrub_errors": 0, "num_shallow_scrub_errors": 0, "num_deep_scrub_errors": 0, "num_objects_recovered": 0, "num_bytes_recovered": 0, "num_keys_recovered": 0, "num_objects_omap": 0, "num_objects_hit_set_archive": 0, "num_bytes_hit_set_archive": 0, "num_flush": 0, "num_flush_kb": 0, "num_evict": 0, "num_evict_kb": 0, "num_promote": 0, "num_flush_mode_high": 0, "num_flush_mode_low": 0, "num_evict_mode_some": 0, "num_evict_mode_full": 0, "num_objects_pinned": 0, "num_legacy_snapsets": 0, "num_large_omap_objects": 0, "num_objects_manifest": 0, "num_omap_bytes": 0, "num_omap_keys": 0, "num_objects_repaired": 0 }, "store_stats": { "total": 0, "available": 0, "internally_reserved": 0, "allocated": 0, "data_stored": 0, "data_compressed": 0, "data_compressed_allocated": 0, "data_compressed_original": 0, "omap_allocated": 0, "internal_metadata": 0 }, "log_size": 0, "ondisk_log_size": 0, "up": 64, "acting": 64, "num_store_stats": 3 }, { "poolid": 1, "num_pg": 32, "stat_sum": { "num_bytes": 0, "num_objects": 0, "num_object_clones": 0, "num_object_copies": 0, "num_objects_missing_on_primary": 0, "num_objects_missing": 0, "num_objects_degraded": 0, "num_objects_misplaced": 0, "num_objects_unfound": 0, "num_objects_dirty": 0, "num_whiteouts": 0, "num_read": 0, "num_read_kb": 0, "num_write": 0, "num_write_kb": 0, "num_scrub_errors": 0, "num_shallow_scrub_errors": 0, "num_deep_scrub_errors": 0, "num_objects_recovered": 0, "num_bytes_recovered": 0, "num_keys_recovered": 0, "num_objects_omap": 0, "num_objects_hit_set_archive": 0, "num_bytes_hit_set_archive": 0, "num_flush": 0, "num_flush_kb": 0, "num_evict": 0, "num_evict_kb": 0, "num_promote": 0, "num_flush_mode_high": 0, "num_flush_mode_low": 0, "num_evict_mode_some": 0, "num_evict_mode_full": 0, "num_objects_pinned": 0, "num_legacy_snapsets": 0, "num_large_omap_objects": 0, "num_objects_manifest": 0, "num_omap_bytes": 0, "num_omap_keys": 0, "num_objects_repaired": 0 }, "store_stats": { "total": 0, "available": 0, "internally_reserved": 0, "allocated": 0, "data_stored": 0, "data_compressed": 0, "data_compressed_allocated": 0, "data_compressed_original": 0, "omap_allocated": 0, "internal_metadata": 0 }, "log_size": 0, "ondisk_log_size": 0, "up": 64, "acting": 64, "num_store_stats": 3 } ], "osd_stats": [ { "osd": 0, "seq": 21474836517 }, { "osd": 1, "seq": 42949672989 }, { "osd": 2, "seq": 0 } ], "num_pg_by_state": [ { "state": "active+undersized", "num": 64 } ], "num_pg_by_osd": [ { "osd": 2, "num_primary_pg": 0, "num_acting_pg": 0, "num_up_not_acting_pg": 0 }, { "osd": 0, "num_primary_pg": 28, "num_acting_pg": 64, "num_up_not_acting_pg": 0 }, { "osd": 1, "num_primary_pg": 36, "num_acting_pg": 64, "num_up_not_acting_pg": 0 } ], "purged_snaps": [ { "pool": 1, "purged_snaps": {} }, { "pool": 2, "purged_snaps": {} } ], "servicemap": { "epoch": 5, "modified": "2024-09-16T03:25:38.422788+0000", "services": {} }, "mgrstat_first_committed": 79, "mgrstat_last_committed": 85, "logm_first_committed": 1, "logm_last_committed": 377, "paxos": { "first_committed": 1, "last_committed": 562, "last_pn": 0, "accepted_pn": 0 } } 2024-09-16T03:26:00.204 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:64: check_lec_lower_than_pool: return 1 2024-09-16T03:26:00.204 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:65: check_lec_lower_than_pool: return 0 2024-09-16T03:26:00.204 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:263: TEST_mon_last_clean_epoch: check_floor_pool_greater_than_pool 2 1 2024-09-16T03:26:00.204 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:70: check_floor_pool_greater_than_pool: local pool_a=2 2024-09-16T03:26:00.204 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:71: check_floor_pool_greater_than_pool: local pool_b=2 2024-09-16T03:26:00.204 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:72: check_floor_pool_greater_than_pool: [[ -z 2 ]] 2024-09-16T03:26:00.204 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:73: check_floor_pool_greater_than_pool: [[ -z 2 ]] 2024-09-16T03:26:00.204 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:75: check_floor_pool_greater_than_pool: ceph report 2024-09-16T03:26:00.693 INFO:tasks.workunit.client.0.smithi096.stderr:report 3583751268 2024-09-16T03:26:00.711 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:75: check_floor_pool_greater_than_pool: report='{ 2024-09-16T03:26:00.711 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_fingerprint": "fda2fc64-07ed-4add-8224-2e527e11d427", 2024-09-16T03:26:00.711 INFO:tasks.workunit.client.0.smithi096.stderr: "version": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:26:00.711 INFO:tasks.workunit.client.0.smithi096.stderr: "commit": "fc3e0bff7468fd55478adbae7f75508b749124b6", 2024-09-16T03:26:00.711 INFO:tasks.workunit.client.0.smithi096.stderr: "timestamp": "2024-09-16T03:26:00.694082+0000", 2024-09-16T03:26:00.711 INFO:tasks.workunit.client.0.smithi096.stderr: "tag": "", 2024-09-16T03:26:00.711 INFO:tasks.workunit.client.0.smithi096.stderr: "health": { 2024-09-16T03:26:00.712 INFO:tasks.workunit.client.0.smithi096.stderr: "status": "HEALTH_OK", 2024-09-16T03:26:00.712 INFO:tasks.workunit.client.0.smithi096.stderr: "checks": {}, 2024-09-16T03:26:00.712 INFO:tasks.workunit.client.0.smithi096.stderr: "mutes": [] 2024-09-16T03:26:00.712 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.712 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap_first_committed": 1, 2024-09-16T03:26:00.712 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap_last_committed": 1, 2024-09-16T03:26:00.712 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap": { 2024-09-16T03:26:00.712 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 1, 2024-09-16T03:26:00.712 INFO:tasks.workunit.client.0.smithi096.stderr: "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", 2024-09-16T03:26:00.712 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:22:45.872880Z", 2024-09-16T03:26:00.712 INFO:tasks.workunit.client.0.smithi096.stderr: "created": "2024-09-16T03:22:45.872880Z", 2024-09-16T03:26:00.712 INFO:tasks.workunit.client.0.smithi096.stderr: "min_mon_release": 19, 2024-09-16T03:26:00.712 INFO:tasks.workunit.client.0.smithi096.stderr: "min_mon_release_name": "squid", 2024-09-16T03:26:00.713 INFO:tasks.workunit.client.0.smithi096.stderr: "election_strategy": 1, 2024-09-16T03:26:00.713 INFO:tasks.workunit.client.0.smithi096.stderr: "disallowed_leaders: ": "", 2024-09-16T03:26:00.713 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode": false, 2024-09-16T03:26:00.713 INFO:tasks.workunit.client.0.smithi096.stderr: "tiebreaker_mon": "", 2024-09-16T03:26:00.713 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_ranks: ": "", 2024-09-16T03:26:00.713 INFO:tasks.workunit.client.0.smithi096.stderr: "features": { 2024-09-16T03:26:00.713 INFO:tasks.workunit.client.0.smithi096.stderr: "persistent": [ 2024-09-16T03:26:00.713 INFO:tasks.workunit.client.0.smithi096.stderr: "kraken", 2024-09-16T03:26:00.714 INFO:tasks.workunit.client.0.smithi096.stderr: "luminous", 2024-09-16T03:26:00.714 INFO:tasks.workunit.client.0.smithi096.stderr: "mimic", 2024-09-16T03:26:00.714 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap-prune", 2024-09-16T03:26:00.714 INFO:tasks.workunit.client.0.smithi096.stderr: "nautilus", 2024-09-16T03:26:00.714 INFO:tasks.workunit.client.0.smithi096.stderr: "octopus", 2024-09-16T03:26:00.714 INFO:tasks.workunit.client.0.smithi096.stderr: "pacific", 2024-09-16T03:26:00.714 INFO:tasks.workunit.client.0.smithi096.stderr: "elector-pinging", 2024-09-16T03:26:00.714 INFO:tasks.workunit.client.0.smithi096.stderr: "quincy", 2024-09-16T03:26:00.714 INFO:tasks.workunit.client.0.smithi096.stderr: "reef", 2024-09-16T03:26:00.714 INFO:tasks.workunit.client.0.smithi096.stderr: "squid" 2024-09-16T03:26:00.714 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:00.714 INFO:tasks.workunit.client.0.smithi096.stderr: "optional": [] 2024-09-16T03:26:00.714 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.714 INFO:tasks.workunit.client.0.smithi096.stderr: "mons": [ 2024-09-16T03:26:00.715 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.715 INFO:tasks.workunit.client.0.smithi096.stderr: "rank": 0, 2024-09-16T03:26:00.715 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "a", 2024-09-16T03:26:00.715 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:26:00.715 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:00.715 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.715 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:00.715 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:7302", 2024-09-16T03:26:00.715 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 0 2024-09-16T03:26:00.715 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:00.715 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:00.715 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.716 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:7302/0", 2024-09-16T03:26:00.716 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:7302/0", 2024-09-16T03:26:00.716 INFO:tasks.workunit.client.0.smithi096.stderr: "priority": 0, 2024-09-16T03:26:00.716 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 0, 2024-09-16T03:26:00.716 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_location": "{}" 2024-09-16T03:26:00.716 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:00.716 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:00.716 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.716 INFO:tasks.workunit.client.0.smithi096.stderr: "quorum": [ 2024-09-16T03:26:00.716 INFO:tasks.workunit.client.0.smithi096.stderr: 0 2024-09-16T03:26:00.716 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:00.716 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap": { 2024-09-16T03:26:00.717 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 83, 2024-09-16T03:26:00.717 INFO:tasks.workunit.client.0.smithi096.stderr: "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", 2024-09-16T03:26:00.717 INFO:tasks.workunit.client.0.smithi096.stderr: "created": "2024-09-16T03:22:46.906117+0000", 2024-09-16T03:26:00.717 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:25:57.328949+0000", 2024-09-16T03:26:00.717 INFO:tasks.workunit.client.0.smithi096.stderr: "last_up_change": "2024-09-16T03:25:08.513363+0000", 2024-09-16T03:26:00.717 INFO:tasks.workunit.client.0.smithi096.stderr: "last_in_change": "2024-09-16T03:25:09.839444+0000", 2024-09-16T03:26:00.717 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-16T03:26:00.717 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_num": 5799936, 2024-09-16T03:26:00.717 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_set": [ 2024-09-16T03:26:00.717 INFO:tasks.workunit.client.0.smithi096.stderr: "pglog_hardlimit", 2024-09-16T03:26:00.717 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snapdirs", 2024-09-16T03:26:00.717 INFO:tasks.workunit.client.0.smithi096.stderr: "recovery_deletes", 2024-09-16T03:26:00.717 INFO:tasks.workunit.client.0.smithi096.stderr: "sortbitwise" 2024-09-16T03:26:00.718 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:00.718 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_version": 7, 2024-09-16T03:26:00.718 INFO:tasks.workunit.client.0.smithi096.stderr: "full_ratio": 0.97000002861022949, 2024-09-16T03:26:00.718 INFO:tasks.workunit.client.0.smithi096.stderr: "backfillfull_ratio": 0.97000002861022949, 2024-09-16T03:26:00.718 INFO:tasks.workunit.client.0.smithi096.stderr: "nearfull_ratio": 0.85000002384185791, 2024-09-16T03:26:00.718 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_snapshot": "", 2024-09-16T03:26:00.718 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_max": 2, 2024-09-16T03:26:00.718 INFO:tasks.workunit.client.0.smithi096.stderr: "max_osd": 3, 2024-09-16T03:26:00.718 INFO:tasks.workunit.client.0.smithi096.stderr: "require_min_compat_client": "luminous", 2024-09-16T03:26:00.718 INFO:tasks.workunit.client.0.smithi096.stderr: "min_compat_client": "jewel", 2024-09-16T03:26:00.718 INFO:tasks.workunit.client.0.smithi096.stderr: "require_osd_release": "squid", 2024-09-16T03:26:00.718 INFO:tasks.workunit.client.0.smithi096.stderr: "allow_crimson": false, 2024-09-16T03:26:00.718 INFO:tasks.workunit.client.0.smithi096.stderr: "pools": [ 2024-09-16T03:26:00.718 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.719 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 1, 2024-09-16T03:26:00.719 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_name": "foo", 2024-09-16T03:26:00.719 INFO:tasks.workunit.client.0.smithi096.stderr: "create_time": "2024-09-16T03:24:44.525189+0000", 2024-09-16T03:26:00.719 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": 1, 2024-09-16T03:26:00.719 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_names": "hashpspool", 2024-09-16T03:26:00.719 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:26:00.719 INFO:tasks.workunit.client.0.smithi096.stderr: "size": 3, 2024-09-16T03:26:00.719 INFO:tasks.workunit.client.0.smithi096.stderr: "min_size": 2, 2024-09-16T03:26:00.719 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_rule": 0, 2024-09-16T03:26:00.719 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_count": 0, 2024-09-16T03:26:00.720 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_target": 0, 2024-09-16T03:26:00.720 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_barrier": 0, 2024-09-16T03:26:00.720 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-16T03:26:00.720 INFO:tasks.workunit.client.0.smithi096.stderr: "is_stretch_pool": false, 2024-09-16T03:26:00.720 INFO:tasks.workunit.client.0.smithi096.stderr: "object_hash": 2, 2024-09-16T03:26:00.720 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_autoscale_mode": "off", 2024-09-16T03:26:00.720 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num": 32, 2024-09-16T03:26:00.720 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num": 32, 2024-09-16T03:26:00.720 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num_target": 32, 2024-09-16T03:26:00.720 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_target": 32, 2024-09-16T03:26:00.720 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_pending": 32, 2024-09-16T03:26:00.720 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pg_merge_meta": { 2024-09-16T03:26:00.720 INFO:tasks.workunit.client.0.smithi096.stderr: "source_pgid": "0.0", 2024-09-16T03:26:00.721 INFO:tasks.workunit.client.0.smithi096.stderr: "ready_epoch": 0, 2024-09-16T03:26:00.721 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_started": 0, 2024-09-16T03:26:00.721 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": 0, 2024-09-16T03:26:00.721 INFO:tasks.workunit.client.0.smithi096.stderr: "source_version": "0'\''0", 2024-09-16T03:26:00.721 INFO:tasks.workunit.client.0.smithi096.stderr: "target_version": "0'\''0" 2024-09-16T03:26:00.721 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.721 INFO:tasks.workunit.client.0.smithi096.stderr: "last_change": "30", 2024-09-16T03:26:00.721 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend": "0", 2024-09-16T03:26:00.721 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_prenautilus": "0", 2024-09-16T03:26:00.721 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_preluminous": "0", 2024-09-16T03:26:00.721 INFO:tasks.workunit.client.0.smithi096.stderr: "auid": 0, 2024-09-16T03:26:00.721 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_mode": "selfmanaged", 2024-09-16T03:26:00.722 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_seq": 0, 2024-09-16T03:26:00.722 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_epoch": 0, 2024-09-16T03:26:00.722 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_snaps": [], 2024-09-16T03:26:00.722 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps": "[]", 2024-09-16T03:26:00.722 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_bytes": 0, 2024-09-16T03:26:00.722 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_objects": 0, 2024-09-16T03:26:00.722 INFO:tasks.workunit.client.0.smithi096.stderr: "tiers": [], 2024-09-16T03:26:00.722 INFO:tasks.workunit.client.0.smithi096.stderr: "tier_of": -1, 2024-09-16T03:26:00.722 INFO:tasks.workunit.client.0.smithi096.stderr: "read_tier": -1, 2024-09-16T03:26:00.722 INFO:tasks.workunit.client.0.smithi096.stderr: "write_tier": -1, 2024-09-16T03:26:00.722 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_mode": "none", 2024-09-16T03:26:00.722 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_bytes": 0, 2024-09-16T03:26:00.722 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_objects": 0, 2024-09-16T03:26:00.723 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_ratio_micro": 400000, 2024-09-16T03:26:00.723 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-16T03:26:00.723 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_full_ratio_micro": 800000, 2024-09-16T03:26:00.723 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_flush_age": 0, 2024-09-16T03:26:00.723 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_evict_age": 0, 2024-09-16T03:26:00.723 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profile": "", 2024-09-16T03:26:00.723 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_params": { 2024-09-16T03:26:00.723 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "none" 2024-09-16T03:26:00.723 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.724 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_period": 0, 2024-09-16T03:26:00.724 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_count": 0, 2024-09-16T03:26:00.724 INFO:tasks.workunit.client.0.smithi096.stderr: "use_gmt_hitset": true, 2024-09-16T03:26:00.724 INFO:tasks.workunit.client.0.smithi096.stderr: "min_read_recency_for_promote": 0, 2024-09-16T03:26:00.724 INFO:tasks.workunit.client.0.smithi096.stderr: "min_write_recency_for_promote": 0, 2024-09-16T03:26:00.724 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_grade_decay_rate": 0, 2024-09-16T03:26:00.724 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_search_last_n": 0, 2024-09-16T03:26:00.724 INFO:tasks.workunit.client.0.smithi096.stderr: "grade_table": [], 2024-09-16T03:26:00.724 INFO:tasks.workunit.client.0.smithi096.stderr: "stripe_width": 0, 2024-09-16T03:26:00.724 INFO:tasks.workunit.client.0.smithi096.stderr: "expected_num_objects": 0, 2024-09-16T03:26:00.725 INFO:tasks.workunit.client.0.smithi096.stderr: "fast_read": false, 2024-09-16T03:26:00.725 INFO:tasks.workunit.client.0.smithi096.stderr: "options": {}, 2024-09-16T03:26:00.725 INFO:tasks.workunit.client.0.smithi096.stderr: "application_metadata": {}, 2024-09-16T03:26:00.725 INFO:tasks.workunit.client.0.smithi096.stderr: "read_balance": { 2024-09-16T03:26:00.725 INFO:tasks.workunit.client.0.smithi096.stderr: "score_type": "Fair distribution", 2024-09-16T03:26:00.725 INFO:tasks.workunit.client.0.smithi096.stderr: "score_acting": 1.8700000047683716, 2024-09-16T03:26:00.725 INFO:tasks.workunit.client.0.smithi096.stderr: "score_stable": 1.8700000047683716, 2024-09-16T03:26:00.725 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_score": 0.67000001668930054, 2024-09-16T03:26:00.725 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_acting": 1.25, 2024-09-16T03:26:00.726 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_stable": 1.25, 2024-09-16T03:26:00.726 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity_weighted": 1, 2024-09-16T03:26:00.726 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity": 1, 2024-09-16T03:26:00.726 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity_weighted": 1 2024-09-16T03:26:00.726 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:00.726 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.727 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.727 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 2, 2024-09-16T03:26:00.727 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_name": "bar", 2024-09-16T03:26:00.727 INFO:tasks.workunit.client.0.smithi096.stderr: "create_time": "2024-09-16T03:24:46.226575+0000", 2024-09-16T03:26:00.727 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": 1, 2024-09-16T03:26:00.727 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_names": "hashpspool", 2024-09-16T03:26:00.727 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:26:00.727 INFO:tasks.workunit.client.0.smithi096.stderr: "size": 2, 2024-09-16T03:26:00.727 INFO:tasks.workunit.client.0.smithi096.stderr: "min_size": 1, 2024-09-16T03:26:00.727 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_rule": 0, 2024-09-16T03:26:00.727 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_count": 0, 2024-09-16T03:26:00.728 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_target": 0, 2024-09-16T03:26:00.728 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_barrier": 0, 2024-09-16T03:26:00.728 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-16T03:26:00.728 INFO:tasks.workunit.client.0.smithi096.stderr: "is_stretch_pool": false, 2024-09-16T03:26:00.728 INFO:tasks.workunit.client.0.smithi096.stderr: "object_hash": 2, 2024-09-16T03:26:00.728 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_autoscale_mode": "off", 2024-09-16T03:26:00.728 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num": 32, 2024-09-16T03:26:00.728 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num": 32, 2024-09-16T03:26:00.728 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num_target": 32, 2024-09-16T03:26:00.728 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_target": 32, 2024-09-16T03:26:00.728 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_pending": 32, 2024-09-16T03:26:00.728 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pg_merge_meta": { 2024-09-16T03:26:00.729 INFO:tasks.workunit.client.0.smithi096.stderr: "source_pgid": "0.0", 2024-09-16T03:26:00.729 INFO:tasks.workunit.client.0.smithi096.stderr: "ready_epoch": 0, 2024-09-16T03:26:00.729 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_started": 0, 2024-09-16T03:26:00.729 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": 0, 2024-09-16T03:26:00.729 INFO:tasks.workunit.client.0.smithi096.stderr: "source_version": "0'\''0", 2024-09-16T03:26:00.729 INFO:tasks.workunit.client.0.smithi096.stderr: "target_version": "0'\''0" 2024-09-16T03:26:00.729 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.729 INFO:tasks.workunit.client.0.smithi096.stderr: "last_change": "83", 2024-09-16T03:26:00.729 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend": "0", 2024-09-16T03:26:00.730 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_prenautilus": "0", 2024-09-16T03:26:00.730 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_preluminous": "0", 2024-09-16T03:26:00.730 INFO:tasks.workunit.client.0.smithi096.stderr: "auid": 0, 2024-09-16T03:26:00.730 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_mode": "selfmanaged", 2024-09-16T03:26:00.730 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_seq": 0, 2024-09-16T03:26:00.730 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_epoch": 0, 2024-09-16T03:26:00.730 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_snaps": [], 2024-09-16T03:26:00.731 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps": "[]", 2024-09-16T03:26:00.731 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_bytes": 0, 2024-09-16T03:26:00.731 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_objects": 0, 2024-09-16T03:26:00.731 INFO:tasks.workunit.client.0.smithi096.stderr: "tiers": [], 2024-09-16T03:26:00.731 INFO:tasks.workunit.client.0.smithi096.stderr: "tier_of": -1, 2024-09-16T03:26:00.731 INFO:tasks.workunit.client.0.smithi096.stderr: "read_tier": -1, 2024-09-16T03:26:00.731 INFO:tasks.workunit.client.0.smithi096.stderr: "write_tier": -1, 2024-09-16T03:26:00.731 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_mode": "none", 2024-09-16T03:26:00.731 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_bytes": 0, 2024-09-16T03:26:00.731 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_objects": 0, 2024-09-16T03:26:00.731 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_ratio_micro": 400000, 2024-09-16T03:26:00.731 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-16T03:26:00.731 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_full_ratio_micro": 800000, 2024-09-16T03:26:00.732 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_flush_age": 0, 2024-09-16T03:26:00.732 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_evict_age": 0, 2024-09-16T03:26:00.732 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profile": "", 2024-09-16T03:26:00.732 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_params": { 2024-09-16T03:26:00.732 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "none" 2024-09-16T03:26:00.732 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.732 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_period": 0, 2024-09-16T03:26:00.732 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_count": 0, 2024-09-16T03:26:00.732 INFO:tasks.workunit.client.0.smithi096.stderr: "use_gmt_hitset": true, 2024-09-16T03:26:00.732 INFO:tasks.workunit.client.0.smithi096.stderr: "min_read_recency_for_promote": 0, 2024-09-16T03:26:00.732 INFO:tasks.workunit.client.0.smithi096.stderr: "min_write_recency_for_promote": 0, 2024-09-16T03:26:00.732 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_grade_decay_rate": 0, 2024-09-16T03:26:00.732 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_search_last_n": 0, 2024-09-16T03:26:00.733 INFO:tasks.workunit.client.0.smithi096.stderr: "grade_table": [], 2024-09-16T03:26:00.733 INFO:tasks.workunit.client.0.smithi096.stderr: "stripe_width": 0, 2024-09-16T03:26:00.733 INFO:tasks.workunit.client.0.smithi096.stderr: "expected_num_objects": 0, 2024-09-16T03:26:00.733 INFO:tasks.workunit.client.0.smithi096.stderr: "fast_read": false, 2024-09-16T03:26:00.733 INFO:tasks.workunit.client.0.smithi096.stderr: "options": {}, 2024-09-16T03:26:00.733 INFO:tasks.workunit.client.0.smithi096.stderr: "application_metadata": {}, 2024-09-16T03:26:00.733 INFO:tasks.workunit.client.0.smithi096.stderr: "read_balance": { 2024-09-16T03:26:00.733 INFO:tasks.workunit.client.0.smithi096.stderr: "score_type": "Fair distribution", 2024-09-16T03:26:00.733 INFO:tasks.workunit.client.0.smithi096.stderr: "score_acting": 1.4900000095367432, 2024-09-16T03:26:00.733 INFO:tasks.workunit.client.0.smithi096.stderr: "score_stable": 1.4900000095367432, 2024-09-16T03:26:00.733 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_score": 0.67000001668930054, 2024-09-16T03:26:00.733 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_acting": 1, 2024-09-16T03:26:00.733 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_stable": 1, 2024-09-16T03:26:00.734 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity_weighted": 1, 2024-09-16T03:26:00.734 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity": 1, 2024-09-16T03:26:00.734 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity_weighted": 1 2024-09-16T03:26:00.734 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:00.734 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:00.734 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:00.734 INFO:tasks.workunit.client.0.smithi096.stderr: "osds": [ 2024-09-16T03:26:00.734 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.734 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:26:00.734 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6", 2024-09-16T03:26:00.734 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:26:00.734 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:26:00.734 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:26:00.735 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:26:00.735 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:26:00.735 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:26:00.735 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 5, 2024-09-16T03:26:00.735 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 81, 2024-09-16T03:26:00.735 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:26:00.735 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:26:00.735 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:26:00.735 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:00.735 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.735 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:00.736 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6802", 2024-09-16T03:26:00.736 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:26:00.736 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.736 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.736 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:00.736 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6803", 2024-09-16T03:26:00.736 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:26:00.736 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:00.736 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:00.736 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.737 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:26:00.737 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:00.737 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.737 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:00.737 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6804", 2024-09-16T03:26:00.737 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:26:00.737 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.737 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.737 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:00.737 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6805", 2024-09-16T03:26:00.737 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:26:00.738 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:00.738 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:00.738 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.738 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:26:00.738 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:00.738 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.738 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:00.738 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6808", 2024-09-16T03:26:00.738 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:26:00.738 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.738 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.738 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:00.738 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6809", 2024-09-16T03:26:00.739 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:26:00.739 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:00.739 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:00.739 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.739 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:26:00.739 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:00.739 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.739 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:00.739 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6806", 2024-09-16T03:26:00.739 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:26:00.739 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.739 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.739 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:00.739 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6807", 2024-09-16T03:26:00.740 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:26:00.740 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:00.740 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:00.740 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.740 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6803/3375787448", 2024-09-16T03:26:00.740 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6805/3375787448", 2024-09-16T03:26:00.740 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6809/3375787448", 2024-09-16T03:26:00.740 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6807/3375787448", 2024-09-16T03:26:00.740 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:26:00.740 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:26:00.740 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:26:00.740 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:00.740 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.741 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.741 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:26:00.741 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "74b26727-75c9-444d-8782-719e4197a382", 2024-09-16T03:26:00.741 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:26:00.741 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:26:00.741 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:26:00.741 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:26:00.741 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:26:00.741 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:26:00.741 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 10, 2024-09-16T03:26:00.741 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 81, 2024-09-16T03:26:00.741 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:26:00.741 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:26:00.741 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:26:00.742 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:00.742 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.742 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:00.742 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6810", 2024-09-16T03:26:00.742 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:26:00.742 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.742 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.742 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:00.742 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6811", 2024-09-16T03:26:00.742 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:26:00.742 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:00.742 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:00.742 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.743 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:26:00.743 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:00.743 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.743 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:00.743 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6812", 2024-09-16T03:26:00.743 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:26:00.743 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.743 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.743 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:00.744 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6813", 2024-09-16T03:26:00.744 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:26:00.744 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:00.744 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:00.744 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.744 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:26:00.745 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:00.745 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.745 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:00.745 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6816", 2024-09-16T03:26:00.745 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:26:00.745 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.746 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.746 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:00.746 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6817", 2024-09-16T03:26:00.746 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:26:00.746 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:00.746 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:00.746 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.746 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:26:00.747 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:00.747 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.747 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:00.747 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6814", 2024-09-16T03:26:00.747 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:26:00.747 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.747 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.748 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:00.748 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6815", 2024-09-16T03:26:00.748 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:26:00.748 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:00.748 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:00.748 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.748 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6811/3733255132", 2024-09-16T03:26:00.748 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6813/3733255132", 2024-09-16T03:26:00.748 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6817/3733255132", 2024-09-16T03:26:00.748 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6815/3733255132", 2024-09-16T03:26:00.748 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:26:00.748 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:26:00.748 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:26:00.749 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:00.749 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.749 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.749 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:26:00.749 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "143da3a7-dad9-4b1e-966b-76cf5bdd3c82", 2024-09-16T03:26:00.749 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 0, 2024-09-16T03:26:00.749 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 0, 2024-09-16T03:26:00.749 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 0, 2024-09-16T03:26:00.749 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:26:00.749 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:26:00.749 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:26:00.749 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 15, 2024-09-16T03:26:00.749 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 21, 2024-09-16T03:26:00.750 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 33, 2024-09-16T03:26:00.750 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:26:00.750 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:26:00.750 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:00.750 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.750 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:00.750 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6818", 2024-09-16T03:26:00.750 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:26:00.750 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.750 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.750 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:00.750 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6819", 2024-09-16T03:26:00.750 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:26:00.750 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:00.750 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:00.751 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.751 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:26:00.751 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:00.751 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.751 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:00.751 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6820", 2024-09-16T03:26:00.751 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:26:00.751 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.751 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.751 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:00.751 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6821", 2024-09-16T03:26:00.751 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:26:00.751 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:00.752 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:00.752 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.752 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:26:00.752 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:00.752 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.752 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:00.752 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6824", 2024-09-16T03:26:00.752 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:26:00.752 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.752 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.752 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:00.752 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6825", 2024-09-16T03:26:00.752 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:26:00.752 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:00.753 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:00.753 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.753 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:26:00.753 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:00.753 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.753 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:00.753 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6822", 2024-09-16T03:26:00.753 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:26:00.753 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.753 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.753 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:00.753 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6823", 2024-09-16T03:26:00.753 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:26:00.753 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:00.754 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:00.754 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.754 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6819/963814857", 2024-09-16T03:26:00.754 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6821/963814857", 2024-09-16T03:26:00.754 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6825/963814857", 2024-09-16T03:26:00.754 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6823/963814857", 2024-09-16T03:26:00.754 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:26:00.754 INFO:tasks.workunit.client.0.smithi096.stderr: "exists" 2024-09-16T03:26:00.754 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:00.754 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:00.754 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:00.754 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_xinfo": [ 2024-09-16T03:26:00.754 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.754 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:26:00.755 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:26:00.755 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:26:00.755 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:26:00.755 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:26:00.755 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:26:00.755 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:23:22.481942+0000", 2024-09-16T03:26:00.755 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:26:00.755 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.755 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.755 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:26:00.755 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:26:00.755 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:26:00.755 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:26:00.756 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:26:00.756 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:26:00.756 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:23:59.663703+0000", 2024-09-16T03:26:00.756 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:26:00.756 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.756 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.756 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:26:00.756 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:26:00.756 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:26:00.756 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:26:00.756 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:26:00.756 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 65536, 2024-09-16T03:26:00.756 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:24:37.320822+0000", 2024-09-16T03:26:00.756 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 32 2024-09-16T03:26:00.757 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:00.757 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:00.757 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap": [], 2024-09-16T03:26:00.757 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap_items": [], 2024-09-16T03:26:00.757 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap_primaries": [], 2024-09-16T03:26:00.757 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_temp": [], 2024-09-16T03:26:00.757 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_temp": [], 2024-09-16T03:26:00.757 INFO:tasks.workunit.client.0.smithi096.stderr: "blocklist": {}, 2024-09-16T03:26:00.757 INFO:tasks.workunit.client.0.smithi096.stderr: "range_blocklist": {}, 2024-09-16T03:26:00.757 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profiles": { 2024-09-16T03:26:00.757 INFO:tasks.workunit.client.0.smithi096.stderr: "default": { 2024-09-16T03:26:00.757 INFO:tasks.workunit.client.0.smithi096.stderr: "k": "2", 2024-09-16T03:26:00.758 INFO:tasks.workunit.client.0.smithi096.stderr: "m": "2", 2024-09-16T03:26:00.758 INFO:tasks.workunit.client.0.smithi096.stderr: "plugin": "jerasure", 2024-09-16T03:26:00.758 INFO:tasks.workunit.client.0.smithi096.stderr: "technique": "reed_sol_van" 2024-09-16T03:26:00.758 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:00.758 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.758 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps_queue": [], 2024-09-16T03:26:00.758 INFO:tasks.workunit.client.0.smithi096.stderr: "new_removed_snaps": [], 2024-09-16T03:26:00.758 INFO:tasks.workunit.client.0.smithi096.stderr: "new_purged_snaps": [], 2024-09-16T03:26:00.758 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_node_flags": {}, 2024-09-16T03:26:00.759 INFO:tasks.workunit.client.0.smithi096.stderr: "device_class_flags": {}, 2024-09-16T03:26:00.759 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode": { 2024-09-16T03:26:00.759 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode_enabled": false, 2024-09-16T03:26:00.759 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_bucket_count": 0, 2024-09-16T03:26:00.759 INFO:tasks.workunit.client.0.smithi096.stderr: "degraded_stretch_mode": 0, 2024-09-16T03:26:00.759 INFO:tasks.workunit.client.0.smithi096.stderr: "recovering_stretch_mode": 0, 2024-09-16T03:26:00.759 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode_bucket": 0 2024-09-16T03:26:00.759 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:00.759 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.759 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_metadata": [ 2024-09-16T03:26:00.759 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.759 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:26:00.759 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:26:00.759 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]", 2024-09-16T03:26:00.759 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:26:00.760 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:26:00.760 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:26:00.760 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:26:00.760 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:26:00.760 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:26:00.760 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:26:00.760 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:26:00.760 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:26:00.760 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:26:00.760 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:26:00.760 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/0/block", 2024-09-16T03:26:00.760 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:26:00.760 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:26:00.761 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:26:00.761 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:26:00.761 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:26:00.761 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:26:00.761 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:26:00.761 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:26:00.761 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:26:00.761 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:26:00.761 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:22:53.662571Z", 2024-09-16T03:26:00.761 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:26:00.761 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:26:00.761 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:26:00.761 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:26:00.762 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:26:00.762 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:26:00.762 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:26:00.762 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]", 2024-09-16T03:26:00.762 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:26:00.762 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]", 2024-09-16T03:26:00.762 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]", 2024-09-16T03:26:00.762 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:26:00.762 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:26:00.762 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:26:00.762 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:26:00.762 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:26:00.762 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:26:00.763 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:26:00.763 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:26:00.763 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:26:00.763 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/0", 2024-09-16T03:26:00.763 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:26:00.763 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:26:00.763 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:26:00.763 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.763 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.763 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:26:00.763 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:26:00.763 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]", 2024-09-16T03:26:00.763 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:26:00.763 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:26:00.764 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:26:00.764 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:26:00.764 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:26:00.764 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:26:00.764 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:26:00.764 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:26:00.764 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:26:00.764 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:26:00.764 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:26:00.764 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/1/block", 2024-09-16T03:26:00.764 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:26:00.764 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:26:00.764 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:26:00.765 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:26:00.765 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:26:00.765 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:26:00.765 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:26:00.765 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:26:00.765 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:26:00.765 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:26:00.765 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:23:30.129885Z", 2024-09-16T03:26:00.765 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:26:00.765 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:26:00.765 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:26:00.765 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:26:00.765 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:26:00.766 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:26:00.766 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:26:00.766 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]", 2024-09-16T03:26:00.766 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:26:00.766 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]", 2024-09-16T03:26:00.766 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]", 2024-09-16T03:26:00.766 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:26:00.766 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:26:00.766 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:26:00.766 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:26:00.766 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:26:00.766 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:26:00.766 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:26:00.766 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:26:00.767 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:26:00.767 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/1", 2024-09-16T03:26:00.767 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:26:00.767 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:26:00.767 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:26:00.767 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.767 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.767 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:26:00.767 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:26:00.767 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]", 2024-09-16T03:26:00.767 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:26:00.767 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:26:00.767 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:26:00.768 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:26:00.768 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:26:00.768 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:26:00.768 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:26:00.768 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:26:00.768 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:26:00.769 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:26:00.769 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:26:00.769 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/2/block", 2024-09-16T03:26:00.769 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:26:00.769 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:26:00.769 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:26:00.769 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:26:00.769 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:26:00.769 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:26:00.769 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:26:00.769 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:26:00.769 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:26:00.770 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:26:00.770 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:24:07.764502Z", 2024-09-16T03:26:00.770 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:26:00.770 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:26:00.770 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:26:00.770 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:26:00.770 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:26:00.770 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:26:00.770 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:26:00.770 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]", 2024-09-16T03:26:00.770 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:26:00.770 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]", 2024-09-16T03:26:00.770 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]", 2024-09-16T03:26:00.771 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:26:00.771 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:26:00.771 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:26:00.771 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:26:00.771 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:26:00.771 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:26:00.771 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:26:00.771 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:26:00.771 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:26:00.771 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/2", 2024-09-16T03:26:00.771 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:26:00.771 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:26:00.771 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:26:00.771 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:00.772 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:00.772 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_clean_epochs": { 2024-09-16T03:26:00.772 INFO:tasks.workunit.client.0.smithi096.stderr: "min_last_epoch_clean": 28, 2024-09-16T03:26:00.772 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": { 2024-09-16T03:26:00.772 INFO:tasks.workunit.client.0.smithi096.stderr: "per_pool": [ 2024-09-16T03:26:00.772 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.772 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 1, 2024-09-16T03:26:00.772 INFO:tasks.workunit.client.0.smithi096.stderr: "floor": 28 2024-09-16T03:26:00.772 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.772 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.772 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 2, 2024-09-16T03:26:00.772 INFO:tasks.workunit.client.0.smithi096.stderr: "floor": 28 2024-09-16T03:26:00.772 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:00.772 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:00.773 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.773 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_epochs": [ 2024-09-16T03:26:00.773 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.773 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:26:00.773 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 78 2024-09-16T03:26:00.773 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.773 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.773 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:26:00.773 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 80 2024-09-16T03:26:00.773 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:00.773 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:00.773 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.773 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_first_committed": 28, 2024-09-16T03:26:00.773 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_last_committed": 83, 2024-09-16T03:26:00.774 INFO:tasks.workunit.client.0.smithi096.stderr: "crushmap": { 2024-09-16T03:26:00.774 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": [ 2024-09-16T03:26:00.774 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.774 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:26:00.774 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.0", 2024-09-16T03:26:00.774 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:26:00.774 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.774 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.774 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:26:00.774 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.1", 2024-09-16T03:26:00.774 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:26:00.774 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.774 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.774 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:26:00.775 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.2", 2024-09-16T03:26:00.775 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:26:00.775 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:00.775 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:00.775 INFO:tasks.workunit.client.0.smithi096.stderr: "types": [ 2024-09-16T03:26:00.775 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.775 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 0, 2024-09-16T03:26:00.775 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd" 2024-09-16T03:26:00.775 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.775 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.775 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:26:00.775 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "host" 2024-09-16T03:26:00.775 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.775 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.776 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 2, 2024-09-16T03:26:00.776 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "chassis" 2024-09-16T03:26:00.776 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.776 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.776 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 3, 2024-09-16T03:26:00.776 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "rack" 2024-09-16T03:26:00.776 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.776 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.776 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 4, 2024-09-16T03:26:00.776 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "row" 2024-09-16T03:26:00.776 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.776 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.776 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 5, 2024-09-16T03:26:00.776 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "pdu" 2024-09-16T03:26:00.777 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.777 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.777 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 6, 2024-09-16T03:26:00.777 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "pod" 2024-09-16T03:26:00.777 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.777 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.777 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 7, 2024-09-16T03:26:00.777 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "room" 2024-09-16T03:26:00.777 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.777 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.777 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 8, 2024-09-16T03:26:00.777 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "datacenter" 2024-09-16T03:26:00.777 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.777 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.778 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 9, 2024-09-16T03:26:00.778 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "zone" 2024-09-16T03:26:00.778 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.778 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.778 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 10, 2024-09-16T03:26:00.778 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "region" 2024-09-16T03:26:00.778 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.778 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.778 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:26:00.778 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "root" 2024-09-16T03:26:00.778 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:00.779 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:00.779 INFO:tasks.workunit.client.0.smithi096.stderr: "buckets": [ 2024-09-16T03:26:00.779 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.779 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -1, 2024-09-16T03:26:00.779 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "default", 2024-09-16T03:26:00.779 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:26:00.779 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "root", 2024-09-16T03:26:00.779 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:26:00.780 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:26:00.780 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:26:00.780 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:26:00.780 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.780 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -3, 2024-09-16T03:26:00.780 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:26:00.780 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:26:00.780 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:00.780 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:00.780 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.780 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.780 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -2, 2024-09-16T03:26:00.780 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "default~hdd", 2024-09-16T03:26:00.780 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:26:00.781 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "root", 2024-09-16T03:26:00.781 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:26:00.781 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:26:00.781 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:26:00.781 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:26:00.781 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.781 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -4, 2024-09-16T03:26:00.781 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:26:00.781 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:26:00.781 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:00.781 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:00.781 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.781 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.782 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -3, 2024-09-16T03:26:00.782 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "smithi096", 2024-09-16T03:26:00.782 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:26:00.782 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "host", 2024-09-16T03:26:00.782 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:26:00.782 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:26:00.782 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:26:00.782 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:26:00.782 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.782 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:26:00.782 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:26:00.782 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:26:00.782 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.782 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.783 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:26:00.783 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:26:00.783 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 1 2024-09-16T03:26:00.783 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.783 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.783 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:26:00.783 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:26:00.783 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 2 2024-09-16T03:26:00.783 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:00.783 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:00.783 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.783 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.784 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -4, 2024-09-16T03:26:00.784 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "smithi096~hdd", 2024-09-16T03:26:00.784 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:26:00.784 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "host", 2024-09-16T03:26:00.784 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:26:00.784 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:26:00.784 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:26:00.784 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:26:00.784 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.784 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:26:00.785 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:26:00.785 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:26:00.785 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.785 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.785 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:26:00.785 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:26:00.785 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 1 2024-09-16T03:26:00.785 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.785 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.785 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:26:00.785 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:26:00.785 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 2 2024-09-16T03:26:00.785 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:00.785 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:00.786 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:00.786 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:00.786 INFO:tasks.workunit.client.0.smithi096.stderr: "rules": [ 2024-09-16T03:26:00.786 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.786 INFO:tasks.workunit.client.0.smithi096.stderr: "rule_id": 0, 2024-09-16T03:26:00.786 INFO:tasks.workunit.client.0.smithi096.stderr: "rule_name": "replicated_rule", 2024-09-16T03:26:00.786 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:26:00.786 INFO:tasks.workunit.client.0.smithi096.stderr: "steps": [ 2024-09-16T03:26:00.786 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.786 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "take", 2024-09-16T03:26:00.786 INFO:tasks.workunit.client.0.smithi096.stderr: "item": -1, 2024-09-16T03:26:00.787 INFO:tasks.workunit.client.0.smithi096.stderr: "item_name": "default" 2024-09-16T03:26:00.787 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.787 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.787 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "choose_firstn", 2024-09-16T03:26:00.787 INFO:tasks.workunit.client.0.smithi096.stderr: "num": 0, 2024-09-16T03:26:00.787 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "osd" 2024-09-16T03:26:00.787 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.787 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.787 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "emit" 2024-09-16T03:26:00.787 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:00.787 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:00.787 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:00.787 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:00.788 INFO:tasks.workunit.client.0.smithi096.stderr: "tunables": { 2024-09-16T03:26:00.788 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_local_tries": 0, 2024-09-16T03:26:00.788 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_local_fallback_tries": 0, 2024-09-16T03:26:00.788 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_total_tries": 50, 2024-09-16T03:26:00.788 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_descend_once": 1, 2024-09-16T03:26:00.788 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_vary_r": 1, 2024-09-16T03:26:00.788 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_stable": 1, 2024-09-16T03:26:00.788 INFO:tasks.workunit.client.0.smithi096.stderr: "msr_descents": 100, 2024-09-16T03:26:00.788 INFO:tasks.workunit.client.0.smithi096.stderr: "msr_collision_tries": 100, 2024-09-16T03:26:00.788 INFO:tasks.workunit.client.0.smithi096.stderr: "straw_calc_version": 1, 2024-09-16T03:26:00.788 INFO:tasks.workunit.client.0.smithi096.stderr: "allowed_bucket_algs": 54, 2024-09-16T03:26:00.789 INFO:tasks.workunit.client.0.smithi096.stderr: "profile": "jewel", 2024-09-16T03:26:00.789 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_tunables": 1, 2024-09-16T03:26:00.789 INFO:tasks.workunit.client.0.smithi096.stderr: "legacy_tunables": 0, 2024-09-16T03:26:00.789 INFO:tasks.workunit.client.0.smithi096.stderr: "minimum_required_version": "jewel", 2024-09-16T03:26:00.789 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables": 1, 2024-09-16T03:26:00.789 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables2": 1, 2024-09-16T03:26:00.789 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v2_rules": 0, 2024-09-16T03:26:00.789 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables3": 1, 2024-09-16T03:26:00.789 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v3_rules": 0, 2024-09-16T03:26:00.790 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v4_buckets": 1, 2024-09-16T03:26:00.790 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables5": 1, 2024-09-16T03:26:00.790 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v5_rules": 0, 2024-09-16T03:26:00.790 INFO:tasks.workunit.client.0.smithi096.stderr: "has_msr_rules": 0 2024-09-16T03:26:00.790 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.790 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_args": {} 2024-09-16T03:26:00.790 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.790 INFO:tasks.workunit.client.0.smithi096.stderr: "fsmap": { 2024-09-16T03:26:00.790 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 1, 2024-09-16T03:26:00.791 INFO:tasks.workunit.client.0.smithi096.stderr: "btime": "2024-09-16T03:22:46:882186+0000", 2024-09-16T03:26:00.791 INFO:tasks.workunit.client.0.smithi096.stderr: "default_fscid": -1, 2024-09-16T03:26:00.791 INFO:tasks.workunit.client.0.smithi096.stderr: "compat": { 2024-09-16T03:26:00.791 INFO:tasks.workunit.client.0.smithi096.stderr: "compat": {}, 2024-09-16T03:26:00.791 INFO:tasks.workunit.client.0.smithi096.stderr: "ro_compat": {}, 2024-09-16T03:26:00.791 INFO:tasks.workunit.client.0.smithi096.stderr: "incompat": { 2024-09-16T03:26:00.791 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_1": "base v0.20", 2024-09-16T03:26:00.791 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_2": "client writeable ranges", 2024-09-16T03:26:00.791 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_3": "default file layouts on dirs", 2024-09-16T03:26:00.791 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_4": "dir inode in separate object", 2024-09-16T03:26:00.791 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_5": "mds uses versioned encoding", 2024-09-16T03:26:00.791 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_6": "dirfrag is stored in omap", 2024-09-16T03:26:00.791 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_8": "no anchor table", 2024-09-16T03:26:00.791 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_9": "file layout v2", 2024-09-16T03:26:00.792 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_10": "snaprealm v2", 2024-09-16T03:26:00.792 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_11": "minor log segments", 2024-09-16T03:26:00.792 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_12": "quiesce subvolumes" 2024-09-16T03:26:00.792 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:00.792 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.792 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_flags": { 2024-09-16T03:26:00.793 INFO:tasks.workunit.client.0.smithi096.stderr: "enable_multiple": true, 2024-09-16T03:26:00.793 INFO:tasks.workunit.client.0.smithi096.stderr: "ever_enabled_multiple": true 2024-09-16T03:26:00.793 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.793 INFO:tasks.workunit.client.0.smithi096.stderr: "standbys": [], 2024-09-16T03:26:00.793 INFO:tasks.workunit.client.0.smithi096.stderr: "filesystems": [] 2024-09-16T03:26:00.793 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.794 INFO:tasks.workunit.client.0.smithi096.stderr: "mdsmap_first_committed": 1, 2024-09-16T03:26:00.794 INFO:tasks.workunit.client.0.smithi096.stderr: "mdsmap_last_committed": 1, 2024-09-16T03:26:00.794 INFO:tasks.workunit.client.0.smithi096.stderr: "auth": { 2024-09-16T03:26:00.794 INFO:tasks.workunit.client.0.smithi096.stderr: "first_committed": 1, 2024-09-16T03:26:00.794 INFO:tasks.workunit.client.0.smithi096.stderr: "last_committed": 5, 2024-09-16T03:26:00.794 INFO:tasks.workunit.client.0.smithi096.stderr: "num_secrets": 3 2024-09-16T03:26:00.794 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.794 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 64, 2024-09-16T03:26:00.795 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_active": 64, 2024-09-16T03:26:00.795 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_unknown": 0, 2024-09-16T03:26:00.795 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osd": 3, 2024-09-16T03:26:00.795 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_sum": { 2024-09-16T03:26:00.795 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:26:00.795 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:26:00.796 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:26:00.796 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:26:00.796 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:26:00.796 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:26:00.796 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:26:00.796 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:26:00.796 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:26:00.796 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:26:00.797 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:26:00.797 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:26:00.797 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:26:00.797 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:26:00.797 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:26:00.797 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:26:00.797 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:26:00.798 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:26:00.798 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:26:00.798 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:26:00.798 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:26:00.798 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:26:00.798 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:26:00.799 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:26:00.799 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:26:00.799 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:26:00.799 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:26:00.799 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:26:00.799 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:26:00.800 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:26:00.800 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:26:00.800 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:26:00.800 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:26:00.800 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:26:00.800 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:26:00.800 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:26:00.800 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:26:00.801 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:26:00.801 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:26:00.801 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:26:00.801 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:26:00.801 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.801 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:26:00.801 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:26:00.801 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:26:00.801 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:26:00.801 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:26:00.802 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:26:00.802 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:26:00.802 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:26:00.802 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:26:00.802 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:26:00.802 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:26:00.802 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.802 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:26:00.802 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:26:00.803 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 128, 2024-09-16T03:26:00.803 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 128, 2024-09-16T03:26:00.803 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 0 2024-09-16T03:26:00.803 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.803 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_sum": { 2024-09-16T03:26:00.803 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 0, 2024-09-16T03:26:00.803 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 0, 2024-09-16T03:26:00.803 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pgs": 128, 2024-09-16T03:26:00.803 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osds": 2, 2024-09-16T03:26:00.803 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_osds": 2, 2024-09-16T03:26:00.803 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_omap_osds": 2, 2024-09-16T03:26:00.803 INFO:tasks.workunit.client.0.smithi096.stderr: "kb": 209715200, 2024-09-16T03:26:00.803 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used": 54580, 2024-09-16T03:26:00.803 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_data": 888, 2024-09-16T03:26:00.803 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_omap": 3, 2024-09-16T03:26:00.804 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_meta": 53628, 2024-09-16T03:26:00.804 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_avail": 209660620, 2024-09-16T03:26:00.804 INFO:tasks.workunit.client.0.smithi096.stderr: "statfs": { 2024-09-16T03:26:00.804 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 214748364800, 2024-09-16T03:26:00.804 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 214692474880, 2024-09-16T03:26:00.804 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:26:00.804 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 909312, 2024-09-16T03:26:00.804 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 340452, 2024-09-16T03:26:00.804 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:26:00.804 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:26:00.804 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:26:00.804 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 3190, 2024-09-16T03:26:00.805 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 54915978 2024-09-16T03:26:00.805 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.805 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_peers": [], 2024-09-16T03:26:00.805 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_trim_queue_len": 0, 2024-09-16T03:26:00.805 INFO:tasks.workunit.client.0.smithi096.stderr: "num_snap_trimming": 0, 2024-09-16T03:26:00.805 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shards_repaired": 0, 2024-09-16T03:26:00.805 INFO:tasks.workunit.client.0.smithi096.stderr: "op_queue_age_hist": { 2024-09-16T03:26:00.805 INFO:tasks.workunit.client.0.smithi096.stderr: "histogram": [], 2024-09-16T03:26:00.805 INFO:tasks.workunit.client.0.smithi096.stderr: "upper_bound": 1 2024-09-16T03:26:00.805 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.806 INFO:tasks.workunit.client.0.smithi096.stderr: "perf_stat": { 2024-09-16T03:26:00.806 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ms": 315, 2024-09-16T03:26:00.806 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ms": 315, 2024-09-16T03:26:00.806 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ns": 315000000, 2024-09-16T03:26:00.806 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ns": 315000000 2024-09-16T03:26:00.806 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.806 INFO:tasks.workunit.client.0.smithi096.stderr: "alerts": [], 2024-09-16T03:26:00.806 INFO:tasks.workunit.client.0.smithi096.stderr: "network_ping_times": [] 2024-09-16T03:26:00.806 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.806 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_sum_by_class": { 2024-09-16T03:26:00.806 INFO:tasks.workunit.client.0.smithi096.stderr: "hdd": { 2024-09-16T03:26:00.806 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 0, 2024-09-16T03:26:00.806 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 0, 2024-09-16T03:26:00.807 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pgs": 128, 2024-09-16T03:26:00.807 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osds": 2, 2024-09-16T03:26:00.807 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_osds": 2, 2024-09-16T03:26:00.807 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_omap_osds": 2, 2024-09-16T03:26:00.807 INFO:tasks.workunit.client.0.smithi096.stderr: "kb": 209715200, 2024-09-16T03:26:00.807 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used": 54580, 2024-09-16T03:26:00.807 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_data": 888, 2024-09-16T03:26:00.807 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_omap": 3, 2024-09-16T03:26:00.807 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_meta": 53628, 2024-09-16T03:26:00.807 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_avail": 209660620, 2024-09-16T03:26:00.807 INFO:tasks.workunit.client.0.smithi096.stderr: "statfs": { 2024-09-16T03:26:00.807 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 214748364800, 2024-09-16T03:26:00.808 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 214692474880, 2024-09-16T03:26:00.808 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:26:00.808 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 909312, 2024-09-16T03:26:00.808 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 340452, 2024-09-16T03:26:00.808 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:26:00.808 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:26:00.808 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:26:00.808 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 3190, 2024-09-16T03:26:00.808 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 54915978 2024-09-16T03:26:00.808 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.808 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_peers": [], 2024-09-16T03:26:00.808 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_trim_queue_len": 0, 2024-09-16T03:26:00.808 INFO:tasks.workunit.client.0.smithi096.stderr: "num_snap_trimming": 0, 2024-09-16T03:26:00.809 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shards_repaired": 0, 2024-09-16T03:26:00.809 INFO:tasks.workunit.client.0.smithi096.stderr: "op_queue_age_hist": { 2024-09-16T03:26:00.809 INFO:tasks.workunit.client.0.smithi096.stderr: "histogram": [], 2024-09-16T03:26:00.809 INFO:tasks.workunit.client.0.smithi096.stderr: "upper_bound": 1 2024-09-16T03:26:00.809 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.809 INFO:tasks.workunit.client.0.smithi096.stderr: "perf_stat": { 2024-09-16T03:26:00.809 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ms": 315, 2024-09-16T03:26:00.809 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ms": 315, 2024-09-16T03:26:00.809 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ns": 315000000, 2024-09-16T03:26:00.809 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ns": 315000000 2024-09-16T03:26:00.809 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.809 INFO:tasks.workunit.client.0.smithi096.stderr: "alerts": [], 2024-09-16T03:26:00.809 INFO:tasks.workunit.client.0.smithi096.stderr: "network_ping_times": [] 2024-09-16T03:26:00.810 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:00.810 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.810 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_stats": [ 2024-09-16T03:26:00.810 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.810 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 2, 2024-09-16T03:26:00.810 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 32, 2024-09-16T03:26:00.810 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:26:00.811 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:26:00.811 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:26:00.811 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:26:00.811 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:26:00.811 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:26:00.811 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:26:00.811 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:26:00.812 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:26:00.812 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:26:00.812 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:26:00.812 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:26:00.812 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:26:00.812 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:26:00.812 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:26:00.812 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:26:00.813 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:26:00.813 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:26:00.813 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:26:00.813 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:26:00.813 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:26:00.813 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:26:00.813 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:26:00.813 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:26:00.813 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:26:00.813 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:26:00.813 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:26:00.813 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:26:00.813 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:26:00.813 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:26:00.814 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:26:00.814 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:26:00.814 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:26:00.814 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:26:00.814 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:26:00.814 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:26:00.814 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:26:00.814 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:26:00.814 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:26:00.814 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:26:00.814 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:26:00.814 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.814 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:26:00.815 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:26:00.815 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:26:00.815 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:26:00.815 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:26:00.815 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:26:00.815 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:26:00.815 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:26:00.815 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:26:00.815 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:26:00.815 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:26:00.815 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.815 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:26:00.815 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:26:00.815 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 64, 2024-09-16T03:26:00.816 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 64, 2024-09-16T03:26:00.816 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 3 2024-09-16T03:26:00.816 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.816 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.816 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 1, 2024-09-16T03:26:00.816 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 32, 2024-09-16T03:26:00.816 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:26:00.816 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:26:00.816 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:26:00.816 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:26:00.816 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:26:00.816 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:26:00.816 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:26:00.817 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:26:00.817 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:26:00.817 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:26:00.817 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:26:00.817 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:26:00.817 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:26:00.817 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:26:00.817 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:26:00.817 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:26:00.817 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:26:00.817 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:26:00.817 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:26:00.817 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:26:00.817 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:26:00.818 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:26:00.818 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:26:00.818 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:26:00.818 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:26:00.818 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:26:00.818 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:26:00.818 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:26:00.818 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:26:00.818 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:26:00.818 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:26:00.818 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:26:00.818 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:26:00.819 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:26:00.819 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:26:00.819 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:26:00.819 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:26:00.819 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:26:00.819 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:26:00.819 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:26:00.819 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:26:00.819 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.819 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:26:00.819 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:26:00.819 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:26:00.819 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:26:00.819 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:26:00.820 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:26:00.820 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:26:00.820 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:26:00.820 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:26:00.820 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:26:00.820 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:26:00.820 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.821 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:26:00.821 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:26:00.821 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 64, 2024-09-16T03:26:00.821 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 64, 2024-09-16T03:26:00.821 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 3 2024-09-16T03:26:00.821 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:00.821 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:00.821 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_stats": [ 2024-09-16T03:26:00.821 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.822 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:26:00.822 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 21474836518 2024-09-16T03:26:00.822 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.822 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.822 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:26:00.822 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 42949672989 2024-09-16T03:26:00.822 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.822 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.822 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:26:00.823 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 0 2024-09-16T03:26:00.823 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:00.823 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:00.823 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_by_state": [ 2024-09-16T03:26:00.823 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.823 INFO:tasks.workunit.client.0.smithi096.stderr: "state": "active+clean", 2024-09-16T03:26:00.824 INFO:tasks.workunit.client.0.smithi096.stderr: "num": 16 2024-09-16T03:26:00.824 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.824 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.824 INFO:tasks.workunit.client.0.smithi096.stderr: "state": "active+undersized", 2024-09-16T03:26:00.824 INFO:tasks.workunit.client.0.smithi096.stderr: "num": 48 2024-09-16T03:26:00.824 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:00.824 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:00.824 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_by_osd": [ 2024-09-16T03:26:00.824 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.824 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:26:00.824 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 0, 2024-09-16T03:26:00.825 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 0, 2024-09-16T03:26:00.825 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:26:00.825 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.825 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.825 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:26:00.825 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 28, 2024-09-16T03:26:00.825 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 64, 2024-09-16T03:26:00.825 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:26:00.825 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.825 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.825 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:26:00.826 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 36, 2024-09-16T03:26:00.826 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 64, 2024-09-16T03:26:00.826 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:26:00.826 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:00.826 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:00.826 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": [ 2024-09-16T03:26:00.826 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.826 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 1, 2024-09-16T03:26:00.826 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": {} 2024-09-16T03:26:00.826 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.826 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:00.826 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 2, 2024-09-16T03:26:00.826 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": {} 2024-09-16T03:26:00.827 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:00.827 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:00.827 INFO:tasks.workunit.client.0.smithi096.stderr: "servicemap": { 2024-09-16T03:26:00.827 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 5, 2024-09-16T03:26:00.827 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:25:38.422788+0000", 2024-09-16T03:26:00.827 INFO:tasks.workunit.client.0.smithi096.stderr: "services": {} 2024-09-16T03:26:00.827 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:00.827 INFO:tasks.workunit.client.0.smithi096.stderr: "mgrstat_first_committed": 79, 2024-09-16T03:26:00.827 INFO:tasks.workunit.client.0.smithi096.stderr: "mgrstat_last_committed": 86, 2024-09-16T03:26:00.827 INFO:tasks.workunit.client.0.smithi096.stderr: "logm_first_committed": 1, 2024-09-16T03:26:00.827 INFO:tasks.workunit.client.0.smithi096.stderr: "logm_last_committed": 379, 2024-09-16T03:26:00.827 INFO:tasks.workunit.client.0.smithi096.stderr: "paxos": { 2024-09-16T03:26:00.827 INFO:tasks.workunit.client.0.smithi096.stderr: "first_committed": 1, 2024-09-16T03:26:00.827 INFO:tasks.workunit.client.0.smithi096.stderr: "last_committed": 565, 2024-09-16T03:26:00.828 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pn": 0, 2024-09-16T03:26:00.828 INFO:tasks.workunit.client.0.smithi096.stderr: "accepted_pn": 0 2024-09-16T03:26:00.828 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:00.828 INFO:tasks.workunit.client.0.smithi096.stderr:}' 2024-09-16T03:26:00.828 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:80: check_floor_pool_greater_than_pool: floor_a=($(echo $report | jq ".osdmap_clean_epochs.last_epoch_clean.per_pool[] |" " select(.poolid == $pool_a) | .floor")) 2024-09-16T03:26:00.833 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:80: check_floor_pool_greater_than_pool: jq '.osdmap_clean_epochs.last_epoch_clean.per_pool[] |' ' select(.poolid == 2) | .floor' 2024-09-16T03:26:00.833 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:80: check_floor_pool_greater_than_pool: echo '{' '"cluster_fingerprint":' '"fda2fc64-07ed-4add-8224-2e527e11d427",' '"version":' '"19.3.0-4930-gfc3e0bff",' '"commit":' '"fc3e0bff7468fd55478adbae7f75508b749124b6",' '"timestamp":' '"2024-09-16T03:26:00.694082+0000",' '"tag":' '"",' '"health":' '{' '"status":' '"HEALTH_OK",' '"checks":' '{},' '"mutes":' '[]' '},' '"monmap_first_committed":' 1, '"monmap_last_committed":' 1, '"monmap":' '{' '"epoch":' 1, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"modified":' '"2024-09-16T03:22:45.872880Z",' '"created":' '"2024-09-16T03:22:45.872880Z",' '"min_mon_release":' 19, '"min_mon_release_name":' '"squid",' '"election_strategy":' 1, '"disallowed_leaders:' '":' '"",' '"stretch_mode":' false, '"tiebreaker_mon":' '"",' '"removed_ranks:' '":' '"",' '"features":' '{' '"persistent":' '[' '"kraken",' '"luminous",' '"mimic",' '"osdmap-prune",' '"nautilus",' '"octopus",' '"pacific",' '"elector-pinging",' '"quincy",' '"reef",' '"squid"' '],' '"optional":' '[]' '},' '"mons":' '[' '{' '"rank":' 0, '"name":' '"a",' '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:7302",' '"nonce":' 0 '}' ']' '},' '"addr":' '"127.0.0.1:7302/0",' '"public_addr":' '"127.0.0.1:7302/0",' '"priority":' 0, '"weight":' 0, '"crush_location":' '"{}"' '}' ']' '},' '"quorum":' '[' 0 '],' '"osdmap":' '{' '"epoch":' 83, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"created":' '"2024-09-16T03:22:46.906117+0000",' '"modified":' '"2024-09-16T03:25:57.328949+0000",' '"last_up_change":' '"2024-09-16T03:25:08.513363+0000",' '"last_in_change":' '"2024-09-16T03:25:09.839444+0000",' '"flags":' '"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit",' '"flags_num":' 5799936, '"flags_set":' '[' '"pglog_hardlimit",' '"purged_snapdirs",' '"recovery_deletes",' '"sortbitwise"' '],' '"crush_version":' 7, '"full_ratio":' 0.97000002861022949, '"backfillfull_ratio":' 0.97000002861022949, '"nearfull_ratio":' 0.85000002384185791, '"cluster_snapshot":' '"",' '"pool_max":' 2, '"max_osd":' 3, '"require_min_compat_client":' '"luminous",' '"min_compat_client":' '"jewel",' '"require_osd_release":' '"squid",' '"allow_crimson":' false, '"pools":' '[' '{' '"pool":' 1, '"pool_name":' '"foo",' '"create_time":' '"2024-09-16T03:24:44.525189+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"30",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.8700000047683716, '"score_stable":' 1.8700000047683716, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1.25, '"raw_score_stable":' 1.25, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '},' '{' '"pool":' 2, '"pool_name":' '"bar",' '"create_time":' '"2024-09-16T03:24:46.226575+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 2, '"min_size":' 1, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"83",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.4900000095367432, '"score_stable":' 1.4900000095367432, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1, '"raw_score_stable":' 1, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '}' '],' '"osds":' '[' '{' '"osd":' 0, '"uuid":' '"64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 5, '"up_thru":' 81, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6802",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6803",' '"nonce":' 3375787448 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6804",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6805",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6808",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6809",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6806",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6807",' '"nonce":' 3375787448 '}' ']' '},' '"public_addr":' '"127.0.0.1:6803/3375787448",' '"cluster_addr":' '"127.0.0.1:6805/3375787448",' '"heartbeat_back_addr":' '"127.0.0.1:6809/3375787448",' '"heartbeat_front_addr":' '"127.0.0.1:6807/3375787448",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 1, '"uuid":' '"74b26727-75c9-444d-8782-719e4197a382",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primjq: error: syntax error, unexpected $end (Unix shell quoting issues?) at , line 1: 2024-09-16T03:26:00.833 INFO:tasks.workunit.client.0.smithi096.stderr:.osdmap_clean_epochs.last_epoch_clean.per_pool[] | 2024-09-16T03:26:00.833 INFO:tasks.workunit.client.0.smithi096.stderr:jq: 1 compile error 2024-09-16T03:26:00.833 INFO:tasks.workunit.client.0.smithi096.stderr:ary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 10, '"up_thru":' 81, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6810",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6811",' '"nonce":' 3733255132 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6812",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6813",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6816",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6817",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6814",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6815",' '"nonce":' 3733255132 '}' ']' '},' '"public_addr":' '"127.0.0.1:6811/3733255132",' '"cluster_addr":' '"127.0.0.1:6813/3733255132",' '"heartbeat_back_addr":' '"127.0.0.1:6817/3733255132",' '"heartbeat_front_addr":' '"127.0.0.1:6815/3733255132",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 2, '"uuid":' '"143da3a7-dad9-4b1e-966b-76cf5bdd3c82",' '"up":' 0, '"in":' 0, '"weight":' 0, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 15, '"up_thru":' 21, '"down_at":' 33, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6818",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6819",' '"nonce":' 963814857 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6820",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6821",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6824",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6825",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6822",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6823",' '"nonce":' 963814857 '}' ']' '},' '"public_addr":' '"127.0.0.1:6819/963814857",' '"cluster_addr":' '"127.0.0.1:6821/963814857",' '"heartbeat_back_addr":' '"127.0.0.1:6825/963814857",' '"heartbeat_front_addr":' '"127.0.0.1:6823/963814857",' '"state":' '[' '"exists"' ']' '}' '],' '"osd_xinfo":' '[' '{' '"osd":' 0, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:22.481942+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 1, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:59.663703+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 2, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 65536, '"last_purged_snaps_scrub":' '"2024-09-16T03:24:37.320822+0000",' '"dead_epoch":' 32 '}' '],' '"pg_upmap":' '[],' '"pg_upmap_items":' '[],' '"pg_upmap_primaries":' '[],' '"pg_temp":' '[],' '"primary_temp":' '[],' '"blocklist":' '{},' '"range_blocklist":' '{},' '"erasure_code_profiles":' '{' '"default":' '{' '"k":' '"2",' '"m":' '"2",' '"plugin":' '"jerasure",' '"technique":' '"reed_sol_van"' '}' '},' '"removed_snaps_queue":' '[],' '"new_removed_snaps":' '[],' '"new_purged_snaps":' '[],' '"crush_node_flags":' '{},' '"device_class_flags":' '{},' '"stretch_mode":' '{' '"stretch_mode_enabled":' false, '"stretch_bucket_count":' 0, '"degraded_stretch_mode":' 0, '"recovering_stretch_mode":' 0, '"stretch_mode_bucket":' 0 '}' '},' '"osd_metadata":' '[' '{' '"id":' 0, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/0/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:22:53.662571Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]",' '"hb_front_addr":' '"[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/0",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 1, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/1/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:23:30.129885Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]",' '"hb_front_addr":' '"[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/1",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 2, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/2/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:24:07.764502Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]",' '"hb_front_addr":' '"[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/2",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '}' '],' '"osdmap_clean_epochs":' '{' '"min_last_epoch_clean":' 28, '"last_epoch_clean":' '{' '"per_pool":' '[' '{' '"poolid":' 1, '"floor":' 28 '},' '{' '"poolid":' 2, '"floor":' 28 '}' ']' '},' '"osd_epochs":' '[' '{' '"id":' 0, '"epoch":' 78 '},' '{' '"id":' 1, '"epoch":' 80 '}' ']' '},' '"osdmap_first_committed":' 28, '"osdmap_last_committed":' 83, '"crushmap":' '{' '"devices":' '[' '{' '"id":' 0, '"name":' '"osd.0",' '"class":' '"hdd"' '},' '{' '"id":' 1, '"name":' '"osd.1",' '"class":' '"hdd"' '},' '{' '"id":' 2, '"name":' '"osd.2",' '"class":' '"hdd"' '}' '],' '"types":' '[' '{' '"type_id":' 0, '"name":' '"osd"' '},' '{' '"type_id":' 1, '"name":' '"host"' '},' '{' '"type_id":' 2, '"name":' '"chassis"' '},' '{' '"type_id":' 3, '"name":' '"rack"' '},' '{' '"type_id":' 4, '"name":' '"row"' '},' '{' '"type_id":' 5, '"name":' '"pdu"' '},' '{' '"type_id":' 6, '"name":' '"pod"' '},' '{' '"type_id":' 7, '"name":' '"room"' '},' '{' '"type_id":' 8, '"name":' '"datacenter"' '},' '{' '"type_id":' 9, '"name":' '"zone"' '},' '{' '"type_id":' 10, '"name":' '"region"' '},' '{' '"type_id":' 11, '"name":' '"root"' '}' '],' '"buckets":' '[' '{' '"id":' -1, '"name":' '"default",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -3, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -2, '"name":' '"default~hdd",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -4, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -3, '"name":' '"smithi096",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '},' '{' '"id":' -4, '"name":' '"smithi096~hdd",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '}' '],' '"rules":' '[' '{' '"rule_id":' 0, '"rule_name":' '"replicated_rule",' '"type":' 1, '"steps":' '[' '{' '"op":' '"take",' '"item":' -1, '"item_name":' '"default"' '},' '{' '"op":' '"choose_firstn",' '"num":' 0, '"type":' '"osd"' '},' '{' '"op":' '"emit"' '}' ']' '}' '],' '"tunables":' '{' '"choose_local_tries":' 0, '"choose_local_fallback_tries":' 0, '"choose_total_tries":' 50, '"chooseleaf_descend_once":' 1, '"chooseleaf_vary_r":' 1, '"chooseleaf_stable":' 1, '"msr_descents":' 100, '"msr_collision_tries":' 100, '"straw_calc_version":' 1, '"allowed_bucket_algs":' 54, '"profile":' '"jewel",' '"optimal_tunables":' 1, '"legacy_tunables":' 0, '"minimum_required_version":' '"jewel",' '"require_feature_tunables":' 1, '"require_feature_tunables2":' 1, '"has_v2_rules":' 0, '"require_feature_tunables3":' 1, '"has_v3_rules":' 0, '"has_v4_buckets":' 1, '"require_feature_tunables5":' 1, '"has_v5_rules":' 0, '"has_msr_rules":' 0 '},' '"choose_args":' '{}' '},' '"fsmap":' '{' '"epoch":' 1, '"btime":' '"2024-09-16T03:22:46:882186+0000",' '"default_fscid":' -1, '"compat":' '{' '"compat":' '{},' '"ro_compat":' '{},' '"incompat":' '{' '"feature_1":' '"base' 'v0.20",' '"feature_2":' '"client' writeable 'ranges",' '"feature_3":' '"default' file layouts on 'dirs",' '"feature_4":' '"dir' inode in separate 'object",' '"feature_5":' '"mds' uses versioned 'encoding",' '"feature_6":' '"dirfrag' is stored in 'omap",' '"feature_8":' '"no' anchor 'table",' '"feature_9":' '"file' layout 'v2",' '"feature_10":' '"snaprealm' 'v2",' '"feature_11":' '"minor' log 'segments",' '"feature_12":' '"quiesce' 'subvolumes"' '}' '},' '"feature_flags":' '{' '"enable_multiple":' true, '"ever_enabled_multiple":' true '},' '"standbys":' '[],' '"filesystems":' '[]' '},' '"mdsmap_first_committed":' 1, '"mdsmap_last_committed":' 1, '"auth":' '{' '"first_committed":' 1, '"last_committed":' 5, '"num_secrets":' 3 '},' '"num_pg":' 64, '"num_pg_active":' 64, '"num_pg_unknown":' 0, '"num_osd":' 3, '"pool_sum":' '{' '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 128, '"acting":' 128, '"num_store_stats":' 0 '},' '"osd_sum":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54580, '"kb_used_data":' 888, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660620, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692474880, '"internally_reserved":' 0, '"allocated":' 909312, '"data_stored":' 340452, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 315, '"apply_latency_ms":' 315, '"commit_latency_ns":' 315000000, '"apply_latency_ns":' 315000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '},' '"osd_sum_by_class":' '{' '"hdd":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54580, '"kb_used_data":' 888, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660620, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692474880, '"internally_reserved":' 0, '"allocated":' 909312, '"data_stored":' 340452, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 315, '"apply_latency_ms":' 315, '"commit_latency_ns":' 315000000, '"apply_latency_ns":' 315000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '}' '},' '"pool_stats":' '[' '{' '"poolid":' 2, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '},' '{' '"poolid":' 1, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '}' '],' '"osd_stats":' '[' '{' '"osd":' 0, '"seq":' 21474836518 '},' '{' '"osd":' 1, '"seq":' 42949672989 '},' '{' '"osd":' 2, '"seq":' 0 '}' '],' '"num_pg_by_state":' '[' '{' '"state":' '"active+clean",' '"num":' 16 '},' '{' '"state":' '"active+undersized",' '"num":' 48 '}' '],' '"num_pg_by_osd":' '[' '{' '"osd":' 2, '"num_primary_pg":' 0, '"num_acting_pg":' 0, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 0, '"num_primary_pg":' 28, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 1, '"num_primary_pg":' 36, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '}' '],' '"purged_snaps":' '[' '{' '"pool":' 1, '"purged_snaps":' '{}' '},' '{' '"pool":' 2, '"purged_snaps":' '{}' '}' '],' '"servicemap":' '{' '"epoch":' 5, '"modified":' '"2024-09-16T03:25:38.422788+0000",' '"services":' '{}' '},' '"mgrstat_first_committed":' 79, '"mgrstat_last_committed":' 86, '"logm_first_committed":' 1, '"logm_last_committed":' 379, '"paxos":' '{' '"first_committed":' 1, '"last_committed":' 565, '"last_pn":' 0, '"accepted_pn":' 0 '}' '}' 2024-09-16T03:26:00.834 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:85: check_floor_pool_greater_than_pool: floor_b=($(echo $report | jq ".osdmap_clean_epochs.last_epoch_clean.per_pool[] |" " select(.poolid == $pool_b) | .floor")) 2024-09-16T03:26:00.834 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:85: check_floor_pool_greater_than_pool: jq '.osdmap_clean_epochs.last_epoch_clean.per_pool[] |' ' select(.poolid == 2) | .floor' 2024-09-16T03:26:00.834 INFO:tasks.workunit.client.0.smithi096.stderr:jq: error: syntax error, unexpected $end (Unix shell quoting issues?) at , line 1: 2024-09-16T03:26:00.834 INFO:tasks.workunit.client.0.smithi096.stderr:.osdmap_clean_epochs.last_epoch_clean.per_pool[] | 2024-09-16T03:26:00.834 INFO:tasks.workunit.client.0.smithi096.stderr:jq: 1 compile error 2024-09-16T03:26:00.834 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:85: check_floor_pool_greater_than_pool: echo '{' '"cluster_fingerprint":' '"fda2fc64-07ed-4add-8224-2e527e11d427",' '"version":' '"19.3.0-4930-gfc3e0bff",' '"commit":' '"fc3e0bff7468fd55478adbae7f75508b749124b6",' '"timestamp":' '"2024-09-16T03:26:00.694082+0000",' '"tag":' '"",' '"health":' '{' '"status":' '"HEALTH_OK",' '"checks":' '{},' '"mutes":' '[]' '},' '"monmap_first_committed":' 1, '"monmap_last_committed":' 1, '"monmap":' '{' '"epoch":' 1, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"modified":' '"2024-09-16T03:22:45.872880Z",' '"created":' '"2024-09-16T03:22:45.872880Z",' '"min_mon_release":' 19, '"min_mon_release_name":' '"squid",' '"election_strategy":' 1, '"disallowed_leaders:' '":' '"",' '"stretch_mode":' false, '"tiebreaker_mon":' '"",' '"removed_ranks:' '":' '"",' '"features":' '{' '"persistent":' '[' '"kraken",' '"luminous",' '"mimic",' '"osdmap-prune",' '"nautilus",' '"octopus",' '"pacific",' '"elector-pinging",' '"quincy",' '"reef",' '"squid"' '],' '"optional":' '[]' '},' '"mons":' '[' '{' '"rank":' 0, '"name":' '"a",' '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:7302",' '"nonce":' 0 '}' ']' '},' '"addr":' '"127.0.0.1:7302/0",' '"public_addr":' '"127.0.0.1:7302/0",' '"priority":' 0, '"weight":' 0, '"crush_location":' '"{}"' '}' ']' '},' '"quorum":' '[' 0 '],' '"osdmap":' '{' '"epoch":' 83, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"created":' '"2024-09-16T03:22:46.906117+0000",' '"modified":' '"2024-09-16T03:25:57.328949+0000",' '"last_up_change":' '"2024-09-16T03:25:08.513363+0000",' '"last_in_change":' '"2024-09-16T03:25:09.839444+0000",' '"flags":' '"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit",' '"flags_num":' 5799936, '"flags_set":' '[' '"pglog_hardlimit",' '"purged_snapdirs",' '"recovery_deletes",' '"sortbitwise"' '],' '"crush_version":' 7, '"full_ratio":' 0.97000002861022949, '"backfillfull_ratio":' 0.97000002861022949, '"nearfull_ratio":' 0.85000002384185791, '"cluster_snapshot":' '"",' '"pool_max":' 2, '"max_osd":' 3, '"require_min_compat_client":' '"luminous",' '"min_compat_client":' '"jewel",' '"require_osd_release":' '"squid",' '"allow_crimson":' false, '"pools":' '[' '{' '"pool":' 1, '"pool_name":' '"foo",' '"create_time":' '"2024-09-16T03:24:44.525189+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"30",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.8700000047683716, '"score_stable":' 1.8700000047683716, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1.25, '"raw_score_stable":' 1.25, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '},' '{' '"pool":' 2, '"pool_name":' '"bar",' '"create_time":' '"2024-09-16T03:24:46.226575+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 2, '"min_size":' 1, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"83",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.4900000095367432, '"score_stable":' 1.4900000095367432, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1, '"raw_score_stable":' 1, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '}' '],' '"osds":' '[' '{' '"osd":' 0, '"uuid":' '"64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 5, '"up_thru":' 81, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6802",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6803",' '"nonce":' 3375787448 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6804",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6805",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6808",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6809",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6806",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6807",' '"nonce":' 3375787448 '}' ']' '},' '"public_addr":' '"127.0.0.1:6803/3375787448",' '"cluster_addr":' '"127.0.0.1:6805/3375787448",' '"heartbeat_back_addr":' '"127.0.0.1:6809/3375787448",' '"heartbeat_front_addr":' '"127.0.0.1:6807/3375787448",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 1, '"uuid":' '"74b26727-75c9-444d-8782-719e4197a382",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 10, '"up_thru":' 81, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6810",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6811",' '"nonce":' 3733255132 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6812",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6813",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6816",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6817",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6814",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6815",' '"nonce":' 3733255132 '}' ']' '},' '"public_addr":' '"127.0.0.1:6811/3733255132",' '"cluster_addr":' '"127.0.0.1:6813/3733255132",' '"heartbeat_back_addr":' '"127.0.0.1:6817/3733255132",' '"heartbeat_front_addr":' '"127.0.0.1:6815/3733255132",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 2, '"uuid":' '"143da3a7-dad9-4b1e-966b-76cf5bdd3c82",' '"up":' 0, '"in":' 0, '"weight":' 0, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 15, '"up_thru":' 21, '"down_at":' 33, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6818",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6819",' '"nonce":' 963814857 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6820",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6821",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6824",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6825",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6822",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6823",' '"nonce":' 963814857 '}' ']' '},' '"public_addr":' '"127.0.0.1:6819/963814857",' '"cluster_addr":' '"127.0.0.1:6821/963814857",' '"heartbeat_back_addr":' '"127.0.0.1:6825/963814857",' '"heartbeat_front_addr":' '"127.0.0.1:6823/963814857",' '"state":' '[' '"exists"' ']' '}' '],' '"osd_xinfo":' '[' '{' '"osd":' 0, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:22.481942+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 1, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:59.663703+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 2, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 65536, '"last_purged_snaps_scrub":' '"2024-09-16T03:24:37.320822+0000",' '"dead_epoch":' 32 '}' '],' '"pg_upmap":' '[],' '"pg_upmap_items":' '[],' '"pg_upmap_primaries":' '[],' '"pg_temp":' '[],' '"primary_temp":' '[],' '"blocklist":' '{},' '"range_blocklist":' '{},' '"erasure_code_profiles":' '{' '"default":' '{' '"k":' '"2",' '"m":' '"2",' '"plugin":' '"jerasure",' '"technique":' '"reed_sol_van"' '}' '},' '"removed_snaps_queue":' '[],' '"new_removed_snaps":' '[],' '"new_purged_snaps":' '[],' '"crush_node_flags":' '{},' '"device_class_flags":' '{},' '"stretch_mode":' '{' '"stretch_mode_enabled":' false, '"stretch_bucket_count":' 0, '"degraded_stretch_mode":' 0, '"recovering_stretch_mode":' 0, '"stretch_mode_bucket":' 0 '}' '},' '"osd_metadata":' '[' '{' '"id":' 0, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/0/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:22:53.662571Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]",' '"hb_front_addr":' '"[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/0",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 1, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/1/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:23:30.129885Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]",' '"hb_front_addr":' '"[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/1",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 2, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/2/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:24:07.764502Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]",' '"hb_front_addr":' '"[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/2",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '}' '],' '"osdmap_clean_epochs":' '{' '"min_last_epoch_clean":' 28, '"last_epoch_clean":' '{' '"per_pool":' '[' '{' '"poolid":' 1, '"floor":' 28 '},' '{' '"poolid":' 2, '"floor":' 28 '}' ']' '},' '"osd_epochs":' '[' '{' '"id":' 0, '"epoch":' 78 '},' '{' '"id":' 1, '"epoch":' 80 '}' ']' '},' '"osdmap_first_committed":' 28, '"osdmap_last_committed":' 83, '"crushmap":' '{' '"devices":' '[' '{' '"id":' 0, '"name":' '"osd.0",' '"class":' '"hdd"' '},' '{' '"id":' 1, '"name":' '"osd.1",' '"class":' '"hdd"' '},' '{' '"id":' 2, '"name":' '"osd.2",' '"class":' '"hdd"' '}' '],' '"types":' '[' '{' '"type_id":' 0, '"name":' '"osd"' '},' '{' '"type_id":' 1, '"name":' '"host"' '},' '{' '"type_id":' 2, '"name":' '"chassis"' '},' '{' '"type_id":' 3, '"name":' '"rack"' '},' '{' '"type_id":' 4, '"name":' '"row"' '},' '{' '"type_id":' 5, '"name":' '"pdu"' '},' '{' '"type_id":' 6, '"name":' '"pod"' '},' '{' '"type_id":' 7, '"name":' '"room"' '},' '{' '"type_id":' 8, '"name":' '"datacenter"' '},' '{' '"type_id":' 9, '"name":' '"zone"' '},' '{' '"type_id":' 10, '"name":' '"region"' '},' '{' '"type_id":' 11, '"name":' '"root"' '}' '],' '"buckets":' '[' '{' '"id":' -1, '"name":' '"default",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -3, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -2, '"name":' '"default~hdd",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -4, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -3, '"name":' '"smithi096",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '},' '{' '"id":' -4, '"name":' '"smithi096~hdd",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '}' '],' '"rules":' '[' '{' '"rule_id":' 0, '"rule_name":' '"replicated_rule",' '"type":' 1, '"steps":' '[' '{' '"op":' '"take",' '"item":' -1, '"item_name":' '"default"' '},' '{' '"op":' '"choose_firstn",' '"num":' 0, '"type":' '"osd"' '},' '{' '"op":' '"emit"' '}' ']' '}' '],' '"tunables":' '{' '"choose_local_tries":' 0, '"choose_local_fallback_tries":' 0, '"choose_total_tries":' 50, '"chooseleaf_descend_once":' 1, '"chooseleaf_vary_r":' 1, '"chooseleaf_stable":' 1, '"msr_descents":' 100, '"msr_collision_tries":' 100, '"straw_calc_version":' 1, '"allowed_bucket_algs":' 54, '"profile":' '"jewel",' '"optimal_tunables":' 1, '"legacy_tunables":' 0, '"minimum_required_version":' '"jewel",' '"require_feature_tunables":' 1, '"require_feature_tunables2":' 1, '"has_v2_rules":' 0, '"require_feature_tunables3":' 1, '"has_v3_rules":' 0, '"has_v4_buckets":' 1, '"require_feature_tunables5":' 1, '"has_v5_rules":' 0, '"has_msr_rules":' 0 '},' '"choose_args":' '{}' '},' '"fsmap":' '{' '"epoch":' 1, '"btime":' '"2024-09-16T03:22:46:882186+0000",' '"default_fscid":' -1, '"compat":' '{' '"compat":' '{},' '"ro_compat":' '{},' '"incompat":' '{' '"feature_1":' '"base' 'v0.20",' '"feature_2":' '"client' writeable 'ranges",' '"feature_3":' '"default' file layouts on 'dirs",' '"feature_4":' '"dir' inode in separate 'object",' '"feature_5":' '"mds' uses versioned 'encoding",' '"feature_6":' '"dirfrag' is stored in 'omap",' '"feature_8":' '"no' anchor 'table",' '"feature_9":' '"file' layout 'v2",' '"feature_10":' '"snaprealm' 'v2",' '"feature_11":' '"minor' log 'segments",' '"feature_12":' '"quiesce' 'subvolumes"' '}' '},' '"feature_flags":' '{' '"enable_multiple":' true, '"ever_enabled_multiple":' true '},' '"standbys":' '[],' '"filesystems":' '[]' '},' '"mdsmap_first_committed":' 1, '"mdsmap_last_committed":' 1, '"auth":' '{' '"first_committed":' 1, '"last_committed":' 5, '"num_secrets":' 3 '},' '"num_pg":' 64, '"num_pg_active":' 64, '"num_pg_unknown":' 0, '"num_osd":' 3, '"pool_sum":' '{' '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 128, '"acting":' 128, '"num_store_stats":' 0 '},' '"osd_sum":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54580, '"kb_used_data":' 888, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660620, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692474880, '"internally_reserved":' 0, '"allocated":' 909312, '"data_stored":' 340452, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 315, '"apply_latency_ms":' 315, '"commit_latency_ns":' 315000000, '"apply_latency_ns":' 315000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '},' '"osd_sum_by_class":' '{' '"hdd":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54580, '"kb_used_data":' 888, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660620, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692474880, '"internally_reserved":' 0, '"allocated":' 909312, '"data_stored":' 340452, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 315, '"apply_latency_ms":' 315, '"commit_latency_ns":' 315000000, '"apply_latency_ns":' 315000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '}' '},' '"pool_stats":' '[' '{' '"poolid":' 2, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '},' '{' '"poolid":' 1, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '}' '],' '"osd_stats":' '[' '{' '"osd":' 0, '"seq":' 21474836518 '},' '{' '"osd":' 1, '"seq":' 42949672989 '},' '{' '"osd":' 2, '"seq":' 0 '}' '],' '"num_pg_by_state":' '[' '{' '"state":' '"active+clean",' '"num":' 16 '},' '{' '"state":' '"active+undersized",' '"num":' 48 '}' '],' '"num_pg_by_osd":' '[' '{' '"osd":' 2, '"num_primary_pg":' 0, '"num_acting_pg":' 0, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 0, '"num_primary_pg":' 28, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 1, '"num_primary_pg":' 36, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '}' '],' '"purged_snaps":' '[' '{' '"pool":' 1, '"purged_snaps":' '{}' '},' '{' '"pool":' 2, '"purged_snaps":' '{}' '}' '],' '"servicemap":' '{' '"epoch":' 5, '"modified":' '"2024-09-16T03:25:38.422788+0000",' '"services":' '{}' '},' '"mgrstat_first_committed":' 79, '"mgrstat_last_committed":' 86, '"logm_first_committed":' 1, '"logm_last_committed":' 379, '"paxos":' '{' '"first_committed":' 1, '"last_committed":' 565, '"last_pn":' 0, '"accepted_pn":' 0 '}' '}' 2024-09-16T03:26:00.834 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:87: check_floor_pool_greater_than_pool: [[ '' -gt '' ]] 2024-09-16T03:26:00.835 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:87: check_floor_pool_greater_than_pool: echo '{' '"cluster_fingerprint":' '"fda2fc64-07ed-4add-8224-2e527e11d427",' '"version":' '"19.3.0-4930-gfc3e0bff",' '"commit":' '"fc3e0bff7468fd55478adbae7f75508b749124b6",' '"timestamp":' '"2024-09-16T03:26:00.694082+0000",' '"tag":' '"",' '"health":' '{' '"status":' '"HEALTH_OK",' '"checks":' '{},' '"mutes":' '[]' '},' '"monmap_first_committed":' 1, '"monmap_last_committed":' 1, '"monmap":' '{' '"epoch":' 1, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"modified":' '"2024-09-16T03:22:45.872880Z",' '"created":' '"2024-09-16T03:22:45.872880Z",' '"min_mon_release":' 19, '"min_mon_release_name":' '"squid",' '"election_strategy":' 1, '"disallowed_leaders:' '":' '"",' '"stretch_mode":' false, '"tiebreaker_mon":' '"",' '"removed_ranks:' '":' '"",' '"features":' '{' '"persistent":' '[' '"kraken",' '"luminous",' '"mimic",' '"osdmap-prune",' '"nautilus",' '"octopus",' '"pacific",' '"elector-pinging",' '"quincy",' '"reef",' '"squid"' '],' '"optional":' '[]' '},' '"mons":' '[' '{' '"rank":' 0, '"name":' '"a",' '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:7302",' '"nonce":' 0 '}' ']' '},' '"addr":' '"127.0.0.1:7302/0",' '"public_addr":' '"127.0.0.1:7302/0",' '"priority":' 0, '"weight":' 0, '"crush_location":' '"{}"' '}' ']' '},' '"quorum":' '[' 0 '],' '"osdmap":' '{' '"epoch":' 83, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"created":' '"2024-09-16T03:22:46.906117+0000",' '"modified":' '"2024-09-16T03:25:57.328949+0000",' '"last_up_change":' '"2024-09-16T03:25:08.513363+0000",' '"last_in_change":' '"2024-09-16T03:25:09.839444+0000",' '"flags":' '"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit",' '"flags_num":' 5799936, '"flags_set":' '[' '"pglog_hardlimit",' '"purged_snapdirs",' '"recovery_deletes",' '"sortbitwise"' '],' '"crush_version":' 7, '"full_ratio":' 0.97000002861022949, '"backfillfull_ratio":' 0.97000002861022949, '"nearfull_ratio":' 0.85000002384185791, '"cluster_snapshot":' '"",' '"pool_max":' 2, '"max_osd":' 3, '"require_min_compat_client":' '"luminous",' '"min_compat_client":' '"jewel",' '"require_osd_release":' '"squid",' '"allow_crimson":' false, '"pools":' '[' '{' '"pool":' 1, '"pool_name":' '"foo",' '"create_time":' '"2024-09-16T03:24:44.525189+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"30",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.8700000047683716, '"score_stable":' 1.8700000047683716, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1.25, '"raw_score_stable":' 1.25, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '},' '{' '"pool":' 2, '"pool_name":' '"bar",' '"create_time":' '"2024-09-16T03:24:46.226575+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 2, '"min_size":' 1, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"83",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.4900000095367432, '"score_stable":' 1.4900000095367432, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1, '"raw_score_stable":' 1, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '}' '],' '"osds":' '[' '{' '"osd":' 0, '"uuid":' '"64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 5, '"up_thru":' 81, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6802",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6803",' '"nonce":' 3375787448 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6804",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6805",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6808",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6809",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6806",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6807",' '"nonce":' 3375787448 '}' ']' '},' '"public_addr":' '"127.0.0.1:6803/3375787448",' '"cluster_addr":' '"127.0.0.1:6805/3375787448",' '"heartbeat_back_addr":' '"127.0.0.1:6809/3375787448",' '"heartbeat_front_addr":' '"127.0.0.1:6807/3375787448",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 1, '"uuid":' '"74b26727-75c9-444d-8782-719e4197a382",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 10, '"up_thru":' 81, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6810",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6811",' '"nonce":' 3733255132 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6812",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6813",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6816",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6817",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6814",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6815",' '"nonce":' 3733255132 '}' ']' '},' '"public_addr":' '"127.0.0.1:6811/3733255132",' '"cluster_addr":' '"127.0.0.1:6813/3733255132",' '"heartbeat_back_addr":' '"127.0.0.1:6817/3733255132",' '"heartbeat_front_addr":' '"127.0.0.1:6815/3733255132",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 2, '"uuid":' '"143da3a7-dad9-4b1e-966b-76cf5bdd3c82",' '"up":' 0, '"in":' 0, '"weight":' 0, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 15, '"up_thru":' 21, '"down_at":' 33, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6818",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6819",' '"nonce":' 963814857 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6820",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6821",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6824",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6825",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6822",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6823",' '"nonce":' 963814857 '}' ']' '},' '"public_addr":' '"127.0.0.1:6819/963814857",' '"cluster_addr":' '"127.0.0.1:6821/963814857",' '"heartbeat_back_addr":' '"127.0.0.1:6825/963814857",' '"heartbeat_front_addr":' '"127.0.0.1:6823/963814857",' '"state":' '[' '"exists"' ']' '}' '],' '"osd_xinfo":' '[' '{' '"osd":' 0, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:22.481942+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 1, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:59.663703+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 2, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 65536, '"last_purged_snaps_scrub":' '"2024-09-16T03:24:37.320822+0000",' '"dead_epoch":' 32 '}' '],' '"pg_upmap":' '[],' '"pg_upmap_items":' '[],' '"pg_upmap_primaries":' '[],' '"pg_temp":' '[],' '"primary_temp":' '[],' '"blocklist":' '{},' '"range_blocklist":' '{},' '"erasure_code_profiles":' '{' '"default":' '{' '"k":' '"2",' '"m":' '"2",' '"plugin":' '"jerasure",' '"technique":' '"reed_sol_van"' '}' '},' '"removed_snaps_queue":' '[],' '"new_removed_snaps":' '[],' '"new_purged_snaps":' '[],' '"crush_node_flags":' '{},' '"device_class_flags":' '{},' '"stretch_mode":' '{' '"stretch_mode_enabled":' false, '"stretch_bucket_count":' 0, '"degraded_stretch_mode":' 0, '"recovering_stretch_mode":' 0, '"stretch_mode_bucket":' 0 '}' '},' '"osd_metadata":' '[' '{' '"id":' 0, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/0/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:22:53.662571Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]",' '"hb_front_addr":' '"[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/0",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 1, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/1/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:23:30.129885Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]",' '"hb_front_addr":' '"[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/1",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 2, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/2/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:24:07.764502Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]",' '"hb_front_addr":' '"[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/2",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '}' '],' '"osdmap_clean_epochs":' '{' '"min_last_epoch_clean":' 28, '"last_epoch_clean":' '{' '"per_pool":' '[' '{' '"poolid":' 1, '"floor":' 28 '},' '{' '"poolid":' 2, '"floor":' 28 '}' ']' '},' '"osd_epochs":' '[' '{' '"id":' 0, '"epoch":' 78 '},' '{' '"id":' 1, '"epoch":' 80 '}' ']' '},' '"osdmap_first_committed":' 28, '"osdmap_last_committed":' 83, '"crushmap":' '{' '"devices":' '[' '{' '"id":' 0, '"name":' '"osd.0",' '"class":' '"hdd"' '},' '{' '"id":' 1, '"name":' '"osd.1",' '"class":' '"hdd"' '},' '{' '"id":' 2, '"name":' '"osd.2",' '"class":' '"hdd"' '}' '],' '"types":' '[' '{' '"type_id":' 0, '"name":' '"osd"' '},' '{' '"type_id":' 1, '"name":' '"host"' '},' '{' '"type_id":' 2, '"name":' '"chassis"' '},' '{' '"type_id":' 3, '"name":' '"rack"' '},' '{' '"type_id":' 4, '"name":' '"row"' '},' '{' '"type_id":' 5, '"name":' '"pdu"' '},' '{' '"type_id":' 6, '"name":' '"pod"' '},' '{' '"type_id":' 7, '"name":' '"room"' '},' '{' '"type_id":' 8, '"name":' '"datacenter"' '},' '{' '"type_id":' 9, '"name":' '"zone"' '},' '{' '"type_id":' 10, '"name":' '"region"' '},' '{' '"type_id":' 11, '"name":' '"root"' '}' '],' '"buckets":' '[' '{' '"id":' -1, '"name":' '"default",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -3, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -2, '"name":' '"default~hdd",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -4, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -3, '"name":' '"smithi096",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '},' '{' '"id":' -4, '"name":' '"smithi096~hdd",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '}' '],' '"rules":' '[' '{' '"rule_id":' 0, '"rule_name":' '"replicated_rule",' '"type":' 1, '"steps":' '[' '{' '"op":' '"take",' '"item":' -1, '"item_name":' '"default"' '},' '{' '"op":' '"choose_firstn",' '"num":' 0, '"type":' '"osd"' '},' '{' '"op":' '"emit"' '}' ']' '}' '],' '"tunables":' '{' '"choose_local_tries":' 0, '"choose_local_fallback_tries":' 0, '"choose_total_tries":' 50, '"chooseleaf_descend_once":' 1, '"chooseleaf_vary_r":' 1, '"chooseleaf_stable":' 1, '"msr_descents":' 100, '"msr_collision_tries":' 100, '"straw_calc_version":' 1, '"allowed_bucket_algs":' 54, '"profile":' '"jewel",' '"optimal_tunables":' 1, '"legacy_tunables":' 0, '"minimum_required_version":' '"jewel",' '"require_feature_tunables":' 1, '"require_feature_tunables2":' 1, '"has_v2_rules":' 0, '"require_feature_tunables3":' 1, '"has_v3_rules":' 0, '"has_v4_buckets":' 1, '"require_feature_tunables5":' 1, '"has_v5_rules":' 0, '"has_msr_rules":' 0 '},' '"choose_args":' '{}' '},' '"fsmap":' '{' '"epoch":' 1, '"btime":' '"2024-09-16T03:22:46:882186+0000",' '"default_fscid":' -1, '"compat":' '{' '"compat":' '{},' '"ro_compat":' '{},' '"incompat":' '{' '"feature_1":' '"base' 'v0.20",' '"feature_2":' '"client' writeable 'ranges",' '"feature_3":' '"default' file layouts on 'dirs",' '"feature_4":' '"dir' inode in separate 'object",' '"feature_5":' '"mds' uses versioned 'encoding",' '"feature_6":' '"dirfrag' is stored in 'omap",' '"feature_8":' '"no' anchor 'table",' '"feature_9":' '"file' layout 'v2",' '"feature_10":' '"snaprealm' 'v2",' '"feature_11":' '"minor' log 'segments",' '"feature_12":' '"quiesce' 'subvolumes"' '}' '},' '"feature_flags":' '{' '"enable_multiple":' true, '"ever_enabled_multiple":' true '},' '"standbys":' '[],' '"filesystems":' '[]' '},' '"mdsmap_first_committed":' 1, '"mdsmap_last_committed":' 1, '"auth":' '{' '"first_committed":' 1, '"last_committed":' 5, '"num_secrets":' 3 '},' '"num_pg":' 64, '"num_pg_active":' 64, '"num_pg_unknown":' 0, '"num_osd":' 3, '"pool_sum":' '{' '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 128, '"acting":' 128, '"num_store_stats":' 0 '},' '"osd_sum":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54580, '"kb_used_data":' 888, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660620, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692474880, '"internally_reserved":' 0, '"allocated":' 909312, '"data_stored":' 340452, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 315, '"apply_latency_ms":' 315, '"commit_latency_ns":' 315000000, '"apply_latency_ns":' 315000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '},' '"osd_sum_by_class":' '{' '"hdd":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54580, '"kb_used_data":' 888, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660620, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692474880, '"internally_reserved":' 0, '"allocated":' 909312, '"data_stored":' 340452, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 315, '"apply_latency_ms":' 315, '"commit_latency_ns":' 315000000, '"apply_latency_ns":' 315000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '}' '},' '"pool_stats":' '[' '{' '"poolid":' 2, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '},' '{' '"poolid":' 1, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '}' '],' '"osd_stats":' '[' '{' '"osd":' 0, '"seq":' 21474836518 '},' '{' '"osd":' 1, '"seq":' 42949672989 '},' '{' '"osd":' 2, '"seq":' 0 '}' '],' '"num_pg_by_state":' '[' '{' '"state":' '"active+clean",' '"num":' 16 '},' '{' '"state":' '"active+undersized",' '"num":' 48 '}' '],' '"num_pg_by_osd":' '[' '{' '"osd":' 2, '"num_primary_pg":' 0, '"num_acting_pg":' 0, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 0, '"num_primary_pg":' 28, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 1, '"num_primary_pg":' 36, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '}' '],' '"purged_snaps":' '[' '{' '"pool":' 1, '"purged_snaps":' '{}' '},' '{' '"pool":' 2, '"purged_snaps":' '{}' '}' '],' '"servicemap":' '{' '"epoch":' 5, '"modified":' '"2024-09-16T03:25:38.422788+0000",' '"services":' '{}' '},' '"mgrstat_first_committed":' 79, '"mgrstat_last_committed":' 86, '"logm_first_committed":' 1, '"logm_last_committed":' 379, '"paxos":' '{' '"first_committed":' 1, '"last_committed":' 565, '"last_pn":' 0, '"accepted_pn":' 0 '}' '}' 2024-09-16T03:26:00.836 INFO:tasks.workunit.client.0.smithi096.stdout:{ "cluster_fingerprint": "fda2fc64-07ed-4add-8224-2e527e11d427", "version": "19.3.0-4930-gfc3e0bff", "commit": "fc3e0bff7468fd55478adbae7f75508b749124b6", "timestamp": "2024-09-16T03:26:00.694082+0000", "tag": "", "health": { "status": "HEALTH_OK", "checks": {}, "mutes": [] }, "monmap_first_committed": 1, "monmap_last_committed": 1, "monmap": { "epoch": 1, "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", "modified": "2024-09-16T03:22:45.872880Z", "created": "2024-09-16T03:22:45.872880Z", "min_mon_release": 19, "min_mon_release_name": "squid", "election_strategy": 1, "disallowed_leaders: ": "", "stretch_mode": false, "tiebreaker_mon": "", "removed_ranks: ": "", "features": { "persistent": [ "kraken", "luminous", "mimic", "osdmap-prune", "nautilus", "octopus", "pacific", "elector-pinging", "quincy", "reef", "squid" ], "optional": [] }, "mons": [ { "rank": 0, "name": "a", "public_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:7302", "nonce": 0 } ] }, "addr": "127.0.0.1:7302/0", "public_addr": "127.0.0.1:7302/0", "priority": 0, "weight": 0, "crush_location": "{}" } ] }, "quorum": [ 0 ], "osdmap": { "epoch": 83, "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", "created": "2024-09-16T03:22:46.906117+0000", "modified": "2024-09-16T03:25:57.328949+0000", "last_up_change": "2024-09-16T03:25:08.513363+0000", "last_in_change": "2024-09-16T03:25:09.839444+0000", "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", "flags_num": 5799936, "flags_set": [ "pglog_hardlimit", "purged_snapdirs", "recovery_deletes", "sortbitwise" ], "crush_version": 7, "full_ratio": 0.97000002861022949, "backfillfull_ratio": 0.97000002861022949, "nearfull_ratio": 0.85000002384185791, "cluster_snapshot": "", "pool_max": 2, "max_osd": 3, "require_min_compat_client": "luminous", "min_compat_client": "jewel", "require_osd_release": "squid", "allow_crimson": false, "pools": [ { "pool": 1, "pool_name": "foo", "create_time": "2024-09-16T03:24:44.525189+0000", "flags": 1, "flags_names": "hashpspool", "type": 1, "size": 3, "min_size": 2, "crush_rule": 0, "peering_crush_bucket_count": 0, "peering_crush_bucket_target": 0, "peering_crush_bucket_barrier": 0, "peering_crush_bucket_mandatory_member": 2147483647, "is_stretch_pool": false, "object_hash": 2, "pg_autoscale_mode": "off", "pg_num": 32, "pg_placement_num": 32, "pg_placement_num_target": 32, "pg_num_target": 32, "pg_num_pending": 32, "last_pg_merge_meta": { "source_pgid": "0.0", "ready_epoch": 0, "last_epoch_started": 0, "last_epoch_clean": 0, "source_version": "0'0", "target_version": "0'0" }, "last_change": "30", "last_force_op_resend": "0", "last_force_op_resend_prenautilus": "0", "last_force_op_resend_preluminous": "0", "auid": 0, "snap_mode": "selfmanaged", "snap_seq": 0, "snap_epoch": 0, "pool_snaps": [], "removed_snaps": "[]", "quota_max_bytes": 0, "quota_max_objects": 0, "tiers": [], "tier_of": -1, "read_tier": -1, "write_tier": -1, "cache_mode": "none", "target_max_bytes": 0, "target_max_objects": 0, "cache_target_dirty_ratio_micro": 400000, "cache_target_dirty_high_ratio_micro": 600000, "cache_target_full_ratio_micro": 800000, "cache_min_flush_age": 0, "cache_min_evict_age": 0, "erasure_code_profile": "", "hit_set_params": { "type": "none" }, "hit_set_period": 0, "hit_set_count": 0, "use_gmt_hitset": true, "min_read_recency_for_promote": 0, "min_write_recency_for_promote": 0, "hit_set_grade_decay_rate": 0, "hit_set_search_last_n": 0, "grade_table": [], "stripe_width": 0, "expected_num_objects": 0, "fast_read": false, "options": {}, "application_metadata": {}, "read_balance": { "score_type": "Fair distribution", "score_acting": 1.8700000047683716, "score_stable": 1.8700000047683716, "optimal_score": 0.67000001668930054, "raw_score_acting": 1.25, "raw_score_stable": 1.25, "primary_affinity_weighted": 1, "average_primary_affinity": 1, "average_primary_affinity_weighted": 1 } }, { "pool": 2, "pool_name": "bar", "create_time": "2024-09-16T03:24:46.226575+0000", "flags": 1, "flags_names": "hashpspool", "type": 1, "size": 2, "min_size": 1, "crush_rule": 0, "peering_crush_bucket_count": 0, "peering_crush_bucket_target": 0, "peering_crush_bucket_barrier": 0, "peering_crush_bucket_mandatory_member": 2147483647, "is_stretch_pool": false, "object_hash": 2, "pg_autoscale_mode": "off", "pg_num": 32, "pg_placement_num": 32, "pg_placement_num_target": 32, "pg_num_target": 32, "pg_num_pending": 32, "last_pg_merge_meta": { "source_pgid": "0.0", "ready_epoch": 0, "last_epoch_started": 0, "last_epoch_clean": 0, "source_version": "0'0", "target_version": "0'0" }, "last_change": "83", "last_force_op_resend": "0", "last_force_op_resend_prenautilus": "0", "last_force_op_resend_preluminous": "0", "auid": 0, "snap_mode": "selfmanaged", "snap_seq": 0, "snap_epoch": 0, "pool_snaps": [], "removed_snaps": "[]", "quota_max_bytes": 0, "quota_max_objects": 0, "tiers": [], "tier_of": -1, "read_tier": -1, "write_tier": -1, "cache_mode": "none", "target_max_bytes": 0, "target_max_objects": 0, "cache_target_dirty_ratio_micro": 400000, "cache_target_dirty_high_ratio_micro": 600000, "cache_target_full_ratio_micro": 800000, "cache_min_flush_age": 0, "cache_min_evict_age": 0, "erasure_code_profile": "", "hit_set_params": { "type": "none" }, "hit_set_period": 0, "hit_set_count": 0, "use_gmt_hitset": true, "min_read_recency_for_promote": 0, "min_write_recency_for_promote": 0, "hit_set_grade_decay_rate": 0, "hit_set_search_last_n": 0, "grade_table": [], "stripe_width": 0, "expected_num_objects": 0, "fast_read": false, "options": {}, "application_metadata": {}, "read_balance": { "score_type": "Fair distribution", "score_acting": 1.4900000095367432, "score_stable": 1.4900000095367432, "optimal_score": 0.67000001668930054, "raw_score_acting": 1, "raw_score_stable": 1, "primary_affinity_weighted": 1, "average_primary_affinity": 1, "average_primary_affinity_weighted": 1 } } ], "osds": [ { "osd": 0, "uuid": "64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6", "up": 1, "in": 1, "weight": 1, "primary_affinity": 1, "last_clean_begin": 0, "last_clean_end": 0, "up_from": 5, "up_thru": 81, "down_at": 0, "lost_at": 0, "public_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6802", "nonce": 3375787448 }, { "type": "v1", "addr": "127.0.0.1:6803", "nonce": 3375787448 } ] }, "cluster_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6804", "nonce": 3375787448 }, { "type": "v1", "addr": "127.0.0.1:6805", "nonce": 3375787448 } ] }, "heartbeat_back_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6808", "nonce": 3375787448 }, { "type": "v1", "addr": "127.0.0.1:6809", "nonce": 3375787448 } ] }, "heartbeat_front_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6806", "nonce": 3375787448 }, { "type": "v1", "addr": "127.0.0.1:6807", "nonce": 3375787448 } ] }, "public_addr": "127.0.0.1:6803/3375787448", "cluster_addr": "127.0.0.1:6805/3375787448", "heartbeat_back_addr": "127.0.0.1:6809/3375787448", "heartbeat_front_addr": "127.0.0.1:6807/3375787448", "state": [ "exists", "up" ] }, { "osd": 1, "uuid": "74b26727-75c9-444d-8782-719e4197a382", "up": 1, "in": 1, "weight": 1, "primary_affinity": 1, "last_clean_begin": 0, "last_clean_end": 0, "up_from": 10, "up_thru": 81, "down_at": 0, "lost_at": 0, "public_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6810", "nonce": 3733255132 }, { "type": "v1", "addr": "127.0.0.1:6811", "nonce": 3733255132 } ] }, "cluster_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6812", "nonce": 3733255132 }, { "type": "v1", "addr": "127.0.0.1:6813", "nonce": 3733255132 } ] }, "heartbeat_back_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6816", "nonce": 3733255132 }, { "type": "v1", "addr": "127.0.0.1:6817", "nonce": 3733255132 } ] }, "heartbeat_front_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6814", "nonce": 3733255132 }, { "type": "v1", "addr": "127.0.0.1:6815", "nonce": 3733255132 } ] }, "public_addr": "127.0.0.1:6811/3733255132", "cluster_addr": "127.0.0.1:6813/3733255132", "heartbeat_back_addr": "127.0.0.1:6817/3733255132", "heartbeat_front_addr": "127.0.0.1:6815/3733255132", "state": [ "exists", "up" ] }, { "osd": 2, "uuid": "143da3a7-dad9-4b1e-966b-76cf5bdd3c82", "up": 0, "in": 0, "weight": 0, "primary_affinity": 1, "last_clean_begin": 0, "last_clean_end": 0, "up_from": 15, "up_thru": 21, "down_at": 33, "lost_at": 0, "public_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6818", "nonce": 963814857 }, { "type": "v1", "addr": "127.0.0.1:6819", "nonce": 963814857 } ] }, "cluster_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6820", "nonce": 963814857 }, { "type": "v1", "addr": "127.0.0.1:6821", "nonce": 963814857 } ] }, "heartbeat_back_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6824", "nonce": 963814857 }, { "type": "v1", "addr": "127.0.0.1:6825", "nonce": 963814857 } ] }, "heartbeat_front_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6822", "nonce": 963814857 }, { "type": "v1", "addr": "127.0.0.1:6823", "nonce": 963814857 } ] }, "public_addr": "127.0.0.1:6819/963814857", "cluster_addr": "127.0.0.1:6821/963814857", "heartbeat_back_addr": "127.0.0.1:6825/963814857", "heartbeat_front_addr": "127.0.0.1:6823/963814857", "state": [ "exists" ] } ], "osd_xinfo": [ { "osd": 0, "down_stamp": "0.000000", "laggy_probability": 0, "laggy_interval": 0, "features": 4540719139924082687, "old_weight": 0, "last_purged_snaps_scrub": "2024-09-16T03:23:22.481942+0000", "dead_epoch": 0 }, { "osd": 1, "down_stamp": "0.000000", "laggy_probability": 0, "laggy_interval": 0, "features": 4540719139924082687, "old_weight": 0, "last_purged_snaps_scrub": "2024-09-16T03:23:59.663703+0000", "dead_epoch": 0 }, { "osd": 2, "down_stamp": "0.000000", "laggy_probability": 0, "laggy_interval": 0, "features": 4540719139924082687, "old_weight": 65536, "last_purged_snaps_scrub": "2024-09-16T03:24:37.320822+0000", "dead_epoch": 32 } ], "pg_upmap": [], "pg_upmap_items": [], "pg_upmap_primaries": [], "pg_temp": [], "primary_temp": [], "blocklist": {}, "range_blocklist": {}, "erasure_code_profiles": { "default": { "k": "2", "m": "2", "plugin": "jerasure", "technique": "reed_sol_van" } }, "removed_snaps_queue": [], "new_removed_snaps": [], "new_purged_snaps": [], "crush_node_flags": {}, "device_class_flags": {}, "stretch_mode": { "stretch_mode_enabled": false, "stretch_bucket_count": 0, "degraded_stretch_mode": 0, "recovering_stretch_mode": 0, "stretch_mode_bucket": 0 } }, "osd_metadata": [ { "id": 0, "arch": "x86_64", "back_addr": "[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]", "back_iface": "", "bluefs": "1", "bluefs_dedicated_db": "0", "bluefs_dedicated_wal": "0", "bluefs_single_shared_device": "1", "bluestore_allocation_from_file": "0", "bluestore_bdev_access_mode": "file", "bluestore_bdev_block_size": "4096", "bluestore_bdev_devices": "sda", "bluestore_bdev_driver": "KernelDevice", "bluestore_bdev_optimal_io_size": "0", "bluestore_bdev_path": "td/mon-last-clean-epoch/0/block", "bluestore_bdev_rotational": "1", "bluestore_bdev_size": "107374182400", "bluestore_bdev_support_discard": "0", "bluestore_bdev_type": "hdd", "bluestore_min_alloc_size": "4096", "ceph_release": "squid", "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", "ceph_version_short": "19.3.0-4930-gfc3e0bff", "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", "created_at": "2024-09-16T03:22:53.662571Z", "default_device_class": "hdd", "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", "devices": "sda", "distro": "ubuntu", "distro_description": "Ubuntu 22.04.1 LTS", "distro_version": "22.04", "front_addr": "[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]", "front_iface": "", "hb_back_addr": "[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]", "hb_front_addr": "[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]", "hostname": "smithi096", "journal_rotational": "1", "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", "kernel_version": "5.15.0-121-generic", "mem_swap_kb": "2097148", "mem_total_kb": "32746824", "network_numa_unknown_ifaces": "back_iface,front_iface", "objectstore_numa_unknown_devices": "sda", "os": "Linux", "osd_data": "td/mon-last-clean-epoch/0", "osd_objectstore": "bluestore", "osdspec_affinity": "", "rotational": "1" }, { "id": 1, "arch": "x86_64", "back_addr": "[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]", "back_iface": "", "bluefs": "1", "bluefs_dedicated_db": "0", "bluefs_dedicated_wal": "0", "bluefs_single_shared_device": "1", "bluestore_allocation_from_file": "0", "bluestore_bdev_access_mode": "file", "bluestore_bdev_block_size": "4096", "bluestore_bdev_devices": "sda", "bluestore_bdev_driver": "KernelDevice", "bluestore_bdev_optimal_io_size": "0", "bluestore_bdev_path": "td/mon-last-clean-epoch/1/block", "bluestore_bdev_rotational": "1", "bluestore_bdev_size": "107374182400", "bluestore_bdev_support_discard": "0", "bluestore_bdev_type": "hdd", "bluestore_min_alloc_size": "4096", "ceph_release": "squid", "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", "ceph_version_short": "19.3.0-4930-gfc3e0bff", "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", "created_at": "2024-09-16T03:23:30.129885Z", "default_device_class": "hdd", "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", "devices": "sda", "distro": "ubuntu", "distro_description": "Ubuntu 22.04.1 LTS", "distro_version": "22.04", "front_addr": "[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]", "front_iface": "", "hb_back_addr": "[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]", "hb_front_addr": "[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]", "hostname": "smithi096", "journal_rotational": "1", "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", "kernel_version": "5.15.0-121-generic", "mem_swap_kb": "2097148", "mem_total_kb": "32746824", "network_numa_unknown_ifaces": "back_iface,front_iface", "objectstore_numa_unknown_devices": "sda", "os": "Linux", "osd_data": "td/mon-last-clean-epoch/1", "osd_objectstore": "bluestore", "osdspec_affinity": "", "rotational": "1" }, { "id": 2, "arch": "x86_64", "back_addr": "[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]", "back_iface": "", "bluefs": "1", "bluefs_dedicated_db": "0", "bluefs_dedicated_wal": "0", "bluefs_single_shared_device": "1", "bluestore_allocation_from_file": "0", "bluestore_bdev_access_mode": "file", "bluestore_bdev_block_size": "4096", "bluestore_bdev_devices": "sda", "bluestore_bdev_driver": "KernelDevice", "bluestore_bdev_optimal_io_size": "0", "bluestore_bdev_path": "td/mon-last-clean-epoch/2/block", "bluestore_bdev_rotational": "1", "bluestore_bdev_size": "107374182400", "bluestore_bdev_support_discard": "0", "bluestore_bdev_type": "hdd", "bluestore_min_alloc_size": "4096", "ceph_release": "squid", "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", "ceph_version_short": "19.3.0-4930-gfc3e0bff", "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", "created_at": "2024-09-16T03:24:07.764502Z", "default_device_class": "hdd", "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", "devices": "sda", "distro": "ubuntu", "distro_description": "Ubuntu 22.04.1 LTS", "distro_version": "22.04", "front_addr": "[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]", "front_iface": "", "hb_back_addr": "[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]", "hb_front_addr": "[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]", "hostname": "smithi096", "journal_rotational": "1", "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", "kernel_version": "5.15.0-121-generic", "mem_swap_kb": "2097148", "mem_total_kb": "32746824", "network_numa_unknown_ifaces": "back_iface,front_iface", "objectstore_numa_unknown_devices": "sda", "os": "Linux", "osd_data": "td/mon-last-clean-epoch/2", "osd_objectstore": "bluestore", "osdspec_affinity": "", "rotational": "1" } ], "osdmap_clean_epochs": { "min_last_epoch_clean": 28, "last_epoch_clean": { "per_pool": [ { "poolid": 1, "floor": 28 }, { "poolid": 2, "floor": 28 } ] }, "osd_epochs": [ { "id": 0, "epoch": 78 }, { "id": 1, "epoch": 80 } ] }, "osdmap_first_committed": 28, "osdmap_last_committed": 83, "crushmap": { "devices": [ { "id": 0, "name": "osd.0", "class": "hdd" }, { "id": 1, "name": "osd.1", "class": "hdd" }, { "id": 2, "name": "osd.2", "class": "hdd" } ], "types": [ { "type_id": 0, "name": "osd" }, { "type_id": 1, "name": "host" }, { "type_id": 2, "name": "chassis" }, { "type_id": 3, "name": "rack" }, { "type_id": 4, "name": "row" }, { "type_id": 5, "name": "pdu" }, { "type_id": 6, "name": "pod" }, { "type_id": 7, "name": "room" }, { "type_id": 8, "name": "datacenter" }, { "type_id": 9, "name": "zone" }, { "type_id": 10, "name": "region" }, { "type_id": 11, "name": "root" } ], "buckets": [ { "id": -1, "name": "default", "type_id": 11, "type_name": "root", "weight": 19206, "alg": "straw2", "hash": "rjenkins1", "items": [ { "id": -3, "weight": 19206, "pos": 0 } ] }, { "id": -2, "name": "default~hdd", "type_id": 11, "type_name": "root", "weight": 19206, "alg": "straw2", "hash": "rjenkins1", "items": [ { "id": -4, "weight": 19206, "pos": 0 } ] }, { "id": -3, "name": "smithi096", "type_id": 1, "type_name": "host", "weight": 19206, "alg": "straw2", "hash": "rjenkins1", "items": [ { "id": 0, "weight": 6402, "pos": 0 }, { "id": 1, "weight": 6402, "pos": 1 }, { "id": 2, "weight": 6402, "pos": 2 } ] }, { "id": -4, "name": "smithi096~hdd", "type_id": 1, "type_name": "host", "weight": 19206, "alg": "straw2", "hash": "rjenkins1", "items": [ { "id": 0, "weight": 6402, "pos": 0 }, { "id": 1, "weight": 6402, "pos": 1 }, { "id": 2, "weight": 6402, "pos": 2 } ] } ], "rules": [ { "rule_id": 0, "rule_name": "replicated_rule", "type": 1, "steps": [ { "op": "take", "item": -1, "item_name": "default" }, { "op": "choose_firstn", "num": 0, "type": "osd" }, { "op": "emit" } ] } ], "tunables": { "choose_local_tries": 0, "choose_local_fallback_tries": 0, "choose_total_tries": 50, "chooseleaf_descend_once": 1, "chooseleaf_vary_r": 1, "chooseleaf_stable": 1, "msr_descents": 100, "msr_collision_tries": 100, "straw_calc_version": 1, "allowed_bucket_algs": 54, "profile": "jewel", "optimal_tunables": 1, "legacy_tunables": 0, "minimum_required_version": "jewel", "require_feature_tunables": 1, "require_feature_tunables2": 1, "has_v2_rules": 0, "require_feature_tunables3": 1, "has_v3_rules": 0, "has_v4_buckets": 1, "require_feature_tunables5": 1, "has_v5_rules": 0, "has_msr_rules": 0 }, "choose_args": {} }, "fsmap": { "epoch": 1, "btime": "2024-09-16T03:22:46:882186+0000", "default_fscid": -1, "compat": { "compat": {}, "ro_compat": {}, "incompat": { "feature_1": "base v0.20", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes" } }, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "standbys": [], "filesystems": [] }, "mdsmap_first_committed": 1, "mdsmap_last_committed": 1, "auth": { "first_committed": 1, "last_committed": 5, "num_secrets": 3 }, "num_pg": 64, "num_pg_active": 64, "num_pg_unknown": 0, "num_osd": 3, "pool_sum": { "stat_sum": { "num_bytes": 0, "num_objects": 0, "num_object_clones": 0, "num_object_copies": 0, "num_objects_missing_on_primary": 0, "num_objects_missing": 0, "num_objects_degraded": 0, "num_objects_misplaced": 0, "num_objects_unfound": 0, "num_objects_dirty": 0, "num_whiteouts": 0, "num_read": 0, "num_read_kb": 0, "num_write": 0, "num_write_kb": 0, "num_scrub_errors": 0, "num_shallow_scrub_errors": 0, "num_deep_scrub_errors": 0, "num_objects_recovered": 0, "num_bytes_recovered": 0, "num_keys_recovered": 0, "num_objects_omap": 0, "num_objects_hit_set_archive": 0, "num_bytes_hit_set_archive": 0, "num_flush": 0, "num_flush_kb": 0, "num_evict": 0, "num_evict_kb": 0, "num_promote": 0, "num_flush_mode_high": 0, "num_flush_mode_low": 0, "num_evict_mode_some": 0, "num_evict_mode_full": 0, "num_objects_pinned": 0, "num_legacy_snapsets": 0, "num_large_omap_objects": 0, "num_objects_manifest": 0, "num_omap_bytes": 0, "num_omap_keys": 0, "num_objects_repaired": 0 }, "store_stats": { "total": 0, "available": 0, "internally_reserved": 0, "allocated": 0, "data_stored": 0, "data_compressed": 0, "data_compressed_allocated": 0, "data_compressed_original": 0, "omap_allocated": 0, "internal_metadata": 0 }, "log_size": 0, "ondisk_log_size": 0, "up": 128, "acting": 128, "num_store_stats": 0 }, "osd_sum": { "up_from": 0, "seq": 0, "num_pgs": 128, "num_osds": 2, "num_per_pool_osds": 2, "num_per_pool_omap_osds": 2, "kb": 209715200, "kb_used": 54580, "kb_used_data": 888, "kb_used_omap": 3, "kb_used_meta": 53628, "kb_avail": 209660620, "statfs": { "total": 214748364800, "available": 214692474880, "internally_reserved": 0, "allocated": 909312, "data_stored": 340452, "data_compressed": 0, "data_compressed_allocated": 0, "data_compressed_original": 0, "omap_allocated": 3190, "internal_metadata": 54915978 }, "hb_peers": [], "snap_trim_queue_len": 0, "num_snap_trimming": 0, "num_shards_repaired": 0, "op_queue_age_hist": { "histogram": [], "upper_bound": 1 }, "perf_stat": { "commit_latency_ms": 315, "apply_latency_ms": 315, "commit_latency_ns": 315000000, "apply_latency_ns": 315000000 }, "alerts": [], "network_ping_times": [] }, "osd_sum_by_class": { "hdd": { "up_from": 0, "seq": 0, "num_pgs": 128, "num_osds": 2, "num_per_pool_osds": 2, "num_per_pool_omap_osds": 2, "kb": 209715200, "kb_used": 54580, "kb_used_data": 888, "kb_used_omap": 3, "kb_used_meta": 53628, "kb_avail": 209660620, "statfs": { "total": 214748364800, "available": 214692474880, "internally_reserved": 0, "allocated": 909312, "data_stored": 340452, "data_compressed": 0, "data_compressed_allocated": 0, "data_compressed_original": 0, "omap_allocated": 3190, "internal_metadata": 54915978 }, "hb_peers": [], "snap_trim_queue_len": 0, "num_snap_trimming": 0, "num_shards_repaired": 0, "op_queue_age_hist": { "histogram": [], "upper_bound": 1 }, "perf_stat": { "commit_latency_ms": 315, "apply_latency_ms": 315, "commit_latency_ns": 315000000, "apply_latency_ns": 315000000 }, "alerts": [], "network_ping_times": [] } }, "pool_stats": [ { "poolid": 2, "num_pg": 32, "stat_sum": { "num_bytes": 0, "num_objects": 0, "num_object_clones": 0, "num_object_copies": 0, "num_objects_missing_on_primary": 0, "num_objects_missing": 0, "num_objects_degraded": 0, "num_objects_misplaced": 0, "num_objects_unfound": 0, "num_objects_dirty": 0, "num_whiteouts": 0, "num_read": 0, "num_read_kb": 0, "num_write": 0, "num_write_kb": 0, "num_scrub_errors": 0, "num_shallow_scrub_errors": 0, "num_deep_scrub_errors": 0, "num_objects_recovered": 0, "num_bytes_recovered": 0, "num_keys_recovered": 0, "num_objects_omap": 0, "num_objects_hit_set_archive": 0, "num_bytes_hit_set_archive": 0, "num_flush": 0, "num_flush_kb": 0, "num_evict": 0, "num_evict_kb": 0, "num_promote": 0, "num_flush_mode_high": 0, "num_flush_mode_low": 0, "num_evict_mode_some": 0, "num_evict_mode_full": 0, "num_objects_pinned": 0, "num_legacy_snapsets": 0, "num_large_omap_objects": 0, "num_objects_manifest": 0, "num_omap_bytes": 0, "num_omap_keys": 0, "num_objects_repaired": 0 }, "store_stats": { "total": 0, "available": 0, "internally_reserved": 0, "allocated": 0, "data_stored": 0, "data_compressed": 0, "data_compressed_allocated": 0, "data_compressed_original": 0, "omap_allocated": 0, "internal_metadata": 0 }, "log_size": 0, "ondisk_log_size": 0, "up": 64, "acting": 64, "num_store_stats": 3 }, { "poolid": 1, "num_pg": 32, "stat_sum": { "num_bytes": 0, "num_objects": 0, "num_object_clones": 0, "num_object_copies": 0, "num_objects_missing_on_primary": 0, "num_objects_missing": 0, "num_objects_degraded": 0, "num_objects_misplaced": 0, "num_objects_unfound": 0, "num_objects_dirty": 0, "num_whiteouts": 0, "num_read": 0, "num_read_kb": 0, "num_write": 0, "num_write_kb": 0, "num_scrub_errors": 0, "num_shallow_scrub_errors": 0, "num_deep_scrub_errors": 0, "num_objects_recovered": 0, "num_bytes_recovered": 0, "num_keys_recovered": 0, "num_objects_omap": 0, "num_objects_hit_set_archive": 0, "num_bytes_hit_set_archive": 0, "num_flush": 0, "num_flush_kb": 0, "num_evict": 0, "num_evict_kb": 0, "num_promote": 0, "num_flush_mode_high": 0, "num_flush_mode_low": 0, "num_evict_mode_some": 0, "num_evict_mode_full": 0, "num_objects_pinned": 0, "num_legacy_snapsets": 0, "num_large_omap_objects": 0, "num_objects_manifest": 0, "num_omap_bytes": 0, "num_omap_keys": 0, "num_objects_repaired": 0 }, "store_stats": { "total": 0, "available": 0, "internally_reserved": 0, "allocated": 0, "data_stored": 0, "data_compressed": 0, "data_compressed_allocated": 0, "data_compressed_original": 0, "omap_allocated": 0, "internal_metadata": 0 }, "log_size": 0, "ondisk_log_size": 0, "up": 64, "acting": 64, "num_store_stats": 3 } ], "osd_stats": [ { "osd": 0, "seq": 21474836518 }, { "osd": 1, "seq": 42949672989 }, { "osd": 2, "seq": 0 } ], "num_pg_by_state": [ { "state": "active+clean", "num": 16 }, { "state": "active+undersized", "num": 48 } ], "num_pg_by_osd": [ { "osd": 2, "num_primary_pg": 0, "num_acting_pg": 0, "num_up_not_acting_pg": 0 }, { "osd": 0, "num_primary_pg": 28, "num_acting_pg": 64, "num_up_not_acting_pg": 0 }, { "osd": 1, "num_primary_pg": 36, "num_acting_pg": 64, "num_up_not_acting_pg": 0 } ], "purged_snaps": [ { "pool": 1, "purged_snaps": {} }, { "pool": 2, "purged_snaps": {} } ], "servicemap": { "epoch": 5, "modified": "2024-09-16T03:25:38.422788+0000", "services": {} }, "mgrstat_first_committed": 79, "mgrstat_last_committed": 86, "logm_first_committed": 1, "logm_last_committed": 379, "paxos": { "first_committed": 1, "last_committed": 565, "last_pn": 0, "accepted_pn": 0 } } 2024-09-16T03:26:00.837 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:87: check_floor_pool_greater_than_pool: return 1 2024-09-16T03:26:00.840 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:88: check_floor_pool_greater_than_pool: return 0 2024-09-16T03:26:00.840 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:271: TEST_mon_last_clean_epoch: get_fc_lc_diff 2024-09-16T03:26:00.840 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:130: get_fc_lc_diff: ceph report 2024-09-16T03:26:01.255 INFO:tasks.workunit.client.0.smithi096.stderr:report 2948438821 2024-09-16T03:26:01.272 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:130: get_fc_lc_diff: report='{ 2024-09-16T03:26:01.272 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_fingerprint": "fda2fc64-07ed-4add-8224-2e527e11d427", 2024-09-16T03:26:01.272 INFO:tasks.workunit.client.0.smithi096.stderr: "version": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:26:01.272 INFO:tasks.workunit.client.0.smithi096.stderr: "commit": "fc3e0bff7468fd55478adbae7f75508b749124b6", 2024-09-16T03:26:01.272 INFO:tasks.workunit.client.0.smithi096.stderr: "timestamp": "2024-09-16T03:26:01.256140+0000", 2024-09-16T03:26:01.272 INFO:tasks.workunit.client.0.smithi096.stderr: "tag": "", 2024-09-16T03:26:01.272 INFO:tasks.workunit.client.0.smithi096.stderr: "health": { 2024-09-16T03:26:01.272 INFO:tasks.workunit.client.0.smithi096.stderr: "status": "HEALTH_OK", 2024-09-16T03:26:01.272 INFO:tasks.workunit.client.0.smithi096.stderr: "checks": {}, 2024-09-16T03:26:01.272 INFO:tasks.workunit.client.0.smithi096.stderr: "mutes": [] 2024-09-16T03:26:01.273 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.273 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap_first_committed": 1, 2024-09-16T03:26:01.273 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap_last_committed": 1, 2024-09-16T03:26:01.273 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap": { 2024-09-16T03:26:01.273 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 1, 2024-09-16T03:26:01.273 INFO:tasks.workunit.client.0.smithi096.stderr: "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", 2024-09-16T03:26:01.273 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:22:45.872880Z", 2024-09-16T03:26:01.273 INFO:tasks.workunit.client.0.smithi096.stderr: "created": "2024-09-16T03:22:45.872880Z", 2024-09-16T03:26:01.273 INFO:tasks.workunit.client.0.smithi096.stderr: "min_mon_release": 19, 2024-09-16T03:26:01.273 INFO:tasks.workunit.client.0.smithi096.stderr: "min_mon_release_name": "squid", 2024-09-16T03:26:01.273 INFO:tasks.workunit.client.0.smithi096.stderr: "election_strategy": 1, 2024-09-16T03:26:01.273 INFO:tasks.workunit.client.0.smithi096.stderr: "disallowed_leaders: ": "", 2024-09-16T03:26:01.274 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode": false, 2024-09-16T03:26:01.274 INFO:tasks.workunit.client.0.smithi096.stderr: "tiebreaker_mon": "", 2024-09-16T03:26:01.274 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_ranks: ": "", 2024-09-16T03:26:01.274 INFO:tasks.workunit.client.0.smithi096.stderr: "features": { 2024-09-16T03:26:01.274 INFO:tasks.workunit.client.0.smithi096.stderr: "persistent": [ 2024-09-16T03:26:01.274 INFO:tasks.workunit.client.0.smithi096.stderr: "kraken", 2024-09-16T03:26:01.274 INFO:tasks.workunit.client.0.smithi096.stderr: "luminous", 2024-09-16T03:26:01.274 INFO:tasks.workunit.client.0.smithi096.stderr: "mimic", 2024-09-16T03:26:01.274 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap-prune", 2024-09-16T03:26:01.274 INFO:tasks.workunit.client.0.smithi096.stderr: "nautilus", 2024-09-16T03:26:01.274 INFO:tasks.workunit.client.0.smithi096.stderr: "octopus", 2024-09-16T03:26:01.274 INFO:tasks.workunit.client.0.smithi096.stderr: "pacific", 2024-09-16T03:26:01.274 INFO:tasks.workunit.client.0.smithi096.stderr: "elector-pinging", 2024-09-16T03:26:01.275 INFO:tasks.workunit.client.0.smithi096.stderr: "quincy", 2024-09-16T03:26:01.275 INFO:tasks.workunit.client.0.smithi096.stderr: "reef", 2024-09-16T03:26:01.275 INFO:tasks.workunit.client.0.smithi096.stderr: "squid" 2024-09-16T03:26:01.275 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:01.275 INFO:tasks.workunit.client.0.smithi096.stderr: "optional": [] 2024-09-16T03:26:01.275 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.275 INFO:tasks.workunit.client.0.smithi096.stderr: "mons": [ 2024-09-16T03:26:01.275 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.275 INFO:tasks.workunit.client.0.smithi096.stderr: "rank": 0, 2024-09-16T03:26:01.275 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "a", 2024-09-16T03:26:01.275 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:26:01.275 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:01.275 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.275 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:01.276 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:7302", 2024-09-16T03:26:01.276 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 0 2024-09-16T03:26:01.276 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:01.276 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:01.276 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.276 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:7302/0", 2024-09-16T03:26:01.276 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:7302/0", 2024-09-16T03:26:01.276 INFO:tasks.workunit.client.0.smithi096.stderr: "priority": 0, 2024-09-16T03:26:01.276 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 0, 2024-09-16T03:26:01.276 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_location": "{}" 2024-09-16T03:26:01.276 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:01.277 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:01.277 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.277 INFO:tasks.workunit.client.0.smithi096.stderr: "quorum": [ 2024-09-16T03:26:01.277 INFO:tasks.workunit.client.0.smithi096.stderr: 0 2024-09-16T03:26:01.277 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:01.277 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap": { 2024-09-16T03:26:01.277 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 83, 2024-09-16T03:26:01.277 INFO:tasks.workunit.client.0.smithi096.stderr: "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", 2024-09-16T03:26:01.277 INFO:tasks.workunit.client.0.smithi096.stderr: "created": "2024-09-16T03:22:46.906117+0000", 2024-09-16T03:26:01.277 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:25:57.328949+0000", 2024-09-16T03:26:01.277 INFO:tasks.workunit.client.0.smithi096.stderr: "last_up_change": "2024-09-16T03:25:08.513363+0000", 2024-09-16T03:26:01.277 INFO:tasks.workunit.client.0.smithi096.stderr: "last_in_change": "2024-09-16T03:25:09.839444+0000", 2024-09-16T03:26:01.277 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-16T03:26:01.278 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_num": 5799936, 2024-09-16T03:26:01.278 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_set": [ 2024-09-16T03:26:01.278 INFO:tasks.workunit.client.0.smithi096.stderr: "pglog_hardlimit", 2024-09-16T03:26:01.278 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snapdirs", 2024-09-16T03:26:01.278 INFO:tasks.workunit.client.0.smithi096.stderr: "recovery_deletes", 2024-09-16T03:26:01.278 INFO:tasks.workunit.client.0.smithi096.stderr: "sortbitwise" 2024-09-16T03:26:01.278 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:01.278 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_version": 7, 2024-09-16T03:26:01.278 INFO:tasks.workunit.client.0.smithi096.stderr: "full_ratio": 0.97000002861022949, 2024-09-16T03:26:01.278 INFO:tasks.workunit.client.0.smithi096.stderr: "backfillfull_ratio": 0.97000002861022949, 2024-09-16T03:26:01.278 INFO:tasks.workunit.client.0.smithi096.stderr: "nearfull_ratio": 0.85000002384185791, 2024-09-16T03:26:01.278 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_snapshot": "", 2024-09-16T03:26:01.278 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_max": 2, 2024-09-16T03:26:01.279 INFO:tasks.workunit.client.0.smithi096.stderr: "max_osd": 3, 2024-09-16T03:26:01.279 INFO:tasks.workunit.client.0.smithi096.stderr: "require_min_compat_client": "luminous", 2024-09-16T03:26:01.279 INFO:tasks.workunit.client.0.smithi096.stderr: "min_compat_client": "jewel", 2024-09-16T03:26:01.279 INFO:tasks.workunit.client.0.smithi096.stderr: "require_osd_release": "squid", 2024-09-16T03:26:01.279 INFO:tasks.workunit.client.0.smithi096.stderr: "allow_crimson": false, 2024-09-16T03:26:01.279 INFO:tasks.workunit.client.0.smithi096.stderr: "pools": [ 2024-09-16T03:26:01.279 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.279 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 1, 2024-09-16T03:26:01.279 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_name": "foo", 2024-09-16T03:26:01.279 INFO:tasks.workunit.client.0.smithi096.stderr: "create_time": "2024-09-16T03:24:44.525189+0000", 2024-09-16T03:26:01.279 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": 1, 2024-09-16T03:26:01.279 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_names": "hashpspool", 2024-09-16T03:26:01.279 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:26:01.280 INFO:tasks.workunit.client.0.smithi096.stderr: "size": 3, 2024-09-16T03:26:01.280 INFO:tasks.workunit.client.0.smithi096.stderr: "min_size": 2, 2024-09-16T03:26:01.280 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_rule": 0, 2024-09-16T03:26:01.280 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_count": 0, 2024-09-16T03:26:01.280 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_target": 0, 2024-09-16T03:26:01.280 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_barrier": 0, 2024-09-16T03:26:01.280 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-16T03:26:01.280 INFO:tasks.workunit.client.0.smithi096.stderr: "is_stretch_pool": false, 2024-09-16T03:26:01.280 INFO:tasks.workunit.client.0.smithi096.stderr: "object_hash": 2, 2024-09-16T03:26:01.280 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_autoscale_mode": "off", 2024-09-16T03:26:01.280 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num": 32, 2024-09-16T03:26:01.280 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num": 32, 2024-09-16T03:26:01.280 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num_target": 32, 2024-09-16T03:26:01.281 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_target": 32, 2024-09-16T03:26:01.281 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_pending": 32, 2024-09-16T03:26:01.281 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pg_merge_meta": { 2024-09-16T03:26:01.281 INFO:tasks.workunit.client.0.smithi096.stderr: "source_pgid": "0.0", 2024-09-16T03:26:01.281 INFO:tasks.workunit.client.0.smithi096.stderr: "ready_epoch": 0, 2024-09-16T03:26:01.281 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_started": 0, 2024-09-16T03:26:01.281 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": 0, 2024-09-16T03:26:01.281 INFO:tasks.workunit.client.0.smithi096.stderr: "source_version": "0'\''0", 2024-09-16T03:26:01.281 INFO:tasks.workunit.client.0.smithi096.stderr: "target_version": "0'\''0" 2024-09-16T03:26:01.281 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.281 INFO:tasks.workunit.client.0.smithi096.stderr: "last_change": "30", 2024-09-16T03:26:01.281 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend": "0", 2024-09-16T03:26:01.281 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_prenautilus": "0", 2024-09-16T03:26:01.282 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_preluminous": "0", 2024-09-16T03:26:01.282 INFO:tasks.workunit.client.0.smithi096.stderr: "auid": 0, 2024-09-16T03:26:01.282 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_mode": "selfmanaged", 2024-09-16T03:26:01.282 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_seq": 0, 2024-09-16T03:26:01.282 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_epoch": 0, 2024-09-16T03:26:01.282 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_snaps": [], 2024-09-16T03:26:01.282 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps": "[]", 2024-09-16T03:26:01.282 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_bytes": 0, 2024-09-16T03:26:01.282 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_objects": 0, 2024-09-16T03:26:01.282 INFO:tasks.workunit.client.0.smithi096.stderr: "tiers": [], 2024-09-16T03:26:01.282 INFO:tasks.workunit.client.0.smithi096.stderr: "tier_of": -1, 2024-09-16T03:26:01.282 INFO:tasks.workunit.client.0.smithi096.stderr: "read_tier": -1, 2024-09-16T03:26:01.282 INFO:tasks.workunit.client.0.smithi096.stderr: "write_tier": -1, 2024-09-16T03:26:01.282 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_mode": "none", 2024-09-16T03:26:01.283 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_bytes": 0, 2024-09-16T03:26:01.283 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_objects": 0, 2024-09-16T03:26:01.283 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_ratio_micro": 400000, 2024-09-16T03:26:01.283 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-16T03:26:01.283 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_full_ratio_micro": 800000, 2024-09-16T03:26:01.283 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_flush_age": 0, 2024-09-16T03:26:01.283 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_evict_age": 0, 2024-09-16T03:26:01.283 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profile": "", 2024-09-16T03:26:01.283 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_params": { 2024-09-16T03:26:01.283 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "none" 2024-09-16T03:26:01.283 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.283 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_period": 0, 2024-09-16T03:26:01.284 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_count": 0, 2024-09-16T03:26:01.284 INFO:tasks.workunit.client.0.smithi096.stderr: "use_gmt_hitset": true, 2024-09-16T03:26:01.284 INFO:tasks.workunit.client.0.smithi096.stderr: "min_read_recency_for_promote": 0, 2024-09-16T03:26:01.284 INFO:tasks.workunit.client.0.smithi096.stderr: "min_write_recency_for_promote": 0, 2024-09-16T03:26:01.284 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_grade_decay_rate": 0, 2024-09-16T03:26:01.284 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_search_last_n": 0, 2024-09-16T03:26:01.284 INFO:tasks.workunit.client.0.smithi096.stderr: "grade_table": [], 2024-09-16T03:26:01.284 INFO:tasks.workunit.client.0.smithi096.stderr: "stripe_width": 0, 2024-09-16T03:26:01.284 INFO:tasks.workunit.client.0.smithi096.stderr: "expected_num_objects": 0, 2024-09-16T03:26:01.284 INFO:tasks.workunit.client.0.smithi096.stderr: "fast_read": false, 2024-09-16T03:26:01.284 INFO:tasks.workunit.client.0.smithi096.stderr: "options": {}, 2024-09-16T03:26:01.285 INFO:tasks.workunit.client.0.smithi096.stderr: "application_metadata": {}, 2024-09-16T03:26:01.285 INFO:tasks.workunit.client.0.smithi096.stderr: "read_balance": { 2024-09-16T03:26:01.285 INFO:tasks.workunit.client.0.smithi096.stderr: "score_type": "Fair distribution", 2024-09-16T03:26:01.285 INFO:tasks.workunit.client.0.smithi096.stderr: "score_acting": 1.8700000047683716, 2024-09-16T03:26:01.285 INFO:tasks.workunit.client.0.smithi096.stderr: "score_stable": 1.8700000047683716, 2024-09-16T03:26:01.285 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_score": 0.67000001668930054, 2024-09-16T03:26:01.285 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_acting": 1.25, 2024-09-16T03:26:01.285 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_stable": 1.25, 2024-09-16T03:26:01.285 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity_weighted": 1, 2024-09-16T03:26:01.285 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity": 1, 2024-09-16T03:26:01.285 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity_weighted": 1 2024-09-16T03:26:01.286 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:01.286 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.286 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.286 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 2, 2024-09-16T03:26:01.286 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_name": "bar", 2024-09-16T03:26:01.286 INFO:tasks.workunit.client.0.smithi096.stderr: "create_time": "2024-09-16T03:24:46.226575+0000", 2024-09-16T03:26:01.286 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": 1, 2024-09-16T03:26:01.286 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_names": "hashpspool", 2024-09-16T03:26:01.286 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:26:01.286 INFO:tasks.workunit.client.0.smithi096.stderr: "size": 2, 2024-09-16T03:26:01.286 INFO:tasks.workunit.client.0.smithi096.stderr: "min_size": 1, 2024-09-16T03:26:01.286 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_rule": 0, 2024-09-16T03:26:01.286 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_count": 0, 2024-09-16T03:26:01.287 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_target": 0, 2024-09-16T03:26:01.287 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_barrier": 0, 2024-09-16T03:26:01.287 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-16T03:26:01.287 INFO:tasks.workunit.client.0.smithi096.stderr: "is_stretch_pool": false, 2024-09-16T03:26:01.287 INFO:tasks.workunit.client.0.smithi096.stderr: "object_hash": 2, 2024-09-16T03:26:01.287 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_autoscale_mode": "off", 2024-09-16T03:26:01.287 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num": 32, 2024-09-16T03:26:01.287 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num": 32, 2024-09-16T03:26:01.287 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num_target": 32, 2024-09-16T03:26:01.287 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_target": 32, 2024-09-16T03:26:01.287 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_pending": 32, 2024-09-16T03:26:01.287 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pg_merge_meta": { 2024-09-16T03:26:01.287 INFO:tasks.workunit.client.0.smithi096.stderr: "source_pgid": "0.0", 2024-09-16T03:26:01.288 INFO:tasks.workunit.client.0.smithi096.stderr: "ready_epoch": 0, 2024-09-16T03:26:01.288 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_started": 0, 2024-09-16T03:26:01.288 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": 0, 2024-09-16T03:26:01.288 INFO:tasks.workunit.client.0.smithi096.stderr: "source_version": "0'\''0", 2024-09-16T03:26:01.288 INFO:tasks.workunit.client.0.smithi096.stderr: "target_version": "0'\''0" 2024-09-16T03:26:01.288 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.288 INFO:tasks.workunit.client.0.smithi096.stderr: "last_change": "83", 2024-09-16T03:26:01.288 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend": "0", 2024-09-16T03:26:01.288 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_prenautilus": "0", 2024-09-16T03:26:01.288 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_preluminous": "0", 2024-09-16T03:26:01.288 INFO:tasks.workunit.client.0.smithi096.stderr: "auid": 0, 2024-09-16T03:26:01.288 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_mode": "selfmanaged", 2024-09-16T03:26:01.288 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_seq": 0, 2024-09-16T03:26:01.289 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_epoch": 0, 2024-09-16T03:26:01.289 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_snaps": [], 2024-09-16T03:26:01.289 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps": "[]", 2024-09-16T03:26:01.289 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_bytes": 0, 2024-09-16T03:26:01.289 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_objects": 0, 2024-09-16T03:26:01.289 INFO:tasks.workunit.client.0.smithi096.stderr: "tiers": [], 2024-09-16T03:26:01.289 INFO:tasks.workunit.client.0.smithi096.stderr: "tier_of": -1, 2024-09-16T03:26:01.289 INFO:tasks.workunit.client.0.smithi096.stderr: "read_tier": -1, 2024-09-16T03:26:01.289 INFO:tasks.workunit.client.0.smithi096.stderr: "write_tier": -1, 2024-09-16T03:26:01.289 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_mode": "none", 2024-09-16T03:26:01.289 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_bytes": 0, 2024-09-16T03:26:01.289 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_objects": 0, 2024-09-16T03:26:01.289 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_ratio_micro": 400000, 2024-09-16T03:26:01.289 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-16T03:26:01.290 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_full_ratio_micro": 800000, 2024-09-16T03:26:01.290 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_flush_age": 0, 2024-09-16T03:26:01.290 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_evict_age": 0, 2024-09-16T03:26:01.290 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profile": "", 2024-09-16T03:26:01.290 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_params": { 2024-09-16T03:26:01.290 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "none" 2024-09-16T03:26:01.290 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.290 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_period": 0, 2024-09-16T03:26:01.290 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_count": 0, 2024-09-16T03:26:01.290 INFO:tasks.workunit.client.0.smithi096.stderr: "use_gmt_hitset": true, 2024-09-16T03:26:01.290 INFO:tasks.workunit.client.0.smithi096.stderr: "min_read_recency_for_promote": 0, 2024-09-16T03:26:01.290 INFO:tasks.workunit.client.0.smithi096.stderr: "min_write_recency_for_promote": 0, 2024-09-16T03:26:01.290 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_grade_decay_rate": 0, 2024-09-16T03:26:01.291 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_search_last_n": 0, 2024-09-16T03:26:01.291 INFO:tasks.workunit.client.0.smithi096.stderr: "grade_table": [], 2024-09-16T03:26:01.291 INFO:tasks.workunit.client.0.smithi096.stderr: "stripe_width": 0, 2024-09-16T03:26:01.291 INFO:tasks.workunit.client.0.smithi096.stderr: "expected_num_objects": 0, 2024-09-16T03:26:01.291 INFO:tasks.workunit.client.0.smithi096.stderr: "fast_read": false, 2024-09-16T03:26:01.291 INFO:tasks.workunit.client.0.smithi096.stderr: "options": {}, 2024-09-16T03:26:01.291 INFO:tasks.workunit.client.0.smithi096.stderr: "application_metadata": {}, 2024-09-16T03:26:01.291 INFO:tasks.workunit.client.0.smithi096.stderr: "read_balance": { 2024-09-16T03:26:01.291 INFO:tasks.workunit.client.0.smithi096.stderr: "score_type": "Fair distribution", 2024-09-16T03:26:01.291 INFO:tasks.workunit.client.0.smithi096.stderr: "score_acting": 1.4900000095367432, 2024-09-16T03:26:01.291 INFO:tasks.workunit.client.0.smithi096.stderr: "score_stable": 1.4900000095367432, 2024-09-16T03:26:01.291 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_score": 0.67000001668930054, 2024-09-16T03:26:01.292 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_acting": 1, 2024-09-16T03:26:01.292 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_stable": 1, 2024-09-16T03:26:01.292 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity_weighted": 1, 2024-09-16T03:26:01.292 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity": 1, 2024-09-16T03:26:01.292 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity_weighted": 1 2024-09-16T03:26:01.292 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:01.292 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:01.292 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:01.292 INFO:tasks.workunit.client.0.smithi096.stderr: "osds": [ 2024-09-16T03:26:01.292 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.292 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:26:01.292 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6", 2024-09-16T03:26:01.292 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:26:01.293 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:26:01.293 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:26:01.293 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:26:01.293 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:26:01.293 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:26:01.293 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 5, 2024-09-16T03:26:01.293 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 81, 2024-09-16T03:26:01.293 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:26:01.293 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:26:01.293 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:26:01.293 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:01.293 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.294 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:01.294 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6802", 2024-09-16T03:26:01.294 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:26:01.294 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.294 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.294 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:01.294 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6803", 2024-09-16T03:26:01.294 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:26:01.294 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:01.294 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:01.294 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.294 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:26:01.294 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:01.294 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.295 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:01.295 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6804", 2024-09-16T03:26:01.295 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:26:01.295 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.295 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.295 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:01.295 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6805", 2024-09-16T03:26:01.295 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:26:01.295 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:01.295 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:01.295 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.295 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:26:01.295 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:01.295 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.296 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:01.296 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6808", 2024-09-16T03:26:01.296 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:26:01.296 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.296 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.296 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:01.296 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6809", 2024-09-16T03:26:01.296 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:26:01.296 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:01.296 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:01.296 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.296 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:26:01.296 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:01.297 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.297 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:01.297 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6806", 2024-09-16T03:26:01.297 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:26:01.297 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.297 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.297 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:01.297 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6807", 2024-09-16T03:26:01.297 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:26:01.297 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:01.297 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:01.297 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.297 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6803/3375787448", 2024-09-16T03:26:01.297 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6805/3375787448", 2024-09-16T03:26:01.298 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6809/3375787448", 2024-09-16T03:26:01.298 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6807/3375787448", 2024-09-16T03:26:01.298 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:26:01.298 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:26:01.298 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:26:01.298 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:01.298 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.298 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.298 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:26:01.298 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "74b26727-75c9-444d-8782-719e4197a382", 2024-09-16T03:26:01.298 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:26:01.298 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:26:01.299 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:26:01.299 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:26:01.299 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:26:01.299 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:26:01.299 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 10, 2024-09-16T03:26:01.299 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 81, 2024-09-16T03:26:01.299 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:26:01.299 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:26:01.299 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:26:01.299 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:01.299 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.299 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:01.300 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6810", 2024-09-16T03:26:01.300 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:26:01.300 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.300 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.300 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:01.300 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6811", 2024-09-16T03:26:01.300 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:26:01.300 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:01.300 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:01.300 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.300 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:26:01.301 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:01.301 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.301 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:01.301 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6812", 2024-09-16T03:26:01.301 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:26:01.301 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.301 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.301 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:01.301 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6813", 2024-09-16T03:26:01.301 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:26:01.301 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:01.301 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:01.302 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.302 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:26:01.302 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:01.302 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.302 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:01.302 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6816", 2024-09-16T03:26:01.302 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:26:01.302 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.302 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.303 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:01.303 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6817", 2024-09-16T03:26:01.303 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:26:01.303 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:01.303 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:01.303 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.303 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:26:01.303 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:01.303 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.303 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:01.303 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6814", 2024-09-16T03:26:01.303 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:26:01.303 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.304 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.304 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:01.304 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6815", 2024-09-16T03:26:01.304 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:26:01.304 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:01.304 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:01.304 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.304 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6811/3733255132", 2024-09-16T03:26:01.304 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6813/3733255132", 2024-09-16T03:26:01.304 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6817/3733255132", 2024-09-16T03:26:01.304 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6815/3733255132", 2024-09-16T03:26:01.304 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:26:01.305 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:26:01.305 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:26:01.305 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:01.305 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.305 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.305 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:26:01.305 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "143da3a7-dad9-4b1e-966b-76cf5bdd3c82", 2024-09-16T03:26:01.305 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 0, 2024-09-16T03:26:01.305 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 0, 2024-09-16T03:26:01.305 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 0, 2024-09-16T03:26:01.305 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:26:01.305 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:26:01.305 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:26:01.306 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 15, 2024-09-16T03:26:01.306 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 21, 2024-09-16T03:26:01.306 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 33, 2024-09-16T03:26:01.306 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:26:01.306 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:26:01.306 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:01.306 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.306 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:01.306 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6818", 2024-09-16T03:26:01.306 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:26:01.306 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.306 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.306 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:01.306 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6819", 2024-09-16T03:26:01.307 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:26:01.307 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:01.307 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:01.307 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.307 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:26:01.307 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:01.307 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.307 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:01.307 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6820", 2024-09-16T03:26:01.307 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:26:01.307 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.308 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.308 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:01.308 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6821", 2024-09-16T03:26:01.308 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:26:01.308 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:01.308 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:01.308 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.308 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:26:01.308 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:01.308 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.308 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:01.308 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6824", 2024-09-16T03:26:01.308 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:26:01.308 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.309 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.309 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:01.309 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6825", 2024-09-16T03:26:01.309 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:26:01.309 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:01.309 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:01.309 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.309 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:26:01.309 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:01.309 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.309 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:01.309 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6822", 2024-09-16T03:26:01.309 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:26:01.310 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.310 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.310 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:01.310 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6823", 2024-09-16T03:26:01.310 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:26:01.310 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:01.310 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:01.310 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.310 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6819/963814857", 2024-09-16T03:26:01.310 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6821/963814857", 2024-09-16T03:26:01.310 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6825/963814857", 2024-09-16T03:26:01.310 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6823/963814857", 2024-09-16T03:26:01.310 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:26:01.310 INFO:tasks.workunit.client.0.smithi096.stderr: "exists" 2024-09-16T03:26:01.311 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:01.311 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:01.311 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:01.311 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_xinfo": [ 2024-09-16T03:26:01.311 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.311 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:26:01.311 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:26:01.311 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:26:01.311 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:26:01.311 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:26:01.311 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:26:01.311 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:23:22.481942+0000", 2024-09-16T03:26:01.311 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:26:01.311 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.312 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.312 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:26:01.312 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:26:01.312 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:26:01.312 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:26:01.312 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:26:01.312 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:26:01.312 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:23:59.663703+0000", 2024-09-16T03:26:01.312 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:26:01.312 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.312 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.312 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:26:01.313 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:26:01.313 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:26:01.313 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:26:01.313 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:26:01.313 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 65536, 2024-09-16T03:26:01.313 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:24:37.320822+0000", 2024-09-16T03:26:01.313 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 32 2024-09-16T03:26:01.313 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:01.313 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:01.313 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap": [], 2024-09-16T03:26:01.313 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap_items": [], 2024-09-16T03:26:01.313 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap_primaries": [], 2024-09-16T03:26:01.313 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_temp": [], 2024-09-16T03:26:01.314 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_temp": [], 2024-09-16T03:26:01.314 INFO:tasks.workunit.client.0.smithi096.stderr: "blocklist": {}, 2024-09-16T03:26:01.314 INFO:tasks.workunit.client.0.smithi096.stderr: "range_blocklist": {}, 2024-09-16T03:26:01.314 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profiles": { 2024-09-16T03:26:01.314 INFO:tasks.workunit.client.0.smithi096.stderr: "default": { 2024-09-16T03:26:01.314 INFO:tasks.workunit.client.0.smithi096.stderr: "k": "2", 2024-09-16T03:26:01.314 INFO:tasks.workunit.client.0.smithi096.stderr: "m": "2", 2024-09-16T03:26:01.314 INFO:tasks.workunit.client.0.smithi096.stderr: "plugin": "jerasure", 2024-09-16T03:26:01.314 INFO:tasks.workunit.client.0.smithi096.stderr: "technique": "reed_sol_van" 2024-09-16T03:26:01.314 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:01.314 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.314 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps_queue": [], 2024-09-16T03:26:01.314 INFO:tasks.workunit.client.0.smithi096.stderr: "new_removed_snaps": [], 2024-09-16T03:26:01.315 INFO:tasks.workunit.client.0.smithi096.stderr: "new_purged_snaps": [], 2024-09-16T03:26:01.315 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_node_flags": {}, 2024-09-16T03:26:01.315 INFO:tasks.workunit.client.0.smithi096.stderr: "device_class_flags": {}, 2024-09-16T03:26:01.315 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode": { 2024-09-16T03:26:01.315 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode_enabled": false, 2024-09-16T03:26:01.315 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_bucket_count": 0, 2024-09-16T03:26:01.315 INFO:tasks.workunit.client.0.smithi096.stderr: "degraded_stretch_mode": 0, 2024-09-16T03:26:01.315 INFO:tasks.workunit.client.0.smithi096.stderr: "recovering_stretch_mode": 0, 2024-09-16T03:26:01.315 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode_bucket": 0 2024-09-16T03:26:01.315 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:01.315 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.315 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_metadata": [ 2024-09-16T03:26:01.316 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.316 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:26:01.316 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:26:01.316 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]", 2024-09-16T03:26:01.316 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:26:01.316 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:26:01.316 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:26:01.316 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:26:01.316 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:26:01.316 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:26:01.316 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:26:01.317 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:26:01.317 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:26:01.317 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:26:01.317 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:26:01.317 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/0/block", 2024-09-16T03:26:01.317 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:26:01.317 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:26:01.317 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:26:01.317 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:26:01.317 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:26:01.317 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:26:01.317 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:26:01.317 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:26:01.318 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:26:01.318 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:26:01.318 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:22:53.662571Z", 2024-09-16T03:26:01.318 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:26:01.318 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:26:01.318 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:26:01.318 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:26:01.318 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:26:01.318 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:26:01.318 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:26:01.318 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]", 2024-09-16T03:26:01.318 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:26:01.319 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]", 2024-09-16T03:26:01.319 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]", 2024-09-16T03:26:01.319 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:26:01.319 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:26:01.319 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:26:01.319 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:26:01.319 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:26:01.319 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:26:01.319 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:26:01.319 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:26:01.319 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:26:01.319 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/0", 2024-09-16T03:26:01.319 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:26:01.320 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:26:01.320 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:26:01.320 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.320 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.320 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:26:01.320 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:26:01.320 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]", 2024-09-16T03:26:01.320 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:26:01.320 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:26:01.320 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:26:01.320 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:26:01.320 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:26:01.321 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:26:01.321 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:26:01.321 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:26:01.321 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:26:01.321 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:26:01.321 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:26:01.321 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/1/block", 2024-09-16T03:26:01.321 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:26:01.321 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:26:01.321 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:26:01.321 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:26:01.321 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:26:01.322 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:26:01.322 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:26:01.322 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:26:01.322 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:26:01.322 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:26:01.322 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:23:30.129885Z", 2024-09-16T03:26:01.322 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:26:01.322 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:26:01.322 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:26:01.322 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:26:01.322 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:26:01.322 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:26:01.322 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:26:01.323 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]", 2024-09-16T03:26:01.323 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:26:01.323 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]", 2024-09-16T03:26:01.323 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]", 2024-09-16T03:26:01.323 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:26:01.323 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:26:01.323 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:26:01.323 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:26:01.323 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:26:01.323 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:26:01.323 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:26:01.323 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:26:01.324 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:26:01.324 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/1", 2024-09-16T03:26:01.324 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:26:01.324 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:26:01.324 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:26:01.324 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.324 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.324 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:26:01.324 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:26:01.324 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]", 2024-09-16T03:26:01.324 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:26:01.324 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:26:01.324 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:26:01.325 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:26:01.325 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:26:01.325 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:26:01.325 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:26:01.325 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:26:01.325 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:26:01.325 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:26:01.325 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:26:01.326 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/2/block", 2024-09-16T03:26:01.326 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:26:01.326 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:26:01.326 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:26:01.326 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:26:01.326 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:26:01.326 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:26:01.326 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:26:01.326 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:26:01.326 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:26:01.326 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:26:01.326 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:24:07.764502Z", 2024-09-16T03:26:01.326 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:26:01.326 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:26:01.327 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:26:01.327 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:26:01.327 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:26:01.327 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:26:01.327 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:26:01.327 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]", 2024-09-16T03:26:01.327 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:26:01.327 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]", 2024-09-16T03:26:01.327 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]", 2024-09-16T03:26:01.327 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:26:01.328 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:26:01.328 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:26:01.328 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:26:01.328 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:26:01.328 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:26:01.328 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:26:01.328 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:26:01.329 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:26:01.329 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/2", 2024-09-16T03:26:01.329 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:26:01.329 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:26:01.329 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:26:01.329 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:01.329 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:01.330 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_clean_epochs": { 2024-09-16T03:26:01.330 INFO:tasks.workunit.client.0.smithi096.stderr: "min_last_epoch_clean": 28, 2024-09-16T03:26:01.330 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": { 2024-09-16T03:26:01.330 INFO:tasks.workunit.client.0.smithi096.stderr: "per_pool": [ 2024-09-16T03:26:01.330 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.330 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 1, 2024-09-16T03:26:01.330 INFO:tasks.workunit.client.0.smithi096.stderr: "floor": 28 2024-09-16T03:26:01.330 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.330 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.330 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 2, 2024-09-16T03:26:01.330 INFO:tasks.workunit.client.0.smithi096.stderr: "floor": 28 2024-09-16T03:26:01.331 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:01.331 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:01.331 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.331 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_epochs": [ 2024-09-16T03:26:01.331 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.331 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:26:01.331 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 78 2024-09-16T03:26:01.331 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.331 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.331 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:26:01.331 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 80 2024-09-16T03:26:01.331 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:01.331 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:01.332 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.332 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_first_committed": 28, 2024-09-16T03:26:01.332 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_last_committed": 83, 2024-09-16T03:26:01.332 INFO:tasks.workunit.client.0.smithi096.stderr: "crushmap": { 2024-09-16T03:26:01.332 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": [ 2024-09-16T03:26:01.332 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.332 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:26:01.332 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.0", 2024-09-16T03:26:01.332 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:26:01.332 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.332 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.332 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:26:01.332 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.1", 2024-09-16T03:26:01.333 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:26:01.333 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.333 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.333 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:26:01.333 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.2", 2024-09-16T03:26:01.333 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:26:01.333 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:01.333 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:01.333 INFO:tasks.workunit.client.0.smithi096.stderr: "types": [ 2024-09-16T03:26:01.333 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.333 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 0, 2024-09-16T03:26:01.333 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd" 2024-09-16T03:26:01.333 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.334 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.334 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:26:01.334 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "host" 2024-09-16T03:26:01.334 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.334 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.334 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 2, 2024-09-16T03:26:01.334 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "chassis" 2024-09-16T03:26:01.334 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.334 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.334 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 3, 2024-09-16T03:26:01.334 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "rack" 2024-09-16T03:26:01.334 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.334 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.334 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 4, 2024-09-16T03:26:01.335 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "row" 2024-09-16T03:26:01.335 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.335 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.335 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 5, 2024-09-16T03:26:01.335 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "pdu" 2024-09-16T03:26:01.335 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.335 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.335 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 6, 2024-09-16T03:26:01.335 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "pod" 2024-09-16T03:26:01.335 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.335 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.335 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 7, 2024-09-16T03:26:01.335 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "room" 2024-09-16T03:26:01.335 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.335 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.336 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 8, 2024-09-16T03:26:01.336 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "datacenter" 2024-09-16T03:26:01.336 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.336 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.336 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 9, 2024-09-16T03:26:01.336 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "zone" 2024-09-16T03:26:01.336 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.336 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.336 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 10, 2024-09-16T03:26:01.336 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "region" 2024-09-16T03:26:01.336 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.336 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.336 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:26:01.337 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "root" 2024-09-16T03:26:01.337 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:01.337 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:01.337 INFO:tasks.workunit.client.0.smithi096.stderr: "buckets": [ 2024-09-16T03:26:01.337 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.337 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -1, 2024-09-16T03:26:01.337 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "default", 2024-09-16T03:26:01.337 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:26:01.337 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "root", 2024-09-16T03:26:01.337 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:26:01.337 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:26:01.337 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:26:01.337 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:26:01.337 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.338 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -3, 2024-09-16T03:26:01.338 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:26:01.338 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:26:01.338 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:01.338 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:01.338 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.338 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.338 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -2, 2024-09-16T03:26:01.338 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "default~hdd", 2024-09-16T03:26:01.338 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:26:01.338 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "root", 2024-09-16T03:26:01.338 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:26:01.338 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:26:01.338 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:26:01.339 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:26:01.339 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.339 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -4, 2024-09-16T03:26:01.339 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:26:01.339 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:26:01.339 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:01.339 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:01.339 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.339 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.339 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -3, 2024-09-16T03:26:01.339 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "smithi096", 2024-09-16T03:26:01.339 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:26:01.339 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "host", 2024-09-16T03:26:01.339 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:26:01.340 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:26:01.340 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:26:01.340 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:26:01.340 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.340 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:26:01.340 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:26:01.340 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:26:01.340 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.340 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.340 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:26:01.340 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:26:01.340 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 1 2024-09-16T03:26:01.341 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.341 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.341 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:26:01.341 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:26:01.341 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 2 2024-09-16T03:26:01.341 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:01.341 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:01.341 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.341 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.341 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -4, 2024-09-16T03:26:01.341 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "smithi096~hdd", 2024-09-16T03:26:01.341 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:26:01.341 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "host", 2024-09-16T03:26:01.341 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:26:01.342 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:26:01.342 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:26:01.342 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:26:01.342 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.342 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:26:01.342 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:26:01.342 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:26:01.342 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.342 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.342 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:26:01.342 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:26:01.342 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 1 2024-09-16T03:26:01.342 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.342 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.343 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:26:01.343 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:26:01.343 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 2 2024-09-16T03:26:01.343 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:01.343 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:01.343 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:01.343 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:01.343 INFO:tasks.workunit.client.0.smithi096.stderr: "rules": [ 2024-09-16T03:26:01.343 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.343 INFO:tasks.workunit.client.0.smithi096.stderr: "rule_id": 0, 2024-09-16T03:26:01.343 INFO:tasks.workunit.client.0.smithi096.stderr: "rule_name": "replicated_rule", 2024-09-16T03:26:01.343 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:26:01.343 INFO:tasks.workunit.client.0.smithi096.stderr: "steps": [ 2024-09-16T03:26:01.344 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.344 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "take", 2024-09-16T03:26:01.344 INFO:tasks.workunit.client.0.smithi096.stderr: "item": -1, 2024-09-16T03:26:01.344 INFO:tasks.workunit.client.0.smithi096.stderr: "item_name": "default" 2024-09-16T03:26:01.344 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.344 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.344 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "choose_firstn", 2024-09-16T03:26:01.344 INFO:tasks.workunit.client.0.smithi096.stderr: "num": 0, 2024-09-16T03:26:01.344 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "osd" 2024-09-16T03:26:01.344 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.344 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.344 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "emit" 2024-09-16T03:26:01.344 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:01.344 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:01.345 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:01.345 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:01.345 INFO:tasks.workunit.client.0.smithi096.stderr: "tunables": { 2024-09-16T03:26:01.345 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_local_tries": 0, 2024-09-16T03:26:01.345 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_local_fallback_tries": 0, 2024-09-16T03:26:01.345 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_total_tries": 50, 2024-09-16T03:26:01.345 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_descend_once": 1, 2024-09-16T03:26:01.345 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_vary_r": 1, 2024-09-16T03:26:01.345 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_stable": 1, 2024-09-16T03:26:01.345 INFO:tasks.workunit.client.0.smithi096.stderr: "msr_descents": 100, 2024-09-16T03:26:01.345 INFO:tasks.workunit.client.0.smithi096.stderr: "msr_collision_tries": 100, 2024-09-16T03:26:01.345 INFO:tasks.workunit.client.0.smithi096.stderr: "straw_calc_version": 1, 2024-09-16T03:26:01.345 INFO:tasks.workunit.client.0.smithi096.stderr: "allowed_bucket_algs": 54, 2024-09-16T03:26:01.346 INFO:tasks.workunit.client.0.smithi096.stderr: "profile": "jewel", 2024-09-16T03:26:01.346 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_tunables": 1, 2024-09-16T03:26:01.346 INFO:tasks.workunit.client.0.smithi096.stderr: "legacy_tunables": 0, 2024-09-16T03:26:01.346 INFO:tasks.workunit.client.0.smithi096.stderr: "minimum_required_version": "jewel", 2024-09-16T03:26:01.346 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables": 1, 2024-09-16T03:26:01.346 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables2": 1, 2024-09-16T03:26:01.346 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v2_rules": 0, 2024-09-16T03:26:01.346 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables3": 1, 2024-09-16T03:26:01.346 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v3_rules": 0, 2024-09-16T03:26:01.346 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v4_buckets": 1, 2024-09-16T03:26:01.346 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables5": 1, 2024-09-16T03:26:01.346 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v5_rules": 0, 2024-09-16T03:26:01.346 INFO:tasks.workunit.client.0.smithi096.stderr: "has_msr_rules": 0 2024-09-16T03:26:01.346 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.346 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_args": {} 2024-09-16T03:26:01.347 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.347 INFO:tasks.workunit.client.0.smithi096.stderr: "fsmap": { 2024-09-16T03:26:01.347 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 1, 2024-09-16T03:26:01.347 INFO:tasks.workunit.client.0.smithi096.stderr: "btime": "2024-09-16T03:22:46:882186+0000", 2024-09-16T03:26:01.347 INFO:tasks.workunit.client.0.smithi096.stderr: "default_fscid": -1, 2024-09-16T03:26:01.347 INFO:tasks.workunit.client.0.smithi096.stderr: "compat": { 2024-09-16T03:26:01.347 INFO:tasks.workunit.client.0.smithi096.stderr: "compat": {}, 2024-09-16T03:26:01.347 INFO:tasks.workunit.client.0.smithi096.stderr: "ro_compat": {}, 2024-09-16T03:26:01.347 INFO:tasks.workunit.client.0.smithi096.stderr: "incompat": { 2024-09-16T03:26:01.347 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_1": "base v0.20", 2024-09-16T03:26:01.347 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_2": "client writeable ranges", 2024-09-16T03:26:01.347 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_3": "default file layouts on dirs", 2024-09-16T03:26:01.347 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_4": "dir inode in separate object", 2024-09-16T03:26:01.347 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_5": "mds uses versioned encoding", 2024-09-16T03:26:01.348 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_6": "dirfrag is stored in omap", 2024-09-16T03:26:01.348 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_8": "no anchor table", 2024-09-16T03:26:01.348 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_9": "file layout v2", 2024-09-16T03:26:01.348 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_10": "snaprealm v2", 2024-09-16T03:26:01.348 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_11": "minor log segments", 2024-09-16T03:26:01.348 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_12": "quiesce subvolumes" 2024-09-16T03:26:01.348 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:01.348 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.348 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_flags": { 2024-09-16T03:26:01.348 INFO:tasks.workunit.client.0.smithi096.stderr: "enable_multiple": true, 2024-09-16T03:26:01.348 INFO:tasks.workunit.client.0.smithi096.stderr: "ever_enabled_multiple": true 2024-09-16T03:26:01.348 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.348 INFO:tasks.workunit.client.0.smithi096.stderr: "standbys": [], 2024-09-16T03:26:01.349 INFO:tasks.workunit.client.0.smithi096.stderr: "filesystems": [] 2024-09-16T03:26:01.349 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.349 INFO:tasks.workunit.client.0.smithi096.stderr: "mdsmap_first_committed": 1, 2024-09-16T03:26:01.349 INFO:tasks.workunit.client.0.smithi096.stderr: "mdsmap_last_committed": 1, 2024-09-16T03:26:01.349 INFO:tasks.workunit.client.0.smithi096.stderr: "auth": { 2024-09-16T03:26:01.349 INFO:tasks.workunit.client.0.smithi096.stderr: "first_committed": 1, 2024-09-16T03:26:01.349 INFO:tasks.workunit.client.0.smithi096.stderr: "last_committed": 5, 2024-09-16T03:26:01.349 INFO:tasks.workunit.client.0.smithi096.stderr: "num_secrets": 3 2024-09-16T03:26:01.349 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.349 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 64, 2024-09-16T03:26:01.349 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_active": 64, 2024-09-16T03:26:01.350 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_unknown": 0, 2024-09-16T03:26:01.350 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osd": 3, 2024-09-16T03:26:01.350 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_sum": { 2024-09-16T03:26:01.350 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:26:01.350 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:26:01.350 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:26:01.350 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:26:01.350 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:26:01.350 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:26:01.350 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:26:01.350 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:26:01.350 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:26:01.351 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:26:01.351 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:26:01.351 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:26:01.351 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:26:01.351 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:26:01.351 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:26:01.351 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:26:01.351 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:26:01.351 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:26:01.351 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:26:01.351 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:26:01.351 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:26:01.351 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:26:01.351 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:26:01.351 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:26:01.352 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:26:01.352 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:26:01.352 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:26:01.352 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:26:01.352 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:26:01.352 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:26:01.352 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:26:01.352 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:26:01.352 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:26:01.352 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:26:01.352 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:26:01.352 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:26:01.353 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:26:01.353 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:26:01.353 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:26:01.353 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:26:01.353 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:26:01.353 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.353 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:26:01.353 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:26:01.353 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:26:01.353 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:26:01.353 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:26:01.354 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:26:01.354 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:26:01.354 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:26:01.354 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:26:01.354 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:26:01.354 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:26:01.354 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.354 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:26:01.354 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:26:01.354 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 128, 2024-09-16T03:26:01.354 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 128, 2024-09-16T03:26:01.354 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 0 2024-09-16T03:26:01.354 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.354 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_sum": { 2024-09-16T03:26:01.355 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 0, 2024-09-16T03:26:01.355 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 0, 2024-09-16T03:26:01.355 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pgs": 128, 2024-09-16T03:26:01.355 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osds": 2, 2024-09-16T03:26:01.355 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_osds": 2, 2024-09-16T03:26:01.355 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_omap_osds": 2, 2024-09-16T03:26:01.355 INFO:tasks.workunit.client.0.smithi096.stderr: "kb": 209715200, 2024-09-16T03:26:01.355 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used": 54580, 2024-09-16T03:26:01.355 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_data": 888, 2024-09-16T03:26:01.355 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_omap": 3, 2024-09-16T03:26:01.355 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_meta": 53628, 2024-09-16T03:26:01.355 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_avail": 209660620, 2024-09-16T03:26:01.355 INFO:tasks.workunit.client.0.smithi096.stderr: "statfs": { 2024-09-16T03:26:01.356 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 214748364800, 2024-09-16T03:26:01.356 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 214692474880, 2024-09-16T03:26:01.356 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:26:01.356 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 909312, 2024-09-16T03:26:01.356 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 340452, 2024-09-16T03:26:01.356 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:26:01.356 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:26:01.356 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:26:01.356 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 3190, 2024-09-16T03:26:01.356 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 54915978 2024-09-16T03:26:01.356 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.357 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_peers": [], 2024-09-16T03:26:01.357 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_trim_queue_len": 0, 2024-09-16T03:26:01.357 INFO:tasks.workunit.client.0.smithi096.stderr: "num_snap_trimming": 0, 2024-09-16T03:26:01.357 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shards_repaired": 0, 2024-09-16T03:26:01.357 INFO:tasks.workunit.client.0.smithi096.stderr: "op_queue_age_hist": { 2024-09-16T03:26:01.358 INFO:tasks.workunit.client.0.smithi096.stderr: "histogram": [], 2024-09-16T03:26:01.358 INFO:tasks.workunit.client.0.smithi096.stderr: "upper_bound": 1 2024-09-16T03:26:01.358 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.358 INFO:tasks.workunit.client.0.smithi096.stderr: "perf_stat": { 2024-09-16T03:26:01.358 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ms": 315, 2024-09-16T03:26:01.358 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ms": 315, 2024-09-16T03:26:01.359 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ns": 315000000, 2024-09-16T03:26:01.359 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ns": 315000000 2024-09-16T03:26:01.359 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.359 INFO:tasks.workunit.client.0.smithi096.stderr: "alerts": [], 2024-09-16T03:26:01.359 INFO:tasks.workunit.client.0.smithi096.stderr: "network_ping_times": [] 2024-09-16T03:26:01.359 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.359 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_sum_by_class": { 2024-09-16T03:26:01.360 INFO:tasks.workunit.client.0.smithi096.stderr: "hdd": { 2024-09-16T03:26:01.360 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 0, 2024-09-16T03:26:01.360 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 0, 2024-09-16T03:26:01.360 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pgs": 128, 2024-09-16T03:26:01.360 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osds": 2, 2024-09-16T03:26:01.360 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_osds": 2, 2024-09-16T03:26:01.360 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_omap_osds": 2, 2024-09-16T03:26:01.360 INFO:tasks.workunit.client.0.smithi096.stderr: "kb": 209715200, 2024-09-16T03:26:01.361 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used": 54580, 2024-09-16T03:26:01.361 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_data": 888, 2024-09-16T03:26:01.361 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_omap": 3, 2024-09-16T03:26:01.361 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_meta": 53628, 2024-09-16T03:26:01.361 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_avail": 209660620, 2024-09-16T03:26:01.361 INFO:tasks.workunit.client.0.smithi096.stderr: "statfs": { 2024-09-16T03:26:01.361 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 214748364800, 2024-09-16T03:26:01.362 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 214692474880, 2024-09-16T03:26:01.362 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:26:01.362 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 909312, 2024-09-16T03:26:01.362 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 340452, 2024-09-16T03:26:01.362 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:26:01.362 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:26:01.363 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:26:01.363 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 3190, 2024-09-16T03:26:01.363 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 54915978 2024-09-16T03:26:01.363 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.363 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_peers": [], 2024-09-16T03:26:01.363 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_trim_queue_len": 0, 2024-09-16T03:26:01.364 INFO:tasks.workunit.client.0.smithi096.stderr: "num_snap_trimming": 0, 2024-09-16T03:26:01.364 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shards_repaired": 0, 2024-09-16T03:26:01.364 INFO:tasks.workunit.client.0.smithi096.stderr: "op_queue_age_hist": { 2024-09-16T03:26:01.364 INFO:tasks.workunit.client.0.smithi096.stderr: "histogram": [], 2024-09-16T03:26:01.364 INFO:tasks.workunit.client.0.smithi096.stderr: "upper_bound": 1 2024-09-16T03:26:01.364 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.365 INFO:tasks.workunit.client.0.smithi096.stderr: "perf_stat": { 2024-09-16T03:26:01.365 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ms": 315, 2024-09-16T03:26:01.365 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ms": 315, 2024-09-16T03:26:01.365 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ns": 315000000, 2024-09-16T03:26:01.365 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ns": 315000000 2024-09-16T03:26:01.365 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.365 INFO:tasks.workunit.client.0.smithi096.stderr: "alerts": [], 2024-09-16T03:26:01.365 INFO:tasks.workunit.client.0.smithi096.stderr: "network_ping_times": [] 2024-09-16T03:26:01.365 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:01.365 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.365 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_stats": [ 2024-09-16T03:26:01.365 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.366 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 2, 2024-09-16T03:26:01.366 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 32, 2024-09-16T03:26:01.366 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:26:01.366 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:26:01.366 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:26:01.366 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:26:01.366 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:26:01.366 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:26:01.366 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:26:01.366 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:26:01.366 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:26:01.366 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:26:01.366 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:26:01.366 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:26:01.367 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:26:01.367 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:26:01.367 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:26:01.367 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:26:01.367 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:26:01.367 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:26:01.367 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:26:01.367 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:26:01.367 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:26:01.367 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:26:01.367 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:26:01.367 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:26:01.368 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:26:01.368 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:26:01.368 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:26:01.368 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:26:01.368 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:26:01.368 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:26:01.368 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:26:01.368 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:26:01.368 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:26:01.368 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:26:01.368 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:26:01.368 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:26:01.368 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:26:01.369 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:26:01.369 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:26:01.369 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:26:01.369 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:26:01.369 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.369 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:26:01.369 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:26:01.369 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:26:01.369 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:26:01.369 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:26:01.369 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:26:01.369 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:26:01.369 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:26:01.369 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:26:01.370 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:26:01.370 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:26:01.370 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.370 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:26:01.370 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:26:01.370 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 64, 2024-09-16T03:26:01.370 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 64, 2024-09-16T03:26:01.370 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 3 2024-09-16T03:26:01.370 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.370 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.371 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 1, 2024-09-16T03:26:01.371 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 32, 2024-09-16T03:26:01.371 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:26:01.371 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:26:01.371 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:26:01.371 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:26:01.371 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:26:01.371 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:26:01.371 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:26:01.371 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:26:01.371 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:26:01.371 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:26:01.371 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:26:01.372 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:26:01.372 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:26:01.372 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:26:01.372 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:26:01.372 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:26:01.372 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:26:01.372 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:26:01.373 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:26:01.373 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:26:01.373 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:26:01.373 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:26:01.373 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:26:01.373 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:26:01.373 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:26:01.373 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:26:01.373 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:26:01.373 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:26:01.373 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:26:01.374 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:26:01.374 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:26:01.374 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:26:01.374 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:26:01.374 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:26:01.374 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:26:01.374 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:26:01.374 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:26:01.374 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:26:01.374 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:26:01.374 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:26:01.374 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:26:01.374 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.374 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:26:01.375 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:26:01.375 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:26:01.375 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:26:01.375 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:26:01.375 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:26:01.375 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:26:01.375 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:26:01.375 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:26:01.375 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:26:01.375 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:26:01.375 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.375 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:26:01.375 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:26:01.375 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 64, 2024-09-16T03:26:01.376 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 64, 2024-09-16T03:26:01.376 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 3 2024-09-16T03:26:01.376 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:01.376 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:01.376 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_stats": [ 2024-09-16T03:26:01.376 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.376 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:26:01.376 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 21474836518 2024-09-16T03:26:01.376 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.376 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.376 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:26:01.376 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 42949672989 2024-09-16T03:26:01.376 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.377 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.377 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:26:01.377 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 0 2024-09-16T03:26:01.377 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:01.377 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:01.377 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_by_state": [ 2024-09-16T03:26:01.377 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.377 INFO:tasks.workunit.client.0.smithi096.stderr: "state": "active+clean", 2024-09-16T03:26:01.377 INFO:tasks.workunit.client.0.smithi096.stderr: "num": 16 2024-09-16T03:26:01.377 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.377 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.377 INFO:tasks.workunit.client.0.smithi096.stderr: "state": "active+undersized", 2024-09-16T03:26:01.377 INFO:tasks.workunit.client.0.smithi096.stderr: "num": 48 2024-09-16T03:26:01.378 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:01.378 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:01.378 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_by_osd": [ 2024-09-16T03:26:01.378 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.378 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:26:01.378 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 0, 2024-09-16T03:26:01.378 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 0, 2024-09-16T03:26:01.378 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:26:01.378 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.378 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.378 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:26:01.378 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 28, 2024-09-16T03:26:01.378 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 64, 2024-09-16T03:26:01.378 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:26:01.379 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.379 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.379 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:26:01.379 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 36, 2024-09-16T03:26:01.379 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 64, 2024-09-16T03:26:01.379 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:26:01.379 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:01.379 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:01.379 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": [ 2024-09-16T03:26:01.379 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.379 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 1, 2024-09-16T03:26:01.379 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": {} 2024-09-16T03:26:01.379 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.379 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:01.380 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 2, 2024-09-16T03:26:01.380 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": {} 2024-09-16T03:26:01.380 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:01.380 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:01.380 INFO:tasks.workunit.client.0.smithi096.stderr: "servicemap": { 2024-09-16T03:26:01.380 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 5, 2024-09-16T03:26:01.380 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:25:38.422788+0000", 2024-09-16T03:26:01.380 INFO:tasks.workunit.client.0.smithi096.stderr: "services": {} 2024-09-16T03:26:01.380 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:01.380 INFO:tasks.workunit.client.0.smithi096.stderr: "mgrstat_first_committed": 79, 2024-09-16T03:26:01.380 INFO:tasks.workunit.client.0.smithi096.stderr: "mgrstat_last_committed": 86, 2024-09-16T03:26:01.380 INFO:tasks.workunit.client.0.smithi096.stderr: "logm_first_committed": 1, 2024-09-16T03:26:01.380 INFO:tasks.workunit.client.0.smithi096.stderr: "logm_last_committed": 382, 2024-09-16T03:26:01.380 INFO:tasks.workunit.client.0.smithi096.stderr: "paxos": { 2024-09-16T03:26:01.381 INFO:tasks.workunit.client.0.smithi096.stderr: "first_committed": 1, 2024-09-16T03:26:01.381 INFO:tasks.workunit.client.0.smithi096.stderr: "last_committed": 568, 2024-09-16T03:26:01.381 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pn": 0, 2024-09-16T03:26:01.381 INFO:tasks.workunit.client.0.smithi096.stderr: "accepted_pn": 0 2024-09-16T03:26:01.381 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:01.381 INFO:tasks.workunit.client.0.smithi096.stderr:}' 2024-09-16T03:26:01.381 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:132: get_fc_lc_diff: jq .osdmap_first_committed 2024-09-16T03:26:01.384 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:132: get_fc_lc_diff: echo '{' '"cluster_fingerprint":' '"fda2fc64-07ed-4add-8224-2e527e11d427",' '"version":' '"19.3.0-4930-gfc3e0bff",' '"commit":' '"fc3e0bff7468fd55478adbae7f75508b749124b6",' '"timestamp":' '"2024-09-16T03:26:01.256140+0000",' '"tag":' '"",' '"health":' '{' '"status":' '"HEALTH_OK",' '"checks":' '{},' '"mutes":' '[]' '},' '"monmap_first_committed":' 1, '"monmap_last_committed":' 1, '"monmap":' '{' '"epoch":' 1, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"modified":' '"2024-09-16T03:22:45.872880Z",' '"created":' '"2024-09-16T03:22:45.872880Z",' '"min_mon_release":' 19, '"min_mon_release_name":' '"squid",' '"election_strategy":' 1, '"disallowed_leaders:' '":' '"",' '"stretch_mode":' false, '"tiebreaker_mon":' '"",' '"removed_ranks:' '":' '"",' '"features":' '{' '"persistent":' '[' '"kraken",' '"luminous",' '"mimic",' '"osdmap-prune",' '"nautilus",' '"octopus",' '"pacific",' '"elector-pinging",' '"quincy",' '"reef",' '"squid"' '],' '"optional":' '[]' '},' '"mons":' '[' '{' '"rank":' 0, '"name":' '"a",' '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:7302",' '"nonce":' 0 '}' ']' '},' '"addr":' '"127.0.0.1:7302/0",' '"public_addr":' '"127.0.0.1:7302/0",' '"priority":' 0, '"weight":' 0, '"crush_location":' '"{}"' '}' ']' '},' '"quorum":' '[' 0 '],' '"osdmap":' '{' '"epoch":' 83, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"created":' '"2024-09-16T03:22:46.906117+0000",' '"modified":' '"2024-09-16T03:25:57.328949+0000",' '"last_up_change":' '"2024-09-16T03:25:08.513363+0000",' '"last_in_change":' '"2024-09-16T03:25:09.839444+0000",' '"flags":' '"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit",' '"flags_num":' 5799936, '"flags_set":' '[' '"pglog_hardlimit",' '"purged_snapdirs",' '"recovery_deletes",' '"sortbitwise"' '],' '"crush_version":' 7, '"full_ratio":' 0.97000002861022949, '"backfillfull_ratio":' 0.97000002861022949, '"nearfull_ratio":' 0.85000002384185791, '"cluster_snapshot":' '"",' '"pool_max":' 2, '"max_osd":' 3, '"require_min_compat_client":' '"luminous",' '"min_compat_client":' '"jewel",' '"require_osd_release":' '"squid",' '"allow_crimson":' false, '"pools":' '[' '{' '"pool":' 1, '"pool_name":' '"foo",' '"create_time":' '"2024-09-16T03:24:44.525189+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"30",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.8700000047683716, '"score_stable":' 1.8700000047683716, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1.25, '"raw_score_stable":' 1.25, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '},' '{' '"pool":' 2, '"pool_name":' '"bar",' '"create_time":' '"2024-09-16T03:24:46.226575+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 2, '"min_size":' 1, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"83",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.4900000095367432, '"score_stable":' 1.4900000095367432, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1, '"raw_score_stable":' 1, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '}' '],' '"osds":' '[' '{' '"osd":' 0, '"uuid":' '"64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 5, '"up_thru":' 81, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6802",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6803",' '"nonce":' 3375787448 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6804",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6805",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6808",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6809",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6806",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6807",' '"nonce":' 3375787448 '}' ']' '},' '"public_addr":' '"127.0.0.1:6803/3375787448",' '"cluster_addr":' '"127.0.0.1:6805/3375787448",' '"heartbeat_back_addr":' '"127.0.0.1:6809/3375787448",' '"heartbeat_front_addr":' '"127.0.0.1:6807/3375787448",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 1, '"uuid":' '"74b26727-75c9-444d-8782-719e4197a382",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 10, '"up_thru":' 81, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6810",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6811",' '"nonce":' 3733255132 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6812",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6813",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6816",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6817",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6814",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6815",' '"nonce":' 3733255132 '}' ']' '},' '"public_addr":' '"127.0.0.1:6811/3733255132",' '"cluster_addr":' '"127.0.0.1:6813/3733255132",' '"heartbeat_back_addr":' '"127.0.0.1:6817/3733255132",' '"heartbeat_front_addr":' '"127.0.0.1:6815/3733255132",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 2, '"uuid":' '"143da3a7-dad9-4b1e-966b-76cf5bdd3c82",' '"up":' 0, '"in":' 0, '"weight":' 0, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 15, '"up_thru":' 21, '"down_at":' 33, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6818",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6819",' '"nonce":' 963814857 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6820",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6821",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6824",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6825",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6822",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6823",' '"nonce":' 963814857 '}' ']' '},' '"public_addr":' '"127.0.0.1:6819/963814857",' '"cluster_addr":' '"127.0.0.1:6821/963814857",' '"heartbeat_back_addr":' '"127.0.0.1:6825/963814857",' '"heartbeat_front_addr":' '"127.0.0.1:6823/963814857",' '"state":' '[' '"exists"' ']' '}' '],' '"osd_xinfo":' '[' '{' '"osd":' 0, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:22.481942+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 1, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:59.663703+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 2, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 65536, '"last_purged_snaps_scrub":' '"2024-09-16T03:24:37.320822+0000",' '"dead_epoch":' 32 '}' '],' '"pg_upmap":' '[],' '"pg_upmap_items":' '[],' '"pg_upmap_primaries":' '[],' '"pg_temp":' '[],' '"primary_temp":' '[],' '"blocklist":' '{},' '"range_blocklist":' '{},' '"erasure_code_profiles":' '{' '"default":' '{' '"k":' '"2",' '"m":' '"2",' '"plugin":' '"jerasure",' '"technique":' '"reed_sol_van"' '}' '},' '"removed_snaps_queue":' '[],' '"new_removed_snaps":' '[],' '"new_purged_snaps":' '[],' '"crush_node_flags":' '{},' '"device_class_flags":' '{},' '"stretch_mode":' '{' '"stretch_mode_enabled":' false, '"stretch_bucket_count":' 0, '"degraded_stretch_mode":' 0, '"recovering_stretch_mode":' 0, '"stretch_mode_bucket":' 0 '}' '},' '"osd_metadata":' '[' '{' '"id":' 0, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/0/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:22:53.662571Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]",' '"hb_front_addr":' '"[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/0",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 1, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/1/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:23:30.129885Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]",' '"hb_front_addr":' '"[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/1",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 2, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/2/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:24:07.764502Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]",' '"hb_front_addr":' '"[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/2",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '}' '],' '"osdmap_clean_epochs":' '{' '"min_last_epoch_clean":' 28, '"last_epoch_clean":' '{' '"per_pool":' '[' '{' '"poolid":' 1, '"floor":' 28 '},' '{' '"poolid":' 2, '"floor":' 28 '}' ']' '},' '"osd_epochs":' '[' '{' '"id":' 0, '"epoch":' 78 '},' '{' '"id":' 1, '"epoch":' 80 '}' ']' '},' '"osdmap_first_committed":' 28, '"osdmap_last_committed":' 83, '"crushmap":' '{' '"devices":' '[' '{' '"id":' 0, '"name":' '"osd.0",' '"class":' '"hdd"' '},' '{' '"id":' 1, '"name":' '"osd.1",' '"class":' '"hdd"' '},' '{' '"id":' 2, '"name":' '"osd.2",' '"class":' '"hdd"' '}' '],' '"types":' '[' '{' '"type_id":' 0, '"name":' '"osd"' '},' '{' '"type_id":' 1, '"name":' '"host"' '},' '{' '"type_id":' 2, '"name":' '"chassis"' '},' '{' '"type_id":' 3, '"name":' '"rack"' '},' '{' '"type_id":' 4, '"name":' '"row"' '},' '{' '"type_id":' 5, '"name":' '"pdu"' '},' '{' '"type_id":' 6, '"name":' '"pod"' '},' '{' '"type_id":' 7, '"name":' '"room"' '},' '{' '"type_id":' 8, '"name":' '"datacenter"' '},' '{' '"type_id":' 9, '"name":' '"zone"' '},' '{' '"type_id":' 10, '"name":' '"region"' '},' '{' '"type_id":' 11, '"name":' '"root"' '}' '],' '"buckets":' '[' '{' '"id":' -1, '"name":' '"default",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -3, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -2, '"name":' '"default~hdd",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -4, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -3, '"name":' '"smithi096",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '},' '{' '"id":' -4, '"name":' '"smithi096~hdd",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '}' '],' '"rules":' '[' '{' '"rule_id":' 0, '"rule_name":' '"replicated_rule",' '"type":' 1, '"steps":' '[' '{' '"op":' '"take",' '"item":' -1, '"item_name":' '"default"' '},' '{' '"op":' '"choose_firstn",' '"num":' 0, '"type":' '"osd"' '},' '{' '"op":' '"emit"' '}' ']' '}' '],' '"tunables":' '{' '"choose_local_tries":' 0, '"choose_local_fallback_tries":' 0, '"choose_total_tries":' 50, '"chooseleaf_descend_once":' 1, '"chooseleaf_vary_r":' 1, '"chooseleaf_stable":' 1, '"msr_descents":' 100, '"msr_collision_tries":' 100, '"straw_calc_version":' 1, '"allowed_bucket_algs":' 54, '"profile":' '"jewel",' '"optimal_tunables":' 1, '"legacy_tunables":' 0, '"minimum_required_version":' '"jewel",' '"require_feature_tunables":' 1, '"require_feature_tunables2":' 1, '"has_v2_rules":' 0, '"require_feature_tunables3":' 1, '"has_v3_rules":' 0, '"has_v4_buckets":' 1, '"require_feature_tunables5":' 1, '"has_v5_rules":' 0, '"has_msr_rules":' 0 '},' '"choose_args":' '{}' '},' '"fsmap":' '{' '"epoch":' 1, '"btime":' '"2024-09-16T03:22:46:882186+0000",' '"default_fscid":' -1, '"compat":' '{' '"compat":' '{},' '"ro_compat":' '{},' '"incompat":' '{' '"feature_1":' '"base' 'v0.20",' '"feature_2":' '"client' writeable 'ranges",' '"feature_3":' '"default' file layouts on 'dirs",' '"feature_4":' '"dir' inode in separate 'object",' '"feature_5":' '"mds' uses versioned 'encoding",' '"feature_6":' '"dirfrag' is stored in 'omap",' '"feature_8":' '"no' anchor 'table",' '"feature_9":' '"file' layout 'v2",' '"feature_10":' '"snaprealm' 'v2",' '"feature_11":' '"minor' log 'segments",' '"feature_12":' '"quiesce' 'subvolumes"' '}' '},' '"feature_flags":' '{' '"enable_multiple":' true, '"ever_enabled_multiple":' true '},' '"standbys":' '[],' '"filesystems":' '[]' '},' '"mdsmap_first_committed":' 1, '"mdsmap_last_committed":' 1, '"auth":' '{' '"first_committed":' 1, '"last_committed":' 5, '"num_secrets":' 3 '},' '"num_pg":' 64, '"num_pg_active":' 64, '"num_pg_unknown":' 0, '"num_osd":' 3, '"pool_sum":' '{' '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 128, '"acting":' 128, '"num_store_stats":' 0 '},' '"osd_sum":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54580, '"kb_used_data":' 888, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660620, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692474880, '"internally_reserved":' 0, '"allocated":' 909312, '"data_stored":' 340452, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 315, '"apply_latency_ms":' 315, '"commit_latency_ns":' 315000000, '"apply_latency_ns":' 315000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '},' '"osd_sum_by_class":' '{' '"hdd":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54580, '"kb_used_data":' 888, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660620, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692474880, '"internally_reserved":' 0, '"allocated":' 909312, '"data_stored":' 340452, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 315, '"apply_latency_ms":' 315, '"commit_latency_ns":' 315000000, '"apply_latency_ns":' 315000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '}' '},' '"pool_stats":' '[' '{' '"poolid":' 2, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '},' '{' '"poolid":' 1, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '}' '],' '"osd_stats":' '[' '{' '"osd":' 0, '"seq":' 21474836518 '},' '{' '"osd":' 1, '"seq":' 42949672989 '},' '{' '"osd":' 2, '"seq":' 0 '}' '],' '"num_pg_by_state":' '[' '{' '"state":' '"active+clean",' '"num":' 16 '},' '{' '"state":' '"active+undersized",' '"num":' 48 '}' '],' '"num_pg_by_osd":' '[' '{' '"osd":' 2, '"num_primary_pg":' 0, '"num_acting_pg":' 0, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 0, '"num_primary_pg":' 28, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 1, '"num_primary_pg":' 36, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '}' '],' '"purged_snaps":' '[' '{' '"pool":' 1, '"purged_snaps":' '{}' '},' '{' '"pool":' 2, '"purged_snaps":' '{}' '}' '],' '"servicemap":' '{' '"epoch":' 5, '"modified":' '"2024-09-16T03:25:38.422788+0000",' '"services":' '{}' '},' '"mgrstat_first_committed":' 79, '"mgrstat_last_committed":' 86, '"logm_first_committed":' 1, '"logm_last_committed":' 382, '"paxos":' '{' '"first_committed":' 1, '"last_committed":' 568, '"last_pn":' 0, '"accepted_pn":' 0 '}' '}' 2024-09-16T03:26:01.384 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:132: get_fc_lc_diff: osdm_fc=28 2024-09-16T03:26:01.384 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:134: get_fc_lc_diff: jq .osdmap_last_committed 2024-09-16T03:26:01.385 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:134: get_fc_lc_diff: echo '{' '"cluster_fingerprint":' '"fda2fc64-07ed-4add-8224-2e527e11d427",' '"version":' '"19.3.0-4930-gfc3e0bff",' '"commit":' '"fc3e0bff7468fd55478adbae7f75508b749124b6",' '"timestamp":' '"2024-09-16T03:26:01.256140+0000",' '"tag":' '"",' '"health":' '{' '"status":' '"HEALTH_OK",' '"checks":' '{},' '"mutes":' '[]' '},' '"monmap_first_committed":' 1, '"monmap_last_committed":' 1, '"monmap":' '{' '"epoch":' 1, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"modified":' '"2024-09-16T03:22:45.872880Z",' '"created":' '"2024-09-16T03:22:45.872880Z",' '"min_mon_release":' 19, '"min_mon_release_name":' '"squid",' '"election_strategy":' 1, '"disallowed_leaders:' '":' '"",' '"stretch_mode":' false, '"tiebreaker_mon":' '"",' '"removed_ranks:' '":' '"",' '"features":' '{' '"persistent":' '[' '"kraken",' '"luminous",' '"mimic",' '"osdmap-prune",' '"nautilus",' '"octopus",' '"pacific",' '"elector-pinging",' '"quincy",' '"reef",' '"squid"' '],' '"optional":' '[]' '},' '"mons":' '[' '{' '"rank":' 0, '"name":' '"a",' '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:7302",' '"nonce":' 0 '}' ']' '},' '"addr":' '"127.0.0.1:7302/0",' '"public_addr":' '"127.0.0.1:7302/0",' '"priority":' 0, '"weight":' 0, '"crush_location":' '"{}"' '}' ']' '},' '"quorum":' '[' 0 '],' '"osdmap":' '{' '"epoch":' 83, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"created":' '"2024-09-16T03:22:46.906117+0000",' '"modified":' '"2024-09-16T03:25:57.328949+0000",' '"last_up_change":' '"2024-09-16T03:25:08.513363+0000",' '"last_in_change":' '"2024-09-16T03:25:09.839444+0000",' '"flags":' '"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit",' '"flags_num":' 5799936, '"flags_set":' '[' '"pglog_hardlimit",' '"purged_snapdirs",' '"recovery_deletes",' '"sortbitwise"' '],' '"crush_version":' 7, '"full_ratio":' 0.97000002861022949, '"backfillfull_ratio":' 0.97000002861022949, '"nearfull_ratio":' 0.85000002384185791, '"cluster_snapshot":' '"",' '"pool_max":' 2, '"max_osd":' 3, '"require_min_compat_client":' '"luminous",' '"min_compat_client":' '"jewel",' '"require_osd_release":' '"squid",' '"allow_crimson":' false, '"pools":' '[' '{' '"pool":' 1, '"pool_name":' '"foo",' '"create_time":' '"2024-09-16T03:24:44.525189+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 3, '"min_size":' 2, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"30",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.8700000047683716, '"score_stable":' 1.8700000047683716, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1.25, '"raw_score_stable":' 1.25, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '},' '{' '"pool":' 2, '"pool_name":' '"bar",' '"create_time":' '"2024-09-16T03:24:46.226575+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 2, '"min_size":' 1, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"83",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.4900000095367432, '"score_stable":' 1.4900000095367432, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1, '"raw_score_stable":' 1, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '}' '],' '"osds":' '[' '{' '"osd":' 0, '"uuid":' '"64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 5, '"up_thru":' 81, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6802",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6803",' '"nonce":' 3375787448 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6804",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6805",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6808",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6809",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6806",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6807",' '"nonce":' 3375787448 '}' ']' '},' '"public_addr":' '"127.0.0.1:6803/3375787448",' '"cluster_addr":' '"127.0.0.1:6805/3375787448",' '"heartbeat_back_addr":' '"127.0.0.1:6809/3375787448",' '"heartbeat_front_addr":' '"127.0.0.1:6807/3375787448",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 1, '"uuid":' '"74b26727-75c9-444d-8782-719e4197a382",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 10, '"up_thru":' 81, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6810",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6811",' '"nonce":' 3733255132 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6812",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6813",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6816",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6817",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6814",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6815",' '"nonce":' 3733255132 '}' ']' '},' '"public_addr":' '"127.0.0.1:6811/3733255132",' '"cluster_addr":' '"127.0.0.1:6813/3733255132",' '"heartbeat_back_addr":' '"127.0.0.1:6817/3733255132",' '"heartbeat_front_addr":' '"127.0.0.1:6815/3733255132",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 2, '"uuid":' '"143da3a7-dad9-4b1e-966b-76cf5bdd3c82",' '"up":' 0, '"in":' 0, '"weight":' 0, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 15, '"up_thru":' 21, '"down_at":' 33, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6818",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6819",' '"nonce":' 963814857 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6820",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6821",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6824",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6825",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6822",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6823",' '"nonce":' 963814857 '}' ']' '},' '"public_addr":' '"127.0.0.1:6819/963814857",' '"cluster_addr":' '"127.0.0.1:6821/963814857",' '"heartbeat_back_addr":' '"127.0.0.1:6825/963814857",' '"heartbeat_front_addr":' '"127.0.0.1:6823/963814857",' '"state":' '[' '"exists"' ']' '}' '],' '"osd_xinfo":' '[' '{' '"osd":' 0, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:22.481942+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 1, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:59.663703+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 2, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 65536, '"last_purged_snaps_scrub":' '"2024-09-16T03:24:37.320822+0000",' '"dead_epoch":' 32 '}' '],' '"pg_upmap":' '[],' '"pg_upmap_items":' '[],' '"pg_upmap_primaries":' '[],' '"pg_temp":' '[],' '"primary_temp":' '[],' '"blocklist":' '{},' '"range_blocklist":' '{},' '"erasure_code_profiles":' '{' '"default":' '{' '"k":' '"2",' '"m":' '"2",' '"plugin":' '"jerasure",' '"technique":' '"reed_sol_van"' '}' '},' '"removed_snaps_queue":' '[],' '"new_removed_snaps":' '[],' '"new_purged_snaps":' '[],' '"crush_node_flags":' '{},' '"device_class_flags":' '{},' '"stretch_mode":' '{' '"stretch_mode_enabled":' false, '"stretch_bucket_count":' 0, '"degraded_stretch_mode":' 0, '"recovering_stretch_mode":' 0, '"stretch_mode_bucket":' 0 '}' '},' '"osd_metadata":' '[' '{' '"id":' 0, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/0/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:22:53.662571Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]",' '"hb_front_addr":' '"[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/0",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 1, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/1/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:23:30.129885Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]",' '"hb_front_addr":' '"[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/1",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 2, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/2/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:24:07.764502Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]",' '"hb_front_addr":' '"[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/2",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '}' '],' '"osdmap_clean_epochs":' '{' '"min_last_epoch_clean":' 28, '"last_epoch_clean":' '{' '"per_pool":' '[' '{' '"poolid":' 1, '"floor":' 28 '},' '{' '"poolid":' 2, '"floor":' 28 '}' ']' '},' '"osd_epochs":' '[' '{' '"id":' 0, '"epoch":' 78 '},' '{' '"id":' 1, '"epoch":' 80 '}' ']' '},' '"osdmap_first_committed":' 28, '"osdmap_last_committed":' 83, '"crushmap":' '{' '"devices":' '[' '{' '"id":' 0, '"name":' '"osd.0",' '"class":' '"hdd"' '},' '{' '"id":' 1, '"name":' '"osd.1",' '"class":' '"hdd"' '},' '{' '"id":' 2, '"name":' '"osd.2",' '"class":' '"hdd"' '}' '],' '"types":' '[' '{' '"type_id":' 0, '"name":' '"osd"' '},' '{' '"type_id":' 1, '"name":' '"host"' '},' '{' '"type_id":' 2, '"name":' '"chassis"' '},' '{' '"type_id":' 3, '"name":' '"rack"' '},' '{' '"type_id":' 4, '"name":' '"row"' '},' '{' '"type_id":' 5, '"name":' '"pdu"' '},' '{' '"type_id":' 6, '"name":' '"pod"' '},' '{' '"type_id":' 7, '"name":' '"room"' '},' '{' '"type_id":' 8, '"name":' '"datacenter"' '},' '{' '"type_id":' 9, '"name":' '"zone"' '},' '{' '"type_id":' 10, '"name":' '"region"' '},' '{' '"type_id":' 11, '"name":' '"root"' '}' '],' '"buckets":' '[' '{' '"id":' -1, '"name":' '"default",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -3, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -2, '"name":' '"default~hdd",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -4, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -3, '"name":' '"smithi096",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '},' '{' '"id":' -4, '"name":' '"smithi096~hdd",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '}' '],' '"rules":' '[' '{' '"rule_id":' 0, '"rule_name":' '"replicated_rule",' '"type":' 1, '"steps":' '[' '{' '"op":' '"take",' '"item":' -1, '"item_name":' '"default"' '},' '{' '"op":' '"choose_firstn",' '"num":' 0, '"type":' '"osd"' '},' '{' '"op":' '"emit"' '}' ']' '}' '],' '"tunables":' '{' '"choose_local_tries":' 0, '"choose_local_fallback_tries":' 0, '"choose_total_tries":' 50, '"chooseleaf_descend_once":' 1, '"chooseleaf_vary_r":' 1, '"chooseleaf_stable":' 1, '"msr_descents":' 100, '"msr_collision_tries":' 100, '"straw_calc_version":' 1, '"allowed_bucket_algs":' 54, '"profile":' '"jewel",' '"optimal_tunables":' 1, '"legacy_tunables":' 0, '"minimum_required_version":' '"jewel",' '"require_feature_tunables":' 1, '"require_feature_tunables2":' 1, '"has_v2_rules":' 0, '"require_feature_tunables3":' 1, '"has_v3_rules":' 0, '"has_v4_buckets":' 1, '"require_feature_tunables5":' 1, '"has_v5_rules":' 0, '"has_msr_rules":' 0 '},' '"choose_args":' '{}' '},' '"fsmap":' '{' '"epoch":' 1, '"btime":' '"2024-09-16T03:22:46:882186+0000",' '"default_fscid":' -1, '"compat":' '{' '"compat":' '{},' '"ro_compat":' '{},' '"incompat":' '{' '"feature_1":' '"base' 'v0.20",' '"feature_2":' '"client' writeable 'ranges",' '"feature_3":' '"default' file layouts on 'dirs",' '"feature_4":' '"dir' inode in separate 'object",' '"feature_5":' '"mds' uses versioned 'encoding",' '"feature_6":' '"dirfrag' is stored in 'omap",' '"feature_8":' '"no' anchor 'table",' '"feature_9":' '"file' layout 'v2",' '"feature_10":' '"snaprealm' 'v2",' '"feature_11":' '"minor' log 'segments",' '"feature_12":' '"quiesce' 'subvolumes"' '}' '},' '"feature_flags":' '{' '"enable_multiple":' true, '"ever_enabled_multiple":' true '},' '"standbys":' '[],' '"filesystems":' '[]' '},' '"mdsmap_first_committed":' 1, '"mdsmap_last_committed":' 1, '"auth":' '{' '"first_committed":' 1, '"last_committed":' 5, '"num_secrets":' 3 '},' '"num_pg":' 64, '"num_pg_active":' 64, '"num_pg_unknown":' 0, '"num_osd":' 3, '"pool_sum":' '{' '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 128, '"acting":' 128, '"num_store_stats":' 0 '},' '"osd_sum":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54580, '"kb_used_data":' 888, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660620, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692474880, '"internally_reserved":' 0, '"allocated":' 909312, '"data_stored":' 340452, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 315, '"apply_latency_ms":' 315, '"commit_latency_ns":' 315000000, '"apply_latency_ns":' 315000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '},' '"osd_sum_by_class":' '{' '"hdd":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54580, '"kb_used_data":' 888, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660620, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692474880, '"internally_reserved":' 0, '"allocated":' 909312, '"data_stored":' 340452, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 315, '"apply_latency_ms":' 315, '"commit_latency_ns":' 315000000, '"apply_latency_ns":' 315000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '}' '},' '"pool_stats":' '[' '{' '"poolid":' 2, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '},' '{' '"poolid":' 1, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '}' '],' '"osd_stats":' '[' '{' '"osd":' 0, '"seq":' 21474836518 '},' '{' '"osd":' 1, '"seq":' 42949672989 '},' '{' '"osd":' 2, '"seq":' 0 '}' '],' '"num_pg_by_state":' '[' '{' '"state":' '"active+clean",' '"num":' 16 '},' '{' '"state":' '"active+undersized",' '"num":' 48 '}' '],' '"num_pg_by_osd":' '[' '{' '"osd":' 2, '"num_primary_pg":' 0, '"num_acting_pg":' 0, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 0, '"num_primary_pg":' 28, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 1, '"num_primary_pg":' 36, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '}' '],' '"purged_snaps":' '[' '{' '"pool":' 1, '"purged_snaps":' '{}' '},' '{' '"pool":' 2, '"purged_snaps":' '{}' '}' '],' '"servicemap":' '{' '"epoch":' 5, '"modified":' '"2024-09-16T03:25:38.422788+0000",' '"services":' '{}' '},' '"mgrstat_first_committed":' 79, '"mgrstat_last_committed":' 86, '"logm_first_committed":' 1, '"logm_last_committed":' 382, '"paxos":' '{' '"first_committed":' 1, '"last_committed":' 568, '"last_pn":' 0, '"accepted_pn":' 0 '}' '}' 2024-09-16T03:26:01.385 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:134: get_fc_lc_diff: osdm_lc=83 2024-09-16T03:26:01.385 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:136: get_fc_lc_diff: echo 55 2024-09-16T03:26:01.385 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:271: TEST_mon_last_clean_epoch: pre_map_diff=55 2024-09-16T03:26:01.385 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:273: TEST_mon_last_clean_epoch: ceph osd pool set foo size 2 2024-09-16T03:26:02.110 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 1 size to 2 2024-09-16T03:26:02.130 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:274: TEST_mon_last_clean_epoch: wait_for_clean 2024-09-16T03:26:02.130 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1633: wait_for_clean: local cmd= 2024-09-16T03:26:02.130 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1634: wait_for_clean: local num_active_clean=-1 2024-09-16T03:26:02.130 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1635: wait_for_clean: local cur_active_clean 2024-09-16T03:26:02.131 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: get_timeout_delays 90 .1 2024-09-16T03:26:02.132 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: shopt -q -o xtrace 2024-09-16T03:26:02.132 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: echo true 2024-09-16T03:26:02.133 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: local trace=true 2024-09-16T03:26:02.133 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: true 2024-09-16T03:26:02.133 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: shopt -u -o xtrace 2024-09-16T03:26:02.240 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-09-16T03:26:02.240 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: local -a delays 2024-09-16T03:26:02.240 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1637: wait_for_clean: local -i loop=0 2024-09-16T03:26:02.240 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1639: wait_for_clean: flush_pg_stats 2024-09-16T03:26:02.240 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: local timeout=300 2024-09-16T03:26:02.240 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ceph osd ls 2024-09-16T03:26:02.801 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ids='0 2024-09-16T03:26:02.801 INFO:tasks.workunit.client.0.smithi096.stderr:1 2024-09-16T03:26:02.801 INFO:tasks.workunit.client.0.smithi096.stderr:2' 2024-09-16T03:26:02.801 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2208: flush_pg_stats: seqs= 2024-09-16T03:26:02.801 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:26:02.802 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-09-16T03:26:02.955 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=21474836520 2024-09-16T03:26:02.956 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 21474836520 2024-09-16T03:26:02.956 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836520' 2024-09-16T03:26:02.956 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:26:02.956 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-09-16T03:26:03.103 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=42949672992 2024-09-16T03:26:03.103 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 42949672992 2024-09-16T03:26:03.103 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836520 1-42949672992' 2024-09-16T03:26:03.104 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:26:03.104 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-09-16T03:26:03.222 INFO:tasks.workunit.client.0.smithi096.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-16T03:26:03.224 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq= 2024-09-16T03:26:03.224 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z '' 2024-09-16T03:26:03.224 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: continue 2024-09-16T03:26:03.224 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:26:03.224 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 0-21474836520 2024-09-16T03:26:03.224 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:26:03.225 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=0 2024-09-16T03:26:03.226 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 0-21474836520 2024-09-16T03:26:03.226 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:26:03.227 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=21474836520 2024-09-16T03:26:03.227 INFO:tasks.workunit.client.0.smithi096.stdout:waiting osd.0 seq 21474836520 2024-09-16T03:26:03.228 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.0 seq 21474836520' 2024-09-16T03:26:03.228 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T03:26:03.682 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836518 -lt 21474836520 2024-09-16T03:26:03.682 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: flush_pg_stats: sleep 1 2024-09-16T03:26:04.683 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2224: flush_pg_stats: '[' 300 -eq 0 ']' 2024-09-16T03:26:04.684 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T03:26:05.117 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836521 -lt 21474836520 2024-09-16T03:26:05.118 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:26:05.119 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 1-42949672992 2024-09-16T03:26:05.119 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:26:05.120 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=1 2024-09-16T03:26:05.121 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:26:05.121 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 1-42949672992 2024-09-16T03:26:05.123 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=42949672992 2024-09-16T03:26:05.123 INFO:tasks.workunit.client.0.smithi096.stdout:waiting osd.1 seq 42949672992 2024-09-16T03:26:05.124 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.1 seq 42949672992' 2024-09-16T03:26:05.124 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 1 2024-09-16T03:26:05.552 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 42949672992 -lt 42949672992 2024-09-16T03:26:05.553 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: get_num_pgs 2024-09-16T03:26:05.554 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:26:05.554 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:26:06.145 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: test 64 == 0 2024-09-16T03:26:06.145 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:26:06.146 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:26:06.146 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:26:06.146 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:26:06.146 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:26:06.146 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:26:06.146 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:26:06.569 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=64 2024-09-16T03:26:06.570 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:26:06.570 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:26:06.570 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:26:07.107 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 64 = 64 2024-09-16T03:26:07.107 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: break 2024-09-16T03:26:07.108 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: return 0 2024-09-16T03:26:07.108 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:276: TEST_mon_last_clean_epoch: check_lec_equals_pools 2024-09-16T03:26:07.108 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:26: check_lec_equals_pools: local pool_id= 2024-09-16T03:26:07.108 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:28: check_lec_equals_pools: ceph report 2024-09-16T03:26:07.625 INFO:tasks.workunit.client.0.smithi096.stderr:report 1589869694 2024-09-16T03:26:07.642 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:28: check_lec_equals_pools: report='{ 2024-09-16T03:26:07.642 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_fingerprint": "fda2fc64-07ed-4add-8224-2e527e11d427", 2024-09-16T03:26:07.642 INFO:tasks.workunit.client.0.smithi096.stderr: "version": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:26:07.642 INFO:tasks.workunit.client.0.smithi096.stderr: "commit": "fc3e0bff7468fd55478adbae7f75508b749124b6", 2024-09-16T03:26:07.643 INFO:tasks.workunit.client.0.smithi096.stderr: "timestamp": "2024-09-16T03:26:07.626620+0000", 2024-09-16T03:26:07.643 INFO:tasks.workunit.client.0.smithi096.stderr: "tag": "", 2024-09-16T03:26:07.643 INFO:tasks.workunit.client.0.smithi096.stderr: "health": { 2024-09-16T03:26:07.643 INFO:tasks.workunit.client.0.smithi096.stderr: "status": "HEALTH_OK", 2024-09-16T03:26:07.643 INFO:tasks.workunit.client.0.smithi096.stderr: "checks": {}, 2024-09-16T03:26:07.643 INFO:tasks.workunit.client.0.smithi096.stderr: "mutes": [] 2024-09-16T03:26:07.643 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.643 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap_first_committed": 1, 2024-09-16T03:26:07.643 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap_last_committed": 1, 2024-09-16T03:26:07.643 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap": { 2024-09-16T03:26:07.643 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 1, 2024-09-16T03:26:07.643 INFO:tasks.workunit.client.0.smithi096.stderr: "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", 2024-09-16T03:26:07.644 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:22:45.872880Z", 2024-09-16T03:26:07.644 INFO:tasks.workunit.client.0.smithi096.stderr: "created": "2024-09-16T03:22:45.872880Z", 2024-09-16T03:26:07.644 INFO:tasks.workunit.client.0.smithi096.stderr: "min_mon_release": 19, 2024-09-16T03:26:07.644 INFO:tasks.workunit.client.0.smithi096.stderr: "min_mon_release_name": "squid", 2024-09-16T03:26:07.644 INFO:tasks.workunit.client.0.smithi096.stderr: "election_strategy": 1, 2024-09-16T03:26:07.644 INFO:tasks.workunit.client.0.smithi096.stderr: "disallowed_leaders: ": "", 2024-09-16T03:26:07.644 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode": false, 2024-09-16T03:26:07.644 INFO:tasks.workunit.client.0.smithi096.stderr: "tiebreaker_mon": "", 2024-09-16T03:26:07.644 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_ranks: ": "", 2024-09-16T03:26:07.644 INFO:tasks.workunit.client.0.smithi096.stderr: "features": { 2024-09-16T03:26:07.644 INFO:tasks.workunit.client.0.smithi096.stderr: "persistent": [ 2024-09-16T03:26:07.644 INFO:tasks.workunit.client.0.smithi096.stderr: "kraken", 2024-09-16T03:26:07.645 INFO:tasks.workunit.client.0.smithi096.stderr: "luminous", 2024-09-16T03:26:07.645 INFO:tasks.workunit.client.0.smithi096.stderr: "mimic", 2024-09-16T03:26:07.645 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap-prune", 2024-09-16T03:26:07.645 INFO:tasks.workunit.client.0.smithi096.stderr: "nautilus", 2024-09-16T03:26:07.645 INFO:tasks.workunit.client.0.smithi096.stderr: "octopus", 2024-09-16T03:26:07.645 INFO:tasks.workunit.client.0.smithi096.stderr: "pacific", 2024-09-16T03:26:07.645 INFO:tasks.workunit.client.0.smithi096.stderr: "elector-pinging", 2024-09-16T03:26:07.645 INFO:tasks.workunit.client.0.smithi096.stderr: "quincy", 2024-09-16T03:26:07.645 INFO:tasks.workunit.client.0.smithi096.stderr: "reef", 2024-09-16T03:26:07.645 INFO:tasks.workunit.client.0.smithi096.stderr: "squid" 2024-09-16T03:26:07.645 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:07.645 INFO:tasks.workunit.client.0.smithi096.stderr: "optional": [] 2024-09-16T03:26:07.645 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.646 INFO:tasks.workunit.client.0.smithi096.stderr: "mons": [ 2024-09-16T03:26:07.646 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:07.646 INFO:tasks.workunit.client.0.smithi096.stderr: "rank": 0, 2024-09-16T03:26:07.646 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "a", 2024-09-16T03:26:07.646 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:26:07.646 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:07.646 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:07.646 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:07.646 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:7302", 2024-09-16T03:26:07.646 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 0 2024-09-16T03:26:07.646 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:07.646 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:07.647 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.647 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:7302/0", 2024-09-16T03:26:07.647 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:7302/0", 2024-09-16T03:26:07.647 INFO:tasks.workunit.client.0.smithi096.stderr: "priority": 0, 2024-09-16T03:26:07.647 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 0, 2024-09-16T03:26:07.647 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_location": "{}" 2024-09-16T03:26:07.647 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:07.647 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:07.647 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.647 INFO:tasks.workunit.client.0.smithi096.stderr: "quorum": [ 2024-09-16T03:26:07.647 INFO:tasks.workunit.client.0.smithi096.stderr: 0 2024-09-16T03:26:07.647 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:07.647 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap": { 2024-09-16T03:26:07.648 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 86, 2024-09-16T03:26:07.648 INFO:tasks.workunit.client.0.smithi096.stderr: "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", 2024-09-16T03:26:07.648 INFO:tasks.workunit.client.0.smithi096.stderr: "created": "2024-09-16T03:22:46.906117+0000", 2024-09-16T03:26:07.648 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:26:02.230083+0000", 2024-09-16T03:26:07.648 INFO:tasks.workunit.client.0.smithi096.stderr: "last_up_change": "2024-09-16T03:25:08.513363+0000", 2024-09-16T03:26:07.648 INFO:tasks.workunit.client.0.smithi096.stderr: "last_in_change": "2024-09-16T03:25:09.839444+0000", 2024-09-16T03:26:07.648 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-16T03:26:07.648 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_num": 5799936, 2024-09-16T03:26:07.648 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_set": [ 2024-09-16T03:26:07.648 INFO:tasks.workunit.client.0.smithi096.stderr: "pglog_hardlimit", 2024-09-16T03:26:07.648 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snapdirs", 2024-09-16T03:26:07.648 INFO:tasks.workunit.client.0.smithi096.stderr: "recovery_deletes", 2024-09-16T03:26:07.649 INFO:tasks.workunit.client.0.smithi096.stderr: "sortbitwise" 2024-09-16T03:26:07.649 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:07.649 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_version": 7, 2024-09-16T03:26:07.649 INFO:tasks.workunit.client.0.smithi096.stderr: "full_ratio": 0.97000002861022949, 2024-09-16T03:26:07.649 INFO:tasks.workunit.client.0.smithi096.stderr: "backfillfull_ratio": 0.97000002861022949, 2024-09-16T03:26:07.649 INFO:tasks.workunit.client.0.smithi096.stderr: "nearfull_ratio": 0.85000002384185791, 2024-09-16T03:26:07.649 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_snapshot": "", 2024-09-16T03:26:07.649 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_max": 2, 2024-09-16T03:26:07.649 INFO:tasks.workunit.client.0.smithi096.stderr: "max_osd": 3, 2024-09-16T03:26:07.649 INFO:tasks.workunit.client.0.smithi096.stderr: "require_min_compat_client": "luminous", 2024-09-16T03:26:07.649 INFO:tasks.workunit.client.0.smithi096.stderr: "min_compat_client": "jewel", 2024-09-16T03:26:07.649 INFO:tasks.workunit.client.0.smithi096.stderr: "require_osd_release": "squid", 2024-09-16T03:26:07.649 INFO:tasks.workunit.client.0.smithi096.stderr: "allow_crimson": false, 2024-09-16T03:26:07.650 INFO:tasks.workunit.client.0.smithi096.stderr: "pools": [ 2024-09-16T03:26:07.650 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:07.650 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 1, 2024-09-16T03:26:07.650 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_name": "foo", 2024-09-16T03:26:07.650 INFO:tasks.workunit.client.0.smithi096.stderr: "create_time": "2024-09-16T03:24:44.525189+0000", 2024-09-16T03:26:07.650 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": 1, 2024-09-16T03:26:07.650 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_names": "hashpspool", 2024-09-16T03:26:07.650 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:26:07.650 INFO:tasks.workunit.client.0.smithi096.stderr: "size": 2, 2024-09-16T03:26:07.650 INFO:tasks.workunit.client.0.smithi096.stderr: "min_size": 1, 2024-09-16T03:26:07.650 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_rule": 0, 2024-09-16T03:26:07.650 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_count": 0, 2024-09-16T03:26:07.650 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_target": 0, 2024-09-16T03:26:07.650 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_barrier": 0, 2024-09-16T03:26:07.651 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-16T03:26:07.651 INFO:tasks.workunit.client.0.smithi096.stderr: "is_stretch_pool": false, 2024-09-16T03:26:07.651 INFO:tasks.workunit.client.0.smithi096.stderr: "object_hash": 2, 2024-09-16T03:26:07.651 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_autoscale_mode": "off", 2024-09-16T03:26:07.651 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num": 32, 2024-09-16T03:26:07.651 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num": 32, 2024-09-16T03:26:07.651 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num_target": 32, 2024-09-16T03:26:07.651 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_target": 32, 2024-09-16T03:26:07.651 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_pending": 32, 2024-09-16T03:26:07.651 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pg_merge_meta": { 2024-09-16T03:26:07.651 INFO:tasks.workunit.client.0.smithi096.stderr: "source_pgid": "0.0", 2024-09-16T03:26:07.651 INFO:tasks.workunit.client.0.smithi096.stderr: "ready_epoch": 0, 2024-09-16T03:26:07.651 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_started": 0, 2024-09-16T03:26:07.652 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": 0, 2024-09-16T03:26:07.652 INFO:tasks.workunit.client.0.smithi096.stderr: "source_version": "0'\''0", 2024-09-16T03:26:07.652 INFO:tasks.workunit.client.0.smithi096.stderr: "target_version": "0'\''0" 2024-09-16T03:26:07.652 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.652 INFO:tasks.workunit.client.0.smithi096.stderr: "last_change": "85", 2024-09-16T03:26:07.652 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend": "0", 2024-09-16T03:26:07.652 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_prenautilus": "0", 2024-09-16T03:26:07.652 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_preluminous": "0", 2024-09-16T03:26:07.652 INFO:tasks.workunit.client.0.smithi096.stderr: "auid": 0, 2024-09-16T03:26:07.652 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_mode": "selfmanaged", 2024-09-16T03:26:07.652 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_seq": 0, 2024-09-16T03:26:07.652 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_epoch": 0, 2024-09-16T03:26:07.652 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_snaps": [], 2024-09-16T03:26:07.653 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps": "[]", 2024-09-16T03:26:07.653 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_bytes": 0, 2024-09-16T03:26:07.653 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_objects": 0, 2024-09-16T03:26:07.653 INFO:tasks.workunit.client.0.smithi096.stderr: "tiers": [], 2024-09-16T03:26:07.653 INFO:tasks.workunit.client.0.smithi096.stderr: "tier_of": -1, 2024-09-16T03:26:07.653 INFO:tasks.workunit.client.0.smithi096.stderr: "read_tier": -1, 2024-09-16T03:26:07.653 INFO:tasks.workunit.client.0.smithi096.stderr: "write_tier": -1, 2024-09-16T03:26:07.653 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_mode": "none", 2024-09-16T03:26:07.653 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_bytes": 0, 2024-09-16T03:26:07.653 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_objects": 0, 2024-09-16T03:26:07.653 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_ratio_micro": 400000, 2024-09-16T03:26:07.653 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-16T03:26:07.653 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_full_ratio_micro": 800000, 2024-09-16T03:26:07.653 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_flush_age": 0, 2024-09-16T03:26:07.654 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_evict_age": 0, 2024-09-16T03:26:07.654 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profile": "", 2024-09-16T03:26:07.654 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_params": { 2024-09-16T03:26:07.654 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "none" 2024-09-16T03:26:07.654 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.654 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_period": 0, 2024-09-16T03:26:07.654 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_count": 0, 2024-09-16T03:26:07.654 INFO:tasks.workunit.client.0.smithi096.stderr: "use_gmt_hitset": true, 2024-09-16T03:26:07.654 INFO:tasks.workunit.client.0.smithi096.stderr: "min_read_recency_for_promote": 0, 2024-09-16T03:26:07.654 INFO:tasks.workunit.client.0.smithi096.stderr: "min_write_recency_for_promote": 0, 2024-09-16T03:26:07.654 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_grade_decay_rate": 0, 2024-09-16T03:26:07.654 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_search_last_n": 0, 2024-09-16T03:26:07.654 INFO:tasks.workunit.client.0.smithi096.stderr: "grade_table": [], 2024-09-16T03:26:07.655 INFO:tasks.workunit.client.0.smithi096.stderr: "stripe_width": 0, 2024-09-16T03:26:07.655 INFO:tasks.workunit.client.0.smithi096.stderr: "expected_num_objects": 0, 2024-09-16T03:26:07.655 INFO:tasks.workunit.client.0.smithi096.stderr: "fast_read": false, 2024-09-16T03:26:07.655 INFO:tasks.workunit.client.0.smithi096.stderr: "options": {}, 2024-09-16T03:26:07.655 INFO:tasks.workunit.client.0.smithi096.stderr: "application_metadata": {}, 2024-09-16T03:26:07.655 INFO:tasks.workunit.client.0.smithi096.stderr: "read_balance": { 2024-09-16T03:26:07.655 INFO:tasks.workunit.client.0.smithi096.stderr: "score_type": "Fair distribution", 2024-09-16T03:26:07.655 INFO:tasks.workunit.client.0.smithi096.stderr: "score_acting": 1.8700000047683716, 2024-09-16T03:26:07.655 INFO:tasks.workunit.client.0.smithi096.stderr: "score_stable": 1.8700000047683716, 2024-09-16T03:26:07.655 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_score": 0.67000001668930054, 2024-09-16T03:26:07.655 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_acting": 1.25, 2024-09-16T03:26:07.655 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_stable": 1.25, 2024-09-16T03:26:07.655 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity_weighted": 1, 2024-09-16T03:26:07.655 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity": 1, 2024-09-16T03:26:07.656 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity_weighted": 1 2024-09-16T03:26:07.656 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:07.656 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.656 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:07.656 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 2, 2024-09-16T03:26:07.656 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_name": "bar", 2024-09-16T03:26:07.656 INFO:tasks.workunit.client.0.smithi096.stderr: "create_time": "2024-09-16T03:24:46.226575+0000", 2024-09-16T03:26:07.656 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": 1, 2024-09-16T03:26:07.656 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_names": "hashpspool", 2024-09-16T03:26:07.656 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:26:07.656 INFO:tasks.workunit.client.0.smithi096.stderr: "size": 2, 2024-09-16T03:26:07.656 INFO:tasks.workunit.client.0.smithi096.stderr: "min_size": 1, 2024-09-16T03:26:07.656 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_rule": 0, 2024-09-16T03:26:07.656 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_count": 0, 2024-09-16T03:26:07.657 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_target": 0, 2024-09-16T03:26:07.657 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_barrier": 0, 2024-09-16T03:26:07.657 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-16T03:26:07.657 INFO:tasks.workunit.client.0.smithi096.stderr: "is_stretch_pool": false, 2024-09-16T03:26:07.657 INFO:tasks.workunit.client.0.smithi096.stderr: "object_hash": 2, 2024-09-16T03:26:07.657 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_autoscale_mode": "off", 2024-09-16T03:26:07.657 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num": 32, 2024-09-16T03:26:07.657 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num": 32, 2024-09-16T03:26:07.657 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num_target": 32, 2024-09-16T03:26:07.657 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_target": 32, 2024-09-16T03:26:07.657 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_pending": 32, 2024-09-16T03:26:07.657 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pg_merge_meta": { 2024-09-16T03:26:07.657 INFO:tasks.workunit.client.0.smithi096.stderr: "source_pgid": "0.0", 2024-09-16T03:26:07.657 INFO:tasks.workunit.client.0.smithi096.stderr: "ready_epoch": 0, 2024-09-16T03:26:07.658 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_started": 0, 2024-09-16T03:26:07.658 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": 0, 2024-09-16T03:26:07.658 INFO:tasks.workunit.client.0.smithi096.stderr: "source_version": "0'\''0", 2024-09-16T03:26:07.658 INFO:tasks.workunit.client.0.smithi096.stderr: "target_version": "0'\''0" 2024-09-16T03:26:07.658 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.658 INFO:tasks.workunit.client.0.smithi096.stderr: "last_change": "83", 2024-09-16T03:26:07.658 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend": "0", 2024-09-16T03:26:07.658 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_prenautilus": "0", 2024-09-16T03:26:07.658 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_preluminous": "0", 2024-09-16T03:26:07.658 INFO:tasks.workunit.client.0.smithi096.stderr: "auid": 0, 2024-09-16T03:26:07.658 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_mode": "selfmanaged", 2024-09-16T03:26:07.658 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_seq": 0, 2024-09-16T03:26:07.658 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_epoch": 0, 2024-09-16T03:26:07.658 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_snaps": [], 2024-09-16T03:26:07.659 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps": "[]", 2024-09-16T03:26:07.659 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_bytes": 0, 2024-09-16T03:26:07.659 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_objects": 0, 2024-09-16T03:26:07.659 INFO:tasks.workunit.client.0.smithi096.stderr: "tiers": [], 2024-09-16T03:26:07.659 INFO:tasks.workunit.client.0.smithi096.stderr: "tier_of": -1, 2024-09-16T03:26:07.659 INFO:tasks.workunit.client.0.smithi096.stderr: "read_tier": -1, 2024-09-16T03:26:07.659 INFO:tasks.workunit.client.0.smithi096.stderr: "write_tier": -1, 2024-09-16T03:26:07.659 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_mode": "none", 2024-09-16T03:26:07.659 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_bytes": 0, 2024-09-16T03:26:07.659 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_objects": 0, 2024-09-16T03:26:07.659 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_ratio_micro": 400000, 2024-09-16T03:26:07.659 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-16T03:26:07.659 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_full_ratio_micro": 800000, 2024-09-16T03:26:07.659 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_flush_age": 0, 2024-09-16T03:26:07.660 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_evict_age": 0, 2024-09-16T03:26:07.660 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profile": "", 2024-09-16T03:26:07.660 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_params": { 2024-09-16T03:26:07.660 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "none" 2024-09-16T03:26:07.660 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.660 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_period": 0, 2024-09-16T03:26:07.660 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_count": 0, 2024-09-16T03:26:07.660 INFO:tasks.workunit.client.0.smithi096.stderr: "use_gmt_hitset": true, 2024-09-16T03:26:07.660 INFO:tasks.workunit.client.0.smithi096.stderr: "min_read_recency_for_promote": 0, 2024-09-16T03:26:07.660 INFO:tasks.workunit.client.0.smithi096.stderr: "min_write_recency_for_promote": 0, 2024-09-16T03:26:07.660 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_grade_decay_rate": 0, 2024-09-16T03:26:07.660 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_search_last_n": 0, 2024-09-16T03:26:07.660 INFO:tasks.workunit.client.0.smithi096.stderr: "grade_table": [], 2024-09-16T03:26:07.660 INFO:tasks.workunit.client.0.smithi096.stderr: "stripe_width": 0, 2024-09-16T03:26:07.661 INFO:tasks.workunit.client.0.smithi096.stderr: "expected_num_objects": 0, 2024-09-16T03:26:07.661 INFO:tasks.workunit.client.0.smithi096.stderr: "fast_read": false, 2024-09-16T03:26:07.661 INFO:tasks.workunit.client.0.smithi096.stderr: "options": {}, 2024-09-16T03:26:07.661 INFO:tasks.workunit.client.0.smithi096.stderr: "application_metadata": {}, 2024-09-16T03:26:07.661 INFO:tasks.workunit.client.0.smithi096.stderr: "read_balance": { 2024-09-16T03:26:07.661 INFO:tasks.workunit.client.0.smithi096.stderr: "score_type": "Fair distribution", 2024-09-16T03:26:07.661 INFO:tasks.workunit.client.0.smithi096.stderr: "score_acting": 1.4900000095367432, 2024-09-16T03:26:07.661 INFO:tasks.workunit.client.0.smithi096.stderr: "score_stable": 1.4900000095367432, 2024-09-16T03:26:07.661 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_score": 0.67000001668930054, 2024-09-16T03:26:07.661 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_acting": 1, 2024-09-16T03:26:07.661 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_stable": 1, 2024-09-16T03:26:07.661 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity_weighted": 1, 2024-09-16T03:26:07.661 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity": 1, 2024-09-16T03:26:07.661 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity_weighted": 1 2024-09-16T03:26:07.662 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:07.662 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:07.662 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:07.662 INFO:tasks.workunit.client.0.smithi096.stderr: "osds": [ 2024-09-16T03:26:07.662 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:07.662 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:26:07.662 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6", 2024-09-16T03:26:07.662 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:26:07.662 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:26:07.662 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:26:07.662 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:26:07.662 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:26:07.662 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:26:07.662 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 5, 2024-09-16T03:26:07.663 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 84, 2024-09-16T03:26:07.663 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:26:07.663 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:26:07.663 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:26:07.663 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:07.663 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:07.663 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:07.663 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6802", 2024-09-16T03:26:07.663 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:26:07.663 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.663 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:07.663 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:07.663 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6803", 2024-09-16T03:26:07.663 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:26:07.664 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:07.664 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:07.664 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.664 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:26:07.664 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:07.664 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:07.664 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:07.664 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6804", 2024-09-16T03:26:07.664 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:26:07.664 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.664 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:07.664 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:07.664 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6805", 2024-09-16T03:26:07.664 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:26:07.664 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:07.665 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:07.665 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.665 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:26:07.665 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:07.665 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:07.665 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:07.665 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6808", 2024-09-16T03:26:07.665 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:26:07.665 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.665 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:07.665 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:07.665 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6809", 2024-09-16T03:26:07.665 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:26:07.666 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:07.666 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:07.666 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.666 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:26:07.666 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:07.666 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:07.666 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:07.666 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6806", 2024-09-16T03:26:07.666 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:26:07.666 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.666 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:07.666 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:07.666 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6807", 2024-09-16T03:26:07.667 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:26:07.667 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:07.667 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:07.667 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.667 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6803/3375787448", 2024-09-16T03:26:07.667 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6805/3375787448", 2024-09-16T03:26:07.667 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6809/3375787448", 2024-09-16T03:26:07.667 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6807/3375787448", 2024-09-16T03:26:07.667 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:26:07.667 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:26:07.667 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:26:07.667 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:07.667 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.667 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:07.667 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:26:07.668 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "74b26727-75c9-444d-8782-719e4197a382", 2024-09-16T03:26:07.668 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:26:07.668 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:26:07.668 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:26:07.668 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:26:07.668 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:26:07.668 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:26:07.668 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 10, 2024-09-16T03:26:07.668 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 84, 2024-09-16T03:26:07.668 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:26:07.668 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:26:07.668 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:26:07.668 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:07.668 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:07.669 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:07.669 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6810", 2024-09-16T03:26:07.669 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:26:07.669 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.669 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:07.669 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:07.669 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6811", 2024-09-16T03:26:07.669 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:26:07.669 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:07.669 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:07.669 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.669 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:26:07.669 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:07.670 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:07.670 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:07.670 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6812", 2024-09-16T03:26:07.670 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:26:07.670 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.670 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:07.670 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:07.670 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6813", 2024-09-16T03:26:07.670 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:26:07.670 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:07.670 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:07.670 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.670 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:26:07.670 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:07.671 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:07.671 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:07.671 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6816", 2024-09-16T03:26:07.671 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:26:07.671 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.671 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:07.671 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:07.671 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6817", 2024-09-16T03:26:07.671 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:26:07.671 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:07.671 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:07.671 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.671 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:26:07.672 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:07.672 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:07.672 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:07.672 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6814", 2024-09-16T03:26:07.672 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:26:07.672 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.672 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:07.672 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:07.672 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6815", 2024-09-16T03:26:07.672 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:26:07.672 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:07.672 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:07.672 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.672 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6811/3733255132", 2024-09-16T03:26:07.673 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6813/3733255132", 2024-09-16T03:26:07.673 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6817/3733255132", 2024-09-16T03:26:07.673 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6815/3733255132", 2024-09-16T03:26:07.673 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:26:07.673 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:26:07.673 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:26:07.673 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:07.673 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.673 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:07.673 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:26:07.673 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "143da3a7-dad9-4b1e-966b-76cf5bdd3c82", 2024-09-16T03:26:07.673 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 0, 2024-09-16T03:26:07.673 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 0, 2024-09-16T03:26:07.674 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 0, 2024-09-16T03:26:07.674 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:26:07.674 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:26:07.674 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:26:07.674 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 15, 2024-09-16T03:26:07.674 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 21, 2024-09-16T03:26:07.674 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 33, 2024-09-16T03:26:07.674 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:26:07.674 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:26:07.674 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:07.674 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:07.674 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:07.674 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6818", 2024-09-16T03:26:07.675 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:26:07.675 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.675 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:07.675 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:07.675 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6819", 2024-09-16T03:26:07.675 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:26:07.675 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:07.675 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:07.675 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.675 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:26:07.675 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:07.675 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:07.675 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:07.676 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6820", 2024-09-16T03:26:07.676 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:26:07.676 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.676 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:07.676 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:07.676 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6821", 2024-09-16T03:26:07.676 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:26:07.676 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:07.676 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:07.676 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.676 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:26:07.676 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:07.676 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:07.677 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:07.677 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6824", 2024-09-16T03:26:07.677 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:26:07.677 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.677 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:07.677 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:07.677 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6825", 2024-09-16T03:26:07.677 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:26:07.677 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:07.677 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:07.677 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.677 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:26:07.677 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:07.678 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:07.678 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:07.678 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6822", 2024-09-16T03:26:07.678 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:26:07.678 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.678 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:07.678 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:07.678 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6823", 2024-09-16T03:26:07.678 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:26:07.678 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:07.678 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:07.678 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.678 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6819/963814857", 2024-09-16T03:26:07.678 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6821/963814857", 2024-09-16T03:26:07.679 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6825/963814857", 2024-09-16T03:26:07.679 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6823/963814857", 2024-09-16T03:26:07.679 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:26:07.679 INFO:tasks.workunit.client.0.smithi096.stderr: "exists" 2024-09-16T03:26:07.679 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:07.679 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:07.679 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:07.679 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_xinfo": [ 2024-09-16T03:26:07.679 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:07.679 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:26:07.679 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:26:07.679 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:26:07.679 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:26:07.679 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:26:07.680 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:26:07.680 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:23:22.481942+0000", 2024-09-16T03:26:07.680 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:26:07.680 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.680 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:07.680 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:26:07.680 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:26:07.680 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:26:07.680 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:26:07.680 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:26:07.680 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:26:07.680 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:23:59.663703+0000", 2024-09-16T03:26:07.680 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:26:07.681 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.681 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:07.681 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:26:07.681 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:26:07.681 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:26:07.681 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:26:07.681 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:26:07.681 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 65536, 2024-09-16T03:26:07.681 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:24:37.320822+0000", 2024-09-16T03:26:07.681 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 32 2024-09-16T03:26:07.681 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:07.681 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:07.681 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap": [], 2024-09-16T03:26:07.682 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap_items": [], 2024-09-16T03:26:07.682 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap_primaries": [], 2024-09-16T03:26:07.682 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_temp": [], 2024-09-16T03:26:07.682 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_temp": [], 2024-09-16T03:26:07.682 INFO:tasks.workunit.client.0.smithi096.stderr: "blocklist": {}, 2024-09-16T03:26:07.682 INFO:tasks.workunit.client.0.smithi096.stderr: "range_blocklist": {}, 2024-09-16T03:26:07.682 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profiles": { 2024-09-16T03:26:07.682 INFO:tasks.workunit.client.0.smithi096.stderr: "default": { 2024-09-16T03:26:07.682 INFO:tasks.workunit.client.0.smithi096.stderr: "k": "2", 2024-09-16T03:26:07.682 INFO:tasks.workunit.client.0.smithi096.stderr: "m": "2", 2024-09-16T03:26:07.682 INFO:tasks.workunit.client.0.smithi096.stderr: "plugin": "jerasure", 2024-09-16T03:26:07.682 INFO:tasks.workunit.client.0.smithi096.stderr: "technique": "reed_sol_van" 2024-09-16T03:26:07.682 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:07.682 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.683 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps_queue": [], 2024-09-16T03:26:07.683 INFO:tasks.workunit.client.0.smithi096.stderr: "new_removed_snaps": [], 2024-09-16T03:26:07.683 INFO:tasks.workunit.client.0.smithi096.stderr: "new_purged_snaps": [], 2024-09-16T03:26:07.683 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_node_flags": {}, 2024-09-16T03:26:07.683 INFO:tasks.workunit.client.0.smithi096.stderr: "device_class_flags": {}, 2024-09-16T03:26:07.683 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode": { 2024-09-16T03:26:07.683 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode_enabled": false, 2024-09-16T03:26:07.683 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_bucket_count": 0, 2024-09-16T03:26:07.683 INFO:tasks.workunit.client.0.smithi096.stderr: "degraded_stretch_mode": 0, 2024-09-16T03:26:07.683 INFO:tasks.workunit.client.0.smithi096.stderr: "recovering_stretch_mode": 0, 2024-09-16T03:26:07.683 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode_bucket": 0 2024-09-16T03:26:07.683 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:07.683 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.683 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_metadata": [ 2024-09-16T03:26:07.683 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:07.684 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:26:07.684 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:26:07.684 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]", 2024-09-16T03:26:07.684 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:26:07.684 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:26:07.684 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:26:07.684 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:26:07.684 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:26:07.684 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:26:07.684 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:26:07.684 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:26:07.684 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:26:07.684 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:26:07.684 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:26:07.685 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/0/block", 2024-09-16T03:26:07.685 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:26:07.685 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:26:07.685 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:26:07.685 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:26:07.685 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:26:07.685 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:26:07.685 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:26:07.685 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:26:07.685 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:26:07.685 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:26:07.685 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:22:53.662571Z", 2024-09-16T03:26:07.685 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:26:07.686 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:26:07.686 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:26:07.686 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:26:07.686 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:26:07.686 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:26:07.686 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:26:07.686 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]", 2024-09-16T03:26:07.686 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:26:07.686 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]", 2024-09-16T03:26:07.686 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]", 2024-09-16T03:26:07.686 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:26:07.686 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:26:07.686 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:26:07.686 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:26:07.687 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:26:07.687 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:26:07.687 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:26:07.687 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:26:07.687 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:26:07.687 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/0", 2024-09-16T03:26:07.687 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:26:07.687 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:26:07.687 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:26:07.687 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.687 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:07.687 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:26:07.687 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:26:07.687 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]", 2024-09-16T03:26:07.687 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:26:07.688 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:26:07.688 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:26:07.688 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:26:07.688 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:26:07.688 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:26:07.688 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:26:07.688 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:26:07.688 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:26:07.688 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:26:07.688 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:26:07.688 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/1/block", 2024-09-16T03:26:07.688 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:26:07.688 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:26:07.688 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:26:07.688 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:26:07.689 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:26:07.689 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:26:07.689 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:26:07.689 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:26:07.689 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:26:07.689 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:26:07.689 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:23:30.129885Z", 2024-09-16T03:26:07.689 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:26:07.689 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:26:07.689 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:26:07.689 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:26:07.689 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:26:07.689 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:26:07.689 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:26:07.690 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]", 2024-09-16T03:26:07.690 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:26:07.690 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]", 2024-09-16T03:26:07.690 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]", 2024-09-16T03:26:07.690 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:26:07.690 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:26:07.690 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:26:07.690 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:26:07.690 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:26:07.690 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:26:07.690 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:26:07.690 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:26:07.690 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:26:07.690 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/1", 2024-09-16T03:26:07.691 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:26:07.691 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:26:07.691 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:26:07.691 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.691 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:07.691 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:26:07.691 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:26:07.691 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]", 2024-09-16T03:26:07.691 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:26:07.691 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:26:07.691 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:26:07.691 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:26:07.691 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:26:07.691 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:26:07.692 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:26:07.692 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:26:07.692 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:26:07.692 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:26:07.692 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:26:07.692 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/2/block", 2024-09-16T03:26:07.692 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:26:07.692 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:26:07.692 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:26:07.692 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:26:07.692 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:26:07.692 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:26:07.692 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:26:07.693 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:26:07.693 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:26:07.693 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:26:07.693 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:24:07.764502Z", 2024-09-16T03:26:07.693 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:26:07.693 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:26:07.693 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:26:07.693 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:26:07.693 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:26:07.693 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:26:07.693 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:26:07.693 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]", 2024-09-16T03:26:07.693 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:26:07.694 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]", 2024-09-16T03:26:07.694 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]", 2024-09-16T03:26:07.694 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:26:07.694 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:26:07.694 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:26:07.694 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:26:07.694 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:26:07.694 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:26:07.694 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:26:07.694 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:26:07.694 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:26:07.694 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/2", 2024-09-16T03:26:07.694 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:26:07.694 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:26:07.694 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:26:07.695 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:07.695 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:07.695 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_clean_epochs": { 2024-09-16T03:26:07.695 INFO:tasks.workunit.client.0.smithi096.stderr: "min_last_epoch_clean": 86, 2024-09-16T03:26:07.695 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": { 2024-09-16T03:26:07.695 INFO:tasks.workunit.client.0.smithi096.stderr: "per_pool": [ 2024-09-16T03:26:07.695 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:07.695 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 1, 2024-09-16T03:26:07.695 INFO:tasks.workunit.client.0.smithi096.stderr: "floor": 86 2024-09-16T03:26:07.695 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.695 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:07.695 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 2, 2024-09-16T03:26:07.695 INFO:tasks.workunit.client.0.smithi096.stderr: "floor": 86 2024-09-16T03:26:07.696 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:07.696 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:07.696 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.696 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_epochs": [ 2024-09-16T03:26:07.696 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:07.696 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:26:07.696 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 86 2024-09-16T03:26:07.696 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.696 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:07.696 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:26:07.696 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 86 2024-09-16T03:26:07.696 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:07.696 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:07.697 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.697 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_first_committed": 28, 2024-09-16T03:26:07.697 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_last_committed": 86, 2024-09-16T03:26:07.697 INFO:tasks.workunit.client.0.smithi096.stderr: "crushmap": { 2024-09-16T03:26:07.697 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": [ 2024-09-16T03:26:07.697 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:07.697 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:26:07.697 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.0", 2024-09-16T03:26:07.697 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:26:07.697 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.697 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:07.697 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:26:07.697 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.1", 2024-09-16T03:26:07.698 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:26:07.698 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.698 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:07.698 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:26:07.698 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.2", 2024-09-16T03:26:07.698 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:26:07.698 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:07.698 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:07.698 INFO:tasks.workunit.client.0.smithi096.stderr: "types": [ 2024-09-16T03:26:07.698 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:07.698 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 0, 2024-09-16T03:26:07.698 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd" 2024-09-16T03:26:07.698 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.698 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:07.699 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:26:07.699 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "host" 2024-09-16T03:26:07.699 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.699 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:07.699 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 2, 2024-09-16T03:26:07.699 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "chassis" 2024-09-16T03:26:07.699 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.699 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:07.699 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 3, 2024-09-16T03:26:07.699 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "rack" 2024-09-16T03:26:07.699 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.699 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:07.699 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 4, 2024-09-16T03:26:07.699 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "row" 2024-09-16T03:26:07.699 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.700 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:07.700 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 5, 2024-09-16T03:26:07.700 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "pdu" 2024-09-16T03:26:07.700 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.700 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:07.700 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 6, 2024-09-16T03:26:07.700 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "pod" 2024-09-16T03:26:07.700 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.700 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:07.700 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 7, 2024-09-16T03:26:07.700 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "room" 2024-09-16T03:26:07.700 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.700 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:07.701 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 8, 2024-09-16T03:26:07.701 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "datacenter" 2024-09-16T03:26:07.701 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.701 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:07.701 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 9, 2024-09-16T03:26:07.701 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "zone" 2024-09-16T03:26:07.701 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.701 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:07.701 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 10, 2024-09-16T03:26:07.701 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "region" 2024-09-16T03:26:07.701 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.701 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:07.701 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:26:07.701 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "root" 2024-09-16T03:26:07.702 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:07.702 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:07.702 INFO:tasks.workunit.client.0.smithi096.stderr: "buckets": [ 2024-09-16T03:26:07.702 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:07.702 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -1, 2024-09-16T03:26:07.702 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "default", 2024-09-16T03:26:07.702 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:26:07.702 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "root", 2024-09-16T03:26:07.702 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:26:07.702 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:26:07.702 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:26:07.702 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:26:07.702 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:07.702 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -3, 2024-09-16T03:26:07.703 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:26:07.703 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:26:07.703 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:07.703 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:07.703 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.703 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:07.703 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -2, 2024-09-16T03:26:07.703 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "default~hdd", 2024-09-16T03:26:07.703 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:26:07.703 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "root", 2024-09-16T03:26:07.703 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:26:07.703 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:26:07.704 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:26:07.704 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:26:07.704 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:07.704 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -4, 2024-09-16T03:26:07.704 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:26:07.704 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:26:07.704 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:07.704 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:07.704 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.704 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:07.704 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -3, 2024-09-16T03:26:07.704 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "smithi096", 2024-09-16T03:26:07.704 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:26:07.705 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "host", 2024-09-16T03:26:07.705 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:26:07.705 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:26:07.705 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:26:07.705 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:26:07.705 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:07.705 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:26:07.705 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:26:07.705 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:26:07.705 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.705 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:07.705 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:26:07.705 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:26:07.706 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 1 2024-09-16T03:26:07.706 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.706 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:07.706 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:26:07.706 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:26:07.706 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 2 2024-09-16T03:26:07.706 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:07.706 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:07.706 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.706 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:07.706 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -4, 2024-09-16T03:26:07.706 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "smithi096~hdd", 2024-09-16T03:26:07.706 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:26:07.706 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "host", 2024-09-16T03:26:07.707 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:26:07.707 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:26:07.707 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:26:07.707 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:26:07.707 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:07.707 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:26:07.707 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:26:07.707 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:26:07.707 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.707 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:07.707 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:26:07.707 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:26:07.707 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 1 2024-09-16T03:26:07.707 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.708 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:07.708 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:26:07.708 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:26:07.708 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 2 2024-09-16T03:26:07.708 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:07.708 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:07.708 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:07.708 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:07.708 INFO:tasks.workunit.client.0.smithi096.stderr: "rules": [ 2024-09-16T03:26:07.708 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:07.708 INFO:tasks.workunit.client.0.smithi096.stderr: "rule_id": 0, 2024-09-16T03:26:07.708 INFO:tasks.workunit.client.0.smithi096.stderr: "rule_name": "replicated_rule", 2024-09-16T03:26:07.708 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:26:07.708 INFO:tasks.workunit.client.0.smithi096.stderr: "steps": [ 2024-09-16T03:26:07.709 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:07.709 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "take", 2024-09-16T03:26:07.709 INFO:tasks.workunit.client.0.smithi096.stderr: "item": -1, 2024-09-16T03:26:07.709 INFO:tasks.workunit.client.0.smithi096.stderr: "item_name": "default" 2024-09-16T03:26:07.709 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.709 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:07.709 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "choose_firstn", 2024-09-16T03:26:07.709 INFO:tasks.workunit.client.0.smithi096.stderr: "num": 0, 2024-09-16T03:26:07.709 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "osd" 2024-09-16T03:26:07.709 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.709 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:07.709 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "emit" 2024-09-16T03:26:07.709 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:07.710 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:07.710 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:07.710 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:07.710 INFO:tasks.workunit.client.0.smithi096.stderr: "tunables": { 2024-09-16T03:26:07.710 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_local_tries": 0, 2024-09-16T03:26:07.710 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_local_fallback_tries": 0, 2024-09-16T03:26:07.710 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_total_tries": 50, 2024-09-16T03:26:07.710 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_descend_once": 1, 2024-09-16T03:26:07.710 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_vary_r": 1, 2024-09-16T03:26:07.710 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_stable": 1, 2024-09-16T03:26:07.710 INFO:tasks.workunit.client.0.smithi096.stderr: "msr_descents": 100, 2024-09-16T03:26:07.710 INFO:tasks.workunit.client.0.smithi096.stderr: "msr_collision_tries": 100, 2024-09-16T03:26:07.710 INFO:tasks.workunit.client.0.smithi096.stderr: "straw_calc_version": 1, 2024-09-16T03:26:07.710 INFO:tasks.workunit.client.0.smithi096.stderr: "allowed_bucket_algs": 54, 2024-09-16T03:26:07.711 INFO:tasks.workunit.client.0.smithi096.stderr: "profile": "jewel", 2024-09-16T03:26:07.711 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_tunables": 1, 2024-09-16T03:26:07.711 INFO:tasks.workunit.client.0.smithi096.stderr: "legacy_tunables": 0, 2024-09-16T03:26:07.711 INFO:tasks.workunit.client.0.smithi096.stderr: "minimum_required_version": "jewel", 2024-09-16T03:26:07.711 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables": 1, 2024-09-16T03:26:07.711 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables2": 1, 2024-09-16T03:26:07.711 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v2_rules": 0, 2024-09-16T03:26:07.711 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables3": 1, 2024-09-16T03:26:07.711 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v3_rules": 0, 2024-09-16T03:26:07.711 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v4_buckets": 1, 2024-09-16T03:26:07.711 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables5": 1, 2024-09-16T03:26:07.711 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v5_rules": 0, 2024-09-16T03:26:07.711 INFO:tasks.workunit.client.0.smithi096.stderr: "has_msr_rules": 0 2024-09-16T03:26:07.712 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.712 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_args": {} 2024-09-16T03:26:07.712 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.712 INFO:tasks.workunit.client.0.smithi096.stderr: "fsmap": { 2024-09-16T03:26:07.712 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 1, 2024-09-16T03:26:07.712 INFO:tasks.workunit.client.0.smithi096.stderr: "btime": "2024-09-16T03:22:46:882186+0000", 2024-09-16T03:26:07.712 INFO:tasks.workunit.client.0.smithi096.stderr: "default_fscid": -1, 2024-09-16T03:26:07.712 INFO:tasks.workunit.client.0.smithi096.stderr: "compat": { 2024-09-16T03:26:07.712 INFO:tasks.workunit.client.0.smithi096.stderr: "compat": {}, 2024-09-16T03:26:07.712 INFO:tasks.workunit.client.0.smithi096.stderr: "ro_compat": {}, 2024-09-16T03:26:07.712 INFO:tasks.workunit.client.0.smithi096.stderr: "incompat": { 2024-09-16T03:26:07.712 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_1": "base v0.20", 2024-09-16T03:26:07.712 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_2": "client writeable ranges", 2024-09-16T03:26:07.713 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_3": "default file layouts on dirs", 2024-09-16T03:26:07.713 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_4": "dir inode in separate object", 2024-09-16T03:26:07.713 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_5": "mds uses versioned encoding", 2024-09-16T03:26:07.713 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_6": "dirfrag is stored in omap", 2024-09-16T03:26:07.713 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_8": "no anchor table", 2024-09-16T03:26:07.713 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_9": "file layout v2", 2024-09-16T03:26:07.713 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_10": "snaprealm v2", 2024-09-16T03:26:07.713 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_11": "minor log segments", 2024-09-16T03:26:07.713 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_12": "quiesce subvolumes" 2024-09-16T03:26:07.713 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:07.713 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.713 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_flags": { 2024-09-16T03:26:07.713 INFO:tasks.workunit.client.0.smithi096.stderr: "enable_multiple": true, 2024-09-16T03:26:07.714 INFO:tasks.workunit.client.0.smithi096.stderr: "ever_enabled_multiple": true 2024-09-16T03:26:07.714 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.714 INFO:tasks.workunit.client.0.smithi096.stderr: "standbys": [], 2024-09-16T03:26:07.714 INFO:tasks.workunit.client.0.smithi096.stderr: "filesystems": [] 2024-09-16T03:26:07.714 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.714 INFO:tasks.workunit.client.0.smithi096.stderr: "mdsmap_first_committed": 1, 2024-09-16T03:26:07.714 INFO:tasks.workunit.client.0.smithi096.stderr: "mdsmap_last_committed": 1, 2024-09-16T03:26:07.714 INFO:tasks.workunit.client.0.smithi096.stderr: "auth": { 2024-09-16T03:26:07.714 INFO:tasks.workunit.client.0.smithi096.stderr: "first_committed": 1, 2024-09-16T03:26:07.714 INFO:tasks.workunit.client.0.smithi096.stderr: "last_committed": 5, 2024-09-16T03:26:07.714 INFO:tasks.workunit.client.0.smithi096.stderr: "num_secrets": 3 2024-09-16T03:26:07.714 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.714 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 64, 2024-09-16T03:26:07.714 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_active": 64, 2024-09-16T03:26:07.715 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_unknown": 0, 2024-09-16T03:26:07.715 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osd": 3, 2024-09-16T03:26:07.715 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_sum": { 2024-09-16T03:26:07.715 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:26:07.715 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:26:07.715 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:26:07.715 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:26:07.715 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:26:07.715 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:26:07.715 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:26:07.715 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:26:07.715 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:26:07.715 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:26:07.716 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:26:07.716 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:26:07.716 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:26:07.716 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:26:07.716 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:26:07.716 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:26:07.716 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:26:07.716 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:26:07.716 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:26:07.716 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:26:07.716 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:26:07.716 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:26:07.716 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:26:07.716 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:26:07.717 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:26:07.717 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:26:07.717 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:26:07.717 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:26:07.717 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:26:07.717 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:26:07.717 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:26:07.717 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:26:07.717 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:26:07.717 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:26:07.717 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:26:07.717 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:26:07.717 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:26:07.717 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:26:07.718 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:26:07.718 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:26:07.718 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:26:07.718 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.718 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:26:07.718 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:26:07.718 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:26:07.718 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:26:07.718 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:26:07.718 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:26:07.718 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:26:07.718 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:26:07.718 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:26:07.718 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:26:07.719 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:26:07.719 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.719 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:26:07.719 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:26:07.719 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 128, 2024-09-16T03:26:07.719 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 128, 2024-09-16T03:26:07.719 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 0 2024-09-16T03:26:07.719 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.719 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_sum": { 2024-09-16T03:26:07.719 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 0, 2024-09-16T03:26:07.719 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 0, 2024-09-16T03:26:07.719 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pgs": 128, 2024-09-16T03:26:07.719 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osds": 2, 2024-09-16T03:26:07.719 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_osds": 2, 2024-09-16T03:26:07.720 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_omap_osds": 2, 2024-09-16T03:26:07.720 INFO:tasks.workunit.client.0.smithi096.stderr: "kb": 209715200, 2024-09-16T03:26:07.720 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used": 54640, 2024-09-16T03:26:07.720 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_data": 960, 2024-09-16T03:26:07.720 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_omap": 3, 2024-09-16T03:26:07.720 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_meta": 53628, 2024-09-16T03:26:07.720 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_avail": 209660560, 2024-09-16T03:26:07.720 INFO:tasks.workunit.client.0.smithi096.stderr: "statfs": { 2024-09-16T03:26:07.720 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 214748364800, 2024-09-16T03:26:07.720 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 214692413440, 2024-09-16T03:26:07.720 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:26:07.720 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 983040, 2024-09-16T03:26:07.720 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 369948, 2024-09-16T03:26:07.720 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:26:07.721 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:26:07.721 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:26:07.721 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 3190, 2024-09-16T03:26:07.721 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 54915978 2024-09-16T03:26:07.721 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.721 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_peers": [], 2024-09-16T03:26:07.721 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_trim_queue_len": 0, 2024-09-16T03:26:07.721 INFO:tasks.workunit.client.0.smithi096.stderr: "num_snap_trimming": 0, 2024-09-16T03:26:07.721 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shards_repaired": 0, 2024-09-16T03:26:07.721 INFO:tasks.workunit.client.0.smithi096.stderr: "op_queue_age_hist": { 2024-09-16T03:26:07.721 INFO:tasks.workunit.client.0.smithi096.stderr: "histogram": [], 2024-09-16T03:26:07.721 INFO:tasks.workunit.client.0.smithi096.stderr: "upper_bound": 1 2024-09-16T03:26:07.721 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.722 INFO:tasks.workunit.client.0.smithi096.stderr: "perf_stat": { 2024-09-16T03:26:07.722 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ms": 325, 2024-09-16T03:26:07.722 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ms": 325, 2024-09-16T03:26:07.722 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ns": 325000000, 2024-09-16T03:26:07.722 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ns": 325000000 2024-09-16T03:26:07.722 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.722 INFO:tasks.workunit.client.0.smithi096.stderr: "alerts": [], 2024-09-16T03:26:07.722 INFO:tasks.workunit.client.0.smithi096.stderr: "network_ping_times": [] 2024-09-16T03:26:07.722 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.722 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_sum_by_class": { 2024-09-16T03:26:07.722 INFO:tasks.workunit.client.0.smithi096.stderr: "hdd": { 2024-09-16T03:26:07.722 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 0, 2024-09-16T03:26:07.722 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 0, 2024-09-16T03:26:07.723 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pgs": 128, 2024-09-16T03:26:07.723 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osds": 2, 2024-09-16T03:26:07.723 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_osds": 2, 2024-09-16T03:26:07.723 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_omap_osds": 2, 2024-09-16T03:26:07.723 INFO:tasks.workunit.client.0.smithi096.stderr: "kb": 209715200, 2024-09-16T03:26:07.723 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used": 54640, 2024-09-16T03:26:07.723 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_data": 960, 2024-09-16T03:26:07.723 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_omap": 3, 2024-09-16T03:26:07.723 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_meta": 53628, 2024-09-16T03:26:07.723 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_avail": 209660560, 2024-09-16T03:26:07.723 INFO:tasks.workunit.client.0.smithi096.stderr: "statfs": { 2024-09-16T03:26:07.723 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 214748364800, 2024-09-16T03:26:07.723 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 214692413440, 2024-09-16T03:26:07.723 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:26:07.724 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 983040, 2024-09-16T03:26:07.724 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 369948, 2024-09-16T03:26:07.724 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:26:07.724 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:26:07.724 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:26:07.724 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 3190, 2024-09-16T03:26:07.724 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 54915978 2024-09-16T03:26:07.724 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.724 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_peers": [], 2024-09-16T03:26:07.724 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_trim_queue_len": 0, 2024-09-16T03:26:07.724 INFO:tasks.workunit.client.0.smithi096.stderr: "num_snap_trimming": 0, 2024-09-16T03:26:07.724 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shards_repaired": 0, 2024-09-16T03:26:07.724 INFO:tasks.workunit.client.0.smithi096.stderr: "op_queue_age_hist": { 2024-09-16T03:26:07.724 INFO:tasks.workunit.client.0.smithi096.stderr: "histogram": [], 2024-09-16T03:26:07.725 INFO:tasks.workunit.client.0.smithi096.stderr: "upper_bound": 1 2024-09-16T03:26:07.725 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.725 INFO:tasks.workunit.client.0.smithi096.stderr: "perf_stat": { 2024-09-16T03:26:07.725 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ms": 325, 2024-09-16T03:26:07.725 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ms": 325, 2024-09-16T03:26:07.725 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ns": 325000000, 2024-09-16T03:26:07.725 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ns": 325000000 2024-09-16T03:26:07.725 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.725 INFO:tasks.workunit.client.0.smithi096.stderr: "alerts": [], 2024-09-16T03:26:07.726 INFO:tasks.workunit.client.0.smithi096.stderr: "network_ping_times": [] 2024-09-16T03:26:07.726 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:07.726 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.726 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_stats": [ 2024-09-16T03:26:07.726 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:07.726 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 2, 2024-09-16T03:26:07.726 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 32, 2024-09-16T03:26:07.726 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:26:07.726 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:26:07.726 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:26:07.726 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:26:07.726 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:26:07.726 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:26:07.726 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:26:07.727 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:26:07.727 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:26:07.727 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:26:07.727 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:26:07.727 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:26:07.727 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:26:07.727 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:26:07.727 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:26:07.727 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:26:07.727 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:26:07.727 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:26:07.727 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:26:07.727 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:26:07.727 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:26:07.728 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:26:07.728 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:26:07.728 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:26:07.728 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:26:07.728 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:26:07.728 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:26:07.728 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:26:07.728 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:26:07.728 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:26:07.728 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:26:07.728 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:26:07.728 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:26:07.728 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:26:07.729 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:26:07.729 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:26:07.729 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:26:07.729 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:26:07.729 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:26:07.729 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:26:07.729 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:26:07.729 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.729 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:26:07.729 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:26:07.729 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:26:07.729 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:26:07.729 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:26:07.729 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:26:07.730 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:26:07.730 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:26:07.730 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:26:07.730 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:26:07.730 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:26:07.730 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.730 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:26:07.730 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:26:07.730 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 64, 2024-09-16T03:26:07.730 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 64, 2024-09-16T03:26:07.730 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 3 2024-09-16T03:26:07.730 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.730 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:07.730 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 1, 2024-09-16T03:26:07.731 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 32, 2024-09-16T03:26:07.731 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:26:07.731 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:26:07.731 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:26:07.731 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:26:07.731 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:26:07.731 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:26:07.731 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:26:07.731 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:26:07.731 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:26:07.731 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:26:07.731 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:26:07.731 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:26:07.731 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:26:07.732 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:26:07.732 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:26:07.732 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:26:07.732 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:26:07.732 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:26:07.732 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:26:07.732 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:26:07.732 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:26:07.732 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:26:07.732 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:26:07.732 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:26:07.732 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:26:07.732 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:26:07.733 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:26:07.733 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:26:07.733 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:26:07.733 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:26:07.733 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:26:07.733 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:26:07.733 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:26:07.733 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:26:07.733 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:26:07.733 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:26:07.733 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:26:07.733 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:26:07.733 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:26:07.734 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:26:07.734 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:26:07.734 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.734 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:26:07.734 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:26:07.734 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:26:07.734 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:26:07.734 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:26:07.734 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:26:07.734 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:26:07.734 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:26:07.734 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:26:07.734 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:26:07.734 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:26:07.735 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.735 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:26:07.735 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:26:07.735 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 64, 2024-09-16T03:26:07.735 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 64, 2024-09-16T03:26:07.735 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 3 2024-09-16T03:26:07.735 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:07.735 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:07.735 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_stats": [ 2024-09-16T03:26:07.735 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:07.735 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:26:07.735 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 21474836521 2024-09-16T03:26:07.735 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.736 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:07.736 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:26:07.736 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 42949672993 2024-09-16T03:26:07.736 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.736 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:07.736 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:26:07.736 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 0 2024-09-16T03:26:07.736 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:07.736 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:07.736 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_by_state": [ 2024-09-16T03:26:07.736 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:07.736 INFO:tasks.workunit.client.0.smithi096.stderr: "state": "active+clean", 2024-09-16T03:26:07.737 INFO:tasks.workunit.client.0.smithi096.stderr: "num": 64 2024-09-16T03:26:07.737 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:07.737 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:07.737 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_by_osd": [ 2024-09-16T03:26:07.737 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:07.737 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:26:07.737 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 0, 2024-09-16T03:26:07.737 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 0, 2024-09-16T03:26:07.737 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:26:07.737 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.737 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:07.737 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:26:07.737 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 28, 2024-09-16T03:26:07.737 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 64, 2024-09-16T03:26:07.738 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:26:07.738 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.738 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:07.738 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:26:07.738 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 36, 2024-09-16T03:26:07.738 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 64, 2024-09-16T03:26:07.738 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:26:07.738 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:07.738 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:07.738 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": [ 2024-09-16T03:26:07.738 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:07.738 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 1, 2024-09-16T03:26:07.738 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": {} 2024-09-16T03:26:07.739 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.739 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:07.739 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 2, 2024-09-16T03:26:07.739 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": {} 2024-09-16T03:26:07.739 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:07.739 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:07.739 INFO:tasks.workunit.client.0.smithi096.stderr: "servicemap": { 2024-09-16T03:26:07.739 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 5, 2024-09-16T03:26:07.739 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:25:38.422788+0000", 2024-09-16T03:26:07.739 INFO:tasks.workunit.client.0.smithi096.stderr: "services": {} 2024-09-16T03:26:07.739 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:07.739 INFO:tasks.workunit.client.0.smithi096.stderr: "mgrstat_first_committed": 82, 2024-09-16T03:26:07.739 INFO:tasks.workunit.client.0.smithi096.stderr: "mgrstat_last_committed": 89, 2024-09-16T03:26:07.740 INFO:tasks.workunit.client.0.smithi096.stderr: "logm_first_committed": 1, 2024-09-16T03:26:07.740 INFO:tasks.workunit.client.0.smithi096.stderr: "logm_last_committed": 400, 2024-09-16T03:26:07.740 INFO:tasks.workunit.client.0.smithi096.stderr: "paxos": { 2024-09-16T03:26:07.740 INFO:tasks.workunit.client.0.smithi096.stderr: "first_committed": 1, 2024-09-16T03:26:07.740 INFO:tasks.workunit.client.0.smithi096.stderr: "last_committed": 592, 2024-09-16T03:26:07.740 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pn": 0, 2024-09-16T03:26:07.740 INFO:tasks.workunit.client.0.smithi096.stderr: "accepted_pn": 0 2024-09-16T03:26:07.740 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:07.740 INFO:tasks.workunit.client.0.smithi096.stderr:}' 2024-09-16T03:26:07.744 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:30: check_lec_equals_pools: jq .osdmap_clean_epochs.min_last_epoch_clean 2024-09-16T03:26:07.744 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:30: check_lec_equals_pools: echo '{' '"cluster_fingerprint":' '"fda2fc64-07ed-4add-8224-2e527e11d427",' '"version":' '"19.3.0-4930-gfc3e0bff",' '"commit":' '"fc3e0bff7468fd55478adbae7f75508b749124b6",' '"timestamp":' '"2024-09-16T03:26:07.626620+0000",' '"tag":' '"",' '"health":' '{' '"status":' '"HEALTH_OK",' '"checks":' '{},' '"mutes":' '[]' '},' '"monmap_first_committed":' 1, '"monmap_last_committed":' 1, '"monmap":' '{' '"epoch":' 1, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"modified":' '"2024-09-16T03:22:45.872880Z",' '"created":' '"2024-09-16T03:22:45.872880Z",' '"min_mon_release":' 19, '"min_mon_release_name":' '"squid",' '"election_strategy":' 1, '"disallowed_leaders:' '":' '"",' '"stretch_mode":' false, '"tiebreaker_mon":' '"",' '"removed_ranks:' '":' '"",' '"features":' '{' '"persistent":' '[' '"kraken",' '"luminous",' '"mimic",' '"osdmap-prune",' '"nautilus",' '"octopus",' '"pacific",' '"elector-pinging",' '"quincy",' '"reef",' '"squid"' '],' '"optional":' '[]' '},' '"mons":' '[' '{' '"rank":' 0, '"name":' '"a",' '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:7302",' '"nonce":' 0 '}' ']' '},' '"addr":' '"127.0.0.1:7302/0",' '"public_addr":' '"127.0.0.1:7302/0",' '"priority":' 0, '"weight":' 0, '"crush_location":' '"{}"' '}' ']' '},' '"quorum":' '[' 0 '],' '"osdmap":' '{' '"epoch":' 86, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"created":' '"2024-09-16T03:22:46.906117+0000",' '"modified":' '"2024-09-16T03:26:02.230083+0000",' '"last_up_change":' '"2024-09-16T03:25:08.513363+0000",' '"last_in_change":' '"2024-09-16T03:25:09.839444+0000",' '"flags":' '"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit",' '"flags_num":' 5799936, '"flags_set":' '[' '"pglog_hardlimit",' '"purged_snapdirs",' '"recovery_deletes",' '"sortbitwise"' '],' '"crush_version":' 7, '"full_ratio":' 0.97000002861022949, '"backfillfull_ratio":' 0.97000002861022949, '"nearfull_ratio":' 0.85000002384185791, '"cluster_snapshot":' '"",' '"pool_max":' 2, '"max_osd":' 3, '"require_min_compat_client":' '"luminous",' '"min_compat_client":' '"jewel",' '"require_osd_release":' '"squid",' '"allow_crimson":' false, '"pools":' '[' '{' '"pool":' 1, '"pool_name":' '"foo",' '"create_time":' '"2024-09-16T03:24:44.525189+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 2, '"min_size":' 1, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"85",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.8700000047683716, '"score_stable":' 1.8700000047683716, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1.25, '"raw_score_stable":' 1.25, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '},' '{' '"pool":' 2, '"pool_name":' '"bar",' '"create_time":' '"2024-09-16T03:24:46.226575+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 2, '"min_size":' 1, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"83",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.4900000095367432, '"score_stable":' 1.4900000095367432, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1, '"raw_score_stable":' 1, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '}' '],' '"osds":' '[' '{' '"osd":' 0, '"uuid":' '"64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 5, '"up_thru":' 84, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6802",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6803",' '"nonce":' 3375787448 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6804",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6805",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6808",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6809",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6806",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6807",' '"nonce":' 3375787448 '}' ']' '},' '"public_addr":' '"127.0.0.1:6803/3375787448",' '"cluster_addr":' '"127.0.0.1:6805/3375787448",' '"heartbeat_back_addr":' '"127.0.0.1:6809/3375787448",' '"heartbeat_front_addr":' '"127.0.0.1:6807/3375787448",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 1, '"uuid":' '"74b26727-75c9-444d-8782-719e4197a382",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 10, '"up_thru":' 84, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6810",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6811",' '"nonce":' 3733255132 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6812",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6813",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6816",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6817",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6814",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6815",' '"nonce":' 3733255132 '}' ']' '},' '"public_addr":' '"127.0.0.1:6811/3733255132",' '"cluster_addr":' '"127.0.0.1:6813/3733255132",' '"heartbeat_back_addr":' '"127.0.0.1:6817/3733255132",' '"heartbeat_front_addr":' '"127.0.0.1:6815/3733255132",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 2, '"uuid":' '"143da3a7-dad9-4b1e-966b-76cf5bdd3c82",' '"up":' 0, '"in":' 0, '"weight":' 0, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 15, '"up_thru":' 21, '"down_at":' 33, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6818",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6819",' '"nonce":' 963814857 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6820",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6821",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6824",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6825",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6822",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6823",' '"nonce":' 963814857 '}' ']' '},' '"public_addr":' '"127.0.0.1:6819/963814857",' '"cluster_addr":' '"127.0.0.1:6821/963814857",' '"heartbeat_back_addr":' '"127.0.0.1:6825/963814857",' '"heartbeat_front_addr":' '"127.0.0.1:6823/963814857",' '"state":' '[' '"exists"' ']' '}' '],' '"osd_xinfo":' '[' '{' '"osd":' 0, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:22.481942+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 1, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:59.663703+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 2, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 65536, '"last_purged_snaps_scrub":' '"2024-09-16T03:24:37.320822+0000",' '"dead_epoch":' 32 '}' '],' '"pg_upmap":' '[],' '"pg_upmap_items":' '[],' '"pg_upmap_primaries":' '[],' '"pg_temp":' '[],' '"primary_temp":' '[],' '"blocklist":' '{},' '"range_blocklist":' '{},' '"erasure_code_profiles":' '{' '"default":' '{' '"k":' '"2",' '"m":' '"2",' '"plugin":' '"jerasure",' '"technique":' '"reed_sol_van"' '}' '},' '"removed_snaps_queue":' '[],' '"new_removed_snaps":' '[],' '"new_purged_snaps":' '[],' '"crush_node_flags":' '{},' '"device_class_flags":' '{},' '"stretch_mode":' '{' '"stretch_mode_enabled":' false, '"stretch_bucket_count":' 0, '"degraded_stretch_mode":' 0, '"recovering_stretch_mode":' 0, '"stretch_mode_bucket":' 0 '}' '},' '"osd_metadata":' '[' '{' '"id":' 0, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/0/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:22:53.662571Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]",' '"hb_front_addr":' '"[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/0",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 1, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/1/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:23:30.129885Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]",' '"hb_front_addr":' '"[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/1",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 2, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/2/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:24:07.764502Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]",' '"hb_front_addr":' '"[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/2",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '}' '],' '"osdmap_clean_epochs":' '{' '"min_last_epoch_clean":' 86, '"last_epoch_clean":' '{' '"per_pool":' '[' '{' '"poolid":' 1, '"floor":' 86 '},' '{' '"poolid":' 2, '"floor":' 86 '}' ']' '},' '"osd_epochs":' '[' '{' '"id":' 0, '"epoch":' 86 '},' '{' '"id":' 1, '"epoch":' 86 '}' ']' '},' '"osdmap_first_committed":' 28, '"osdmap_last_committed":' 86, '"crushmap":' '{' '"devices":' '[' '{' '"id":' 0, '"name":' '"osd.0",' '"class":' '"hdd"' '},' '{' '"id":' 1, '"name":' '"osd.1",' '"class":' '"hdd"' '},' '{' '"id":' 2, '"name":' '"osd.2",' '"class":' '"hdd"' '}' '],' '"types":' '[' '{' '"type_id":' 0, '"name":' '"osd"' '},' '{' '"type_id":' 1, '"name":' '"host"' '},' '{' '"type_id":' 2, '"name":' '"chassis"' '},' '{' '"type_id":' 3, '"name":' '"rack"' '},' '{' '"type_id":' 4, '"name":' '"row"' '},' '{' '"type_id":' 5, '"name":' '"pdu"' '},' '{' '"type_id":' 6, '"name":' '"pod"' '},' '{' '"type_id":' 7, '"name":' '"room"' '},' '{' '"type_id":' 8, '"name":' '"datacenter"' '},' '{' '"type_id":' 9, '"name":' '"zone"' '},' '{' '"type_id":' 10, '"name":' '"region"' '},' '{' '"type_id":' 11, '"name":' '"root"' '}' '],' '"buckets":' '[' '{' '"id":' -1, '"name":' '"default",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -3, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -2, '"name":' '"default~hdd",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -4, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -3, '"name":' '"smithi096",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '},' '{' '"id":' -4, '"name":' '"smithi096~hdd",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '}' '],' '"rules":' '[' '{' '"rule_id":' 0, '"rule_name":' '"replicated_rule",' '"type":' 1, '"steps":' '[' '{' '"op":' '"take",' '"item":' -1, '"item_name":' '"default"' '},' '{' '"op":' '"choose_firstn",' '"num":' 0, '"type":' '"osd"' '},' '{' '"op":' '"emit"' '}' ']' '}' '],' '"tunables":' '{' '"choose_local_tries":' 0, '"choose_local_fallback_tries":' 0, '"choose_total_tries":' 50, '"chooseleaf_descend_once":' 1, '"chooseleaf_vary_r":' 1, '"chooseleaf_stable":' 1, '"msr_descents":' 100, '"msr_collision_tries":' 100, '"straw_calc_version":' 1, '"allowed_bucket_algs":' 54, '"profile":' '"jewel",' '"optimal_tunables":' 1, '"legacy_tunables":' 0, '"minimum_required_version":' '"jewel",' '"require_feature_tunables":' 1, '"require_feature_tunables2":' 1, '"has_v2_rules":' 0, '"require_feature_tunables3":' 1, '"has_v3_rules":' 0, '"has_v4_buckets":' 1, '"require_feature_tunables5":' 1, '"has_v5_rules":' 0, '"has_msr_rules":' 0 '},' '"choose_args":' '{}' '},' '"fsmap":' '{' '"epoch":' 1, '"btime":' '"2024-09-16T03:22:46:882186+0000",' '"default_fscid":' -1, '"compat":' '{' '"compat":' '{},' '"ro_compat":' '{},' '"incompat":' '{' '"feature_1":' '"base' 'v0.20",' '"feature_2":' '"client' writeable 'ranges",' '"feature_3":' '"default' file layouts on 'dirs",' '"feature_4":' '"dir' inode in separate 'object",' '"feature_5":' '"mds' uses versioned 'encoding",' '"feature_6":' '"dirfrag' is stored in 'omap",' '"feature_8":' '"no' anchor 'table",' '"feature_9":' '"file' layout 'v2",' '"feature_10":' '"snaprealm' 'v2",' '"feature_11":' '"minor' log 'segments",' '"feature_12":' '"quiesce' 'subvolumes"' '}' '},' '"feature_flags":' '{' '"enable_multiple":' true, '"ever_enabled_multiple":' true '},' '"standbys":' '[],' '"filesystems":' '[]' '},' '"mdsmap_first_committed":' 1, '"mdsmap_last_committed":' 1, '"auth":' '{' '"first_committed":' 1, '"last_committed":' 5, '"num_secrets":' 3 '},' '"num_pg":' 64, '"num_pg_active":' 64, '"num_pg_unknown":' 0, '"num_osd":' 3, '"pool_sum":' '{' '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 128, '"acting":' 128, '"num_store_stats":' 0 '},' '"osd_sum":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54640, '"kb_used_data":' 960, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660560, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692413440, '"internally_reserved":' 0, '"allocated":' 983040, '"data_stored":' 369948, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 325, '"apply_latency_ms":' 325, '"commit_latency_ns":' 325000000, '"apply_latency_ns":' 325000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '},' '"osd_sum_by_class":' '{' '"hdd":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54640, '"kb_used_data":' 960, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660560, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692413440, '"internally_reserved":' 0, '"allocated":' 983040, '"data_stored":' 369948, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 325, '"apply_latency_ms":' 325, '"commit_latency_ns":' 325000000, '"apply_latency_ns":' 325000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '}' '},' '"pool_stats":' '[' '{' '"poolid":' 2, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '},' '{' '"poolid":' 1, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '}' '],' '"osd_stats":' '[' '{' '"osd":' 0, '"seq":' 21474836521 '},' '{' '"osd":' 1, '"seq":' 42949672993 '},' '{' '"osd":' 2, '"seq":' 0 '}' '],' '"num_pg_by_state":' '[' '{' '"state":' '"active+clean",' '"num":' 64 '}' '],' '"num_pg_by_osd":' '[' '{' '"osd":' 2, '"num_primary_pg":' 0, '"num_acting_pg":' 0, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 0, '"num_primary_pg":' 28, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 1, '"num_primary_pg":' 36, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '}' '],' '"purged_snaps":' '[' '{' '"pool":' 1, '"purged_snaps":' '{}' '},' '{' '"pool":' 2, '"purged_snaps":' '{}' '}' '],' '"servicemap":' '{' '"epoch":' 5, '"modified":' '"2024-09-16T03:25:38.422788+0000",' '"services":' '{}' '},' '"mgrstat_first_committed":' 82, '"mgrstat_last_committed":' 89, '"logm_first_committed":' 1, '"logm_last_committed":' 400, '"paxos":' '{' '"first_committed":' 1, '"last_committed":' 592, '"last_pn":' 0, '"accepted_pn":' 0 '}' '}' 2024-09-16T03:26:07.744 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:30: check_lec_equals_pools: lec=86 2024-09-16T03:26:07.744 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:32: check_lec_equals_pools: [[ -z '' ]] 2024-09-16T03:26:07.744 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:36: check_lec_equals_pools: pools=($(echo $report | jq ".osdmap_clean_epochs.last_epoch_clean.per_pool[] |" " select(.floor == $lec) | .poolid")) 2024-09-16T03:26:07.744 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:36: check_lec_equals_pools: jq '.osdmap_clean_epochs.last_epoch_clean.per_pool[] |' ' select(.floor == 86) | .poolid' 2024-09-16T03:26:07.745 INFO:tasks.workunit.client.0.smithi096.stderr:jq: error: syntax error, unexpected $end (Unix shell quoting issues?) at , line 1: 2024-09-16T03:26:07.745 INFO:tasks.workunit.client.0.smithi096.stderr:.osdmap_clean_epochs.last_epoch_clean.per_pool[] | 2024-09-16T03:26:07.745 INFO:tasks.workunit.client.0.smithi096.stderr:jq: 1 compile error 2024-09-16T03:26:07.745 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:36: check_lec_equals_pools: echo '{' '"cluster_fingerprint":' '"fda2fc64-07ed-4add-8224-2e527e11d427",' '"version":' '"19.3.0-4930-gfc3e0bff",' '"commit":' '"fc3e0bff7468fd55478adbae7f75508b749124b6",' '"timestamp":' '"2024-09-16T03:26:07.626620+0000",' '"tag":' '"",' '"health":' '{' '"status":' '"HEALTH_OK",' '"checks":' '{},' '"mutes":' '[]' '},' '"monmap_first_committed":' 1, '"monmap_last_committed":' 1, '"monmap":' '{' '"epoch":' 1, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"modified":' '"2024-09-16T03:22:45.872880Z",' '"created":' '"2024-09-16T03:22:45.872880Z",' '"min_mon_release":' 19, '"min_mon_release_name":' '"squid",' '"election_strategy":' 1, '"disallowed_leaders:' '":' '"",' '"stretch_mode":' false, '"tiebreaker_mon":' '"",' '"removed_ranks:' '":' '"",' '"features":' '{' '"persistent":' '[' '"kraken",' '"luminous",' '"mimic",' '"osdmap-prune",' '"nautilus",' '"octopus",' '"pacific",' '"elector-pinging",' '"quincy",' '"reef",' '"squid"' '],' '"optional":' '[]' '},' '"mons":' '[' '{' '"rank":' 0, '"name":' '"a",' '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:7302",' '"nonce":' 0 '}' ']' '},' '"addr":' '"127.0.0.1:7302/0",' '"public_addr":' '"127.0.0.1:7302/0",' '"priority":' 0, '"weight":' 0, '"crush_location":' '"{}"' '}' ']' '},' '"quorum":' '[' 0 '],' '"osdmap":' '{' '"epoch":' 86, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"created":' '"2024-09-16T03:22:46.906117+0000",' '"modified":' '"2024-09-16T03:26:02.230083+0000",' '"last_up_change":' '"2024-09-16T03:25:08.513363+0000",' '"last_in_change":' '"2024-09-16T03:25:09.839444+0000",' '"flags":' '"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit",' '"flags_num":' 5799936, '"flags_set":' '[' '"pglog_hardlimit",' '"purged_snapdirs",' '"recovery_deletes",' '"sortbitwise"' '],' '"crush_version":' 7, '"full_ratio":' 0.97000002861022949, '"backfillfull_ratio":' 0.97000002861022949, '"nearfull_ratio":' 0.85000002384185791, '"cluster_snapshot":' '"",' '"pool_max":' 2, '"max_osd":' 3, '"require_min_compat_client":' '"luminous",' '"min_compat_client":' '"jewel",' '"require_osd_release":' '"squid",' '"allow_crimson":' false, '"pools":' '[' '{' '"pool":' 1, '"pool_name":' '"foo",' '"create_time":' '"2024-09-16T03:24:44.525189+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 2, '"min_size":' 1, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"85",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.8700000047683716, '"score_stable":' 1.8700000047683716, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1.25, '"raw_score_stable":' 1.25, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '},' '{' '"pool":' 2, '"pool_name":' '"bar",' '"create_time":' '"2024-09-16T03:24:46.226575+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 2, '"min_size":' 1, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"83",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.4900000095367432, '"score_stable":' 1.4900000095367432, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1, '"raw_score_stable":' 1, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '}' '],' '"osds":' '[' '{' '"osd":' 0, '"uuid":' '"64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 5, '"up_thru":' 84, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6802",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6803",' '"nonce":' 3375787448 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6804",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6805",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6808",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6809",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6806",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6807",' '"nonce":' 3375787448 '}' ']' '},' '"public_addr":' '"127.0.0.1:6803/3375787448",' '"cluster_addr":' '"127.0.0.1:6805/3375787448",' '"heartbeat_back_addr":' '"127.0.0.1:6809/3375787448",' '"heartbeat_front_addr":' '"127.0.0.1:6807/3375787448",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 1, '"uuid":' '"74b26727-75c9-444d-8782-719e4197a382",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 10, '"up_thru":' 84, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6810",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6811",' '"nonce":' 3733255132 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6812",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6813",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6816",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6817",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6814",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6815",' '"nonce":' 3733255132 '}' ']' '},' '"public_addr":' '"127.0.0.1:6811/3733255132",' '"cluster_addr":' '"127.0.0.1:6813/3733255132",' '"heartbeat_back_addr":' '"127.0.0.1:6817/3733255132",' '"heartbeat_front_addr":' '"127.0.0.1:6815/3733255132",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 2, '"uuid":' '"143da3a7-dad9-4b1e-966b-76cf5bdd3c82",' '"up":' 0, '"in":' 0, '"weight":' 0, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 15, '"up_thru":' 21, '"down_at":' 33, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6818",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6819",' '"nonce":' 963814857 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6820",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6821",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6824",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6825",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6822",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6823",' '"nonce":' 963814857 '}' ']' '},' '"public_addr":' '"127.0.0.1:6819/963814857",' '"cluster_addr":' '"127.0.0.1:6821/963814857",' '"heartbeat_back_addr":' '"127.0.0.1:6825/963814857",' '"heartbeat_front_addr":' '"127.0.0.1:6823/963814857",' '"state":' '[' '"exists"' ']' '}' '],' '"osd_xinfo":' '[' '{' '"osd":' 0, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:22.481942+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 1, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:59.663703+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 2, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 65536, '"last_purged_snaps_scrub":' '"2024-09-16T03:24:37.320822+0000",' '"dead_epoch":' 32 '}' '],' '"pg_upmap":' '[],' '"pg_upmap_items":' '[],' '"pg_upmap_primaries":' '[],' '"pg_temp":' '[],' '"primary_temp":' '[],' '"blocklist":' '{},' '"range_blocklist":' '{},' '"erasure_code_profiles":' '{' '"default":' '{' '"k":' '"2",' '"m":' '"2",' '"plugin":' '"jerasure",' '"technique":' '"reed_sol_van"' '}' '},' '"removed_snaps_queue":' '[],' '"new_removed_snaps":' '[],' '"new_purged_snaps":' '[],' '"crush_node_flags":' '{},' '"device_class_flags":' '{},' '"stretch_mode":' '{' '"stretch_mode_enabled":' false, '"stretch_bucket_count":' 0, '"degraded_stretch_mode":' 0, '"recovering_stretch_mode":' 0, '"stretch_mode_bucket":' 0 '}' '},' '"osd_metadata":' '[' '{' '"id":' 0, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/0/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:22:53.662571Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]",' '"hb_front_addr":' '"[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/0",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 1, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/1/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:23:30.129885Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]",' '"hb_front_addr":' '"[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/1",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 2, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/2/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:24:07.764502Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]",' '"hb_front_addr":' '"[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/2",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '}' '],' '"osdmap_clean_epochs":' '{' '"min_last_epoch_clean":' 86, '"last_epoch_clean":' '{' '"per_pool":' '[' '{' '"poolid":' 1, '"floor":' 86 '},' '{' '"poolid":' 2, '"floor":' 86 '}' ']' '},' '"osd_epochs":' '[' '{' '"id":' 0, '"epoch":' 86 '},' '{' '"id":' 1, '"epoch":' 86 '}' ']' '},' '"osdmap_first_committed":' 28, '"osdmap_last_committed":' 86, '"crushmap":' '{' '"devices":' '[' '{' '"id":' 0, '"name":' '"osd.0",' '"class":' '"hdd"' '},' '{' '"id":' 1, '"name":' '"osd.1",' '"class":' '"hdd"' '},' '{' '"id":' 2, '"name":' '"osd.2",' '"class":' '"hdd"' '}' '],' '"types":' '[' '{' '"type_id":' 0, '"name":' '"osd"' '},' '{' '"type_id":' 1, '"name":' '"host"' '},' '{' '"type_id":' 2, '"name":' '"chassis"' '},' '{' '"type_id":' 3, '"name":' '"rack"' '},' '{' '"type_id":' 4, '"name":' '"row"' '},' '{' '"type_id":' 5, '"name":' '"pdu"' '},' '{' '"type_id":' 6, '"name":' '"pod"' '},' '{' '"type_id":' 7, '"name":' '"room"' '},' '{' '"type_id":' 8, '"name":' '"datacenter"' '},' '{' '"type_id":' 9, '"name":' '"zone"' '},' '{' '"type_id":' 10, '"name":' '"region"' '},' '{' '"type_id":' 11, '"name":' '"root"' '}' '],' '"buckets":' '[' '{' '"id":' -1, '"name":' '"default",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -3, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -2, '"name":' '"default~hdd",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -4, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -3, '"name":' '"smithi096",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '},' '{' '"id":' -4, '"name":' '"smithi096~hdd",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '}' '],' '"rules":' '[' '{' '"rule_id":' 0, '"rule_name":' '"replicated_rule",' '"type":' 1, '"steps":' '[' '{' '"op":' '"take",' '"item":' -1, '"item_name":' '"default"' '},' '{' '"op":' '"choose_firstn",' '"num":' 0, '"type":' '"osd"' '},' '{' '"op":' '"emit"' '}' ']' '}' '],' '"tunables":' '{' '"choose_local_tries":' 0, '"choose_local_fallback_tries":' 0, '"choose_total_tries":' 50, '"chooseleaf_descend_once":' 1, '"chooseleaf_vary_r":' 1, '"chooseleaf_stable":' 1, '"msr_descents":' 100, '"msr_collision_tries":' 100, '"straw_calc_version":' 1, '"allowed_bucket_algs":' 54, '"profile":' '"jewel",' '"optimal_tunables":' 1, '"legacy_tunables":' 0, '"minimum_required_version":' '"jewel",' '"require_feature_tunables":' 1, '"require_feature_tunables2":' 1, '"has_v2_rules":' 0, '"require_feature_tunables3":' 1, '"has_v3_rules":' 0, '"has_v4_buckets":' 1, '"require_feature_tunables5":' 1, '"has_v5_rules":' 0, '"has_msr_rules":' 0 '},' '"choose_args":' '{}' '},' '"fsmap":' '{' '"epoch":' 1, '"btime":' '"2024-09-16T03:22:46:882186+0000",' '"default_fscid":' -1, '"compat":' '{' '"compat":' '{},' '"ro_compat":' '{},' '"incompat":' '{' '"feature_1":' '"base' 'v0.20",' '"feature_2":' '"client' writeable 'ranges",' '"feature_3":' '"default' file layouts on 'dirs",' '"feature_4":' '"dir' inode in separate 'object",' '"feature_5":' '"mds' uses versioned 'encoding",' '"feature_6":' '"dirfrag' is stored in 'omap",' '"feature_8":' '"no' anchor 'table",' '"feature_9":' '"file' layout 'v2",' '"feature_10":' '"snaprealm' 'v2",' '"feature_11":' '"minor' log 'segments",' '"feature_12":' '"quiesce' 'subvolumes"' '}' '},' '"feature_flags":' '{' '"enable_multiple":' true, '"ever_enabled_multiple":' true '},' '"standbys":' '[],' '"filesystems":' '[]' '},' '"mdsmap_first_committed":' 1, '"mdsmap_last_committed":' 1, '"auth":' '{' '"first_committed":' 1, '"last_committed":' 5, '"num_secrets":' 3 '},' '"num_pg":' 64, '"num_pg_active":' 64, '"num_pg_unknown":' 0, '"num_osd":' 3, '"pool_sum":' '{' '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 128, '"acting":' 128, '"num_store_stats":' 0 '},' '"osd_sum":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54640, '"kb_used_data":' 960, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660560, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692413440, '"internally_reserved":' 0, '"allocated":' 983040, '"data_stored":' 369948, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 325, '"apply_latency_ms":' 325, '"commit_latency_ns":' 325000000, '"apply_latency_ns":' 325000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '},' '"osd_sum_by_class":' '{' '"hdd":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54640, '"kb_used_data":' 960, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660560, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692413440, '"internally_reserved":' 0, '"allocated":' 983040, '"data_stored":' 369948, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 325, '"apply_latency_ms":' 325, '"commit_latency_ns":' 325000000, '"apply_latency_ns":' 325000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '}' '},' '"pool_stats":' '[' '{' '"poolid":' 2, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '},' '{' '"poolid":' 1, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '}' '],' '"osd_stats":' '[' '{' '"osd":' 0, '"seq":' 21474836521 '},' '{' '"osd":' 1, '"seq":' 42949672993 '},' '{' '"osd":' 2, '"seq":' 0 '}' '],' '"num_pg_by_state":' '[' '{' '"state":' '"active+clean",' '"num":' 64 '}' '],' '"num_pg_by_osd":' '[' '{' '"osd":' 2, '"num_primary_pg":' 0, '"num_acting_pg":' 0, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 0, '"num_primary_pg":' 28, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 1, '"num_primary_pg":' 36, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '}' '],' '"purged_snaps":' '[' '{' '"pool":' 1, '"purged_snaps":' '{}' '},' '{' '"pool":' 2, '"purged_snaps":' '{}' '}' '],' '"servicemap":' '{' '"epoch":' 5, '"modified":' '"2024-09-16T03:25:38.422788+0000",' '"services":' '{}' '},' '"mgrstat_first_committed":' 82, '"mgrstat_last_committed":' 89, '"logm_first_committed":' 1, '"logm_last_committed":' 400, '"paxos":' '{' '"first_committed":' 1, '"last_committed":' 592, '"last_pn":' 0, '"accepted_pn":' 0 '}' '}' 2024-09-16T03:26:07.745 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:38: check_lec_equals_pools: [[ 0 -eq 2 ]] 2024-09-16T03:26:07.745 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:38: check_lec_equals_pools: echo '{' '"cluster_fingerprint":' '"fda2fc64-07ed-4add-8224-2e527e11d427",' '"version":' '"19.3.0-4930-gfc3e0bff",' '"commit":' '"fc3e0bff7468fd55478adbae7f75508b749124b6",' '"timestamp":' '"2024-09-16T03:26:07.626620+0000",' '"tag":' '"",' '"health":' '{' '"status":' '"HEALTH_OK",' '"checks":' '{},' '"mutes":' '[]' '},' '"monmap_first_committed":' 1, '"monmap_last_committed":' 1, '"monmap":' '{' '"epoch":' 1, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"modified":' '"2024-09-16T03:22:45.872880Z",' '"created":' '"2024-09-16T03:22:45.872880Z",' '"min_mon_release":' 19, '"min_mon_release_name":' '"squid",' '"election_strategy":' 1, '"disallowed_leaders:' '":' '"",' '"stretch_mode":' false, '"tiebreaker_mon":' '"",' '"removed_ranks:' '":' '"",' '"features":' '{' '"persistent":' '[' '"kraken",' '"luminous",' '"mimic",' '"osdmap-prune",' '"nautilus",' '"octopus",' '"pacific",' '"elector-pinging",' '"quincy",' '"reef",' '"squid"' '],' '"optional":' '[]' '},' '"mons":' '[' '{' '"rank":' 0, '"name":' '"a",' '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:7302",' '"nonce":' 0 '}' ']' '},' '"addr":' '"127.0.0.1:7302/0",' '"public_addr":' '"127.0.0.1:7302/0",' '"priority":' 0, '"weight":' 0, '"crush_location":' '"{}"' '}' ']' '},' '"quorum":' '[' 0 '],' '"osdmap":' '{' '"epoch":' 86, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"created":' '"2024-09-16T03:22:46.906117+0000",' '"modified":' '"2024-09-16T03:26:02.230083+0000",' '"last_up_change":' '"2024-09-16T03:25:08.513363+0000",' '"last_in_change":' '"2024-09-16T03:25:09.839444+0000",' '"flags":' '"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit",' '"flags_num":' 5799936, '"flags_set":' '[' '"pglog_hardlimit",' '"purged_snapdirs",' '"recovery_deletes",' '"sortbitwise"' '],' '"crush_version":' 7, '"full_ratio":' 0.97000002861022949, '"backfillfull_ratio":' 0.97000002861022949, '"nearfull_ratio":' 0.85000002384185791, '"cluster_snapshot":' '"",' '"pool_max":' 2, '"max_osd":' 3, '"require_min_compat_client":' '"luminous",' '"min_compat_client":' '"jewel",' '"require_osd_release":' '"squid",' '"allow_crimson":' false, '"pools":' '[' '{' '"pool":' 1, '"pool_name":' '"foo",' '"create_time":' '"2024-09-16T03:24:44.525189+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 2, '"min_size":' 1, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"85",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.8700000047683716, '"score_stable":' 1.8700000047683716, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1.25, '"raw_score_stable":' 1.25, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '},' '{' '"pool":' 2, '"pool_name":' '"bar",' '"create_time":' '"2024-09-16T03:24:46.226575+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 2, '"min_size":' 1, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"83",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.4900000095367432, '"score_stable":' 1.4900000095367432, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1, '"raw_score_stable":' 1, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '}' '],' '"osds":' '[' '{' '"osd":' 0, '"uuid":' '"64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 5, '"up_thru":' 84, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6802",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6803",' '"nonce":' 3375787448 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6804",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6805",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6808",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6809",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6806",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6807",' '"nonce":' 3375787448 '}' ']' '},' '"public_addr":' '"127.0.0.1:6803/3375787448",' '"cluster_addr":' '"127.0.0.1:6805/3375787448",' '"heartbeat_back_addr":' '"127.0.0.1:6809/3375787448",' '"heartbeat_front_addr":' '"127.0.0.1:6807/3375787448",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 1, '"uuid":' '"74b26727-75c9-444d-8782-719e4197a382",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 10, '"up_thru":' 84, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6810",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6811",' '"nonce":' 3733255132 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6812",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6813",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6816",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6817",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6814",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6815",' '"nonce":' 3733255132 '}' ']' '},' '"public_addr":' '"127.0.0.1:6811/3733255132",' '"cluster_addr":' '"127.0.0.1:6813/3733255132",' '"heartbeat_back_addr":' '"127.0.0.1:6817/3733255132",' '"heartbeat_front_addr":' '"127.0.0.1:6815/3733255132",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 2, '"uuid":' '"143da3a7-dad9-4b1e-966b-76cf5bdd3c82",' '"up":' 0, '"in":' 0, '"weight":' 0, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 15, '"up_thru":' 21, '"down_at":' 33, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6818",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6819",' '"nonce":' 963814857 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6820",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6821",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6824",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6825",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6822",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6823",' '"nonce":' 963814857 '}' ']' '},' '"public_addr":' '"127.0.0.1:6819/963814857",' '"cluster_addr":' '"127.0.0.1:6821/963814857",' '"heartbeat_back_addr":' '"127.0.0.1:6825/963814857",' '"heartbeat_front_addr":' '"127.0.0.1:6823/963814857",' '"state":' '[' '"exists"' ']' '}' '],' '"osd_xinfo":' '[' '{' '"osd":' 0, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:22.481942+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 1, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:59.663703+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 2, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 65536, '"last_purged_snaps_scrub":' '"2024-09-16T03:24:37.320822+0000",' '"dead_epoch":' 32 '}' '],' '"pg_upmap":' '[],' '"pg_upmap_items":' '[],' '"pg_upmap_primaries":' '[],' '"pg_temp":' '[],' '"primary_temp":' '[],' '"blocklist":' '{},' '"range_blocklist":' '{},' '"erasure_code_profiles":' '{' '"default":' '{' '"k":' '"2",' '"m":' '"2",' '"plugin":' '"jerasure",' '"technique":' '"reed_sol_van"' '}' '},' '"removed_snaps_queue":' '[],' '"new_removed_snaps":' '[],' '"new_purged_snaps":' '[],' '"crush_node_flags":' '{},' '"device_class_flags":' '{},' '"stretch_mode":' '{' '"stretch_mode_enabled":' false, '"stretch_bucket_count":' 0, '"degraded_stretch_mode":' 0, '"recovering_stretch_mode":' 0, '"stretch_mode_bucket":' 0 '}' '},' '"osd_metadata":' '[' '{' '"id":' 0, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/0/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:22:53.662571Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]",' '"hb_front_addr":' '"[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/0",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 1, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/1/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:23:30.129885Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]",' '"hb_front_addr":' '"[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/1",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 2, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/2/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:24:07.764502Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]",' '"hb_front_addr":' '"[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/2",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '}' '],' '"osdmap_clean_epochs":' '{' '"min_last_epoch_clean":' 86, '"last_epoch_clean":' '{' '"per_pool":' '[' '{' '"poolid":' 1, '"floor":' 86 '},' '{' '"poolid":' 2, '"floor":' 86 '}' ']' '},' '"osd_epochs":' '[' '{' '"id":' 0, '"epoch":' 86 '},' '{' '"id":' 1, '"epoch":' 86 '}' ']' '},' '"osdmap_first_committed":' 28, '"osdmap_last_committed":' 86, '"crushmap":' '{' '"devices":' '[' '{' '"id":' 0, '"name":' '"osd.0",' '"class":' '"hdd"' '},' '{' '"id":' 1, '"name":' '"osd.1",' '"class":' '"hdd"' '},' '{' '"id":' 2, '"name":' '"osd.2",' '"class":' '"hdd"' '}' '],' '"types":' '[' '{' '"type_id":' 0, '"name":' '"osd"' '},' '{' '"type_id":' 1, '"name":' '"host"' '},' '{' '"type_id":' 2, '"name":' '"chassis"' '},' '{' '"type_id":' 3, '"name":' '"rack"' '},' '{' '"type_id":' 4, '"name":' '"row"' '},' '{' '"type_id":' 5, '"name":' '"pdu"' '},' '{' '"type_id":' 6, '"name":' '"pod"' '},' '{' '"type_id":' 7, '"name":' '"room"' '},' '{' '"type_id":' 8, '"name":' '"datacenter"' '},' '{' '"type_id":' 9, '"name":' '"zone"' '},' '{' '"type_id":' 10, '"name":' '"region"' '},' '{' '"type_id":' 11, '"name":' '"root"' '}' '],' '"buckets":' '[' '{' '"id":' -1, '"name":' '"default",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -3, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -2, '"name":' '"default~hdd",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -4, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -3, '"name":' '"smithi096",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '},' '{' '"id":' -4, '"name":' '"smithi096~hdd",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '}' '],' '"rules":' '[' '{' '"rule_id":' 0, '"rule_name":' '"replicated_rule",' '"type":' 1, '"steps":' '[' '{' '"op":' '"take",' '"item":' -1, '"item_name":' '"default"' '},' '{' '"op":' '"choose_firstn",' '"num":' 0, '"type":' '"osd"' '},' '{' '"op":' '"emit"' '}' ']' '}' '],' '"tunables":' '{' '"choose_local_tries":' 0, '"choose_local_fallback_tries":' 0, '"choose_total_tries":' 50, '"chooseleaf_descend_once":' 1, '"chooseleaf_vary_r":' 1, '"chooseleaf_stable":' 1, '"msr_descents":' 100, '"msr_collision_tries":' 100, '"straw_calc_version":' 1, '"allowed_bucket_algs":' 54, '"profile":' '"jewel",' '"optimal_tunables":' 1, '"legacy_tunables":' 0, '"minimum_required_version":' '"jewel",' '"require_feature_tunables":' 1, '"require_feature_tunables2":' 1, '"has_v2_rules":' 0, '"require_feature_tunables3":' 1, '"has_v3_rules":' 0, '"has_v4_buckets":' 1, '"require_feature_tunables5":' 1, '"has_v5_rules":' 0, '"has_msr_rules":' 0 '},' '"choose_args":' '{}' '},' '"fsmap":' '{' '"epoch":' 1, '"btime":' '"2024-09-16T03:22:46:882186+0000",' '"default_fscid":' -1, '"compat":' '{' '"compat":' '{},' '"ro_compat":' '{},' '"incompat":' '{' '"feature_1":' '"base' 'v0.20",' '"feature_2":' '"client' writeable 'ranges",' '"feature_3":' '"default' file layouts on 'dirs",' '"feature_4":' '"dir' inode in separate 'object",' '"feature_5":' '"mds' uses versioned 'encoding",' '"feature_6":' '"dirfrag' is stored in 'omap",' '"feature_8":' '"no' anchor 'table",' '"feature_9":' '"file' layout 'v2",' '"feature_10":' '"snaprealm' 'v2",' '"feature_11":' '"minor' log 'segments",' '"feature_12":' '"quiesce' 'subvolumes"' '}' '},' '"feature_flags":' '{' '"enable_multiple":' true, '"ever_enabled_multiple":' true '},' '"standbys":' '[],' '"filesystems":' '[]' '},' '"mdsmap_first_committed":' 1, '"mdsmap_last_committed":' 1, '"auth":' '{' '"first_committed":' 1, '"last_committed":' 5, '"num_secrets":' 3 '},' '"num_pg":' 64, '"num_pg_active":' 64, '"num_pg_unknown":' 0, '"num_osd":' 3, '"pool_sum":' '{' '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 128, '"acting":' 128, '"num_store_stats":' 0 '},' '"osd_sum":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54640, '"kb_used_data":' 960, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660560, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692413440, '"internally_reserved":' 0, '"allocated":' 983040, '"data_stored":' 369948, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 325, '"apply_latency_ms":' 325, '"commit_latency_ns":' 325000000, '"apply_latency_ns":' 325000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '},' '"osd_sum_by_class":' '{' '"hdd":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54640, '"kb_used_data":' 960, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660560, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692413440, '"internally_reserved":' 0, '"allocated":' 983040, '"data_stored":' 369948, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 325, '"apply_latency_ms":' 325, '"commit_latency_ns":' 325000000, '"apply_latency_ns":' 325000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '}' '},' '"pool_stats":' '[' '{' '"poolid":' 2, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '},' '{' '"poolid":' 1, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '}' '],' '"osd_stats":' '[' '{' '"osd":' 0, '"seq":' 21474836521 '},' '{' '"osd":' 1, '"seq":' 42949672993 '},' '{' '"osd":' 2, '"seq":' 0 '}' '],' '"num_pg_by_state":' '[' '{' '"state":' '"active+clean",' '"num":' 64 '}' '],' '"num_pg_by_osd":' '[' '{' '"osd":' 2, '"num_primary_pg":' 0, '"num_acting_pg":' 0, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 0, '"num_primary_pg":' 28, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 1, '"num_primary_pg":' 36, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '}' '],' '"purged_snaps":' '[' '{' '"pool":' 1, '"purged_snaps":' '{}' '},' '{' '"pool":' 2, '"purged_snaps":' '{}' '}' '],' '"servicemap":' '{' '"epoch":' 5, '"modified":' '"2024-09-16T03:25:38.422788+0000",' '"services":' '{}' '},' '"mgrstat_first_committed":' 82, '"mgrstat_last_committed":' 89, '"logm_first_committed":' 1, '"logm_last_committed":' 400, '"paxos":' '{' '"first_committed":' 1, '"last_committed":' 592, '"last_pn":' 0, '"accepted_pn":' 0 '}' '}' 2024-09-16T03:26:07.746 INFO:tasks.workunit.client.0.smithi096.stdout:{ "cluster_fingerprint": "fda2fc64-07ed-4add-8224-2e527e11d427", "version": "19.3.0-4930-gfc3e0bff", "commit": "fc3e0bff7468fd55478adbae7f75508b749124b6", "timestamp": "2024-09-16T03:26:07.626620+0000", "tag": "", "health": { "status": "HEALTH_OK", "checks": {}, "mutes": [] }, "monmap_first_committed": 1, "monmap_last_committed": 1, "monmap": { "epoch": 1, "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", "modified": "2024-09-16T03:22:45.872880Z", "created": "2024-09-16T03:22:45.872880Z", "min_mon_release": 19, "min_mon_release_name": "squid", "election_strategy": 1, "disallowed_leaders: ": "", "stretch_mode": false, "tiebreaker_mon": "", "removed_ranks: ": "", "features": { "persistent": [ "kraken", "luminous", "mimic", "osdmap-prune", "nautilus", "octopus", "pacific", "elector-pinging", "quincy", "reef", "squid" ], "optional": [] }, "mons": [ { "rank": 0, "name": "a", "public_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:7302", "nonce": 0 } ] }, "addr": "127.0.0.1:7302/0", "public_addr": "127.0.0.1:7302/0", "priority": 0, "weight": 0, "crush_location": "{}" } ] }, "quorum": [ 0 ], "osdmap": { "epoch": 86, "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", "created": "2024-09-16T03:22:46.906117+0000", "modified": "2024-09-16T03:26:02.230083+0000", "last_up_change": "2024-09-16T03:25:08.513363+0000", "last_in_change": "2024-09-16T03:25:09.839444+0000", "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", "flags_num": 5799936, "flags_set": [ "pglog_hardlimit", "purged_snapdirs", "recovery_deletes", "sortbitwise" ], "crush_version": 7, "full_ratio": 0.97000002861022949, "backfillfull_ratio": 0.97000002861022949, "nearfull_ratio": 0.85000002384185791, "cluster_snapshot": "", "pool_max": 2, "max_osd": 3, "require_min_compat_client": "luminous", "min_compat_client": "jewel", "require_osd_release": "squid", "allow_crimson": false, "pools": [ { "pool": 1, "pool_name": "foo", "create_time": "2024-09-16T03:24:44.525189+0000", "flags": 1, "flags_names": "hashpspool", "type": 1, "size": 2, "min_size": 1, "crush_rule": 0, "peering_crush_bucket_count": 0, "peering_crush_bucket_target": 0, "peering_crush_bucket_barrier": 0, "peering_crush_bucket_mandatory_member": 2147483647, "is_stretch_pool": false, "object_hash": 2, "pg_autoscale_mode": "off", "pg_num": 32, "pg_placement_num": 32, "pg_placement_num_target": 32, "pg_num_target": 32, "pg_num_pending": 32, "last_pg_merge_meta": { "source_pgid": "0.0", "ready_epoch": 0, "last_epoch_started": 0, "last_epoch_clean": 0, "source_version": "0'0", "target_version": "0'0" }, "last_change": "85", "last_force_op_resend": "0", "last_force_op_resend_prenautilus": "0", "last_force_op_resend_preluminous": "0", "auid": 0, "snap_mode": "selfmanaged", "snap_seq": 0, "snap_epoch": 0, "pool_snaps": [], "removed_snaps": "[]", "quota_max_bytes": 0, "quota_max_objects": 0, "tiers": [], "tier_of": -1, "read_tier": -1, "write_tier": -1, "cache_mode": "none", "target_max_bytes": 0, "target_max_objects": 0, "cache_target_dirty_ratio_micro": 400000, "cache_target_dirty_high_ratio_micro": 600000, "cache_target_full_ratio_micro": 800000, "cache_min_flush_age": 0, "cache_min_evict_age": 0, "erasure_code_profile": "", "hit_set_params": { "type": "none" }, "hit_set_period": 0, "hit_set_count": 0, "use_gmt_hitset": true, "min_read_recency_for_promote": 0, "min_write_recency_for_promote": 0, "hit_set_grade_decay_rate": 0, "hit_set_search_last_n": 0, "grade_table": [], "stripe_width": 0, "expected_num_objects": 0, "fast_read": false, "options": {}, "application_metadata": {}, "read_balance": { "score_type": "Fair distribution", "score_acting": 1.8700000047683716, "score_stable": 1.8700000047683716, "optimal_score": 0.67000001668930054, "raw_score_acting": 1.25, "raw_score_stable": 1.25, "primary_affinity_weighted": 1, "average_primary_affinity": 1, "average_primary_affinity_weighted": 1 } }, { "pool": 2, "pool_name": "bar", "create_time": "2024-09-16T03:24:46.226575+0000", "flags": 1, "flags_names": "hashpspool", "type": 1, "size": 2, "min_size": 1, "crush_rule": 0, "peering_crush_bucket_count": 0, "peering_crush_bucket_target": 0, "peering_crush_bucket_barrier": 0, "peering_crush_bucket_mandatory_member": 2147483647, "is_stretch_pool": false, "object_hash": 2, "pg_autoscale_mode": "off", "pg_num": 32, "pg_placement_num": 32, "pg_placement_num_target": 32, "pg_num_target": 32, "pg_num_pending": 32, "last_pg_merge_meta": { "source_pgid": "0.0", "ready_epoch": 0, "last_epoch_started": 0, "last_epoch_clean": 0, "source_version": "0'0", "target_version": "0'0" }, "last_change": "83", "last_force_op_resend": "0", "last_force_op_resend_prenautilus": "0", "last_force_op_resend_preluminous": "0", "auid": 0, "snap_mode": "selfmanaged", "snap_seq": 0, "snap_epoch": 0, "pool_snaps": [], "removed_snaps": "[]", "quota_max_bytes": 0, "quota_max_objects": 0, "tiers": [], "tier_of": -1, "read_tier": -1, "write_tier": -1, "cache_mode": "none", "target_max_bytes": 0, "target_max_objects": 0, "cache_target_dirty_ratio_micro": 400000, "cache_target_dirty_high_ratio_micro": 600000, "cache_target_full_ratio_micro": 800000, "cache_min_flush_age": 0, "cache_min_evict_age": 0, "erasure_code_profile": "", "hit_set_params": { "type": "none" }, "hit_set_period": 0, "hit_set_count": 0, "use_gmt_hitset": true, "min_read_recency_for_promote": 0, "min_write_recency_for_promote": 0, "hit_set_grade_decay_rate": 0, "hit_set_search_last_n": 0, "grade_table": [], "stripe_width": 0, "expected_num_objects": 0, "fast_read": false, "options": {}, "application_metadata": {}, "read_balance": { "score_type": "Fair distribution", "score_acting": 1.4900000095367432, "score_stable": 1.4900000095367432, "optimal_score": 0.67000001668930054, "raw_score_acting": 1, "raw_score_stable": 1, "primary_affinity_weighted": 1, "average_primary_affinity": 1, "average_primary_affinity_weighted": 1 } } ], "osds": [ { "osd": 0, "uuid": "64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6", "up": 1, "in": 1, "weight": 1, "primary_affinity": 1, "last_clean_begin": 0, "last_clean_end": 0, "up_from": 5, "up_thru": 84, "down_at": 0, "lost_at": 0, "public_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6802", "nonce": 3375787448 }, { "type": "v1", "addr": "127.0.0.1:6803", "nonce": 3375787448 } ] }, "cluster_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6804", "nonce": 3375787448 }, { "type": "v1", "addr": "127.0.0.1:6805", "nonce": 3375787448 } ] }, "heartbeat_back_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6808", "nonce": 3375787448 }, { "type": "v1", "addr": "127.0.0.1:6809", "nonce": 3375787448 } ] }, "heartbeat_front_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6806", "nonce": 3375787448 }, { "type": "v1", "addr": "127.0.0.1:6807", "nonce": 3375787448 } ] }, "public_addr": "127.0.0.1:6803/3375787448", "cluster_addr": "127.0.0.1:6805/3375787448", "heartbeat_back_addr": "127.0.0.1:6809/3375787448", "heartbeat_front_addr": "127.0.0.1:6807/3375787448", "state": [ "exists", "up" ] }, { "osd": 1, "uuid": "74b26727-75c9-444d-8782-719e4197a382", "up": 1, "in": 1, "weight": 1, "primary_affinity": 1, "last_clean_begin": 0, "last_clean_end": 0, "up_from": 10, "up_thru": 84, "down_at": 0, "lost_at": 0, "public_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6810", "nonce": 3733255132 }, { "type": "v1", "addr": "127.0.0.1:6811", "nonce": 3733255132 } ] }, "cluster_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6812", "nonce": 3733255132 }, { "type": "v1", "addr": "127.0.0.1:6813", "nonce": 3733255132 } ] }, "heartbeat_back_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6816", "nonce": 3733255132 }, { "type": "v1", "addr": "127.0.0.1:6817", "nonce": 3733255132 } ] }, "heartbeat_front_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6814", "nonce": 3733255132 }, { "type": "v1", "addr": "127.0.0.1:6815", "nonce": 3733255132 } ] }, "public_addr": "127.0.0.1:6811/3733255132", "cluster_addr": "127.0.0.1:6813/3733255132", "heartbeat_back_addr": "127.0.0.1:6817/3733255132", "heartbeat_front_addr": "127.0.0.1:6815/3733255132", "state": [ "exists", "up" ] }, { "osd": 2, "uuid": "143da3a7-dad9-4b1e-966b-76cf5bdd3c82", "up": 0, "in": 0, "weight": 0, "primary_affinity": 1, "last_clean_begin": 0, "last_clean_end": 0, "up_from": 15, "up_thru": 21, "down_at": 33, "lost_at": 0, "public_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6818", "nonce": 963814857 }, { "type": "v1", "addr": "127.0.0.1:6819", "nonce": 963814857 } ] }, "cluster_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6820", "nonce": 963814857 }, { "type": "v1", "addr": "127.0.0.1:6821", "nonce": 963814857 } ] }, "heartbeat_back_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6824", "nonce": 963814857 }, { "type": "v1", "addr": "127.0.0.1:6825", "nonce": 963814857 } ] }, "heartbeat_front_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6822", "nonce": 963814857 }, { "type": "v1", "addr": "127.0.0.1:6823", "nonce": 963814857 } ] }, "public_addr": "127.0.0.1:6819/963814857", "cluster_addr": "127.0.0.1:6821/963814857", "heartbeat_back_addr": "127.0.0.1:6825/963814857", "heartbeat_front_addr": "127.0.0.1:6823/963814857", "state": [ "exists" ] } ], "osd_xinfo": [ { "osd": 0, "down_stamp": "0.000000", "laggy_probability": 0, "laggy_interval": 0, "features": 4540719139924082687, "old_weight": 0, "last_purged_snaps_scrub": "2024-09-16T03:23:22.481942+0000", "dead_epoch": 0 }, { "osd": 1, "down_stamp": "0.000000", "laggy_probability": 0, "laggy_interval": 0, "features": 4540719139924082687, "old_weight": 0, "last_purged_snaps_scrub": "2024-09-16T03:23:59.663703+0000", "dead_epoch": 0 }, { "osd": 2, "down_stamp": "0.000000", "laggy_probability": 0, "laggy_interval": 0, "features": 4540719139924082687, "old_weight": 65536, "last_purged_snaps_scrub": "2024-09-16T03:24:37.320822+0000", "dead_epoch": 32 } ], "pg_upmap": [], "pg_upmap_items": [], "pg_upmap_primaries": [], "pg_temp": [], "primary_temp": [], "blocklist": {}, "range_blocklist": {}, "erasure_code_profiles": { "default": { "k": "2", "m": "2", "plugin": "jerasure", "technique": "reed_sol_van" } }, "removed_snaps_queue": [], "new_removed_snaps": [], "new_purged_snaps": [], "crush_node_flags": {}, "device_class_flags": {}, "stretch_mode": { "stretch_mode_enabled": false, "stretch_bucket_count": 0, "degraded_stretch_mode": 0, "recovering_stretch_mode": 0, "stretch_mode_bucket": 0 } }, "osd_metadata": [ { "id": 0, "arch": "x86_64", "back_addr": "[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]", "back_iface": "", "bluefs": "1", "bluefs_dedicated_db": "0", "bluefs_dedicated_wal": "0", "bluefs_single_shared_device": "1", "bluestore_allocation_from_file": "0", "bluestore_bdev_access_mode": "file", "bluestore_bdev_block_size": "4096", "bluestore_bdev_devices": "sda", "bluestore_bdev_driver": "KernelDevice", "bluestore_bdev_optimal_io_size": "0", "bluestore_bdev_path": "td/mon-last-clean-epoch/0/block", "bluestore_bdev_rotational": "1", "bluestore_bdev_size": "107374182400", "bluestore_bdev_support_discard": "0", "bluestore_bdev_type": "hdd", "bluestore_min_alloc_size": "4096", "ceph_release": "squid", "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", "ceph_version_short": "19.3.0-4930-gfc3e0bff", "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", "created_at": "2024-09-16T03:22:53.662571Z", "default_device_class": "hdd", "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", "devices": "sda", "distro": "ubuntu", "distro_description": "Ubuntu 22.04.1 LTS", "distro_version": "22.04", "front_addr": "[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]", "front_iface": "", "hb_back_addr": "[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]", "hb_front_addr": "[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]", "hostname": "smithi096", "journal_rotational": "1", "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", "kernel_version": "5.15.0-121-generic", "mem_swap_kb": "2097148", "mem_total_kb": "32746824", "network_numa_unknown_ifaces": "back_iface,front_iface", "objectstore_numa_unknown_devices": "sda", "os": "Linux", "osd_data": "td/mon-last-clean-epoch/0", "osd_objectstore": "bluestore", "osdspec_affinity": "", "rotational": "1" }, { "id": 1, "arch": "x86_64", "back_addr": "[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]", "back_iface": "", "bluefs": "1", "bluefs_dedicated_db": "0", "bluefs_dedicated_wal": "0", "bluefs_single_shared_device": "1", "bluestore_allocation_from_file": "0", "bluestore_bdev_access_mode": "file", "bluestore_bdev_block_size": "4096", "bluestore_bdev_devices": "sda", "bluestore_bdev_driver": "KernelDevice", "bluestore_bdev_optimal_io_size": "0", "bluestore_bdev_path": "td/mon-last-clean-epoch/1/block", "bluestore_bdev_rotational": "1", "bluestore_bdev_size": "107374182400", "bluestore_bdev_support_discard": "0", "bluestore_bdev_type": "hdd", "bluestore_min_alloc_size": "4096", "ceph_release": "squid", "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", "ceph_version_short": "19.3.0-4930-gfc3e0bff", "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", "created_at": "2024-09-16T03:23:30.129885Z", "default_device_class": "hdd", "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", "devices": "sda", "distro": "ubuntu", "distro_description": "Ubuntu 22.04.1 LTS", "distro_version": "22.04", "front_addr": "[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]", "front_iface": "", "hb_back_addr": "[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]", "hb_front_addr": "[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]", "hostname": "smithi096", "journal_rotational": "1", "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", "kernel_version": "5.15.0-121-generic", "mem_swap_kb": "2097148", "mem_total_kb": "32746824", "network_numa_unknown_ifaces": "back_iface,front_iface", "objectstore_numa_unknown_devices": "sda", "os": "Linux", "osd_data": "td/mon-last-clean-epoch/1", "osd_objectstore": "bluestore", "osdspec_affinity": "", "rotational": "1" }, { "id": 2, "arch": "x86_64", "back_addr": "[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]", "back_iface": "", "bluefs": "1", "bluefs_dedicated_db": "0", "bluefs_dedicated_wal": "0", "bluefs_single_shared_device": "1", "bluestore_allocation_from_file": "0", "bluestore_bdev_access_mode": "file", "bluestore_bdev_block_size": "4096", "bluestore_bdev_devices": "sda", "bluestore_bdev_driver": "KernelDevice", "bluestore_bdev_optimal_io_size": "0", "bluestore_bdev_path": "td/mon-last-clean-epoch/2/block", "bluestore_bdev_rotational": "1", "bluestore_bdev_size": "107374182400", "bluestore_bdev_support_discard": "0", "bluestore_bdev_type": "hdd", "bluestore_min_alloc_size": "4096", "ceph_release": "squid", "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", "ceph_version_short": "19.3.0-4930-gfc3e0bff", "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", "created_at": "2024-09-16T03:24:07.764502Z", "default_device_class": "hdd", "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", "devices": "sda", "distro": "ubuntu", "distro_description": "Ubuntu 22.04.1 LTS", "distro_version": "22.04", "front_addr": "[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]", "front_iface": "", "hb_back_addr": "[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]", "hb_front_addr": "[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]", "hostname": "smithi096", "journal_rotational": "1", "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", "kernel_version": "5.15.0-121-generic", "mem_swap_kb": "2097148", "mem_total_kb": "32746824", "network_numa_unknown_ifaces": "back_iface,front_iface", "objectstore_numa_unknown_devices": "sda", "os": "Linux", "osd_data": "td/mon-last-clean-epoch/2", "osd_objectstore": "bluestore", "osdspec_affinity": "", "rotational": "1" } ], "osdmap_clean_epochs": { "min_last_epoch_clean": 86, "last_epoch_clean": { "per_pool": [ { "poolid": 1, "floor": 86 }, { "poolid": 2, "floor": 86 } ] }, "osd_epochs": [ { "id": 0, "epoch": 86 }, { "id": 1, "epoch": 86 } ] }, "osdmap_first_committed": 28, "osdmap_last_committed": 86, "crushmap": { "devices": [ { "id": 0, "name": "osd.0", "class": "hdd" }, { "id": 1, "name": "osd.1", "class": "hdd" }, { "id": 2, "name": "osd.2", "class": "hdd" } ], "types": [ { "type_id": 0, "name": "osd" }, { "type_id": 1, "name": "host" }, { "type_id": 2, "name": "chassis" }, { "type_id": 3, "name": "rack" }, { "type_id": 4, "name": "row" }, { "type_id": 5, "name": "pdu" }, { "type_id": 6, "name": "pod" }, { "type_id": 7, "name": "room" }, { "type_id": 8, "name": "datacenter" }, { "type_id": 9, "name": "zone" }, { "type_id": 10, "name": "region" }, { "type_id": 11, "name": "root" } ], "buckets": [ { "id": -1, "name": "default", "type_id": 11, "type_name": "root", "weight": 19206, "alg": "straw2", "hash": "rjenkins1", "items": [ { "id": -3, "weight": 19206, "pos": 0 } ] }, { "id": -2, "name": "default~hdd", "type_id": 11, "type_name": "root", "weight": 19206, "alg": "straw2", "hash": "rjenkins1", "items": [ { "id": -4, "weight": 19206, "pos": 0 } ] }, { "id": -3, "name": "smithi096", "type_id": 1, "type_name": "host", "weight": 19206, "alg": "straw2", "hash": "rjenkins1", "items": [ { "id": 0, "weight": 6402, "pos": 0 }, { "id": 1, "weight": 6402, "pos": 1 }, { "id": 2, "weight": 6402, "pos": 2 } ] }, { "id": -4, "name": "smithi096~hdd", "type_id": 1, "type_name": "host", "weight": 19206, "alg": "straw2", "hash": "rjenkins1", "items": [ { "id": 0, "weight": 6402, "pos": 0 }, { "id": 1, "weight": 6402, "pos": 1 }, { "id": 2, "weight": 6402, "pos": 2 } ] } ], "rules": [ { "rule_id": 0, "rule_name": "replicated_rule", "type": 1, "steps": [ { "op": "take", "item": -1, "item_name": "default" }, { "op": "choose_firstn", "num": 0, "type": "osd" }, { "op": "emit" } ] } ], "tunables": { "choose_local_tries": 0, "choose_local_fallback_tries": 0, "choose_total_tries": 50, "chooseleaf_descend_once": 1, "chooseleaf_vary_r": 1, "chooseleaf_stable": 1, "msr_descents": 100, "msr_collision_tries": 100, "straw_calc_version": 1, "allowed_bucket_algs": 54, "profile": "jewel", "optimal_tunables": 1, "legacy_tunables": 0, "minimum_required_version": "jewel", "require_feature_tunables": 1, "require_feature_tunables2": 1, "has_v2_rules": 0, "require_feature_tunables3": 1, "has_v3_rules": 0, "has_v4_buckets": 1, "require_feature_tunables5": 1, "has_v5_rules": 0, "has_msr_rules": 0 }, "choose_args": {} }, "fsmap": { "epoch": 1, "btime": "2024-09-16T03:22:46:882186+0000", "default_fscid": -1, "compat": { "compat": {}, "ro_compat": {}, "incompat": { "feature_1": "base v0.20", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes" } }, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "standbys": [], "filesystems": [] }, "mdsmap_first_committed": 1, "mdsmap_last_committed": 1, "auth": { "first_committed": 1, "last_committed": 5, "num_secrets": 3 }, "num_pg": 64, "num_pg_active": 64, "num_pg_unknown": 0, "num_osd": 3, "pool_sum": { "stat_sum": { "num_bytes": 0, "num_objects": 0, "num_object_clones": 0, "num_object_copies": 0, "num_objects_missing_on_primary": 0, "num_objects_missing": 0, "num_objects_degraded": 0, "num_objects_misplaced": 0, "num_objects_unfound": 0, "num_objects_dirty": 0, "num_whiteouts": 0, "num_read": 0, "num_read_kb": 0, "num_write": 0, "num_write_kb": 0, "num_scrub_errors": 0, "num_shallow_scrub_errors": 0, "num_deep_scrub_errors": 0, "num_objects_recovered": 0, "num_bytes_recovered": 0, "num_keys_recovered": 0, "num_objects_omap": 0, "num_objects_hit_set_archive": 0, "num_bytes_hit_set_archive": 0, "num_flush": 0, "num_flush_kb": 0, "num_evict": 0, "num_evict_kb": 0, "num_promote": 0, "num_flush_mode_high": 0, "num_flush_mode_low": 0, "num_evict_mode_some": 0, "num_evict_mode_full": 0, "num_objects_pinned": 0, "num_legacy_snapsets": 0, "num_large_omap_objects": 0, "num_objects_manifest": 0, "num_omap_bytes": 0, "num_omap_keys": 0, "num_objects_repaired": 0 }, "store_stats": { "total": 0, "available": 0, "internally_reserved": 0, "allocated": 0, "data_stored": 0, "data_compressed": 0, "data_compressed_allocated": 0, "data_compressed_original": 0, "omap_allocated": 0, "internal_metadata": 0 }, "log_size": 0, "ondisk_log_size": 0, "up": 128, "acting": 128, "num_store_stats": 0 }, "osd_sum": { "up_from": 0, "seq": 0, "num_pgs": 128, "num_osds": 2, "num_per_pool_osds": 2, "num_per_pool_omap_osds": 2, "kb": 209715200, "kb_used": 54640, "kb_used_data": 960, "kb_used_omap": 3, "kb_used_meta": 53628, "kb_avail": 209660560, "statfs": { "total": 214748364800, "available": 214692413440, "internally_reserved": 0, "allocated": 983040, "data_stored": 369948, "data_compressed": 0, "data_compressed_allocated": 0, "data_compressed_original": 0, "omap_allocated": 3190, "internal_metadata": 54915978 }, "hb_peers": [], "snap_trim_queue_len": 0, "num_snap_trimming": 0, "num_shards_repaired": 0, "op_queue_age_hist": { "histogram": [], "upper_bound": 1 }, "perf_stat": { "commit_latency_ms": 325, "apply_latency_ms": 325, "commit_latency_ns": 325000000, "apply_latency_ns": 325000000 }, "alerts": [], "network_ping_times": [] }, "osd_sum_by_class": { "hdd": { "up_from": 0, "seq": 0, "num_pgs": 128, "num_osds": 2, "num_per_pool_osds": 2, "num_per_pool_omap_osds": 2, "kb": 209715200, "kb_used": 54640, "kb_used_data": 960, "kb_used_omap": 3, "kb_used_meta": 53628, "kb_avail": 209660560, "statfs": { "total": 214748364800, "available": 214692413440, "internally_reserved": 0, "allocated": 983040, "data_stored": 369948, "data_compressed": 0, "data_compressed_allocated": 0, "data_compressed_original": 0, "omap_allocated": 3190, "internal_metadata": 54915978 }, "hb_peers": [], "snap_trim_queue_len": 0, "num_snap_trimming": 0, "num_shards_repaired": 0, "op_queue_age_hist": { "histogram": [], "upper_bound": 1 }, "perf_stat": { "commit_latency_ms": 325, "apply_latency_ms": 325, "commit_latency_ns": 325000000, "apply_latency_ns": 325000000 }, "alerts": [], "network_ping_times": [] } }, "pool_stats": [ { "poolid": 2, "num_pg": 32, "stat_sum": { "num_bytes": 0, "num_objects": 0, "num_object_clones": 0, "num_object_copies": 0, "num_objects_missing_on_primary": 0, "num_objects_missing": 0, "num_objects_degraded": 0, "num_objects_misplaced": 0, "num_objects_unfound": 0, "num_objects_dirty": 0, "num_whiteouts": 0, "num_read": 0, "num_read_kb": 0, "num_write": 0, "num_write_kb": 0, "num_scrub_errors": 0, "num_shallow_scrub_errors": 0, "num_deep_scrub_errors": 0, "num_objects_recovered": 0, "num_bytes_recovered": 0, "num_keys_recovered": 0, "num_objects_omap": 0, "num_objects_hit_set_archive": 0, "num_bytes_hit_set_archive": 0, "num_flush": 0, "num_flush_kb": 0, "num_evict": 0, "num_evict_kb": 0, "num_promote": 0, "num_flush_mode_high": 0, "num_flush_mode_low": 0, "num_evict_mode_some": 0, "num_evict_mode_full": 0, "num_objects_pinned": 0, "num_legacy_snapsets": 0, "num_large_omap_objects": 0, "num_objects_manifest": 0, "num_omap_bytes": 0, "num_omap_keys": 0, "num_objects_repaired": 0 }, "store_stats": { "total": 0, "available": 0, "internally_reserved": 0, "allocated": 0, "data_stored": 0, "data_compressed": 0, "data_compressed_allocated": 0, "data_compressed_original": 0, "omap_allocated": 0, "internal_metadata": 0 }, "log_size": 0, "ondisk_log_size": 0, "up": 64, "acting": 64, "num_store_stats": 3 }, { "poolid": 1, "num_pg": 32, "stat_sum": { "num_bytes": 0, "num_objects": 0, "num_object_clones": 0, "num_object_copies": 0, "num_objects_missing_on_primary": 0, "num_objects_missing": 0, "num_objects_degraded": 0, "num_objects_misplaced": 0, "num_objects_unfound": 0, "num_objects_dirty": 0, "num_whiteouts": 0, "num_read": 0, "num_read_kb": 0, "num_write": 0, "num_write_kb": 0, "num_scrub_errors": 0, "num_shallow_scrub_errors": 0, "num_deep_scrub_errors": 0, "num_objects_recovered": 0, "num_bytes_recovered": 0, "num_keys_recovered": 0, "num_objects_omap": 0, "num_objects_hit_set_archive": 0, "num_bytes_hit_set_archive": 0, "num_flush": 0, "num_flush_kb": 0, "num_evict": 0, "num_evict_kb": 0, "num_promote": 0, "num_flush_mode_high": 0, "num_flush_mode_low": 0, "num_evict_mode_some": 0, "num_evict_mode_full": 0, "num_objects_pinned": 0, "num_legacy_snapsets": 0, "num_large_omap_objects": 0, "num_objects_manifest": 0, "num_omap_bytes": 0, "num_omap_keys": 0, "num_objects_repaired": 0 }, "store_stats": { "total": 0, "available": 0, "internally_reserved": 0, "allocated": 0, "data_stored": 0, "data_compressed": 0, "data_compressed_allocated": 0, "data_compressed_original": 0, "omap_allocated": 0, "internal_metadata": 0 }, "log_size": 0, "ondisk_log_size": 0, "up": 64, "acting": 64, "num_store_stats": 3 } ], "osd_stats": [ { "osd": 0, "seq": 21474836521 }, { "osd": 1, "seq": 42949672993 }, { "osd": 2, "seq": 0 } ], "num_pg_by_state": [ { "state": "active+clean", "num": 64 } ], "num_pg_by_osd": [ { "osd": 2, "num_primary_pg": 0, "num_acting_pg": 0, "num_up_not_acting_pg": 0 }, { "osd": 0, "num_primary_pg": 28, "num_acting_pg": 64, "num_up_not_acting_pg": 0 }, { "osd": 1, "num_primary_pg": 36, "num_acting_pg": 64, "num_up_not_acting_pg": 0 } ], "purged_snaps": [ { "pool": 1, "purged_snaps": {} }, { "pool": 2, "purged_snaps": {} } ], "servicemap": { "epoch": 5, "modified": "2024-09-16T03:25:38.422788+0000", "services": {} }, "mgrstat_first_committed": 82, "mgrstat_last_committed": 89, "logm_first_committed": 1, "logm_last_committed": 400, "paxos": { "first_committed": 1, "last_committed": 592, "last_pn": 0, "accepted_pn": 0 } } 2024-09-16T03:26:07.747 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:38: check_lec_equals_pools: return 1 2024-09-16T03:26:07.747 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:47: check_lec_equals_pools: return 0 2024-09-16T03:26:07.747 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:277: TEST_mon_last_clean_epoch: validate_fc 2024-09-16T03:26:07.747 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:119: validate_fc: ceph report 2024-09-16T03:26:08.247 INFO:tasks.workunit.client.0.smithi096.stderr:report 3190429737 2024-09-16T03:26:08.265 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:119: validate_fc: report='{ 2024-09-16T03:26:08.266 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_fingerprint": "fda2fc64-07ed-4add-8224-2e527e11d427", 2024-09-16T03:26:08.266 INFO:tasks.workunit.client.0.smithi096.stderr: "version": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:26:08.266 INFO:tasks.workunit.client.0.smithi096.stderr: "commit": "fc3e0bff7468fd55478adbae7f75508b749124b6", 2024-09-16T03:26:08.266 INFO:tasks.workunit.client.0.smithi096.stderr: "timestamp": "2024-09-16T03:26:08.248292+0000", 2024-09-16T03:26:08.266 INFO:tasks.workunit.client.0.smithi096.stderr: "tag": "", 2024-09-16T03:26:08.266 INFO:tasks.workunit.client.0.smithi096.stderr: "health": { 2024-09-16T03:26:08.267 INFO:tasks.workunit.client.0.smithi096.stderr: "status": "HEALTH_OK", 2024-09-16T03:26:08.267 INFO:tasks.workunit.client.0.smithi096.stderr: "checks": {}, 2024-09-16T03:26:08.267 INFO:tasks.workunit.client.0.smithi096.stderr: "mutes": [] 2024-09-16T03:26:08.267 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.267 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap_first_committed": 1, 2024-09-16T03:26:08.267 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap_last_committed": 1, 2024-09-16T03:26:08.267 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap": { 2024-09-16T03:26:08.268 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 1, 2024-09-16T03:26:08.268 INFO:tasks.workunit.client.0.smithi096.stderr: "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", 2024-09-16T03:26:08.268 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:22:45.872880Z", 2024-09-16T03:26:08.268 INFO:tasks.workunit.client.0.smithi096.stderr: "created": "2024-09-16T03:22:45.872880Z", 2024-09-16T03:26:08.268 INFO:tasks.workunit.client.0.smithi096.stderr: "min_mon_release": 19, 2024-09-16T03:26:08.268 INFO:tasks.workunit.client.0.smithi096.stderr: "min_mon_release_name": "squid", 2024-09-16T03:26:08.268 INFO:tasks.workunit.client.0.smithi096.stderr: "election_strategy": 1, 2024-09-16T03:26:08.268 INFO:tasks.workunit.client.0.smithi096.stderr: "disallowed_leaders: ": "", 2024-09-16T03:26:08.269 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode": false, 2024-09-16T03:26:08.269 INFO:tasks.workunit.client.0.smithi096.stderr: "tiebreaker_mon": "", 2024-09-16T03:26:08.269 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_ranks: ": "", 2024-09-16T03:26:08.269 INFO:tasks.workunit.client.0.smithi096.stderr: "features": { 2024-09-16T03:26:08.269 INFO:tasks.workunit.client.0.smithi096.stderr: "persistent": [ 2024-09-16T03:26:08.269 INFO:tasks.workunit.client.0.smithi096.stderr: "kraken", 2024-09-16T03:26:08.269 INFO:tasks.workunit.client.0.smithi096.stderr: "luminous", 2024-09-16T03:26:08.270 INFO:tasks.workunit.client.0.smithi096.stderr: "mimic", 2024-09-16T03:26:08.270 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap-prune", 2024-09-16T03:26:08.270 INFO:tasks.workunit.client.0.smithi096.stderr: "nautilus", 2024-09-16T03:26:08.270 INFO:tasks.workunit.client.0.smithi096.stderr: "octopus", 2024-09-16T03:26:08.270 INFO:tasks.workunit.client.0.smithi096.stderr: "pacific", 2024-09-16T03:26:08.270 INFO:tasks.workunit.client.0.smithi096.stderr: "elector-pinging", 2024-09-16T03:26:08.271 INFO:tasks.workunit.client.0.smithi096.stderr: "quincy", 2024-09-16T03:26:08.271 INFO:tasks.workunit.client.0.smithi096.stderr: "reef", 2024-09-16T03:26:08.271 INFO:tasks.workunit.client.0.smithi096.stderr: "squid" 2024-09-16T03:26:08.271 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:08.272 INFO:tasks.workunit.client.0.smithi096.stderr: "optional": [] 2024-09-16T03:26:08.272 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.272 INFO:tasks.workunit.client.0.smithi096.stderr: "mons": [ 2024-09-16T03:26:08.272 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:08.272 INFO:tasks.workunit.client.0.smithi096.stderr: "rank": 0, 2024-09-16T03:26:08.272 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "a", 2024-09-16T03:26:08.273 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:26:08.273 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:08.273 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:08.273 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:08.273 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:7302", 2024-09-16T03:26:08.273 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 0 2024-09-16T03:26:08.273 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:08.274 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:08.274 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.274 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:7302/0", 2024-09-16T03:26:08.274 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:7302/0", 2024-09-16T03:26:08.274 INFO:tasks.workunit.client.0.smithi096.stderr: "priority": 0, 2024-09-16T03:26:08.274 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 0, 2024-09-16T03:26:08.275 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_location": "{}" 2024-09-16T03:26:08.275 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:08.275 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:08.275 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.275 INFO:tasks.workunit.client.0.smithi096.stderr: "quorum": [ 2024-09-16T03:26:08.275 INFO:tasks.workunit.client.0.smithi096.stderr: 0 2024-09-16T03:26:08.276 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:08.276 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap": { 2024-09-16T03:26:08.276 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 86, 2024-09-16T03:26:08.276 INFO:tasks.workunit.client.0.smithi096.stderr: "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", 2024-09-16T03:26:08.276 INFO:tasks.workunit.client.0.smithi096.stderr: "created": "2024-09-16T03:22:46.906117+0000", 2024-09-16T03:26:08.276 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:26:02.230083+0000", 2024-09-16T03:26:08.277 INFO:tasks.workunit.client.0.smithi096.stderr: "last_up_change": "2024-09-16T03:25:08.513363+0000", 2024-09-16T03:26:08.277 INFO:tasks.workunit.client.0.smithi096.stderr: "last_in_change": "2024-09-16T03:25:09.839444+0000", 2024-09-16T03:26:08.277 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-16T03:26:08.277 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_num": 5799936, 2024-09-16T03:26:08.277 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_set": [ 2024-09-16T03:26:08.277 INFO:tasks.workunit.client.0.smithi096.stderr: "pglog_hardlimit", 2024-09-16T03:26:08.278 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snapdirs", 2024-09-16T03:26:08.278 INFO:tasks.workunit.client.0.smithi096.stderr: "recovery_deletes", 2024-09-16T03:26:08.278 INFO:tasks.workunit.client.0.smithi096.stderr: "sortbitwise" 2024-09-16T03:26:08.278 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:08.278 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_version": 7, 2024-09-16T03:26:08.278 INFO:tasks.workunit.client.0.smithi096.stderr: "full_ratio": 0.97000002861022949, 2024-09-16T03:26:08.278 INFO:tasks.workunit.client.0.smithi096.stderr: "backfillfull_ratio": 0.97000002861022949, 2024-09-16T03:26:08.279 INFO:tasks.workunit.client.0.smithi096.stderr: "nearfull_ratio": 0.85000002384185791, 2024-09-16T03:26:08.279 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_snapshot": "", 2024-09-16T03:26:08.279 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_max": 2, 2024-09-16T03:26:08.279 INFO:tasks.workunit.client.0.smithi096.stderr: "max_osd": 3, 2024-09-16T03:26:08.279 INFO:tasks.workunit.client.0.smithi096.stderr: "require_min_compat_client": "luminous", 2024-09-16T03:26:08.280 INFO:tasks.workunit.client.0.smithi096.stderr: "min_compat_client": "jewel", 2024-09-16T03:26:08.280 INFO:tasks.workunit.client.0.smithi096.stderr: "require_osd_release": "squid", 2024-09-16T03:26:08.280 INFO:tasks.workunit.client.0.smithi096.stderr: "allow_crimson": false, 2024-09-16T03:26:08.280 INFO:tasks.workunit.client.0.smithi096.stderr: "pools": [ 2024-09-16T03:26:08.280 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:08.280 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 1, 2024-09-16T03:26:08.281 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_name": "foo", 2024-09-16T03:26:08.281 INFO:tasks.workunit.client.0.smithi096.stderr: "create_time": "2024-09-16T03:24:44.525189+0000", 2024-09-16T03:26:08.281 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": 1, 2024-09-16T03:26:08.281 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_names": "hashpspool", 2024-09-16T03:26:08.281 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:26:08.281 INFO:tasks.workunit.client.0.smithi096.stderr: "size": 2, 2024-09-16T03:26:08.282 INFO:tasks.workunit.client.0.smithi096.stderr: "min_size": 1, 2024-09-16T03:26:08.282 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_rule": 0, 2024-09-16T03:26:08.282 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_count": 0, 2024-09-16T03:26:08.282 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_target": 0, 2024-09-16T03:26:08.282 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_barrier": 0, 2024-09-16T03:26:08.282 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-16T03:26:08.283 INFO:tasks.workunit.client.0.smithi096.stderr: "is_stretch_pool": false, 2024-09-16T03:26:08.283 INFO:tasks.workunit.client.0.smithi096.stderr: "object_hash": 2, 2024-09-16T03:26:08.283 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_autoscale_mode": "off", 2024-09-16T03:26:08.283 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num": 32, 2024-09-16T03:26:08.283 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num": 32, 2024-09-16T03:26:08.283 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num_target": 32, 2024-09-16T03:26:08.283 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_target": 32, 2024-09-16T03:26:08.283 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_pending": 32, 2024-09-16T03:26:08.283 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pg_merge_meta": { 2024-09-16T03:26:08.284 INFO:tasks.workunit.client.0.smithi096.stderr: "source_pgid": "0.0", 2024-09-16T03:26:08.284 INFO:tasks.workunit.client.0.smithi096.stderr: "ready_epoch": 0, 2024-09-16T03:26:08.284 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_started": 0, 2024-09-16T03:26:08.284 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": 0, 2024-09-16T03:26:08.284 INFO:tasks.workunit.client.0.smithi096.stderr: "source_version": "0'\''0", 2024-09-16T03:26:08.284 INFO:tasks.workunit.client.0.smithi096.stderr: "target_version": "0'\''0" 2024-09-16T03:26:08.284 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.284 INFO:tasks.workunit.client.0.smithi096.stderr: "last_change": "85", 2024-09-16T03:26:08.284 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend": "0", 2024-09-16T03:26:08.284 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_prenautilus": "0", 2024-09-16T03:26:08.284 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_preluminous": "0", 2024-09-16T03:26:08.284 INFO:tasks.workunit.client.0.smithi096.stderr: "auid": 0, 2024-09-16T03:26:08.284 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_mode": "selfmanaged", 2024-09-16T03:26:08.285 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_seq": 0, 2024-09-16T03:26:08.285 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_epoch": 0, 2024-09-16T03:26:08.285 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_snaps": [], 2024-09-16T03:26:08.285 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps": "[]", 2024-09-16T03:26:08.285 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_bytes": 0, 2024-09-16T03:26:08.285 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_objects": 0, 2024-09-16T03:26:08.285 INFO:tasks.workunit.client.0.smithi096.stderr: "tiers": [], 2024-09-16T03:26:08.285 INFO:tasks.workunit.client.0.smithi096.stderr: "tier_of": -1, 2024-09-16T03:26:08.285 INFO:tasks.workunit.client.0.smithi096.stderr: "read_tier": -1, 2024-09-16T03:26:08.285 INFO:tasks.workunit.client.0.smithi096.stderr: "write_tier": -1, 2024-09-16T03:26:08.285 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_mode": "none", 2024-09-16T03:26:08.285 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_bytes": 0, 2024-09-16T03:26:08.285 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_objects": 0, 2024-09-16T03:26:08.286 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_ratio_micro": 400000, 2024-09-16T03:26:08.286 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-16T03:26:08.286 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_full_ratio_micro": 800000, 2024-09-16T03:26:08.286 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_flush_age": 0, 2024-09-16T03:26:08.286 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_evict_age": 0, 2024-09-16T03:26:08.286 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profile": "", 2024-09-16T03:26:08.286 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_params": { 2024-09-16T03:26:08.286 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "none" 2024-09-16T03:26:08.286 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.286 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_period": 0, 2024-09-16T03:26:08.286 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_count": 0, 2024-09-16T03:26:08.286 INFO:tasks.workunit.client.0.smithi096.stderr: "use_gmt_hitset": true, 2024-09-16T03:26:08.287 INFO:tasks.workunit.client.0.smithi096.stderr: "min_read_recency_for_promote": 0, 2024-09-16T03:26:08.287 INFO:tasks.workunit.client.0.smithi096.stderr: "min_write_recency_for_promote": 0, 2024-09-16T03:26:08.287 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_grade_decay_rate": 0, 2024-09-16T03:26:08.287 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_search_last_n": 0, 2024-09-16T03:26:08.287 INFO:tasks.workunit.client.0.smithi096.stderr: "grade_table": [], 2024-09-16T03:26:08.287 INFO:tasks.workunit.client.0.smithi096.stderr: "stripe_width": 0, 2024-09-16T03:26:08.287 INFO:tasks.workunit.client.0.smithi096.stderr: "expected_num_objects": 0, 2024-09-16T03:26:08.287 INFO:tasks.workunit.client.0.smithi096.stderr: "fast_read": false, 2024-09-16T03:26:08.287 INFO:tasks.workunit.client.0.smithi096.stderr: "options": {}, 2024-09-16T03:26:08.287 INFO:tasks.workunit.client.0.smithi096.stderr: "application_metadata": {}, 2024-09-16T03:26:08.287 INFO:tasks.workunit.client.0.smithi096.stderr: "read_balance": { 2024-09-16T03:26:08.288 INFO:tasks.workunit.client.0.smithi096.stderr: "score_type": "Fair distribution", 2024-09-16T03:26:08.288 INFO:tasks.workunit.client.0.smithi096.stderr: "score_acting": 1.8700000047683716, 2024-09-16T03:26:08.288 INFO:tasks.workunit.client.0.smithi096.stderr: "score_stable": 1.8700000047683716, 2024-09-16T03:26:08.288 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_score": 0.67000001668930054, 2024-09-16T03:26:08.288 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_acting": 1.25, 2024-09-16T03:26:08.288 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_stable": 1.25, 2024-09-16T03:26:08.288 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity_weighted": 1, 2024-09-16T03:26:08.288 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity": 1, 2024-09-16T03:26:08.288 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity_weighted": 1 2024-09-16T03:26:08.288 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:08.288 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.288 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:08.288 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 2, 2024-09-16T03:26:08.288 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_name": "bar", 2024-09-16T03:26:08.289 INFO:tasks.workunit.client.0.smithi096.stderr: "create_time": "2024-09-16T03:24:46.226575+0000", 2024-09-16T03:26:08.289 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": 1, 2024-09-16T03:26:08.289 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_names": "hashpspool", 2024-09-16T03:26:08.289 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:26:08.289 INFO:tasks.workunit.client.0.smithi096.stderr: "size": 2, 2024-09-16T03:26:08.289 INFO:tasks.workunit.client.0.smithi096.stderr: "min_size": 1, 2024-09-16T03:26:08.289 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_rule": 0, 2024-09-16T03:26:08.289 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_count": 0, 2024-09-16T03:26:08.289 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_target": 0, 2024-09-16T03:26:08.289 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_barrier": 0, 2024-09-16T03:26:08.289 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-16T03:26:08.289 INFO:tasks.workunit.client.0.smithi096.stderr: "is_stretch_pool": false, 2024-09-16T03:26:08.289 INFO:tasks.workunit.client.0.smithi096.stderr: "object_hash": 2, 2024-09-16T03:26:08.289 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_autoscale_mode": "off", 2024-09-16T03:26:08.290 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num": 32, 2024-09-16T03:26:08.290 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num": 32, 2024-09-16T03:26:08.290 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num_target": 32, 2024-09-16T03:26:08.290 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_target": 32, 2024-09-16T03:26:08.290 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_pending": 32, 2024-09-16T03:26:08.290 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pg_merge_meta": { 2024-09-16T03:26:08.290 INFO:tasks.workunit.client.0.smithi096.stderr: "source_pgid": "0.0", 2024-09-16T03:26:08.290 INFO:tasks.workunit.client.0.smithi096.stderr: "ready_epoch": 0, 2024-09-16T03:26:08.290 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_started": 0, 2024-09-16T03:26:08.290 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": 0, 2024-09-16T03:26:08.290 INFO:tasks.workunit.client.0.smithi096.stderr: "source_version": "0'\''0", 2024-09-16T03:26:08.290 INFO:tasks.workunit.client.0.smithi096.stderr: "target_version": "0'\''0" 2024-09-16T03:26:08.290 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.290 INFO:tasks.workunit.client.0.smithi096.stderr: "last_change": "83", 2024-09-16T03:26:08.291 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend": "0", 2024-09-16T03:26:08.291 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_prenautilus": "0", 2024-09-16T03:26:08.291 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_preluminous": "0", 2024-09-16T03:26:08.291 INFO:tasks.workunit.client.0.smithi096.stderr: "auid": 0, 2024-09-16T03:26:08.291 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_mode": "selfmanaged", 2024-09-16T03:26:08.291 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_seq": 0, 2024-09-16T03:26:08.291 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_epoch": 0, 2024-09-16T03:26:08.291 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_snaps": [], 2024-09-16T03:26:08.291 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps": "[]", 2024-09-16T03:26:08.291 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_bytes": 0, 2024-09-16T03:26:08.291 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_objects": 0, 2024-09-16T03:26:08.291 INFO:tasks.workunit.client.0.smithi096.stderr: "tiers": [], 2024-09-16T03:26:08.291 INFO:tasks.workunit.client.0.smithi096.stderr: "tier_of": -1, 2024-09-16T03:26:08.292 INFO:tasks.workunit.client.0.smithi096.stderr: "read_tier": -1, 2024-09-16T03:26:08.292 INFO:tasks.workunit.client.0.smithi096.stderr: "write_tier": -1, 2024-09-16T03:26:08.292 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_mode": "none", 2024-09-16T03:26:08.292 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_bytes": 0, 2024-09-16T03:26:08.292 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_objects": 0, 2024-09-16T03:26:08.292 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_ratio_micro": 400000, 2024-09-16T03:26:08.292 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-16T03:26:08.292 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_full_ratio_micro": 800000, 2024-09-16T03:26:08.293 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_flush_age": 0, 2024-09-16T03:26:08.293 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_evict_age": 0, 2024-09-16T03:26:08.293 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profile": "", 2024-09-16T03:26:08.293 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_params": { 2024-09-16T03:26:08.293 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "none" 2024-09-16T03:26:08.293 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.293 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_period": 0, 2024-09-16T03:26:08.293 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_count": 0, 2024-09-16T03:26:08.293 INFO:tasks.workunit.client.0.smithi096.stderr: "use_gmt_hitset": true, 2024-09-16T03:26:08.293 INFO:tasks.workunit.client.0.smithi096.stderr: "min_read_recency_for_promote": 0, 2024-09-16T03:26:08.293 INFO:tasks.workunit.client.0.smithi096.stderr: "min_write_recency_for_promote": 0, 2024-09-16T03:26:08.293 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_grade_decay_rate": 0, 2024-09-16T03:26:08.294 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_search_last_n": 0, 2024-09-16T03:26:08.294 INFO:tasks.workunit.client.0.smithi096.stderr: "grade_table": [], 2024-09-16T03:26:08.294 INFO:tasks.workunit.client.0.smithi096.stderr: "stripe_width": 0, 2024-09-16T03:26:08.294 INFO:tasks.workunit.client.0.smithi096.stderr: "expected_num_objects": 0, 2024-09-16T03:26:08.294 INFO:tasks.workunit.client.0.smithi096.stderr: "fast_read": false, 2024-09-16T03:26:08.294 INFO:tasks.workunit.client.0.smithi096.stderr: "options": {}, 2024-09-16T03:26:08.294 INFO:tasks.workunit.client.0.smithi096.stderr: "application_metadata": {}, 2024-09-16T03:26:08.294 INFO:tasks.workunit.client.0.smithi096.stderr: "read_balance": { 2024-09-16T03:26:08.294 INFO:tasks.workunit.client.0.smithi096.stderr: "score_type": "Fair distribution", 2024-09-16T03:26:08.294 INFO:tasks.workunit.client.0.smithi096.stderr: "score_acting": 1.4900000095367432, 2024-09-16T03:26:08.294 INFO:tasks.workunit.client.0.smithi096.stderr: "score_stable": 1.4900000095367432, 2024-09-16T03:26:08.295 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_score": 0.67000001668930054, 2024-09-16T03:26:08.295 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_acting": 1, 2024-09-16T03:26:08.295 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_stable": 1, 2024-09-16T03:26:08.295 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity_weighted": 1, 2024-09-16T03:26:08.295 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity": 1, 2024-09-16T03:26:08.295 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity_weighted": 1 2024-09-16T03:26:08.295 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:08.295 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:08.295 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:08.295 INFO:tasks.workunit.client.0.smithi096.stderr: "osds": [ 2024-09-16T03:26:08.295 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:08.296 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:26:08.296 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6", 2024-09-16T03:26:08.296 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:26:08.296 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:26:08.296 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:26:08.296 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:26:08.296 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:26:08.296 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:26:08.297 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 5, 2024-09-16T03:26:08.297 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 84, 2024-09-16T03:26:08.297 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:26:08.297 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:26:08.297 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:26:08.297 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:08.297 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:08.297 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:08.297 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6802", 2024-09-16T03:26:08.297 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:26:08.297 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.298 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:08.298 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:08.298 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6803", 2024-09-16T03:26:08.298 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:26:08.298 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:08.298 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:08.298 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.298 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:26:08.298 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:08.299 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:08.299 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:08.299 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6804", 2024-09-16T03:26:08.299 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:26:08.299 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.299 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:08.299 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:08.299 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6805", 2024-09-16T03:26:08.299 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:26:08.299 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:08.300 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:08.300 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.300 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:26:08.300 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:08.300 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:08.300 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:08.300 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6808", 2024-09-16T03:26:08.300 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:26:08.300 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.300 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:08.301 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:08.301 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6809", 2024-09-16T03:26:08.301 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:26:08.301 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:08.301 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:08.301 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.301 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:26:08.301 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:08.302 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:08.302 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:08.302 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6806", 2024-09-16T03:26:08.302 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:26:08.302 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.302 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:08.302 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:08.302 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6807", 2024-09-16T03:26:08.302 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:26:08.302 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:08.302 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:08.302 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.302 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6803/3375787448", 2024-09-16T03:26:08.303 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6805/3375787448", 2024-09-16T03:26:08.303 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6809/3375787448", 2024-09-16T03:26:08.303 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6807/3375787448", 2024-09-16T03:26:08.303 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:26:08.303 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:26:08.303 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:26:08.303 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:08.303 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.303 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:08.303 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:26:08.303 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "74b26727-75c9-444d-8782-719e4197a382", 2024-09-16T03:26:08.303 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:26:08.303 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:26:08.303 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:26:08.304 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:26:08.304 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:26:08.304 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:26:08.304 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 10, 2024-09-16T03:26:08.304 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 84, 2024-09-16T03:26:08.304 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:26:08.304 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:26:08.304 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:26:08.304 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:08.304 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:08.304 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:08.305 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6810", 2024-09-16T03:26:08.305 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:26:08.305 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.305 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:08.305 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:08.305 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6811", 2024-09-16T03:26:08.305 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:26:08.305 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:08.305 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:08.305 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.305 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:26:08.305 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:08.305 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:08.305 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:08.306 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6812", 2024-09-16T03:26:08.306 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:26:08.306 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.306 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:08.306 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:08.306 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6813", 2024-09-16T03:26:08.307 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:26:08.307 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:08.307 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:08.307 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.307 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:26:08.307 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:08.307 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:08.307 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:08.308 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6816", 2024-09-16T03:26:08.308 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:26:08.308 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.308 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:08.308 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:08.308 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6817", 2024-09-16T03:26:08.308 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:26:08.308 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:08.308 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:08.308 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.308 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:26:08.308 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:08.309 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:08.309 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:08.309 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6814", 2024-09-16T03:26:08.309 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:26:08.309 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.309 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:08.309 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:08.309 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6815", 2024-09-16T03:26:08.309 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:26:08.309 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:08.309 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:08.309 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.309 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6811/3733255132", 2024-09-16T03:26:08.309 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6813/3733255132", 2024-09-16T03:26:08.310 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6817/3733255132", 2024-09-16T03:26:08.310 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6815/3733255132", 2024-09-16T03:26:08.310 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:26:08.310 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:26:08.310 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:26:08.310 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:08.310 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.310 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:08.310 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:26:08.310 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "143da3a7-dad9-4b1e-966b-76cf5bdd3c82", 2024-09-16T03:26:08.310 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 0, 2024-09-16T03:26:08.310 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 0, 2024-09-16T03:26:08.310 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 0, 2024-09-16T03:26:08.310 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:26:08.311 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:26:08.311 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:26:08.311 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 15, 2024-09-16T03:26:08.311 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 21, 2024-09-16T03:26:08.311 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 33, 2024-09-16T03:26:08.311 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:26:08.311 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:26:08.311 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:08.311 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:08.311 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:08.311 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6818", 2024-09-16T03:26:08.311 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:26:08.311 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.311 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:08.312 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:08.312 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6819", 2024-09-16T03:26:08.312 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:26:08.312 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:08.312 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:08.312 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.312 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:26:08.312 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:08.312 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:08.312 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:08.313 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6820", 2024-09-16T03:26:08.313 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:26:08.313 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.313 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:08.313 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:08.313 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6821", 2024-09-16T03:26:08.313 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:26:08.313 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:08.314 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:08.314 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.314 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:26:08.314 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:08.314 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:08.314 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:08.315 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6824", 2024-09-16T03:26:08.315 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:26:08.315 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.315 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:08.315 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:08.315 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6825", 2024-09-16T03:26:08.315 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:26:08.316 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:08.316 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:08.316 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.316 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:26:08.316 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:08.316 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:08.317 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:08.317 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6822", 2024-09-16T03:26:08.317 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:26:08.317 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.317 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:08.317 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:08.318 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6823", 2024-09-16T03:26:08.318 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:26:08.318 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:08.318 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:08.318 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.318 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6819/963814857", 2024-09-16T03:26:08.318 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6821/963814857", 2024-09-16T03:26:08.318 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6825/963814857", 2024-09-16T03:26:08.318 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6823/963814857", 2024-09-16T03:26:08.318 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:26:08.319 INFO:tasks.workunit.client.0.smithi096.stderr: "exists" 2024-09-16T03:26:08.319 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:08.319 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:08.319 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:08.319 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_xinfo": [ 2024-09-16T03:26:08.319 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:08.319 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:26:08.319 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:26:08.319 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:26:08.319 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:26:08.319 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:26:08.319 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:26:08.320 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:23:22.481942+0000", 2024-09-16T03:26:08.320 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:26:08.320 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.320 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:08.320 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:26:08.320 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:26:08.320 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:26:08.320 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:26:08.320 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:26:08.320 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:26:08.320 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:23:59.663703+0000", 2024-09-16T03:26:08.320 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:26:08.320 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.321 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:08.321 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:26:08.321 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:26:08.321 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:26:08.321 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:26:08.321 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:26:08.321 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 65536, 2024-09-16T03:26:08.321 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:24:37.320822+0000", 2024-09-16T03:26:08.321 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 32 2024-09-16T03:26:08.321 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:08.321 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:08.321 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap": [], 2024-09-16T03:26:08.321 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap_items": [], 2024-09-16T03:26:08.321 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap_primaries": [], 2024-09-16T03:26:08.322 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_temp": [], 2024-09-16T03:26:08.322 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_temp": [], 2024-09-16T03:26:08.322 INFO:tasks.workunit.client.0.smithi096.stderr: "blocklist": {}, 2024-09-16T03:26:08.322 INFO:tasks.workunit.client.0.smithi096.stderr: "range_blocklist": {}, 2024-09-16T03:26:08.322 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profiles": { 2024-09-16T03:26:08.322 INFO:tasks.workunit.client.0.smithi096.stderr: "default": { 2024-09-16T03:26:08.322 INFO:tasks.workunit.client.0.smithi096.stderr: "k": "2", 2024-09-16T03:26:08.322 INFO:tasks.workunit.client.0.smithi096.stderr: "m": "2", 2024-09-16T03:26:08.322 INFO:tasks.workunit.client.0.smithi096.stderr: "plugin": "jerasure", 2024-09-16T03:26:08.322 INFO:tasks.workunit.client.0.smithi096.stderr: "technique": "reed_sol_van" 2024-09-16T03:26:08.322 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:08.322 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.322 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps_queue": [], 2024-09-16T03:26:08.322 INFO:tasks.workunit.client.0.smithi096.stderr: "new_removed_snaps": [], 2024-09-16T03:26:08.323 INFO:tasks.workunit.client.0.smithi096.stderr: "new_purged_snaps": [], 2024-09-16T03:26:08.323 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_node_flags": {}, 2024-09-16T03:26:08.323 INFO:tasks.workunit.client.0.smithi096.stderr: "device_class_flags": {}, 2024-09-16T03:26:08.323 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode": { 2024-09-16T03:26:08.323 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode_enabled": false, 2024-09-16T03:26:08.323 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_bucket_count": 0, 2024-09-16T03:26:08.323 INFO:tasks.workunit.client.0.smithi096.stderr: "degraded_stretch_mode": 0, 2024-09-16T03:26:08.323 INFO:tasks.workunit.client.0.smithi096.stderr: "recovering_stretch_mode": 0, 2024-09-16T03:26:08.323 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode_bucket": 0 2024-09-16T03:26:08.323 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:08.323 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.323 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_metadata": [ 2024-09-16T03:26:08.323 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:08.323 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:26:08.324 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:26:08.324 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]", 2024-09-16T03:26:08.324 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:26:08.324 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:26:08.324 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:26:08.324 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:26:08.324 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:26:08.324 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:26:08.324 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:26:08.324 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:26:08.324 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:26:08.325 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:26:08.325 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:26:08.325 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/0/block", 2024-09-16T03:26:08.325 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:26:08.325 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:26:08.325 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:26:08.325 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:26:08.325 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:26:08.325 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:26:08.326 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:26:08.326 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:26:08.326 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:26:08.326 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:26:08.326 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:22:53.662571Z", 2024-09-16T03:26:08.326 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:26:08.326 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:26:08.326 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:26:08.326 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:26:08.326 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:26:08.326 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:26:08.326 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:26:08.326 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]", 2024-09-16T03:26:08.327 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:26:08.327 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]", 2024-09-16T03:26:08.327 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]", 2024-09-16T03:26:08.327 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:26:08.327 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:26:08.327 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:26:08.327 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:26:08.327 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:26:08.328 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:26:08.328 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:26:08.328 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:26:08.328 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:26:08.328 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/0", 2024-09-16T03:26:08.328 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:26:08.328 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:26:08.328 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:26:08.328 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.328 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:08.328 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:26:08.328 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:26:08.328 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]", 2024-09-16T03:26:08.329 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:26:08.329 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:26:08.329 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:26:08.329 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:26:08.329 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:26:08.329 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:26:08.329 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:26:08.329 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:26:08.329 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:26:08.329 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:26:08.329 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:26:08.329 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/1/block", 2024-09-16T03:26:08.329 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:26:08.330 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:26:08.330 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:26:08.330 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:26:08.330 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:26:08.330 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:26:08.330 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:26:08.330 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:26:08.330 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:26:08.330 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:26:08.330 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:23:30.129885Z", 2024-09-16T03:26:08.330 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:26:08.330 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:26:08.330 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:26:08.331 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:26:08.331 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:26:08.331 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:26:08.331 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:26:08.331 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]", 2024-09-16T03:26:08.331 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:26:08.331 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]", 2024-09-16T03:26:08.331 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]", 2024-09-16T03:26:08.331 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:26:08.332 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:26:08.332 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:26:08.332 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:26:08.332 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:26:08.332 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:26:08.332 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:26:08.333 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:26:08.333 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:26:08.333 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/1", 2024-09-16T03:26:08.333 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:26:08.333 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:26:08.333 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:26:08.334 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.334 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:08.334 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:26:08.334 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:26:08.334 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]", 2024-09-16T03:26:08.334 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:26:08.334 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:26:08.335 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:26:08.335 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:26:08.335 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:26:08.335 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:26:08.335 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:26:08.335 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:26:08.336 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:26:08.336 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:26:08.336 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:26:08.336 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/2/block", 2024-09-16T03:26:08.336 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:26:08.336 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:26:08.336 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:26:08.336 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:26:08.337 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:26:08.337 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:26:08.337 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:26:08.337 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:26:08.337 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:26:08.337 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:26:08.337 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:24:07.764502Z", 2024-09-16T03:26:08.337 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:26:08.337 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:26:08.337 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:26:08.337 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:26:08.337 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:26:08.337 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:26:08.337 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:26:08.338 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]", 2024-09-16T03:26:08.338 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:26:08.338 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]", 2024-09-16T03:26:08.338 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]", 2024-09-16T03:26:08.338 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:26:08.338 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:26:08.338 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:26:08.339 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:26:08.339 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:26:08.339 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:26:08.339 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:26:08.339 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:26:08.339 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:26:08.339 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/2", 2024-09-16T03:26:08.339 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:26:08.339 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:26:08.339 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:26:08.339 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:08.339 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:08.339 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_clean_epochs": { 2024-09-16T03:26:08.339 INFO:tasks.workunit.client.0.smithi096.stderr: "min_last_epoch_clean": 86, 2024-09-16T03:26:08.340 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": { 2024-09-16T03:26:08.340 INFO:tasks.workunit.client.0.smithi096.stderr: "per_pool": [ 2024-09-16T03:26:08.340 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:08.340 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 1, 2024-09-16T03:26:08.340 INFO:tasks.workunit.client.0.smithi096.stderr: "floor": 86 2024-09-16T03:26:08.340 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.340 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:08.340 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 2, 2024-09-16T03:26:08.340 INFO:tasks.workunit.client.0.smithi096.stderr: "floor": 86 2024-09-16T03:26:08.340 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:08.340 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:08.340 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.340 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_epochs": [ 2024-09-16T03:26:08.340 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:08.341 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:26:08.341 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 86 2024-09-16T03:26:08.341 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.341 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:08.341 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:26:08.341 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 86 2024-09-16T03:26:08.341 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:08.341 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:08.341 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.341 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_first_committed": 84, 2024-09-16T03:26:08.341 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_last_committed": 86, 2024-09-16T03:26:08.341 INFO:tasks.workunit.client.0.smithi096.stderr: "crushmap": { 2024-09-16T03:26:08.341 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": [ 2024-09-16T03:26:08.341 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:08.342 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:26:08.342 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.0", 2024-09-16T03:26:08.342 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:26:08.342 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.342 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:08.342 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:26:08.342 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.1", 2024-09-16T03:26:08.342 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:26:08.342 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.342 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:08.342 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:26:08.342 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.2", 2024-09-16T03:26:08.342 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:26:08.342 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:08.343 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:08.343 INFO:tasks.workunit.client.0.smithi096.stderr: "types": [ 2024-09-16T03:26:08.343 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:08.343 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 0, 2024-09-16T03:26:08.343 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd" 2024-09-16T03:26:08.343 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.343 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:08.343 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:26:08.343 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "host" 2024-09-16T03:26:08.343 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.343 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:08.343 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 2, 2024-09-16T03:26:08.343 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "chassis" 2024-09-16T03:26:08.343 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.344 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:08.344 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 3, 2024-09-16T03:26:08.344 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "rack" 2024-09-16T03:26:08.344 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.344 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:08.344 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 4, 2024-09-16T03:26:08.344 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "row" 2024-09-16T03:26:08.344 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.344 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:08.344 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 5, 2024-09-16T03:26:08.344 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "pdu" 2024-09-16T03:26:08.344 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.344 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:08.344 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 6, 2024-09-16T03:26:08.345 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "pod" 2024-09-16T03:26:08.345 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.345 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:08.345 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 7, 2024-09-16T03:26:08.345 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "room" 2024-09-16T03:26:08.345 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.345 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:08.345 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 8, 2024-09-16T03:26:08.345 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "datacenter" 2024-09-16T03:26:08.345 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.345 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:08.346 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 9, 2024-09-16T03:26:08.346 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "zone" 2024-09-16T03:26:08.346 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.346 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:08.346 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 10, 2024-09-16T03:26:08.346 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "region" 2024-09-16T03:26:08.346 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.346 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:08.346 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:26:08.347 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "root" 2024-09-16T03:26:08.347 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:08.347 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:08.347 INFO:tasks.workunit.client.0.smithi096.stderr: "buckets": [ 2024-09-16T03:26:08.347 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:08.347 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -1, 2024-09-16T03:26:08.347 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "default", 2024-09-16T03:26:08.347 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:26:08.347 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "root", 2024-09-16T03:26:08.347 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:26:08.347 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:26:08.348 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:26:08.348 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:26:08.348 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:08.348 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -3, 2024-09-16T03:26:08.348 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:26:08.348 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:26:08.348 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:08.348 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:08.348 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.348 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:08.348 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -2, 2024-09-16T03:26:08.349 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "default~hdd", 2024-09-16T03:26:08.349 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:26:08.349 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "root", 2024-09-16T03:26:08.349 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:26:08.349 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:26:08.349 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:26:08.349 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:26:08.349 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:08.349 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -4, 2024-09-16T03:26:08.350 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:26:08.350 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:26:08.350 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:08.350 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:08.350 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.350 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:08.350 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -3, 2024-09-16T03:26:08.350 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "smithi096", 2024-09-16T03:26:08.350 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:26:08.350 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "host", 2024-09-16T03:26:08.350 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:26:08.350 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:26:08.350 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:26:08.350 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:26:08.351 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:08.351 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:26:08.351 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:26:08.351 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:26:08.351 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.351 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:08.351 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:26:08.351 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:26:08.351 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 1 2024-09-16T03:26:08.351 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.351 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:08.352 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:26:08.352 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:26:08.352 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 2 2024-09-16T03:26:08.352 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:08.352 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:08.352 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.352 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:08.352 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -4, 2024-09-16T03:26:08.353 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "smithi096~hdd", 2024-09-16T03:26:08.353 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:26:08.353 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "host", 2024-09-16T03:26:08.353 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:26:08.353 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:26:08.353 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:26:08.353 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:26:08.353 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:08.353 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:26:08.353 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:26:08.353 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:26:08.353 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.354 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:08.354 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:26:08.354 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:26:08.354 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 1 2024-09-16T03:26:08.354 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.354 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:08.354 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:26:08.354 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:26:08.354 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 2 2024-09-16T03:26:08.354 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:08.354 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:08.354 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:08.354 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:08.355 INFO:tasks.workunit.client.0.smithi096.stderr: "rules": [ 2024-09-16T03:26:08.355 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:08.355 INFO:tasks.workunit.client.0.smithi096.stderr: "rule_id": 0, 2024-09-16T03:26:08.355 INFO:tasks.workunit.client.0.smithi096.stderr: "rule_name": "replicated_rule", 2024-09-16T03:26:08.355 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:26:08.355 INFO:tasks.workunit.client.0.smithi096.stderr: "steps": [ 2024-09-16T03:26:08.355 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:08.355 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "take", 2024-09-16T03:26:08.355 INFO:tasks.workunit.client.0.smithi096.stderr: "item": -1, 2024-09-16T03:26:08.355 INFO:tasks.workunit.client.0.smithi096.stderr: "item_name": "default" 2024-09-16T03:26:08.355 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.355 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:08.355 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "choose_firstn", 2024-09-16T03:26:08.355 INFO:tasks.workunit.client.0.smithi096.stderr: "num": 0, 2024-09-16T03:26:08.355 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "osd" 2024-09-16T03:26:08.356 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.356 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:08.356 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "emit" 2024-09-16T03:26:08.356 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:08.356 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:08.356 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:08.356 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:08.356 INFO:tasks.workunit.client.0.smithi096.stderr: "tunables": { 2024-09-16T03:26:08.356 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_local_tries": 0, 2024-09-16T03:26:08.356 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_local_fallback_tries": 0, 2024-09-16T03:26:08.356 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_total_tries": 50, 2024-09-16T03:26:08.356 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_descend_once": 1, 2024-09-16T03:26:08.357 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_vary_r": 1, 2024-09-16T03:26:08.357 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_stable": 1, 2024-09-16T03:26:08.357 INFO:tasks.workunit.client.0.smithi096.stderr: "msr_descents": 100, 2024-09-16T03:26:08.357 INFO:tasks.workunit.client.0.smithi096.stderr: "msr_collision_tries": 100, 2024-09-16T03:26:08.357 INFO:tasks.workunit.client.0.smithi096.stderr: "straw_calc_version": 1, 2024-09-16T03:26:08.357 INFO:tasks.workunit.client.0.smithi096.stderr: "allowed_bucket_algs": 54, 2024-09-16T03:26:08.357 INFO:tasks.workunit.client.0.smithi096.stderr: "profile": "jewel", 2024-09-16T03:26:08.357 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_tunables": 1, 2024-09-16T03:26:08.357 INFO:tasks.workunit.client.0.smithi096.stderr: "legacy_tunables": 0, 2024-09-16T03:26:08.357 INFO:tasks.workunit.client.0.smithi096.stderr: "minimum_required_version": "jewel", 2024-09-16T03:26:08.358 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables": 1, 2024-09-16T03:26:08.358 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables2": 1, 2024-09-16T03:26:08.358 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v2_rules": 0, 2024-09-16T03:26:08.358 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables3": 1, 2024-09-16T03:26:08.358 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v3_rules": 0, 2024-09-16T03:26:08.358 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v4_buckets": 1, 2024-09-16T03:26:08.358 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables5": 1, 2024-09-16T03:26:08.358 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v5_rules": 0, 2024-09-16T03:26:08.358 INFO:tasks.workunit.client.0.smithi096.stderr: "has_msr_rules": 0 2024-09-16T03:26:08.358 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.358 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_args": {} 2024-09-16T03:26:08.358 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.358 INFO:tasks.workunit.client.0.smithi096.stderr: "fsmap": { 2024-09-16T03:26:08.358 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 1, 2024-09-16T03:26:08.359 INFO:tasks.workunit.client.0.smithi096.stderr: "btime": "2024-09-16T03:22:46:882186+0000", 2024-09-16T03:26:08.359 INFO:tasks.workunit.client.0.smithi096.stderr: "default_fscid": -1, 2024-09-16T03:26:08.359 INFO:tasks.workunit.client.0.smithi096.stderr: "compat": { 2024-09-16T03:26:08.359 INFO:tasks.workunit.client.0.smithi096.stderr: "compat": {}, 2024-09-16T03:26:08.359 INFO:tasks.workunit.client.0.smithi096.stderr: "ro_compat": {}, 2024-09-16T03:26:08.359 INFO:tasks.workunit.client.0.smithi096.stderr: "incompat": { 2024-09-16T03:26:08.359 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_1": "base v0.20", 2024-09-16T03:26:08.359 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_2": "client writeable ranges", 2024-09-16T03:26:08.359 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_3": "default file layouts on dirs", 2024-09-16T03:26:08.360 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_4": "dir inode in separate object", 2024-09-16T03:26:08.360 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_5": "mds uses versioned encoding", 2024-09-16T03:26:08.360 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_6": "dirfrag is stored in omap", 2024-09-16T03:26:08.360 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_8": "no anchor table", 2024-09-16T03:26:08.360 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_9": "file layout v2", 2024-09-16T03:26:08.360 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_10": "snaprealm v2", 2024-09-16T03:26:08.360 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_11": "minor log segments", 2024-09-16T03:26:08.360 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_12": "quiesce subvolumes" 2024-09-16T03:26:08.360 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:08.360 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.360 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_flags": { 2024-09-16T03:26:08.360 INFO:tasks.workunit.client.0.smithi096.stderr: "enable_multiple": true, 2024-09-16T03:26:08.360 INFO:tasks.workunit.client.0.smithi096.stderr: "ever_enabled_multiple": true 2024-09-16T03:26:08.361 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.361 INFO:tasks.workunit.client.0.smithi096.stderr: "standbys": [], 2024-09-16T03:26:08.361 INFO:tasks.workunit.client.0.smithi096.stderr: "filesystems": [] 2024-09-16T03:26:08.361 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.361 INFO:tasks.workunit.client.0.smithi096.stderr: "mdsmap_first_committed": 1, 2024-09-16T03:26:08.361 INFO:tasks.workunit.client.0.smithi096.stderr: "mdsmap_last_committed": 1, 2024-09-16T03:26:08.361 INFO:tasks.workunit.client.0.smithi096.stderr: "auth": { 2024-09-16T03:26:08.361 INFO:tasks.workunit.client.0.smithi096.stderr: "first_committed": 1, 2024-09-16T03:26:08.361 INFO:tasks.workunit.client.0.smithi096.stderr: "last_committed": 5, 2024-09-16T03:26:08.361 INFO:tasks.workunit.client.0.smithi096.stderr: "num_secrets": 3 2024-09-16T03:26:08.361 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.361 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 64, 2024-09-16T03:26:08.361 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_active": 64, 2024-09-16T03:26:08.361 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_unknown": 0, 2024-09-16T03:26:08.362 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osd": 3, 2024-09-16T03:26:08.362 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_sum": { 2024-09-16T03:26:08.362 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:26:08.362 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:26:08.362 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:26:08.362 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:26:08.362 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:26:08.362 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:26:08.362 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:26:08.362 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:26:08.362 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:26:08.362 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:26:08.362 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:26:08.363 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:26:08.363 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:26:08.363 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:26:08.363 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:26:08.363 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:26:08.363 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:26:08.363 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:26:08.363 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:26:08.363 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:26:08.363 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:26:08.363 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:26:08.363 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:26:08.363 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:26:08.363 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:26:08.364 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:26:08.364 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:26:08.364 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:26:08.364 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:26:08.364 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:26:08.364 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:26:08.364 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:26:08.364 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:26:08.364 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:26:08.364 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:26:08.364 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:26:08.364 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:26:08.364 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:26:08.364 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:26:08.365 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:26:08.365 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:26:08.365 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.365 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:26:08.365 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:26:08.365 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:26:08.365 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:26:08.365 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:26:08.365 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:26:08.365 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:26:08.365 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:26:08.365 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:26:08.365 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:26:08.366 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:26:08.366 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.366 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:26:08.366 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:26:08.366 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 128, 2024-09-16T03:26:08.366 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 128, 2024-09-16T03:26:08.366 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 0 2024-09-16T03:26:08.366 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.366 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_sum": { 2024-09-16T03:26:08.366 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 0, 2024-09-16T03:26:08.366 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 0, 2024-09-16T03:26:08.366 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pgs": 128, 2024-09-16T03:26:08.366 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osds": 2, 2024-09-16T03:26:08.366 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_osds": 2, 2024-09-16T03:26:08.367 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_omap_osds": 2, 2024-09-16T03:26:08.367 INFO:tasks.workunit.client.0.smithi096.stderr: "kb": 209715200, 2024-09-16T03:26:08.367 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used": 54640, 2024-09-16T03:26:08.367 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_data": 960, 2024-09-16T03:26:08.367 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_omap": 3, 2024-09-16T03:26:08.367 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_meta": 53628, 2024-09-16T03:26:08.367 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_avail": 209660560, 2024-09-16T03:26:08.367 INFO:tasks.workunit.client.0.smithi096.stderr: "statfs": { 2024-09-16T03:26:08.367 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 214748364800, 2024-09-16T03:26:08.367 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 214692413440, 2024-09-16T03:26:08.367 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:26:08.368 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 983040, 2024-09-16T03:26:08.368 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 369948, 2024-09-16T03:26:08.368 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:26:08.368 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:26:08.368 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:26:08.368 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 3190, 2024-09-16T03:26:08.368 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 54915978 2024-09-16T03:26:08.368 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.368 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_peers": [], 2024-09-16T03:26:08.368 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_trim_queue_len": 0, 2024-09-16T03:26:08.369 INFO:tasks.workunit.client.0.smithi096.stderr: "num_snap_trimming": 0, 2024-09-16T03:26:08.369 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shards_repaired": 0, 2024-09-16T03:26:08.369 INFO:tasks.workunit.client.0.smithi096.stderr: "op_queue_age_hist": { 2024-09-16T03:26:08.369 INFO:tasks.workunit.client.0.smithi096.stderr: "histogram": [], 2024-09-16T03:26:08.369 INFO:tasks.workunit.client.0.smithi096.stderr: "upper_bound": 1 2024-09-16T03:26:08.369 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.369 INFO:tasks.workunit.client.0.smithi096.stderr: "perf_stat": { 2024-09-16T03:26:08.369 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ms": 325, 2024-09-16T03:26:08.369 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ms": 325, 2024-09-16T03:26:08.369 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ns": 325000000, 2024-09-16T03:26:08.369 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ns": 325000000 2024-09-16T03:26:08.370 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.370 INFO:tasks.workunit.client.0.smithi096.stderr: "alerts": [], 2024-09-16T03:26:08.370 INFO:tasks.workunit.client.0.smithi096.stderr: "network_ping_times": [] 2024-09-16T03:26:08.370 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.370 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_sum_by_class": { 2024-09-16T03:26:08.370 INFO:tasks.workunit.client.0.smithi096.stderr: "hdd": { 2024-09-16T03:26:08.370 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 0, 2024-09-16T03:26:08.370 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 0, 2024-09-16T03:26:08.370 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pgs": 128, 2024-09-16T03:26:08.370 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osds": 2, 2024-09-16T03:26:08.370 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_osds": 2, 2024-09-16T03:26:08.370 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_omap_osds": 2, 2024-09-16T03:26:08.370 INFO:tasks.workunit.client.0.smithi096.stderr: "kb": 209715200, 2024-09-16T03:26:08.371 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used": 54640, 2024-09-16T03:26:08.371 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_data": 960, 2024-09-16T03:26:08.371 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_omap": 3, 2024-09-16T03:26:08.371 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_meta": 53628, 2024-09-16T03:26:08.371 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_avail": 209660560, 2024-09-16T03:26:08.371 INFO:tasks.workunit.client.0.smithi096.stderr: "statfs": { 2024-09-16T03:26:08.371 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 214748364800, 2024-09-16T03:26:08.371 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 214692413440, 2024-09-16T03:26:08.371 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:26:08.371 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 983040, 2024-09-16T03:26:08.371 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 369948, 2024-09-16T03:26:08.371 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:26:08.371 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:26:08.371 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:26:08.371 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 3190, 2024-09-16T03:26:08.372 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 54915978 2024-09-16T03:26:08.372 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.372 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_peers": [], 2024-09-16T03:26:08.372 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_trim_queue_len": 0, 2024-09-16T03:26:08.372 INFO:tasks.workunit.client.0.smithi096.stderr: "num_snap_trimming": 0, 2024-09-16T03:26:08.372 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shards_repaired": 0, 2024-09-16T03:26:08.372 INFO:tasks.workunit.client.0.smithi096.stderr: "op_queue_age_hist": { 2024-09-16T03:26:08.372 INFO:tasks.workunit.client.0.smithi096.stderr: "histogram": [], 2024-09-16T03:26:08.372 INFO:tasks.workunit.client.0.smithi096.stderr: "upper_bound": 1 2024-09-16T03:26:08.372 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.373 INFO:tasks.workunit.client.0.smithi096.stderr: "perf_stat": { 2024-09-16T03:26:08.373 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ms": 325, 2024-09-16T03:26:08.373 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ms": 325, 2024-09-16T03:26:08.373 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ns": 325000000, 2024-09-16T03:26:08.373 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ns": 325000000 2024-09-16T03:26:08.373 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.373 INFO:tasks.workunit.client.0.smithi096.stderr: "alerts": [], 2024-09-16T03:26:08.373 INFO:tasks.workunit.client.0.smithi096.stderr: "network_ping_times": [] 2024-09-16T03:26:08.373 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:08.373 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.373 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_stats": [ 2024-09-16T03:26:08.373 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:08.373 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 2, 2024-09-16T03:26:08.373 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 32, 2024-09-16T03:26:08.374 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:26:08.374 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:26:08.374 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:26:08.374 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:26:08.374 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:26:08.374 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:26:08.374 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:26:08.374 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:26:08.374 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:26:08.374 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:26:08.374 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:26:08.374 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:26:08.374 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:26:08.374 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:26:08.375 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:26:08.375 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:26:08.375 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:26:08.375 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:26:08.375 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:26:08.375 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:26:08.375 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:26:08.375 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:26:08.375 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:26:08.375 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:26:08.375 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:26:08.375 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:26:08.375 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:26:08.376 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:26:08.376 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:26:08.376 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:26:08.376 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:26:08.376 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:26:08.376 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:26:08.376 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:26:08.376 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:26:08.376 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:26:08.376 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:26:08.376 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:26:08.376 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:26:08.377 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:26:08.377 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:26:08.377 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.377 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:26:08.377 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:26:08.377 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:26:08.377 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:26:08.377 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:26:08.377 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:26:08.377 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:26:08.377 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:26:08.377 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:26:08.377 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:26:08.377 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:26:08.378 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.378 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:26:08.378 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:26:08.378 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 64, 2024-09-16T03:26:08.378 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 64, 2024-09-16T03:26:08.378 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 3 2024-09-16T03:26:08.378 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.378 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:08.378 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 1, 2024-09-16T03:26:08.379 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 32, 2024-09-16T03:26:08.379 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:26:08.379 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:26:08.379 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:26:08.379 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:26:08.379 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:26:08.379 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:26:08.379 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:26:08.379 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:26:08.379 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:26:08.379 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:26:08.380 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:26:08.380 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:26:08.380 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:26:08.380 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:26:08.380 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:26:08.380 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:26:08.380 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:26:08.380 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:26:08.380 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:26:08.380 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:26:08.381 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:26:08.381 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:26:08.381 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:26:08.381 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:26:08.381 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:26:08.381 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:26:08.381 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:26:08.381 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:26:08.381 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:26:08.381 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:26:08.381 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:26:08.381 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:26:08.381 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:26:08.381 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:26:08.382 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:26:08.382 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:26:08.382 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:26:08.382 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:26:08.382 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:26:08.382 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:26:08.382 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:26:08.382 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.382 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:26:08.382 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:26:08.382 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:26:08.383 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:26:08.383 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:26:08.383 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:26:08.383 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:26:08.383 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:26:08.383 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:26:08.383 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:26:08.383 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:26:08.383 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.383 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:26:08.383 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:26:08.383 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 64, 2024-09-16T03:26:08.383 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 64, 2024-09-16T03:26:08.383 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 3 2024-09-16T03:26:08.384 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:08.384 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:08.384 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_stats": [ 2024-09-16T03:26:08.384 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:08.384 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:26:08.384 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 21474836521 2024-09-16T03:26:08.384 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.384 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:08.384 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:26:08.384 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 42949672993 2024-09-16T03:26:08.384 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.384 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:08.384 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:26:08.384 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 0 2024-09-16T03:26:08.385 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:08.385 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:08.385 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_by_state": [ 2024-09-16T03:26:08.385 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:08.385 INFO:tasks.workunit.client.0.smithi096.stderr: "state": "active+clean", 2024-09-16T03:26:08.385 INFO:tasks.workunit.client.0.smithi096.stderr: "num": 64 2024-09-16T03:26:08.385 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:08.385 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:08.385 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_by_osd": [ 2024-09-16T03:26:08.385 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:08.385 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:26:08.385 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 0, 2024-09-16T03:26:08.385 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 0, 2024-09-16T03:26:08.385 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:26:08.386 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.386 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:08.386 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:26:08.386 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 28, 2024-09-16T03:26:08.386 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 64, 2024-09-16T03:26:08.386 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:26:08.386 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.386 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:08.386 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:26:08.386 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 36, 2024-09-16T03:26:08.386 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 64, 2024-09-16T03:26:08.386 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:26:08.386 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:08.386 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:08.386 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": [ 2024-09-16T03:26:08.387 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:08.387 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 1, 2024-09-16T03:26:08.387 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": {} 2024-09-16T03:26:08.387 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.387 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:08.387 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 2, 2024-09-16T03:26:08.387 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": {} 2024-09-16T03:26:08.387 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:08.387 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:08.388 INFO:tasks.workunit.client.0.smithi096.stderr: "servicemap": { 2024-09-16T03:26:08.388 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 5, 2024-09-16T03:26:08.388 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:25:38.422788+0000", 2024-09-16T03:26:08.388 INFO:tasks.workunit.client.0.smithi096.stderr: "services": {} 2024-09-16T03:26:08.388 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:08.388 INFO:tasks.workunit.client.0.smithi096.stderr: "mgrstat_first_committed": 84, 2024-09-16T03:26:08.388 INFO:tasks.workunit.client.0.smithi096.stderr: "mgrstat_last_committed": 89, 2024-09-16T03:26:08.388 INFO:tasks.workunit.client.0.smithi096.stderr: "logm_first_committed": 1, 2024-09-16T03:26:08.388 INFO:tasks.workunit.client.0.smithi096.stderr: "logm_last_committed": 402, 2024-09-16T03:26:08.388 INFO:tasks.workunit.client.0.smithi096.stderr: "paxos": { 2024-09-16T03:26:08.388 INFO:tasks.workunit.client.0.smithi096.stderr: "first_committed": 1, 2024-09-16T03:26:08.388 INFO:tasks.workunit.client.0.smithi096.stderr: "last_committed": 594, 2024-09-16T03:26:08.389 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pn": 0, 2024-09-16T03:26:08.389 INFO:tasks.workunit.client.0.smithi096.stderr: "accepted_pn": 0 2024-09-16T03:26:08.389 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:08.389 INFO:tasks.workunit.client.0.smithi096.stderr:}' 2024-09-16T03:26:08.389 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:121: validate_fc: jq .osdmap_clean_epochs.min_last_epoch_clean 2024-09-16T03:26:08.393 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:121: validate_fc: echo '{' '"cluster_fingerprint":' '"fda2fc64-07ed-4add-8224-2e527e11d427",' '"version":' '"19.3.0-4930-gfc3e0bff",' '"commit":' '"fc3e0bff7468fd55478adbae7f75508b749124b6",' '"timestamp":' '"2024-09-16T03:26:08.248292+0000",' '"tag":' '"",' '"health":' '{' '"status":' '"HEALTH_OK",' '"checks":' '{},' '"mutes":' '[]' '},' '"monmap_first_committed":' 1, '"monmap_last_committed":' 1, '"monmap":' '{' '"epoch":' 1, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"modified":' '"2024-09-16T03:22:45.872880Z",' '"created":' '"2024-09-16T03:22:45.872880Z",' '"min_mon_release":' 19, '"min_mon_release_name":' '"squid",' '"election_strategy":' 1, '"disallowed_leaders:' '":' '"",' '"stretch_mode":' false, '"tiebreaker_mon":' '"",' '"removed_ranks:' '":' '"",' '"features":' '{' '"persistent":' '[' '"kraken",' '"luminous",' '"mimic",' '"osdmap-prune",' '"nautilus",' '"octopus",' '"pacific",' '"elector-pinging",' '"quincy",' '"reef",' '"squid"' '],' '"optional":' '[]' '},' '"mons":' '[' '{' '"rank":' 0, '"name":' '"a",' '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:7302",' '"nonce":' 0 '}' ']' '},' '"addr":' '"127.0.0.1:7302/0",' '"public_addr":' '"127.0.0.1:7302/0",' '"priority":' 0, '"weight":' 0, '"crush_location":' '"{}"' '}' ']' '},' '"quorum":' '[' 0 '],' '"osdmap":' '{' '"epoch":' 86, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"created":' '"2024-09-16T03:22:46.906117+0000",' '"modified":' '"2024-09-16T03:26:02.230083+0000",' '"last_up_change":' '"2024-09-16T03:25:08.513363+0000",' '"last_in_change":' '"2024-09-16T03:25:09.839444+0000",' '"flags":' '"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit",' '"flags_num":' 5799936, '"flags_set":' '[' '"pglog_hardlimit",' '"purged_snapdirs",' '"recovery_deletes",' '"sortbitwise"' '],' '"crush_version":' 7, '"full_ratio":' 0.97000002861022949, '"backfillfull_ratio":' 0.97000002861022949, '"nearfull_ratio":' 0.85000002384185791, '"cluster_snapshot":' '"",' '"pool_max":' 2, '"max_osd":' 3, '"require_min_compat_client":' '"luminous",' '"min_compat_client":' '"jewel",' '"require_osd_release":' '"squid",' '"allow_crimson":' false, '"pools":' '[' '{' '"pool":' 1, '"pool_name":' '"foo",' '"create_time":' '"2024-09-16T03:24:44.525189+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 2, '"min_size":' 1, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"85",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.8700000047683716, '"score_stable":' 1.8700000047683716, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1.25, '"raw_score_stable":' 1.25, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '},' '{' '"pool":' 2, '"pool_name":' '"bar",' '"create_time":' '"2024-09-16T03:24:46.226575+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 2, '"min_size":' 1, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"83",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.4900000095367432, '"score_stable":' 1.4900000095367432, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1, '"raw_score_stable":' 1, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '}' '],' '"osds":' '[' '{' '"osd":' 0, '"uuid":' '"64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 5, '"up_thru":' 84, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6802",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6803",' '"nonce":' 3375787448 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6804",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6805",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6808",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6809",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6806",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6807",' '"nonce":' 3375787448 '}' ']' '},' '"public_addr":' '"127.0.0.1:6803/3375787448",' '"cluster_addr":' '"127.0.0.1:6805/3375787448",' '"heartbeat_back_addr":' '"127.0.0.1:6809/3375787448",' '"heartbeat_front_addr":' '"127.0.0.1:6807/3375787448",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 1, '"uuid":' '"74b26727-75c9-444d-8782-719e4197a382",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 10, '"up_thru":' 84, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6810",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6811",' '"nonce":' 3733255132 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6812",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6813",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6816",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6817",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6814",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6815",' '"nonce":' 3733255132 '}' ']' '},' '"public_addr":' '"127.0.0.1:6811/3733255132",' '"cluster_addr":' '"127.0.0.1:6813/3733255132",' '"heartbeat_back_addr":' '"127.0.0.1:6817/3733255132",' '"heartbeat_front_addr":' '"127.0.0.1:6815/3733255132",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 2, '"uuid":' '"143da3a7-dad9-4b1e-966b-76cf5bdd3c82",' '"up":' 0, '"in":' 0, '"weight":' 0, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 15, '"up_thru":' 21, '"down_at":' 33, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6818",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6819",' '"nonce":' 963814857 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6820",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6821",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6824",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6825",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6822",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6823",' '"nonce":' 963814857 '}' ']' '},' '"public_addr":' '"127.0.0.1:6819/963814857",' '"cluster_addr":' '"127.0.0.1:6821/963814857",' '"heartbeat_back_addr":' '"127.0.0.1:6825/963814857",' '"heartbeat_front_addr":' '"127.0.0.1:6823/963814857",' '"state":' '[' '"exists"' ']' '}' '],' '"osd_xinfo":' '[' '{' '"osd":' 0, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:22.481942+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 1, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:59.663703+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 2, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 65536, '"last_purged_snaps_scrub":' '"2024-09-16T03:24:37.320822+0000",' '"dead_epoch":' 32 '}' '],' '"pg_upmap":' '[],' '"pg_upmap_items":' '[],' '"pg_upmap_primaries":' '[],' '"pg_temp":' '[],' '"primary_temp":' '[],' '"blocklist":' '{},' '"range_blocklist":' '{},' '"erasure_code_profiles":' '{' '"default":' '{' '"k":' '"2",' '"m":' '"2",' '"plugin":' '"jerasure",' '"technique":' '"reed_sol_van"' '}' '},' '"removed_snaps_queue":' '[],' '"new_removed_snaps":' '[],' '"new_purged_snaps":' '[],' '"crush_node_flags":' '{},' '"device_class_flags":' '{},' '"stretch_mode":' '{' '"stretch_mode_enabled":' false, '"stretch_bucket_count":' 0, '"degraded_stretch_mode":' 0, '"recovering_stretch_mode":' 0, '"stretch_mode_bucket":' 0 '}' '},' '"osd_metadata":' '[' '{' '"id":' 0, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/0/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:22:53.662571Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]",' '"hb_front_addr":' '"[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/0",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 1, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/1/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:23:30.129885Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]",' '"hb_front_addr":' '"[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/1",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 2, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/2/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:24:07.764502Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]",' '"hb_front_addr":' '"[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/2",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '}' '],' '"osdmap_clean_epochs":' '{' '"min_last_epoch_clean":' 86, '"last_epoch_clean":' '{' '"per_pool":' '[' '{' '"poolid":' 1, '"floor":' 86 '},' '{' '"poolid":' 2, '"floor":' 86 '}' ']' '},' '"osd_epochs":' '[' '{' '"id":' 0, '"epoch":' 86 '},' '{' '"id":' 1, '"epoch":' 86 '}' ']' '},' '"osdmap_first_committed":' 84, '"osdmap_last_committed":' 86, '"crushmap":' '{' '"devices":' '[' '{' '"id":' 0, '"name":' '"osd.0",' '"class":' '"hdd"' '},' '{' '"id":' 1, '"name":' '"osd.1",' '"class":' '"hdd"' '},' '{' '"id":' 2, '"name":' '"osd.2",' '"class":' '"hdd"' '}' '],' '"types":' '[' '{' '"type_id":' 0, '"name":' '"osd"' '},' '{' '"type_id":' 1, '"name":' '"host"' '},' '{' '"type_id":' 2, '"name":' '"chassis"' '},' '{' '"type_id":' 3, '"name":' '"rack"' '},' '{' '"type_id":' 4, '"name":' '"row"' '},' '{' '"type_id":' 5, '"name":' '"pdu"' '},' '{' '"type_id":' 6, '"name":' '"pod"' '},' '{' '"type_id":' 7, '"name":' '"room"' '},' '{' '"type_id":' 8, '"name":' '"datacenter"' '},' '{' '"type_id":' 9, '"name":' '"zone"' '},' '{' '"type_id":' 10, '"name":' '"region"' '},' '{' '"type_id":' 11, '"name":' '"root"' '}' '],' '"buckets":' '[' '{' '"id":' -1, '"name":' '"default",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -3, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -2, '"name":' '"default~hdd",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -4, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -3, '"name":' '"smithi096",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '},' '{' '"id":' -4, '"name":' '"smithi096~hdd",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '}' '],' '"rules":' '[' '{' '"rule_id":' 0, '"rule_name":' '"replicated_rule",' '"type":' 1, '"steps":' '[' '{' '"op":' '"take",' '"item":' -1, '"item_name":' '"default"' '},' '{' '"op":' '"choose_firstn",' '"num":' 0, '"type":' '"osd"' '},' '{' '"op":' '"emit"' '}' ']' '}' '],' '"tunables":' '{' '"choose_local_tries":' 0, '"choose_local_fallback_tries":' 0, '"choose_total_tries":' 50, '"chooseleaf_descend_once":' 1, '"chooseleaf_vary_r":' 1, '"chooseleaf_stable":' 1, '"msr_descents":' 100, '"msr_collision_tries":' 100, '"straw_calc_version":' 1, '"allowed_bucket_algs":' 54, '"profile":' '"jewel",' '"optimal_tunables":' 1, '"legacy_tunables":' 0, '"minimum_required_version":' '"jewel",' '"require_feature_tunables":' 1, '"require_feature_tunables2":' 1, '"has_v2_rules":' 0, '"require_feature_tunables3":' 1, '"has_v3_rules":' 0, '"has_v4_buckets":' 1, '"require_feature_tunables5":' 1, '"has_v5_rules":' 0, '"has_msr_rules":' 0 '},' '"choose_args":' '{}' '},' '"fsmap":' '{' '"epoch":' 1, '"btime":' '"2024-09-16T03:22:46:882186+0000",' '"default_fscid":' -1, '"compat":' '{' '"compat":' '{},' '"ro_compat":' '{},' '"incompat":' '{' '"feature_1":' '"base' 'v0.20",' '"feature_2":' '"client' writeable 'ranges",' '"feature_3":' '"default' file layouts on 'dirs",' '"feature_4":' '"dir' inode in separate 'object",' '"feature_5":' '"mds' uses versioned 'encoding",' '"feature_6":' '"dirfrag' is stored in 'omap",' '"feature_8":' '"no' anchor 'table",' '"feature_9":' '"file' layout 'v2",' '"feature_10":' '"snaprealm' 'v2",' '"feature_11":' '"minor' log 'segments",' '"feature_12":' '"quiesce' 'subvolumes"' '}' '},' '"feature_flags":' '{' '"enable_multiple":' true, '"ever_enabled_multiple":' true '},' '"standbys":' '[],' '"filesystems":' '[]' '},' '"mdsmap_first_committed":' 1, '"mdsmap_last_committed":' 1, '"auth":' '{' '"first_committed":' 1, '"last_committed":' 5, '"num_secrets":' 3 '},' '"num_pg":' 64, '"num_pg_active":' 64, '"num_pg_unknown":' 0, '"num_osd":' 3, '"pool_sum":' '{' '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 128, '"acting":' 128, '"num_store_stats":' 0 '},' '"osd_sum":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54640, '"kb_used_data":' 960, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660560, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692413440, '"internally_reserved":' 0, '"allocated":' 983040, '"data_stored":' 369948, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 325, '"apply_latency_ms":' 325, '"commit_latency_ns":' 325000000, '"apply_latency_ns":' 325000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '},' '"osd_sum_by_class":' '{' '"hdd":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54640, '"kb_used_data":' 960, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660560, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692413440, '"internally_reserved":' 0, '"allocated":' 983040, '"data_stored":' 369948, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 325, '"apply_latency_ms":' 325, '"commit_latency_ns":' 325000000, '"apply_latency_ns":' 325000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '}' '},' '"pool_stats":' '[' '{' '"poolid":' 2, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '},' '{' '"poolid":' 1, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '}' '],' '"osd_stats":' '[' '{' '"osd":' 0, '"seq":' 21474836521 '},' '{' '"osd":' 1, '"seq":' 42949672993 '},' '{' '"osd":' 2, '"seq":' 0 '}' '],' '"num_pg_by_state":' '[' '{' '"state":' '"active+clean",' '"num":' 64 '}' '],' '"num_pg_by_osd":' '[' '{' '"osd":' 2, '"num_primary_pg":' 0, '"num_acting_pg":' 0, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 0, '"num_primary_pg":' 28, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 1, '"num_primary_pg":' 36, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '}' '],' '"purged_snaps":' '[' '{' '"pool":' 1, '"purged_snaps":' '{}' '},' '{' '"pool":' 2, '"purged_snaps":' '{}' '}' '],' '"servicemap":' '{' '"epoch":' 5, '"modified":' '"2024-09-16T03:25:38.422788+0000",' '"services":' '{}' '},' '"mgrstat_first_committed":' 84, '"mgrstat_last_committed":' 89, '"logm_first_committed":' 1, '"logm_last_committed":' 402, '"paxos":' '{' '"first_committed":' 1, '"last_committed":' 594, '"last_pn":' 0, '"accepted_pn":' 0 '}' '}' 2024-09-16T03:26:08.393 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:121: validate_fc: lec=86 2024-09-16T03:26:08.393 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:123: validate_fc: jq .osdmap_first_committed 2024-09-16T03:26:08.394 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:123: validate_fc: echo '{' '"cluster_fingerprint":' '"fda2fc64-07ed-4add-8224-2e527e11d427",' '"version":' '"19.3.0-4930-gfc3e0bff",' '"commit":' '"fc3e0bff7468fd55478adbae7f75508b749124b6",' '"timestamp":' '"2024-09-16T03:26:08.248292+0000",' '"tag":' '"",' '"health":' '{' '"status":' '"HEALTH_OK",' '"checks":' '{},' '"mutes":' '[]' '},' '"monmap_first_committed":' 1, '"monmap_last_committed":' 1, '"monmap":' '{' '"epoch":' 1, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"modified":' '"2024-09-16T03:22:45.872880Z",' '"created":' '"2024-09-16T03:22:45.872880Z",' '"min_mon_release":' 19, '"min_mon_release_name":' '"squid",' '"election_strategy":' 1, '"disallowed_leaders:' '":' '"",' '"stretch_mode":' false, '"tiebreaker_mon":' '"",' '"removed_ranks:' '":' '"",' '"features":' '{' '"persistent":' '[' '"kraken",' '"luminous",' '"mimic",' '"osdmap-prune",' '"nautilus",' '"octopus",' '"pacific",' '"elector-pinging",' '"quincy",' '"reef",' '"squid"' '],' '"optional":' '[]' '},' '"mons":' '[' '{' '"rank":' 0, '"name":' '"a",' '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:7302",' '"nonce":' 0 '}' ']' '},' '"addr":' '"127.0.0.1:7302/0",' '"public_addr":' '"127.0.0.1:7302/0",' '"priority":' 0, '"weight":' 0, '"crush_location":' '"{}"' '}' ']' '},' '"quorum":' '[' 0 '],' '"osdmap":' '{' '"epoch":' 86, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"created":' '"2024-09-16T03:22:46.906117+0000",' '"modified":' '"2024-09-16T03:26:02.230083+0000",' '"last_up_change":' '"2024-09-16T03:25:08.513363+0000",' '"last_in_change":' '"2024-09-16T03:25:09.839444+0000",' '"flags":' '"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit",' '"flags_num":' 5799936, '"flags_set":' '[' '"pglog_hardlimit",' '"purged_snapdirs",' '"recovery_deletes",' '"sortbitwise"' '],' '"crush_version":' 7, '"full_ratio":' 0.97000002861022949, '"backfillfull_ratio":' 0.97000002861022949, '"nearfull_ratio":' 0.85000002384185791, '"cluster_snapshot":' '"",' '"pool_max":' 2, '"max_osd":' 3, '"require_min_compat_client":' '"luminous",' '"min_compat_client":' '"jewel",' '"require_osd_release":' '"squid",' '"allow_crimson":' false, '"pools":' '[' '{' '"pool":' 1, '"pool_name":' '"foo",' '"create_time":' '"2024-09-16T03:24:44.525189+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 2, '"min_size":' 1, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"85",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.8700000047683716, '"score_stable":' 1.8700000047683716, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1.25, '"raw_score_stable":' 1.25, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '},' '{' '"pool":' 2, '"pool_name":' '"bar",' '"create_time":' '"2024-09-16T03:24:46.226575+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 2, '"min_size":' 1, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"83",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.4900000095367432, '"score_stable":' 1.4900000095367432, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1, '"raw_score_stable":' 1, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '}' '],' '"osds":' '[' '{' '"osd":' 0, '"uuid":' '"64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 5, '"up_thru":' 84, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6802",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6803",' '"nonce":' 3375787448 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6804",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6805",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6808",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6809",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6806",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6807",' '"nonce":' 3375787448 '}' ']' '},' '"public_addr":' '"127.0.0.1:6803/3375787448",' '"cluster_addr":' '"127.0.0.1:6805/3375787448",' '"heartbeat_back_addr":' '"127.0.0.1:6809/3375787448",' '"heartbeat_front_addr":' '"127.0.0.1:6807/3375787448",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 1, '"uuid":' '"74b26727-75c9-444d-8782-719e4197a382",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 10, '"up_thru":' 84, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6810",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6811",' '"nonce":' 3733255132 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6812",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6813",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6816",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6817",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6814",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6815",' '"nonce":' 3733255132 '}' ']' '},' '"public_addr":' '"127.0.0.1:6811/3733255132",' '"cluster_addr":' '"127.0.0.1:6813/3733255132",' '"heartbeat_back_addr":' '"127.0.0.1:6817/3733255132",' '"heartbeat_front_addr":' '"127.0.0.1:6815/3733255132",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 2, '"uuid":' '"143da3a7-dad9-4b1e-966b-76cf5bdd3c82",' '"up":' 0, '"in":' 0, '"weight":' 0, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 15, '"up_thru":' 21, '"down_at":' 33, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6818",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6819",' '"nonce":' 963814857 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6820",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6821",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6824",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6825",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6822",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6823",' '"nonce":' 963814857 '}' ']' '},' '"public_addr":' '"127.0.0.1:6819/963814857",' '"cluster_addr":' '"127.0.0.1:6821/963814857",' '"heartbeat_back_addr":' '"127.0.0.1:6825/963814857",' '"heartbeat_front_addr":' '"127.0.0.1:6823/963814857",' '"state":' '[' '"exists"' ']' '}' '],' '"osd_xinfo":' '[' '{' '"osd":' 0, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:22.481942+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 1, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:59.663703+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 2, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 65536, '"last_purged_snaps_scrub":' '"2024-09-16T03:24:37.320822+0000",' '"dead_epoch":' 32 '}' '],' '"pg_upmap":' '[],' '"pg_upmap_items":' '[],' '"pg_upmap_primaries":' '[],' '"pg_temp":' '[],' '"primary_temp":' '[],' '"blocklist":' '{},' '"range_blocklist":' '{},' '"erasure_code_profiles":' '{' '"default":' '{' '"k":' '"2",' '"m":' '"2",' '"plugin":' '"jerasure",' '"technique":' '"reed_sol_van"' '}' '},' '"removed_snaps_queue":' '[],' '"new_removed_snaps":' '[],' '"new_purged_snaps":' '[],' '"crush_node_flags":' '{},' '"device_class_flags":' '{},' '"stretch_mode":' '{' '"stretch_mode_enabled":' false, '"stretch_bucket_count":' 0, '"degraded_stretch_mode":' 0, '"recovering_stretch_mode":' 0, '"stretch_mode_bucket":' 0 '}' '},' '"osd_metadata":' '[' '{' '"id":' 0, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/0/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:22:53.662571Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]",' '"hb_front_addr":' '"[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/0",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 1, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/1/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:23:30.129885Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]",' '"hb_front_addr":' '"[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/1",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 2, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/2/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:24:07.764502Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]",' '"hb_front_addr":' '"[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/2",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '}' '],' '"osdmap_clean_epochs":' '{' '"min_last_epoch_clean":' 86, '"last_epoch_clean":' '{' '"per_pool":' '[' '{' '"poolid":' 1, '"floor":' 86 '},' '{' '"poolid":' 2, '"floor":' 86 '}' ']' '},' '"osd_epochs":' '[' '{' '"id":' 0, '"epoch":' 86 '},' '{' '"id":' 1, '"epoch":' 86 '}' ']' '},' '"osdmap_first_committed":' 84, '"osdmap_last_committed":' 86, '"crushmap":' '{' '"devices":' '[' '{' '"id":' 0, '"name":' '"osd.0",' '"class":' '"hdd"' '},' '{' '"id":' 1, '"name":' '"osd.1",' '"class":' '"hdd"' '},' '{' '"id":' 2, '"name":' '"osd.2",' '"class":' '"hdd"' '}' '],' '"types":' '[' '{' '"type_id":' 0, '"name":' '"osd"' '},' '{' '"type_id":' 1, '"name":' '"host"' '},' '{' '"type_id":' 2, '"name":' '"chassis"' '},' '{' '"type_id":' 3, '"name":' '"rack"' '},' '{' '"type_id":' 4, '"name":' '"row"' '},' '{' '"type_id":' 5, '"name":' '"pdu"' '},' '{' '"type_id":' 6, '"name":' '"pod"' '},' '{' '"type_id":' 7, '"name":' '"room"' '},' '{' '"type_id":' 8, '"name":' '"datacenter"' '},' '{' '"type_id":' 9, '"name":' '"zone"' '},' '{' '"type_id":' 10, '"name":' '"region"' '},' '{' '"type_id":' 11, '"name":' '"root"' '}' '],' '"buckets":' '[' '{' '"id":' -1, '"name":' '"default",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -3, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -2, '"name":' '"default~hdd",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -4, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -3, '"name":' '"smithi096",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '},' '{' '"id":' -4, '"name":' '"smithi096~hdd",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '}' '],' '"rules":' '[' '{' '"rule_id":' 0, '"rule_name":' '"replicated_rule",' '"type":' 1, '"steps":' '[' '{' '"op":' '"take",' '"item":' -1, '"item_name":' '"default"' '},' '{' '"op":' '"choose_firstn",' '"num":' 0, '"type":' '"osd"' '},' '{' '"op":' '"emit"' '}' ']' '}' '],' '"tunables":' '{' '"choose_local_tries":' 0, '"choose_local_fallback_tries":' 0, '"choose_total_tries":' 50, '"chooseleaf_descend_once":' 1, '"chooseleaf_vary_r":' 1, '"chooseleaf_stable":' 1, '"msr_descents":' 100, '"msr_collision_tries":' 100, '"straw_calc_version":' 1, '"allowed_bucket_algs":' 54, '"profile":' '"jewel",' '"optimal_tunables":' 1, '"legacy_tunables":' 0, '"minimum_required_version":' '"jewel",' '"require_feature_tunables":' 1, '"require_feature_tunables2":' 1, '"has_v2_rules":' 0, '"require_feature_tunables3":' 1, '"has_v3_rules":' 0, '"has_v4_buckets":' 1, '"require_feature_tunables5":' 1, '"has_v5_rules":' 0, '"has_msr_rules":' 0 '},' '"choose_args":' '{}' '},' '"fsmap":' '{' '"epoch":' 1, '"btime":' '"2024-09-16T03:22:46:882186+0000",' '"default_fscid":' -1, '"compat":' '{' '"compat":' '{},' '"ro_compat":' '{},' '"incompat":' '{' '"feature_1":' '"base' 'v0.20",' '"feature_2":' '"client' writeable 'ranges",' '"feature_3":' '"default' file layouts on 'dirs",' '"feature_4":' '"dir' inode in separate 'object",' '"feature_5":' '"mds' uses versioned 'encoding",' '"feature_6":' '"dirfrag' is stored in 'omap",' '"feature_8":' '"no' anchor 'table",' '"feature_9":' '"file' layout 'v2",' '"feature_10":' '"snaprealm' 'v2",' '"feature_11":' '"minor' log 'segments",' '"feature_12":' '"quiesce' 'subvolumes"' '}' '},' '"feature_flags":' '{' '"enable_multiple":' true, '"ever_enabled_multiple":' true '},' '"standbys":' '[],' '"filesystems":' '[]' '},' '"mdsmap_first_committed":' 1, '"mdsmap_last_committed":' 1, '"auth":' '{' '"first_committed":' 1, '"last_committed":' 5, '"num_secrets":' 3 '},' '"num_pg":' 64, '"num_pg_active":' 64, '"num_pg_unknown":' 0, '"num_osd":' 3, '"pool_sum":' '{' '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 128, '"acting":' 128, '"num_store_stats":' 0 '},' '"osd_sum":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54640, '"kb_used_data":' 960, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660560, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692413440, '"internally_reserved":' 0, '"allocated":' 983040, '"data_stored":' 369948, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 325, '"apply_latency_ms":' 325, '"commit_latency_ns":' 325000000, '"apply_latency_ns":' 325000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '},' '"osd_sum_by_class":' '{' '"hdd":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54640, '"kb_used_data":' 960, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660560, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692413440, '"internally_reserved":' 0, '"allocated":' 983040, '"data_stored":' 369948, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 325, '"apply_latency_ms":' 325, '"commit_latency_ns":' 325000000, '"apply_latency_ns":' 325000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '}' '},' '"pool_stats":' '[' '{' '"poolid":' 2, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '},' '{' '"poolid":' 1, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '}' '],' '"osd_stats":' '[' '{' '"osd":' 0, '"seq":' 21474836521 '},' '{' '"osd":' 1, '"seq":' 42949672993 '},' '{' '"osd":' 2, '"seq":' 0 '}' '],' '"num_pg_by_state":' '[' '{' '"state":' '"active+clean",' '"num":' 64 '}' '],' '"num_pg_by_osd":' '[' '{' '"osd":' 2, '"num_primary_pg":' 0, '"num_acting_pg":' 0, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 0, '"num_primary_pg":' 28, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 1, '"num_primary_pg":' 36, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '}' '],' '"purged_snaps":' '[' '{' '"pool":' 1, '"purged_snaps":' '{}' '},' '{' '"pool":' 2, '"purged_snaps":' '{}' '}' '],' '"servicemap":' '{' '"epoch":' 5, '"modified":' '"2024-09-16T03:25:38.422788+0000",' '"services":' '{}' '},' '"mgrstat_first_committed":' 84, '"mgrstat_last_committed":' 89, '"logm_first_committed":' 1, '"logm_last_committed":' 402, '"paxos":' '{' '"first_committed":' 1, '"last_committed":' 594, '"last_pn":' 0, '"accepted_pn":' 0 '}' '}' 2024-09-16T03:26:08.394 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:123: validate_fc: osdm_fc=84 2024-09-16T03:26:08.394 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:125: validate_fc: [[ 86 -eq 84 ]] 2024-09-16T03:26:08.394 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:125: validate_fc: echo '{' '"cluster_fingerprint":' '"fda2fc64-07ed-4add-8224-2e527e11d427",' '"version":' '"19.3.0-4930-gfc3e0bff",' '"commit":' '"fc3e0bff7468fd55478adbae7f75508b749124b6",' '"timestamp":' '"2024-09-16T03:26:08.248292+0000",' '"tag":' '"",' '"health":' '{' '"status":' '"HEALTH_OK",' '"checks":' '{},' '"mutes":' '[]' '},' '"monmap_first_committed":' 1, '"monmap_last_committed":' 1, '"monmap":' '{' '"epoch":' 1, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"modified":' '"2024-09-16T03:22:45.872880Z",' '"created":' '"2024-09-16T03:22:45.872880Z",' '"min_mon_release":' 19, '"min_mon_release_name":' '"squid",' '"election_strategy":' 1, '"disallowed_leaders:' '":' '"",' '"stretch_mode":' false, '"tiebreaker_mon":' '"",' '"removed_ranks:' '":' '"",' '"features":' '{' '"persistent":' '[' '"kraken",' '"luminous",' '"mimic",' '"osdmap-prune",' '"nautilus",' '"octopus",' '"pacific",' '"elector-pinging",' '"quincy",' '"reef",' '"squid"' '],' '"optional":' '[]' '},' '"mons":' '[' '{' '"rank":' 0, '"name":' '"a",' '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:7302",' '"nonce":' 0 '}' ']' '},' '"addr":' '"127.0.0.1:7302/0",' '"public_addr":' '"127.0.0.1:7302/0",' '"priority":' 0, '"weight":' 0, '"crush_location":' '"{}"' '}' ']' '},' '"quorum":' '[' 0 '],' '"osdmap":' '{' '"epoch":' 86, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"created":' '"2024-09-16T03:22:46.906117+0000",' '"modified":' '"2024-09-16T03:26:02.230083+0000",' '"last_up_change":' '"2024-09-16T03:25:08.513363+0000",' '"last_in_change":' '"2024-09-16T03:25:09.839444+0000",' '"flags":' '"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit",' '"flags_num":' 5799936, '"flags_set":' '[' '"pglog_hardlimit",' '"purged_snapdirs",' '"recovery_deletes",' '"sortbitwise"' '],' '"crush_version":' 7, '"full_ratio":' 0.97000002861022949, '"backfillfull_ratio":' 0.97000002861022949, '"nearfull_ratio":' 0.85000002384185791, '"cluster_snapshot":' '"",' '"pool_max":' 2, '"max_osd":' 3, '"require_min_compat_client":' '"luminous",' '"min_compat_client":' '"jewel",' '"require_osd_release":' '"squid",' '"allow_crimson":' false, '"pools":' '[' '{' '"pool":' 1, '"pool_name":' '"foo",' '"create_time":' '"2024-09-16T03:24:44.525189+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 2, '"min_size":' 1, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"85",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.8700000047683716, '"score_stable":' 1.8700000047683716, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1.25, '"raw_score_stable":' 1.25, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '},' '{' '"pool":' 2, '"pool_name":' '"bar",' '"create_time":' '"2024-09-16T03:24:46.226575+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 2, '"min_size":' 1, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"83",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.4900000095367432, '"score_stable":' 1.4900000095367432, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1, '"raw_score_stable":' 1, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '}' '],' '"osds":' '[' '{' '"osd":' 0, '"uuid":' '"64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 5, '"up_thru":' 84, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6802",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6803",' '"nonce":' 3375787448 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6804",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6805",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6808",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6809",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6806",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6807",' '"nonce":' 3375787448 '}' ']' '},' '"public_addr":' '"127.0.0.1:6803/3375787448",' '"cluster_addr":' '"127.0.0.1:6805/3375787448",' '"heartbeat_back_addr":' '"127.0.0.1:6809/3375787448",' '"heartbeat_front_addr":' '"127.0.0.1:6807/3375787448",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 1, '"uuid":' '"74b26727-75c9-444d-8782-719e4197a382",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 10, '"up_thru":' 84, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6810",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6811",' '"nonce":' 3733255132 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6812",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6813",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6816",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6817",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6814",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6815",' '"nonce":' 3733255132 '}' ']' '},' '"public_addr":' '"127.0.0.1:6811/3733255132",' '"cluster_addr":' '"127.0.0.1:6813/3733255132",' '"heartbeat_back_addr":' '"127.0.0.1:6817/3733255132",' '"heartbeat_front_addr":' '"127.0.0.1:6815/3733255132",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 2, '"uuid":' '"143da3a7-dad9-4b1e-966b-76cf5bdd3c82",' '"up":' 0, '"in":' 0, '"weight":' 0, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 15, '"up_thru":' 21, '"down_at":' 33, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6818",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6819",' '"nonce":' 963814857 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6820",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6821",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6824",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6825",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6822",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6823",' '"nonce":' 963814857 '}' ']' '},' '"public_addr":' '"127.0.0.1:6819/963814857",' '"cluster_addr":' '"127.0.0.1:6821/963814857",' '"heartbeat_back_addr":' '"127.0.0.1:6825/963814857",' '"heartbeat_front_addr":' '"127.0.0.1:6823/963814857",' '"state":' '[' '"exists"' ']' '}' '],' '"osd_xinfo":' '[' '{' '"osd":' 0, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:22.481942+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 1, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:59.663703+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 2, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 65536, '"last_purged_snaps_scrub":' '"2024-09-16T03:24:37.320822+0000",' '"dead_epoch":' 32 '}' '],' '"pg_upmap":' '[],' '"pg_upmap_items":' '[],' '"pg_upmap_primaries":' '[],' '"pg_temp":' '[],' '"primary_temp":' '[],' '"blocklist":' '{},' '"range_blocklist":' '{},' '"erasure_code_profiles":' '{' '"default":' '{' '"k":' '"2",' '"m":' '"2",' '"plugin":' '"jerasure",' '"technique":' '"reed_sol_van"' '}' '},' '"removed_snaps_queue":' '[],' '"new_removed_snaps":' '[],' '"new_purged_snaps":' '[],' '"crush_node_flags":' '{},' '"device_class_flags":' '{},' '"stretch_mode":' '{' '"stretch_mode_enabled":' false, '"stretch_bucket_count":' 0, '"degraded_stretch_mode":' 0, '"recovering_stretch_mode":' 0, '"stretch_mode_bucket":' 0 '}' '},' '"osd_metadata":' '[' '{' '"id":' 0, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/0/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:22:53.662571Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]",' '"hb_front_addr":' '"[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/0",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 1, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/1/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:23:30.129885Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]",' '"hb_front_addr":' '"[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/1",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 2, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/2/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:24:07.764502Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]",' '"hb_front_addr":' '"[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/2",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '}' '],' '"osdmap_clean_epochs":' '{' '"min_last_epoch_clean":' 86, '"last_epoch_clean":' '{' '"per_pool":' '[' '{' '"poolid":' 1, '"floor":' 86 '},' '{' '"poolid":' 2, '"floor":' 86 '}' ']' '},' '"osd_epochs":' '[' '{' '"id":' 0, '"epoch":' 86 '},' '{' '"id":' 1, '"epoch":' 86 '}' ']' '},' '"osdmap_first_committed":' 84, '"osdmap_last_committed":' 86, '"crushmap":' '{' '"devices":' '[' '{' '"id":' 0, '"name":' '"osd.0",' '"class":' '"hdd"' '},' '{' '"id":' 1, '"name":' '"osd.1",' '"class":' '"hdd"' '},' '{' '"id":' 2, '"name":' '"osd.2",' '"class":' '"hdd"' '}' '],' '"types":' '[' '{' '"type_id":' 0, '"name":' '"osd"' '},' '{' '"type_id":' 1, '"name":' '"host"' '},' '{' '"type_id":' 2, '"name":' '"chassis"' '},' '{' '"type_id":' 3, '"name":' '"rack"' '},' '{' '"type_id":' 4, '"name":' '"row"' '},' '{' '"type_id":' 5, '"name":' '"pdu"' '},' '{' '"type_id":' 6, '"name":' '"pod"' '},' '{' '"type_id":' 7, '"name":' '"room"' '},' '{' '"type_id":' 8, '"name":' '"datacenter"' '},' '{' '"type_id":' 9, '"name":' '"zone"' '},' '{' '"type_id":' 10, '"name":' '"region"' '},' '{' '"type_id":' 11, '"name":' '"root"' '}' '],' '"buckets":' '[' '{' '"id":' -1, '"name":' '"default",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -3, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -2, '"name":' '"default~hdd",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -4, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -3, '"name":' '"smithi096",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '},' '{' '"id":' -4, '"name":' '"smithi096~hdd",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '}' '],' '"rules":' '[' '{' '"rule_id":' 0, '"rule_name":' '"replicated_rule",' '"type":' 1, '"steps":' '[' '{' '"op":' '"take",' '"item":' -1, '"item_name":' '"default"' '},' '{' '"op":' '"choose_firstn",' '"num":' 0, '"type":' '"osd"' '},' '{' '"op":' '"emit"' '}' ']' '}' '],' '"tunables":' '{' '"choose_local_tries":' 0, '"choose_local_fallback_tries":' 0, '"choose_total_tries":' 50, '"chooseleaf_descend_once":' 1, '"chooseleaf_vary_r":' 1, '"chooseleaf_stable":' 1, '"msr_descents":' 100, '"msr_collision_tries":' 100, '"straw_calc_version":' 1, '"allowed_bucket_algs":' 54, '"profile":' '"jewel",' '"optimal_tunables":' 1, '"legacy_tunables":' 0, '"minimum_required_version":' '"jewel",' '"require_feature_tunables":' 1, '"require_feature_tunables2":' 1, '"has_v2_rules":' 0, '"require_feature_tunables3":' 1, '"has_v3_rules":' 0, '"has_v4_buckets":' 1, '"require_feature_tunables5":' 1, '"has_v5_rules":' 0, '"has_msr_rules":' 0 '},' '"choose_args":' '{}' '},' '"fsmap":' '{' '"epoch":' 1, '"btime":' '"2024-09-16T03:22:46:882186+0000",' '"default_fscid":' -1, '"compat":' '{' '"compat":' '{},' '"ro_compat":' '{},' '"incompat":' '{' '"feature_1":' '"base' 'v0.20",' '"feature_2":' '"client' writeable 'ranges",' '"feature_3":' '"default' file layouts on 'dirs",' '"feature_4":' '"dir' inode in separate 'object",' '"feature_5":' '"mds' uses versioned 'encoding",' '"feature_6":' '"dirfrag' is stored in 'omap",' '"feature_8":' '"no' anchor 'table",' '"feature_9":' '"file' layout 'v2",' '"feature_10":' '"snaprealm' 'v2",' '"feature_11":' '"minor' log 'segments",' '"feature_12":' '"quiesce' 'subvolumes"' '}' '},' '"feature_flags":' '{' '"enable_multiple":' true, '"ever_enabled_multiple":' true '},' '"standbys":' '[],' '"filesystems":' '[]' '},' '"mdsmap_first_committed":' 1, '"mdsmap_last_committed":' 1, '"auth":' '{' '"first_committed":' 1, '"last_committed":' 5, '"num_secrets":' 3 '},' '"num_pg":' 64, '"num_pg_active":' 64, '"num_pg_unknown":' 0, '"num_osd":' 3, '"pool_sum":' '{' '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 128, '"acting":' 128, '"num_store_stats":' 0 '},' '"osd_sum":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54640, '"kb_used_data":' 960, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660560, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692413440, '"internally_reserved":' 0, '"allocated":' 983040, '"data_stored":' 369948, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 325, '"apply_latency_ms":' 325, '"commit_latency_ns":' 325000000, '"apply_latency_ns":' 325000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '},' '"osd_sum_by_class":' '{' '"hdd":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54640, '"kb_used_data":' 960, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660560, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692413440, '"internally_reserved":' 0, '"allocated":' 983040, '"data_stored":' 369948, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 325, '"apply_latency_ms":' 325, '"commit_latency_ns":' 325000000, '"apply_latency_ns":' 325000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '}' '},' '"pool_stats":' '[' '{' '"poolid":' 2, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '},' '{' '"poolid":' 1, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '}' '],' '"osd_stats":' '[' '{' '"osd":' 0, '"seq":' 21474836521 '},' '{' '"osd":' 1, '"seq":' 42949672993 '},' '{' '"osd":' 2, '"seq":' 0 '}' '],' '"num_pg_by_state":' '[' '{' '"state":' '"active+clean",' '"num":' 64 '}' '],' '"num_pg_by_osd":' '[' '{' '"osd":' 2, '"num_primary_pg":' 0, '"num_acting_pg":' 0, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 0, '"num_primary_pg":' 28, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 1, '"num_primary_pg":' 36, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '}' '],' '"purged_snaps":' '[' '{' '"pool":' 1, '"purged_snaps":' '{}' '},' '{' '"pool":' 2, '"purged_snaps":' '{}' '}' '],' '"servicemap":' '{' '"epoch":' 5, '"modified":' '"2024-09-16T03:25:38.422788+0000",' '"services":' '{}' '},' '"mgrstat_first_committed":' 84, '"mgrstat_last_committed":' 89, '"logm_first_committed":' 1, '"logm_last_committed":' 402, '"paxos":' '{' '"first_committed":' 1, '"last_committed":' 594, '"last_pn":' 0, '"accepted_pn":' 0 '}' '}' 2024-09-16T03:26:08.395 INFO:tasks.workunit.client.0.smithi096.stdout:{ "cluster_fingerprint": "fda2fc64-07ed-4add-8224-2e527e11d427", "version": "19.3.0-4930-gfc3e0bff", "commit": "fc3e0bff7468fd55478adbae7f75508b749124b6", "timestamp": "2024-09-16T03:26:08.248292+0000", "tag": "", "health": { "status": "HEALTH_OK", "checks": {}, "mutes": [] }, "monmap_first_committed": 1, "monmap_last_committed": 1, "monmap": { "epoch": 1, "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", "modified": "2024-09-16T03:22:45.872880Z", "created": "2024-09-16T03:22:45.872880Z", "min_mon_release": 19, "min_mon_release_name": "squid", "election_strategy": 1, "disallowed_leaders: ": "", "stretch_mode": false, "tiebreaker_mon": "", "removed_ranks: ": "", "features": { "persistent": [ "kraken", "luminous", "mimic", "osdmap-prune", "nautilus", "octopus", "pacific", "elector-pinging", "quincy", "reef", "squid" ], "optional": [] }, "mons": [ { "rank": 0, "name": "a", "public_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:7302", "nonce": 0 } ] }, "addr": "127.0.0.1:7302/0", "public_addr": "127.0.0.1:7302/0", "priority": 0, "weight": 0, "crush_location": "{}" } ] }, "quorum": [ 0 ], "osdmap": { "epoch": 86, "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", "created": "2024-09-16T03:22:46.906117+0000", "modified": "2024-09-16T03:26:02.230083+0000", "last_up_change": "2024-09-16T03:25:08.513363+0000", "last_in_change": "2024-09-16T03:25:09.839444+0000", "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", "flags_num": 5799936, "flags_set": [ "pglog_hardlimit", "purged_snapdirs", "recovery_deletes", "sortbitwise" ], "crush_version": 7, "full_ratio": 0.97000002861022949, "backfillfull_ratio": 0.97000002861022949, "nearfull_ratio": 0.85000002384185791, "cluster_snapshot": "", "pool_max": 2, "max_osd": 3, "require_min_compat_client": "luminous", "min_compat_client": "jewel", "require_osd_release": "squid", "allow_crimson": false, "pools": [ { "pool": 1, "pool_name": "foo", "create_time": "2024-09-16T03:24:44.525189+0000", "flags": 1, "flags_names": "hashpspool", "type": 1, "size": 2, "min_size": 1, "crush_rule": 0, "peering_crush_bucket_count": 0, "peering_crush_bucket_target": 0, "peering_crush_bucket_barrier": 0, "peering_crush_bucket_mandatory_member": 2147483647, "is_stretch_pool": false, "object_hash": 2, "pg_autoscale_mode": "off", "pg_num": 32, "pg_placement_num": 32, "pg_placement_num_target": 32, "pg_num_target": 32, "pg_num_pending": 32, "last_pg_merge_meta": { "source_pgid": "0.0", "ready_epoch": 0, "last_epoch_started": 0, "last_epoch_clean": 0, "source_version": "0'0", "target_version": "0'0" }, "last_change": "85", "last_force_op_resend": "0", "last_force_op_resend_prenautilus": "0", "last_force_op_resend_preluminous": "0", "auid": 0, "snap_mode": "selfmanaged", "snap_seq": 0, "snap_epoch": 0, "pool_snaps": [], "removed_snaps": "[]", "quota_max_bytes": 0, "quota_max_objects": 0, "tiers": [], "tier_of": -1, "read_tier": -1, "write_tier": -1, "cache_mode": "none", "target_max_bytes": 0, "target_max_objects": 0, "cache_target_dirty_ratio_micro": 400000, "cache_target_dirty_high_ratio_micro": 600000, "cache_target_full_ratio_micro": 800000, "cache_min_flush_age": 0, "cache_min_evict_age": 0, "erasure_code_profile": "", "hit_set_params": { "type": "none" }, "hit_set_period": 0, "hit_set_count": 0, "use_gmt_hitset": true, "min_read_recency_for_promote": 0, "min_write_recency_for_promote": 0, "hit_set_grade_decay_rate": 0, "hit_set_search_last_n": 0, "grade_table": [], "stripe_width": 0, "expected_num_objects": 0, "fast_read": false, "options": {}, "application_metadata": {}, "read_balance": { "score_type": "Fair distribution", "score_acting": 1.8700000047683716, "score_stable": 1.8700000047683716, "optimal_score": 0.67000001668930054, "raw_score_acting": 1.25, "raw_score_stable": 1.25, "primary_affinity_weighted": 1, "average_primary_affinity": 1, "average_primary_affinity_weighted": 1 } }, { "pool": 2, "pool_name": "bar", "create_time": "2024-09-16T03:24:46.226575+0000", "flags": 1, "flags_names": "hashpspool", "type": 1, "size": 2, "min_size": 1, "crush_rule": 0, "peering_crush_bucket_count": 0, "peering_crush_bucket_target": 0, "peering_crush_bucket_barrier": 0, "peering_crush_bucket_mandatory_member": 2147483647, "is_stretch_pool": false, "object_hash": 2, "pg_autoscale_mode": "off", "pg_num": 32, "pg_placement_num": 32, "pg_placement_num_target": 32, "pg_num_target": 32, "pg_num_pending": 32, "last_pg_merge_meta": { "source_pgid": "0.0", "ready_epoch": 0, "last_epoch_started": 0, "last_epoch_clean": 0, "source_version": "0'0", "target_version": "0'0" }, "last_change": "83", "last_force_op_resend": "0", "last_force_op_resend_prenautilus": "0", "last_force_op_resend_preluminous": "0", "auid": 0, "snap_mode": "selfmanaged", "snap_seq": 0, "snap_epoch": 0, "pool_snaps": [], "removed_snaps": "[]", "quota_max_bytes": 0, "quota_max_objects": 0, "tiers": [], "tier_of": -1, "read_tier": -1, "write_tier": -1, "cache_mode": "none", "target_max_bytes": 0, "target_max_objects": 0, "cache_target_dirty_ratio_micro": 400000, "cache_target_dirty_high_ratio_micro": 600000, "cache_target_full_ratio_micro": 800000, "cache_min_flush_age": 0, "cache_min_evict_age": 0, "erasure_code_profile": "", "hit_set_params": { "type": "none" }, "hit_set_period": 0, "hit_set_count": 0, "use_gmt_hitset": true, "min_read_recency_for_promote": 0, "min_write_recency_for_promote": 0, "hit_set_grade_decay_rate": 0, "hit_set_search_last_n": 0, "grade_table": [], "stripe_width": 0, "expected_num_objects": 0, "fast_read": false, "options": {}, "application_metadata": {}, "read_balance": { "score_type": "Fair distribution", "score_acting": 1.4900000095367432, "score_stable": 1.4900000095367432, "optimal_score": 0.67000001668930054, "raw_score_acting": 1, "raw_score_stable": 1, "primary_affinity_weighted": 1, "average_primary_affinity": 1, "average_primary_affinity_weighted": 1 } } ], "osds": [ { "osd": 0, "uuid": "64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6", "up": 1, "in": 1, "weight": 1, "primary_affinity": 1, "last_clean_begin": 0, "last_clean_end": 0, "up_from": 5, "up_thru": 84, "down_at": 0, "lost_at": 0, "public_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6802", "nonce": 3375787448 }, { "type": "v1", "addr": "127.0.0.1:6803", "nonce": 3375787448 } ] }, "cluster_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6804", "nonce": 3375787448 }, { "type": "v1", "addr": "127.0.0.1:6805", "nonce": 3375787448 } ] }, "heartbeat_back_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6808", "nonce": 3375787448 }, { "type": "v1", "addr": "127.0.0.1:6809", "nonce": 3375787448 } ] }, "heartbeat_front_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6806", "nonce": 3375787448 }, { "type": "v1", "addr": "127.0.0.1:6807", "nonce": 3375787448 } ] }, "public_addr": "127.0.0.1:6803/3375787448", "cluster_addr": "127.0.0.1:6805/3375787448", "heartbeat_back_addr": "127.0.0.1:6809/3375787448", "heartbeat_front_addr": "127.0.0.1:6807/3375787448", "state": [ "exists", "up" ] }, { "osd": 1, "uuid": "74b26727-75c9-444d-8782-719e4197a382", "up": 1, "in": 1, "weight": 1, "primary_affinity": 1, "last_clean_begin": 0, "last_clean_end": 0, "up_from": 10, "up_thru": 84, "down_at": 0, "lost_at": 0, "public_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6810", "nonce": 3733255132 }, { "type": "v1", "addr": "127.0.0.1:6811", "nonce": 3733255132 } ] }, "cluster_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6812", "nonce": 3733255132 }, { "type": "v1", "addr": "127.0.0.1:6813", "nonce": 3733255132 } ] }, "heartbeat_back_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6816", "nonce": 3733255132 }, { "type": "v1", "addr": "127.0.0.1:6817", "nonce": 3733255132 } ] }, "heartbeat_front_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6814", "nonce": 3733255132 }, { "type": "v1", "addr": "127.0.0.1:6815", "nonce": 3733255132 } ] }, "public_addr": "127.0.0.1:6811/3733255132", "cluster_addr": "127.0.0.1:6813/3733255132", "heartbeat_back_addr": "127.0.0.1:6817/3733255132", "heartbeat_front_addr": "127.0.0.1:6815/3733255132", "state": [ "exists", "up" ] }, { "osd": 2, "uuid": "143da3a7-dad9-4b1e-966b-76cf5bdd3c82", "up": 0, "in": 0, "weight": 0, "primary_affinity": 1, "last_clean_begin": 0, "last_clean_end": 0, "up_from": 15, "up_thru": 21, "down_at": 33, "lost_at": 0, "public_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6818", "nonce": 963814857 }, { "type": "v1", "addr": "127.0.0.1:6819", "nonce": 963814857 } ] }, "cluster_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6820", "nonce": 963814857 }, { "type": "v1", "addr": "127.0.0.1:6821", "nonce": 963814857 } ] }, "heartbeat_back_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6824", "nonce": 963814857 }, { "type": "v1", "addr": "127.0.0.1:6825", "nonce": 963814857 } ] }, "heartbeat_front_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6822", "nonce": 963814857 }, { "type": "v1", "addr": "127.0.0.1:6823", "nonce": 963814857 } ] }, "public_addr": "127.0.0.1:6819/963814857", "cluster_addr": "127.0.0.1:6821/963814857", "heartbeat_back_addr": "127.0.0.1:6825/963814857", "heartbeat_front_addr": "127.0.0.1:6823/963814857", "state": [ "exists" ] } ], "osd_xinfo": [ { "osd": 0, "down_stamp": "0.000000", "laggy_probability": 0, "laggy_interval": 0, "features": 4540719139924082687, "old_weight": 0, "last_purged_snaps_scrub": "2024-09-16T03:23:22.481942+0000", "dead_epoch": 0 }, { "osd": 1, "down_stamp": "0.000000", "laggy_probability": 0, "laggy_interval": 0, "features": 4540719139924082687, "old_weight": 0, "last_purged_snaps_scrub": "2024-09-16T03:23:59.663703+0000", "dead_epoch": 0 }, { "osd": 2, "down_stamp": "0.000000", "laggy_probability": 0, "laggy_interval": 0, "features": 4540719139924082687, "old_weight": 65536, "last_purged_snaps_scrub": "2024-09-16T03:24:37.320822+0000", "dead_epoch": 32 } ], "pg_upmap": [], "pg_upmap_items": [], "pg_upmap_primaries": [], "pg_temp": [], "primary_temp": [], "blocklist": {}, "range_blocklist": {}, "erasure_code_profiles": { "default": { "k": "2", "m": "2", "plugin": "jerasure", "technique": "reed_sol_van" } }, "removed_snaps_queue": [], "new_removed_snaps": [], "new_purged_snaps": [], "crush_node_flags": {}, "device_class_flags": {}, "stretch_mode": { "stretch_mode_enabled": false, "stretch_bucket_count": 0, "degraded_stretch_mode": 0, "recovering_stretch_mode": 0, "stretch_mode_bucket": 0 } }, "osd_metadata": [ { "id": 0, "arch": "x86_64", "back_addr": "[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]", "back_iface": "", "bluefs": "1", "bluefs_dedicated_db": "0", "bluefs_dedicated_wal": "0", "bluefs_single_shared_device": "1", "bluestore_allocation_from_file": "0", "bluestore_bdev_access_mode": "file", "bluestore_bdev_block_size": "4096", "bluestore_bdev_devices": "sda", "bluestore_bdev_driver": "KernelDevice", "bluestore_bdev_optimal_io_size": "0", "bluestore_bdev_path": "td/mon-last-clean-epoch/0/block", "bluestore_bdev_rotational": "1", "bluestore_bdev_size": "107374182400", "bluestore_bdev_support_discard": "0", "bluestore_bdev_type": "hdd", "bluestore_min_alloc_size": "4096", "ceph_release": "squid", "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", "ceph_version_short": "19.3.0-4930-gfc3e0bff", "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", "created_at": "2024-09-16T03:22:53.662571Z", "default_device_class": "hdd", "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", "devices": "sda", "distro": "ubuntu", "distro_description": "Ubuntu 22.04.1 LTS", "distro_version": "22.04", "front_addr": "[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]", "front_iface": "", "hb_back_addr": "[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]", "hb_front_addr": "[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]", "hostname": "smithi096", "journal_rotational": "1", "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", "kernel_version": "5.15.0-121-generic", "mem_swap_kb": "2097148", "mem_total_kb": "32746824", "network_numa_unknown_ifaces": "back_iface,front_iface", "objectstore_numa_unknown_devices": "sda", "os": "Linux", "osd_data": "td/mon-last-clean-epoch/0", "osd_objectstore": "bluestore", "osdspec_affinity": "", "rotational": "1" }, { "id": 1, "arch": "x86_64", "back_addr": "[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]", "back_iface": "", "bluefs": "1", "bluefs_dedicated_db": "0", "bluefs_dedicated_wal": "0", "bluefs_single_shared_device": "1", "bluestore_allocation_from_file": "0", "bluestore_bdev_access_mode": "file", "bluestore_bdev_block_size": "4096", "bluestore_bdev_devices": "sda", "bluestore_bdev_driver": "KernelDevice", "bluestore_bdev_optimal_io_size": "0", "bluestore_bdev_path": "td/mon-last-clean-epoch/1/block", "bluestore_bdev_rotational": "1", "bluestore_bdev_size": "107374182400", "bluestore_bdev_support_discard": "0", "bluestore_bdev_type": "hdd", "bluestore_min_alloc_size": "4096", "ceph_release": "squid", "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", "ceph_version_short": "19.3.0-4930-gfc3e0bff", "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", "created_at": "2024-09-16T03:23:30.129885Z", "default_device_class": "hdd", "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", "devices": "sda", "distro": "ubuntu", "distro_description": "Ubuntu 22.04.1 LTS", "distro_version": "22.04", "front_addr": "[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]", "front_iface": "", "hb_back_addr": "[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]", "hb_front_addr": "[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]", "hostname": "smithi096", "journal_rotational": "1", "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", "kernel_version": "5.15.0-121-generic", "mem_swap_kb": "2097148", "mem_total_kb": "32746824", "network_numa_unknown_ifaces": "back_iface,front_iface", "objectstore_numa_unknown_devices": "sda", "os": "Linux", "osd_data": "td/mon-last-clean-epoch/1", "osd_objectstore": "bluestore", "osdspec_affinity": "", "rotational": "1" }, { "id": 2, "arch": "x86_64", "back_addr": "[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]", "back_iface": "", "bluefs": "1", "bluefs_dedicated_db": "0", "bluefs_dedicated_wal": "0", "bluefs_single_shared_device": "1", "bluestore_allocation_from_file": "0", "bluestore_bdev_access_mode": "file", "bluestore_bdev_block_size": "4096", "bluestore_bdev_devices": "sda", "bluestore_bdev_driver": "KernelDevice", "bluestore_bdev_optimal_io_size": "0", "bluestore_bdev_path": "td/mon-last-clean-epoch/2/block", "bluestore_bdev_rotational": "1", "bluestore_bdev_size": "107374182400", "bluestore_bdev_support_discard": "0", "bluestore_bdev_type": "hdd", "bluestore_min_alloc_size": "4096", "ceph_release": "squid", "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", "ceph_version_short": "19.3.0-4930-gfc3e0bff", "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", "created_at": "2024-09-16T03:24:07.764502Z", "default_device_class": "hdd", "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", "devices": "sda", "distro": "ubuntu", "distro_description": "Ubuntu 22.04.1 LTS", "distro_version": "22.04", "front_addr": "[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]", "front_iface": "", "hb_back_addr": "[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]", "hb_front_addr": "[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]", "hostname": "smithi096", "journal_rotational": "1", "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", "kernel_version": "5.15.0-121-generic", "mem_swap_kb": "2097148", "mem_total_kb": "32746824", "network_numa_unknown_ifaces": "back_iface,front_iface", "objectstore_numa_unknown_devices": "sda", "os": "Linux", "osd_data": "td/mon-last-clean-epoch/2", "osd_objectstore": "bluestore", "osdspec_affinity": "", "rotational": "1" } ], "osdmap_clean_epochs": { "min_last_epoch_clean": 86, "last_epoch_clean": { "per_pool": [ { "poolid": 1, "floor": 86 }, { "poolid": 2, "floor": 86 } ] }, "osd_epochs": [ { "id": 0, "epoch": 86 }, { "id": 1, "epoch": 86 } ] }, "osdmap_first_committed": 84, "osdmap_last_committed": 86, "crushmap": { "devices": [ { "id": 0, "name": "osd.0", "class": "hdd" }, { "id": 1, "name": "osd.1", "class": "hdd" }, { "id": 2, "name": "osd.2", "class": "hdd" } ], "types": [ { "type_id": 0, "name": "osd" }, { "type_id": 1, "name": "host" }, { "type_id": 2, "name": "chassis" }, { "type_id": 3, "name": "rack" }, { "type_id": 4, "name": "row" }, { "type_id": 5, "name": "pdu" }, { "type_id": 6, "name": "pod" }, { "type_id": 7, "name": "room" }, { "type_id": 8, "name": "datacenter" }, { "type_id": 9, "name": "zone" }, { "type_id": 10, "name": "region" }, { "type_id": 11, "name": "root" } ], "buckets": [ { "id": -1, "name": "default", "type_id": 11, "type_name": "root", "weight": 19206, "alg": "straw2", "hash": "rjenkins1", "items": [ { "id": -3, "weight": 19206, "pos": 0 } ] }, { "id": -2, "name": "default~hdd", "type_id": 11, "type_name": "root", "weight": 19206, "alg": "straw2", "hash": "rjenkins1", "items": [ { "id": -4, "weight": 19206, "pos": 0 } ] }, { "id": -3, "name": "smithi096", "type_id": 1, "type_name": "host", "weight": 19206, "alg": "straw2", "hash": "rjenkins1", "items": [ { "id": 0, "weight": 6402, "pos": 0 }, { "id": 1, "weight": 6402, "pos": 1 }, { "id": 2, "weight": 6402, "pos": 2 } ] }, { "id": -4, "name": "smithi096~hdd", "type_id": 1, "type_name": "host", "weight": 19206, "alg": "straw2", "hash": "rjenkins1", "items": [ { "id": 0, "weight": 6402, "pos": 0 }, { "id": 1, "weight": 6402, "pos": 1 }, { "id": 2, "weight": 6402, "pos": 2 } ] } ], "rules": [ { "rule_id": 0, "rule_name": "replicated_rule", "type": 1, "steps": [ { "op": "take", "item": -1, "item_name": "default" }, { "op": "choose_firstn", "num": 0, "type": "osd" }, { "op": "emit" } ] } ], "tunables": { "choose_local_tries": 0, "choose_local_fallback_tries": 0, "choose_total_tries": 50, "chooseleaf_descend_once": 1, "chooseleaf_vary_r": 1, "chooseleaf_stable": 1, "msr_descents": 100, "msr_collision_tries": 100, "straw_calc_version": 1, "allowed_bucket_algs": 54, "profile": "jewel", "optimal_tunables": 1, "legacy_tunables": 0, "minimum_required_version": "jewel", "require_feature_tunables": 1, "require_feature_tunables2": 1, "has_v2_rules": 0, "require_feature_tunables3": 1, "has_v3_rules": 0, "has_v4_buckets": 1, "require_feature_tunables5": 1, "has_v5_rules": 0, "has_msr_rules": 0 }, "choose_args": {} }, "fsmap": { "epoch": 1, "btime": "2024-09-16T03:22:46:882186+0000", "default_fscid": -1, "compat": { "compat": {}, "ro_compat": {}, "incompat": { "feature_1": "base v0.20", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes" } }, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "standbys": [], "filesystems": [] }, "mdsmap_first_committed": 1, "mdsmap_last_committed": 1, "auth": { "first_committed": 1, "last_committed": 5, "num_secrets": 3 }, "num_pg": 64, "num_pg_active": 64, "num_pg_unknown": 0, "num_osd": 3, "pool_sum": { "stat_sum": { "num_bytes": 0, "num_objects": 0, "num_object_clones": 0, "num_object_copies": 0, "num_objects_missing_on_primary": 0, "num_objects_missing": 0, "num_objects_degraded": 0, "num_objects_misplaced": 0, "num_objects_unfound": 0, "num_objects_dirty": 0, "num_whiteouts": 0, "num_read": 0, "num_read_kb": 0, "num_write": 0, "num_write_kb": 0, "num_scrub_errors": 0, "num_shallow_scrub_errors": 0, "num_deep_scrub_errors": 0, "num_objects_recovered": 0, "num_bytes_recovered": 0, "num_keys_recovered": 0, "num_objects_omap": 0, "num_objects_hit_set_archive": 0, "num_bytes_hit_set_archive": 0, "num_flush": 0, "num_flush_kb": 0, "num_evict": 0, "num_evict_kb": 0, "num_promote": 0, "num_flush_mode_high": 0, "num_flush_mode_low": 0, "num_evict_mode_some": 0, "num_evict_mode_full": 0, "num_objects_pinned": 0, "num_legacy_snapsets": 0, "num_large_omap_objects": 0, "num_objects_manifest": 0, "num_omap_bytes": 0, "num_omap_keys": 0, "num_objects_repaired": 0 }, "store_stats": { "total": 0, "available": 0, "internally_reserved": 0, "allocated": 0, "data_stored": 0, "data_compressed": 0, "data_compressed_allocated": 0, "data_compressed_original": 0, "omap_allocated": 0, "internal_metadata": 0 }, "log_size": 0, "ondisk_log_size": 0, "up": 128, "acting": 128, "num_store_stats": 0 }, "osd_sum": { "up_from": 0, "seq": 0, "num_pgs": 128, "num_osds": 2, "num_per_pool_osds": 2, "num_per_pool_omap_osds": 2, "kb": 209715200, "kb_used": 54640, "kb_used_data": 960, "kb_used_omap": 3, "kb_used_meta": 53628, "kb_avail": 209660560, "statfs": { "total": 214748364800, "available": 214692413440, "internally_reserved": 0, "allocated": 983040, "data_stored": 369948, "data_compressed": 0, "data_compressed_allocated": 0, "data_compressed_original": 0, "omap_allocated": 3190, "internal_metadata": 54915978 }, "hb_peers": [], "snap_trim_queue_len": 0, "num_snap_trimming": 0, "num_shards_repaired": 0, "op_queue_age_hist": { "histogram": [], "upper_bound": 1 }, "perf_stat": { "commit_latency_ms": 325, "apply_latency_ms": 325, "commit_latency_ns": 325000000, "apply_latency_ns": 325000000 }, "alerts": [], "network_ping_times": [] }, "osd_sum_by_class": { "hdd": { "up_from": 0, "seq": 0, "num_pgs": 128, "num_osds": 2, "num_per_pool_osds": 2, "num_per_pool_omap_osds": 2, "kb": 209715200, "kb_used": 54640, "kb_used_data": 960, "kb_used_omap": 3, "kb_used_meta": 53628, "kb_avail": 209660560, "statfs": { "total": 214748364800, "available": 214692413440, "internally_reserved": 0, "allocated": 983040, "data_stored": 369948, "data_compressed": 0, "data_compressed_allocated": 0, "data_compressed_original": 0, "omap_allocated": 3190, "internal_metadata": 54915978 }, "hb_peers": [], "snap_trim_queue_len": 0, "num_snap_trimming": 0, "num_shards_repaired": 0, "op_queue_age_hist": { "histogram": [], "upper_bound": 1 }, "perf_stat": { "commit_latency_ms": 325, "apply_latency_ms": 325, "commit_latency_ns": 325000000, "apply_latency_ns": 325000000 }, "alerts": [], "network_ping_times": [] } }, "pool_stats": [ { "poolid": 2, "num_pg": 32, "stat_sum": { "num_bytes": 0, "num_objects": 0, "num_object_clones": 0, "num_object_copies": 0, "num_objects_missing_on_primary": 0, "num_objects_missing": 0, "num_objects_degraded": 0, "num_objects_misplaced": 0, "num_objects_unfound": 0, "num_objects_dirty": 0, "num_whiteouts": 0, "num_read": 0, "num_read_kb": 0, "num_write": 0, "num_write_kb": 0, "num_scrub_errors": 0, "num_shallow_scrub_errors": 0, "num_deep_scrub_errors": 0, "num_objects_recovered": 0, "num_bytes_recovered": 0, "num_keys_recovered": 0, "num_objects_omap": 0, "num_objects_hit_set_archive": 0, "num_bytes_hit_set_archive": 0, "num_flush": 0, "num_flush_kb": 0, "num_evict": 0, "num_evict_kb": 0, "num_promote": 0, "num_flush_mode_high": 0, "num_flush_mode_low": 0, "num_evict_mode_some": 0, "num_evict_mode_full": 0, "num_objects_pinned": 0, "num_legacy_snapsets": 0, "num_large_omap_objects": 0, "num_objects_manifest": 0, "num_omap_bytes": 0, "num_omap_keys": 0, "num_objects_repaired": 0 }, "store_stats": { "total": 0, "available": 0, "internally_reserved": 0, "allocated": 0, "data_stored": 0, "data_compressed": 0, "data_compressed_allocated": 0, "data_compressed_original": 0, "omap_allocated": 0, "internal_metadata": 0 }, "log_size": 0, "ondisk_log_size": 0, "up": 64, "acting": 64, "num_store_stats": 3 }, { "poolid": 1, "num_pg": 32, "stat_sum": { "num_bytes": 0, "num_objects": 0, "num_object_clones": 0, "num_object_copies": 0, "num_objects_missing_on_primary": 0, "num_objects_missing": 0, "num_objects_degraded": 0, "num_objects_misplaced": 0, "num_objects_unfound": 0, "num_objects_dirty": 0, "num_whiteouts": 0, "num_read": 0, "num_read_kb": 0, "num_write": 0, "num_write_kb": 0, "num_scrub_errors": 0, "num_shallow_scrub_errors": 0, "num_deep_scrub_errors": 0, "num_objects_recovered": 0, "num_bytes_recovered": 0, "num_keys_recovered": 0, "num_objects_omap": 0, "num_objects_hit_set_archive": 0, "num_bytes_hit_set_archive": 0, "num_flush": 0, "num_flush_kb": 0, "num_evict": 0, "num_evict_kb": 0, "num_promote": 0, "num_flush_mode_high": 0, "num_flush_mode_low": 0, "num_evict_mode_some": 0, "num_evict_mode_full": 0, "num_objects_pinned": 0, "num_legacy_snapsets": 0, "num_large_omap_objects": 0, "num_objects_manifest": 0, "num_omap_bytes": 0, "num_omap_keys": 0, "num_objects_repaired": 0 }, "store_stats": { "total": 0, "available": 0, "internally_reserved": 0, "allocated": 0, "data_stored": 0, "data_compressed": 0, "data_compressed_allocated": 0, "data_compressed_original": 0, "omap_allocated": 0, "internal_metadata": 0 }, "log_size": 0, "ondisk_log_size": 0, "up": 64, "acting": 64, "num_store_stats": 3 } ], "osd_stats": [ { "osd": 0, "seq": 21474836521 }, { "osd": 1, "seq": 42949672993 }, { "osd": 2, "seq": 0 } ], "num_pg_by_state": [ { "state": "active+clean", "num": 64 } ], "num_pg_by_osd": [ { "osd": 2, "num_primary_pg": 0, "num_acting_pg": 0, "num_up_not_acting_pg": 0 }, { "osd": 0, "num_primary_pg": 28, "num_acting_pg": 64, "num_up_not_acting_pg": 0 }, { "osd": 1, "num_primary_pg": 36, "num_acting_pg": 64, "num_up_not_acting_pg": 0 } ], "purged_snaps": [ { "pool": 1, "purged_snaps": {} }, { "pool": 2, "purged_snaps": {} } ], "servicemap": { "epoch": 5, "modified": "2024-09-16T03:25:38.422788+0000", "services": {} }, "mgrstat_first_committed": 84, "mgrstat_last_committed": 89, "logm_first_committed": 1, "logm_last_committed": 402, "paxos": { "first_committed": 1, "last_committed": 594, "last_pn": 0, "accepted_pn": 0 } } 2024-09-16T03:26:08.397 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:125: validate_fc: return 1 2024-09-16T03:26:08.397 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:126: validate_fc: return 0 2024-09-16T03:26:08.397 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:279: TEST_mon_last_clean_epoch: wait_for_total_num_maps 2 2024-09-16T03:26:08.397 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:157: wait_for_total_num_maps: get_timeout_delays 300 .1 2024-09-16T03:26:08.397 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: shopt -q -o xtrace 2024-09-16T03:26:08.397 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: echo true 2024-09-16T03:26:08.397 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: local trace=true 2024-09-16T03:26:08.397 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: true 2024-09-16T03:26:08.397 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: shopt -u -o xtrace 2024-09-16T03:26:08.517 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:157: wait_for_total_num_maps: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '4.5') 2024-09-16T03:26:08.517 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:157: wait_for_total_num_maps: local -a delays 2024-09-16T03:26:08.517 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:158: wait_for_total_num_maps: local -i loop=0 2024-09-16T03:26:08.517 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:159: wait_for_total_num_maps: local -i v_diff=2 2024-09-16T03:26:08.517 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:161: wait_for_total_num_maps: get_fc_lc_diff 2024-09-16T03:26:08.518 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:130: get_fc_lc_diff: ceph report 2024-09-16T03:26:09.102 INFO:tasks.workunit.client.0.smithi096.stderr:report 3852749542 2024-09-16T03:26:09.119 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:130: get_fc_lc_diff: report='{ 2024-09-16T03:26:09.119 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_fingerprint": "fda2fc64-07ed-4add-8224-2e527e11d427", 2024-09-16T03:26:09.119 INFO:tasks.workunit.client.0.smithi096.stderr: "version": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:26:09.119 INFO:tasks.workunit.client.0.smithi096.stderr: "commit": "fc3e0bff7468fd55478adbae7f75508b749124b6", 2024-09-16T03:26:09.119 INFO:tasks.workunit.client.0.smithi096.stderr: "timestamp": "2024-09-16T03:26:09.103074+0000", 2024-09-16T03:26:09.119 INFO:tasks.workunit.client.0.smithi096.stderr: "tag": "", 2024-09-16T03:26:09.119 INFO:tasks.workunit.client.0.smithi096.stderr: "health": { 2024-09-16T03:26:09.120 INFO:tasks.workunit.client.0.smithi096.stderr: "status": "HEALTH_OK", 2024-09-16T03:26:09.120 INFO:tasks.workunit.client.0.smithi096.stderr: "checks": {}, 2024-09-16T03:26:09.120 INFO:tasks.workunit.client.0.smithi096.stderr: "mutes": [] 2024-09-16T03:26:09.120 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.120 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap_first_committed": 1, 2024-09-16T03:26:09.120 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap_last_committed": 1, 2024-09-16T03:26:09.120 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap": { 2024-09-16T03:26:09.121 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 1, 2024-09-16T03:26:09.121 INFO:tasks.workunit.client.0.smithi096.stderr: "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", 2024-09-16T03:26:09.121 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:22:45.872880Z", 2024-09-16T03:26:09.121 INFO:tasks.workunit.client.0.smithi096.stderr: "created": "2024-09-16T03:22:45.872880Z", 2024-09-16T03:26:09.121 INFO:tasks.workunit.client.0.smithi096.stderr: "min_mon_release": 19, 2024-09-16T03:26:09.121 INFO:tasks.workunit.client.0.smithi096.stderr: "min_mon_release_name": "squid", 2024-09-16T03:26:09.121 INFO:tasks.workunit.client.0.smithi096.stderr: "election_strategy": 1, 2024-09-16T03:26:09.121 INFO:tasks.workunit.client.0.smithi096.stderr: "disallowed_leaders: ": "", 2024-09-16T03:26:09.122 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode": false, 2024-09-16T03:26:09.122 INFO:tasks.workunit.client.0.smithi096.stderr: "tiebreaker_mon": "", 2024-09-16T03:26:09.122 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_ranks: ": "", 2024-09-16T03:26:09.122 INFO:tasks.workunit.client.0.smithi096.stderr: "features": { 2024-09-16T03:26:09.122 INFO:tasks.workunit.client.0.smithi096.stderr: "persistent": [ 2024-09-16T03:26:09.122 INFO:tasks.workunit.client.0.smithi096.stderr: "kraken", 2024-09-16T03:26:09.123 INFO:tasks.workunit.client.0.smithi096.stderr: "luminous", 2024-09-16T03:26:09.123 INFO:tasks.workunit.client.0.smithi096.stderr: "mimic", 2024-09-16T03:26:09.123 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap-prune", 2024-09-16T03:26:09.123 INFO:tasks.workunit.client.0.smithi096.stderr: "nautilus", 2024-09-16T03:26:09.123 INFO:tasks.workunit.client.0.smithi096.stderr: "octopus", 2024-09-16T03:26:09.123 INFO:tasks.workunit.client.0.smithi096.stderr: "pacific", 2024-09-16T03:26:09.123 INFO:tasks.workunit.client.0.smithi096.stderr: "elector-pinging", 2024-09-16T03:26:09.124 INFO:tasks.workunit.client.0.smithi096.stderr: "quincy", 2024-09-16T03:26:09.124 INFO:tasks.workunit.client.0.smithi096.stderr: "reef", 2024-09-16T03:26:09.124 INFO:tasks.workunit.client.0.smithi096.stderr: "squid" 2024-09-16T03:26:09.124 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:09.124 INFO:tasks.workunit.client.0.smithi096.stderr: "optional": [] 2024-09-16T03:26:09.124 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.125 INFO:tasks.workunit.client.0.smithi096.stderr: "mons": [ 2024-09-16T03:26:09.125 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.125 INFO:tasks.workunit.client.0.smithi096.stderr: "rank": 0, 2024-09-16T03:26:09.125 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "a", 2024-09-16T03:26:09.125 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:26:09.125 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:09.125 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.125 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:09.125 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:7302", 2024-09-16T03:26:09.125 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 0 2024-09-16T03:26:09.125 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:09.125 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:09.126 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.126 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:7302/0", 2024-09-16T03:26:09.126 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:7302/0", 2024-09-16T03:26:09.126 INFO:tasks.workunit.client.0.smithi096.stderr: "priority": 0, 2024-09-16T03:26:09.126 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 0, 2024-09-16T03:26:09.126 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_location": "{}" 2024-09-16T03:26:09.126 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:09.126 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:09.126 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.126 INFO:tasks.workunit.client.0.smithi096.stderr: "quorum": [ 2024-09-16T03:26:09.127 INFO:tasks.workunit.client.0.smithi096.stderr: 0 2024-09-16T03:26:09.127 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:09.127 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap": { 2024-09-16T03:26:09.127 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 86, 2024-09-16T03:26:09.127 INFO:tasks.workunit.client.0.smithi096.stderr: "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", 2024-09-16T03:26:09.127 INFO:tasks.workunit.client.0.smithi096.stderr: "created": "2024-09-16T03:22:46.906117+0000", 2024-09-16T03:26:09.127 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:26:02.230083+0000", 2024-09-16T03:26:09.127 INFO:tasks.workunit.client.0.smithi096.stderr: "last_up_change": "2024-09-16T03:25:08.513363+0000", 2024-09-16T03:26:09.127 INFO:tasks.workunit.client.0.smithi096.stderr: "last_in_change": "2024-09-16T03:25:09.839444+0000", 2024-09-16T03:26:09.127 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-16T03:26:09.127 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_num": 5799936, 2024-09-16T03:26:09.128 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_set": [ 2024-09-16T03:26:09.128 INFO:tasks.workunit.client.0.smithi096.stderr: "pglog_hardlimit", 2024-09-16T03:26:09.128 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snapdirs", 2024-09-16T03:26:09.128 INFO:tasks.workunit.client.0.smithi096.stderr: "recovery_deletes", 2024-09-16T03:26:09.128 INFO:tasks.workunit.client.0.smithi096.stderr: "sortbitwise" 2024-09-16T03:26:09.128 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:09.128 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_version": 7, 2024-09-16T03:26:09.128 INFO:tasks.workunit.client.0.smithi096.stderr: "full_ratio": 0.97000002861022949, 2024-09-16T03:26:09.128 INFO:tasks.workunit.client.0.smithi096.stderr: "backfillfull_ratio": 0.97000002861022949, 2024-09-16T03:26:09.128 INFO:tasks.workunit.client.0.smithi096.stderr: "nearfull_ratio": 0.85000002384185791, 2024-09-16T03:26:09.128 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_snapshot": "", 2024-09-16T03:26:09.128 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_max": 2, 2024-09-16T03:26:09.128 INFO:tasks.workunit.client.0.smithi096.stderr: "max_osd": 3, 2024-09-16T03:26:09.129 INFO:tasks.workunit.client.0.smithi096.stderr: "require_min_compat_client": "luminous", 2024-09-16T03:26:09.129 INFO:tasks.workunit.client.0.smithi096.stderr: "min_compat_client": "jewel", 2024-09-16T03:26:09.129 INFO:tasks.workunit.client.0.smithi096.stderr: "require_osd_release": "squid", 2024-09-16T03:26:09.129 INFO:tasks.workunit.client.0.smithi096.stderr: "allow_crimson": false, 2024-09-16T03:26:09.129 INFO:tasks.workunit.client.0.smithi096.stderr: "pools": [ 2024-09-16T03:26:09.129 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.129 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 1, 2024-09-16T03:26:09.129 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_name": "foo", 2024-09-16T03:26:09.129 INFO:tasks.workunit.client.0.smithi096.stderr: "create_time": "2024-09-16T03:24:44.525189+0000", 2024-09-16T03:26:09.129 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": 1, 2024-09-16T03:26:09.129 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_names": "hashpspool", 2024-09-16T03:26:09.129 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:26:09.129 INFO:tasks.workunit.client.0.smithi096.stderr: "size": 2, 2024-09-16T03:26:09.130 INFO:tasks.workunit.client.0.smithi096.stderr: "min_size": 1, 2024-09-16T03:26:09.130 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_rule": 0, 2024-09-16T03:26:09.130 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_count": 0, 2024-09-16T03:26:09.130 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_target": 0, 2024-09-16T03:26:09.130 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_barrier": 0, 2024-09-16T03:26:09.130 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-16T03:26:09.130 INFO:tasks.workunit.client.0.smithi096.stderr: "is_stretch_pool": false, 2024-09-16T03:26:09.130 INFO:tasks.workunit.client.0.smithi096.stderr: "object_hash": 2, 2024-09-16T03:26:09.130 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_autoscale_mode": "off", 2024-09-16T03:26:09.130 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num": 32, 2024-09-16T03:26:09.130 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num": 32, 2024-09-16T03:26:09.130 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num_target": 32, 2024-09-16T03:26:09.130 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_target": 32, 2024-09-16T03:26:09.130 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_pending": 32, 2024-09-16T03:26:09.130 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pg_merge_meta": { 2024-09-16T03:26:09.131 INFO:tasks.workunit.client.0.smithi096.stderr: "source_pgid": "0.0", 2024-09-16T03:26:09.131 INFO:tasks.workunit.client.0.smithi096.stderr: "ready_epoch": 0, 2024-09-16T03:26:09.131 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_started": 0, 2024-09-16T03:26:09.131 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": 0, 2024-09-16T03:26:09.131 INFO:tasks.workunit.client.0.smithi096.stderr: "source_version": "0'\''0", 2024-09-16T03:26:09.131 INFO:tasks.workunit.client.0.smithi096.stderr: "target_version": "0'\''0" 2024-09-16T03:26:09.131 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.131 INFO:tasks.workunit.client.0.smithi096.stderr: "last_change": "85", 2024-09-16T03:26:09.131 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend": "0", 2024-09-16T03:26:09.131 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_prenautilus": "0", 2024-09-16T03:26:09.131 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_preluminous": "0", 2024-09-16T03:26:09.131 INFO:tasks.workunit.client.0.smithi096.stderr: "auid": 0, 2024-09-16T03:26:09.131 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_mode": "selfmanaged", 2024-09-16T03:26:09.131 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_seq": 0, 2024-09-16T03:26:09.132 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_epoch": 0, 2024-09-16T03:26:09.132 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_snaps": [], 2024-09-16T03:26:09.132 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps": "[]", 2024-09-16T03:26:09.132 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_bytes": 0, 2024-09-16T03:26:09.132 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_objects": 0, 2024-09-16T03:26:09.132 INFO:tasks.workunit.client.0.smithi096.stderr: "tiers": [], 2024-09-16T03:26:09.133 INFO:tasks.workunit.client.0.smithi096.stderr: "tier_of": -1, 2024-09-16T03:26:09.133 INFO:tasks.workunit.client.0.smithi096.stderr: "read_tier": -1, 2024-09-16T03:26:09.133 INFO:tasks.workunit.client.0.smithi096.stderr: "write_tier": -1, 2024-09-16T03:26:09.133 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_mode": "none", 2024-09-16T03:26:09.133 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_bytes": 0, 2024-09-16T03:26:09.133 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_objects": 0, 2024-09-16T03:26:09.133 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_ratio_micro": 400000, 2024-09-16T03:26:09.133 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-16T03:26:09.133 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_full_ratio_micro": 800000, 2024-09-16T03:26:09.133 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_flush_age": 0, 2024-09-16T03:26:09.133 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_evict_age": 0, 2024-09-16T03:26:09.133 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profile": "", 2024-09-16T03:26:09.133 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_params": { 2024-09-16T03:26:09.133 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "none" 2024-09-16T03:26:09.134 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.134 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_period": 0, 2024-09-16T03:26:09.134 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_count": 0, 2024-09-16T03:26:09.134 INFO:tasks.workunit.client.0.smithi096.stderr: "use_gmt_hitset": true, 2024-09-16T03:26:09.134 INFO:tasks.workunit.client.0.smithi096.stderr: "min_read_recency_for_promote": 0, 2024-09-16T03:26:09.134 INFO:tasks.workunit.client.0.smithi096.stderr: "min_write_recency_for_promote": 0, 2024-09-16T03:26:09.134 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_grade_decay_rate": 0, 2024-09-16T03:26:09.134 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_search_last_n": 0, 2024-09-16T03:26:09.134 INFO:tasks.workunit.client.0.smithi096.stderr: "grade_table": [], 2024-09-16T03:26:09.134 INFO:tasks.workunit.client.0.smithi096.stderr: "stripe_width": 0, 2024-09-16T03:26:09.134 INFO:tasks.workunit.client.0.smithi096.stderr: "expected_num_objects": 0, 2024-09-16T03:26:09.134 INFO:tasks.workunit.client.0.smithi096.stderr: "fast_read": false, 2024-09-16T03:26:09.135 INFO:tasks.workunit.client.0.smithi096.stderr: "options": {}, 2024-09-16T03:26:09.135 INFO:tasks.workunit.client.0.smithi096.stderr: "application_metadata": {}, 2024-09-16T03:26:09.135 INFO:tasks.workunit.client.0.smithi096.stderr: "read_balance": { 2024-09-16T03:26:09.135 INFO:tasks.workunit.client.0.smithi096.stderr: "score_type": "Fair distribution", 2024-09-16T03:26:09.135 INFO:tasks.workunit.client.0.smithi096.stderr: "score_acting": 1.8700000047683716, 2024-09-16T03:26:09.135 INFO:tasks.workunit.client.0.smithi096.stderr: "score_stable": 1.8700000047683716, 2024-09-16T03:26:09.135 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_score": 0.67000001668930054, 2024-09-16T03:26:09.135 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_acting": 1.25, 2024-09-16T03:26:09.135 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_stable": 1.25, 2024-09-16T03:26:09.135 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity_weighted": 1, 2024-09-16T03:26:09.135 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity": 1, 2024-09-16T03:26:09.135 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity_weighted": 1 2024-09-16T03:26:09.135 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:09.135 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.136 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.136 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 2, 2024-09-16T03:26:09.136 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_name": "bar", 2024-09-16T03:26:09.136 INFO:tasks.workunit.client.0.smithi096.stderr: "create_time": "2024-09-16T03:24:46.226575+0000", 2024-09-16T03:26:09.136 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": 1, 2024-09-16T03:26:09.136 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_names": "hashpspool", 2024-09-16T03:26:09.136 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:26:09.136 INFO:tasks.workunit.client.0.smithi096.stderr: "size": 2, 2024-09-16T03:26:09.136 INFO:tasks.workunit.client.0.smithi096.stderr: "min_size": 1, 2024-09-16T03:26:09.136 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_rule": 0, 2024-09-16T03:26:09.136 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_count": 0, 2024-09-16T03:26:09.137 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_target": 0, 2024-09-16T03:26:09.137 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_barrier": 0, 2024-09-16T03:26:09.137 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-16T03:26:09.137 INFO:tasks.workunit.client.0.smithi096.stderr: "is_stretch_pool": false, 2024-09-16T03:26:09.137 INFO:tasks.workunit.client.0.smithi096.stderr: "object_hash": 2, 2024-09-16T03:26:09.137 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_autoscale_mode": "off", 2024-09-16T03:26:09.137 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num": 32, 2024-09-16T03:26:09.137 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num": 32, 2024-09-16T03:26:09.137 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num_target": 32, 2024-09-16T03:26:09.137 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_target": 32, 2024-09-16T03:26:09.137 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_pending": 32, 2024-09-16T03:26:09.137 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pg_merge_meta": { 2024-09-16T03:26:09.137 INFO:tasks.workunit.client.0.smithi096.stderr: "source_pgid": "0.0", 2024-09-16T03:26:09.137 INFO:tasks.workunit.client.0.smithi096.stderr: "ready_epoch": 0, 2024-09-16T03:26:09.138 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_started": 0, 2024-09-16T03:26:09.138 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": 0, 2024-09-16T03:26:09.138 INFO:tasks.workunit.client.0.smithi096.stderr: "source_version": "0'\''0", 2024-09-16T03:26:09.138 INFO:tasks.workunit.client.0.smithi096.stderr: "target_version": "0'\''0" 2024-09-16T03:26:09.138 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.138 INFO:tasks.workunit.client.0.smithi096.stderr: "last_change": "83", 2024-09-16T03:26:09.138 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend": "0", 2024-09-16T03:26:09.138 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_prenautilus": "0", 2024-09-16T03:26:09.138 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_preluminous": "0", 2024-09-16T03:26:09.139 INFO:tasks.workunit.client.0.smithi096.stderr: "auid": 0, 2024-09-16T03:26:09.139 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_mode": "selfmanaged", 2024-09-16T03:26:09.139 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_seq": 0, 2024-09-16T03:26:09.139 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_epoch": 0, 2024-09-16T03:26:09.139 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_snaps": [], 2024-09-16T03:26:09.139 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps": "[]", 2024-09-16T03:26:09.139 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_bytes": 0, 2024-09-16T03:26:09.139 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_objects": 0, 2024-09-16T03:26:09.140 INFO:tasks.workunit.client.0.smithi096.stderr: "tiers": [], 2024-09-16T03:26:09.140 INFO:tasks.workunit.client.0.smithi096.stderr: "tier_of": -1, 2024-09-16T03:26:09.140 INFO:tasks.workunit.client.0.smithi096.stderr: "read_tier": -1, 2024-09-16T03:26:09.140 INFO:tasks.workunit.client.0.smithi096.stderr: "write_tier": -1, 2024-09-16T03:26:09.140 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_mode": "none", 2024-09-16T03:26:09.140 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_bytes": 0, 2024-09-16T03:26:09.140 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_objects": 0, 2024-09-16T03:26:09.140 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_ratio_micro": 400000, 2024-09-16T03:26:09.140 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-16T03:26:09.140 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_full_ratio_micro": 800000, 2024-09-16T03:26:09.140 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_flush_age": 0, 2024-09-16T03:26:09.140 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_evict_age": 0, 2024-09-16T03:26:09.140 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profile": "", 2024-09-16T03:26:09.141 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_params": { 2024-09-16T03:26:09.141 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "none" 2024-09-16T03:26:09.141 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.141 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_period": 0, 2024-09-16T03:26:09.141 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_count": 0, 2024-09-16T03:26:09.141 INFO:tasks.workunit.client.0.smithi096.stderr: "use_gmt_hitset": true, 2024-09-16T03:26:09.141 INFO:tasks.workunit.client.0.smithi096.stderr: "min_read_recency_for_promote": 0, 2024-09-16T03:26:09.141 INFO:tasks.workunit.client.0.smithi096.stderr: "min_write_recency_for_promote": 0, 2024-09-16T03:26:09.141 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_grade_decay_rate": 0, 2024-09-16T03:26:09.141 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_search_last_n": 0, 2024-09-16T03:26:09.141 INFO:tasks.workunit.client.0.smithi096.stderr: "grade_table": [], 2024-09-16T03:26:09.142 INFO:tasks.workunit.client.0.smithi096.stderr: "stripe_width": 0, 2024-09-16T03:26:09.142 INFO:tasks.workunit.client.0.smithi096.stderr: "expected_num_objects": 0, 2024-09-16T03:26:09.142 INFO:tasks.workunit.client.0.smithi096.stderr: "fast_read": false, 2024-09-16T03:26:09.142 INFO:tasks.workunit.client.0.smithi096.stderr: "options": {}, 2024-09-16T03:26:09.142 INFO:tasks.workunit.client.0.smithi096.stderr: "application_metadata": {}, 2024-09-16T03:26:09.142 INFO:tasks.workunit.client.0.smithi096.stderr: "read_balance": { 2024-09-16T03:26:09.142 INFO:tasks.workunit.client.0.smithi096.stderr: "score_type": "Fair distribution", 2024-09-16T03:26:09.142 INFO:tasks.workunit.client.0.smithi096.stderr: "score_acting": 1.4900000095367432, 2024-09-16T03:26:09.142 INFO:tasks.workunit.client.0.smithi096.stderr: "score_stable": 1.4900000095367432, 2024-09-16T03:26:09.142 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_score": 0.67000001668930054, 2024-09-16T03:26:09.142 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_acting": 1, 2024-09-16T03:26:09.142 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_stable": 1, 2024-09-16T03:26:09.142 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity_weighted": 1, 2024-09-16T03:26:09.142 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity": 1, 2024-09-16T03:26:09.143 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity_weighted": 1 2024-09-16T03:26:09.143 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:09.143 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:09.143 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:09.143 INFO:tasks.workunit.client.0.smithi096.stderr: "osds": [ 2024-09-16T03:26:09.143 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.143 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:26:09.143 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6", 2024-09-16T03:26:09.143 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:26:09.143 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:26:09.143 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:26:09.143 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:26:09.143 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:26:09.144 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:26:09.144 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 5, 2024-09-16T03:26:09.144 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 84, 2024-09-16T03:26:09.144 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:26:09.144 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:26:09.144 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:26:09.144 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:09.144 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.144 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:09.144 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6802", 2024-09-16T03:26:09.144 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:26:09.144 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.144 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.144 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:09.145 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6803", 2024-09-16T03:26:09.145 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:26:09.145 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:09.145 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:09.145 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.145 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:26:09.145 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:09.145 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.145 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:09.145 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6804", 2024-09-16T03:26:09.145 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:26:09.146 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.146 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.146 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:09.146 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6805", 2024-09-16T03:26:09.146 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:26:09.146 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:09.146 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:09.146 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.146 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:26:09.146 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:09.146 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.146 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:09.146 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6808", 2024-09-16T03:26:09.146 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:26:09.147 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.147 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.147 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:09.147 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6809", 2024-09-16T03:26:09.147 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:26:09.147 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:09.147 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:09.147 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.147 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:26:09.147 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:09.147 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.147 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:09.147 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6806", 2024-09-16T03:26:09.147 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:26:09.148 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.148 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.148 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:09.148 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6807", 2024-09-16T03:26:09.148 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:26:09.148 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:09.148 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:09.148 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.148 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6803/3375787448", 2024-09-16T03:26:09.149 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6805/3375787448", 2024-09-16T03:26:09.149 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6809/3375787448", 2024-09-16T03:26:09.149 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6807/3375787448", 2024-09-16T03:26:09.149 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:26:09.149 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:26:09.149 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:26:09.149 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:09.149 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.149 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.149 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:26:09.149 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "74b26727-75c9-444d-8782-719e4197a382", 2024-09-16T03:26:09.149 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:26:09.149 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:26:09.150 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:26:09.150 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:26:09.150 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:26:09.150 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:26:09.150 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 10, 2024-09-16T03:26:09.150 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 84, 2024-09-16T03:26:09.150 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:26:09.150 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:26:09.150 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:26:09.150 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:09.150 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.150 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:09.150 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6810", 2024-09-16T03:26:09.150 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:26:09.151 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.151 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.151 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:09.151 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6811", 2024-09-16T03:26:09.151 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:26:09.151 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:09.151 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:09.151 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.151 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:26:09.151 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:09.151 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.151 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:09.151 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6812", 2024-09-16T03:26:09.152 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:26:09.152 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.152 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.152 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:09.152 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6813", 2024-09-16T03:26:09.152 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:26:09.152 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:09.152 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:09.152 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.153 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:26:09.153 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:09.153 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.153 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:09.153 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6816", 2024-09-16T03:26:09.153 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:26:09.153 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.153 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.153 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:09.153 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6817", 2024-09-16T03:26:09.154 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:26:09.154 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:09.154 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:09.154 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.154 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:26:09.154 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:09.154 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.154 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:09.154 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6814", 2024-09-16T03:26:09.154 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:26:09.155 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.155 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.155 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:09.155 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6815", 2024-09-16T03:26:09.155 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:26:09.155 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:09.155 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:09.155 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.155 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6811/3733255132", 2024-09-16T03:26:09.156 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6813/3733255132", 2024-09-16T03:26:09.156 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6817/3733255132", 2024-09-16T03:26:09.156 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6815/3733255132", 2024-09-16T03:26:09.156 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:26:09.156 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:26:09.156 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:26:09.156 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:09.156 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.156 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.156 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:26:09.157 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "143da3a7-dad9-4b1e-966b-76cf5bdd3c82", 2024-09-16T03:26:09.157 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 0, 2024-09-16T03:26:09.157 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 0, 2024-09-16T03:26:09.157 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 0, 2024-09-16T03:26:09.157 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:26:09.157 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:26:09.157 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:26:09.157 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 15, 2024-09-16T03:26:09.157 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 21, 2024-09-16T03:26:09.157 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 33, 2024-09-16T03:26:09.158 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:26:09.158 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:26:09.158 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:09.158 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.158 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:09.158 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6818", 2024-09-16T03:26:09.158 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:26:09.158 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.158 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.158 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:09.158 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6819", 2024-09-16T03:26:09.158 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:26:09.158 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:09.158 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:09.159 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.159 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:26:09.159 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:09.159 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.159 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:09.159 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6820", 2024-09-16T03:26:09.159 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:26:09.159 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.159 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.159 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:09.159 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6821", 2024-09-16T03:26:09.159 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:26:09.159 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:09.160 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:09.160 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.160 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:26:09.160 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:09.160 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.160 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:09.160 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6824", 2024-09-16T03:26:09.161 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:26:09.161 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.161 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.161 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:09.161 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6825", 2024-09-16T03:26:09.161 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:26:09.161 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:09.161 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:09.161 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.161 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:26:09.161 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:09.162 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.162 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:09.162 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6822", 2024-09-16T03:26:09.162 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:26:09.162 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.162 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.162 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:09.162 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6823", 2024-09-16T03:26:09.162 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:26:09.162 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:09.162 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:09.163 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.163 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6819/963814857", 2024-09-16T03:26:09.163 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6821/963814857", 2024-09-16T03:26:09.163 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6825/963814857", 2024-09-16T03:26:09.164 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6823/963814857", 2024-09-16T03:26:09.164 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:26:09.164 INFO:tasks.workunit.client.0.smithi096.stderr: "exists" 2024-09-16T03:26:09.164 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:09.164 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:09.165 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:09.165 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_xinfo": [ 2024-09-16T03:26:09.165 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.165 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:26:09.165 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:26:09.165 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:26:09.165 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:26:09.165 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:26:09.165 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:26:09.165 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:23:22.481942+0000", 2024-09-16T03:26:09.165 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:26:09.166 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.166 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.166 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:26:09.166 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:26:09.166 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:26:09.166 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:26:09.166 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:26:09.166 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:26:09.166 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:23:59.663703+0000", 2024-09-16T03:26:09.166 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:26:09.166 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.166 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.166 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:26:09.166 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:26:09.167 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:26:09.167 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:26:09.167 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:26:09.167 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 65536, 2024-09-16T03:26:09.167 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:24:37.320822+0000", 2024-09-16T03:26:09.167 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 32 2024-09-16T03:26:09.167 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:09.167 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:09.167 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap": [], 2024-09-16T03:26:09.167 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap_items": [], 2024-09-16T03:26:09.167 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap_primaries": [], 2024-09-16T03:26:09.168 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_temp": [], 2024-09-16T03:26:09.168 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_temp": [], 2024-09-16T03:26:09.168 INFO:tasks.workunit.client.0.smithi096.stderr: "blocklist": {}, 2024-09-16T03:26:09.168 INFO:tasks.workunit.client.0.smithi096.stderr: "range_blocklist": {}, 2024-09-16T03:26:09.168 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profiles": { 2024-09-16T03:26:09.168 INFO:tasks.workunit.client.0.smithi096.stderr: "default": { 2024-09-16T03:26:09.168 INFO:tasks.workunit.client.0.smithi096.stderr: "k": "2", 2024-09-16T03:26:09.168 INFO:tasks.workunit.client.0.smithi096.stderr: "m": "2", 2024-09-16T03:26:09.168 INFO:tasks.workunit.client.0.smithi096.stderr: "plugin": "jerasure", 2024-09-16T03:26:09.168 INFO:tasks.workunit.client.0.smithi096.stderr: "technique": "reed_sol_van" 2024-09-16T03:26:09.169 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:09.169 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.169 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps_queue": [], 2024-09-16T03:26:09.169 INFO:tasks.workunit.client.0.smithi096.stderr: "new_removed_snaps": [], 2024-09-16T03:26:09.169 INFO:tasks.workunit.client.0.smithi096.stderr: "new_purged_snaps": [], 2024-09-16T03:26:09.169 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_node_flags": {}, 2024-09-16T03:26:09.169 INFO:tasks.workunit.client.0.smithi096.stderr: "device_class_flags": {}, 2024-09-16T03:26:09.169 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode": { 2024-09-16T03:26:09.169 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode_enabled": false, 2024-09-16T03:26:09.169 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_bucket_count": 0, 2024-09-16T03:26:09.169 INFO:tasks.workunit.client.0.smithi096.stderr: "degraded_stretch_mode": 0, 2024-09-16T03:26:09.169 INFO:tasks.workunit.client.0.smithi096.stderr: "recovering_stretch_mode": 0, 2024-09-16T03:26:09.169 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode_bucket": 0 2024-09-16T03:26:09.170 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:09.170 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.170 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_metadata": [ 2024-09-16T03:26:09.170 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.170 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:26:09.170 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:26:09.170 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]", 2024-09-16T03:26:09.170 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:26:09.170 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:26:09.170 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:26:09.170 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:26:09.170 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:26:09.170 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:26:09.170 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:26:09.171 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:26:09.171 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:26:09.171 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:26:09.171 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:26:09.171 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/0/block", 2024-09-16T03:26:09.171 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:26:09.171 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:26:09.171 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:26:09.171 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:26:09.171 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:26:09.171 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:26:09.171 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:26:09.171 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:26:09.171 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:26:09.172 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:26:09.172 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:22:53.662571Z", 2024-09-16T03:26:09.172 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:26:09.172 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:26:09.172 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:26:09.172 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:26:09.172 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:26:09.172 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:26:09.172 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:26:09.172 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]", 2024-09-16T03:26:09.172 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:26:09.172 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]", 2024-09-16T03:26:09.172 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]", 2024-09-16T03:26:09.172 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:26:09.173 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:26:09.173 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:26:09.173 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:26:09.173 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:26:09.173 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:26:09.173 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:26:09.173 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:26:09.173 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:26:09.173 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/0", 2024-09-16T03:26:09.173 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:26:09.173 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:26:09.173 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:26:09.174 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.174 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.174 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:26:09.174 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:26:09.174 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]", 2024-09-16T03:26:09.174 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:26:09.174 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:26:09.174 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:26:09.174 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:26:09.174 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:26:09.174 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:26:09.174 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:26:09.174 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:26:09.174 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:26:09.175 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:26:09.175 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:26:09.175 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/1/block", 2024-09-16T03:26:09.175 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:26:09.175 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:26:09.175 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:26:09.175 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:26:09.175 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:26:09.175 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:26:09.176 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:26:09.176 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:26:09.176 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:26:09.176 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:26:09.176 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:23:30.129885Z", 2024-09-16T03:26:09.176 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:26:09.176 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:26:09.177 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:26:09.177 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:26:09.177 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:26:09.177 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:26:09.177 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:26:09.178 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]", 2024-09-16T03:26:09.178 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:26:09.178 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]", 2024-09-16T03:26:09.178 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]", 2024-09-16T03:26:09.178 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:26:09.178 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:26:09.178 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:26:09.179 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:26:09.179 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:26:09.179 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:26:09.179 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:26:09.179 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:26:09.179 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:26:09.180 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/1", 2024-09-16T03:26:09.180 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:26:09.180 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:26:09.180 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:26:09.180 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.181 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.181 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:26:09.181 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:26:09.181 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]", 2024-09-16T03:26:09.181 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:26:09.181 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:26:09.182 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:26:09.182 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:26:09.182 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:26:09.182 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:26:09.182 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:26:09.182 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:26:09.183 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:26:09.183 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:26:09.183 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:26:09.183 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/2/block", 2024-09-16T03:26:09.183 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:26:09.184 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:26:09.184 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:26:09.184 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:26:09.184 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:26:09.184 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:26:09.184 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:26:09.185 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:26:09.185 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:26:09.185 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:26:09.185 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:24:07.764502Z", 2024-09-16T03:26:09.185 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:26:09.185 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:26:09.185 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:26:09.185 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:26:09.185 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:26:09.186 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:26:09.186 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:26:09.186 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]", 2024-09-16T03:26:09.186 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:26:09.186 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]", 2024-09-16T03:26:09.186 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]", 2024-09-16T03:26:09.186 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:26:09.186 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:26:09.186 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:26:09.186 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:26:09.186 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:26:09.186 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:26:09.186 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:26:09.186 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:26:09.187 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:26:09.187 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/2", 2024-09-16T03:26:09.187 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:26:09.187 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:26:09.187 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:26:09.187 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:09.187 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:09.187 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_clean_epochs": { 2024-09-16T03:26:09.187 INFO:tasks.workunit.client.0.smithi096.stderr: "min_last_epoch_clean": 86, 2024-09-16T03:26:09.187 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": { 2024-09-16T03:26:09.187 INFO:tasks.workunit.client.0.smithi096.stderr: "per_pool": [ 2024-09-16T03:26:09.187 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.187 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 1, 2024-09-16T03:26:09.187 INFO:tasks.workunit.client.0.smithi096.stderr: "floor": 86 2024-09-16T03:26:09.187 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.188 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.188 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 2, 2024-09-16T03:26:09.188 INFO:tasks.workunit.client.0.smithi096.stderr: "floor": 86 2024-09-16T03:26:09.188 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:09.188 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:09.188 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.188 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_epochs": [ 2024-09-16T03:26:09.188 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.188 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:26:09.188 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 86 2024-09-16T03:26:09.188 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.188 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.188 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:26:09.188 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 86 2024-09-16T03:26:09.189 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:09.189 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:09.189 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.189 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_first_committed": 84, 2024-09-16T03:26:09.189 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_last_committed": 86, 2024-09-16T03:26:09.189 INFO:tasks.workunit.client.0.smithi096.stderr: "crushmap": { 2024-09-16T03:26:09.189 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": [ 2024-09-16T03:26:09.189 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.189 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:26:09.189 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.0", 2024-09-16T03:26:09.189 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:26:09.189 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.189 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.189 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:26:09.189 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.1", 2024-09-16T03:26:09.190 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:26:09.190 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.190 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.190 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:26:09.190 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.2", 2024-09-16T03:26:09.190 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:26:09.190 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:09.190 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:09.190 INFO:tasks.workunit.client.0.smithi096.stderr: "types": [ 2024-09-16T03:26:09.190 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.191 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 0, 2024-09-16T03:26:09.191 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd" 2024-09-16T03:26:09.191 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.191 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.191 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:26:09.191 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "host" 2024-09-16T03:26:09.191 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.191 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.191 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 2, 2024-09-16T03:26:09.191 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "chassis" 2024-09-16T03:26:09.191 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.191 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.191 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 3, 2024-09-16T03:26:09.191 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "rack" 2024-09-16T03:26:09.192 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.192 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.192 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 4, 2024-09-16T03:26:09.192 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "row" 2024-09-16T03:26:09.192 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.192 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.192 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 5, 2024-09-16T03:26:09.192 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "pdu" 2024-09-16T03:26:09.192 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.192 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.192 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 6, 2024-09-16T03:26:09.192 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "pod" 2024-09-16T03:26:09.192 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.192 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.193 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 7, 2024-09-16T03:26:09.193 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "room" 2024-09-16T03:26:09.193 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.193 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.193 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 8, 2024-09-16T03:26:09.193 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "datacenter" 2024-09-16T03:26:09.193 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.193 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.193 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 9, 2024-09-16T03:26:09.193 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "zone" 2024-09-16T03:26:09.193 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.193 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.193 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 10, 2024-09-16T03:26:09.193 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "region" 2024-09-16T03:26:09.194 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.194 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.194 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:26:09.194 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "root" 2024-09-16T03:26:09.194 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:09.194 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:09.194 INFO:tasks.workunit.client.0.smithi096.stderr: "buckets": [ 2024-09-16T03:26:09.194 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.194 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -1, 2024-09-16T03:26:09.194 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "default", 2024-09-16T03:26:09.194 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:26:09.194 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "root", 2024-09-16T03:26:09.195 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:26:09.195 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:26:09.195 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:26:09.195 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:26:09.195 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.195 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -3, 2024-09-16T03:26:09.195 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:26:09.195 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:26:09.195 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:09.195 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:09.195 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.195 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.195 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -2, 2024-09-16T03:26:09.195 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "default~hdd", 2024-09-16T03:26:09.196 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:26:09.196 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "root", 2024-09-16T03:26:09.196 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:26:09.196 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:26:09.196 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:26:09.196 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:26:09.196 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.196 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -4, 2024-09-16T03:26:09.196 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:26:09.196 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:26:09.196 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:09.196 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:09.196 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.196 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.197 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -3, 2024-09-16T03:26:09.197 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "smithi096", 2024-09-16T03:26:09.197 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:26:09.197 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "host", 2024-09-16T03:26:09.197 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:26:09.197 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:26:09.197 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:26:09.197 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:26:09.197 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.197 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:26:09.197 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:26:09.197 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:26:09.197 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.197 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.198 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:26:09.198 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:26:09.198 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 1 2024-09-16T03:26:09.198 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.198 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.198 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:26:09.198 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:26:09.198 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 2 2024-09-16T03:26:09.198 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:09.198 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:09.198 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.198 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.198 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -4, 2024-09-16T03:26:09.198 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "smithi096~hdd", 2024-09-16T03:26:09.199 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:26:09.199 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "host", 2024-09-16T03:26:09.199 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:26:09.199 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:26:09.199 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:26:09.199 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:26:09.199 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.199 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:26:09.199 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:26:09.199 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:26:09.199 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.199 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.199 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:26:09.199 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:26:09.199 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 1 2024-09-16T03:26:09.200 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.200 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.200 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:26:09.200 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:26:09.200 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 2 2024-09-16T03:26:09.200 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:09.200 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:09.200 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:09.200 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:09.200 INFO:tasks.workunit.client.0.smithi096.stderr: "rules": [ 2024-09-16T03:26:09.200 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.200 INFO:tasks.workunit.client.0.smithi096.stderr: "rule_id": 0, 2024-09-16T03:26:09.200 INFO:tasks.workunit.client.0.smithi096.stderr: "rule_name": "replicated_rule", 2024-09-16T03:26:09.201 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:26:09.201 INFO:tasks.workunit.client.0.smithi096.stderr: "steps": [ 2024-09-16T03:26:09.201 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.201 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "take", 2024-09-16T03:26:09.201 INFO:tasks.workunit.client.0.smithi096.stderr: "item": -1, 2024-09-16T03:26:09.201 INFO:tasks.workunit.client.0.smithi096.stderr: "item_name": "default" 2024-09-16T03:26:09.201 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.201 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.201 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "choose_firstn", 2024-09-16T03:26:09.201 INFO:tasks.workunit.client.0.smithi096.stderr: "num": 0, 2024-09-16T03:26:09.201 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "osd" 2024-09-16T03:26:09.201 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.201 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.201 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "emit" 2024-09-16T03:26:09.202 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:09.202 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:09.202 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:09.202 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:09.202 INFO:tasks.workunit.client.0.smithi096.stderr: "tunables": { 2024-09-16T03:26:09.202 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_local_tries": 0, 2024-09-16T03:26:09.202 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_local_fallback_tries": 0, 2024-09-16T03:26:09.202 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_total_tries": 50, 2024-09-16T03:26:09.202 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_descend_once": 1, 2024-09-16T03:26:09.202 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_vary_r": 1, 2024-09-16T03:26:09.202 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_stable": 1, 2024-09-16T03:26:09.202 INFO:tasks.workunit.client.0.smithi096.stderr: "msr_descents": 100, 2024-09-16T03:26:09.202 INFO:tasks.workunit.client.0.smithi096.stderr: "msr_collision_tries": 100, 2024-09-16T03:26:09.202 INFO:tasks.workunit.client.0.smithi096.stderr: "straw_calc_version": 1, 2024-09-16T03:26:09.203 INFO:tasks.workunit.client.0.smithi096.stderr: "allowed_bucket_algs": 54, 2024-09-16T03:26:09.203 INFO:tasks.workunit.client.0.smithi096.stderr: "profile": "jewel", 2024-09-16T03:26:09.203 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_tunables": 1, 2024-09-16T03:26:09.203 INFO:tasks.workunit.client.0.smithi096.stderr: "legacy_tunables": 0, 2024-09-16T03:26:09.203 INFO:tasks.workunit.client.0.smithi096.stderr: "minimum_required_version": "jewel", 2024-09-16T03:26:09.203 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables": 1, 2024-09-16T03:26:09.203 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables2": 1, 2024-09-16T03:26:09.203 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v2_rules": 0, 2024-09-16T03:26:09.203 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables3": 1, 2024-09-16T03:26:09.203 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v3_rules": 0, 2024-09-16T03:26:09.203 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v4_buckets": 1, 2024-09-16T03:26:09.203 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables5": 1, 2024-09-16T03:26:09.203 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v5_rules": 0, 2024-09-16T03:26:09.203 INFO:tasks.workunit.client.0.smithi096.stderr: "has_msr_rules": 0 2024-09-16T03:26:09.204 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.204 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_args": {} 2024-09-16T03:26:09.204 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.204 INFO:tasks.workunit.client.0.smithi096.stderr: "fsmap": { 2024-09-16T03:26:09.204 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 1, 2024-09-16T03:26:09.204 INFO:tasks.workunit.client.0.smithi096.stderr: "btime": "2024-09-16T03:22:46:882186+0000", 2024-09-16T03:26:09.204 INFO:tasks.workunit.client.0.smithi096.stderr: "default_fscid": -1, 2024-09-16T03:26:09.204 INFO:tasks.workunit.client.0.smithi096.stderr: "compat": { 2024-09-16T03:26:09.204 INFO:tasks.workunit.client.0.smithi096.stderr: "compat": {}, 2024-09-16T03:26:09.204 INFO:tasks.workunit.client.0.smithi096.stderr: "ro_compat": {}, 2024-09-16T03:26:09.204 INFO:tasks.workunit.client.0.smithi096.stderr: "incompat": { 2024-09-16T03:26:09.204 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_1": "base v0.20", 2024-09-16T03:26:09.204 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_2": "client writeable ranges", 2024-09-16T03:26:09.205 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_3": "default file layouts on dirs", 2024-09-16T03:26:09.205 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_4": "dir inode in separate object", 2024-09-16T03:26:09.205 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_5": "mds uses versioned encoding", 2024-09-16T03:26:09.205 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_6": "dirfrag is stored in omap", 2024-09-16T03:26:09.205 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_8": "no anchor table", 2024-09-16T03:26:09.205 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_9": "file layout v2", 2024-09-16T03:26:09.205 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_10": "snaprealm v2", 2024-09-16T03:26:09.205 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_11": "minor log segments", 2024-09-16T03:26:09.205 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_12": "quiesce subvolumes" 2024-09-16T03:26:09.205 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:09.205 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.205 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_flags": { 2024-09-16T03:26:09.205 INFO:tasks.workunit.client.0.smithi096.stderr: "enable_multiple": true, 2024-09-16T03:26:09.205 INFO:tasks.workunit.client.0.smithi096.stderr: "ever_enabled_multiple": true 2024-09-16T03:26:09.206 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.206 INFO:tasks.workunit.client.0.smithi096.stderr: "standbys": [], 2024-09-16T03:26:09.206 INFO:tasks.workunit.client.0.smithi096.stderr: "filesystems": [] 2024-09-16T03:26:09.206 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.206 INFO:tasks.workunit.client.0.smithi096.stderr: "mdsmap_first_committed": 1, 2024-09-16T03:26:09.206 INFO:tasks.workunit.client.0.smithi096.stderr: "mdsmap_last_committed": 1, 2024-09-16T03:26:09.206 INFO:tasks.workunit.client.0.smithi096.stderr: "auth": { 2024-09-16T03:26:09.206 INFO:tasks.workunit.client.0.smithi096.stderr: "first_committed": 1, 2024-09-16T03:26:09.206 INFO:tasks.workunit.client.0.smithi096.stderr: "last_committed": 5, 2024-09-16T03:26:09.206 INFO:tasks.workunit.client.0.smithi096.stderr: "num_secrets": 3 2024-09-16T03:26:09.206 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.206 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 64, 2024-09-16T03:26:09.206 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_active": 64, 2024-09-16T03:26:09.206 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_unknown": 0, 2024-09-16T03:26:09.207 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osd": 3, 2024-09-16T03:26:09.207 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_sum": { 2024-09-16T03:26:09.207 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:26:09.207 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:26:09.207 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:26:09.207 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:26:09.207 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:26:09.207 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:26:09.207 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:26:09.207 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:26:09.207 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:26:09.207 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:26:09.207 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:26:09.207 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:26:09.207 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:26:09.208 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:26:09.208 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:26:09.208 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:26:09.208 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:26:09.208 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:26:09.208 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:26:09.208 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:26:09.208 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:26:09.208 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:26:09.208 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:26:09.208 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:26:09.208 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:26:09.208 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:26:09.208 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:26:09.209 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:26:09.209 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:26:09.209 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:26:09.209 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:26:09.209 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:26:09.209 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:26:09.209 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:26:09.209 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:26:09.209 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:26:09.209 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:26:09.209 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:26:09.209 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:26:09.209 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:26:09.209 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:26:09.210 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.210 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:26:09.210 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:26:09.210 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:26:09.210 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:26:09.210 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:26:09.210 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:26:09.210 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:26:09.210 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:26:09.210 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:26:09.210 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:26:09.210 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:26:09.210 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.210 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:26:09.210 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:26:09.211 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 128, 2024-09-16T03:26:09.211 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 128, 2024-09-16T03:26:09.211 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 0 2024-09-16T03:26:09.211 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.211 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_sum": { 2024-09-16T03:26:09.211 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 0, 2024-09-16T03:26:09.211 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 0, 2024-09-16T03:26:09.211 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pgs": 128, 2024-09-16T03:26:09.211 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osds": 2, 2024-09-16T03:26:09.211 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_osds": 2, 2024-09-16T03:26:09.211 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_omap_osds": 2, 2024-09-16T03:26:09.211 INFO:tasks.workunit.client.0.smithi096.stderr: "kb": 209715200, 2024-09-16T03:26:09.211 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used": 54640, 2024-09-16T03:26:09.211 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_data": 960, 2024-09-16T03:26:09.212 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_omap": 3, 2024-09-16T03:26:09.212 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_meta": 53628, 2024-09-16T03:26:09.212 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_avail": 209660560, 2024-09-16T03:26:09.212 INFO:tasks.workunit.client.0.smithi096.stderr: "statfs": { 2024-09-16T03:26:09.212 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 214748364800, 2024-09-16T03:26:09.212 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 214692413440, 2024-09-16T03:26:09.212 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:26:09.212 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 983040, 2024-09-16T03:26:09.212 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 369948, 2024-09-16T03:26:09.212 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:26:09.212 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:26:09.212 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:26:09.212 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 3190, 2024-09-16T03:26:09.213 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 54915978 2024-09-16T03:26:09.213 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.213 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_peers": [], 2024-09-16T03:26:09.213 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_trim_queue_len": 0, 2024-09-16T03:26:09.213 INFO:tasks.workunit.client.0.smithi096.stderr: "num_snap_trimming": 0, 2024-09-16T03:26:09.213 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shards_repaired": 0, 2024-09-16T03:26:09.213 INFO:tasks.workunit.client.0.smithi096.stderr: "op_queue_age_hist": { 2024-09-16T03:26:09.213 INFO:tasks.workunit.client.0.smithi096.stderr: "histogram": [], 2024-09-16T03:26:09.213 INFO:tasks.workunit.client.0.smithi096.stderr: "upper_bound": 1 2024-09-16T03:26:09.213 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.213 INFO:tasks.workunit.client.0.smithi096.stderr: "perf_stat": { 2024-09-16T03:26:09.213 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ms": 325, 2024-09-16T03:26:09.213 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ms": 325, 2024-09-16T03:26:09.214 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ns": 325000000, 2024-09-16T03:26:09.214 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ns": 325000000 2024-09-16T03:26:09.214 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.214 INFO:tasks.workunit.client.0.smithi096.stderr: "alerts": [], 2024-09-16T03:26:09.214 INFO:tasks.workunit.client.0.smithi096.stderr: "network_ping_times": [] 2024-09-16T03:26:09.214 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.214 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_sum_by_class": { 2024-09-16T03:26:09.214 INFO:tasks.workunit.client.0.smithi096.stderr: "hdd": { 2024-09-16T03:26:09.214 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 0, 2024-09-16T03:26:09.214 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 0, 2024-09-16T03:26:09.214 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pgs": 128, 2024-09-16T03:26:09.214 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osds": 2, 2024-09-16T03:26:09.214 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_osds": 2, 2024-09-16T03:26:09.214 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_omap_osds": 2, 2024-09-16T03:26:09.214 INFO:tasks.workunit.client.0.smithi096.stderr: "kb": 209715200, 2024-09-16T03:26:09.215 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used": 54640, 2024-09-16T03:26:09.215 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_data": 960, 2024-09-16T03:26:09.215 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_omap": 3, 2024-09-16T03:26:09.215 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_meta": 53628, 2024-09-16T03:26:09.215 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_avail": 209660560, 2024-09-16T03:26:09.215 INFO:tasks.workunit.client.0.smithi096.stderr: "statfs": { 2024-09-16T03:26:09.215 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 214748364800, 2024-09-16T03:26:09.215 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 214692413440, 2024-09-16T03:26:09.215 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:26:09.215 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 983040, 2024-09-16T03:26:09.215 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 369948, 2024-09-16T03:26:09.215 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:26:09.215 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:26:09.216 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:26:09.216 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 3190, 2024-09-16T03:26:09.216 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 54915978 2024-09-16T03:26:09.216 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.216 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_peers": [], 2024-09-16T03:26:09.216 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_trim_queue_len": 0, 2024-09-16T03:26:09.216 INFO:tasks.workunit.client.0.smithi096.stderr: "num_snap_trimming": 0, 2024-09-16T03:26:09.216 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shards_repaired": 0, 2024-09-16T03:26:09.216 INFO:tasks.workunit.client.0.smithi096.stderr: "op_queue_age_hist": { 2024-09-16T03:26:09.216 INFO:tasks.workunit.client.0.smithi096.stderr: "histogram": [], 2024-09-16T03:26:09.216 INFO:tasks.workunit.client.0.smithi096.stderr: "upper_bound": 1 2024-09-16T03:26:09.216 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.216 INFO:tasks.workunit.client.0.smithi096.stderr: "perf_stat": { 2024-09-16T03:26:09.216 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ms": 325, 2024-09-16T03:26:09.217 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ms": 325, 2024-09-16T03:26:09.217 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ns": 325000000, 2024-09-16T03:26:09.217 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ns": 325000000 2024-09-16T03:26:09.217 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.217 INFO:tasks.workunit.client.0.smithi096.stderr: "alerts": [], 2024-09-16T03:26:09.217 INFO:tasks.workunit.client.0.smithi096.stderr: "network_ping_times": [] 2024-09-16T03:26:09.217 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:09.217 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.217 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_stats": [ 2024-09-16T03:26:09.217 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.217 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 2, 2024-09-16T03:26:09.217 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 32, 2024-09-16T03:26:09.217 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:26:09.217 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:26:09.217 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:26:09.218 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:26:09.218 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:26:09.218 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:26:09.218 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:26:09.218 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:26:09.218 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:26:09.218 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:26:09.218 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:26:09.218 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:26:09.218 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:26:09.218 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:26:09.218 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:26:09.218 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:26:09.218 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:26:09.219 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:26:09.219 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:26:09.219 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:26:09.219 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:26:09.219 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:26:09.219 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:26:09.219 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:26:09.219 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:26:09.219 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:26:09.219 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:26:09.219 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:26:09.219 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:26:09.219 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:26:09.219 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:26:09.220 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:26:09.220 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:26:09.220 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:26:09.220 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:26:09.220 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:26:09.220 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:26:09.220 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:26:09.220 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:26:09.220 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:26:09.220 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:26:09.220 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.220 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:26:09.220 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:26:09.221 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:26:09.221 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:26:09.221 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:26:09.221 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:26:09.221 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:26:09.221 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:26:09.221 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:26:09.221 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:26:09.221 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:26:09.221 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.221 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:26:09.221 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:26:09.221 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 64, 2024-09-16T03:26:09.222 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 64, 2024-09-16T03:26:09.222 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 3 2024-09-16T03:26:09.222 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.222 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.222 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 1, 2024-09-16T03:26:09.222 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 32, 2024-09-16T03:26:09.222 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:26:09.222 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:26:09.222 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:26:09.222 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:26:09.222 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:26:09.222 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:26:09.222 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:26:09.223 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:26:09.223 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:26:09.223 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:26:09.223 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:26:09.223 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:26:09.223 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:26:09.223 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:26:09.223 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:26:09.223 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:26:09.223 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:26:09.223 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:26:09.223 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:26:09.223 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:26:09.223 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:26:09.224 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:26:09.224 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:26:09.224 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:26:09.224 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:26:09.224 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:26:09.224 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:26:09.224 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:26:09.224 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:26:09.224 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:26:09.224 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:26:09.224 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:26:09.224 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:26:09.224 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:26:09.225 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:26:09.225 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:26:09.225 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:26:09.225 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:26:09.225 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:26:09.225 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:26:09.225 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:26:09.225 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.225 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:26:09.225 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:26:09.225 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:26:09.225 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:26:09.225 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:26:09.225 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:26:09.226 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:26:09.226 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:26:09.226 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:26:09.226 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:26:09.226 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:26:09.226 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.226 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:26:09.226 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:26:09.226 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 64, 2024-09-16T03:26:09.226 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 64, 2024-09-16T03:26:09.226 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 3 2024-09-16T03:26:09.226 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:09.226 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:09.226 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_stats": [ 2024-09-16T03:26:09.227 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.227 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:26:09.227 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 21474836521 2024-09-16T03:26:09.227 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.227 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.227 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:26:09.227 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 42949672993 2024-09-16T03:26:09.227 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.227 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.227 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:26:09.227 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 0 2024-09-16T03:26:09.227 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:09.227 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:09.228 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_by_state": [ 2024-09-16T03:26:09.228 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.228 INFO:tasks.workunit.client.0.smithi096.stderr: "state": "active+clean", 2024-09-16T03:26:09.228 INFO:tasks.workunit.client.0.smithi096.stderr: "num": 64 2024-09-16T03:26:09.228 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:09.228 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:09.228 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_by_osd": [ 2024-09-16T03:26:09.228 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.228 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:26:09.228 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 0, 2024-09-16T03:26:09.228 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 0, 2024-09-16T03:26:09.228 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:26:09.228 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.228 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.229 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:26:09.229 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 28, 2024-09-16T03:26:09.229 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 64, 2024-09-16T03:26:09.229 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:26:09.229 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.229 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.229 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:26:09.229 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 36, 2024-09-16T03:26:09.229 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 64, 2024-09-16T03:26:09.229 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:26:09.229 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:09.229 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:09.229 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": [ 2024-09-16T03:26:09.230 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.230 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 1, 2024-09-16T03:26:09.230 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": {} 2024-09-16T03:26:09.230 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.230 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.230 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 2, 2024-09-16T03:26:09.230 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": {} 2024-09-16T03:26:09.230 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:09.230 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:09.230 INFO:tasks.workunit.client.0.smithi096.stderr: "servicemap": { 2024-09-16T03:26:09.230 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 5, 2024-09-16T03:26:09.230 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:25:38.422788+0000", 2024-09-16T03:26:09.230 INFO:tasks.workunit.client.0.smithi096.stderr: "services": {} 2024-09-16T03:26:09.230 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.230 INFO:tasks.workunit.client.0.smithi096.stderr: "mgrstat_first_committed": 84, 2024-09-16T03:26:09.231 INFO:tasks.workunit.client.0.smithi096.stderr: "mgrstat_last_committed": 90, 2024-09-16T03:26:09.231 INFO:tasks.workunit.client.0.smithi096.stderr: "logm_first_committed": 1, 2024-09-16T03:26:09.231 INFO:tasks.workunit.client.0.smithi096.stderr: "logm_last_committed": 405, 2024-09-16T03:26:09.231 INFO:tasks.workunit.client.0.smithi096.stderr: "paxos": { 2024-09-16T03:26:09.231 INFO:tasks.workunit.client.0.smithi096.stderr: "first_committed": 1, 2024-09-16T03:26:09.231 INFO:tasks.workunit.client.0.smithi096.stderr: "last_committed": 599, 2024-09-16T03:26:09.231 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pn": 0, 2024-09-16T03:26:09.231 INFO:tasks.workunit.client.0.smithi096.stderr: "accepted_pn": 0 2024-09-16T03:26:09.231 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:09.231 INFO:tasks.workunit.client.0.smithi096.stderr:}' 2024-09-16T03:26:09.234 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:132: get_fc_lc_diff: jq .osdmap_first_committed 2024-09-16T03:26:09.234 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:132: get_fc_lc_diff: echo '{' '"cluster_fingerprint":' '"fda2fc64-07ed-4add-8224-2e527e11d427",' '"version":' '"19.3.0-4930-gfc3e0bff",' '"commit":' '"fc3e0bff7468fd55478adbae7f75508b749124b6",' '"timestamp":' '"2024-09-16T03:26:09.103074+0000",' '"tag":' '"",' '"health":' '{' '"status":' '"HEALTH_OK",' '"checks":' '{},' '"mutes":' '[]' '},' '"monmap_first_committed":' 1, '"monmap_last_committed":' 1, '"monmap":' '{' '"epoch":' 1, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"modified":' '"2024-09-16T03:22:45.872880Z",' '"created":' '"2024-09-16T03:22:45.872880Z",' '"min_mon_release":' 19, '"min_mon_release_name":' '"squid",' '"election_strategy":' 1, '"disallowed_leaders:' '":' '"",' '"stretch_mode":' false, '"tiebreaker_mon":' '"",' '"removed_ranks:' '":' '"",' '"features":' '{' '"persistent":' '[' '"kraken",' '"luminous",' '"mimic",' '"osdmap-prune",' '"nautilus",' '"octopus",' '"pacific",' '"elector-pinging",' '"quincy",' '"reef",' '"squid"' '],' '"optional":' '[]' '},' '"mons":' '[' '{' '"rank":' 0, '"name":' '"a",' '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:7302",' '"nonce":' 0 '}' ']' '},' '"addr":' '"127.0.0.1:7302/0",' '"public_addr":' '"127.0.0.1:7302/0",' '"priority":' 0, '"weight":' 0, '"crush_location":' '"{}"' '}' ']' '},' '"quorum":' '[' 0 '],' '"osdmap":' '{' '"epoch":' 86, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"created":' '"2024-09-16T03:22:46.906117+0000",' '"modified":' '"2024-09-16T03:26:02.230083+0000",' '"last_up_change":' '"2024-09-16T03:25:08.513363+0000",' '"last_in_change":' '"2024-09-16T03:25:09.839444+0000",' '"flags":' '"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit",' '"flags_num":' 5799936, '"flags_set":' '[' '"pglog_hardlimit",' '"purged_snapdirs",' '"recovery_deletes",' '"sortbitwise"' '],' '"crush_version":' 7, '"full_ratio":' 0.97000002861022949, '"backfillfull_ratio":' 0.97000002861022949, '"nearfull_ratio":' 0.85000002384185791, '"cluster_snapshot":' '"",' '"pool_max":' 2, '"max_osd":' 3, '"require_min_compat_client":' '"luminous",' '"min_compat_client":' '"jewel",' '"require_osd_release":' '"squid",' '"allow_crimson":' false, '"pools":' '[' '{' '"pool":' 1, '"pool_name":' '"foo",' '"create_time":' '"2024-09-16T03:24:44.525189+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 2, '"min_size":' 1, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"85",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.8700000047683716, '"score_stable":' 1.8700000047683716, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1.25, '"raw_score_stable":' 1.25, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '},' '{' '"pool":' 2, '"pool_name":' '"bar",' '"create_time":' '"2024-09-16T03:24:46.226575+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 2, '"min_size":' 1, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"83",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.4900000095367432, '"score_stable":' 1.4900000095367432, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1, '"raw_score_stable":' 1, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '}' '],' '"osds":' '[' '{' '"osd":' 0, '"uuid":' '"64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 5, '"up_thru":' 84, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6802",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6803",' '"nonce":' 3375787448 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6804",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6805",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6808",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6809",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6806",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6807",' '"nonce":' 3375787448 '}' ']' '},' '"public_addr":' '"127.0.0.1:6803/3375787448",' '"cluster_addr":' '"127.0.0.1:6805/3375787448",' '"heartbeat_back_addr":' '"127.0.0.1:6809/3375787448",' '"heartbeat_front_addr":' '"127.0.0.1:6807/3375787448",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 1, '"uuid":' '"74b26727-75c9-444d-8782-719e4197a382",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 10, '"up_thru":' 84, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6810",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6811",' '"nonce":' 3733255132 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6812",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6813",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6816",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6817",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6814",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6815",' '"nonce":' 3733255132 '}' ']' '},' '"public_addr":' '"127.0.0.1:6811/3733255132",' '"cluster_addr":' '"127.0.0.1:6813/3733255132",' '"heartbeat_back_addr":' '"127.0.0.1:6817/3733255132",' '"heartbeat_front_addr":' '"127.0.0.1:6815/3733255132",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 2, '"uuid":' '"143da3a7-dad9-4b1e-966b-76cf5bdd3c82",' '"up":' 0, '"in":' 0, '"weight":' 0, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 15, '"up_thru":' 21, '"down_at":' 33, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6818",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6819",' '"nonce":' 963814857 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6820",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6821",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6824",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6825",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6822",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6823",' '"nonce":' 963814857 '}' ']' '},' '"public_addr":' '"127.0.0.1:6819/963814857",' '"cluster_addr":' '"127.0.0.1:6821/963814857",' '"heartbeat_back_addr":' '"127.0.0.1:6825/963814857",' '"heartbeat_front_addr":' '"127.0.0.1:6823/963814857",' '"state":' '[' '"exists"' ']' '}' '],' '"osd_xinfo":' '[' '{' '"osd":' 0, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:22.481942+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 1, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:59.663703+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 2, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 65536, '"last_purged_snaps_scrub":' '"2024-09-16T03:24:37.320822+0000",' '"dead_epoch":' 32 '}' '],' '"pg_upmap":' '[],' '"pg_upmap_items":' '[],' '"pg_upmap_primaries":' '[],' '"pg_temp":' '[],' '"primary_temp":' '[],' '"blocklist":' '{},' '"range_blocklist":' '{},' '"erasure_code_profiles":' '{' '"default":' '{' '"k":' '"2",' '"m":' '"2",' '"plugin":' '"jerasure",' '"technique":' '"reed_sol_van"' '}' '},' '"removed_snaps_queue":' '[],' '"new_removed_snaps":' '[],' '"new_purged_snaps":' '[],' '"crush_node_flags":' '{},' '"device_class_flags":' '{},' '"stretch_mode":' '{' '"stretch_mode_enabled":' false, '"stretch_bucket_count":' 0, '"degraded_stretch_mode":' 0, '"recovering_stretch_mode":' 0, '"stretch_mode_bucket":' 0 '}' '},' '"osd_metadata":' '[' '{' '"id":' 0, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/0/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:22:53.662571Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]",' '"hb_front_addr":' '"[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/0",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 1, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/1/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:23:30.129885Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]",' '"hb_front_addr":' '"[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/1",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 2, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/2/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:24:07.764502Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]",' '"hb_front_addr":' '"[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/2",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '}' '],' '"osdmap_clean_epochs":' '{' '"min_last_epoch_clean":' 86, '"last_epoch_clean":' '{' '"per_pool":' '[' '{' '"poolid":' 1, '"floor":' 86 '},' '{' '"poolid":' 2, '"floor":' 86 '}' ']' '},' '"osd_epochs":' '[' '{' '"id":' 0, '"epoch":' 86 '},' '{' '"id":' 1, '"epoch":' 86 '}' ']' '},' '"osdmap_first_committed":' 84, '"osdmap_last_committed":' 86, '"crushmap":' '{' '"devices":' '[' '{' '"id":' 0, '"name":' '"osd.0",' '"class":' '"hdd"' '},' '{' '"id":' 1, '"name":' '"osd.1",' '"class":' '"hdd"' '},' '{' '"id":' 2, '"name":' '"osd.2",' '"class":' '"hdd"' '}' '],' '"types":' '[' '{' '"type_id":' 0, '"name":' '"osd"' '},' '{' '"type_id":' 1, '"name":' '"host"' '},' '{' '"type_id":' 2, '"name":' '"chassis"' '},' '{' '"type_id":' 3, '"name":' '"rack"' '},' '{' '"type_id":' 4, '"name":' '"row"' '},' '{' '"type_id":' 5, '"name":' '"pdu"' '},' '{' '"type_id":' 6, '"name":' '"pod"' '},' '{' '"type_id":' 7, '"name":' '"room"' '},' '{' '"type_id":' 8, '"name":' '"datacenter"' '},' '{' '"type_id":' 9, '"name":' '"zone"' '},' '{' '"type_id":' 10, '"name":' '"region"' '},' '{' '"type_id":' 11, '"name":' '"root"' '}' '],' '"buckets":' '[' '{' '"id":' -1, '"name":' '"default",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -3, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -2, '"name":' '"default~hdd",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -4, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -3, '"name":' '"smithi096",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '},' '{' '"id":' -4, '"name":' '"smithi096~hdd",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '}' '],' '"rules":' '[' '{' '"rule_id":' 0, '"rule_name":' '"replicated_rule",' '"type":' 1, '"steps":' '[' '{' '"op":' '"take",' '"item":' -1, '"item_name":' '"default"' '},' '{' '"op":' '"choose_firstn",' '"num":' 0, '"type":' '"osd"' '},' '{' '"op":' '"emit"' '}' ']' '}' '],' '"tunables":' '{' '"choose_local_tries":' 0, '"choose_local_fallback_tries":' 0, '"choose_total_tries":' 50, '"chooseleaf_descend_once":' 1, '"chooseleaf_vary_r":' 1, '"chooseleaf_stable":' 1, '"msr_descents":' 100, '"msr_collision_tries":' 100, '"straw_calc_version":' 1, '"allowed_bucket_algs":' 54, '"profile":' '"jewel",' '"optimal_tunables":' 1, '"legacy_tunables":' 0, '"minimum_required_version":' '"jewel",' '"require_feature_tunables":' 1, '"require_feature_tunables2":' 1, '"has_v2_rules":' 0, '"require_feature_tunables3":' 1, '"has_v3_rules":' 0, '"has_v4_buckets":' 1, '"require_feature_tunables5":' 1, '"has_v5_rules":' 0, '"has_msr_rules":' 0 '},' '"choose_args":' '{}' '},' '"fsmap":' '{' '"epoch":' 1, '"btime":' '"2024-09-16T03:22:46:882186+0000",' '"default_fscid":' -1, '"compat":' '{' '"compat":' '{},' '"ro_compat":' '{},' '"incompat":' '{' '"feature_1":' '"base' 'v0.20",' '"feature_2":' '"client' writeable 'ranges",' '"feature_3":' '"default' file layouts on 'dirs",' '"feature_4":' '"dir' inode in separate 'object",' '"feature_5":' '"mds' uses versioned 'encoding",' '"feature_6":' '"dirfrag' is stored in 'omap",' '"feature_8":' '"no' anchor 'table",' '"feature_9":' '"file' layout 'v2",' '"feature_10":' '"snaprealm' 'v2",' '"feature_11":' '"minor' log 'segments",' '"feature_12":' '"quiesce' 'subvolumes"' '}' '},' '"feature_flags":' '{' '"enable_multiple":' true, '"ever_enabled_multiple":' true '},' '"standbys":' '[],' '"filesystems":' '[]' '},' '"mdsmap_first_committed":' 1, '"mdsmap_last_committed":' 1, '"auth":' '{' '"first_committed":' 1, '"last_committed":' 5, '"num_secrets":' 3 '},' '"num_pg":' 64, '"num_pg_active":' 64, '"num_pg_unknown":' 0, '"num_osd":' 3, '"pool_sum":' '{' '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 128, '"acting":' 128, '"num_store_stats":' 0 '},' '"osd_sum":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54640, '"kb_used_data":' 960, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660560, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692413440, '"internally_reserved":' 0, '"allocated":' 983040, '"data_stored":' 369948, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 325, '"apply_latency_ms":' 325, '"commit_latency_ns":' 325000000, '"apply_latency_ns":' 325000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '},' '"osd_sum_by_class":' '{' '"hdd":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54640, '"kb_used_data":' 960, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660560, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692413440, '"internally_reserved":' 0, '"allocated":' 983040, '"data_stored":' 369948, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 325, '"apply_latency_ms":' 325, '"commit_latency_ns":' 325000000, '"apply_latency_ns":' 325000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '}' '},' '"pool_stats":' '[' '{' '"poolid":' 2, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '},' '{' '"poolid":' 1, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '}' '],' '"osd_stats":' '[' '{' '"osd":' 0, '"seq":' 21474836521 '},' '{' '"osd":' 1, '"seq":' 42949672993 '},' '{' '"osd":' 2, '"seq":' 0 '}' '],' '"num_pg_by_state":' '[' '{' '"state":' '"active+clean",' '"num":' 64 '}' '],' '"num_pg_by_osd":' '[' '{' '"osd":' 2, '"num_primary_pg":' 0, '"num_acting_pg":' 0, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 0, '"num_primary_pg":' 28, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 1, '"num_primary_pg":' 36, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '}' '],' '"purged_snaps":' '[' '{' '"pool":' 1, '"purged_snaps":' '{}' '},' '{' '"pool":' 2, '"purged_snaps":' '{}' '}' '],' '"servicemap":' '{' '"epoch":' 5, '"modified":' '"2024-09-16T03:25:38.422788+0000",' '"services":' '{}' '},' '"mgrstat_first_committed":' 84, '"mgrstat_last_committed":' 90, '"logm_first_committed":' 1, '"logm_last_committed":' 405, '"paxos":' '{' '"first_committed":' 1, '"last_committed":' 599, '"last_pn":' 0, '"accepted_pn":' 0 '}' '}' 2024-09-16T03:26:09.234 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:132: get_fc_lc_diff: osdm_fc=84 2024-09-16T03:26:09.235 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:134: get_fc_lc_diff: jq .osdmap_last_committed 2024-09-16T03:26:09.235 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:134: get_fc_lc_diff: echo '{' '"cluster_fingerprint":' '"fda2fc64-07ed-4add-8224-2e527e11d427",' '"version":' '"19.3.0-4930-gfc3e0bff",' '"commit":' '"fc3e0bff7468fd55478adbae7f75508b749124b6",' '"timestamp":' '"2024-09-16T03:26:09.103074+0000",' '"tag":' '"",' '"health":' '{' '"status":' '"HEALTH_OK",' '"checks":' '{},' '"mutes":' '[]' '},' '"monmap_first_committed":' 1, '"monmap_last_committed":' 1, '"monmap":' '{' '"epoch":' 1, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"modified":' '"2024-09-16T03:22:45.872880Z",' '"created":' '"2024-09-16T03:22:45.872880Z",' '"min_mon_release":' 19, '"min_mon_release_name":' '"squid",' '"election_strategy":' 1, '"disallowed_leaders:' '":' '"",' '"stretch_mode":' false, '"tiebreaker_mon":' '"",' '"removed_ranks:' '":' '"",' '"features":' '{' '"persistent":' '[' '"kraken",' '"luminous",' '"mimic",' '"osdmap-prune",' '"nautilus",' '"octopus",' '"pacific",' '"elector-pinging",' '"quincy",' '"reef",' '"squid"' '],' '"optional":' '[]' '},' '"mons":' '[' '{' '"rank":' 0, '"name":' '"a",' '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:7302",' '"nonce":' 0 '}' ']' '},' '"addr":' '"127.0.0.1:7302/0",' '"public_addr":' '"127.0.0.1:7302/0",' '"priority":' 0, '"weight":' 0, '"crush_location":' '"{}"' '}' ']' '},' '"quorum":' '[' 0 '],' '"osdmap":' '{' '"epoch":' 86, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"created":' '"2024-09-16T03:22:46.906117+0000",' '"modified":' '"2024-09-16T03:26:02.230083+0000",' '"last_up_change":' '"2024-09-16T03:25:08.513363+0000",' '"last_in_change":' '"2024-09-16T03:25:09.839444+0000",' '"flags":' '"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit",' '"flags_num":' 5799936, '"flags_set":' '[' '"pglog_hardlimit",' '"purged_snapdirs",' '"recovery_deletes",' '"sortbitwise"' '],' '"crush_version":' 7, '"full_ratio":' 0.97000002861022949, '"backfillfull_ratio":' 0.97000002861022949, '"nearfull_ratio":' 0.85000002384185791, '"cluster_snapshot":' '"",' '"pool_max":' 2, '"max_osd":' 3, '"require_min_compat_client":' '"luminous",' '"min_compat_client":' '"jewel",' '"require_osd_release":' '"squid",' '"allow_crimson":' false, '"pools":' '[' '{' '"pool":' 1, '"pool_name":' '"foo",' '"create_time":' '"2024-09-16T03:24:44.525189+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 2, '"min_size":' 1, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"85",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.8700000047683716, '"score_stable":' 1.8700000047683716, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1.25, '"raw_score_stable":' 1.25, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '},' '{' '"pool":' 2, '"pool_name":' '"bar",' '"create_time":' '"2024-09-16T03:24:46.226575+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 2, '"min_size":' 1, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"83",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.4900000095367432, '"score_stable":' 1.4900000095367432, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1, '"raw_score_stable":' 1, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '}' '],' '"osds":' '[' '{' '"osd":' 0, '"uuid":' '"64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 5, '"up_thru":' 84, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6802",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6803",' '"nonce":' 3375787448 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6804",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6805",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6808",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6809",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6806",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6807",' '"nonce":' 3375787448 '}' ']' '},' '"public_addr":' '"127.0.0.1:6803/3375787448",' '"cluster_addr":' '"127.0.0.1:6805/3375787448",' '"heartbeat_back_addr":' '"127.0.0.1:6809/3375787448",' '"heartbeat_front_addr":' '"127.0.0.1:6807/3375787448",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 1, '"uuid":' '"74b26727-75c9-444d-8782-719e4197a382",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 10, '"up_thru":' 84, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6810",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6811",' '"nonce":' 3733255132 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6812",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6813",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6816",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6817",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6814",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6815",' '"nonce":' 3733255132 '}' ']' '},' '"public_addr":' '"127.0.0.1:6811/3733255132",' '"cluster_addr":' '"127.0.0.1:6813/3733255132",' '"heartbeat_back_addr":' '"127.0.0.1:6817/3733255132",' '"heartbeat_front_addr":' '"127.0.0.1:6815/3733255132",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 2, '"uuid":' '"143da3a7-dad9-4b1e-966b-76cf5bdd3c82",' '"up":' 0, '"in":' 0, '"weight":' 0, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 15, '"up_thru":' 21, '"down_at":' 33, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6818",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6819",' '"nonce":' 963814857 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6820",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6821",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6824",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6825",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6822",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6823",' '"nonce":' 963814857 '}' ']' '},' '"public_addr":' '"127.0.0.1:6819/963814857",' '"cluster_addr":' '"127.0.0.1:6821/963814857",' '"heartbeat_back_addr":' '"127.0.0.1:6825/963814857",' '"heartbeat_front_addr":' '"127.0.0.1:6823/963814857",' '"state":' '[' '"exists"' ']' '}' '],' '"osd_xinfo":' '[' '{' '"osd":' 0, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:22.481942+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 1, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:59.663703+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 2, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 65536, '"last_purged_snaps_scrub":' '"2024-09-16T03:24:37.320822+0000",' '"dead_epoch":' 32 '}' '],' '"pg_upmap":' '[],' '"pg_upmap_items":' '[],' '"pg_upmap_primaries":' '[],' '"pg_temp":' '[],' '"primary_temp":' '[],' '"blocklist":' '{},' '"range_blocklist":' '{},' '"erasure_code_profiles":' '{' '"default":' '{' '"k":' '"2",' '"m":' '"2",' '"plugin":' '"jerasure",' '"technique":' '"reed_sol_van"' '}' '},' '"removed_snaps_queue":' '[],' '"new_removed_snaps":' '[],' '"new_purged_snaps":' '[],' '"crush_node_flags":' '{},' '"device_class_flags":' '{},' '"stretch_mode":' '{' '"stretch_mode_enabled":' false, '"stretch_bucket_count":' 0, '"degraded_stretch_mode":' 0, '"recovering_stretch_mode":' 0, '"stretch_mode_bucket":' 0 '}' '},' '"osd_metadata":' '[' '{' '"id":' 0, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/0/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:22:53.662571Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]",' '"hb_front_addr":' '"[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/0",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 1, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/1/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:23:30.129885Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]",' '"hb_front_addr":' '"[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/1",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 2, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/2/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:24:07.764502Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]",' '"hb_front_addr":' '"[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/2",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '}' '],' '"osdmap_clean_epochs":' '{' '"min_last_epoch_clean":' 86, '"last_epoch_clean":' '{' '"per_pool":' '[' '{' '"poolid":' 1, '"floor":' 86 '},' '{' '"poolid":' 2, '"floor":' 86 '}' ']' '},' '"osd_epochs":' '[' '{' '"id":' 0, '"epoch":' 86 '},' '{' '"id":' 1, '"epoch":' 86 '}' ']' '},' '"osdmap_first_committed":' 84, '"osdmap_last_committed":' 86, '"crushmap":' '{' '"devices":' '[' '{' '"id":' 0, '"name":' '"osd.0",' '"class":' '"hdd"' '},' '{' '"id":' 1, '"name":' '"osd.1",' '"class":' '"hdd"' '},' '{' '"id":' 2, '"name":' '"osd.2",' '"class":' '"hdd"' '}' '],' '"types":' '[' '{' '"type_id":' 0, '"name":' '"osd"' '},' '{' '"type_id":' 1, '"name":' '"host"' '},' '{' '"type_id":' 2, '"name":' '"chassis"' '},' '{' '"type_id":' 3, '"name":' '"rack"' '},' '{' '"type_id":' 4, '"name":' '"row"' '},' '{' '"type_id":' 5, '"name":' '"pdu"' '},' '{' '"type_id":' 6, '"name":' '"pod"' '},' '{' '"type_id":' 7, '"name":' '"room"' '},' '{' '"type_id":' 8, '"name":' '"datacenter"' '},' '{' '"type_id":' 9, '"name":' '"zone"' '},' '{' '"type_id":' 10, '"name":' '"region"' '},' '{' '"type_id":' 11, '"name":' '"root"' '}' '],' '"buckets":' '[' '{' '"id":' -1, '"name":' '"default",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -3, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -2, '"name":' '"default~hdd",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -4, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -3, '"name":' '"smithi096",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '},' '{' '"id":' -4, '"name":' '"smithi096~hdd",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '}' '],' '"rules":' '[' '{' '"rule_id":' 0, '"rule_name":' '"replicated_rule",' '"type":' 1, '"steps":' '[' '{' '"op":' '"take",' '"item":' -1, '"item_name":' '"default"' '},' '{' '"op":' '"choose_firstn",' '"num":' 0, '"type":' '"osd"' '},' '{' '"op":' '"emit"' '}' ']' '}' '],' '"tunables":' '{' '"choose_local_tries":' 0, '"choose_local_fallback_tries":' 0, '"choose_total_tries":' 50, '"chooseleaf_descend_once":' 1, '"chooseleaf_vary_r":' 1, '"chooseleaf_stable":' 1, '"msr_descents":' 100, '"msr_collision_tries":' 100, '"straw_calc_version":' 1, '"allowed_bucket_algs":' 54, '"profile":' '"jewel",' '"optimal_tunables":' 1, '"legacy_tunables":' 0, '"minimum_required_version":' '"jewel",' '"require_feature_tunables":' 1, '"require_feature_tunables2":' 1, '"has_v2_rules":' 0, '"require_feature_tunables3":' 1, '"has_v3_rules":' 0, '"has_v4_buckets":' 1, '"require_feature_tunables5":' 1, '"has_v5_rules":' 0, '"has_msr_rules":' 0 '},' '"choose_args":' '{}' '},' '"fsmap":' '{' '"epoch":' 1, '"btime":' '"2024-09-16T03:22:46:882186+0000",' '"default_fscid":' -1, '"compat":' '{' '"compat":' '{},' '"ro_compat":' '{},' '"incompat":' '{' '"feature_1":' '"base' 'v0.20",' '"feature_2":' '"client' writeable 'ranges",' '"feature_3":' '"default' file layouts on 'dirs",' '"feature_4":' '"dir' inode in separate 'object",' '"feature_5":' '"mds' uses versioned 'encoding",' '"feature_6":' '"dirfrag' is stored in 'omap",' '"feature_8":' '"no' anchor 'table",' '"feature_9":' '"file' layout 'v2",' '"feature_10":' '"snaprealm' 'v2",' '"feature_11":' '"minor' log 'segments",' '"feature_12":' '"quiesce' 'subvolumes"' '}' '},' '"feature_flags":' '{' '"enable_multiple":' true, '"ever_enabled_multiple":' true '},' '"standbys":' '[],' '"filesystems":' '[]' '},' '"mdsmap_first_committed":' 1, '"mdsmap_last_committed":' 1, '"auth":' '{' '"first_committed":' 1, '"last_committed":' 5, '"num_secrets":' 3 '},' '"num_pg":' 64, '"num_pg_active":' 64, '"num_pg_unknown":' 0, '"num_osd":' 3, '"pool_sum":' '{' '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 128, '"acting":' 128, '"num_store_stats":' 0 '},' '"osd_sum":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54640, '"kb_used_data":' 960, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660560, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692413440, '"internally_reserved":' 0, '"allocated":' 983040, '"data_stored":' 369948, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 325, '"apply_latency_ms":' 325, '"commit_latency_ns":' 325000000, '"apply_latency_ns":' 325000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '},' '"osd_sum_by_class":' '{' '"hdd":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54640, '"kb_used_data":' 960, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660560, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692413440, '"internally_reserved":' 0, '"allocated":' 983040, '"data_stored":' 369948, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 325, '"apply_latency_ms":' 325, '"commit_latency_ns":' 325000000, '"apply_latency_ns":' 325000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '}' '},' '"pool_stats":' '[' '{' '"poolid":' 2, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '},' '{' '"poolid":' 1, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '}' '],' '"osd_stats":' '[' '{' '"osd":' 0, '"seq":' 21474836521 '},' '{' '"osd":' 1, '"seq":' 42949672993 '},' '{' '"osd":' 2, '"seq":' 0 '}' '],' '"num_pg_by_state":' '[' '{' '"state":' '"active+clean",' '"num":' 64 '}' '],' '"num_pg_by_osd":' '[' '{' '"osd":' 2, '"num_primary_pg":' 0, '"num_acting_pg":' 0, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 0, '"num_primary_pg":' 28, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 1, '"num_primary_pg":' 36, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '}' '],' '"purged_snaps":' '[' '{' '"pool":' 1, '"purged_snaps":' '{}' '},' '{' '"pool":' 2, '"purged_snaps":' '{}' '}' '],' '"servicemap":' '{' '"epoch":' 5, '"modified":' '"2024-09-16T03:25:38.422788+0000",' '"services":' '{}' '},' '"mgrstat_first_committed":' 84, '"mgrstat_last_committed":' 90, '"logm_first_committed":' 1, '"logm_last_committed":' 405, '"paxos":' '{' '"first_committed":' 1, '"last_committed":' 599, '"last_pn":' 0, '"accepted_pn":' 0 '}' '}' 2024-09-16T03:26:09.235 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:134: get_fc_lc_diff: osdm_lc=86 2024-09-16T03:26:09.235 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:136: get_fc_lc_diff: echo 2 2024-09-16T03:26:09.235 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:161: wait_for_total_num_maps: [[ 2 -gt 2 ]] 2024-09-16T03:26:09.235 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:291: TEST_mon_last_clean_epoch: get_fc_lc_diff 2024-09-16T03:26:09.235 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:130: get_fc_lc_diff: ceph report 2024-09-16T03:26:09.769 INFO:tasks.workunit.client.0.smithi096.stderr:report 1664860241 2024-09-16T03:26:09.785 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:130: get_fc_lc_diff: report='{ 2024-09-16T03:26:09.786 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_fingerprint": "fda2fc64-07ed-4add-8224-2e527e11d427", 2024-09-16T03:26:09.786 INFO:tasks.workunit.client.0.smithi096.stderr: "version": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:26:09.786 INFO:tasks.workunit.client.0.smithi096.stderr: "commit": "fc3e0bff7468fd55478adbae7f75508b749124b6", 2024-09-16T03:26:09.786 INFO:tasks.workunit.client.0.smithi096.stderr: "timestamp": "2024-09-16T03:26:09.770284+0000", 2024-09-16T03:26:09.786 INFO:tasks.workunit.client.0.smithi096.stderr: "tag": "", 2024-09-16T03:26:09.786 INFO:tasks.workunit.client.0.smithi096.stderr: "health": { 2024-09-16T03:26:09.786 INFO:tasks.workunit.client.0.smithi096.stderr: "status": "HEALTH_OK", 2024-09-16T03:26:09.786 INFO:tasks.workunit.client.0.smithi096.stderr: "checks": {}, 2024-09-16T03:26:09.786 INFO:tasks.workunit.client.0.smithi096.stderr: "mutes": [] 2024-09-16T03:26:09.786 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.786 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap_first_committed": 1, 2024-09-16T03:26:09.786 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap_last_committed": 1, 2024-09-16T03:26:09.786 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap": { 2024-09-16T03:26:09.787 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 1, 2024-09-16T03:26:09.787 INFO:tasks.workunit.client.0.smithi096.stderr: "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", 2024-09-16T03:26:09.787 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:22:45.872880Z", 2024-09-16T03:26:09.787 INFO:tasks.workunit.client.0.smithi096.stderr: "created": "2024-09-16T03:22:45.872880Z", 2024-09-16T03:26:09.787 INFO:tasks.workunit.client.0.smithi096.stderr: "min_mon_release": 19, 2024-09-16T03:26:09.787 INFO:tasks.workunit.client.0.smithi096.stderr: "min_mon_release_name": "squid", 2024-09-16T03:26:09.787 INFO:tasks.workunit.client.0.smithi096.stderr: "election_strategy": 1, 2024-09-16T03:26:09.787 INFO:tasks.workunit.client.0.smithi096.stderr: "disallowed_leaders: ": "", 2024-09-16T03:26:09.787 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode": false, 2024-09-16T03:26:09.787 INFO:tasks.workunit.client.0.smithi096.stderr: "tiebreaker_mon": "", 2024-09-16T03:26:09.787 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_ranks: ": "", 2024-09-16T03:26:09.787 INFO:tasks.workunit.client.0.smithi096.stderr: "features": { 2024-09-16T03:26:09.787 INFO:tasks.workunit.client.0.smithi096.stderr: "persistent": [ 2024-09-16T03:26:09.787 INFO:tasks.workunit.client.0.smithi096.stderr: "kraken", 2024-09-16T03:26:09.788 INFO:tasks.workunit.client.0.smithi096.stderr: "luminous", 2024-09-16T03:26:09.788 INFO:tasks.workunit.client.0.smithi096.stderr: "mimic", 2024-09-16T03:26:09.788 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap-prune", 2024-09-16T03:26:09.788 INFO:tasks.workunit.client.0.smithi096.stderr: "nautilus", 2024-09-16T03:26:09.788 INFO:tasks.workunit.client.0.smithi096.stderr: "octopus", 2024-09-16T03:26:09.788 INFO:tasks.workunit.client.0.smithi096.stderr: "pacific", 2024-09-16T03:26:09.788 INFO:tasks.workunit.client.0.smithi096.stderr: "elector-pinging", 2024-09-16T03:26:09.788 INFO:tasks.workunit.client.0.smithi096.stderr: "quincy", 2024-09-16T03:26:09.788 INFO:tasks.workunit.client.0.smithi096.stderr: "reef", 2024-09-16T03:26:09.788 INFO:tasks.workunit.client.0.smithi096.stderr: "squid" 2024-09-16T03:26:09.788 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:09.788 INFO:tasks.workunit.client.0.smithi096.stderr: "optional": [] 2024-09-16T03:26:09.788 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.788 INFO:tasks.workunit.client.0.smithi096.stderr: "mons": [ 2024-09-16T03:26:09.789 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.789 INFO:tasks.workunit.client.0.smithi096.stderr: "rank": 0, 2024-09-16T03:26:09.789 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "a", 2024-09-16T03:26:09.789 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:26:09.789 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:09.789 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.789 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:09.789 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:7302", 2024-09-16T03:26:09.789 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 0 2024-09-16T03:26:09.789 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:09.789 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:09.789 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.789 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:7302/0", 2024-09-16T03:26:09.790 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:7302/0", 2024-09-16T03:26:09.790 INFO:tasks.workunit.client.0.smithi096.stderr: "priority": 0, 2024-09-16T03:26:09.790 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 0, 2024-09-16T03:26:09.790 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_location": "{}" 2024-09-16T03:26:09.790 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:09.790 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:09.790 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.790 INFO:tasks.workunit.client.0.smithi096.stderr: "quorum": [ 2024-09-16T03:26:09.790 INFO:tasks.workunit.client.0.smithi096.stderr: 0 2024-09-16T03:26:09.790 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:09.790 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap": { 2024-09-16T03:26:09.790 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 86, 2024-09-16T03:26:09.790 INFO:tasks.workunit.client.0.smithi096.stderr: "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", 2024-09-16T03:26:09.790 INFO:tasks.workunit.client.0.smithi096.stderr: "created": "2024-09-16T03:22:46.906117+0000", 2024-09-16T03:26:09.791 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:26:02.230083+0000", 2024-09-16T03:26:09.791 INFO:tasks.workunit.client.0.smithi096.stderr: "last_up_change": "2024-09-16T03:25:08.513363+0000", 2024-09-16T03:26:09.791 INFO:tasks.workunit.client.0.smithi096.stderr: "last_in_change": "2024-09-16T03:25:09.839444+0000", 2024-09-16T03:26:09.791 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-16T03:26:09.791 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_num": 5799936, 2024-09-16T03:26:09.791 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_set": [ 2024-09-16T03:26:09.791 INFO:tasks.workunit.client.0.smithi096.stderr: "pglog_hardlimit", 2024-09-16T03:26:09.791 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snapdirs", 2024-09-16T03:26:09.791 INFO:tasks.workunit.client.0.smithi096.stderr: "recovery_deletes", 2024-09-16T03:26:09.791 INFO:tasks.workunit.client.0.smithi096.stderr: "sortbitwise" 2024-09-16T03:26:09.791 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:09.791 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_version": 7, 2024-09-16T03:26:09.791 INFO:tasks.workunit.client.0.smithi096.stderr: "full_ratio": 0.97000002861022949, 2024-09-16T03:26:09.792 INFO:tasks.workunit.client.0.smithi096.stderr: "backfillfull_ratio": 0.97000002861022949, 2024-09-16T03:26:09.792 INFO:tasks.workunit.client.0.smithi096.stderr: "nearfull_ratio": 0.85000002384185791, 2024-09-16T03:26:09.792 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_snapshot": "", 2024-09-16T03:26:09.792 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_max": 2, 2024-09-16T03:26:09.792 INFO:tasks.workunit.client.0.smithi096.stderr: "max_osd": 3, 2024-09-16T03:26:09.792 INFO:tasks.workunit.client.0.smithi096.stderr: "require_min_compat_client": "luminous", 2024-09-16T03:26:09.792 INFO:tasks.workunit.client.0.smithi096.stderr: "min_compat_client": "jewel", 2024-09-16T03:26:09.792 INFO:tasks.workunit.client.0.smithi096.stderr: "require_osd_release": "squid", 2024-09-16T03:26:09.792 INFO:tasks.workunit.client.0.smithi096.stderr: "allow_crimson": false, 2024-09-16T03:26:09.792 INFO:tasks.workunit.client.0.smithi096.stderr: "pools": [ 2024-09-16T03:26:09.792 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.792 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 1, 2024-09-16T03:26:09.792 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_name": "foo", 2024-09-16T03:26:09.792 INFO:tasks.workunit.client.0.smithi096.stderr: "create_time": "2024-09-16T03:24:44.525189+0000", 2024-09-16T03:26:09.793 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": 1, 2024-09-16T03:26:09.793 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_names": "hashpspool", 2024-09-16T03:26:09.793 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:26:09.793 INFO:tasks.workunit.client.0.smithi096.stderr: "size": 2, 2024-09-16T03:26:09.793 INFO:tasks.workunit.client.0.smithi096.stderr: "min_size": 1, 2024-09-16T03:26:09.793 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_rule": 0, 2024-09-16T03:26:09.793 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_count": 0, 2024-09-16T03:26:09.793 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_target": 0, 2024-09-16T03:26:09.793 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_barrier": 0, 2024-09-16T03:26:09.793 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-16T03:26:09.793 INFO:tasks.workunit.client.0.smithi096.stderr: "is_stretch_pool": false, 2024-09-16T03:26:09.793 INFO:tasks.workunit.client.0.smithi096.stderr: "object_hash": 2, 2024-09-16T03:26:09.794 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_autoscale_mode": "off", 2024-09-16T03:26:09.794 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num": 32, 2024-09-16T03:26:09.794 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num": 32, 2024-09-16T03:26:09.794 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num_target": 32, 2024-09-16T03:26:09.794 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_target": 32, 2024-09-16T03:26:09.794 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_pending": 32, 2024-09-16T03:26:09.794 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pg_merge_meta": { 2024-09-16T03:26:09.794 INFO:tasks.workunit.client.0.smithi096.stderr: "source_pgid": "0.0", 2024-09-16T03:26:09.794 INFO:tasks.workunit.client.0.smithi096.stderr: "ready_epoch": 0, 2024-09-16T03:26:09.794 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_started": 0, 2024-09-16T03:26:09.794 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": 0, 2024-09-16T03:26:09.794 INFO:tasks.workunit.client.0.smithi096.stderr: "source_version": "0'\''0", 2024-09-16T03:26:09.794 INFO:tasks.workunit.client.0.smithi096.stderr: "target_version": "0'\''0" 2024-09-16T03:26:09.794 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.795 INFO:tasks.workunit.client.0.smithi096.stderr: "last_change": "85", 2024-09-16T03:26:09.795 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend": "0", 2024-09-16T03:26:09.795 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_prenautilus": "0", 2024-09-16T03:26:09.795 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_preluminous": "0", 2024-09-16T03:26:09.795 INFO:tasks.workunit.client.0.smithi096.stderr: "auid": 0, 2024-09-16T03:26:09.795 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_mode": "selfmanaged", 2024-09-16T03:26:09.795 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_seq": 0, 2024-09-16T03:26:09.795 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_epoch": 0, 2024-09-16T03:26:09.795 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_snaps": [], 2024-09-16T03:26:09.795 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps": "[]", 2024-09-16T03:26:09.795 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_bytes": 0, 2024-09-16T03:26:09.795 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_objects": 0, 2024-09-16T03:26:09.795 INFO:tasks.workunit.client.0.smithi096.stderr: "tiers": [], 2024-09-16T03:26:09.795 INFO:tasks.workunit.client.0.smithi096.stderr: "tier_of": -1, 2024-09-16T03:26:09.796 INFO:tasks.workunit.client.0.smithi096.stderr: "read_tier": -1, 2024-09-16T03:26:09.796 INFO:tasks.workunit.client.0.smithi096.stderr: "write_tier": -1, 2024-09-16T03:26:09.796 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_mode": "none", 2024-09-16T03:26:09.796 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_bytes": 0, 2024-09-16T03:26:09.796 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_objects": 0, 2024-09-16T03:26:09.796 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_ratio_micro": 400000, 2024-09-16T03:26:09.796 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-16T03:26:09.796 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_full_ratio_micro": 800000, 2024-09-16T03:26:09.796 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_flush_age": 0, 2024-09-16T03:26:09.796 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_evict_age": 0, 2024-09-16T03:26:09.796 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profile": "", 2024-09-16T03:26:09.796 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_params": { 2024-09-16T03:26:09.796 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "none" 2024-09-16T03:26:09.797 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.797 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_period": 0, 2024-09-16T03:26:09.797 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_count": 0, 2024-09-16T03:26:09.797 INFO:tasks.workunit.client.0.smithi096.stderr: "use_gmt_hitset": true, 2024-09-16T03:26:09.797 INFO:tasks.workunit.client.0.smithi096.stderr: "min_read_recency_for_promote": 0, 2024-09-16T03:26:09.797 INFO:tasks.workunit.client.0.smithi096.stderr: "min_write_recency_for_promote": 0, 2024-09-16T03:26:09.797 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_grade_decay_rate": 0, 2024-09-16T03:26:09.797 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_search_last_n": 0, 2024-09-16T03:26:09.797 INFO:tasks.workunit.client.0.smithi096.stderr: "grade_table": [], 2024-09-16T03:26:09.797 INFO:tasks.workunit.client.0.smithi096.stderr: "stripe_width": 0, 2024-09-16T03:26:09.797 INFO:tasks.workunit.client.0.smithi096.stderr: "expected_num_objects": 0, 2024-09-16T03:26:09.797 INFO:tasks.workunit.client.0.smithi096.stderr: "fast_read": false, 2024-09-16T03:26:09.797 INFO:tasks.workunit.client.0.smithi096.stderr: "options": {}, 2024-09-16T03:26:09.797 INFO:tasks.workunit.client.0.smithi096.stderr: "application_metadata": {}, 2024-09-16T03:26:09.798 INFO:tasks.workunit.client.0.smithi096.stderr: "read_balance": { 2024-09-16T03:26:09.798 INFO:tasks.workunit.client.0.smithi096.stderr: "score_type": "Fair distribution", 2024-09-16T03:26:09.798 INFO:tasks.workunit.client.0.smithi096.stderr: "score_acting": 1.8700000047683716, 2024-09-16T03:26:09.798 INFO:tasks.workunit.client.0.smithi096.stderr: "score_stable": 1.8700000047683716, 2024-09-16T03:26:09.798 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_score": 0.67000001668930054, 2024-09-16T03:26:09.798 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_acting": 1.25, 2024-09-16T03:26:09.798 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_stable": 1.25, 2024-09-16T03:26:09.798 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity_weighted": 1, 2024-09-16T03:26:09.798 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity": 1, 2024-09-16T03:26:09.798 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity_weighted": 1 2024-09-16T03:26:09.798 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:09.798 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.798 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.798 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 2, 2024-09-16T03:26:09.799 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_name": "bar", 2024-09-16T03:26:09.799 INFO:tasks.workunit.client.0.smithi096.stderr: "create_time": "2024-09-16T03:24:46.226575+0000", 2024-09-16T03:26:09.799 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": 1, 2024-09-16T03:26:09.799 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_names": "hashpspool", 2024-09-16T03:26:09.799 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:26:09.799 INFO:tasks.workunit.client.0.smithi096.stderr: "size": 2, 2024-09-16T03:26:09.799 INFO:tasks.workunit.client.0.smithi096.stderr: "min_size": 1, 2024-09-16T03:26:09.799 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_rule": 0, 2024-09-16T03:26:09.799 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_count": 0, 2024-09-16T03:26:09.799 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_target": 0, 2024-09-16T03:26:09.799 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_barrier": 0, 2024-09-16T03:26:09.799 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-16T03:26:09.799 INFO:tasks.workunit.client.0.smithi096.stderr: "is_stretch_pool": false, 2024-09-16T03:26:09.799 INFO:tasks.workunit.client.0.smithi096.stderr: "object_hash": 2, 2024-09-16T03:26:09.800 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_autoscale_mode": "off", 2024-09-16T03:26:09.800 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num": 32, 2024-09-16T03:26:09.800 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num": 32, 2024-09-16T03:26:09.800 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num_target": 32, 2024-09-16T03:26:09.800 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_target": 32, 2024-09-16T03:26:09.800 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_pending": 32, 2024-09-16T03:26:09.800 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pg_merge_meta": { 2024-09-16T03:26:09.800 INFO:tasks.workunit.client.0.smithi096.stderr: "source_pgid": "0.0", 2024-09-16T03:26:09.800 INFO:tasks.workunit.client.0.smithi096.stderr: "ready_epoch": 0, 2024-09-16T03:26:09.800 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_started": 0, 2024-09-16T03:26:09.800 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": 0, 2024-09-16T03:26:09.800 INFO:tasks.workunit.client.0.smithi096.stderr: "source_version": "0'\''0", 2024-09-16T03:26:09.800 INFO:tasks.workunit.client.0.smithi096.stderr: "target_version": "0'\''0" 2024-09-16T03:26:09.801 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.801 INFO:tasks.workunit.client.0.smithi096.stderr: "last_change": "83", 2024-09-16T03:26:09.801 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend": "0", 2024-09-16T03:26:09.801 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_prenautilus": "0", 2024-09-16T03:26:09.801 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_preluminous": "0", 2024-09-16T03:26:09.801 INFO:tasks.workunit.client.0.smithi096.stderr: "auid": 0, 2024-09-16T03:26:09.801 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_mode": "selfmanaged", 2024-09-16T03:26:09.801 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_seq": 0, 2024-09-16T03:26:09.801 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_epoch": 0, 2024-09-16T03:26:09.801 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_snaps": [], 2024-09-16T03:26:09.801 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps": "[]", 2024-09-16T03:26:09.801 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_bytes": 0, 2024-09-16T03:26:09.801 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_objects": 0, 2024-09-16T03:26:09.801 INFO:tasks.workunit.client.0.smithi096.stderr: "tiers": [], 2024-09-16T03:26:09.802 INFO:tasks.workunit.client.0.smithi096.stderr: "tier_of": -1, 2024-09-16T03:26:09.802 INFO:tasks.workunit.client.0.smithi096.stderr: "read_tier": -1, 2024-09-16T03:26:09.802 INFO:tasks.workunit.client.0.smithi096.stderr: "write_tier": -1, 2024-09-16T03:26:09.802 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_mode": "none", 2024-09-16T03:26:09.802 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_bytes": 0, 2024-09-16T03:26:09.802 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_objects": 0, 2024-09-16T03:26:09.802 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_ratio_micro": 400000, 2024-09-16T03:26:09.802 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-16T03:26:09.802 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_full_ratio_micro": 800000, 2024-09-16T03:26:09.802 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_flush_age": 0, 2024-09-16T03:26:09.802 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_evict_age": 0, 2024-09-16T03:26:09.802 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profile": "", 2024-09-16T03:26:09.802 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_params": { 2024-09-16T03:26:09.802 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "none" 2024-09-16T03:26:09.803 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.803 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_period": 0, 2024-09-16T03:26:09.803 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_count": 0, 2024-09-16T03:26:09.803 INFO:tasks.workunit.client.0.smithi096.stderr: "use_gmt_hitset": true, 2024-09-16T03:26:09.803 INFO:tasks.workunit.client.0.smithi096.stderr: "min_read_recency_for_promote": 0, 2024-09-16T03:26:09.803 INFO:tasks.workunit.client.0.smithi096.stderr: "min_write_recency_for_promote": 0, 2024-09-16T03:26:09.803 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_grade_decay_rate": 0, 2024-09-16T03:26:09.803 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_search_last_n": 0, 2024-09-16T03:26:09.803 INFO:tasks.workunit.client.0.smithi096.stderr: "grade_table": [], 2024-09-16T03:26:09.803 INFO:tasks.workunit.client.0.smithi096.stderr: "stripe_width": 0, 2024-09-16T03:26:09.803 INFO:tasks.workunit.client.0.smithi096.stderr: "expected_num_objects": 0, 2024-09-16T03:26:09.803 INFO:tasks.workunit.client.0.smithi096.stderr: "fast_read": false, 2024-09-16T03:26:09.803 INFO:tasks.workunit.client.0.smithi096.stderr: "options": {}, 2024-09-16T03:26:09.803 INFO:tasks.workunit.client.0.smithi096.stderr: "application_metadata": {}, 2024-09-16T03:26:09.804 INFO:tasks.workunit.client.0.smithi096.stderr: "read_balance": { 2024-09-16T03:26:09.804 INFO:tasks.workunit.client.0.smithi096.stderr: "score_type": "Fair distribution", 2024-09-16T03:26:09.804 INFO:tasks.workunit.client.0.smithi096.stderr: "score_acting": 1.4900000095367432, 2024-09-16T03:26:09.804 INFO:tasks.workunit.client.0.smithi096.stderr: "score_stable": 1.4900000095367432, 2024-09-16T03:26:09.804 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_score": 0.67000001668930054, 2024-09-16T03:26:09.804 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_acting": 1, 2024-09-16T03:26:09.804 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_stable": 1, 2024-09-16T03:26:09.804 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity_weighted": 1, 2024-09-16T03:26:09.804 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity": 1, 2024-09-16T03:26:09.804 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity_weighted": 1 2024-09-16T03:26:09.804 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:09.804 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:09.804 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:09.805 INFO:tasks.workunit.client.0.smithi096.stderr: "osds": [ 2024-09-16T03:26:09.805 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.805 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:26:09.805 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6", 2024-09-16T03:26:09.805 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:26:09.805 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:26:09.805 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:26:09.805 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:26:09.805 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:26:09.805 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:26:09.805 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 5, 2024-09-16T03:26:09.805 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 84, 2024-09-16T03:26:09.805 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:26:09.805 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:26:09.806 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:26:09.806 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:09.806 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.806 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:09.806 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6802", 2024-09-16T03:26:09.806 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:26:09.806 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.806 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.806 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:09.806 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6803", 2024-09-16T03:26:09.806 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:26:09.806 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:09.806 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:09.806 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.806 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:26:09.807 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:09.807 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.807 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:09.807 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6804", 2024-09-16T03:26:09.807 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:26:09.807 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.807 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.807 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:09.807 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6805", 2024-09-16T03:26:09.807 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:26:09.807 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:09.807 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:09.807 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.807 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:26:09.808 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:09.808 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.808 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:09.808 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6808", 2024-09-16T03:26:09.808 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:26:09.808 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.808 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.808 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:09.808 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6809", 2024-09-16T03:26:09.808 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:26:09.808 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:09.808 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:09.808 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.809 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:26:09.809 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:09.809 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.809 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:09.809 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6806", 2024-09-16T03:26:09.809 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:26:09.809 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.809 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.809 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:09.809 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6807", 2024-09-16T03:26:09.809 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:26:09.809 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:09.809 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:09.809 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.810 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6803/3375787448", 2024-09-16T03:26:09.810 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6805/3375787448", 2024-09-16T03:26:09.810 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6809/3375787448", 2024-09-16T03:26:09.810 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6807/3375787448", 2024-09-16T03:26:09.810 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:26:09.810 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:26:09.810 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:26:09.810 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:09.810 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.810 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.810 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:26:09.810 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "74b26727-75c9-444d-8782-719e4197a382", 2024-09-16T03:26:09.810 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:26:09.810 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:26:09.811 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:26:09.811 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:26:09.811 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:26:09.811 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:26:09.811 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 10, 2024-09-16T03:26:09.811 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 84, 2024-09-16T03:26:09.811 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:26:09.811 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:26:09.811 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:26:09.811 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:09.811 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.811 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:09.811 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6810", 2024-09-16T03:26:09.811 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:26:09.812 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.812 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.812 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:09.812 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6811", 2024-09-16T03:26:09.812 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:26:09.813 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:09.813 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:09.813 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.813 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:26:09.813 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:09.813 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.813 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:09.814 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6812", 2024-09-16T03:26:09.814 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:26:09.814 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.814 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.814 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:09.814 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6813", 2024-09-16T03:26:09.814 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:26:09.814 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:09.814 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:09.814 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.814 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:26:09.814 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:09.814 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.814 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:09.815 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6816", 2024-09-16T03:26:09.815 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:26:09.815 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.815 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.815 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:09.815 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6817", 2024-09-16T03:26:09.815 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:26:09.815 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:09.815 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:09.815 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.815 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:26:09.815 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:09.815 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.815 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:09.816 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6814", 2024-09-16T03:26:09.816 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:26:09.816 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.816 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.816 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:09.816 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6815", 2024-09-16T03:26:09.816 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:26:09.816 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:09.816 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:09.816 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.816 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6811/3733255132", 2024-09-16T03:26:09.816 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6813/3733255132", 2024-09-16T03:26:09.816 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6817/3733255132", 2024-09-16T03:26:09.816 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6815/3733255132", 2024-09-16T03:26:09.817 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:26:09.817 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:26:09.817 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:26:09.817 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:09.817 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.817 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.817 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:26:09.817 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "143da3a7-dad9-4b1e-966b-76cf5bdd3c82", 2024-09-16T03:26:09.817 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 0, 2024-09-16T03:26:09.817 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 0, 2024-09-16T03:26:09.817 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 0, 2024-09-16T03:26:09.817 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:26:09.817 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:26:09.817 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:26:09.817 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 15, 2024-09-16T03:26:09.818 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 21, 2024-09-16T03:26:09.818 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 33, 2024-09-16T03:26:09.818 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:26:09.818 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:26:09.818 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:09.818 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.818 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:09.818 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6818", 2024-09-16T03:26:09.818 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:26:09.818 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.818 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.818 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:09.818 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6819", 2024-09-16T03:26:09.818 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:26:09.819 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:09.819 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:09.819 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.819 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:26:09.819 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:09.819 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.819 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:09.819 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6820", 2024-09-16T03:26:09.819 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:26:09.819 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.819 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.819 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:09.819 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6821", 2024-09-16T03:26:09.819 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:26:09.820 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:09.820 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:09.820 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.820 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:26:09.820 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:09.820 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.820 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:09.820 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6824", 2024-09-16T03:26:09.820 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:26:09.820 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.820 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.820 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:09.820 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6825", 2024-09-16T03:26:09.820 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:26:09.821 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:09.821 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:09.821 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.821 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:26:09.821 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:09.821 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.821 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:09.821 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6822", 2024-09-16T03:26:09.821 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:26:09.821 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.821 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.821 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:09.821 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6823", 2024-09-16T03:26:09.821 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 963814857 2024-09-16T03:26:09.822 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:09.822 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:09.822 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.822 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6819/963814857", 2024-09-16T03:26:09.822 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6821/963814857", 2024-09-16T03:26:09.822 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6825/963814857", 2024-09-16T03:26:09.822 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6823/963814857", 2024-09-16T03:26:09.822 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:26:09.822 INFO:tasks.workunit.client.0.smithi096.stderr: "exists" 2024-09-16T03:26:09.822 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:09.822 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:09.822 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:09.822 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_xinfo": [ 2024-09-16T03:26:09.822 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.822 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:26:09.823 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:26:09.823 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:26:09.823 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:26:09.823 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:26:09.823 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:26:09.823 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:23:22.481942+0000", 2024-09-16T03:26:09.823 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:26:09.823 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.823 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.823 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:26:09.823 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:26:09.823 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:26:09.823 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:26:09.823 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:26:09.824 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:26:09.824 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:23:59.663703+0000", 2024-09-16T03:26:09.824 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:26:09.824 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.824 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.824 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:26:09.824 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:26:09.824 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:26:09.824 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:26:09.824 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:26:09.824 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 65536, 2024-09-16T03:26:09.824 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:24:37.320822+0000", 2024-09-16T03:26:09.824 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 32 2024-09-16T03:26:09.824 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:09.825 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:09.825 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap": [], 2024-09-16T03:26:09.825 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap_items": [], 2024-09-16T03:26:09.825 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap_primaries": [], 2024-09-16T03:26:09.825 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_temp": [], 2024-09-16T03:26:09.825 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_temp": [], 2024-09-16T03:26:09.825 INFO:tasks.workunit.client.0.smithi096.stderr: "blocklist": {}, 2024-09-16T03:26:09.825 INFO:tasks.workunit.client.0.smithi096.stderr: "range_blocklist": {}, 2024-09-16T03:26:09.825 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profiles": { 2024-09-16T03:26:09.825 INFO:tasks.workunit.client.0.smithi096.stderr: "default": { 2024-09-16T03:26:09.825 INFO:tasks.workunit.client.0.smithi096.stderr: "k": "2", 2024-09-16T03:26:09.825 INFO:tasks.workunit.client.0.smithi096.stderr: "m": "2", 2024-09-16T03:26:09.825 INFO:tasks.workunit.client.0.smithi096.stderr: "plugin": "jerasure", 2024-09-16T03:26:09.825 INFO:tasks.workunit.client.0.smithi096.stderr: "technique": "reed_sol_van" 2024-09-16T03:26:09.825 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:09.826 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.826 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps_queue": [], 2024-09-16T03:26:09.826 INFO:tasks.workunit.client.0.smithi096.stderr: "new_removed_snaps": [], 2024-09-16T03:26:09.826 INFO:tasks.workunit.client.0.smithi096.stderr: "new_purged_snaps": [], 2024-09-16T03:26:09.826 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_node_flags": {}, 2024-09-16T03:26:09.826 INFO:tasks.workunit.client.0.smithi096.stderr: "device_class_flags": {}, 2024-09-16T03:26:09.826 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode": { 2024-09-16T03:26:09.826 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode_enabled": false, 2024-09-16T03:26:09.826 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_bucket_count": 0, 2024-09-16T03:26:09.826 INFO:tasks.workunit.client.0.smithi096.stderr: "degraded_stretch_mode": 0, 2024-09-16T03:26:09.826 INFO:tasks.workunit.client.0.smithi096.stderr: "recovering_stretch_mode": 0, 2024-09-16T03:26:09.826 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode_bucket": 0 2024-09-16T03:26:09.826 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:09.826 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.827 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_metadata": [ 2024-09-16T03:26:09.827 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.827 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:26:09.827 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:26:09.827 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]", 2024-09-16T03:26:09.827 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:26:09.827 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:26:09.827 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:26:09.827 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:26:09.827 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:26:09.827 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:26:09.827 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:26:09.827 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:26:09.827 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:26:09.828 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:26:09.828 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:26:09.828 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/0/block", 2024-09-16T03:26:09.828 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:26:09.828 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:26:09.828 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:26:09.828 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:26:09.828 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:26:09.828 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:26:09.828 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:26:09.828 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:26:09.828 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:26:09.828 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:26:09.829 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:22:53.662571Z", 2024-09-16T03:26:09.829 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:26:09.829 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:26:09.829 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:26:09.829 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:26:09.829 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:26:09.829 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:26:09.829 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:26:09.829 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]", 2024-09-16T03:26:09.829 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:26:09.829 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]", 2024-09-16T03:26:09.829 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]", 2024-09-16T03:26:09.829 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:26:09.829 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:26:09.830 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:26:09.830 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:26:09.830 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:26:09.830 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:26:09.830 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:26:09.830 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:26:09.830 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:26:09.830 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/0", 2024-09-16T03:26:09.830 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:26:09.830 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:26:09.830 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:26:09.830 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.830 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.830 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:26:09.831 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:26:09.831 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]", 2024-09-16T03:26:09.831 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:26:09.831 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:26:09.831 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:26:09.831 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:26:09.831 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:26:09.831 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:26:09.831 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:26:09.831 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:26:09.831 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:26:09.831 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:26:09.831 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:26:09.831 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/1/block", 2024-09-16T03:26:09.832 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:26:09.832 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:26:09.832 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:26:09.832 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:26:09.832 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:26:09.832 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:26:09.832 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:26:09.832 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:26:09.832 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:26:09.832 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:26:09.832 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:23:30.129885Z", 2024-09-16T03:26:09.832 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:26:09.832 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:26:09.832 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:26:09.833 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:26:09.833 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:26:09.833 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:26:09.833 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:26:09.833 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]", 2024-09-16T03:26:09.833 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:26:09.833 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]", 2024-09-16T03:26:09.833 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]", 2024-09-16T03:26:09.833 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:26:09.833 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:26:09.833 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:26:09.833 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:26:09.833 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:26:09.833 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:26:09.834 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:26:09.834 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:26:09.834 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:26:09.834 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/1", 2024-09-16T03:26:09.834 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:26:09.834 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:26:09.834 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:26:09.834 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.834 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.834 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:26:09.834 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:26:09.834 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]", 2024-09-16T03:26:09.834 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:26:09.834 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:26:09.835 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:26:09.835 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:26:09.835 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:26:09.835 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:26:09.835 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:26:09.835 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:26:09.835 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:26:09.835 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:26:09.835 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:26:09.835 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/2/block", 2024-09-16T03:26:09.835 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:26:09.835 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:26:09.835 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:26:09.835 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:26:09.836 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:26:09.836 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:26:09.836 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:26:09.836 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:26:09.836 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:26:09.836 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:26:09.836 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:24:07.764502Z", 2024-09-16T03:26:09.836 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:26:09.836 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:26:09.836 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:26:09.836 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:26:09.836 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:26:09.836 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:26:09.837 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:26:09.837 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]", 2024-09-16T03:26:09.837 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:26:09.837 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]", 2024-09-16T03:26:09.837 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]", 2024-09-16T03:26:09.837 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:26:09.837 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:26:09.837 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:26:09.837 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:26:09.837 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:26:09.837 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:26:09.837 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:26:09.837 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:26:09.837 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:26:09.838 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/2", 2024-09-16T03:26:09.838 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:26:09.838 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:26:09.838 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:26:09.838 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:09.838 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:09.838 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_clean_epochs": { 2024-09-16T03:26:09.838 INFO:tasks.workunit.client.0.smithi096.stderr: "min_last_epoch_clean": 86, 2024-09-16T03:26:09.838 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": { 2024-09-16T03:26:09.838 INFO:tasks.workunit.client.0.smithi096.stderr: "per_pool": [ 2024-09-16T03:26:09.838 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.838 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 1, 2024-09-16T03:26:09.838 INFO:tasks.workunit.client.0.smithi096.stderr: "floor": 86 2024-09-16T03:26:09.838 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.839 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.839 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 2, 2024-09-16T03:26:09.839 INFO:tasks.workunit.client.0.smithi096.stderr: "floor": 86 2024-09-16T03:26:09.839 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:09.839 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:09.839 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.839 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_epochs": [ 2024-09-16T03:26:09.839 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.839 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:26:09.839 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 86 2024-09-16T03:26:09.839 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.839 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.839 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:26:09.839 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 86 2024-09-16T03:26:09.840 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:09.840 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:09.840 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.840 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_first_committed": 84, 2024-09-16T03:26:09.840 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_last_committed": 86, 2024-09-16T03:26:09.840 INFO:tasks.workunit.client.0.smithi096.stderr: "crushmap": { 2024-09-16T03:26:09.840 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": [ 2024-09-16T03:26:09.840 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.840 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:26:09.840 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.0", 2024-09-16T03:26:09.840 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:26:09.840 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.840 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.840 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:26:09.841 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.1", 2024-09-16T03:26:09.841 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:26:09.841 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.841 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.841 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:26:09.841 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.2", 2024-09-16T03:26:09.841 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:26:09.841 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:09.841 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:09.841 INFO:tasks.workunit.client.0.smithi096.stderr: "types": [ 2024-09-16T03:26:09.841 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.841 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 0, 2024-09-16T03:26:09.841 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd" 2024-09-16T03:26:09.841 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.842 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.842 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:26:09.842 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "host" 2024-09-16T03:26:09.842 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.842 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.842 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 2, 2024-09-16T03:26:09.842 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "chassis" 2024-09-16T03:26:09.842 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.842 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.842 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 3, 2024-09-16T03:26:09.842 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "rack" 2024-09-16T03:26:09.842 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.842 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.842 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 4, 2024-09-16T03:26:09.843 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "row" 2024-09-16T03:26:09.843 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.843 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.843 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 5, 2024-09-16T03:26:09.843 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "pdu" 2024-09-16T03:26:09.843 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.843 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.843 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 6, 2024-09-16T03:26:09.843 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "pod" 2024-09-16T03:26:09.843 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.843 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.843 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 7, 2024-09-16T03:26:09.843 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "room" 2024-09-16T03:26:09.843 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.843 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.844 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 8, 2024-09-16T03:26:09.844 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "datacenter" 2024-09-16T03:26:09.844 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.844 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.844 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 9, 2024-09-16T03:26:09.844 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "zone" 2024-09-16T03:26:09.844 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.844 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.844 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 10, 2024-09-16T03:26:09.844 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "region" 2024-09-16T03:26:09.844 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.844 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.844 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:26:09.844 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "root" 2024-09-16T03:26:09.845 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:09.845 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:09.845 INFO:tasks.workunit.client.0.smithi096.stderr: "buckets": [ 2024-09-16T03:26:09.845 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.845 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -1, 2024-09-16T03:26:09.845 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "default", 2024-09-16T03:26:09.845 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:26:09.845 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "root", 2024-09-16T03:26:09.845 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:26:09.845 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:26:09.845 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:26:09.845 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:26:09.845 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.845 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -3, 2024-09-16T03:26:09.846 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:26:09.846 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:26:09.846 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:09.846 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:09.846 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.846 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.846 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -2, 2024-09-16T03:26:09.846 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "default~hdd", 2024-09-16T03:26:09.846 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:26:09.846 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "root", 2024-09-16T03:26:09.846 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:26:09.846 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:26:09.846 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:26:09.846 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:26:09.846 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.847 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -4, 2024-09-16T03:26:09.847 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:26:09.847 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:26:09.847 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:09.847 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:09.847 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.847 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.847 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -3, 2024-09-16T03:26:09.847 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "smithi096", 2024-09-16T03:26:09.847 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:26:09.847 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "host", 2024-09-16T03:26:09.847 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:26:09.847 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:26:09.847 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:26:09.848 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:26:09.848 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.848 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:26:09.848 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:26:09.848 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:26:09.848 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.848 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.848 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:26:09.848 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:26:09.848 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 1 2024-09-16T03:26:09.848 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.848 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.848 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:26:09.848 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:26:09.849 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 2 2024-09-16T03:26:09.849 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:09.849 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:09.849 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.849 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.849 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -4, 2024-09-16T03:26:09.849 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "smithi096~hdd", 2024-09-16T03:26:09.849 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:26:09.849 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "host", 2024-09-16T03:26:09.849 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:26:09.849 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:26:09.849 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:26:09.849 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:26:09.849 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.850 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:26:09.850 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:26:09.850 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:26:09.850 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.850 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.850 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:26:09.850 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:26:09.850 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 1 2024-09-16T03:26:09.850 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.850 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.850 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:26:09.850 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:26:09.850 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 2 2024-09-16T03:26:09.850 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:09.850 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:09.851 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:09.851 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:09.851 INFO:tasks.workunit.client.0.smithi096.stderr: "rules": [ 2024-09-16T03:26:09.851 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.851 INFO:tasks.workunit.client.0.smithi096.stderr: "rule_id": 0, 2024-09-16T03:26:09.851 INFO:tasks.workunit.client.0.smithi096.stderr: "rule_name": "replicated_rule", 2024-09-16T03:26:09.851 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:26:09.851 INFO:tasks.workunit.client.0.smithi096.stderr: "steps": [ 2024-09-16T03:26:09.851 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.851 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "take", 2024-09-16T03:26:09.851 INFO:tasks.workunit.client.0.smithi096.stderr: "item": -1, 2024-09-16T03:26:09.851 INFO:tasks.workunit.client.0.smithi096.stderr: "item_name": "default" 2024-09-16T03:26:09.851 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.851 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.852 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "choose_firstn", 2024-09-16T03:26:09.852 INFO:tasks.workunit.client.0.smithi096.stderr: "num": 0, 2024-09-16T03:26:09.852 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "osd" 2024-09-16T03:26:09.852 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.852 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.852 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "emit" 2024-09-16T03:26:09.852 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:09.852 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:09.852 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:09.852 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:09.852 INFO:tasks.workunit.client.0.smithi096.stderr: "tunables": { 2024-09-16T03:26:09.852 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_local_tries": 0, 2024-09-16T03:26:09.852 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_local_fallback_tries": 0, 2024-09-16T03:26:09.852 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_total_tries": 50, 2024-09-16T03:26:09.853 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_descend_once": 1, 2024-09-16T03:26:09.853 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_vary_r": 1, 2024-09-16T03:26:09.853 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_stable": 1, 2024-09-16T03:26:09.853 INFO:tasks.workunit.client.0.smithi096.stderr: "msr_descents": 100, 2024-09-16T03:26:09.853 INFO:tasks.workunit.client.0.smithi096.stderr: "msr_collision_tries": 100, 2024-09-16T03:26:09.853 INFO:tasks.workunit.client.0.smithi096.stderr: "straw_calc_version": 1, 2024-09-16T03:26:09.853 INFO:tasks.workunit.client.0.smithi096.stderr: "allowed_bucket_algs": 54, 2024-09-16T03:26:09.853 INFO:tasks.workunit.client.0.smithi096.stderr: "profile": "jewel", 2024-09-16T03:26:09.853 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_tunables": 1, 2024-09-16T03:26:09.853 INFO:tasks.workunit.client.0.smithi096.stderr: "legacy_tunables": 0, 2024-09-16T03:26:09.853 INFO:tasks.workunit.client.0.smithi096.stderr: "minimum_required_version": "jewel", 2024-09-16T03:26:09.853 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables": 1, 2024-09-16T03:26:09.853 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables2": 1, 2024-09-16T03:26:09.853 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v2_rules": 0, 2024-09-16T03:26:09.854 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables3": 1, 2024-09-16T03:26:09.854 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v3_rules": 0, 2024-09-16T03:26:09.854 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v4_buckets": 1, 2024-09-16T03:26:09.854 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables5": 1, 2024-09-16T03:26:09.854 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v5_rules": 0, 2024-09-16T03:26:09.854 INFO:tasks.workunit.client.0.smithi096.stderr: "has_msr_rules": 0 2024-09-16T03:26:09.854 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.856 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_args": {} 2024-09-16T03:26:09.856 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.856 INFO:tasks.workunit.client.0.smithi096.stderr: "fsmap": { 2024-09-16T03:26:09.856 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 1, 2024-09-16T03:26:09.856 INFO:tasks.workunit.client.0.smithi096.stderr: "btime": "2024-09-16T03:22:46:882186+0000", 2024-09-16T03:26:09.856 INFO:tasks.workunit.client.0.smithi096.stderr: "default_fscid": -1, 2024-09-16T03:26:09.856 INFO:tasks.workunit.client.0.smithi096.stderr: "compat": { 2024-09-16T03:26:09.856 INFO:tasks.workunit.client.0.smithi096.stderr: "compat": {}, 2024-09-16T03:26:09.856 INFO:tasks.workunit.client.0.smithi096.stderr: "ro_compat": {}, 2024-09-16T03:26:09.856 INFO:tasks.workunit.client.0.smithi096.stderr: "incompat": { 2024-09-16T03:26:09.856 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_1": "base v0.20", 2024-09-16T03:26:09.856 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_2": "client writeable ranges", 2024-09-16T03:26:09.856 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_3": "default file layouts on dirs", 2024-09-16T03:26:09.857 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_4": "dir inode in separate object", 2024-09-16T03:26:09.857 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_5": "mds uses versioned encoding", 2024-09-16T03:26:09.857 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_6": "dirfrag is stored in omap", 2024-09-16T03:26:09.857 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_8": "no anchor table", 2024-09-16T03:26:09.857 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_9": "file layout v2", 2024-09-16T03:26:09.857 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_10": "snaprealm v2", 2024-09-16T03:26:09.857 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_11": "minor log segments", 2024-09-16T03:26:09.857 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_12": "quiesce subvolumes" 2024-09-16T03:26:09.857 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:09.857 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.857 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_flags": { 2024-09-16T03:26:09.857 INFO:tasks.workunit.client.0.smithi096.stderr: "enable_multiple": true, 2024-09-16T03:26:09.858 INFO:tasks.workunit.client.0.smithi096.stderr: "ever_enabled_multiple": true 2024-09-16T03:26:09.858 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.858 INFO:tasks.workunit.client.0.smithi096.stderr: "standbys": [], 2024-09-16T03:26:09.858 INFO:tasks.workunit.client.0.smithi096.stderr: "filesystems": [] 2024-09-16T03:26:09.858 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.858 INFO:tasks.workunit.client.0.smithi096.stderr: "mdsmap_first_committed": 1, 2024-09-16T03:26:09.858 INFO:tasks.workunit.client.0.smithi096.stderr: "mdsmap_last_committed": 1, 2024-09-16T03:26:09.858 INFO:tasks.workunit.client.0.smithi096.stderr: "auth": { 2024-09-16T03:26:09.858 INFO:tasks.workunit.client.0.smithi096.stderr: "first_committed": 1, 2024-09-16T03:26:09.858 INFO:tasks.workunit.client.0.smithi096.stderr: "last_committed": 5, 2024-09-16T03:26:09.858 INFO:tasks.workunit.client.0.smithi096.stderr: "num_secrets": 3 2024-09-16T03:26:09.859 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.859 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 64, 2024-09-16T03:26:09.859 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_active": 64, 2024-09-16T03:26:09.859 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_unknown": 0, 2024-09-16T03:26:09.859 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osd": 3, 2024-09-16T03:26:09.859 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_sum": { 2024-09-16T03:26:09.859 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:26:09.859 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:26:09.859 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:26:09.859 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:26:09.859 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:26:09.859 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:26:09.859 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:26:09.859 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:26:09.860 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:26:09.860 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:26:09.860 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:26:09.860 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:26:09.860 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:26:09.860 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:26:09.860 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:26:09.860 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:26:09.860 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:26:09.860 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:26:09.860 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:26:09.860 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:26:09.860 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:26:09.861 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:26:09.861 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:26:09.861 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:26:09.861 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:26:09.861 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:26:09.861 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:26:09.861 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:26:09.861 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:26:09.861 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:26:09.861 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:26:09.861 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:26:09.861 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:26:09.861 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:26:09.861 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:26:09.862 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:26:09.862 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:26:09.862 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:26:09.862 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:26:09.862 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:26:09.862 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:26:09.862 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.862 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:26:09.862 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:26:09.862 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:26:09.862 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:26:09.862 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:26:09.862 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:26:09.862 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:26:09.863 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:26:09.863 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:26:09.863 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:26:09.863 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:26:09.863 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.863 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:26:09.863 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:26:09.863 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 128, 2024-09-16T03:26:09.863 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 128, 2024-09-16T03:26:09.863 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 0 2024-09-16T03:26:09.863 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.863 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_sum": { 2024-09-16T03:26:09.863 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 0, 2024-09-16T03:26:09.863 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 0, 2024-09-16T03:26:09.864 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pgs": 128, 2024-09-16T03:26:09.864 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osds": 2, 2024-09-16T03:26:09.864 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_osds": 2, 2024-09-16T03:26:09.864 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_omap_osds": 2, 2024-09-16T03:26:09.864 INFO:tasks.workunit.client.0.smithi096.stderr: "kb": 209715200, 2024-09-16T03:26:09.864 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used": 54640, 2024-09-16T03:26:09.864 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_data": 960, 2024-09-16T03:26:09.864 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_omap": 3, 2024-09-16T03:26:09.864 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_meta": 53628, 2024-09-16T03:26:09.864 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_avail": 209660560, 2024-09-16T03:26:09.864 INFO:tasks.workunit.client.0.smithi096.stderr: "statfs": { 2024-09-16T03:26:09.864 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 214748364800, 2024-09-16T03:26:09.864 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 214692413440, 2024-09-16T03:26:09.864 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:26:09.864 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 983040, 2024-09-16T03:26:09.865 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 369948, 2024-09-16T03:26:09.865 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:26:09.865 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:26:09.865 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:26:09.865 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 3190, 2024-09-16T03:26:09.865 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 54915978 2024-09-16T03:26:09.865 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.865 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_peers": [], 2024-09-16T03:26:09.865 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_trim_queue_len": 0, 2024-09-16T03:26:09.865 INFO:tasks.workunit.client.0.smithi096.stderr: "num_snap_trimming": 0, 2024-09-16T03:26:09.865 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shards_repaired": 0, 2024-09-16T03:26:09.865 INFO:tasks.workunit.client.0.smithi096.stderr: "op_queue_age_hist": { 2024-09-16T03:26:09.865 INFO:tasks.workunit.client.0.smithi096.stderr: "histogram": [], 2024-09-16T03:26:09.865 INFO:tasks.workunit.client.0.smithi096.stderr: "upper_bound": 1 2024-09-16T03:26:09.866 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.866 INFO:tasks.workunit.client.0.smithi096.stderr: "perf_stat": { 2024-09-16T03:26:09.866 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ms": 325, 2024-09-16T03:26:09.866 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ms": 325, 2024-09-16T03:26:09.866 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ns": 325000000, 2024-09-16T03:26:09.866 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ns": 325000000 2024-09-16T03:26:09.866 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.866 INFO:tasks.workunit.client.0.smithi096.stderr: "alerts": [], 2024-09-16T03:26:09.866 INFO:tasks.workunit.client.0.smithi096.stderr: "network_ping_times": [] 2024-09-16T03:26:09.866 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.866 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_sum_by_class": { 2024-09-16T03:26:09.866 INFO:tasks.workunit.client.0.smithi096.stderr: "hdd": { 2024-09-16T03:26:09.866 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 0, 2024-09-16T03:26:09.866 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 0, 2024-09-16T03:26:09.867 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pgs": 128, 2024-09-16T03:26:09.867 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osds": 2, 2024-09-16T03:26:09.867 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_osds": 2, 2024-09-16T03:26:09.867 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_omap_osds": 2, 2024-09-16T03:26:09.867 INFO:tasks.workunit.client.0.smithi096.stderr: "kb": 209715200, 2024-09-16T03:26:09.867 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used": 54640, 2024-09-16T03:26:09.867 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_data": 960, 2024-09-16T03:26:09.867 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_omap": 3, 2024-09-16T03:26:09.867 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_meta": 53628, 2024-09-16T03:26:09.867 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_avail": 209660560, 2024-09-16T03:26:09.867 INFO:tasks.workunit.client.0.smithi096.stderr: "statfs": { 2024-09-16T03:26:09.867 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 214748364800, 2024-09-16T03:26:09.867 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 214692413440, 2024-09-16T03:26:09.868 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:26:09.868 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 983040, 2024-09-16T03:26:09.868 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 369948, 2024-09-16T03:26:09.868 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:26:09.868 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:26:09.868 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:26:09.868 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 3190, 2024-09-16T03:26:09.868 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 54915978 2024-09-16T03:26:09.868 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.868 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_peers": [], 2024-09-16T03:26:09.868 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_trim_queue_len": 0, 2024-09-16T03:26:09.868 INFO:tasks.workunit.client.0.smithi096.stderr: "num_snap_trimming": 0, 2024-09-16T03:26:09.868 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shards_repaired": 0, 2024-09-16T03:26:09.868 INFO:tasks.workunit.client.0.smithi096.stderr: "op_queue_age_hist": { 2024-09-16T03:26:09.868 INFO:tasks.workunit.client.0.smithi096.stderr: "histogram": [], 2024-09-16T03:26:09.868 INFO:tasks.workunit.client.0.smithi096.stderr: "upper_bound": 1 2024-09-16T03:26:09.869 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.869 INFO:tasks.workunit.client.0.smithi096.stderr: "perf_stat": { 2024-09-16T03:26:09.869 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ms": 325, 2024-09-16T03:26:09.869 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ms": 325, 2024-09-16T03:26:09.869 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ns": 325000000, 2024-09-16T03:26:09.869 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ns": 325000000 2024-09-16T03:26:09.869 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.869 INFO:tasks.workunit.client.0.smithi096.stderr: "alerts": [], 2024-09-16T03:26:09.869 INFO:tasks.workunit.client.0.smithi096.stderr: "network_ping_times": [] 2024-09-16T03:26:09.869 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:09.869 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.869 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_stats": [ 2024-09-16T03:26:09.869 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.870 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 2, 2024-09-16T03:26:09.870 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 32, 2024-09-16T03:26:09.870 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:26:09.870 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:26:09.870 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:26:09.870 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:26:09.870 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:26:09.870 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:26:09.870 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:26:09.870 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:26:09.870 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:26:09.870 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:26:09.870 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:26:09.870 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:26:09.871 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:26:09.871 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:26:09.871 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:26:09.871 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:26:09.871 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:26:09.871 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:26:09.871 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:26:09.871 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:26:09.871 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:26:09.871 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:26:09.871 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:26:09.871 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:26:09.871 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:26:09.872 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:26:09.872 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:26:09.872 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:26:09.872 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:26:09.872 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:26:09.872 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:26:09.872 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:26:09.872 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:26:09.872 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:26:09.872 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:26:09.872 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:26:09.872 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:26:09.872 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:26:09.872 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:26:09.873 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:26:09.873 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:26:09.873 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.873 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:26:09.873 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:26:09.873 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:26:09.873 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:26:09.873 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:26:09.873 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:26:09.873 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:26:09.873 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:26:09.873 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:26:09.873 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:26:09.874 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:26:09.874 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.874 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:26:09.874 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:26:09.874 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 64, 2024-09-16T03:26:09.874 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 64, 2024-09-16T03:26:09.874 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 3 2024-09-16T03:26:09.874 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.874 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.874 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 1, 2024-09-16T03:26:09.874 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 32, 2024-09-16T03:26:09.874 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:26:09.874 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:26:09.874 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:26:09.874 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:26:09.875 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:26:09.875 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:26:09.875 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:26:09.875 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:26:09.875 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:26:09.875 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:26:09.875 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:26:09.875 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:26:09.875 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:26:09.875 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:26:09.875 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:26:09.875 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:26:09.875 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:26:09.875 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:26:09.876 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:26:09.876 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:26:09.876 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:26:09.876 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:26:09.876 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:26:09.876 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:26:09.876 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:26:09.876 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:26:09.876 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:26:09.876 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:26:09.876 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:26:09.876 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:26:09.876 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:26:09.876 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:26:09.877 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:26:09.877 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:26:09.877 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:26:09.877 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:26:09.877 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:26:09.877 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:26:09.877 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:26:09.877 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:26:09.877 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:26:09.877 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.877 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:26:09.877 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:26:09.877 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:26:09.877 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:26:09.878 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:26:09.878 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:26:09.878 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:26:09.878 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:26:09.878 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:26:09.878 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:26:09.878 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:26:09.878 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.878 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:26:09.878 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:26:09.878 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 64, 2024-09-16T03:26:09.878 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 64, 2024-09-16T03:26:09.878 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 3 2024-09-16T03:26:09.879 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:09.879 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:09.879 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_stats": [ 2024-09-16T03:26:09.879 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.879 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:26:09.879 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 21474836521 2024-09-16T03:26:09.879 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.879 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.879 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:26:09.879 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 42949672993 2024-09-16T03:26:09.879 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.879 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.879 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:26:09.879 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 0 2024-09-16T03:26:09.880 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:09.880 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:09.880 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_by_state": [ 2024-09-16T03:26:09.880 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.880 INFO:tasks.workunit.client.0.smithi096.stderr: "state": "active+clean", 2024-09-16T03:26:09.880 INFO:tasks.workunit.client.0.smithi096.stderr: "num": 64 2024-09-16T03:26:09.880 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:09.880 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:09.880 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_by_osd": [ 2024-09-16T03:26:09.880 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.880 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:26:09.880 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 0, 2024-09-16T03:26:09.880 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 0, 2024-09-16T03:26:09.881 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:26:09.881 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.881 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.881 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:26:09.881 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 28, 2024-09-16T03:26:09.881 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 64, 2024-09-16T03:26:09.881 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:26:09.881 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.881 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.881 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:26:09.881 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 36, 2024-09-16T03:26:09.881 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 64, 2024-09-16T03:26:09.881 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:26:09.882 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:09.882 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:09.882 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": [ 2024-09-16T03:26:09.882 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.882 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 1, 2024-09-16T03:26:09.882 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": {} 2024-09-16T03:26:09.882 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.882 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:09.882 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 2, 2024-09-16T03:26:09.882 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": {} 2024-09-16T03:26:09.882 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:09.882 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:09.882 INFO:tasks.workunit.client.0.smithi096.stderr: "servicemap": { 2024-09-16T03:26:09.882 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 5, 2024-09-16T03:26:09.883 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:25:38.422788+0000", 2024-09-16T03:26:09.883 INFO:tasks.workunit.client.0.smithi096.stderr: "services": {} 2024-09-16T03:26:09.883 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:09.883 INFO:tasks.workunit.client.0.smithi096.stderr: "mgrstat_first_committed": 84, 2024-09-16T03:26:09.883 INFO:tasks.workunit.client.0.smithi096.stderr: "mgrstat_last_committed": 90, 2024-09-16T03:26:09.883 INFO:tasks.workunit.client.0.smithi096.stderr: "logm_first_committed": 1, 2024-09-16T03:26:09.883 INFO:tasks.workunit.client.0.smithi096.stderr: "logm_last_committed": 407, 2024-09-16T03:26:09.883 INFO:tasks.workunit.client.0.smithi096.stderr: "paxos": { 2024-09-16T03:26:09.883 INFO:tasks.workunit.client.0.smithi096.stderr: "first_committed": 1, 2024-09-16T03:26:09.883 INFO:tasks.workunit.client.0.smithi096.stderr: "last_committed": 601, 2024-09-16T03:26:09.883 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pn": 0, 2024-09-16T03:26:09.883 INFO:tasks.workunit.client.0.smithi096.stderr: "accepted_pn": 0 2024-09-16T03:26:09.883 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:09.883 INFO:tasks.workunit.client.0.smithi096.stderr:}' 2024-09-16T03:26:09.887 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:132: get_fc_lc_diff: jq .osdmap_first_committed 2024-09-16T03:26:09.888 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:132: get_fc_lc_diff: echo '{' '"cluster_fingerprint":' '"fda2fc64-07ed-4add-8224-2e527e11d427",' '"version":' '"19.3.0-4930-gfc3e0bff",' '"commit":' '"fc3e0bff7468fd55478adbae7f75508b749124b6",' '"timestamp":' '"2024-09-16T03:26:09.770284+0000",' '"tag":' '"",' '"health":' '{' '"status":' '"HEALTH_OK",' '"checks":' '{},' '"mutes":' '[]' '},' '"monmap_first_committed":' 1, '"monmap_last_committed":' 1, '"monmap":' '{' '"epoch":' 1, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"modified":' '"2024-09-16T03:22:45.872880Z",' '"created":' '"2024-09-16T03:22:45.872880Z",' '"min_mon_release":' 19, '"min_mon_release_name":' '"squid",' '"election_strategy":' 1, '"disallowed_leaders:' '":' '"",' '"stretch_mode":' false, '"tiebreaker_mon":' '"",' '"removed_ranks:' '":' '"",' '"features":' '{' '"persistent":' '[' '"kraken",' '"luminous",' '"mimic",' '"osdmap-prune",' '"nautilus",' '"octopus",' '"pacific",' '"elector-pinging",' '"quincy",' '"reef",' '"squid"' '],' '"optional":' '[]' '},' '"mons":' '[' '{' '"rank":' 0, '"name":' '"a",' '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:7302",' '"nonce":' 0 '}' ']' '},' '"addr":' '"127.0.0.1:7302/0",' '"public_addr":' '"127.0.0.1:7302/0",' '"priority":' 0, '"weight":' 0, '"crush_location":' '"{}"' '}' ']' '},' '"quorum":' '[' 0 '],' '"osdmap":' '{' '"epoch":' 86, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"created":' '"2024-09-16T03:22:46.906117+0000",' '"modified":' '"2024-09-16T03:26:02.230083+0000",' '"last_up_change":' '"2024-09-16T03:25:08.513363+0000",' '"last_in_change":' '"2024-09-16T03:25:09.839444+0000",' '"flags":' '"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit",' '"flags_num":' 5799936, '"flags_set":' '[' '"pglog_hardlimit",' '"purged_snapdirs",' '"recovery_deletes",' '"sortbitwise"' '],' '"crush_version":' 7, '"full_ratio":' 0.97000002861022949, '"backfillfull_ratio":' 0.97000002861022949, '"nearfull_ratio":' 0.85000002384185791, '"cluster_snapshot":' '"",' '"pool_max":' 2, '"max_osd":' 3, '"require_min_compat_client":' '"luminous",' '"min_compat_client":' '"jewel",' '"require_osd_release":' '"squid",' '"allow_crimson":' false, '"pools":' '[' '{' '"pool":' 1, '"pool_name":' '"foo",' '"create_time":' '"2024-09-16T03:24:44.525189+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 2, '"min_size":' 1, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"85",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.8700000047683716, '"score_stable":' 1.8700000047683716, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1.25, '"raw_score_stable":' 1.25, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '},' '{' '"pool":' 2, '"pool_name":' '"bar",' '"create_time":' '"2024-09-16T03:24:46.226575+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 2, '"min_size":' 1, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"83",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.4900000095367432, '"score_stable":' 1.4900000095367432, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1, '"raw_score_stable":' 1, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '}' '],' '"osds":' '[' '{' '"osd":' 0, '"uuid":' '"64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 5, '"up_thru":' 84, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6802",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6803",' '"nonce":' 3375787448 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6804",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6805",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6808",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6809",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6806",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6807",' '"nonce":' 3375787448 '}' ']' '},' '"public_addr":' '"127.0.0.1:6803/3375787448",' '"cluster_addr":' '"127.0.0.1:6805/3375787448",' '"heartbeat_back_addr":' '"127.0.0.1:6809/3375787448",' '"heartbeat_front_addr":' '"127.0.0.1:6807/3375787448",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 1, '"uuid":' '"74b26727-75c9-444d-8782-719e4197a382",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 10, '"up_thru":' 84, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6810",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6811",' '"nonce":' 3733255132 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6812",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6813",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6816",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6817",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6814",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6815",' '"nonce":' 3733255132 '}' ']' '},' '"public_addr":' '"127.0.0.1:6811/3733255132",' '"cluster_addr":' '"127.0.0.1:6813/3733255132",' '"heartbeat_back_addr":' '"127.0.0.1:6817/3733255132",' '"heartbeat_front_addr":' '"127.0.0.1:6815/3733255132",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 2, '"uuid":' '"143da3a7-dad9-4b1e-966b-76cf5bdd3c82",' '"up":' 0, '"in":' 0, '"weight":' 0, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 15, '"up_thru":' 21, '"down_at":' 33, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6818",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6819",' '"nonce":' 963814857 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6820",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6821",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6824",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6825",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6822",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6823",' '"nonce":' 963814857 '}' ']' '},' '"public_addr":' '"127.0.0.1:6819/963814857",' '"cluster_addr":' '"127.0.0.1:6821/963814857",' '"heartbeat_back_addr":' '"127.0.0.1:6825/963814857",' '"heartbeat_front_addr":' '"127.0.0.1:6823/963814857",' '"state":' '[' '"exists"' ']' '}' '],' '"osd_xinfo":' '[' '{' '"osd":' 0, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:22.481942+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 1, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:59.663703+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 2, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 65536, '"last_purged_snaps_scrub":' '"2024-09-16T03:24:37.320822+0000",' '"dead_epoch":' 32 '}' '],' '"pg_upmap":' '[],' '"pg_upmap_items":' '[],' '"pg_upmap_primaries":' '[],' '"pg_temp":' '[],' '"primary_temp":' '[],' '"blocklist":' '{},' '"range_blocklist":' '{},' '"erasure_code_profiles":' '{' '"default":' '{' '"k":' '"2",' '"m":' '"2",' '"plugin":' '"jerasure",' '"technique":' '"reed_sol_van"' '}' '},' '"removed_snaps_queue":' '[],' '"new_removed_snaps":' '[],' '"new_purged_snaps":' '[],' '"crush_node_flags":' '{},' '"device_class_flags":' '{},' '"stretch_mode":' '{' '"stretch_mode_enabled":' false, '"stretch_bucket_count":' 0, '"degraded_stretch_mode":' 0, '"recovering_stretch_mode":' 0, '"stretch_mode_bucket":' 0 '}' '},' '"osd_metadata":' '[' '{' '"id":' 0, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/0/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:22:53.662571Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]",' '"hb_front_addr":' '"[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/0",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 1, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/1/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:23:30.129885Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]",' '"hb_front_addr":' '"[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/1",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 2, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/2/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:24:07.764502Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]",' '"hb_front_addr":' '"[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/2",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '}' '],' '"osdmap_clean_epochs":' '{' '"min_last_epoch_clean":' 86, '"last_epoch_clean":' '{' '"per_pool":' '[' '{' '"poolid":' 1, '"floor":' 86 '},' '{' '"poolid":' 2, '"floor":' 86 '}' ']' '},' '"osd_epochs":' '[' '{' '"id":' 0, '"epoch":' 86 '},' '{' '"id":' 1, '"epoch":' 86 '}' ']' '},' '"osdmap_first_committed":' 84, '"osdmap_last_committed":' 86, '"crushmap":' '{' '"devices":' '[' '{' '"id":' 0, '"name":' '"osd.0",' '"class":' '"hdd"' '},' '{' '"id":' 1, '"name":' '"osd.1",' '"class":' '"hdd"' '},' '{' '"id":' 2, '"name":' '"osd.2",' '"class":' '"hdd"' '}' '],' '"types":' '[' '{' '"type_id":' 0, '"name":' '"osd"' '},' '{' '"type_id":' 1, '"name":' '"host"' '},' '{' '"type_id":' 2, '"name":' '"chassis"' '},' '{' '"type_id":' 3, '"name":' '"rack"' '},' '{' '"type_id":' 4, '"name":' '"row"' '},' '{' '"type_id":' 5, '"name":' '"pdu"' '},' '{' '"type_id":' 6, '"name":' '"pod"' '},' '{' '"type_id":' 7, '"name":' '"room"' '},' '{' '"type_id":' 8, '"name":' '"datacenter"' '},' '{' '"type_id":' 9, '"name":' '"zone"' '},' '{' '"type_id":' 10, '"name":' '"region"' '},' '{' '"type_id":' 11, '"name":' '"root"' '}' '],' '"buckets":' '[' '{' '"id":' -1, '"name":' '"default",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -3, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -2, '"name":' '"default~hdd",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -4, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -3, '"name":' '"smithi096",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '},' '{' '"id":' -4, '"name":' '"smithi096~hdd",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '}' '],' '"rules":' '[' '{' '"rule_id":' 0, '"rule_name":' '"replicated_rule",' '"type":' 1, '"steps":' '[' '{' '"op":' '"take",' '"item":' -1, '"item_name":' '"default"' '},' '{' '"op":' '"choose_firstn",' '"num":' 0, '"type":' '"osd"' '},' '{' '"op":' '"emit"' '}' ']' '}' '],' '"tunables":' '{' '"choose_local_tries":' 0, '"choose_local_fallback_tries":' 0, '"choose_total_tries":' 50, '"chooseleaf_descend_once":' 1, '"chooseleaf_vary_r":' 1, '"chooseleaf_stable":' 1, '"msr_descents":' 100, '"msr_collision_tries":' 100, '"straw_calc_version":' 1, '"allowed_bucket_algs":' 54, '"profile":' '"jewel",' '"optimal_tunables":' 1, '"legacy_tunables":' 0, '"minimum_required_version":' '"jewel",' '"require_feature_tunables":' 1, '"require_feature_tunables2":' 1, '"has_v2_rules":' 0, '"require_feature_tunables3":' 1, '"has_v3_rules":' 0, '"has_v4_buckets":' 1, '"require_feature_tunables5":' 1, '"has_v5_rules":' 0, '"has_msr_rules":' 0 '},' '"choose_args":' '{}' '},' '"fsmap":' '{' '"epoch":' 1, '"btime":' '"2024-09-16T03:22:46:882186+0000",' '"default_fscid":' -1, '"compat":' '{' '"compat":' '{},' '"ro_compat":' '{},' '"incompat":' '{' '"feature_1":' '"base' 'v0.20",' '"feature_2":' '"client' writeable 'ranges",' '"feature_3":' '"default' file layouts on 'dirs",' '"feature_4":' '"dir' inode in separate 'object",' '"feature_5":' '"mds' uses versioned 'encoding",' '"feature_6":' '"dirfrag' is stored in 'omap",' '"feature_8":' '"no' anchor 'table",' '"feature_9":' '"file' layout 'v2",' '"feature_10":' '"snaprealm' 'v2",' '"feature_11":' '"minor' log 'segments",' '"feature_12":' '"quiesce' 'subvolumes"' '}' '},' '"feature_flags":' '{' '"enable_multiple":' true, '"ever_enabled_multiple":' true '},' '"standbys":' '[],' '"filesystems":' '[]' '},' '"mdsmap_first_committed":' 1, '"mdsmap_last_committed":' 1, '"auth":' '{' '"first_committed":' 1, '"last_committed":' 5, '"num_secrets":' 3 '},' '"num_pg":' 64, '"num_pg_active":' 64, '"num_pg_unknown":' 0, '"num_osd":' 3, '"pool_sum":' '{' '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 128, '"acting":' 128, '"num_store_stats":' 0 '},' '"osd_sum":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54640, '"kb_used_data":' 960, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660560, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692413440, '"internally_reserved":' 0, '"allocated":' 983040, '"data_stored":' 369948, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 325, '"apply_latency_ms":' 325, '"commit_latency_ns":' 325000000, '"apply_latency_ns":' 325000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '},' '"osd_sum_by_class":' '{' '"hdd":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54640, '"kb_used_data":' 960, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660560, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692413440, '"internally_reserved":' 0, '"allocated":' 983040, '"data_stored":' 369948, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 325, '"apply_latency_ms":' 325, '"commit_latency_ns":' 325000000, '"apply_latency_ns":' 325000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '}' '},' '"pool_stats":' '[' '{' '"poolid":' 2, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '},' '{' '"poolid":' 1, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '}' '],' '"osd_stats":' '[' '{' '"osd":' 0, '"seq":' 21474836521 '},' '{' '"osd":' 1, '"seq":' 42949672993 '},' '{' '"osd":' 2, '"seq":' 0 '}' '],' '"num_pg_by_state":' '[' '{' '"state":' '"active+clean",' '"num":' 64 '}' '],' '"num_pg_by_osd":' '[' '{' '"osd":' 2, '"num_primary_pg":' 0, '"num_acting_pg":' 0, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 0, '"num_primary_pg":' 28, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 1, '"num_primary_pg":' 36, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '}' '],' '"purged_snaps":' '[' '{' '"pool":' 1, '"purged_snaps":' '{}' '},' '{' '"pool":' 2, '"purged_snaps":' '{}' '}' '],' '"servicemap":' '{' '"epoch":' 5, '"modified":' '"2024-09-16T03:25:38.422788+0000",' '"services":' '{}' '},' '"mgrstat_first_committed":' 84, '"mgrstat_last_committed":' 90, '"logm_first_committed":' 1, '"logm_last_committed":' 407, '"paxos":' '{' '"first_committed":' 1, '"last_committed":' 601, '"last_pn":' 0, '"accepted_pn":' 0 '}' '}' 2024-09-16T03:26:09.888 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:132: get_fc_lc_diff: osdm_fc=84 2024-09-16T03:26:09.888 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:134: get_fc_lc_diff: jq .osdmap_last_committed 2024-09-16T03:26:09.888 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:134: get_fc_lc_diff: echo '{' '"cluster_fingerprint":' '"fda2fc64-07ed-4add-8224-2e527e11d427",' '"version":' '"19.3.0-4930-gfc3e0bff",' '"commit":' '"fc3e0bff7468fd55478adbae7f75508b749124b6",' '"timestamp":' '"2024-09-16T03:26:09.770284+0000",' '"tag":' '"",' '"health":' '{' '"status":' '"HEALTH_OK",' '"checks":' '{},' '"mutes":' '[]' '},' '"monmap_first_committed":' 1, '"monmap_last_committed":' 1, '"monmap":' '{' '"epoch":' 1, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"modified":' '"2024-09-16T03:22:45.872880Z",' '"created":' '"2024-09-16T03:22:45.872880Z",' '"min_mon_release":' 19, '"min_mon_release_name":' '"squid",' '"election_strategy":' 1, '"disallowed_leaders:' '":' '"",' '"stretch_mode":' false, '"tiebreaker_mon":' '"",' '"removed_ranks:' '":' '"",' '"features":' '{' '"persistent":' '[' '"kraken",' '"luminous",' '"mimic",' '"osdmap-prune",' '"nautilus",' '"octopus",' '"pacific",' '"elector-pinging",' '"quincy",' '"reef",' '"squid"' '],' '"optional":' '[]' '},' '"mons":' '[' '{' '"rank":' 0, '"name":' '"a",' '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:7302",' '"nonce":' 0 '}' ']' '},' '"addr":' '"127.0.0.1:7302/0",' '"public_addr":' '"127.0.0.1:7302/0",' '"priority":' 0, '"weight":' 0, '"crush_location":' '"{}"' '}' ']' '},' '"quorum":' '[' 0 '],' '"osdmap":' '{' '"epoch":' 86, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"created":' '"2024-09-16T03:22:46.906117+0000",' '"modified":' '"2024-09-16T03:26:02.230083+0000",' '"last_up_change":' '"2024-09-16T03:25:08.513363+0000",' '"last_in_change":' '"2024-09-16T03:25:09.839444+0000",' '"flags":' '"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit",' '"flags_num":' 5799936, '"flags_set":' '[' '"pglog_hardlimit",' '"purged_snapdirs",' '"recovery_deletes",' '"sortbitwise"' '],' '"crush_version":' 7, '"full_ratio":' 0.97000002861022949, '"backfillfull_ratio":' 0.97000002861022949, '"nearfull_ratio":' 0.85000002384185791, '"cluster_snapshot":' '"",' '"pool_max":' 2, '"max_osd":' 3, '"require_min_compat_client":' '"luminous",' '"min_compat_client":' '"jewel",' '"require_osd_release":' '"squid",' '"allow_crimson":' false, '"pools":' '[' '{' '"pool":' 1, '"pool_name":' '"foo",' '"create_time":' '"2024-09-16T03:24:44.525189+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 2, '"min_size":' 1, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"85",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.8700000047683716, '"score_stable":' 1.8700000047683716, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1.25, '"raw_score_stable":' 1.25, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '},' '{' '"pool":' 2, '"pool_name":' '"bar",' '"create_time":' '"2024-09-16T03:24:46.226575+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 2, '"min_size":' 1, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"83",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.4900000095367432, '"score_stable":' 1.4900000095367432, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1, '"raw_score_stable":' 1, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '}' '],' '"osds":' '[' '{' '"osd":' 0, '"uuid":' '"64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 5, '"up_thru":' 84, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6802",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6803",' '"nonce":' 3375787448 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6804",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6805",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6808",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6809",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6806",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6807",' '"nonce":' 3375787448 '}' ']' '},' '"public_addr":' '"127.0.0.1:6803/3375787448",' '"cluster_addr":' '"127.0.0.1:6805/3375787448",' '"heartbeat_back_addr":' '"127.0.0.1:6809/3375787448",' '"heartbeat_front_addr":' '"127.0.0.1:6807/3375787448",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 1, '"uuid":' '"74b26727-75c9-444d-8782-719e4197a382",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 10, '"up_thru":' 84, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6810",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6811",' '"nonce":' 3733255132 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6812",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6813",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6816",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6817",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6814",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6815",' '"nonce":' 3733255132 '}' ']' '},' '"public_addr":' '"127.0.0.1:6811/3733255132",' '"cluster_addr":' '"127.0.0.1:6813/3733255132",' '"heartbeat_back_addr":' '"127.0.0.1:6817/3733255132",' '"heartbeat_front_addr":' '"127.0.0.1:6815/3733255132",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 2, '"uuid":' '"143da3a7-dad9-4b1e-966b-76cf5bdd3c82",' '"up":' 0, '"in":' 0, '"weight":' 0, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 15, '"up_thru":' 21, '"down_at":' 33, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6818",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6819",' '"nonce":' 963814857 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6820",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6821",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6824",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6825",' '"nonce":' 963814857 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6822",' '"nonce":' 963814857 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6823",' '"nonce":' 963814857 '}' ']' '},' '"public_addr":' '"127.0.0.1:6819/963814857",' '"cluster_addr":' '"127.0.0.1:6821/963814857",' '"heartbeat_back_addr":' '"127.0.0.1:6825/963814857",' '"heartbeat_front_addr":' '"127.0.0.1:6823/963814857",' '"state":' '[' '"exists"' ']' '}' '],' '"osd_xinfo":' '[' '{' '"osd":' 0, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:22.481942+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 1, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:59.663703+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 2, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 65536, '"last_purged_snaps_scrub":' '"2024-09-16T03:24:37.320822+0000",' '"dead_epoch":' 32 '}' '],' '"pg_upmap":' '[],' '"pg_upmap_items":' '[],' '"pg_upmap_primaries":' '[],' '"pg_temp":' '[],' '"primary_temp":' '[],' '"blocklist":' '{},' '"range_blocklist":' '{},' '"erasure_code_profiles":' '{' '"default":' '{' '"k":' '"2",' '"m":' '"2",' '"plugin":' '"jerasure",' '"technique":' '"reed_sol_van"' '}' '},' '"removed_snaps_queue":' '[],' '"new_removed_snaps":' '[],' '"new_purged_snaps":' '[],' '"crush_node_flags":' '{},' '"device_class_flags":' '{},' '"stretch_mode":' '{' '"stretch_mode_enabled":' false, '"stretch_bucket_count":' 0, '"degraded_stretch_mode":' 0, '"recovering_stretch_mode":' 0, '"stretch_mode_bucket":' 0 '}' '},' '"osd_metadata":' '[' '{' '"id":' 0, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/0/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:22:53.662571Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]",' '"hb_front_addr":' '"[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/0",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 1, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/1/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:23:30.129885Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]",' '"hb_front_addr":' '"[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/1",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 2, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6820/963814857,v1:127.0.0.1:6821/963814857]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/2/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:24:07.764502Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6818/963814857,v1:127.0.0.1:6819/963814857]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6824/963814857,v1:127.0.0.1:6825/963814857]",' '"hb_front_addr":' '"[v2:127.0.0.1:6822/963814857,v1:127.0.0.1:6823/963814857]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/2",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '}' '],' '"osdmap_clean_epochs":' '{' '"min_last_epoch_clean":' 86, '"last_epoch_clean":' '{' '"per_pool":' '[' '{' '"poolid":' 1, '"floor":' 86 '},' '{' '"poolid":' 2, '"floor":' 86 '}' ']' '},' '"osd_epochs":' '[' '{' '"id":' 0, '"epoch":' 86 '},' '{' '"id":' 1, '"epoch":' 86 '}' ']' '},' '"osdmap_first_committed":' 84, '"osdmap_last_committed":' 86, '"crushmap":' '{' '"devices":' '[' '{' '"id":' 0, '"name":' '"osd.0",' '"class":' '"hdd"' '},' '{' '"id":' 1, '"name":' '"osd.1",' '"class":' '"hdd"' '},' '{' '"id":' 2, '"name":' '"osd.2",' '"class":' '"hdd"' '}' '],' '"types":' '[' '{' '"type_id":' 0, '"name":' '"osd"' '},' '{' '"type_id":' 1, '"name":' '"host"' '},' '{' '"type_id":' 2, '"name":' '"chassis"' '},' '{' '"type_id":' 3, '"name":' '"rack"' '},' '{' '"type_id":' 4, '"name":' '"row"' '},' '{' '"type_id":' 5, '"name":' '"pdu"' '},' '{' '"type_id":' 6, '"name":' '"pod"' '},' '{' '"type_id":' 7, '"name":' '"room"' '},' '{' '"type_id":' 8, '"name":' '"datacenter"' '},' '{' '"type_id":' 9, '"name":' '"zone"' '},' '{' '"type_id":' 10, '"name":' '"region"' '},' '{' '"type_id":' 11, '"name":' '"root"' '}' '],' '"buckets":' '[' '{' '"id":' -1, '"name":' '"default",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -3, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -2, '"name":' '"default~hdd",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -4, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -3, '"name":' '"smithi096",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '},' '{' '"id":' -4, '"name":' '"smithi096~hdd",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '}' '],' '"rules":' '[' '{' '"rule_id":' 0, '"rule_name":' '"replicated_rule",' '"type":' 1, '"steps":' '[' '{' '"op":' '"take",' '"item":' -1, '"item_name":' '"default"' '},' '{' '"op":' '"choose_firstn",' '"num":' 0, '"type":' '"osd"' '},' '{' '"op":' '"emit"' '}' ']' '}' '],' '"tunables":' '{' '"choose_local_tries":' 0, '"choose_local_fallback_tries":' 0, '"choose_total_tries":' 50, '"chooseleaf_descend_once":' 1, '"chooseleaf_vary_r":' 1, '"chooseleaf_stable":' 1, '"msr_descents":' 100, '"msr_collision_tries":' 100, '"straw_calc_version":' 1, '"allowed_bucket_algs":' 54, '"profile":' '"jewel",' '"optimal_tunables":' 1, '"legacy_tunables":' 0, '"minimum_required_version":' '"jewel",' '"require_feature_tunables":' 1, '"require_feature_tunables2":' 1, '"has_v2_rules":' 0, '"require_feature_tunables3":' 1, '"has_v3_rules":' 0, '"has_v4_buckets":' 1, '"require_feature_tunables5":' 1, '"has_v5_rules":' 0, '"has_msr_rules":' 0 '},' '"choose_args":' '{}' '},' '"fsmap":' '{' '"epoch":' 1, '"btime":' '"2024-09-16T03:22:46:882186+0000",' '"default_fscid":' -1, '"compat":' '{' '"compat":' '{},' '"ro_compat":' '{},' '"incompat":' '{' '"feature_1":' '"base' 'v0.20",' '"feature_2":' '"client' writeable 'ranges",' '"feature_3":' '"default' file layouts on 'dirs",' '"feature_4":' '"dir' inode in separate 'object",' '"feature_5":' '"mds' uses versioned 'encoding",' '"feature_6":' '"dirfrag' is stored in 'omap",' '"feature_8":' '"no' anchor 'table",' '"feature_9":' '"file' layout 'v2",' '"feature_10":' '"snaprealm' 'v2",' '"feature_11":' '"minor' log 'segments",' '"feature_12":' '"quiesce' 'subvolumes"' '}' '},' '"feature_flags":' '{' '"enable_multiple":' true, '"ever_enabled_multiple":' true '},' '"standbys":' '[],' '"filesystems":' '[]' '},' '"mdsmap_first_committed":' 1, '"mdsmap_last_committed":' 1, '"auth":' '{' '"first_committed":' 1, '"last_committed":' 5, '"num_secrets":' 3 '},' '"num_pg":' 64, '"num_pg_active":' 64, '"num_pg_unknown":' 0, '"num_osd":' 3, '"pool_sum":' '{' '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 128, '"acting":' 128, '"num_store_stats":' 0 '},' '"osd_sum":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54640, '"kb_used_data":' 960, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660560, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692413440, '"internally_reserved":' 0, '"allocated":' 983040, '"data_stored":' 369948, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 325, '"apply_latency_ms":' 325, '"commit_latency_ns":' 325000000, '"apply_latency_ns":' 325000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '},' '"osd_sum_by_class":' '{' '"hdd":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54640, '"kb_used_data":' 960, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660560, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692413440, '"internally_reserved":' 0, '"allocated":' 983040, '"data_stored":' 369948, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 325, '"apply_latency_ms":' 325, '"commit_latency_ns":' 325000000, '"apply_latency_ns":' 325000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '}' '},' '"pool_stats":' '[' '{' '"poolid":' 2, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '},' '{' '"poolid":' 1, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '}' '],' '"osd_stats":' '[' '{' '"osd":' 0, '"seq":' 21474836521 '},' '{' '"osd":' 1, '"seq":' 42949672993 '},' '{' '"osd":' 2, '"seq":' 0 '}' '],' '"num_pg_by_state":' '[' '{' '"state":' '"active+clean",' '"num":' 64 '}' '],' '"num_pg_by_osd":' '[' '{' '"osd":' 2, '"num_primary_pg":' 0, '"num_acting_pg":' 0, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 0, '"num_primary_pg":' 28, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 1, '"num_primary_pg":' 36, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '}' '],' '"purged_snaps":' '[' '{' '"pool":' 1, '"purged_snaps":' '{}' '},' '{' '"pool":' 2, '"purged_snaps":' '{}' '}' '],' '"servicemap":' '{' '"epoch":' 5, '"modified":' '"2024-09-16T03:25:38.422788+0000",' '"services":' '{}' '},' '"mgrstat_first_committed":' 84, '"mgrstat_last_committed":' 90, '"logm_first_committed":' 1, '"logm_last_committed":' 407, '"paxos":' '{' '"first_committed":' 1, '"last_committed":' 601, '"last_pn":' 0, '"accepted_pn":' 0 '}' '}' 2024-09-16T03:26:09.888 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:134: get_fc_lc_diff: osdm_lc=86 2024-09-16T03:26:09.888 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:136: get_fc_lc_diff: echo 2 2024-09-16T03:26:09.888 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:291: TEST_mon_last_clean_epoch: pre_map_diff=2 2024-09-16T03:26:09.888 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:293: TEST_mon_last_clean_epoch: activate_osd td/mon-last-clean-epoch 2 2024-09-16T03:26:09.889 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/mon-last-clean-epoch 2024-09-16T03:26:09.889 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2024-09-16T03:26:09.889 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2024-09-16T03:26:09.889 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2024-09-16T03:26:09.889 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/mon-last-clean-epoch/2 2024-09-16T03:26:09.889 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=b3030d7e-4989-4f9f-a16f-63e0a549ceae --auth-supported=none --mon-host=127.0.0.1:7302 ' 2024-09-16T03:26:09.889 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T03:26:09.889 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T03:26:09.889 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T03:26:09.889 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/mon-last-clean-epoch/2' 2024-09-16T03:26:09.889 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/mon-last-clean-epoch/2/journal' 2024-09-16T03:26:09.889 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2024-09-16T03:26:09.889 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2024-09-16T03:26:09.890 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/mon-last-clean-epoch' 2024-09-16T03:26:09.890 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2024-09-16T03:26:09.890 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:26:09.890 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:26:09.890 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:26:09.890 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:26:09.890 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.47455 2024-09-16T03:26:09.890 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.47455/$cluster-$name.asok' 2024-09-16T03:26:09.890 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.47455/$cluster-$name.asok' 2024-09-16T03:26:09.890 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2024-09-16T03:26:09.890 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/mon-last-clean-epoch/$name.log' 2024-09-16T03:26:09.890 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/mon-last-clean-epoch/$name.pid' 2024-09-16T03:26:09.890 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T03:26:09.891 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T03:26:09.891 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T03:26:09.891 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T03:26:09.891 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2024-09-16T03:26:09.891 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2024-09-16T03:26:09.891 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/mon-last-clean-epoch/2 2024-09-16T03:26:09.891 INFO:tasks.workunit.client.0.smithi096.stdout:start osd.2 2024-09-16T03:26:09.892 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2024-09-16T03:26:09.892 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=b3030d7e-4989-4f9f-a16f-63e0a549ceae --auth-supported=none --mon-host=127.0.0.1:7302 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/mon-last-clean-epoch/2 --osd-journal=td/mon-last-clean-epoch/2/journal --chdir= --run-dir=td/mon-last-clean-epoch '--admin-socket=/tmp/ceph-asok.47455/$cluster-$name.asok' --debug-osd=20 '--log-file=td/mon-last-clean-epoch/$name.log' '--pid-file=td/mon-last-clean-epoch/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T03:26:09.892 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/mon-last-clean-epoch/2/whoami 2024-09-16T03:26:09.892 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2024-09-16T03:26:09.892 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2024-09-16T03:26:09.892 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2024-09-16T03:26:09.892 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2024-09-16T03:26:09.893 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:26:09.889+0000 7fa3536797c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:26:09.904 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:26:09.905+0000 7fa3536797c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:26:09.905 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:26:09.905+0000 7fa3536797c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:26:10.264 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2024-09-16T03:26:10.265 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:26:10.265 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2024-09-16T03:26:10.265 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:26:10.265 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:26:10.265 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:26:10.265 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:26:10.265 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T03:26:10.266 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:26:10.266 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:26:10.688 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:26:10.918 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:26:10.917+0000 7fa3536797c0 -1 Falling back to public interface 2024-09-16T03:26:11.689 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:26:11.689 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:26:11.690 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T03:26:11.690 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T03:26:11.690 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:26:11.690 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:26:12.156 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:26:13.158 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:26:13.158 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:26:13.158 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T03:26:13.159 INFO:tasks.workunit.client.0.smithi096.stdout:2 2024-09-16T03:26:13.159 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:26:13.159 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:26:13.637 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:26:14.432 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:26:14.433+0000 7fa3536797c0 -1 osd.2 32 log_to_monitors true 2024-09-16T03:26:14.639 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:26:14.639 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:26:14.639 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T03:26:14.639 INFO:tasks.workunit.client.0.smithi096.stdout:3 2024-09-16T03:26:14.639 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:26:14.639 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:26:15.156 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:26:16.158 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:26:16.158 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:26:16.158 INFO:tasks.workunit.client.0.smithi096.stdout:4 2024-09-16T03:26:16.159 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T03:26:16.159 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:26:16.159 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:26:16.599 INFO:tasks.workunit.client.0.smithi096.stdout:osd.2 up out weight 0 up_from 88 up_thru 21 down_at 33 last_clean_interval [15,32) [v2:127.0.0.1:6818/2576002244,v1:127.0.0.1:6819/2576002244] [v2:127.0.0.1:6820/2576002244,v1:127.0.0.1:6821/2576002244] exists,up 143da3a7-dad9-4b1e-966b-76cf5bdd3c82 2024-09-16T03:26:16.600 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:26:16.600 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:26:16.600 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:26:16.600 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:294: TEST_mon_last_clean_epoch: wait_for_health_ok 2024-09-16T03:26:16.600 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1809: wait_for_health_ok: wait_for_health HEALTH_OK 2024-09-16T03:26:16.600 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1788: wait_for_health: local grepstr=HEALTH_OK 2024-09-16T03:26:16.601 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1789: wait_for_health: get_timeout_delays 300 .1 2024-09-16T03:26:16.601 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: shopt -q -o xtrace 2024-09-16T03:26:16.601 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: echo true 2024-09-16T03:26:16.601 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: local trace=true 2024-09-16T03:26:16.601 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: true 2024-09-16T03:26:16.601 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: shopt -u -o xtrace 2024-09-16T03:26:16.820 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1789: wait_for_health: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '4.5') 2024-09-16T03:26:16.821 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1789: wait_for_health: local -a delays 2024-09-16T03:26:16.821 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1790: wait_for_health: local -i loop=0 2024-09-16T03:26:16.821 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1792: wait_for_health: ceph health detail 2024-09-16T03:26:16.821 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1792: wait_for_health: grep HEALTH_OK 2024-09-16T03:26:17.446 INFO:tasks.workunit.client.0.smithi096.stdout:HEALTH_OK 2024-09-16T03:26:17.447 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:295: TEST_mon_last_clean_epoch: validate_fc 2024-09-16T03:26:17.447 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:119: validate_fc: ceph report 2024-09-16T03:26:18.002 INFO:tasks.workunit.client.0.smithi096.stderr:report 999423031 2024-09-16T03:26:18.018 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:119: validate_fc: report='{ 2024-09-16T03:26:18.018 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_fingerprint": "fda2fc64-07ed-4add-8224-2e527e11d427", 2024-09-16T03:26:18.018 INFO:tasks.workunit.client.0.smithi096.stderr: "version": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:26:18.018 INFO:tasks.workunit.client.0.smithi096.stderr: "commit": "fc3e0bff7468fd55478adbae7f75508b749124b6", 2024-09-16T03:26:18.018 INFO:tasks.workunit.client.0.smithi096.stderr: "timestamp": "2024-09-16T03:26:18.003503+0000", 2024-09-16T03:26:18.018 INFO:tasks.workunit.client.0.smithi096.stderr: "tag": "", 2024-09-16T03:26:18.018 INFO:tasks.workunit.client.0.smithi096.stderr: "health": { 2024-09-16T03:26:18.018 INFO:tasks.workunit.client.0.smithi096.stderr: "status": "HEALTH_OK", 2024-09-16T03:26:18.018 INFO:tasks.workunit.client.0.smithi096.stderr: "checks": {}, 2024-09-16T03:26:18.018 INFO:tasks.workunit.client.0.smithi096.stderr: "mutes": [] 2024-09-16T03:26:18.019 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.019 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap_first_committed": 1, 2024-09-16T03:26:18.019 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap_last_committed": 1, 2024-09-16T03:26:18.019 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap": { 2024-09-16T03:26:18.019 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 1, 2024-09-16T03:26:18.019 INFO:tasks.workunit.client.0.smithi096.stderr: "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", 2024-09-16T03:26:18.019 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:22:45.872880Z", 2024-09-16T03:26:18.019 INFO:tasks.workunit.client.0.smithi096.stderr: "created": "2024-09-16T03:22:45.872880Z", 2024-09-16T03:26:18.019 INFO:tasks.workunit.client.0.smithi096.stderr: "min_mon_release": 19, 2024-09-16T03:26:18.019 INFO:tasks.workunit.client.0.smithi096.stderr: "min_mon_release_name": "squid", 2024-09-16T03:26:18.019 INFO:tasks.workunit.client.0.smithi096.stderr: "election_strategy": 1, 2024-09-16T03:26:18.019 INFO:tasks.workunit.client.0.smithi096.stderr: "disallowed_leaders: ": "", 2024-09-16T03:26:18.019 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode": false, 2024-09-16T03:26:18.020 INFO:tasks.workunit.client.0.smithi096.stderr: "tiebreaker_mon": "", 2024-09-16T03:26:18.020 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_ranks: ": "", 2024-09-16T03:26:18.020 INFO:tasks.workunit.client.0.smithi096.stderr: "features": { 2024-09-16T03:26:18.020 INFO:tasks.workunit.client.0.smithi096.stderr: "persistent": [ 2024-09-16T03:26:18.020 INFO:tasks.workunit.client.0.smithi096.stderr: "kraken", 2024-09-16T03:26:18.020 INFO:tasks.workunit.client.0.smithi096.stderr: "luminous", 2024-09-16T03:26:18.020 INFO:tasks.workunit.client.0.smithi096.stderr: "mimic", 2024-09-16T03:26:18.020 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap-prune", 2024-09-16T03:26:18.020 INFO:tasks.workunit.client.0.smithi096.stderr: "nautilus", 2024-09-16T03:26:18.020 INFO:tasks.workunit.client.0.smithi096.stderr: "octopus", 2024-09-16T03:26:18.020 INFO:tasks.workunit.client.0.smithi096.stderr: "pacific", 2024-09-16T03:26:18.020 INFO:tasks.workunit.client.0.smithi096.stderr: "elector-pinging", 2024-09-16T03:26:18.020 INFO:tasks.workunit.client.0.smithi096.stderr: "quincy", 2024-09-16T03:26:18.020 INFO:tasks.workunit.client.0.smithi096.stderr: "reef", 2024-09-16T03:26:18.021 INFO:tasks.workunit.client.0.smithi096.stderr: "squid" 2024-09-16T03:26:18.021 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:18.021 INFO:tasks.workunit.client.0.smithi096.stderr: "optional": [] 2024-09-16T03:26:18.021 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.021 INFO:tasks.workunit.client.0.smithi096.stderr: "mons": [ 2024-09-16T03:26:18.021 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.021 INFO:tasks.workunit.client.0.smithi096.stderr: "rank": 0, 2024-09-16T03:26:18.021 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "a", 2024-09-16T03:26:18.021 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:26:18.021 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:18.021 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.021 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:18.021 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:7302", 2024-09-16T03:26:18.021 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 0 2024-09-16T03:26:18.022 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:18.022 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:18.022 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.022 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:7302/0", 2024-09-16T03:26:18.022 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:7302/0", 2024-09-16T03:26:18.022 INFO:tasks.workunit.client.0.smithi096.stderr: "priority": 0, 2024-09-16T03:26:18.022 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 0, 2024-09-16T03:26:18.022 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_location": "{}" 2024-09-16T03:26:18.022 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:18.022 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:18.022 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.022 INFO:tasks.workunit.client.0.smithi096.stderr: "quorum": [ 2024-09-16T03:26:18.022 INFO:tasks.workunit.client.0.smithi096.stderr: 0 2024-09-16T03:26:18.022 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:18.023 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap": { 2024-09-16T03:26:18.023 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 88, 2024-09-16T03:26:18.023 INFO:tasks.workunit.client.0.smithi096.stderr: "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", 2024-09-16T03:26:18.023 INFO:tasks.workunit.client.0.smithi096.stderr: "created": "2024-09-16T03:22:46.906117+0000", 2024-09-16T03:26:18.023 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:26:15.120212+0000", 2024-09-16T03:26:18.023 INFO:tasks.workunit.client.0.smithi096.stderr: "last_up_change": "2024-09-16T03:26:15.120212+0000", 2024-09-16T03:26:18.023 INFO:tasks.workunit.client.0.smithi096.stderr: "last_in_change": "2024-09-16T03:25:09.839444+0000", 2024-09-16T03:26:18.023 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-16T03:26:18.023 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_num": 5799936, 2024-09-16T03:26:18.023 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_set": [ 2024-09-16T03:26:18.023 INFO:tasks.workunit.client.0.smithi096.stderr: "pglog_hardlimit", 2024-09-16T03:26:18.023 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snapdirs", 2024-09-16T03:26:18.024 INFO:tasks.workunit.client.0.smithi096.stderr: "recovery_deletes", 2024-09-16T03:26:18.024 INFO:tasks.workunit.client.0.smithi096.stderr: "sortbitwise" 2024-09-16T03:26:18.024 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:18.024 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_version": 8, 2024-09-16T03:26:18.024 INFO:tasks.workunit.client.0.smithi096.stderr: "full_ratio": 0.97000002861022949, 2024-09-16T03:26:18.024 INFO:tasks.workunit.client.0.smithi096.stderr: "backfillfull_ratio": 0.97000002861022949, 2024-09-16T03:26:18.024 INFO:tasks.workunit.client.0.smithi096.stderr: "nearfull_ratio": 0.85000002384185791, 2024-09-16T03:26:18.024 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_snapshot": "", 2024-09-16T03:26:18.024 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_max": 2, 2024-09-16T03:26:18.024 INFO:tasks.workunit.client.0.smithi096.stderr: "max_osd": 3, 2024-09-16T03:26:18.024 INFO:tasks.workunit.client.0.smithi096.stderr: "require_min_compat_client": "luminous", 2024-09-16T03:26:18.024 INFO:tasks.workunit.client.0.smithi096.stderr: "min_compat_client": "jewel", 2024-09-16T03:26:18.024 INFO:tasks.workunit.client.0.smithi096.stderr: "require_osd_release": "squid", 2024-09-16T03:26:18.024 INFO:tasks.workunit.client.0.smithi096.stderr: "allow_crimson": false, 2024-09-16T03:26:18.025 INFO:tasks.workunit.client.0.smithi096.stderr: "pools": [ 2024-09-16T03:26:18.025 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.025 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 1, 2024-09-16T03:26:18.025 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_name": "foo", 2024-09-16T03:26:18.025 INFO:tasks.workunit.client.0.smithi096.stderr: "create_time": "2024-09-16T03:24:44.525189+0000", 2024-09-16T03:26:18.025 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": 1, 2024-09-16T03:26:18.025 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_names": "hashpspool", 2024-09-16T03:26:18.025 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:26:18.025 INFO:tasks.workunit.client.0.smithi096.stderr: "size": 2, 2024-09-16T03:26:18.025 INFO:tasks.workunit.client.0.smithi096.stderr: "min_size": 1, 2024-09-16T03:26:18.025 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_rule": 0, 2024-09-16T03:26:18.025 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_count": 0, 2024-09-16T03:26:18.025 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_target": 0, 2024-09-16T03:26:18.026 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_barrier": 0, 2024-09-16T03:26:18.026 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-16T03:26:18.026 INFO:tasks.workunit.client.0.smithi096.stderr: "is_stretch_pool": false, 2024-09-16T03:26:18.026 INFO:tasks.workunit.client.0.smithi096.stderr: "object_hash": 2, 2024-09-16T03:26:18.026 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_autoscale_mode": "off", 2024-09-16T03:26:18.026 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num": 32, 2024-09-16T03:26:18.026 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num": 32, 2024-09-16T03:26:18.026 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num_target": 32, 2024-09-16T03:26:18.026 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_target": 32, 2024-09-16T03:26:18.026 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_pending": 32, 2024-09-16T03:26:18.026 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pg_merge_meta": { 2024-09-16T03:26:18.026 INFO:tasks.workunit.client.0.smithi096.stderr: "source_pgid": "0.0", 2024-09-16T03:26:18.026 INFO:tasks.workunit.client.0.smithi096.stderr: "ready_epoch": 0, 2024-09-16T03:26:18.026 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_started": 0, 2024-09-16T03:26:18.026 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": 0, 2024-09-16T03:26:18.027 INFO:tasks.workunit.client.0.smithi096.stderr: "source_version": "0'\''0", 2024-09-16T03:26:18.027 INFO:tasks.workunit.client.0.smithi096.stderr: "target_version": "0'\''0" 2024-09-16T03:26:18.027 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.027 INFO:tasks.workunit.client.0.smithi096.stderr: "last_change": "85", 2024-09-16T03:26:18.027 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend": "0", 2024-09-16T03:26:18.027 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_prenautilus": "0", 2024-09-16T03:26:18.027 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_preluminous": "0", 2024-09-16T03:26:18.027 INFO:tasks.workunit.client.0.smithi096.stderr: "auid": 0, 2024-09-16T03:26:18.027 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_mode": "selfmanaged", 2024-09-16T03:26:18.027 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_seq": 0, 2024-09-16T03:26:18.027 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_epoch": 0, 2024-09-16T03:26:18.028 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_snaps": [], 2024-09-16T03:26:18.028 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps": "[]", 2024-09-16T03:26:18.028 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_bytes": 0, 2024-09-16T03:26:18.028 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_objects": 0, 2024-09-16T03:26:18.028 INFO:tasks.workunit.client.0.smithi096.stderr: "tiers": [], 2024-09-16T03:26:18.028 INFO:tasks.workunit.client.0.smithi096.stderr: "tier_of": -1, 2024-09-16T03:26:18.028 INFO:tasks.workunit.client.0.smithi096.stderr: "read_tier": -1, 2024-09-16T03:26:18.028 INFO:tasks.workunit.client.0.smithi096.stderr: "write_tier": -1, 2024-09-16T03:26:18.028 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_mode": "none", 2024-09-16T03:26:18.028 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_bytes": 0, 2024-09-16T03:26:18.028 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_objects": 0, 2024-09-16T03:26:18.028 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_ratio_micro": 400000, 2024-09-16T03:26:18.029 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-16T03:26:18.029 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_full_ratio_micro": 800000, 2024-09-16T03:26:18.029 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_flush_age": 0, 2024-09-16T03:26:18.029 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_evict_age": 0, 2024-09-16T03:26:18.029 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profile": "", 2024-09-16T03:26:18.029 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_params": { 2024-09-16T03:26:18.029 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "none" 2024-09-16T03:26:18.029 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.029 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_period": 0, 2024-09-16T03:26:18.029 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_count": 0, 2024-09-16T03:26:18.029 INFO:tasks.workunit.client.0.smithi096.stderr: "use_gmt_hitset": true, 2024-09-16T03:26:18.029 INFO:tasks.workunit.client.0.smithi096.stderr: "min_read_recency_for_promote": 0, 2024-09-16T03:26:18.029 INFO:tasks.workunit.client.0.smithi096.stderr: "min_write_recency_for_promote": 0, 2024-09-16T03:26:18.029 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_grade_decay_rate": 0, 2024-09-16T03:26:18.029 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_search_last_n": 0, 2024-09-16T03:26:18.030 INFO:tasks.workunit.client.0.smithi096.stderr: "grade_table": [], 2024-09-16T03:26:18.030 INFO:tasks.workunit.client.0.smithi096.stderr: "stripe_width": 0, 2024-09-16T03:26:18.030 INFO:tasks.workunit.client.0.smithi096.stderr: "expected_num_objects": 0, 2024-09-16T03:26:18.030 INFO:tasks.workunit.client.0.smithi096.stderr: "fast_read": false, 2024-09-16T03:26:18.030 INFO:tasks.workunit.client.0.smithi096.stderr: "options": {}, 2024-09-16T03:26:18.030 INFO:tasks.workunit.client.0.smithi096.stderr: "application_metadata": {}, 2024-09-16T03:26:18.030 INFO:tasks.workunit.client.0.smithi096.stderr: "read_balance": { 2024-09-16T03:26:18.030 INFO:tasks.workunit.client.0.smithi096.stderr: "score_type": "Fair distribution", 2024-09-16T03:26:18.030 INFO:tasks.workunit.client.0.smithi096.stderr: "score_acting": 1.8700000047683716, 2024-09-16T03:26:18.030 INFO:tasks.workunit.client.0.smithi096.stderr: "score_stable": 1.8700000047683716, 2024-09-16T03:26:18.030 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_score": 0.67000001668930054, 2024-09-16T03:26:18.030 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_acting": 1.25, 2024-09-16T03:26:18.030 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_stable": 1.25, 2024-09-16T03:26:18.030 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity_weighted": 1, 2024-09-16T03:26:18.031 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity": 1, 2024-09-16T03:26:18.031 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity_weighted": 1 2024-09-16T03:26:18.031 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:18.031 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.031 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.031 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 2, 2024-09-16T03:26:18.031 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_name": "bar", 2024-09-16T03:26:18.031 INFO:tasks.workunit.client.0.smithi096.stderr: "create_time": "2024-09-16T03:24:46.226575+0000", 2024-09-16T03:26:18.031 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": 1, 2024-09-16T03:26:18.031 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_names": "hashpspool", 2024-09-16T03:26:18.031 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:26:18.031 INFO:tasks.workunit.client.0.smithi096.stderr: "size": 2, 2024-09-16T03:26:18.031 INFO:tasks.workunit.client.0.smithi096.stderr: "min_size": 1, 2024-09-16T03:26:18.032 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_rule": 0, 2024-09-16T03:26:18.032 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_count": 0, 2024-09-16T03:26:18.032 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_target": 0, 2024-09-16T03:26:18.032 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_barrier": 0, 2024-09-16T03:26:18.032 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-16T03:26:18.032 INFO:tasks.workunit.client.0.smithi096.stderr: "is_stretch_pool": false, 2024-09-16T03:26:18.032 INFO:tasks.workunit.client.0.smithi096.stderr: "object_hash": 2, 2024-09-16T03:26:18.032 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_autoscale_mode": "off", 2024-09-16T03:26:18.032 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num": 32, 2024-09-16T03:26:18.032 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num": 32, 2024-09-16T03:26:18.032 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num_target": 32, 2024-09-16T03:26:18.032 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_target": 32, 2024-09-16T03:26:18.032 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_pending": 32, 2024-09-16T03:26:18.033 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pg_merge_meta": { 2024-09-16T03:26:18.033 INFO:tasks.workunit.client.0.smithi096.stderr: "source_pgid": "0.0", 2024-09-16T03:26:18.033 INFO:tasks.workunit.client.0.smithi096.stderr: "ready_epoch": 0, 2024-09-16T03:26:18.033 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_started": 0, 2024-09-16T03:26:18.033 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": 0, 2024-09-16T03:26:18.033 INFO:tasks.workunit.client.0.smithi096.stderr: "source_version": "0'\''0", 2024-09-16T03:26:18.033 INFO:tasks.workunit.client.0.smithi096.stderr: "target_version": "0'\''0" 2024-09-16T03:26:18.033 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.033 INFO:tasks.workunit.client.0.smithi096.stderr: "last_change": "83", 2024-09-16T03:26:18.033 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend": "0", 2024-09-16T03:26:18.033 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_prenautilus": "0", 2024-09-16T03:26:18.033 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_preluminous": "0", 2024-09-16T03:26:18.033 INFO:tasks.workunit.client.0.smithi096.stderr: "auid": 0, 2024-09-16T03:26:18.033 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_mode": "selfmanaged", 2024-09-16T03:26:18.034 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_seq": 0, 2024-09-16T03:26:18.034 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_epoch": 0, 2024-09-16T03:26:18.034 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_snaps": [], 2024-09-16T03:26:18.034 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps": "[]", 2024-09-16T03:26:18.034 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_bytes": 0, 2024-09-16T03:26:18.034 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_objects": 0, 2024-09-16T03:26:18.034 INFO:tasks.workunit.client.0.smithi096.stderr: "tiers": [], 2024-09-16T03:26:18.034 INFO:tasks.workunit.client.0.smithi096.stderr: "tier_of": -1, 2024-09-16T03:26:18.034 INFO:tasks.workunit.client.0.smithi096.stderr: "read_tier": -1, 2024-09-16T03:26:18.034 INFO:tasks.workunit.client.0.smithi096.stderr: "write_tier": -1, 2024-09-16T03:26:18.034 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_mode": "none", 2024-09-16T03:26:18.035 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_bytes": 0, 2024-09-16T03:26:18.035 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_objects": 0, 2024-09-16T03:26:18.035 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_ratio_micro": 400000, 2024-09-16T03:26:18.035 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-16T03:26:18.035 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_full_ratio_micro": 800000, 2024-09-16T03:26:18.035 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_flush_age": 0, 2024-09-16T03:26:18.035 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_evict_age": 0, 2024-09-16T03:26:18.035 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profile": "", 2024-09-16T03:26:18.035 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_params": { 2024-09-16T03:26:18.036 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "none" 2024-09-16T03:26:18.036 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.036 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_period": 0, 2024-09-16T03:26:18.036 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_count": 0, 2024-09-16T03:26:18.036 INFO:tasks.workunit.client.0.smithi096.stderr: "use_gmt_hitset": true, 2024-09-16T03:26:18.036 INFO:tasks.workunit.client.0.smithi096.stderr: "min_read_recency_for_promote": 0, 2024-09-16T03:26:18.036 INFO:tasks.workunit.client.0.smithi096.stderr: "min_write_recency_for_promote": 0, 2024-09-16T03:26:18.036 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_grade_decay_rate": 0, 2024-09-16T03:26:18.036 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_search_last_n": 0, 2024-09-16T03:26:18.036 INFO:tasks.workunit.client.0.smithi096.stderr: "grade_table": [], 2024-09-16T03:26:18.036 INFO:tasks.workunit.client.0.smithi096.stderr: "stripe_width": 0, 2024-09-16T03:26:18.036 INFO:tasks.workunit.client.0.smithi096.stderr: "expected_num_objects": 0, 2024-09-16T03:26:18.037 INFO:tasks.workunit.client.0.smithi096.stderr: "fast_read": false, 2024-09-16T03:26:18.037 INFO:tasks.workunit.client.0.smithi096.stderr: "options": {}, 2024-09-16T03:26:18.037 INFO:tasks.workunit.client.0.smithi096.stderr: "application_metadata": {}, 2024-09-16T03:26:18.037 INFO:tasks.workunit.client.0.smithi096.stderr: "read_balance": { 2024-09-16T03:26:18.037 INFO:tasks.workunit.client.0.smithi096.stderr: "score_type": "Fair distribution", 2024-09-16T03:26:18.037 INFO:tasks.workunit.client.0.smithi096.stderr: "score_acting": 1.4900000095367432, 2024-09-16T03:26:18.037 INFO:tasks.workunit.client.0.smithi096.stderr: "score_stable": 1.4900000095367432, 2024-09-16T03:26:18.037 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_score": 0.67000001668930054, 2024-09-16T03:26:18.037 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_acting": 1, 2024-09-16T03:26:18.037 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_stable": 1, 2024-09-16T03:26:18.037 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity_weighted": 1, 2024-09-16T03:26:18.038 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity": 1, 2024-09-16T03:26:18.038 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity_weighted": 1 2024-09-16T03:26:18.038 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:18.038 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:18.038 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:18.038 INFO:tasks.workunit.client.0.smithi096.stderr: "osds": [ 2024-09-16T03:26:18.038 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.038 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:26:18.038 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6", 2024-09-16T03:26:18.039 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:26:18.039 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:26:18.039 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:26:18.039 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:26:18.039 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:26:18.039 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:26:18.039 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 5, 2024-09-16T03:26:18.039 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 84, 2024-09-16T03:26:18.039 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:26:18.040 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:26:18.040 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:26:18.040 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:18.040 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.040 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:18.040 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6802", 2024-09-16T03:26:18.040 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:26:18.040 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.040 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.040 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:18.040 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6803", 2024-09-16T03:26:18.041 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:26:18.041 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:18.041 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:18.041 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.041 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:26:18.041 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:18.041 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.041 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:18.041 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6804", 2024-09-16T03:26:18.041 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:26:18.041 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.041 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.042 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:18.042 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6805", 2024-09-16T03:26:18.042 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:26:18.042 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:18.042 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:18.042 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.042 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:26:18.042 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:18.042 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.042 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:18.042 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6808", 2024-09-16T03:26:18.042 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:26:18.043 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.043 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.043 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:18.043 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6809", 2024-09-16T03:26:18.043 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:26:18.043 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:18.043 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:18.043 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.043 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:26:18.043 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:18.043 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.043 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:18.044 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6806", 2024-09-16T03:26:18.044 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:26:18.044 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.044 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.044 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:18.044 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6807", 2024-09-16T03:26:18.044 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:26:18.044 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:18.044 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:18.044 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.044 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6803/3375787448", 2024-09-16T03:26:18.044 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6805/3375787448", 2024-09-16T03:26:18.045 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6809/3375787448", 2024-09-16T03:26:18.045 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6807/3375787448", 2024-09-16T03:26:18.045 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:26:18.045 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:26:18.045 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:26:18.045 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:18.045 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.045 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.045 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:26:18.045 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "74b26727-75c9-444d-8782-719e4197a382", 2024-09-16T03:26:18.045 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:26:18.046 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:26:18.046 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:26:18.046 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:26:18.046 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:26:18.046 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:26:18.046 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 10, 2024-09-16T03:26:18.046 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 84, 2024-09-16T03:26:18.046 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:26:18.046 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:26:18.046 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:26:18.046 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:18.046 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.047 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:18.047 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6810", 2024-09-16T03:26:18.047 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:26:18.047 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.047 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.047 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:18.047 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6811", 2024-09-16T03:26:18.047 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:26:18.047 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:18.047 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:18.047 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.047 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:26:18.048 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:18.048 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.048 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:18.048 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6812", 2024-09-16T03:26:18.048 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:26:18.048 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.048 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.048 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:18.048 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6813", 2024-09-16T03:26:18.048 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:26:18.048 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:18.048 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:18.049 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.049 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:26:18.049 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:18.049 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.049 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:18.049 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6816", 2024-09-16T03:26:18.049 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:26:18.049 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.049 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.049 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:18.049 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6817", 2024-09-16T03:26:18.050 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:26:18.050 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:18.050 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:18.050 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.050 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:26:18.050 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:18.050 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.050 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:18.050 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6814", 2024-09-16T03:26:18.050 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:26:18.050 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.050 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.051 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:18.051 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6815", 2024-09-16T03:26:18.051 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:26:18.051 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:18.051 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:18.051 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.051 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6811/3733255132", 2024-09-16T03:26:18.051 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6813/3733255132", 2024-09-16T03:26:18.051 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6817/3733255132", 2024-09-16T03:26:18.051 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6815/3733255132", 2024-09-16T03:26:18.051 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:26:18.051 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:26:18.051 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:26:18.052 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:18.052 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.052 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.052 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:26:18.052 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "143da3a7-dad9-4b1e-966b-76cf5bdd3c82", 2024-09-16T03:26:18.052 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:26:18.052 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 0, 2024-09-16T03:26:18.052 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 0, 2024-09-16T03:26:18.052 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:26:18.052 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 15, 2024-09-16T03:26:18.052 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 32, 2024-09-16T03:26:18.052 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 88, 2024-09-16T03:26:18.053 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 21, 2024-09-16T03:26:18.053 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 33, 2024-09-16T03:26:18.053 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:26:18.053 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:26:18.053 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:18.053 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.053 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:18.053 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6818", 2024-09-16T03:26:18.053 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 2576002244 2024-09-16T03:26:18.053 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.053 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.053 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:18.054 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6819", 2024-09-16T03:26:18.054 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 2576002244 2024-09-16T03:26:18.054 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:18.054 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:18.054 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.054 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:26:18.054 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:18.054 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.054 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:18.054 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6820", 2024-09-16T03:26:18.054 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 2576002244 2024-09-16T03:26:18.054 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.055 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.055 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:18.055 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6821", 2024-09-16T03:26:18.055 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 2576002244 2024-09-16T03:26:18.055 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:18.055 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:18.055 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.055 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:26:18.055 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:18.055 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.055 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:18.055 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6824", 2024-09-16T03:26:18.056 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 2576002244 2024-09-16T03:26:18.056 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.056 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.056 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:18.056 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6825", 2024-09-16T03:26:18.056 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 2576002244 2024-09-16T03:26:18.056 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:18.056 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:18.056 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.056 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:26:18.056 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:18.057 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.057 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:18.057 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6822", 2024-09-16T03:26:18.057 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 2576002244 2024-09-16T03:26:18.057 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.057 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.057 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:18.057 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6823", 2024-09-16T03:26:18.057 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 2576002244 2024-09-16T03:26:18.057 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:18.057 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:18.057 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.058 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6819/2576002244", 2024-09-16T03:26:18.058 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6821/2576002244", 2024-09-16T03:26:18.058 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6825/2576002244", 2024-09-16T03:26:18.058 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6823/2576002244", 2024-09-16T03:26:18.059 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:26:18.060 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:26:18.060 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:26:18.060 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:18.060 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:18.060 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:18.060 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_xinfo": [ 2024-09-16T03:26:18.060 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.060 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:26:18.060 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:26:18.060 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:26:18.060 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:26:18.060 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:26:18.061 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:26:18.061 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:23:22.481942+0000", 2024-09-16T03:26:18.061 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:26:18.061 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.061 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.061 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:26:18.061 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:26:18.061 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:26:18.061 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:26:18.061 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:26:18.061 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:26:18.062 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:23:59.663703+0000", 2024-09-16T03:26:18.062 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:26:18.062 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.062 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.062 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:26:18.062 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:26:18.062 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:26:18.062 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:26:18.062 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:26:18.062 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 65536, 2024-09-16T03:26:18.062 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:24:37.320822+0000", 2024-09-16T03:26:18.062 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 32 2024-09-16T03:26:18.063 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:18.063 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:18.063 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap": [], 2024-09-16T03:26:18.063 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap_items": [], 2024-09-16T03:26:18.063 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap_primaries": [], 2024-09-16T03:26:18.063 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_temp": [], 2024-09-16T03:26:18.063 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_temp": [], 2024-09-16T03:26:18.063 INFO:tasks.workunit.client.0.smithi096.stderr: "blocklist": {}, 2024-09-16T03:26:18.063 INFO:tasks.workunit.client.0.smithi096.stderr: "range_blocklist": {}, 2024-09-16T03:26:18.063 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profiles": { 2024-09-16T03:26:18.063 INFO:tasks.workunit.client.0.smithi096.stderr: "default": { 2024-09-16T03:26:18.063 INFO:tasks.workunit.client.0.smithi096.stderr: "k": "2", 2024-09-16T03:26:18.064 INFO:tasks.workunit.client.0.smithi096.stderr: "m": "2", 2024-09-16T03:26:18.064 INFO:tasks.workunit.client.0.smithi096.stderr: "plugin": "jerasure", 2024-09-16T03:26:18.064 INFO:tasks.workunit.client.0.smithi096.stderr: "technique": "reed_sol_van" 2024-09-16T03:26:18.064 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:18.064 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.064 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps_queue": [], 2024-09-16T03:26:18.064 INFO:tasks.workunit.client.0.smithi096.stderr: "new_removed_snaps": [], 2024-09-16T03:26:18.064 INFO:tasks.workunit.client.0.smithi096.stderr: "new_purged_snaps": [], 2024-09-16T03:26:18.064 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_node_flags": {}, 2024-09-16T03:26:18.064 INFO:tasks.workunit.client.0.smithi096.stderr: "device_class_flags": {}, 2024-09-16T03:26:18.064 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode": { 2024-09-16T03:26:18.064 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode_enabled": false, 2024-09-16T03:26:18.065 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_bucket_count": 0, 2024-09-16T03:26:18.065 INFO:tasks.workunit.client.0.smithi096.stderr: "degraded_stretch_mode": 0, 2024-09-16T03:26:18.065 INFO:tasks.workunit.client.0.smithi096.stderr: "recovering_stretch_mode": 0, 2024-09-16T03:26:18.065 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode_bucket": 0 2024-09-16T03:26:18.065 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:18.065 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.065 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_metadata": [ 2024-09-16T03:26:18.065 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.065 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:26:18.065 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:26:18.065 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]", 2024-09-16T03:26:18.065 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:26:18.066 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:26:18.066 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:26:18.066 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:26:18.066 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:26:18.066 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:26:18.066 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:26:18.066 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:26:18.066 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:26:18.066 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:26:18.066 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:26:18.066 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/0/block", 2024-09-16T03:26:18.066 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:26:18.067 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:26:18.067 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:26:18.067 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:26:18.067 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:26:18.067 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:26:18.067 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:26:18.067 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:26:18.067 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:26:18.067 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:26:18.067 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:22:53.662571Z", 2024-09-16T03:26:18.067 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:26:18.067 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:26:18.068 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:26:18.068 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:26:18.068 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:26:18.068 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:26:18.068 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:26:18.068 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]", 2024-09-16T03:26:18.068 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:26:18.068 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]", 2024-09-16T03:26:18.068 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]", 2024-09-16T03:26:18.068 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:26:18.068 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:26:18.069 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:26:18.069 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:26:18.069 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:26:18.069 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:26:18.069 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:26:18.069 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:26:18.069 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:26:18.069 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/0", 2024-09-16T03:26:18.069 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:26:18.069 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:26:18.069 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:26:18.069 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.070 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.070 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:26:18.070 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:26:18.070 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]", 2024-09-16T03:26:18.070 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:26:18.070 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:26:18.070 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:26:18.070 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:26:18.070 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:26:18.070 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:26:18.070 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:26:18.070 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:26:18.071 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:26:18.071 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:26:18.071 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:26:18.071 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/1/block", 2024-09-16T03:26:18.071 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:26:18.071 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:26:18.071 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:26:18.071 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:26:18.071 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:26:18.071 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:26:18.071 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:26:18.071 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:26:18.072 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:26:18.072 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:26:18.072 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:23:30.129885Z", 2024-09-16T03:26:18.072 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:26:18.072 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:26:18.072 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:26:18.072 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:26:18.072 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:26:18.072 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:26:18.072 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:26:18.072 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]", 2024-09-16T03:26:18.073 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:26:18.073 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]", 2024-09-16T03:26:18.073 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]", 2024-09-16T03:26:18.073 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:26:18.073 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:26:18.073 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:26:18.073 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:26:18.073 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:26:18.073 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:26:18.073 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:26:18.073 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:26:18.073 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:26:18.074 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/1", 2024-09-16T03:26:18.074 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:26:18.074 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:26:18.074 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:26:18.074 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.074 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.074 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:26:18.075 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:26:18.075 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6820/2576002244,v1:127.0.0.1:6821/2576002244]", 2024-09-16T03:26:18.075 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:26:18.075 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:26:18.075 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:26:18.075 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:26:18.075 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:26:18.075 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:26:18.075 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:26:18.075 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:26:18.075 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:26:18.075 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:26:18.076 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:26:18.076 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/2/block", 2024-09-16T03:26:18.076 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:26:18.076 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:26:18.076 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:26:18.076 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:26:18.076 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:26:18.076 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:26:18.076 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:26:18.076 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:26:18.076 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:26:18.077 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:26:18.077 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:24:07.764502Z", 2024-09-16T03:26:18.077 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:26:18.077 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:26:18.077 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:26:18.077 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:26:18.077 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:26:18.077 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:26:18.077 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:26:18.077 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6818/2576002244,v1:127.0.0.1:6819/2576002244]", 2024-09-16T03:26:18.077 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:26:18.077 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6824/2576002244,v1:127.0.0.1:6825/2576002244]", 2024-09-16T03:26:18.078 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6822/2576002244,v1:127.0.0.1:6823/2576002244]", 2024-09-16T03:26:18.078 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:26:18.078 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:26:18.078 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:26:18.078 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:26:18.078 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:26:18.078 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:26:18.078 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:26:18.078 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:26:18.078 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:26:18.078 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/2", 2024-09-16T03:26:18.078 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:26:18.079 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:26:18.079 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:26:18.079 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:18.079 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:18.079 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_clean_epochs": { 2024-09-16T03:26:18.079 INFO:tasks.workunit.client.0.smithi096.stderr: "min_last_epoch_clean": 86, 2024-09-16T03:26:18.079 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": { 2024-09-16T03:26:18.079 INFO:tasks.workunit.client.0.smithi096.stderr: "per_pool": [ 2024-09-16T03:26:18.079 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.079 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 1, 2024-09-16T03:26:18.079 INFO:tasks.workunit.client.0.smithi096.stderr: "floor": 86 2024-09-16T03:26:18.080 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.080 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.080 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 2, 2024-09-16T03:26:18.080 INFO:tasks.workunit.client.0.smithi096.stderr: "floor": 86 2024-09-16T03:26:18.080 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:18.080 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:18.080 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.080 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_epochs": [ 2024-09-16T03:26:18.080 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.080 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:26:18.080 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 86 2024-09-16T03:26:18.080 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.081 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.081 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:26:18.081 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 88 2024-09-16T03:26:18.081 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.081 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.081 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:26:18.081 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 88 2024-09-16T03:26:18.081 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:18.082 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:18.082 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.082 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_first_committed": 84, 2024-09-16T03:26:18.082 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_last_committed": 88, 2024-09-16T03:26:18.082 INFO:tasks.workunit.client.0.smithi096.stderr: "crushmap": { 2024-09-16T03:26:18.082 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": [ 2024-09-16T03:26:18.082 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.082 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:26:18.082 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.0", 2024-09-16T03:26:18.083 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:26:18.083 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.083 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.083 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:26:18.083 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.1", 2024-09-16T03:26:18.083 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:26:18.083 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.083 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.083 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:26:18.083 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.2", 2024-09-16T03:26:18.083 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:26:18.083 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:18.084 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:18.084 INFO:tasks.workunit.client.0.smithi096.stderr: "types": [ 2024-09-16T03:26:18.084 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.084 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 0, 2024-09-16T03:26:18.084 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd" 2024-09-16T03:26:18.084 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.084 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.084 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:26:18.084 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "host" 2024-09-16T03:26:18.084 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.084 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.085 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 2, 2024-09-16T03:26:18.085 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "chassis" 2024-09-16T03:26:18.085 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.085 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.085 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 3, 2024-09-16T03:26:18.085 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "rack" 2024-09-16T03:26:18.085 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.085 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.085 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 4, 2024-09-16T03:26:18.085 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "row" 2024-09-16T03:26:18.085 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.086 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.086 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 5, 2024-09-16T03:26:18.086 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "pdu" 2024-09-16T03:26:18.086 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.086 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.086 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 6, 2024-09-16T03:26:18.086 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "pod" 2024-09-16T03:26:18.086 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.086 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.086 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 7, 2024-09-16T03:26:18.086 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "room" 2024-09-16T03:26:18.086 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.087 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.087 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 8, 2024-09-16T03:26:18.087 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "datacenter" 2024-09-16T03:26:18.087 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.087 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.087 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 9, 2024-09-16T03:26:18.087 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "zone" 2024-09-16T03:26:18.087 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.087 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.087 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 10, 2024-09-16T03:26:18.087 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "region" 2024-09-16T03:26:18.088 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.088 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.088 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:26:18.088 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "root" 2024-09-16T03:26:18.088 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:18.088 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:18.088 INFO:tasks.workunit.client.0.smithi096.stderr: "buckets": [ 2024-09-16T03:26:18.088 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.088 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -1, 2024-09-16T03:26:18.088 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "default", 2024-09-16T03:26:18.088 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:26:18.088 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "root", 2024-09-16T03:26:18.089 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:26:18.089 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:26:18.089 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:26:18.089 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:26:18.089 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.089 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -3, 2024-09-16T03:26:18.089 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:26:18.089 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:26:18.089 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:18.089 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:18.089 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.090 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.090 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -2, 2024-09-16T03:26:18.090 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "default~hdd", 2024-09-16T03:26:18.090 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:26:18.090 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "root", 2024-09-16T03:26:18.090 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:26:18.090 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:26:18.090 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:26:18.090 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:26:18.090 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.090 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -4, 2024-09-16T03:26:18.090 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:26:18.090 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:26:18.091 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:18.091 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:18.091 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.091 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.091 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -3, 2024-09-16T03:26:18.091 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "smithi096", 2024-09-16T03:26:18.091 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:26:18.091 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "host", 2024-09-16T03:26:18.091 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:26:18.091 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:26:18.091 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:26:18.091 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:26:18.092 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.092 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:26:18.092 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:26:18.092 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:26:18.092 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.092 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.092 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:26:18.092 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:26:18.092 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 1 2024-09-16T03:26:18.092 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.092 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.093 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:26:18.093 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:26:18.093 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 2 2024-09-16T03:26:18.093 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:18.093 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:18.093 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.093 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.093 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -4, 2024-09-16T03:26:18.093 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "smithi096~hdd", 2024-09-16T03:26:18.093 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:26:18.093 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "host", 2024-09-16T03:26:18.093 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:26:18.094 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:26:18.094 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:26:18.094 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:26:18.094 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.094 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:26:18.094 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:26:18.094 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:26:18.094 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.094 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.094 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:26:18.094 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:26:18.094 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 1 2024-09-16T03:26:18.095 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.095 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.095 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:26:18.095 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:26:18.095 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 2 2024-09-16T03:26:18.095 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:18.095 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:18.095 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:18.095 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:18.095 INFO:tasks.workunit.client.0.smithi096.stderr: "rules": [ 2024-09-16T03:26:18.095 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.095 INFO:tasks.workunit.client.0.smithi096.stderr: "rule_id": 0, 2024-09-16T03:26:18.096 INFO:tasks.workunit.client.0.smithi096.stderr: "rule_name": "replicated_rule", 2024-09-16T03:26:18.096 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:26:18.096 INFO:tasks.workunit.client.0.smithi096.stderr: "steps": [ 2024-09-16T03:26:18.096 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.096 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "take", 2024-09-16T03:26:18.096 INFO:tasks.workunit.client.0.smithi096.stderr: "item": -1, 2024-09-16T03:26:18.096 INFO:tasks.workunit.client.0.smithi096.stderr: "item_name": "default" 2024-09-16T03:26:18.096 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.096 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.096 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "choose_firstn", 2024-09-16T03:26:18.096 INFO:tasks.workunit.client.0.smithi096.stderr: "num": 0, 2024-09-16T03:26:18.096 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "osd" 2024-09-16T03:26:18.097 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.097 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.097 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "emit" 2024-09-16T03:26:18.097 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:18.097 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:18.097 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:18.097 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:18.097 INFO:tasks.workunit.client.0.smithi096.stderr: "tunables": { 2024-09-16T03:26:18.097 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_local_tries": 0, 2024-09-16T03:26:18.097 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_local_fallback_tries": 0, 2024-09-16T03:26:18.097 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_total_tries": 50, 2024-09-16T03:26:18.097 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_descend_once": 1, 2024-09-16T03:26:18.098 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_vary_r": 1, 2024-09-16T03:26:18.098 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_stable": 1, 2024-09-16T03:26:18.098 INFO:tasks.workunit.client.0.smithi096.stderr: "msr_descents": 100, 2024-09-16T03:26:18.098 INFO:tasks.workunit.client.0.smithi096.stderr: "msr_collision_tries": 100, 2024-09-16T03:26:18.098 INFO:tasks.workunit.client.0.smithi096.stderr: "straw_calc_version": 1, 2024-09-16T03:26:18.098 INFO:tasks.workunit.client.0.smithi096.stderr: "allowed_bucket_algs": 54, 2024-09-16T03:26:18.098 INFO:tasks.workunit.client.0.smithi096.stderr: "profile": "jewel", 2024-09-16T03:26:18.098 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_tunables": 1, 2024-09-16T03:26:18.098 INFO:tasks.workunit.client.0.smithi096.stderr: "legacy_tunables": 0, 2024-09-16T03:26:18.098 INFO:tasks.workunit.client.0.smithi096.stderr: "minimum_required_version": "jewel", 2024-09-16T03:26:18.098 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables": 1, 2024-09-16T03:26:18.099 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables2": 1, 2024-09-16T03:26:18.099 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v2_rules": 0, 2024-09-16T03:26:18.099 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables3": 1, 2024-09-16T03:26:18.099 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v3_rules": 0, 2024-09-16T03:26:18.099 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v4_buckets": 1, 2024-09-16T03:26:18.099 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables5": 1, 2024-09-16T03:26:18.099 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v5_rules": 0, 2024-09-16T03:26:18.099 INFO:tasks.workunit.client.0.smithi096.stderr: "has_msr_rules": 0 2024-09-16T03:26:18.099 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.099 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_args": {} 2024-09-16T03:26:18.099 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.099 INFO:tasks.workunit.client.0.smithi096.stderr: "fsmap": { 2024-09-16T03:26:18.100 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 1, 2024-09-16T03:26:18.100 INFO:tasks.workunit.client.0.smithi096.stderr: "btime": "2024-09-16T03:22:46:882186+0000", 2024-09-16T03:26:18.100 INFO:tasks.workunit.client.0.smithi096.stderr: "default_fscid": -1, 2024-09-16T03:26:18.100 INFO:tasks.workunit.client.0.smithi096.stderr: "compat": { 2024-09-16T03:26:18.100 INFO:tasks.workunit.client.0.smithi096.stderr: "compat": {}, 2024-09-16T03:26:18.100 INFO:tasks.workunit.client.0.smithi096.stderr: "ro_compat": {}, 2024-09-16T03:26:18.100 INFO:tasks.workunit.client.0.smithi096.stderr: "incompat": { 2024-09-16T03:26:18.100 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_1": "base v0.20", 2024-09-16T03:26:18.100 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_2": "client writeable ranges", 2024-09-16T03:26:18.100 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_3": "default file layouts on dirs", 2024-09-16T03:26:18.100 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_4": "dir inode in separate object", 2024-09-16T03:26:18.101 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_5": "mds uses versioned encoding", 2024-09-16T03:26:18.101 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_6": "dirfrag is stored in omap", 2024-09-16T03:26:18.101 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_8": "no anchor table", 2024-09-16T03:26:18.101 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_9": "file layout v2", 2024-09-16T03:26:18.101 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_10": "snaprealm v2", 2024-09-16T03:26:18.101 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_11": "minor log segments", 2024-09-16T03:26:18.101 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_12": "quiesce subvolumes" 2024-09-16T03:26:18.101 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:18.101 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.101 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_flags": { 2024-09-16T03:26:18.101 INFO:tasks.workunit.client.0.smithi096.stderr: "enable_multiple": true, 2024-09-16T03:26:18.102 INFO:tasks.workunit.client.0.smithi096.stderr: "ever_enabled_multiple": true 2024-09-16T03:26:18.102 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.102 INFO:tasks.workunit.client.0.smithi096.stderr: "standbys": [], 2024-09-16T03:26:18.102 INFO:tasks.workunit.client.0.smithi096.stderr: "filesystems": [] 2024-09-16T03:26:18.102 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.102 INFO:tasks.workunit.client.0.smithi096.stderr: "mdsmap_first_committed": 1, 2024-09-16T03:26:18.102 INFO:tasks.workunit.client.0.smithi096.stderr: "mdsmap_last_committed": 1, 2024-09-16T03:26:18.102 INFO:tasks.workunit.client.0.smithi096.stderr: "auth": { 2024-09-16T03:26:18.102 INFO:tasks.workunit.client.0.smithi096.stderr: "first_committed": 1, 2024-09-16T03:26:18.102 INFO:tasks.workunit.client.0.smithi096.stderr: "last_committed": 5, 2024-09-16T03:26:18.102 INFO:tasks.workunit.client.0.smithi096.stderr: "num_secrets": 3 2024-09-16T03:26:18.102 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.102 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 64, 2024-09-16T03:26:18.103 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_active": 64, 2024-09-16T03:26:18.103 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_unknown": 0, 2024-09-16T03:26:18.103 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osd": 3, 2024-09-16T03:26:18.103 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_sum": { 2024-09-16T03:26:18.103 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:26:18.103 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:26:18.103 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:26:18.103 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:26:18.103 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:26:18.103 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:26:18.103 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:26:18.103 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:26:18.104 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:26:18.104 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:26:18.104 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:26:18.104 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:26:18.104 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:26:18.104 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:26:18.104 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:26:18.104 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:26:18.104 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:26:18.104 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:26:18.105 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:26:18.105 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:26:18.105 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:26:18.105 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:26:18.105 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:26:18.105 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:26:18.105 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:26:18.105 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:26:18.105 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:26:18.105 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:26:18.105 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:26:18.105 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:26:18.106 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:26:18.106 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:26:18.106 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:26:18.106 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:26:18.106 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:26:18.106 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:26:18.106 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:26:18.106 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:26:18.106 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:26:18.106 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:26:18.106 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:26:18.106 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.106 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:26:18.107 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:26:18.107 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:26:18.107 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:26:18.107 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:26:18.107 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:26:18.107 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:26:18.107 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:26:18.107 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:26:18.107 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:26:18.107 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:26:18.107 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.107 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:26:18.108 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:26:18.108 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 128, 2024-09-16T03:26:18.108 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 128, 2024-09-16T03:26:18.108 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 0 2024-09-16T03:26:18.108 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.108 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_sum": { 2024-09-16T03:26:18.108 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 0, 2024-09-16T03:26:18.108 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 0, 2024-09-16T03:26:18.108 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pgs": 128, 2024-09-16T03:26:18.108 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osds": 2, 2024-09-16T03:26:18.108 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_osds": 2, 2024-09-16T03:26:18.108 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_omap_osds": 2, 2024-09-16T03:26:18.109 INFO:tasks.workunit.client.0.smithi096.stderr: "kb": 209715200, 2024-09-16T03:26:18.109 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used": 54660, 2024-09-16T03:26:18.109 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_data": 888, 2024-09-16T03:26:18.109 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_omap": 3, 2024-09-16T03:26:18.109 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_meta": 53628, 2024-09-16T03:26:18.109 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_avail": 209660540, 2024-09-16T03:26:18.109 INFO:tasks.workunit.client.0.smithi096.stderr: "statfs": { 2024-09-16T03:26:18.109 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 214748364800, 2024-09-16T03:26:18.109 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 214692392960, 2024-09-16T03:26:18.109 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:26:18.109 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 909312, 2024-09-16T03:26:18.109 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 340707, 2024-09-16T03:26:18.110 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:26:18.110 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:26:18.110 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:26:18.110 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 3190, 2024-09-16T03:26:18.110 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 54915978 2024-09-16T03:26:18.110 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.110 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_peers": [], 2024-09-16T03:26:18.110 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_trim_queue_len": 0, 2024-09-16T03:26:18.110 INFO:tasks.workunit.client.0.smithi096.stderr: "num_snap_trimming": 0, 2024-09-16T03:26:18.110 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shards_repaired": 0, 2024-09-16T03:26:18.110 INFO:tasks.workunit.client.0.smithi096.stderr: "op_queue_age_hist": { 2024-09-16T03:26:18.110 INFO:tasks.workunit.client.0.smithi096.stderr: "histogram": [], 2024-09-16T03:26:18.111 INFO:tasks.workunit.client.0.smithi096.stderr: "upper_bound": 1 2024-09-16T03:26:18.111 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.111 INFO:tasks.workunit.client.0.smithi096.stderr: "perf_stat": { 2024-09-16T03:26:18.111 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ms": 121, 2024-09-16T03:26:18.111 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ms": 121, 2024-09-16T03:26:18.111 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ns": 121000000, 2024-09-16T03:26:18.111 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ns": 121000000 2024-09-16T03:26:18.111 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.111 INFO:tasks.workunit.client.0.smithi096.stderr: "alerts": [], 2024-09-16T03:26:18.111 INFO:tasks.workunit.client.0.smithi096.stderr: "network_ping_times": [] 2024-09-16T03:26:18.111 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.111 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_sum_by_class": { 2024-09-16T03:26:18.112 INFO:tasks.workunit.client.0.smithi096.stderr: "hdd": { 2024-09-16T03:26:18.112 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 0, 2024-09-16T03:26:18.112 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 0, 2024-09-16T03:26:18.112 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pgs": 128, 2024-09-16T03:26:18.112 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osds": 2, 2024-09-16T03:26:18.112 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_osds": 2, 2024-09-16T03:26:18.112 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_omap_osds": 2, 2024-09-16T03:26:18.112 INFO:tasks.workunit.client.0.smithi096.stderr: "kb": 209715200, 2024-09-16T03:26:18.112 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used": 54660, 2024-09-16T03:26:18.112 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_data": 888, 2024-09-16T03:26:18.112 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_omap": 3, 2024-09-16T03:26:18.112 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_meta": 53628, 2024-09-16T03:26:18.113 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_avail": 209660540, 2024-09-16T03:26:18.113 INFO:tasks.workunit.client.0.smithi096.stderr: "statfs": { 2024-09-16T03:26:18.113 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 214748364800, 2024-09-16T03:26:18.113 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 214692392960, 2024-09-16T03:26:18.113 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:26:18.113 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 909312, 2024-09-16T03:26:18.113 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 340707, 2024-09-16T03:26:18.113 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:26:18.113 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:26:18.113 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:26:18.113 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 3190, 2024-09-16T03:26:18.113 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 54915978 2024-09-16T03:26:18.114 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.114 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_peers": [], 2024-09-16T03:26:18.114 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_trim_queue_len": 0, 2024-09-16T03:26:18.114 INFO:tasks.workunit.client.0.smithi096.stderr: "num_snap_trimming": 0, 2024-09-16T03:26:18.114 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shards_repaired": 0, 2024-09-16T03:26:18.114 INFO:tasks.workunit.client.0.smithi096.stderr: "op_queue_age_hist": { 2024-09-16T03:26:18.114 INFO:tasks.workunit.client.0.smithi096.stderr: "histogram": [], 2024-09-16T03:26:18.114 INFO:tasks.workunit.client.0.smithi096.stderr: "upper_bound": 1 2024-09-16T03:26:18.114 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.114 INFO:tasks.workunit.client.0.smithi096.stderr: "perf_stat": { 2024-09-16T03:26:18.114 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ms": 121, 2024-09-16T03:26:18.114 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ms": 121, 2024-09-16T03:26:18.115 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ns": 121000000, 2024-09-16T03:26:18.115 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ns": 121000000 2024-09-16T03:26:18.115 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.115 INFO:tasks.workunit.client.0.smithi096.stderr: "alerts": [], 2024-09-16T03:26:18.115 INFO:tasks.workunit.client.0.smithi096.stderr: "network_ping_times": [] 2024-09-16T03:26:18.115 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:18.115 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.115 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_stats": [ 2024-09-16T03:26:18.115 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.115 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 2, 2024-09-16T03:26:18.115 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 32, 2024-09-16T03:26:18.115 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:26:18.116 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:26:18.116 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:26:18.116 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:26:18.116 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:26:18.116 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:26:18.116 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:26:18.116 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:26:18.116 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:26:18.116 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:26:18.116 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:26:18.116 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:26:18.117 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:26:18.117 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:26:18.117 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:26:18.117 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:26:18.117 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:26:18.117 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:26:18.117 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:26:18.117 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:26:18.117 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:26:18.117 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:26:18.117 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:26:18.118 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:26:18.118 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:26:18.118 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:26:18.118 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:26:18.118 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:26:18.118 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:26:18.118 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:26:18.118 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:26:18.118 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:26:18.118 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:26:18.118 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:26:18.118 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:26:18.119 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:26:18.119 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:26:18.119 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:26:18.119 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:26:18.119 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:26:18.119 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:26:18.119 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.119 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:26:18.119 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:26:18.119 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:26:18.119 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:26:18.120 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:26:18.120 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:26:18.120 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:26:18.120 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:26:18.120 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:26:18.120 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:26:18.120 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:26:18.120 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.120 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:26:18.120 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:26:18.120 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 64, 2024-09-16T03:26:18.120 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 64, 2024-09-16T03:26:18.121 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 3 2024-09-16T03:26:18.121 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.121 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.121 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 1, 2024-09-16T03:26:18.121 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 32, 2024-09-16T03:26:18.121 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:26:18.121 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:26:18.121 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:26:18.121 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:26:18.121 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:26:18.121 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:26:18.122 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:26:18.122 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:26:18.122 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:26:18.122 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:26:18.122 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:26:18.122 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:26:18.122 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:26:18.122 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:26:18.122 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:26:18.122 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:26:18.122 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:26:18.122 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:26:18.123 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:26:18.123 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:26:18.123 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:26:18.123 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:26:18.123 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:26:18.123 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:26:18.123 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:26:18.123 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:26:18.123 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:26:18.123 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:26:18.123 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:26:18.123 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:26:18.124 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:26:18.124 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:26:18.124 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:26:18.124 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:26:18.124 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:26:18.124 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:26:18.124 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:26:18.124 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:26:18.124 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:26:18.124 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:26:18.124 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:26:18.125 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.125 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:26:18.125 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:26:18.125 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:26:18.125 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:26:18.125 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:26:18.125 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:26:18.125 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:26:18.125 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:26:18.125 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:26:18.125 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:26:18.125 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:26:18.125 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.126 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:26:18.126 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:26:18.126 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 64, 2024-09-16T03:26:18.126 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 64, 2024-09-16T03:26:18.126 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 3 2024-09-16T03:26:18.126 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:18.126 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:18.126 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_stats": [ 2024-09-16T03:26:18.126 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.126 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:26:18.126 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 21474836523 2024-09-16T03:26:18.127 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.127 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.127 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:26:18.127 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 42949672995 2024-09-16T03:26:18.127 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.127 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.127 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:26:18.127 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 1 2024-09-16T03:26:18.127 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:18.127 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:18.127 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_by_state": [ 2024-09-16T03:26:18.128 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.128 INFO:tasks.workunit.client.0.smithi096.stderr: "state": "active+clean", 2024-09-16T03:26:18.128 INFO:tasks.workunit.client.0.smithi096.stderr: "num": 64 2024-09-16T03:26:18.128 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:18.128 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:18.128 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_by_osd": [ 2024-09-16T03:26:18.128 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.128 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:26:18.128 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 0, 2024-09-16T03:26:18.128 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 0, 2024-09-16T03:26:18.128 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:26:18.128 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.129 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.129 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:26:18.129 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 28, 2024-09-16T03:26:18.129 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 64, 2024-09-16T03:26:18.129 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:26:18.129 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.129 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.129 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:26:18.129 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 36, 2024-09-16T03:26:18.129 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 64, 2024-09-16T03:26:18.129 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:26:18.130 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:18.130 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:18.130 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": [ 2024-09-16T03:26:18.130 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.130 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 1, 2024-09-16T03:26:18.130 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": {} 2024-09-16T03:26:18.130 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.130 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.130 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 2, 2024-09-16T03:26:18.130 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": {} 2024-09-16T03:26:18.130 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:18.131 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:18.131 INFO:tasks.workunit.client.0.smithi096.stderr: "servicemap": { 2024-09-16T03:26:18.131 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 5, 2024-09-16T03:26:18.131 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:25:38.422788+0000", 2024-09-16T03:26:18.131 INFO:tasks.workunit.client.0.smithi096.stderr: "services": {} 2024-09-16T03:26:18.131 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.131 INFO:tasks.workunit.client.0.smithi096.stderr: "mgrstat_first_committed": 87, 2024-09-16T03:26:18.131 INFO:tasks.workunit.client.0.smithi096.stderr: "mgrstat_last_committed": 94, 2024-09-16T03:26:18.131 INFO:tasks.workunit.client.0.smithi096.stderr: "logm_first_committed": 1, 2024-09-16T03:26:18.131 INFO:tasks.workunit.client.0.smithi096.stderr: "logm_last_committed": 428, 2024-09-16T03:26:18.131 INFO:tasks.workunit.client.0.smithi096.stderr: "paxos": { 2024-09-16T03:26:18.131 INFO:tasks.workunit.client.0.smithi096.stderr: "first_committed": 1, 2024-09-16T03:26:18.131 INFO:tasks.workunit.client.0.smithi096.stderr: "last_committed": 628, 2024-09-16T03:26:18.132 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pn": 0, 2024-09-16T03:26:18.132 INFO:tasks.workunit.client.0.smithi096.stderr: "accepted_pn": 0 2024-09-16T03:26:18.132 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:18.132 INFO:tasks.workunit.client.0.smithi096.stderr:}' 2024-09-16T03:26:18.136 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:121: validate_fc: jq .osdmap_clean_epochs.min_last_epoch_clean 2024-09-16T03:26:18.136 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:121: validate_fc: echo '{' '"cluster_fingerprint":' '"fda2fc64-07ed-4add-8224-2e527e11d427",' '"version":' '"19.3.0-4930-gfc3e0bff",' '"commit":' '"fc3e0bff7468fd55478adbae7f75508b749124b6",' '"timestamp":' '"2024-09-16T03:26:18.003503+0000",' '"tag":' '"",' '"health":' '{' '"status":' '"HEALTH_OK",' '"checks":' '{},' '"mutes":' '[]' '},' '"monmap_first_committed":' 1, '"monmap_last_committed":' 1, '"monmap":' '{' '"epoch":' 1, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"modified":' '"2024-09-16T03:22:45.872880Z",' '"created":' '"2024-09-16T03:22:45.872880Z",' '"min_mon_release":' 19, '"min_mon_release_name":' '"squid",' '"election_strategy":' 1, '"disallowed_leaders:' '":' '"",' '"stretch_mode":' false, '"tiebreaker_mon":' '"",' '"removed_ranks:' '":' '"",' '"features":' '{' '"persistent":' '[' '"kraken",' '"luminous",' '"mimic",' '"osdmap-prune",' '"nautilus",' '"octopus",' '"pacific",' '"elector-pinging",' '"quincy",' '"reef",' '"squid"' '],' '"optional":' '[]' '},' '"mons":' '[' '{' '"rank":' 0, '"name":' '"a",' '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:7302",' '"nonce":' 0 '}' ']' '},' '"addr":' '"127.0.0.1:7302/0",' '"public_addr":' '"127.0.0.1:7302/0",' '"priority":' 0, '"weight":' 0, '"crush_location":' '"{}"' '}' ']' '},' '"quorum":' '[' 0 '],' '"osdmap":' '{' '"epoch":' 88, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"created":' '"2024-09-16T03:22:46.906117+0000",' '"modified":' '"2024-09-16T03:26:15.120212+0000",' '"last_up_change":' '"2024-09-16T03:26:15.120212+0000",' '"last_in_change":' '"2024-09-16T03:25:09.839444+0000",' '"flags":' '"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit",' '"flags_num":' 5799936, '"flags_set":' '[' '"pglog_hardlimit",' '"purged_snapdirs",' '"recovery_deletes",' '"sortbitwise"' '],' '"crush_version":' 8, '"full_ratio":' 0.97000002861022949, '"backfillfull_ratio":' 0.97000002861022949, '"nearfull_ratio":' 0.85000002384185791, '"cluster_snapshot":' '"",' '"pool_max":' 2, '"max_osd":' 3, '"require_min_compat_client":' '"luminous",' '"min_compat_client":' '"jewel",' '"require_osd_release":' '"squid",' '"allow_crimson":' false, '"pools":' '[' '{' '"pool":' 1, '"pool_name":' '"foo",' '"create_time":' '"2024-09-16T03:24:44.525189+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 2, '"min_size":' 1, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"85",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.8700000047683716, '"score_stable":' 1.8700000047683716, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1.25, '"raw_score_stable":' 1.25, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '},' '{' '"pool":' 2, '"pool_name":' '"bar",' '"create_time":' '"2024-09-16T03:24:46.226575+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 2, '"min_size":' 1, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"83",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.4900000095367432, '"score_stable":' 1.4900000095367432, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1, '"raw_score_stable":' 1, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '}' '],' '"osds":' '[' '{' '"osd":' 0, '"uuid":' '"64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 5, '"up_thru":' 84, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6802",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6803",' '"nonce":' 3375787448 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6804",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6805",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6808",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6809",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6806",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6807",' '"nonce":' 3375787448 '}' ']' '},' '"public_addr":' '"127.0.0.1:6803/3375787448",' '"cluster_addr":' '"127.0.0.1:6805/3375787448",' '"heartbeat_back_addr":' '"127.0.0.1:6809/3375787448",' '"heartbeat_front_addr":' '"127.0.0.1:6807/3375787448",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 1, '"uuid":' '"74b26727-75c9-444d-8782-719e4197a382",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 10, '"up_thru":' 84, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6810",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6811",' '"nonce":' 3733255132 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6812",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6813",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6816",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6817",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6814",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6815",' '"nonce":' 3733255132 '}' ']' '},' '"public_addr":' '"127.0.0.1:6811/3733255132",' '"cluster_addr":' '"127.0.0.1:6813/3733255132",' '"heartbeat_back_addr":' '"127.0.0.1:6817/3733255132",' '"heartbeat_front_addr":' '"127.0.0.1:6815/3733255132",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 2, '"uuid":' '"143da3a7-dad9-4b1e-966b-76cf5bdd3c82",' '"up":' 1, '"in":' 0, '"weight":' 0, '"primary_affinity":' 1, '"last_clean_begin":' 15, '"last_clean_end":' 32, '"up_from":' 88, '"up_thru":' 21, '"down_at":' 33, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6818",' '"nonce":' 2576002244 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6819",' '"nonce":' 2576002244 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6820",' '"nonce":' 2576002244 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6821",' '"nonce":' 2576002244 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6824",' '"nonce":' 2576002244 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6825",' '"nonce":' 2576002244 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6822",' '"nonce":' 2576002244 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6823",' '"nonce":' 2576002244 '}' ']' '},' '"public_addr":' '"127.0.0.1:6819/2576002244",' '"cluster_addr":' '"127.0.0.1:6821/2576002244",' '"heartbeat_back_addr":' '"127.0.0.1:6825/2576002244",' '"heartbeat_front_addr":' '"127.0.0.1:6823/2576002244",' '"state":' '[' '"exists",' '"up"' ']' '}' '],' '"osd_xinfo":' '[' '{' '"osd":' 0, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:22.481942+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 1, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:59.663703+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 2, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 65536, '"last_purged_snaps_scrub":' '"2024-09-16T03:24:37.320822+0000",' '"dead_epoch":' 32 '}' '],' '"pg_upmap":' '[],' '"pg_upmap_items":' '[],' '"pg_upmap_primaries":' '[],' '"pg_temp":' '[],' '"primary_temp":' '[],' '"blocklist":' '{},' '"range_blocklist":' '{},' '"erasure_code_profiles":' '{' '"default":' '{' '"k":' '"2",' '"m":' '"2",' '"plugin":' '"jerasure",' '"technique":' '"reed_sol_van"' '}' '},' '"removed_snaps_queue":' '[],' '"new_removed_snaps":' '[],' '"new_purged_snaps":' '[],' '"crush_node_flags":' '{},' '"device_class_flags":' '{},' '"stretch_mode":' '{' '"stretch_mode_enabled":' false, '"stretch_bucket_count":' 0, '"degraded_stretch_mode":' 0, '"recovering_stretch_mode":' 0, '"stretch_mode_bucket":' 0 '}' '},' '"osd_metadata":' '[' '{' '"id":' 0, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/0/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:22:53.662571Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]",' '"hb_front_addr":' '"[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/0",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 1, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/1/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:23:30.129885Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]",' '"hb_front_addr":' '"[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/1",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 2, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6820/2576002244,v1:127.0.0.1:6821/2576002244]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/2/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:24:07.764502Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6818/2576002244,v1:127.0.0.1:6819/2576002244]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6824/2576002244,v1:127.0.0.1:6825/2576002244]",' '"hb_front_addr":' '"[v2:127.0.0.1:6822/2576002244,v1:127.0.0.1:6823/2576002244]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/2",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '}' '],' '"osdmap_clean_epochs":' '{' '"min_last_epoch_clean":' 86, '"last_epoch_clean":' '{' '"per_pool":' '[' '{' '"poolid":' 1, '"floor":' 86 '},' '{' '"poolid":' 2, '"floor":' 86 '}' ']' '},' '"osd_epochs":' '[' '{' '"id":' 0, '"epoch":' 86 '},' '{' '"id":' 1, '"epoch":' 88 '},' '{' '"id":' 2, '"epoch":' 88 '}' ']' '},' '"osdmap_first_committed":' 84, '"osdmap_last_committed":' 88, '"crushmap":' '{' '"devices":' '[' '{' '"id":' 0, '"name":' '"osd.0",' '"class":' '"hdd"' '},' '{' '"id":' 1, '"name":' '"osd.1",' '"class":' '"hdd"' '},' '{' '"id":' 2, '"name":' '"osd.2",' '"class":' '"hdd"' '}' '],' '"types":' '[' '{' '"type_id":' 0, '"name":' '"osd"' '},' '{' '"type_id":' 1, '"name":' '"host"' '},' '{' '"type_id":' 2, '"name":' '"chassis"' '},' '{' '"type_id":' 3, '"name":' '"rack"' '},' '{' '"type_id":' 4, '"name":' '"row"' '},' '{' '"type_id":' 5, '"name":' '"pdu"' '},' '{' '"type_id":' 6, '"name":' '"pod"' '},' '{' '"type_id":' 7, '"name":' '"room"' '},' '{' '"type_id":' 8, '"name":' '"datacenter"' '},' '{' '"type_id":' 9, '"name":' '"zone"' '},' '{' '"type_id":' 10, '"name":' '"region"' '},' '{' '"type_id":' 11, '"name":' '"root"' '}' '],' '"buckets":' '[' '{' '"id":' -1, '"name":' '"default",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -3, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -2, '"name":' '"default~hdd",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -4, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -3, '"name":' '"smithi096",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '},' '{' '"id":' -4, '"name":' '"smithi096~hdd",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '}' '],' '"rules":' '[' '{' '"rule_id":' 0, '"rule_name":' '"replicated_rule",' '"type":' 1, '"steps":' '[' '{' '"op":' '"take",' '"item":' -1, '"item_name":' '"default"' '},' '{' '"op":' '"choose_firstn",' '"num":' 0, '"type":' '"osd"' '},' '{' '"op":' '"emit"' '}' ']' '}' '],' '"tunables":' '{' '"choose_local_tries":' 0, '"choose_local_fallback_tries":' 0, '"choose_total_tries":' 50, '"chooseleaf_descend_once":' 1, '"chooseleaf_vary_r":' 1, '"chooseleaf_stable":' 1, '"msr_descents":' 100, '"msr_collision_tries":' 100, '"straw_calc_version":' 1, '"allowed_bucket_algs":' 54, '"profile":' '"jewel",' '"optimal_tunables":' 1, '"legacy_tunables":' 0, '"minimum_required_version":' '"jewel",' '"require_feature_tunables":' 1, '"require_feature_tunables2":' 1, '"has_v2_rules":' 0, '"require_feature_tunables3":' 1, '"has_v3_rules":' 0, '"has_v4_buckets":' 1, '"require_feature_tunables5":' 1, '"has_v5_rules":' 0, '"has_msr_rules":' 0 '},' '"choose_args":' '{}' '},' '"fsmap":' '{' '"epoch":' 1, '"btime":' '"2024-09-16T03:22:46:882186+0000",' '"default_fscid":' -1, '"compat":' '{' '"compat":' '{},' '"ro_compat":' '{},' '"incompat":' '{' '"feature_1":' '"base' 'v0.20",' '"feature_2":' '"client' writeable 'ranges",' '"feature_3":' '"default' file layouts on 'dirs",' '"feature_4":' '"dir' inode in separate 'object",' '"feature_5":' '"mds' uses versioned 'encoding",' '"feature_6":' '"dirfrag' is stored in 'omap",' '"feature_8":' '"no' anchor 'table",' '"feature_9":' '"file' layout 'v2",' '"feature_10":' '"snaprealm' 'v2",' '"feature_11":' '"minor' log 'segments",' '"feature_12":' '"quiesce' 'subvolumes"' '}' '},' '"feature_flags":' '{' '"enable_multiple":' true, '"ever_enabled_multiple":' true '},' '"standbys":' '[],' '"filesystems":' '[]' '},' '"mdsmap_first_committed":' 1, '"mdsmap_last_committed":' 1, '"auth":' '{' '"first_committed":' 1, '"last_committed":' 5, '"num_secrets":' 3 '},' '"num_pg":' 64, '"num_pg_active":' 64, '"num_pg_unknown":' 0, '"num_osd":' 3, '"pool_sum":' '{' '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 128, '"acting":' 128, '"num_store_stats":' 0 '},' '"osd_sum":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54660, '"kb_used_data":' 888, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660540, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692392960, '"internally_reserved":' 0, '"allocated":' 909312, '"data_stored":' 340707, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 121, '"apply_latency_ms":' 121, '"commit_latency_ns":' 121000000, '"apply_latency_ns":' 121000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '},' '"osd_sum_by_class":' '{' '"hdd":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54660, '"kb_used_data":' 888, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660540, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692392960, '"internally_reserved":' 0, '"allocated":' 909312, '"data_stored":' 340707, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 121, '"apply_latency_ms":' 121, '"commit_latency_ns":' 121000000, '"apply_latency_ns":' 121000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '}' '},' '"pool_stats":' '[' '{' '"poolid":' 2, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '},' '{' '"poolid":' 1, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '}' '],' '"osd_stats":' '[' '{' '"osd":' 0, '"seq":' 21474836523 '},' '{' '"osd":' 1, '"seq":' 42949672995 '},' '{' '"osd":' 2, '"seq":' 1 '}' '],' '"num_pg_by_state":' '[' '{' '"state":' '"active+clean",' '"num":' 64 '}' '],' '"num_pg_by_osd":' '[' '{' '"osd":' 2, '"num_primary_pg":' 0, '"num_acting_pg":' 0, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 0, '"num_primary_pg":' 28, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 1, '"num_primary_pg":' 36, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '}' '],' '"purged_snaps":' '[' '{' '"pool":' 1, '"purged_snaps":' '{}' '},' '{' '"pool":' 2, '"purged_snaps":' '{}' '}' '],' '"servicemap":' '{' '"epoch":' 5, '"modified":' '"2024-09-16T03:25:38.422788+0000",' '"services":' '{}' '},' '"mgrstat_first_committed":' 87, '"mgrstat_last_committed":' 94, '"logm_first_committed":' 1, '"logm_last_committed":' 428, '"paxos":' '{' '"first_committed":' 1, '"last_committed":' 628, '"last_pn":' 0, '"accepted_pn":' 0 '}' '}' 2024-09-16T03:26:18.136 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:121: validate_fc: lec=86 2024-09-16T03:26:18.136 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:123: validate_fc: jq .osdmap_first_committed 2024-09-16T03:26:18.136 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:123: validate_fc: echo '{' '"cluster_fingerprint":' '"fda2fc64-07ed-4add-8224-2e527e11d427",' '"version":' '"19.3.0-4930-gfc3e0bff",' '"commit":' '"fc3e0bff7468fd55478adbae7f75508b749124b6",' '"timestamp":' '"2024-09-16T03:26:18.003503+0000",' '"tag":' '"",' '"health":' '{' '"status":' '"HEALTH_OK",' '"checks":' '{},' '"mutes":' '[]' '},' '"monmap_first_committed":' 1, '"monmap_last_committed":' 1, '"monmap":' '{' '"epoch":' 1, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"modified":' '"2024-09-16T03:22:45.872880Z",' '"created":' '"2024-09-16T03:22:45.872880Z",' '"min_mon_release":' 19, '"min_mon_release_name":' '"squid",' '"election_strategy":' 1, '"disallowed_leaders:' '":' '"",' '"stretch_mode":' false, '"tiebreaker_mon":' '"",' '"removed_ranks:' '":' '"",' '"features":' '{' '"persistent":' '[' '"kraken",' '"luminous",' '"mimic",' '"osdmap-prune",' '"nautilus",' '"octopus",' '"pacific",' '"elector-pinging",' '"quincy",' '"reef",' '"squid"' '],' '"optional":' '[]' '},' '"mons":' '[' '{' '"rank":' 0, '"name":' '"a",' '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:7302",' '"nonce":' 0 '}' ']' '},' '"addr":' '"127.0.0.1:7302/0",' '"public_addr":' '"127.0.0.1:7302/0",' '"priority":' 0, '"weight":' 0, '"crush_location":' '"{}"' '}' ']' '},' '"quorum":' '[' 0 '],' '"osdmap":' '{' '"epoch":' 88, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"created":' '"2024-09-16T03:22:46.906117+0000",' '"modified":' '"2024-09-16T03:26:15.120212+0000",' '"last_up_change":' '"2024-09-16T03:26:15.120212+0000",' '"last_in_change":' '"2024-09-16T03:25:09.839444+0000",' '"flags":' '"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit",' '"flags_num":' 5799936, '"flags_set":' '[' '"pglog_hardlimit",' '"purged_snapdirs",' '"recovery_deletes",' '"sortbitwise"' '],' '"crush_version":' 8, '"full_ratio":' 0.97000002861022949, '"backfillfull_ratio":' 0.97000002861022949, '"nearfull_ratio":' 0.85000002384185791, '"cluster_snapshot":' '"",' '"pool_max":' 2, '"max_osd":' 3, '"require_min_compat_client":' '"luminous",' '"min_compat_client":' '"jewel",' '"require_osd_release":' '"squid",' '"allow_crimson":' false, '"pools":' '[' '{' '"pool":' 1, '"pool_name":' '"foo",' '"create_time":' '"2024-09-16T03:24:44.525189+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 2, '"min_size":' 1, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"85",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.8700000047683716, '"score_stable":' 1.8700000047683716, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1.25, '"raw_score_stable":' 1.25, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '},' '{' '"pool":' 2, '"pool_name":' '"bar",' '"create_time":' '"2024-09-16T03:24:46.226575+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 2, '"min_size":' 1, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"83",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.4900000095367432, '"score_stable":' 1.4900000095367432, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1, '"raw_score_stable":' 1, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '}' '],' '"osds":' '[' '{' '"osd":' 0, '"uuid":' '"64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 5, '"up_thru":' 84, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6802",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6803",' '"nonce":' 3375787448 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6804",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6805",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6808",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6809",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6806",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6807",' '"nonce":' 3375787448 '}' ']' '},' '"public_addr":' '"127.0.0.1:6803/3375787448",' '"cluster_addr":' '"127.0.0.1:6805/3375787448",' '"heartbeat_back_addr":' '"127.0.0.1:6809/3375787448",' '"heartbeat_front_addr":' '"127.0.0.1:6807/3375787448",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 1, '"uuid":' '"74b26727-75c9-444d-8782-719e4197a382",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 10, '"up_thru":' 84, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6810",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6811",' '"nonce":' 3733255132 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6812",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6813",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6816",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6817",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6814",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6815",' '"nonce":' 3733255132 '}' ']' '},' '"public_addr":' '"127.0.0.1:6811/3733255132",' '"cluster_addr":' '"127.0.0.1:6813/3733255132",' '"heartbeat_back_addr":' '"127.0.0.1:6817/3733255132",' '"heartbeat_front_addr":' '"127.0.0.1:6815/3733255132",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 2, '"uuid":' '"143da3a7-dad9-4b1e-966b-76cf5bdd3c82",' '"up":' 1, '"in":' 0, '"weight":' 0, '"primary_affinity":' 1, '"last_clean_begin":' 15, '"last_clean_end":' 32, '"up_from":' 88, '"up_thru":' 21, '"down_at":' 33, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6818",' '"nonce":' 2576002244 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6819",' '"nonce":' 2576002244 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6820",' '"nonce":' 2576002244 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6821",' '"nonce":' 2576002244 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6824",' '"nonce":' 2576002244 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6825",' '"nonce":' 2576002244 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6822",' '"nonce":' 2576002244 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6823",' '"nonce":' 2576002244 '}' ']' '},' '"public_addr":' '"127.0.0.1:6819/2576002244",' '"cluster_addr":' '"127.0.0.1:6821/2576002244",' '"heartbeat_back_addr":' '"127.0.0.1:6825/2576002244",' '"heartbeat_front_addr":' '"127.0.0.1:6823/2576002244",' '"state":' '[' '"exists",' '"up"' ']' '}' '],' '"osd_xinfo":' '[' '{' '"osd":' 0, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:22.481942+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 1, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:59.663703+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 2, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 65536, '"last_purged_snaps_scrub":' '"2024-09-16T03:24:37.320822+0000",' '"dead_epoch":' 32 '}' '],' '"pg_upmap":' '[],' '"pg_upmap_items":' '[],' '"pg_upmap_primaries":' '[],' '"pg_temp":' '[],' '"primary_temp":' '[],' '"blocklist":' '{},' '"range_blocklist":' '{},' '"erasure_code_profiles":' '{' '"default":' '{' '"k":' '"2",' '"m":' '"2",' '"plugin":' '"jerasure",' '"technique":' '"reed_sol_van"' '}' '},' '"removed_snaps_queue":' '[],' '"new_removed_snaps":' '[],' '"new_purged_snaps":' '[],' '"crush_node_flags":' '{},' '"device_class_flags":' '{},' '"stretch_mode":' '{' '"stretch_mode_enabled":' false, '"stretch_bucket_count":' 0, '"degraded_stretch_mode":' 0, '"recovering_stretch_mode":' 0, '"stretch_mode_bucket":' 0 '}' '},' '"osd_metadata":' '[' '{' '"id":' 0, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/0/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:22:53.662571Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]",' '"hb_front_addr":' '"[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/0",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 1, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/1/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:23:30.129885Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]",' '"hb_front_addr":' '"[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/1",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 2, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6820/2576002244,v1:127.0.0.1:6821/2576002244]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/2/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:24:07.764502Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6818/2576002244,v1:127.0.0.1:6819/2576002244]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6824/2576002244,v1:127.0.0.1:6825/2576002244]",' '"hb_front_addr":' '"[v2:127.0.0.1:6822/2576002244,v1:127.0.0.1:6823/2576002244]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/2",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '}' '],' '"osdmap_clean_epochs":' '{' '"min_last_epoch_clean":' 86, '"last_epoch_clean":' '{' '"per_pool":' '[' '{' '"poolid":' 1, '"floor":' 86 '},' '{' '"poolid":' 2, '"floor":' 86 '}' ']' '},' '"osd_epochs":' '[' '{' '"id":' 0, '"epoch":' 86 '},' '{' '"id":' 1, '"epoch":' 88 '},' '{' '"id":' 2, '"epoch":' 88 '}' ']' '},' '"osdmap_first_committed":' 84, '"osdmap_last_committed":' 88, '"crushmap":' '{' '"devices":' '[' '{' '"id":' 0, '"name":' '"osd.0",' '"class":' '"hdd"' '},' '{' '"id":' 1, '"name":' '"osd.1",' '"class":' '"hdd"' '},' '{' '"id":' 2, '"name":' '"osd.2",' '"class":' '"hdd"' '}' '],' '"types":' '[' '{' '"type_id":' 0, '"name":' '"osd"' '},' '{' '"type_id":' 1, '"name":' '"host"' '},' '{' '"type_id":' 2, '"name":' '"chassis"' '},' '{' '"type_id":' 3, '"name":' '"rack"' '},' '{' '"type_id":' 4, '"name":' '"row"' '},' '{' '"type_id":' 5, '"name":' '"pdu"' '},' '{' '"type_id":' 6, '"name":' '"pod"' '},' '{' '"type_id":' 7, '"name":' '"room"' '},' '{' '"type_id":' 8, '"name":' '"datacenter"' '},' '{' '"type_id":' 9, '"name":' '"zone"' '},' '{' '"type_id":' 10, '"name":' '"region"' '},' '{' '"type_id":' 11, '"name":' '"root"' '}' '],' '"buckets":' '[' '{' '"id":' -1, '"name":' '"default",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -3, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -2, '"name":' '"default~hdd",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -4, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -3, '"name":' '"smithi096",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '},' '{' '"id":' -4, '"name":' '"smithi096~hdd",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '}' '],' '"rules":' '[' '{' '"rule_id":' 0, '"rule_name":' '"replicated_rule",' '"type":' 1, '"steps":' '[' '{' '"op":' '"take",' '"item":' -1, '"item_name":' '"default"' '},' '{' '"op":' '"choose_firstn",' '"num":' 0, '"type":' '"osd"' '},' '{' '"op":' '"emit"' '}' ']' '}' '],' '"tunables":' '{' '"choose_local_tries":' 0, '"choose_local_fallback_tries":' 0, '"choose_total_tries":' 50, '"chooseleaf_descend_once":' 1, '"chooseleaf_vary_r":' 1, '"chooseleaf_stable":' 1, '"msr_descents":' 100, '"msr_collision_tries":' 100, '"straw_calc_version":' 1, '"allowed_bucket_algs":' 54, '"profile":' '"jewel",' '"optimal_tunables":' 1, '"legacy_tunables":' 0, '"minimum_required_version":' '"jewel",' '"require_feature_tunables":' 1, '"require_feature_tunables2":' 1, '"has_v2_rules":' 0, '"require_feature_tunables3":' 1, '"has_v3_rules":' 0, '"has_v4_buckets":' 1, '"require_feature_tunables5":' 1, '"has_v5_rules":' 0, '"has_msr_rules":' 0 '},' '"choose_args":' '{}' '},' '"fsmap":' '{' '"epoch":' 1, '"btime":' '"2024-09-16T03:22:46:882186+0000",' '"default_fscid":' -1, '"compat":' '{' '"compat":' '{},' '"ro_compat":' '{},' '"incompat":' '{' '"feature_1":' '"base' 'v0.20",' '"feature_2":' '"client' writeable 'ranges",' '"feature_3":' '"default' file layouts on 'dirs",' '"feature_4":' '"dir' inode in separate 'object",' '"feature_5":' '"mds' uses versioned 'encoding",' '"feature_6":' '"dirfrag' is stored in 'omap",' '"feature_8":' '"no' anchor 'table",' '"feature_9":' '"file' layout 'v2",' '"feature_10":' '"snaprealm' 'v2",' '"feature_11":' '"minor' log 'segments",' '"feature_12":' '"quiesce' 'subvolumes"' '}' '},' '"feature_flags":' '{' '"enable_multiple":' true, '"ever_enabled_multiple":' true '},' '"standbys":' '[],' '"filesystems":' '[]' '},' '"mdsmap_first_committed":' 1, '"mdsmap_last_committed":' 1, '"auth":' '{' '"first_committed":' 1, '"last_committed":' 5, '"num_secrets":' 3 '},' '"num_pg":' 64, '"num_pg_active":' 64, '"num_pg_unknown":' 0, '"num_osd":' 3, '"pool_sum":' '{' '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 128, '"acting":' 128, '"num_store_stats":' 0 '},' '"osd_sum":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54660, '"kb_used_data":' 888, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660540, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692392960, '"internally_reserved":' 0, '"allocated":' 909312, '"data_stored":' 340707, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 121, '"apply_latency_ms":' 121, '"commit_latency_ns":' 121000000, '"apply_latency_ns":' 121000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '},' '"osd_sum_by_class":' '{' '"hdd":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54660, '"kb_used_data":' 888, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660540, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692392960, '"internally_reserved":' 0, '"allocated":' 909312, '"data_stored":' 340707, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 121, '"apply_latency_ms":' 121, '"commit_latency_ns":' 121000000, '"apply_latency_ns":' 121000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '}' '},' '"pool_stats":' '[' '{' '"poolid":' 2, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '},' '{' '"poolid":' 1, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '}' '],' '"osd_stats":' '[' '{' '"osd":' 0, '"seq":' 21474836523 '},' '{' '"osd":' 1, '"seq":' 42949672995 '},' '{' '"osd":' 2, '"seq":' 1 '}' '],' '"num_pg_by_state":' '[' '{' '"state":' '"active+clean",' '"num":' 64 '}' '],' '"num_pg_by_osd":' '[' '{' '"osd":' 2, '"num_primary_pg":' 0, '"num_acting_pg":' 0, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 0, '"num_primary_pg":' 28, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 1, '"num_primary_pg":' 36, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '}' '],' '"purged_snaps":' '[' '{' '"pool":' 1, '"purged_snaps":' '{}' '},' '{' '"pool":' 2, '"purged_snaps":' '{}' '}' '],' '"servicemap":' '{' '"epoch":' 5, '"modified":' '"2024-09-16T03:25:38.422788+0000",' '"services":' '{}' '},' '"mgrstat_first_committed":' 87, '"mgrstat_last_committed":' 94, '"logm_first_committed":' 1, '"logm_last_committed":' 428, '"paxos":' '{' '"first_committed":' 1, '"last_committed":' 628, '"last_pn":' 0, '"accepted_pn":' 0 '}' '}' 2024-09-16T03:26:18.136 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:123: validate_fc: osdm_fc=84 2024-09-16T03:26:18.137 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:125: validate_fc: [[ 86 -eq 84 ]] 2024-09-16T03:26:18.137 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:125: validate_fc: echo '{' '"cluster_fingerprint":' '"fda2fc64-07ed-4add-8224-2e527e11d427",' '"version":' '"19.3.0-4930-gfc3e0bff",' '"commit":' '"fc3e0bff7468fd55478adbae7f75508b749124b6",' '"timestamp":' '"2024-09-16T03:26:18.003503+0000",' '"tag":' '"",' '"health":' '{' '"status":' '"HEALTH_OK",' '"checks":' '{},' '"mutes":' '[]' '},' '"monmap_first_committed":' 1, '"monmap_last_committed":' 1, '"monmap":' '{' '"epoch":' 1, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"modified":' '"2024-09-16T03:22:45.872880Z",' '"created":' '"2024-09-16T03:22:45.872880Z",' '"min_mon_release":' 19, '"min_mon_release_name":' '"squid",' '"election_strategy":' 1, '"disallowed_leaders:' '":' '"",' '"stretch_mode":' false, '"tiebreaker_mon":' '"",' '"removed_ranks:' '":' '"",' '"features":' '{' '"persistent":' '[' '"kraken",' '"luminous",' '"mimic",' '"osdmap-prune",' '"nautilus",' '"octopus",' '"pacific",' '"elector-pinging",' '"quincy",' '"reef",' '"squid"' '],' '"optional":' '[]' '},' '"mons":' '[' '{' '"rank":' 0, '"name":' '"a",' '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:7302",' '"nonce":' 0 '}' ']' '},' '"addr":' '"127.0.0.1:7302/0",' '"public_addr":' '"127.0.0.1:7302/0",' '"priority":' 0, '"weight":' 0, '"crush_location":' '"{}"' '}' ']' '},' '"quorum":' '[' 0 '],' '"osdmap":' '{' '"epoch":' 88, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"created":' '"2024-09-16T03:22:46.906117+0000",' '"modified":' '"2024-09-16T03:26:15.120212+0000",' '"last_up_change":' '"2024-09-16T03:26:15.120212+0000",' '"last_in_change":' '"2024-09-16T03:25:09.839444+0000",' '"flags":' '"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit",' '"flags_num":' 5799936, '"flags_set":' '[' '"pglog_hardlimit",' '"purged_snapdirs",' '"recovery_deletes",' '"sortbitwise"' '],' '"crush_version":' 8, '"full_ratio":' 0.97000002861022949, '"backfillfull_ratio":' 0.97000002861022949, '"nearfull_ratio":' 0.85000002384185791, '"cluster_snapshot":' '"",' '"pool_max":' 2, '"max_osd":' 3, '"require_min_compat_client":' '"luminous",' '"min_compat_client":' '"jewel",' '"require_osd_release":' '"squid",' '"allow_crimson":' false, '"pools":' '[' '{' '"pool":' 1, '"pool_name":' '"foo",' '"create_time":' '"2024-09-16T03:24:44.525189+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 2, '"min_size":' 1, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"85",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.8700000047683716, '"score_stable":' 1.8700000047683716, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1.25, '"raw_score_stable":' 1.25, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '},' '{' '"pool":' 2, '"pool_name":' '"bar",' '"create_time":' '"2024-09-16T03:24:46.226575+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 2, '"min_size":' 1, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"83",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.4900000095367432, '"score_stable":' 1.4900000095367432, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1, '"raw_score_stable":' 1, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '}' '],' '"osds":' '[' '{' '"osd":' 0, '"uuid":' '"64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 5, '"up_thru":' 84, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6802",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6803",' '"nonce":' 3375787448 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6804",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6805",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6808",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6809",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6806",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6807",' '"nonce":' 3375787448 '}' ']' '},' '"public_addr":' '"127.0.0.1:6803/3375787448",' '"cluster_addr":' '"127.0.0.1:6805/3375787448",' '"heartbeat_back_addr":' '"127.0.0.1:6809/3375787448",' '"heartbeat_front_addr":' '"127.0.0.1:6807/3375787448",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 1, '"uuid":' '"74b26727-75c9-444d-8782-719e4197a382",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 10, '"up_thru":' 84, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6810",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6811",' '"nonce":' 3733255132 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6812",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6813",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6816",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6817",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6814",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6815",' '"nonce":' 3733255132 '}' ']' '},' '"public_addr":' '"127.0.0.1:6811/3733255132",' '"cluster_addr":' '"127.0.0.1:6813/3733255132",' '"heartbeat_back_addr":' '"127.0.0.1:6817/3733255132",' '"heartbeat_front_addr":' '"127.0.0.1:6815/3733255132",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 2, '"uuid":' '"143da3a7-dad9-4b1e-966b-76cf5bdd3c82",' '"up":' 1, '"in":' 0, '"weight":' 0, '"primary_affinity":' 1, '"last_clean_begin":' 15, '"last_clean_end":' 32, '"up_from":' 88, '"up_thru":' 21, '"down_at":' 33, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6818",' '"nonce":' 2576002244 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6819",' '"nonce":' 2576002244 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6820",' '"nonce":' 2576002244 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6821",' '"nonce":' 2576002244 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6824",' '"nonce":' 2576002244 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6825",' '"nonce":' 2576002244 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6822",' '"nonce":' 2576002244 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6823",' '"nonce":' 2576002244 '}' ']' '},' '"public_addr":' '"127.0.0.1:6819/2576002244",' '"cluster_addr":' '"127.0.0.1:6821/2576002244",' '"heartbeat_back_addr":' '"127.0.0.1:6825/2576002244",' '"heartbeat_front_addr":' '"127.0.0.1:6823/2576002244",' '"state":' '[' '"exists",' '"up"' ']' '}' '],' '"osd_xinfo":' '[' '{' '"osd":' 0, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:22.481942+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 1, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:59.663703+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 2, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 65536, '"last_purged_snaps_scrub":' '"2024-09-16T03:24:37.320822+0000",' '"dead_epoch":' 32 '}' '],' '"pg_upmap":' '[],' '"pg_upmap_items":' '[],' '"pg_upmap_primaries":' '[],' '"pg_temp":' '[],' '"primary_temp":' '[],' '"blocklist":' '{},' '"range_blocklist":' '{},' '"erasure_code_profiles":' '{' '"default":' '{' '"k":' '"2",' '"m":' '"2",' '"plugin":' '"jerasure",' '"technique":' '"reed_sol_van"' '}' '},' '"removed_snaps_queue":' '[],' '"new_removed_snaps":' '[],' '"new_purged_snaps":' '[],' '"crush_node_flags":' '{},' '"device_class_flags":' '{},' '"stretch_mode":' '{' '"stretch_mode_enabled":' false, '"stretch_bucket_count":' 0, '"degraded_stretch_mode":' 0, '"recovering_stretch_mode":' 0, '"stretch_mode_bucket":' 0 '}' '},' '"osd_metadata":' '[' '{' '"id":' 0, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/0/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:22:53.662571Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]",' '"hb_front_addr":' '"[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/0",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 1, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/1/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:23:30.129885Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]",' '"hb_front_addr":' '"[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/1",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 2, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6820/2576002244,v1:127.0.0.1:6821/2576002244]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/2/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:24:07.764502Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6818/2576002244,v1:127.0.0.1:6819/2576002244]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6824/2576002244,v1:127.0.0.1:6825/2576002244]",' '"hb_front_addr":' '"[v2:127.0.0.1:6822/2576002244,v1:127.0.0.1:6823/2576002244]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/2",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '}' '],' '"osdmap_clean_epochs":' '{' '"min_last_epoch_clean":' 86, '"last_epoch_clean":' '{' '"per_pool":' '[' '{' '"poolid":' 1, '"floor":' 86 '},' '{' '"poolid":' 2, '"floor":' 86 '}' ']' '},' '"osd_epochs":' '[' '{' '"id":' 0, '"epoch":' 86 '},' '{' '"id":' 1, '"epoch":' 88 '},' '{' '"id":' 2, '"epoch":' 88 '}' ']' '},' '"osdmap_first_committed":' 84, '"osdmap_last_committed":' 88, '"crushmap":' '{' '"devices":' '[' '{' '"id":' 0, '"name":' '"osd.0",' '"class":' '"hdd"' '},' '{' '"id":' 1, '"name":' '"osd.1",' '"class":' '"hdd"' '},' '{' '"id":' 2, '"name":' '"osd.2",' '"class":' '"hdd"' '}' '],' '"types":' '[' '{' '"type_id":' 0, '"name":' '"osd"' '},' '{' '"type_id":' 1, '"name":' '"host"' '},' '{' '"type_id":' 2, '"name":' '"chassis"' '},' '{' '"type_id":' 3, '"name":' '"rack"' '},' '{' '"type_id":' 4, '"name":' '"row"' '},' '{' '"type_id":' 5, '"name":' '"pdu"' '},' '{' '"type_id":' 6, '"name":' '"pod"' '},' '{' '"type_id":' 7, '"name":' '"room"' '},' '{' '"type_id":' 8, '"name":' '"datacenter"' '},' '{' '"type_id":' 9, '"name":' '"zone"' '},' '{' '"type_id":' 10, '"name":' '"region"' '},' '{' '"type_id":' 11, '"name":' '"root"' '}' '],' '"buckets":' '[' '{' '"id":' -1, '"name":' '"default",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -3, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -2, '"name":' '"default~hdd",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -4, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -3, '"name":' '"smithi096",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '},' '{' '"id":' -4, '"name":' '"smithi096~hdd",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '}' '],' '"rules":' '[' '{' '"rule_id":' 0, '"rule_name":' '"replicated_rule",' '"type":' 1, '"steps":' '[' '{' '"op":' '"take",' '"item":' -1, '"item_name":' '"default"' '},' '{' '"op":' '"choose_firstn",' '"num":' 0, '"type":' '"osd"' '},' '{' '"op":' '"emit"' '}' ']' '}' '],' '"tunables":' '{' '"choose_local_tries":' 0, '"choose_local_fallback_tries":' 0, '"choose_total_tries":' 50, '"chooseleaf_descend_once":' 1, '"chooseleaf_vary_r":' 1, '"chooseleaf_stable":' 1, '"msr_descents":' 100, '"msr_collision_tries":' 100, '"straw_calc_version":' 1, '"allowed_bucket_algs":' 54, '"profile":' '"jewel",' '"optimal_tunables":' 1, '"legacy_tunables":' 0, '"minimum_required_version":' '"jewel",' '"require_feature_tunables":' 1, '"require_feature_tunables2":' 1, '"has_v2_rules":' 0, '"require_feature_tunables3":' 1, '"has_v3_rules":' 0, '"has_v4_buckets":' 1, '"require_feature_tunables5":' 1, '"has_v5_rules":' 0, '"has_msr_rules":' 0 '},' '"choose_args":' '{}' '},' '"fsmap":' '{' '"epoch":' 1, '"btime":' '"2024-09-16T03:22:46:882186+0000",' '"default_fscid":' -1, '"compat":' '{' '"compat":' '{},' '"ro_compat":' '{},' '"incompat":' '{' '"feature_1":' '"base' 'v0.20",' '"feature_2":' '"client' writeable 'ranges",' '"feature_3":' '"default' file layouts on 'dirs",' '"feature_4":' '"dir' inode in separate 'object",' '"feature_5":' '"mds' uses versioned 'encoding",' '"feature_6":' '"dirfrag' is stored in 'omap",' '"feature_8":' '"no' anchor 'table",' '"feature_9":' '"file' layout 'v2",' '"feature_10":' '"snaprealm' 'v2",' '"feature_11":' '"minor' log 'segments",' '"feature_12":' '"quiesce' 'subvolumes"' '}' '},' '"feature_flags":' '{' '"enable_multiple":' true, '"ever_enabled_multiple":' true '},' '"standbys":' '[],' '"filesystems":' '[]' '},' '"mdsmap_first_committed":' 1, '"mdsmap_last_committed":' 1, '"auth":' '{' '"first_committed":' 1, '"last_committed":' 5, '"num_secrets":' 3 '},' '"num_pg":' 64, '"num_pg_active":' 64, '"num_pg_unknown":' 0, '"num_osd":' 3, '"pool_sum":' '{' '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 128, '"acting":' 128, '"num_store_stats":' 0 '},' '"osd_sum":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54660, '"kb_used_data":' 888, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660540, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692392960, '"internally_reserved":' 0, '"allocated":' 909312, '"data_stored":' 340707, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 121, '"apply_latency_ms":' 121, '"commit_latency_ns":' 121000000, '"apply_latency_ns":' 121000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '},' '"osd_sum_by_class":' '{' '"hdd":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54660, '"kb_used_data":' 888, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660540, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692392960, '"internally_reserved":' 0, '"allocated":' 909312, '"data_stored":' 340707, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 121, '"apply_latency_ms":' 121, '"commit_latency_ns":' 121000000, '"apply_latency_ns":' 121000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '}' '},' '"pool_stats":' '[' '{' '"poolid":' 2, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '},' '{' '"poolid":' 1, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '}' '],' '"osd_stats":' '[' '{' '"osd":' 0, '"seq":' 21474836523 '},' '{' '"osd":' 1, '"seq":' 42949672995 '},' '{' '"osd":' 2, '"seq":' 1 '}' '],' '"num_pg_by_state":' '[' '{' '"state":' '"active+clean",' '"num":' 64 '}' '],' '"num_pg_by_osd":' '[' '{' '"osd":' 2, '"num_primary_pg":' 0, '"num_acting_pg":' 0, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 0, '"num_primary_pg":' 28, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 1, '"num_primary_pg":' 36, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '}' '],' '"purged_snaps":' '[' '{' '"pool":' 1, '"purged_snaps":' '{}' '},' '{' '"pool":' 2, '"purged_snaps":' '{}' '}' '],' '"servicemap":' '{' '"epoch":' 5, '"modified":' '"2024-09-16T03:25:38.422788+0000",' '"services":' '{}' '},' '"mgrstat_first_committed":' 87, '"mgrstat_last_committed":' 94, '"logm_first_committed":' 1, '"logm_last_committed":' 428, '"paxos":' '{' '"first_committed":' 1, '"last_committed":' 628, '"last_pn":' 0, '"accepted_pn":' 0 '}' '}' 2024-09-16T03:26:18.138 INFO:tasks.workunit.client.0.smithi096.stdout:{ "cluster_fingerprint": "fda2fc64-07ed-4add-8224-2e527e11d427", "version": "19.3.0-4930-gfc3e0bff", "commit": "fc3e0bff7468fd55478adbae7f75508b749124b6", "timestamp": "2024-09-16T03:26:18.003503+0000", "tag": "", "health": { "status": "HEALTH_OK", "checks": {}, "mutes": [] }, "monmap_first_committed": 1, "monmap_last_committed": 1, "monmap": { "epoch": 1, "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", "modified": "2024-09-16T03:22:45.872880Z", "created": "2024-09-16T03:22:45.872880Z", "min_mon_release": 19, "min_mon_release_name": "squid", "election_strategy": 1, "disallowed_leaders: ": "", "stretch_mode": false, "tiebreaker_mon": "", "removed_ranks: ": "", "features": { "persistent": [ "kraken", "luminous", "mimic", "osdmap-prune", "nautilus", "octopus", "pacific", "elector-pinging", "quincy", "reef", "squid" ], "optional": [] }, "mons": [ { "rank": 0, "name": "a", "public_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:7302", "nonce": 0 } ] }, "addr": "127.0.0.1:7302/0", "public_addr": "127.0.0.1:7302/0", "priority": 0, "weight": 0, "crush_location": "{}" } ] }, "quorum": [ 0 ], "osdmap": { "epoch": 88, "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", "created": "2024-09-16T03:22:46.906117+0000", "modified": "2024-09-16T03:26:15.120212+0000", "last_up_change": "2024-09-16T03:26:15.120212+0000", "last_in_change": "2024-09-16T03:25:09.839444+0000", "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", "flags_num": 5799936, "flags_set": [ "pglog_hardlimit", "purged_snapdirs", "recovery_deletes", "sortbitwise" ], "crush_version": 8, "full_ratio": 0.97000002861022949, "backfillfull_ratio": 0.97000002861022949, "nearfull_ratio": 0.85000002384185791, "cluster_snapshot": "", "pool_max": 2, "max_osd": 3, "require_min_compat_client": "luminous", "min_compat_client": "jewel", "require_osd_release": "squid", "allow_crimson": false, "pools": [ { "pool": 1, "pool_name": "foo", "create_time": "2024-09-16T03:24:44.525189+0000", "flags": 1, "flags_names": "hashpspool", "type": 1, "size": 2, "min_size": 1, "crush_rule": 0, "peering_crush_bucket_count": 0, "peering_crush_bucket_target": 0, "peering_crush_bucket_barrier": 0, "peering_crush_bucket_mandatory_member": 2147483647, "is_stretch_pool": false, "object_hash": 2, "pg_autoscale_mode": "off", "pg_num": 32, "pg_placement_num": 32, "pg_placement_num_target": 32, "pg_num_target": 32, "pg_num_pending": 32, "last_pg_merge_meta": { "source_pgid": "0.0", "ready_epoch": 0, "last_epoch_started": 0, "last_epoch_clean": 0, "source_version": "0'0", "target_version": "0'0" }, "last_change": "85", "last_force_op_resend": "0", "last_force_op_resend_prenautilus": "0", "last_force_op_resend_preluminous": "0", "auid": 0, "snap_mode": "selfmanaged", "snap_seq": 0, "snap_epoch": 0, "pool_snaps": [], "removed_snaps": "[]", "quota_max_bytes": 0, "quota_max_objects": 0, "tiers": [], "tier_of": -1, "read_tier": -1, "write_tier": -1, "cache_mode": "none", "target_max_bytes": 0, "target_max_objects": 0, "cache_target_dirty_ratio_micro": 400000, "cache_target_dirty_high_ratio_micro": 600000, "cache_target_full_ratio_micro": 800000, "cache_min_flush_age": 0, "cache_min_evict_age": 0, "erasure_code_profile": "", "hit_set_params": { "type": "none" }, "hit_set_period": 0, "hit_set_count": 0, "use_gmt_hitset": true, "min_read_recency_for_promote": 0, "min_write_recency_for_promote": 0, "hit_set_grade_decay_rate": 0, "hit_set_search_last_n": 0, "grade_table": [], "stripe_width": 0, "expected_num_objects": 0, "fast_read": false, "options": {}, "application_metadata": {}, "read_balance": { "score_type": "Fair distribution", "score_acting": 1.8700000047683716, "score_stable": 1.8700000047683716, "optimal_score": 0.67000001668930054, "raw_score_acting": 1.25, "raw_score_stable": 1.25, "primary_affinity_weighted": 1, "average_primary_affinity": 1, "average_primary_affinity_weighted": 1 } }, { "pool": 2, "pool_name": "bar", "create_time": "2024-09-16T03:24:46.226575+0000", "flags": 1, "flags_names": "hashpspool", "type": 1, "size": 2, "min_size": 1, "crush_rule": 0, "peering_crush_bucket_count": 0, "peering_crush_bucket_target": 0, "peering_crush_bucket_barrier": 0, "peering_crush_bucket_mandatory_member": 2147483647, "is_stretch_pool": false, "object_hash": 2, "pg_autoscale_mode": "off", "pg_num": 32, "pg_placement_num": 32, "pg_placement_num_target": 32, "pg_num_target": 32, "pg_num_pending": 32, "last_pg_merge_meta": { "source_pgid": "0.0", "ready_epoch": 0, "last_epoch_started": 0, "last_epoch_clean": 0, "source_version": "0'0", "target_version": "0'0" }, "last_change": "83", "last_force_op_resend": "0", "last_force_op_resend_prenautilus": "0", "last_force_op_resend_preluminous": "0", "auid": 0, "snap_mode": "selfmanaged", "snap_seq": 0, "snap_epoch": 0, "pool_snaps": [], "removed_snaps": "[]", "quota_max_bytes": 0, "quota_max_objects": 0, "tiers": [], "tier_of": -1, "read_tier": -1, "write_tier": -1, "cache_mode": "none", "target_max_bytes": 0, "target_max_objects": 0, "cache_target_dirty_ratio_micro": 400000, "cache_target_dirty_high_ratio_micro": 600000, "cache_target_full_ratio_micro": 800000, "cache_min_flush_age": 0, "cache_min_evict_age": 0, "erasure_code_profile": "", "hit_set_params": { "type": "none" }, "hit_set_period": 0, "hit_set_count": 0, "use_gmt_hitset": true, "min_read_recency_for_promote": 0, "min_write_recency_for_promote": 0, "hit_set_grade_decay_rate": 0, "hit_set_search_last_n": 0, "grade_table": [], "stripe_width": 0, "expected_num_objects": 0, "fast_read": false, "options": {}, "application_metadata": {}, "read_balance": { "score_type": "Fair distribution", "score_acting": 1.4900000095367432, "score_stable": 1.4900000095367432, "optimal_score": 0.67000001668930054, "raw_score_acting": 1, "raw_score_stable": 1, "primary_affinity_weighted": 1, "average_primary_affinity": 1, "average_primary_affinity_weighted": 1 } } ], "osds": [ { "osd": 0, "uuid": "64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6", "up": 1, "in": 1, "weight": 1, "primary_affinity": 1, "last_clean_begin": 0, "last_clean_end": 0, "up_from": 5, "up_thru": 84, "down_at": 0, "lost_at": 0, "public_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6802", "nonce": 3375787448 }, { "type": "v1", "addr": "127.0.0.1:6803", "nonce": 3375787448 } ] }, "cluster_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6804", "nonce": 3375787448 }, { "type": "v1", "addr": "127.0.0.1:6805", "nonce": 3375787448 } ] }, "heartbeat_back_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6808", "nonce": 3375787448 }, { "type": "v1", "addr": "127.0.0.1:6809", "nonce": 3375787448 } ] }, "heartbeat_front_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6806", "nonce": 3375787448 }, { "type": "v1", "addr": "127.0.0.1:6807", "nonce": 3375787448 } ] }, "public_addr": "127.0.0.1:6803/3375787448", "cluster_addr": "127.0.0.1:6805/3375787448", "heartbeat_back_addr": "127.0.0.1:6809/3375787448", "heartbeat_front_addr": "127.0.0.1:6807/3375787448", "state": [ "exists", "up" ] }, { "osd": 1, "uuid": "74b26727-75c9-444d-8782-719e4197a382", "up": 1, "in": 1, "weight": 1, "primary_affinity": 1, "last_clean_begin": 0, "last_clean_end": 0, "up_from": 10, "up_thru": 84, "down_at": 0, "lost_at": 0, "public_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6810", "nonce": 3733255132 }, { "type": "v1", "addr": "127.0.0.1:6811", "nonce": 3733255132 } ] }, "cluster_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6812", "nonce": 3733255132 }, { "type": "v1", "addr": "127.0.0.1:6813", "nonce": 3733255132 } ] }, "heartbeat_back_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6816", "nonce": 3733255132 }, { "type": "v1", "addr": "127.0.0.1:6817", "nonce": 3733255132 } ] }, "heartbeat_front_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6814", "nonce": 3733255132 }, { "type": "v1", "addr": "127.0.0.1:6815", "nonce": 3733255132 } ] }, "public_addr": "127.0.0.1:6811/3733255132", "cluster_addr": "127.0.0.1:6813/3733255132", "heartbeat_back_addr": "127.0.0.1:6817/3733255132", "heartbeat_front_addr": "127.0.0.1:6815/3733255132", "state": [ "exists", "up" ] }, { "osd": 2, "uuid": "143da3a7-dad9-4b1e-966b-76cf5bdd3c82", "up": 1, "in": 0, "weight": 0, "primary_affinity": 1, "last_clean_begin": 15, "last_clean_end": 32, "up_from": 88, "up_thru": 21, "down_at": 33, "lost_at": 0, "public_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6818", "nonce": 2576002244 }, { "type": "v1", "addr": "127.0.0.1:6819", "nonce": 2576002244 } ] }, "cluster_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6820", "nonce": 2576002244 }, { "type": "v1", "addr": "127.0.0.1:6821", "nonce": 2576002244 } ] }, "heartbeat_back_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6824", "nonce": 2576002244 }, { "type": "v1", "addr": "127.0.0.1:6825", "nonce": 2576002244 } ] }, "heartbeat_front_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6822", "nonce": 2576002244 }, { "type": "v1", "addr": "127.0.0.1:6823", "nonce": 2576002244 } ] }, "public_addr": "127.0.0.1:6819/2576002244", "cluster_addr": "127.0.0.1:6821/2576002244", "heartbeat_back_addr": "127.0.0.1:6825/2576002244", "heartbeat_front_addr": "127.0.0.1:6823/2576002244", "state": [ "exists", "up" ] } ], "osd_xinfo": [ { "osd": 0, "down_stamp": "0.000000", "laggy_probability": 0, "laggy_interval": 0, "features": 4540719139924082687, "old_weight": 0, "last_purged_snaps_scrub": "2024-09-16T03:23:22.481942+0000", "dead_epoch": 0 }, { "osd": 1, "down_stamp": "0.000000", "laggy_probability": 0, "laggy_interval": 0, "features": 4540719139924082687, "old_weight": 0, "last_purged_snaps_scrub": "2024-09-16T03:23:59.663703+0000", "dead_epoch": 0 }, { "osd": 2, "down_stamp": "0.000000", "laggy_probability": 0, "laggy_interval": 0, "features": 4540719139924082687, "old_weight": 65536, "last_purged_snaps_scrub": "2024-09-16T03:24:37.320822+0000", "dead_epoch": 32 } ], "pg_upmap": [], "pg_upmap_items": [], "pg_upmap_primaries": [], "pg_temp": [], "primary_temp": [], "blocklist": {}, "range_blocklist": {}, "erasure_code_profiles": { "default": { "k": "2", "m": "2", "plugin": "jerasure", "technique": "reed_sol_van" } }, "removed_snaps_queue": [], "new_removed_snaps": [], "new_purged_snaps": [], "crush_node_flags": {}, "device_class_flags": {}, "stretch_mode": { "stretch_mode_enabled": false, "stretch_bucket_count": 0, "degraded_stretch_mode": 0, "recovering_stretch_mode": 0, "stretch_mode_bucket": 0 } }, "osd_metadata": [ { "id": 0, "arch": "x86_64", "back_addr": "[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]", "back_iface": "", "bluefs": "1", "bluefs_dedicated_db": "0", "bluefs_dedicated_wal": "0", "bluefs_single_shared_device": "1", "bluestore_allocation_from_file": "0", "bluestore_bdev_access_mode": "file", "bluestore_bdev_block_size": "4096", "bluestore_bdev_devices": "sda", "bluestore_bdev_driver": "KernelDevice", "bluestore_bdev_optimal_io_size": "0", "bluestore_bdev_path": "td/mon-last-clean-epoch/0/block", "bluestore_bdev_rotational": "1", "bluestore_bdev_size": "107374182400", "bluestore_bdev_support_discard": "0", "bluestore_bdev_type": "hdd", "bluestore_min_alloc_size": "4096", "ceph_release": "squid", "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", "ceph_version_short": "19.3.0-4930-gfc3e0bff", "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", "created_at": "2024-09-16T03:22:53.662571Z", "default_device_class": "hdd", "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", "devices": "sda", "distro": "ubuntu", "distro_description": "Ubuntu 22.04.1 LTS", "distro_version": "22.04", "front_addr": "[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]", "front_iface": "", "hb_back_addr": "[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]", "hb_front_addr": "[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]", "hostname": "smithi096", "journal_rotational": "1", "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", "kernel_version": "5.15.0-121-generic", "mem_swap_kb": "2097148", "mem_total_kb": "32746824", "network_numa_unknown_ifaces": "back_iface,front_iface", "objectstore_numa_unknown_devices": "sda", "os": "Linux", "osd_data": "td/mon-last-clean-epoch/0", "osd_objectstore": "bluestore", "osdspec_affinity": "", "rotational": "1" }, { "id": 1, "arch": "x86_64", "back_addr": "[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]", "back_iface": "", "bluefs": "1", "bluefs_dedicated_db": "0", "bluefs_dedicated_wal": "0", "bluefs_single_shared_device": "1", "bluestore_allocation_from_file": "0", "bluestore_bdev_access_mode": "file", "bluestore_bdev_block_size": "4096", "bluestore_bdev_devices": "sda", "bluestore_bdev_driver": "KernelDevice", "bluestore_bdev_optimal_io_size": "0", "bluestore_bdev_path": "td/mon-last-clean-epoch/1/block", "bluestore_bdev_rotational": "1", "bluestore_bdev_size": "107374182400", "bluestore_bdev_support_discard": "0", "bluestore_bdev_type": "hdd", "bluestore_min_alloc_size": "4096", "ceph_release": "squid", "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", "ceph_version_short": "19.3.0-4930-gfc3e0bff", "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", "created_at": "2024-09-16T03:23:30.129885Z", "default_device_class": "hdd", "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", "devices": "sda", "distro": "ubuntu", "distro_description": "Ubuntu 22.04.1 LTS", "distro_version": "22.04", "front_addr": "[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]", "front_iface": "", "hb_back_addr": "[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]", "hb_front_addr": "[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]", "hostname": "smithi096", "journal_rotational": "1", "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", "kernel_version": "5.15.0-121-generic", "mem_swap_kb": "2097148", "mem_total_kb": "32746824", "network_numa_unknown_ifaces": "back_iface,front_iface", "objectstore_numa_unknown_devices": "sda", "os": "Linux", "osd_data": "td/mon-last-clean-epoch/1", "osd_objectstore": "bluestore", "osdspec_affinity": "", "rotational": "1" }, { "id": 2, "arch": "x86_64", "back_addr": "[v2:127.0.0.1:6820/2576002244,v1:127.0.0.1:6821/2576002244]", "back_iface": "", "bluefs": "1", "bluefs_dedicated_db": "0", "bluefs_dedicated_wal": "0", "bluefs_single_shared_device": "1", "bluestore_allocation_from_file": "0", "bluestore_bdev_access_mode": "file", "bluestore_bdev_block_size": "4096", "bluestore_bdev_devices": "sda", "bluestore_bdev_driver": "KernelDevice", "bluestore_bdev_optimal_io_size": "0", "bluestore_bdev_path": "td/mon-last-clean-epoch/2/block", "bluestore_bdev_rotational": "1", "bluestore_bdev_size": "107374182400", "bluestore_bdev_support_discard": "0", "bluestore_bdev_type": "hdd", "bluestore_min_alloc_size": "4096", "ceph_release": "squid", "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", "ceph_version_short": "19.3.0-4930-gfc3e0bff", "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", "created_at": "2024-09-16T03:24:07.764502Z", "default_device_class": "hdd", "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", "devices": "sda", "distro": "ubuntu", "distro_description": "Ubuntu 22.04.1 LTS", "distro_version": "22.04", "front_addr": "[v2:127.0.0.1:6818/2576002244,v1:127.0.0.1:6819/2576002244]", "front_iface": "", "hb_back_addr": "[v2:127.0.0.1:6824/2576002244,v1:127.0.0.1:6825/2576002244]", "hb_front_addr": "[v2:127.0.0.1:6822/2576002244,v1:127.0.0.1:6823/2576002244]", "hostname": "smithi096", "journal_rotational": "1", "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", "kernel_version": "5.15.0-121-generic", "mem_swap_kb": "2097148", "mem_total_kb": "32746824", "network_numa_unknown_ifaces": "back_iface,front_iface", "objectstore_numa_unknown_devices": "sda", "os": "Linux", "osd_data": "td/mon-last-clean-epoch/2", "osd_objectstore": "bluestore", "osdspec_affinity": "", "rotational": "1" } ], "osdmap_clean_epochs": { "min_last_epoch_clean": 86, "last_epoch_clean": { "per_pool": [ { "poolid": 1, "floor": 86 }, { "poolid": 2, "floor": 86 } ] }, "osd_epochs": [ { "id": 0, "epoch": 86 }, { "id": 1, "epoch": 88 }, { "id": 2, "epoch": 88 } ] }, "osdmap_first_committed": 84, "osdmap_last_committed": 88, "crushmap": { "devices": [ { "id": 0, "name": "osd.0", "class": "hdd" }, { "id": 1, "name": "osd.1", "class": "hdd" }, { "id": 2, "name": "osd.2", "class": "hdd" } ], "types": [ { "type_id": 0, "name": "osd" }, { "type_id": 1, "name": "host" }, { "type_id": 2, "name": "chassis" }, { "type_id": 3, "name": "rack" }, { "type_id": 4, "name": "row" }, { "type_id": 5, "name": "pdu" }, { "type_id": 6, "name": "pod" }, { "type_id": 7, "name": "room" }, { "type_id": 8, "name": "datacenter" }, { "type_id": 9, "name": "zone" }, { "type_id": 10, "name": "region" }, { "type_id": 11, "name": "root" } ], "buckets": [ { "id": -1, "name": "default", "type_id": 11, "type_name": "root", "weight": 19206, "alg": "straw2", "hash": "rjenkins1", "items": [ { "id": -3, "weight": 19206, "pos": 0 } ] }, { "id": -2, "name": "default~hdd", "type_id": 11, "type_name": "root", "weight": 19206, "alg": "straw2", "hash": "rjenkins1", "items": [ { "id": -4, "weight": 19206, "pos": 0 } ] }, { "id": -3, "name": "smithi096", "type_id": 1, "type_name": "host", "weight": 19206, "alg": "straw2", "hash": "rjenkins1", "items": [ { "id": 0, "weight": 6402, "pos": 0 }, { "id": 1, "weight": 6402, "pos": 1 }, { "id": 2, "weight": 6402, "pos": 2 } ] }, { "id": -4, "name": "smithi096~hdd", "type_id": 1, "type_name": "host", "weight": 19206, "alg": "straw2", "hash": "rjenkins1", "items": [ { "id": 0, "weight": 6402, "pos": 0 }, { "id": 1, "weight": 6402, "pos": 1 }, { "id": 2, "weight": 6402, "pos": 2 } ] } ], "rules": [ { "rule_id": 0, "rule_name": "replicated_rule", "type": 1, "steps": [ { "op": "take", "item": -1, "item_name": "default" }, { "op": "choose_firstn", "num": 0, "type": "osd" }, { "op": "emit" } ] } ], "tunables": { "choose_local_tries": 0, "choose_local_fallback_tries": 0, "choose_total_tries": 50, "chooseleaf_descend_once": 1, "chooseleaf_vary_r": 1, "chooseleaf_stable": 1, "msr_descents": 100, "msr_collision_tries": 100, "straw_calc_version": 1, "allowed_bucket_algs": 54, "profile": "jewel", "optimal_tunables": 1, "legacy_tunables": 0, "minimum_required_version": "jewel", "require_feature_tunables": 1, "require_feature_tunables2": 1, "has_v2_rules": 0, "require_feature_tunables3": 1, "has_v3_rules": 0, "has_v4_buckets": 1, "require_feature_tunables5": 1, "has_v5_rules": 0, "has_msr_rules": 0 }, "choose_args": {} }, "fsmap": { "epoch": 1, "btime": "2024-09-16T03:22:46:882186+0000", "default_fscid": -1, "compat": { "compat": {}, "ro_compat": {}, "incompat": { "feature_1": "base v0.20", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes" } }, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "standbys": [], "filesystems": [] }, "mdsmap_first_committed": 1, "mdsmap_last_committed": 1, "auth": { "first_committed": 1, "last_committed": 5, "num_secrets": 3 }, "num_pg": 64, "num_pg_active": 64, "num_pg_unknown": 0, "num_osd": 3, "pool_sum": { "stat_sum": { "num_bytes": 0, "num_objects": 0, "num_object_clones": 0, "num_object_copies": 0, "num_objects_missing_on_primary": 0, "num_objects_missing": 0, "num_objects_degraded": 0, "num_objects_misplaced": 0, "num_objects_unfound": 0, "num_objects_dirty": 0, "num_whiteouts": 0, "num_read": 0, "num_read_kb": 0, "num_write": 0, "num_write_kb": 0, "num_scrub_errors": 0, "num_shallow_scrub_errors": 0, "num_deep_scrub_errors": 0, "num_objects_recovered": 0, "num_bytes_recovered": 0, "num_keys_recovered": 0, "num_objects_omap": 0, "num_objects_hit_set_archive": 0, "num_bytes_hit_set_archive": 0, "num_flush": 0, "num_flush_kb": 0, "num_evict": 0, "num_evict_kb": 0, "num_promote": 0, "num_flush_mode_high": 0, "num_flush_mode_low": 0, "num_evict_mode_some": 0, "num_evict_mode_full": 0, "num_objects_pinned": 0, "num_legacy_snapsets": 0, "num_large_omap_objects": 0, "num_objects_manifest": 0, "num_omap_bytes": 0, "num_omap_keys": 0, "num_objects_repaired": 0 }, "store_stats": { "total": 0, "available": 0, "internally_reserved": 0, "allocated": 0, "data_stored": 0, "data_compressed": 0, "data_compressed_allocated": 0, "data_compressed_original": 0, "omap_allocated": 0, "internal_metadata": 0 }, "log_size": 0, "ondisk_log_size": 0, "up": 128, "acting": 128, "num_store_stats": 0 }, "osd_sum": { "up_from": 0, "seq": 0, "num_pgs": 128, "num_osds": 2, "num_per_pool_osds": 2, "num_per_pool_omap_osds": 2, "kb": 209715200, "kb_used": 54660, "kb_used_data": 888, "kb_used_omap": 3, "kb_used_meta": 53628, "kb_avail": 209660540, "statfs": { "total": 214748364800, "available": 214692392960, "internally_reserved": 0, "allocated": 909312, "data_stored": 340707, "data_compressed": 0, "data_compressed_allocated": 0, "data_compressed_original": 0, "omap_allocated": 3190, "internal_metadata": 54915978 }, "hb_peers": [], "snap_trim_queue_len": 0, "num_snap_trimming": 0, "num_shards_repaired": 0, "op_queue_age_hist": { "histogram": [], "upper_bound": 1 }, "perf_stat": { "commit_latency_ms": 121, "apply_latency_ms": 121, "commit_latency_ns": 121000000, "apply_latency_ns": 121000000 }, "alerts": [], "network_ping_times": [] }, "osd_sum_by_class": { "hdd": { "up_from": 0, "seq": 0, "num_pgs": 128, "num_osds": 2, "num_per_pool_osds": 2, "num_per_pool_omap_osds": 2, "kb": 209715200, "kb_used": 54660, "kb_used_data": 888, "kb_used_omap": 3, "kb_used_meta": 53628, "kb_avail": 209660540, "statfs": { "total": 214748364800, "available": 214692392960, "internally_reserved": 0, "allocated": 909312, "data_stored": 340707, "data_compressed": 0, "data_compressed_allocated": 0, "data_compressed_original": 0, "omap_allocated": 3190, "internal_metadata": 54915978 }, "hb_peers": [], "snap_trim_queue_len": 0, "num_snap_trimming": 0, "num_shards_repaired": 0, "op_queue_age_hist": { "histogram": [], "upper_bound": 1 }, "perf_stat": { "commit_latency_ms": 121, "apply_latency_ms": 121, "commit_latency_ns": 121000000, "apply_latency_ns": 121000000 }, "alerts": [], "network_ping_times": [] } }, "pool_stats": [ { "poolid": 2, "num_pg": 32, "stat_sum": { "num_bytes": 0, "num_objects": 0, "num_object_clones": 0, "num_object_copies": 0, "num_objects_missing_on_primary": 0, "num_objects_missing": 0, "num_objects_degraded": 0, "num_objects_misplaced": 0, "num_objects_unfound": 0, "num_objects_dirty": 0, "num_whiteouts": 0, "num_read": 0, "num_read_kb": 0, "num_write": 0, "num_write_kb": 0, "num_scrub_errors": 0, "num_shallow_scrub_errors": 0, "num_deep_scrub_errors": 0, "num_objects_recovered": 0, "num_bytes_recovered": 0, "num_keys_recovered": 0, "num_objects_omap": 0, "num_objects_hit_set_archive": 0, "num_bytes_hit_set_archive": 0, "num_flush": 0, "num_flush_kb": 0, "num_evict": 0, "num_evict_kb": 0, "num_promote": 0, "num_flush_mode_high": 0, "num_flush_mode_low": 0, "num_evict_mode_some": 0, "num_evict_mode_full": 0, "num_objects_pinned": 0, "num_legacy_snapsets": 0, "num_large_omap_objects": 0, "num_objects_manifest": 0, "num_omap_bytes": 0, "num_omap_keys": 0, "num_objects_repaired": 0 }, "store_stats": { "total": 0, "available": 0, "internally_reserved": 0, "allocated": 0, "data_stored": 0, "data_compressed": 0, "data_compressed_allocated": 0, "data_compressed_original": 0, "omap_allocated": 0, "internal_metadata": 0 }, "log_size": 0, "ondisk_log_size": 0, "up": 64, "acting": 64, "num_store_stats": 3 }, { "poolid": 1, "num_pg": 32, "stat_sum": { "num_bytes": 0, "num_objects": 0, "num_object_clones": 0, "num_object_copies": 0, "num_objects_missing_on_primary": 0, "num_objects_missing": 0, "num_objects_degraded": 0, "num_objects_misplaced": 0, "num_objects_unfound": 0, "num_objects_dirty": 0, "num_whiteouts": 0, "num_read": 0, "num_read_kb": 0, "num_write": 0, "num_write_kb": 0, "num_scrub_errors": 0, "num_shallow_scrub_errors": 0, "num_deep_scrub_errors": 0, "num_objects_recovered": 0, "num_bytes_recovered": 0, "num_keys_recovered": 0, "num_objects_omap": 0, "num_objects_hit_set_archive": 0, "num_bytes_hit_set_archive": 0, "num_flush": 0, "num_flush_kb": 0, "num_evict": 0, "num_evict_kb": 0, "num_promote": 0, "num_flush_mode_high": 0, "num_flush_mode_low": 0, "num_evict_mode_some": 0, "num_evict_mode_full": 0, "num_objects_pinned": 0, "num_legacy_snapsets": 0, "num_large_omap_objects": 0, "num_objects_manifest": 0, "num_omap_bytes": 0, "num_omap_keys": 0, "num_objects_repaired": 0 }, "store_stats": { "total": 0, "available": 0, "internally_reserved": 0, "allocated": 0, "data_stored": 0, "data_compressed": 0, "data_compressed_allocated": 0, "data_compressed_original": 0, "omap_allocated": 0, "internal_metadata": 0 }, "log_size": 0, "ondisk_log_size": 0, "up": 64, "acting": 64, "num_store_stats": 3 } ], "osd_stats": [ { "osd": 0, "seq": 21474836523 }, { "osd": 1, "seq": 42949672995 }, { "osd": 2, "seq": 1 } ], "num_pg_by_state": [ { "state": "active+clean", "num": 64 } ], "num_pg_by_osd": [ { "osd": 2, "num_primary_pg": 0, "num_acting_pg": 0, "num_up_not_acting_pg": 0 }, { "osd": 0, "num_primary_pg": 28, "num_acting_pg": 64, "num_up_not_acting_pg": 0 }, { "osd": 1, "num_primary_pg": 36, "num_acting_pg": 64, "num_up_not_acting_pg": 0 } ], "purged_snaps": [ { "pool": 1, "purged_snaps": {} }, { "pool": 2, "purged_snaps": {} } ], "servicemap": { "epoch": 5, "modified": "2024-09-16T03:25:38.422788+0000", "services": {} }, "mgrstat_first_committed": 87, "mgrstat_last_committed": 94, "logm_first_committed": 1, "logm_last_committed": 428, "paxos": { "first_committed": 1, "last_committed": 628, "last_pn": 0, "accepted_pn": 0 } } 2024-09-16T03:26:18.139 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:125: validate_fc: return 1 2024-09-16T03:26:18.139 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:126: validate_fc: return 0 2024-09-16T03:26:18.139 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:296: TEST_mon_last_clean_epoch: check_lec_equals_pools 2024-09-16T03:26:18.139 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:26: check_lec_equals_pools: local pool_id= 2024-09-16T03:26:18.139 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:28: check_lec_equals_pools: ceph report 2024-09-16T03:26:18.748 INFO:tasks.workunit.client.0.smithi096.stderr:report 180574758 2024-09-16T03:26:18.767 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:28: check_lec_equals_pools: report='{ 2024-09-16T03:26:18.767 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_fingerprint": "fda2fc64-07ed-4add-8224-2e527e11d427", 2024-09-16T03:26:18.767 INFO:tasks.workunit.client.0.smithi096.stderr: "version": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:26:18.767 INFO:tasks.workunit.client.0.smithi096.stderr: "commit": "fc3e0bff7468fd55478adbae7f75508b749124b6", 2024-09-16T03:26:18.767 INFO:tasks.workunit.client.0.smithi096.stderr: "timestamp": "2024-09-16T03:26:18.748590+0000", 2024-09-16T03:26:18.768 INFO:tasks.workunit.client.0.smithi096.stderr: "tag": "", 2024-09-16T03:26:18.768 INFO:tasks.workunit.client.0.smithi096.stderr: "health": { 2024-09-16T03:26:18.768 INFO:tasks.workunit.client.0.smithi096.stderr: "status": "HEALTH_OK", 2024-09-16T03:26:18.768 INFO:tasks.workunit.client.0.smithi096.stderr: "checks": {}, 2024-09-16T03:26:18.768 INFO:tasks.workunit.client.0.smithi096.stderr: "mutes": [] 2024-09-16T03:26:18.768 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.768 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap_first_committed": 1, 2024-09-16T03:26:18.768 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap_last_committed": 1, 2024-09-16T03:26:18.768 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap": { 2024-09-16T03:26:18.768 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 1, 2024-09-16T03:26:18.768 INFO:tasks.workunit.client.0.smithi096.stderr: "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", 2024-09-16T03:26:18.768 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:22:45.872880Z", 2024-09-16T03:26:18.768 INFO:tasks.workunit.client.0.smithi096.stderr: "created": "2024-09-16T03:22:45.872880Z", 2024-09-16T03:26:18.769 INFO:tasks.workunit.client.0.smithi096.stderr: "min_mon_release": 19, 2024-09-16T03:26:18.769 INFO:tasks.workunit.client.0.smithi096.stderr: "min_mon_release_name": "squid", 2024-09-16T03:26:18.769 INFO:tasks.workunit.client.0.smithi096.stderr: "election_strategy": 1, 2024-09-16T03:26:18.769 INFO:tasks.workunit.client.0.smithi096.stderr: "disallowed_leaders: ": "", 2024-09-16T03:26:18.769 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode": false, 2024-09-16T03:26:18.769 INFO:tasks.workunit.client.0.smithi096.stderr: "tiebreaker_mon": "", 2024-09-16T03:26:18.769 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_ranks: ": "", 2024-09-16T03:26:18.769 INFO:tasks.workunit.client.0.smithi096.stderr: "features": { 2024-09-16T03:26:18.769 INFO:tasks.workunit.client.0.smithi096.stderr: "persistent": [ 2024-09-16T03:26:18.769 INFO:tasks.workunit.client.0.smithi096.stderr: "kraken", 2024-09-16T03:26:18.769 INFO:tasks.workunit.client.0.smithi096.stderr: "luminous", 2024-09-16T03:26:18.769 INFO:tasks.workunit.client.0.smithi096.stderr: "mimic", 2024-09-16T03:26:18.769 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap-prune", 2024-09-16T03:26:18.769 INFO:tasks.workunit.client.0.smithi096.stderr: "nautilus", 2024-09-16T03:26:18.770 INFO:tasks.workunit.client.0.smithi096.stderr: "octopus", 2024-09-16T03:26:18.770 INFO:tasks.workunit.client.0.smithi096.stderr: "pacific", 2024-09-16T03:26:18.770 INFO:tasks.workunit.client.0.smithi096.stderr: "elector-pinging", 2024-09-16T03:26:18.770 INFO:tasks.workunit.client.0.smithi096.stderr: "quincy", 2024-09-16T03:26:18.770 INFO:tasks.workunit.client.0.smithi096.stderr: "reef", 2024-09-16T03:26:18.770 INFO:tasks.workunit.client.0.smithi096.stderr: "squid" 2024-09-16T03:26:18.770 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:18.770 INFO:tasks.workunit.client.0.smithi096.stderr: "optional": [] 2024-09-16T03:26:18.770 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.770 INFO:tasks.workunit.client.0.smithi096.stderr: "mons": [ 2024-09-16T03:26:18.770 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.770 INFO:tasks.workunit.client.0.smithi096.stderr: "rank": 0, 2024-09-16T03:26:18.770 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "a", 2024-09-16T03:26:18.771 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:26:18.771 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:18.771 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.771 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:18.771 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:7302", 2024-09-16T03:26:18.771 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 0 2024-09-16T03:26:18.771 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:18.771 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:18.771 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.771 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:7302/0", 2024-09-16T03:26:18.771 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:7302/0", 2024-09-16T03:26:18.771 INFO:tasks.workunit.client.0.smithi096.stderr: "priority": 0, 2024-09-16T03:26:18.771 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 0, 2024-09-16T03:26:18.771 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_location": "{}" 2024-09-16T03:26:18.772 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:18.772 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:18.772 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.772 INFO:tasks.workunit.client.0.smithi096.stderr: "quorum": [ 2024-09-16T03:26:18.772 INFO:tasks.workunit.client.0.smithi096.stderr: 0 2024-09-16T03:26:18.772 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:18.772 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap": { 2024-09-16T03:26:18.772 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 88, 2024-09-16T03:26:18.772 INFO:tasks.workunit.client.0.smithi096.stderr: "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", 2024-09-16T03:26:18.772 INFO:tasks.workunit.client.0.smithi096.stderr: "created": "2024-09-16T03:22:46.906117+0000", 2024-09-16T03:26:18.773 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:26:15.120212+0000", 2024-09-16T03:26:18.773 INFO:tasks.workunit.client.0.smithi096.stderr: "last_up_change": "2024-09-16T03:26:15.120212+0000", 2024-09-16T03:26:18.773 INFO:tasks.workunit.client.0.smithi096.stderr: "last_in_change": "2024-09-16T03:25:09.839444+0000", 2024-09-16T03:26:18.773 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-16T03:26:18.773 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_num": 5799936, 2024-09-16T03:26:18.773 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_set": [ 2024-09-16T03:26:18.773 INFO:tasks.workunit.client.0.smithi096.stderr: "pglog_hardlimit", 2024-09-16T03:26:18.773 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snapdirs", 2024-09-16T03:26:18.773 INFO:tasks.workunit.client.0.smithi096.stderr: "recovery_deletes", 2024-09-16T03:26:18.773 INFO:tasks.workunit.client.0.smithi096.stderr: "sortbitwise" 2024-09-16T03:26:18.774 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:18.774 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_version": 8, 2024-09-16T03:26:18.774 INFO:tasks.workunit.client.0.smithi096.stderr: "full_ratio": 0.97000002861022949, 2024-09-16T03:26:18.774 INFO:tasks.workunit.client.0.smithi096.stderr: "backfillfull_ratio": 0.97000002861022949, 2024-09-16T03:26:18.774 INFO:tasks.workunit.client.0.smithi096.stderr: "nearfull_ratio": 0.85000002384185791, 2024-09-16T03:26:18.774 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_snapshot": "", 2024-09-16T03:26:18.774 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_max": 2, 2024-09-16T03:26:18.774 INFO:tasks.workunit.client.0.smithi096.stderr: "max_osd": 3, 2024-09-16T03:26:18.774 INFO:tasks.workunit.client.0.smithi096.stderr: "require_min_compat_client": "luminous", 2024-09-16T03:26:18.774 INFO:tasks.workunit.client.0.smithi096.stderr: "min_compat_client": "jewel", 2024-09-16T03:26:18.775 INFO:tasks.workunit.client.0.smithi096.stderr: "require_osd_release": "squid", 2024-09-16T03:26:18.775 INFO:tasks.workunit.client.0.smithi096.stderr: "allow_crimson": false, 2024-09-16T03:26:18.775 INFO:tasks.workunit.client.0.smithi096.stderr: "pools": [ 2024-09-16T03:26:18.775 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.775 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 1, 2024-09-16T03:26:18.775 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_name": "foo", 2024-09-16T03:26:18.775 INFO:tasks.workunit.client.0.smithi096.stderr: "create_time": "2024-09-16T03:24:44.525189+0000", 2024-09-16T03:26:18.775 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": 1, 2024-09-16T03:26:18.775 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_names": "hashpspool", 2024-09-16T03:26:18.775 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:26:18.775 INFO:tasks.workunit.client.0.smithi096.stderr: "size": 2, 2024-09-16T03:26:18.775 INFO:tasks.workunit.client.0.smithi096.stderr: "min_size": 1, 2024-09-16T03:26:18.775 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_rule": 0, 2024-09-16T03:26:18.775 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_count": 0, 2024-09-16T03:26:18.776 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_target": 0, 2024-09-16T03:26:18.776 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_barrier": 0, 2024-09-16T03:26:18.776 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-16T03:26:18.776 INFO:tasks.workunit.client.0.smithi096.stderr: "is_stretch_pool": false, 2024-09-16T03:26:18.776 INFO:tasks.workunit.client.0.smithi096.stderr: "object_hash": 2, 2024-09-16T03:26:18.776 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_autoscale_mode": "off", 2024-09-16T03:26:18.776 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num": 32, 2024-09-16T03:26:18.776 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num": 32, 2024-09-16T03:26:18.776 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num_target": 32, 2024-09-16T03:26:18.776 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_target": 32, 2024-09-16T03:26:18.776 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_pending": 32, 2024-09-16T03:26:18.776 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pg_merge_meta": { 2024-09-16T03:26:18.776 INFO:tasks.workunit.client.0.smithi096.stderr: "source_pgid": "0.0", 2024-09-16T03:26:18.777 INFO:tasks.workunit.client.0.smithi096.stderr: "ready_epoch": 0, 2024-09-16T03:26:18.777 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_started": 0, 2024-09-16T03:26:18.777 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": 0, 2024-09-16T03:26:18.777 INFO:tasks.workunit.client.0.smithi096.stderr: "source_version": "0'\''0", 2024-09-16T03:26:18.777 INFO:tasks.workunit.client.0.smithi096.stderr: "target_version": "0'\''0" 2024-09-16T03:26:18.777 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.777 INFO:tasks.workunit.client.0.smithi096.stderr: "last_change": "85", 2024-09-16T03:26:18.778 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend": "0", 2024-09-16T03:26:18.778 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_prenautilus": "0", 2024-09-16T03:26:18.778 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_preluminous": "0", 2024-09-16T03:26:18.778 INFO:tasks.workunit.client.0.smithi096.stderr: "auid": 0, 2024-09-16T03:26:18.778 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_mode": "selfmanaged", 2024-09-16T03:26:18.778 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_seq": 0, 2024-09-16T03:26:18.778 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_epoch": 0, 2024-09-16T03:26:18.778 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_snaps": [], 2024-09-16T03:26:18.778 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps": "[]", 2024-09-16T03:26:18.778 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_bytes": 0, 2024-09-16T03:26:18.778 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_objects": 0, 2024-09-16T03:26:18.778 INFO:tasks.workunit.client.0.smithi096.stderr: "tiers": [], 2024-09-16T03:26:18.779 INFO:tasks.workunit.client.0.smithi096.stderr: "tier_of": -1, 2024-09-16T03:26:18.779 INFO:tasks.workunit.client.0.smithi096.stderr: "read_tier": -1, 2024-09-16T03:26:18.779 INFO:tasks.workunit.client.0.smithi096.stderr: "write_tier": -1, 2024-09-16T03:26:18.779 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_mode": "none", 2024-09-16T03:26:18.779 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_bytes": 0, 2024-09-16T03:26:18.779 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_objects": 0, 2024-09-16T03:26:18.779 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_ratio_micro": 400000, 2024-09-16T03:26:18.779 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-16T03:26:18.779 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_full_ratio_micro": 800000, 2024-09-16T03:26:18.779 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_flush_age": 0, 2024-09-16T03:26:18.780 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_evict_age": 0, 2024-09-16T03:26:18.780 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profile": "", 2024-09-16T03:26:18.780 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_params": { 2024-09-16T03:26:18.780 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "none" 2024-09-16T03:26:18.780 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.780 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_period": 0, 2024-09-16T03:26:18.780 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_count": 0, 2024-09-16T03:26:18.780 INFO:tasks.workunit.client.0.smithi096.stderr: "use_gmt_hitset": true, 2024-09-16T03:26:18.780 INFO:tasks.workunit.client.0.smithi096.stderr: "min_read_recency_for_promote": 0, 2024-09-16T03:26:18.780 INFO:tasks.workunit.client.0.smithi096.stderr: "min_write_recency_for_promote": 0, 2024-09-16T03:26:18.780 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_grade_decay_rate": 0, 2024-09-16T03:26:18.780 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_search_last_n": 0, 2024-09-16T03:26:18.780 INFO:tasks.workunit.client.0.smithi096.stderr: "grade_table": [], 2024-09-16T03:26:18.780 INFO:tasks.workunit.client.0.smithi096.stderr: "stripe_width": 0, 2024-09-16T03:26:18.781 INFO:tasks.workunit.client.0.smithi096.stderr: "expected_num_objects": 0, 2024-09-16T03:26:18.781 INFO:tasks.workunit.client.0.smithi096.stderr: "fast_read": false, 2024-09-16T03:26:18.781 INFO:tasks.workunit.client.0.smithi096.stderr: "options": {}, 2024-09-16T03:26:18.781 INFO:tasks.workunit.client.0.smithi096.stderr: "application_metadata": {}, 2024-09-16T03:26:18.781 INFO:tasks.workunit.client.0.smithi096.stderr: "read_balance": { 2024-09-16T03:26:18.781 INFO:tasks.workunit.client.0.smithi096.stderr: "score_type": "Fair distribution", 2024-09-16T03:26:18.781 INFO:tasks.workunit.client.0.smithi096.stderr: "score_acting": 1.8700000047683716, 2024-09-16T03:26:18.781 INFO:tasks.workunit.client.0.smithi096.stderr: "score_stable": 1.8700000047683716, 2024-09-16T03:26:18.781 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_score": 0.67000001668930054, 2024-09-16T03:26:18.781 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_acting": 1.25, 2024-09-16T03:26:18.781 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_stable": 1.25, 2024-09-16T03:26:18.781 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity_weighted": 1, 2024-09-16T03:26:18.781 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity": 1, 2024-09-16T03:26:18.782 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity_weighted": 1 2024-09-16T03:26:18.782 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:18.782 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.782 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.782 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 2, 2024-09-16T03:26:18.782 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_name": "bar", 2024-09-16T03:26:18.782 INFO:tasks.workunit.client.0.smithi096.stderr: "create_time": "2024-09-16T03:24:46.226575+0000", 2024-09-16T03:26:18.782 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": 1, 2024-09-16T03:26:18.782 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_names": "hashpspool", 2024-09-16T03:26:18.782 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:26:18.782 INFO:tasks.workunit.client.0.smithi096.stderr: "size": 2, 2024-09-16T03:26:18.782 INFO:tasks.workunit.client.0.smithi096.stderr: "min_size": 1, 2024-09-16T03:26:18.782 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_rule": 0, 2024-09-16T03:26:18.782 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_count": 0, 2024-09-16T03:26:18.783 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_target": 0, 2024-09-16T03:26:18.783 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_barrier": 0, 2024-09-16T03:26:18.783 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-16T03:26:18.783 INFO:tasks.workunit.client.0.smithi096.stderr: "is_stretch_pool": false, 2024-09-16T03:26:18.783 INFO:tasks.workunit.client.0.smithi096.stderr: "object_hash": 2, 2024-09-16T03:26:18.783 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_autoscale_mode": "off", 2024-09-16T03:26:18.783 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num": 32, 2024-09-16T03:26:18.783 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num": 32, 2024-09-16T03:26:18.783 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num_target": 32, 2024-09-16T03:26:18.783 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_target": 32, 2024-09-16T03:26:18.783 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_pending": 32, 2024-09-16T03:26:18.783 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pg_merge_meta": { 2024-09-16T03:26:18.783 INFO:tasks.workunit.client.0.smithi096.stderr: "source_pgid": "0.0", 2024-09-16T03:26:18.784 INFO:tasks.workunit.client.0.smithi096.stderr: "ready_epoch": 0, 2024-09-16T03:26:18.784 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_started": 0, 2024-09-16T03:26:18.784 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": 0, 2024-09-16T03:26:18.784 INFO:tasks.workunit.client.0.smithi096.stderr: "source_version": "0'\''0", 2024-09-16T03:26:18.784 INFO:tasks.workunit.client.0.smithi096.stderr: "target_version": "0'\''0" 2024-09-16T03:26:18.784 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.784 INFO:tasks.workunit.client.0.smithi096.stderr: "last_change": "83", 2024-09-16T03:26:18.784 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend": "0", 2024-09-16T03:26:18.784 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_prenautilus": "0", 2024-09-16T03:26:18.784 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_preluminous": "0", 2024-09-16T03:26:18.784 INFO:tasks.workunit.client.0.smithi096.stderr: "auid": 0, 2024-09-16T03:26:18.784 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_mode": "selfmanaged", 2024-09-16T03:26:18.784 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_seq": 0, 2024-09-16T03:26:18.785 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_epoch": 0, 2024-09-16T03:26:18.785 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_snaps": [], 2024-09-16T03:26:18.785 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps": "[]", 2024-09-16T03:26:18.785 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_bytes": 0, 2024-09-16T03:26:18.785 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_objects": 0, 2024-09-16T03:26:18.785 INFO:tasks.workunit.client.0.smithi096.stderr: "tiers": [], 2024-09-16T03:26:18.785 INFO:tasks.workunit.client.0.smithi096.stderr: "tier_of": -1, 2024-09-16T03:26:18.785 INFO:tasks.workunit.client.0.smithi096.stderr: "read_tier": -1, 2024-09-16T03:26:18.785 INFO:tasks.workunit.client.0.smithi096.stderr: "write_tier": -1, 2024-09-16T03:26:18.785 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_mode": "none", 2024-09-16T03:26:18.786 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_bytes": 0, 2024-09-16T03:26:18.786 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_objects": 0, 2024-09-16T03:26:18.786 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_ratio_micro": 400000, 2024-09-16T03:26:18.786 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-16T03:26:18.786 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_full_ratio_micro": 800000, 2024-09-16T03:26:18.786 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_flush_age": 0, 2024-09-16T03:26:18.786 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_evict_age": 0, 2024-09-16T03:26:18.786 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profile": "", 2024-09-16T03:26:18.786 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_params": { 2024-09-16T03:26:18.786 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "none" 2024-09-16T03:26:18.786 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.786 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_period": 0, 2024-09-16T03:26:18.786 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_count": 0, 2024-09-16T03:26:18.787 INFO:tasks.workunit.client.0.smithi096.stderr: "use_gmt_hitset": true, 2024-09-16T03:26:18.787 INFO:tasks.workunit.client.0.smithi096.stderr: "min_read_recency_for_promote": 0, 2024-09-16T03:26:18.787 INFO:tasks.workunit.client.0.smithi096.stderr: "min_write_recency_for_promote": 0, 2024-09-16T03:26:18.787 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_grade_decay_rate": 0, 2024-09-16T03:26:18.787 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_search_last_n": 0, 2024-09-16T03:26:18.787 INFO:tasks.workunit.client.0.smithi096.stderr: "grade_table": [], 2024-09-16T03:26:18.787 INFO:tasks.workunit.client.0.smithi096.stderr: "stripe_width": 0, 2024-09-16T03:26:18.787 INFO:tasks.workunit.client.0.smithi096.stderr: "expected_num_objects": 0, 2024-09-16T03:26:18.787 INFO:tasks.workunit.client.0.smithi096.stderr: "fast_read": false, 2024-09-16T03:26:18.787 INFO:tasks.workunit.client.0.smithi096.stderr: "options": {}, 2024-09-16T03:26:18.787 INFO:tasks.workunit.client.0.smithi096.stderr: "application_metadata": {}, 2024-09-16T03:26:18.787 INFO:tasks.workunit.client.0.smithi096.stderr: "read_balance": { 2024-09-16T03:26:18.787 INFO:tasks.workunit.client.0.smithi096.stderr: "score_type": "Fair distribution", 2024-09-16T03:26:18.788 INFO:tasks.workunit.client.0.smithi096.stderr: "score_acting": 1.4900000095367432, 2024-09-16T03:26:18.788 INFO:tasks.workunit.client.0.smithi096.stderr: "score_stable": 1.4900000095367432, 2024-09-16T03:26:18.788 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_score": 0.67000001668930054, 2024-09-16T03:26:18.788 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_acting": 1, 2024-09-16T03:26:18.788 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_stable": 1, 2024-09-16T03:26:18.788 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity_weighted": 1, 2024-09-16T03:26:18.788 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity": 1, 2024-09-16T03:26:18.788 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity_weighted": 1 2024-09-16T03:26:18.788 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:18.788 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:18.788 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:18.788 INFO:tasks.workunit.client.0.smithi096.stderr: "osds": [ 2024-09-16T03:26:18.788 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.788 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:26:18.789 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6", 2024-09-16T03:26:18.789 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:26:18.789 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:26:18.789 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:26:18.789 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:26:18.789 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:26:18.789 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:26:18.789 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 5, 2024-09-16T03:26:18.789 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 84, 2024-09-16T03:26:18.789 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:26:18.789 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:26:18.789 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:26:18.789 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:18.790 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.790 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:18.790 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6802", 2024-09-16T03:26:18.790 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:26:18.790 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.790 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.790 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:18.790 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6803", 2024-09-16T03:26:18.790 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:26:18.790 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:18.790 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:18.790 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.790 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:26:18.790 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:18.791 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.791 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:18.791 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6804", 2024-09-16T03:26:18.791 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:26:18.791 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.791 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.791 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:18.791 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6805", 2024-09-16T03:26:18.791 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:26:18.791 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:18.791 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:18.791 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.791 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:26:18.792 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:18.792 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.792 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:18.792 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6808", 2024-09-16T03:26:18.792 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:26:18.792 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.792 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.792 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:18.792 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6809", 2024-09-16T03:26:18.792 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:26:18.792 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:18.792 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:18.792 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.792 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:26:18.793 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:18.793 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.793 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:18.793 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6806", 2024-09-16T03:26:18.793 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:26:18.793 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.793 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.793 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:18.793 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6807", 2024-09-16T03:26:18.793 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:26:18.793 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:18.793 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:18.793 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.793 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6803/3375787448", 2024-09-16T03:26:18.794 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6805/3375787448", 2024-09-16T03:26:18.794 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6809/3375787448", 2024-09-16T03:26:18.794 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6807/3375787448", 2024-09-16T03:26:18.794 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:26:18.794 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:26:18.794 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:26:18.794 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:18.794 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.794 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.794 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:26:18.794 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "74b26727-75c9-444d-8782-719e4197a382", 2024-09-16T03:26:18.794 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:26:18.794 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:26:18.795 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:26:18.795 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:26:18.795 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:26:18.795 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:26:18.795 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 10, 2024-09-16T03:26:18.795 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 84, 2024-09-16T03:26:18.795 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:26:18.795 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:26:18.795 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:26:18.795 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:18.795 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.795 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:18.795 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6810", 2024-09-16T03:26:18.795 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:26:18.796 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.796 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.796 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:18.796 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6811", 2024-09-16T03:26:18.796 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:26:18.796 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:18.796 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:18.796 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.796 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:26:18.796 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:18.796 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.796 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:18.796 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6812", 2024-09-16T03:26:18.797 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:26:18.797 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.797 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.797 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:18.797 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6813", 2024-09-16T03:26:18.797 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:26:18.797 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:18.797 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:18.797 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.797 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:26:18.797 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:18.797 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.797 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:18.797 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6816", 2024-09-16T03:26:18.798 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:26:18.798 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.798 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.798 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:18.798 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6817", 2024-09-16T03:26:18.798 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:26:18.798 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:18.798 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:18.798 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.798 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:26:18.798 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:18.798 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.798 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:18.798 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6814", 2024-09-16T03:26:18.799 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:26:18.799 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.799 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.799 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:18.799 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6815", 2024-09-16T03:26:18.799 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:26:18.799 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:18.799 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:18.799 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.799 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6811/3733255132", 2024-09-16T03:26:18.799 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6813/3733255132", 2024-09-16T03:26:18.799 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6817/3733255132", 2024-09-16T03:26:18.799 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6815/3733255132", 2024-09-16T03:26:18.799 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:26:18.800 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:26:18.800 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:26:18.800 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:18.800 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.800 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.800 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:26:18.800 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "143da3a7-dad9-4b1e-966b-76cf5bdd3c82", 2024-09-16T03:26:18.800 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:26:18.800 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 0, 2024-09-16T03:26:18.800 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 0, 2024-09-16T03:26:18.800 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:26:18.800 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 15, 2024-09-16T03:26:18.800 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 32, 2024-09-16T03:26:18.801 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 88, 2024-09-16T03:26:18.801 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 21, 2024-09-16T03:26:18.801 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 33, 2024-09-16T03:26:18.801 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:26:18.801 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:26:18.801 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:18.801 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.801 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:18.802 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6818", 2024-09-16T03:26:18.802 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 2576002244 2024-09-16T03:26:18.802 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.802 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.802 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:18.802 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6819", 2024-09-16T03:26:18.802 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 2576002244 2024-09-16T03:26:18.802 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:18.802 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:18.802 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.802 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:26:18.803 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:18.803 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.803 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:18.803 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6820", 2024-09-16T03:26:18.803 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 2576002244 2024-09-16T03:26:18.803 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.803 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.803 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:18.803 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6821", 2024-09-16T03:26:18.803 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 2576002244 2024-09-16T03:26:18.803 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:18.803 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:18.803 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.803 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:26:18.804 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:18.804 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.804 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:18.804 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6824", 2024-09-16T03:26:18.804 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 2576002244 2024-09-16T03:26:18.804 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.804 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.804 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:18.804 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6825", 2024-09-16T03:26:18.804 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 2576002244 2024-09-16T03:26:18.804 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:18.804 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:18.804 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.805 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:26:18.805 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:18.805 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.805 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:18.805 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6822", 2024-09-16T03:26:18.805 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 2576002244 2024-09-16T03:26:18.805 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.805 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.805 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:18.805 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6823", 2024-09-16T03:26:18.805 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 2576002244 2024-09-16T03:26:18.805 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:18.805 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:18.805 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.806 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6819/2576002244", 2024-09-16T03:26:18.806 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6821/2576002244", 2024-09-16T03:26:18.806 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6825/2576002244", 2024-09-16T03:26:18.806 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6823/2576002244", 2024-09-16T03:26:18.806 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:26:18.806 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:26:18.806 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:26:18.806 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:18.806 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:18.806 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:18.807 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_xinfo": [ 2024-09-16T03:26:18.807 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.807 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:26:18.807 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:26:18.807 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:26:18.807 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:26:18.807 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:26:18.807 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:26:18.807 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:23:22.481942+0000", 2024-09-16T03:26:18.807 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:26:18.807 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.807 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.807 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:26:18.807 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:26:18.808 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:26:18.808 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:26:18.808 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:26:18.808 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:26:18.808 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:23:59.663703+0000", 2024-09-16T03:26:18.808 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:26:18.808 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.808 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.808 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:26:18.808 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:26:18.808 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:26:18.808 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:26:18.808 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:26:18.809 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 65536, 2024-09-16T03:26:18.809 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:24:37.320822+0000", 2024-09-16T03:26:18.809 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 32 2024-09-16T03:26:18.809 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:18.809 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:18.809 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap": [], 2024-09-16T03:26:18.809 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap_items": [], 2024-09-16T03:26:18.809 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap_primaries": [], 2024-09-16T03:26:18.809 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_temp": [], 2024-09-16T03:26:18.809 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_temp": [], 2024-09-16T03:26:18.809 INFO:tasks.workunit.client.0.smithi096.stderr: "blocklist": {}, 2024-09-16T03:26:18.809 INFO:tasks.workunit.client.0.smithi096.stderr: "range_blocklist": {}, 2024-09-16T03:26:18.809 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profiles": { 2024-09-16T03:26:18.809 INFO:tasks.workunit.client.0.smithi096.stderr: "default": { 2024-09-16T03:26:18.810 INFO:tasks.workunit.client.0.smithi096.stderr: "k": "2", 2024-09-16T03:26:18.810 INFO:tasks.workunit.client.0.smithi096.stderr: "m": "2", 2024-09-16T03:26:18.810 INFO:tasks.workunit.client.0.smithi096.stderr: "plugin": "jerasure", 2024-09-16T03:26:18.810 INFO:tasks.workunit.client.0.smithi096.stderr: "technique": "reed_sol_van" 2024-09-16T03:26:18.810 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:18.810 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.810 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps_queue": [], 2024-09-16T03:26:18.810 INFO:tasks.workunit.client.0.smithi096.stderr: "new_removed_snaps": [], 2024-09-16T03:26:18.810 INFO:tasks.workunit.client.0.smithi096.stderr: "new_purged_snaps": [], 2024-09-16T03:26:18.810 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_node_flags": {}, 2024-09-16T03:26:18.810 INFO:tasks.workunit.client.0.smithi096.stderr: "device_class_flags": {}, 2024-09-16T03:26:18.810 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode": { 2024-09-16T03:26:18.810 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode_enabled": false, 2024-09-16T03:26:18.811 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_bucket_count": 0, 2024-09-16T03:26:18.811 INFO:tasks.workunit.client.0.smithi096.stderr: "degraded_stretch_mode": 0, 2024-09-16T03:26:18.811 INFO:tasks.workunit.client.0.smithi096.stderr: "recovering_stretch_mode": 0, 2024-09-16T03:26:18.811 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode_bucket": 0 2024-09-16T03:26:18.811 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:18.811 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.811 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_metadata": [ 2024-09-16T03:26:18.811 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.811 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:26:18.811 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:26:18.811 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]", 2024-09-16T03:26:18.812 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:26:18.812 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:26:18.812 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:26:18.812 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:26:18.812 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:26:18.812 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:26:18.812 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:26:18.812 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:26:18.812 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:26:18.813 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:26:18.813 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:26:18.813 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/0/block", 2024-09-16T03:26:18.813 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:26:18.813 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:26:18.813 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:26:18.813 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:26:18.813 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:26:18.813 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:26:18.813 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:26:18.813 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:26:18.813 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:26:18.814 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:26:18.814 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:22:53.662571Z", 2024-09-16T03:26:18.814 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:26:18.814 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:26:18.814 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:26:18.814 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:26:18.814 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:26:18.814 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:26:18.814 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:26:18.814 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]", 2024-09-16T03:26:18.814 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:26:18.814 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]", 2024-09-16T03:26:18.815 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]", 2024-09-16T03:26:18.815 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:26:18.815 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:26:18.815 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:26:18.815 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:26:18.815 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:26:18.815 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:26:18.815 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:26:18.815 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:26:18.815 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:26:18.815 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/0", 2024-09-16T03:26:18.815 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:26:18.815 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:26:18.815 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:26:18.816 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.816 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.816 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:26:18.816 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:26:18.816 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]", 2024-09-16T03:26:18.816 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:26:18.816 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:26:18.816 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:26:18.816 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:26:18.816 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:26:18.816 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:26:18.816 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:26:18.816 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:26:18.817 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:26:18.817 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:26:18.817 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:26:18.817 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/1/block", 2024-09-16T03:26:18.817 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:26:18.817 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:26:18.817 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:26:18.817 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:26:18.817 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:26:18.817 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:26:18.817 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:26:18.817 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:26:18.818 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:26:18.818 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:26:18.818 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:23:30.129885Z", 2024-09-16T03:26:18.818 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:26:18.818 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:26:18.818 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:26:18.818 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:26:18.818 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:26:18.818 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:26:18.818 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:26:18.818 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]", 2024-09-16T03:26:18.818 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:26:18.818 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]", 2024-09-16T03:26:18.819 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]", 2024-09-16T03:26:18.819 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:26:18.819 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:26:18.819 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:26:18.819 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:26:18.819 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:26:18.819 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:26:18.819 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:26:18.819 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:26:18.819 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:26:18.819 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/1", 2024-09-16T03:26:18.819 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:26:18.819 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:26:18.819 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:26:18.820 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.820 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.820 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:26:18.820 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:26:18.820 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6820/2576002244,v1:127.0.0.1:6821/2576002244]", 2024-09-16T03:26:18.820 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:26:18.820 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:26:18.820 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:26:18.820 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:26:18.821 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:26:18.821 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:26:18.821 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:26:18.821 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:26:18.821 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:26:18.821 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:26:18.821 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:26:18.821 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/2/block", 2024-09-16T03:26:18.821 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:26:18.821 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:26:18.821 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:26:18.821 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:26:18.821 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:26:18.821 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:26:18.822 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:26:18.822 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:26:18.822 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:26:18.822 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:26:18.822 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:24:07.764502Z", 2024-09-16T03:26:18.822 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:26:18.822 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:26:18.822 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:26:18.822 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:26:18.822 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:26:18.822 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:26:18.822 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:26:18.822 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6818/2576002244,v1:127.0.0.1:6819/2576002244]", 2024-09-16T03:26:18.822 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:26:18.823 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6824/2576002244,v1:127.0.0.1:6825/2576002244]", 2024-09-16T03:26:18.823 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6822/2576002244,v1:127.0.0.1:6823/2576002244]", 2024-09-16T03:26:18.823 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:26:18.823 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:26:18.823 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:26:18.823 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:26:18.823 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:26:18.823 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:26:18.823 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:26:18.823 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:26:18.823 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:26:18.824 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/2", 2024-09-16T03:26:18.824 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:26:18.824 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:26:18.824 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:26:18.824 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:18.824 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:18.824 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_clean_epochs": { 2024-09-16T03:26:18.824 INFO:tasks.workunit.client.0.smithi096.stderr: "min_last_epoch_clean": 86, 2024-09-16T03:26:18.824 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": { 2024-09-16T03:26:18.824 INFO:tasks.workunit.client.0.smithi096.stderr: "per_pool": [ 2024-09-16T03:26:18.825 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.825 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 1, 2024-09-16T03:26:18.825 INFO:tasks.workunit.client.0.smithi096.stderr: "floor": 86 2024-09-16T03:26:18.825 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.825 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.825 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 2, 2024-09-16T03:26:18.825 INFO:tasks.workunit.client.0.smithi096.stderr: "floor": 86 2024-09-16T03:26:18.825 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:18.825 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:18.825 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.825 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_epochs": [ 2024-09-16T03:26:18.825 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.825 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:26:18.825 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 86 2024-09-16T03:26:18.826 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.826 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.826 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:26:18.826 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 88 2024-09-16T03:26:18.826 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.826 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.826 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:26:18.826 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 88 2024-09-16T03:26:18.826 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:18.826 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:18.826 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.826 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_first_committed": 86, 2024-09-16T03:26:18.826 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_last_committed": 88, 2024-09-16T03:26:18.827 INFO:tasks.workunit.client.0.smithi096.stderr: "crushmap": { 2024-09-16T03:26:18.827 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": [ 2024-09-16T03:26:18.827 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.827 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:26:18.827 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.0", 2024-09-16T03:26:18.827 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:26:18.827 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.827 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.827 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:26:18.827 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.1", 2024-09-16T03:26:18.827 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:26:18.827 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.827 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.827 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:26:18.828 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.2", 2024-09-16T03:26:18.828 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:26:18.828 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:18.828 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:18.828 INFO:tasks.workunit.client.0.smithi096.stderr: "types": [ 2024-09-16T03:26:18.828 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.828 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 0, 2024-09-16T03:26:18.828 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd" 2024-09-16T03:26:18.828 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.828 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.829 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:26:18.829 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "host" 2024-09-16T03:26:18.829 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.829 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.829 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 2, 2024-09-16T03:26:18.829 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "chassis" 2024-09-16T03:26:18.829 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.829 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.829 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 3, 2024-09-16T03:26:18.829 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "rack" 2024-09-16T03:26:18.829 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.829 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.829 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 4, 2024-09-16T03:26:18.829 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "row" 2024-09-16T03:26:18.830 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.830 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.830 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 5, 2024-09-16T03:26:18.830 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "pdu" 2024-09-16T03:26:18.830 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.830 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.830 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 6, 2024-09-16T03:26:18.830 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "pod" 2024-09-16T03:26:18.830 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.830 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.830 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 7, 2024-09-16T03:26:18.830 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "room" 2024-09-16T03:26:18.830 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.830 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.831 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 8, 2024-09-16T03:26:18.831 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "datacenter" 2024-09-16T03:26:18.831 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.831 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.831 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 9, 2024-09-16T03:26:18.831 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "zone" 2024-09-16T03:26:18.831 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.831 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.831 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 10, 2024-09-16T03:26:18.831 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "region" 2024-09-16T03:26:18.831 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.832 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.832 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:26:18.832 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "root" 2024-09-16T03:26:18.832 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:18.832 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:18.832 INFO:tasks.workunit.client.0.smithi096.stderr: "buckets": [ 2024-09-16T03:26:18.832 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.832 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -1, 2024-09-16T03:26:18.832 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "default", 2024-09-16T03:26:18.832 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:26:18.832 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "root", 2024-09-16T03:26:18.832 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:26:18.832 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:26:18.833 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:26:18.833 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:26:18.833 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.833 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -3, 2024-09-16T03:26:18.833 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:26:18.833 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:26:18.833 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:18.833 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:18.833 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.833 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.833 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -2, 2024-09-16T03:26:18.833 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "default~hdd", 2024-09-16T03:26:18.833 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:26:18.833 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "root", 2024-09-16T03:26:18.834 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:26:18.834 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:26:18.834 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:26:18.834 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:26:18.834 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.834 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -4, 2024-09-16T03:26:18.834 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:26:18.834 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:26:18.834 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:18.834 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:18.834 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.834 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.834 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -3, 2024-09-16T03:26:18.834 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "smithi096", 2024-09-16T03:26:18.835 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:26:18.835 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "host", 2024-09-16T03:26:18.835 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:26:18.835 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:26:18.835 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:26:18.835 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:26:18.835 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.835 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:26:18.835 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:26:18.835 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:26:18.835 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.835 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.836 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:26:18.836 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:26:18.836 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 1 2024-09-16T03:26:18.836 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.836 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.836 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:26:18.836 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:26:18.836 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 2 2024-09-16T03:26:18.836 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:18.836 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:18.836 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.836 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.837 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -4, 2024-09-16T03:26:18.837 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "smithi096~hdd", 2024-09-16T03:26:18.837 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:26:18.837 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "host", 2024-09-16T03:26:18.837 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:26:18.837 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:26:18.837 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:26:18.837 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:26:18.837 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.837 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:26:18.837 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:26:18.837 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:26:18.837 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.837 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.838 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:26:18.838 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:26:18.838 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 1 2024-09-16T03:26:18.838 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.838 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.838 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:26:18.838 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:26:18.838 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 2 2024-09-16T03:26:18.838 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:18.838 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:18.838 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:18.838 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:18.838 INFO:tasks.workunit.client.0.smithi096.stderr: "rules": [ 2024-09-16T03:26:18.839 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.839 INFO:tasks.workunit.client.0.smithi096.stderr: "rule_id": 0, 2024-09-16T03:26:18.839 INFO:tasks.workunit.client.0.smithi096.stderr: "rule_name": "replicated_rule", 2024-09-16T03:26:18.839 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:26:18.839 INFO:tasks.workunit.client.0.smithi096.stderr: "steps": [ 2024-09-16T03:26:18.839 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.839 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "take", 2024-09-16T03:26:18.839 INFO:tasks.workunit.client.0.smithi096.stderr: "item": -1, 2024-09-16T03:26:18.839 INFO:tasks.workunit.client.0.smithi096.stderr: "item_name": "default" 2024-09-16T03:26:18.839 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.839 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.839 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "choose_firstn", 2024-09-16T03:26:18.839 INFO:tasks.workunit.client.0.smithi096.stderr: "num": 0, 2024-09-16T03:26:18.839 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "osd" 2024-09-16T03:26:18.840 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.840 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.840 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "emit" 2024-09-16T03:26:18.840 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:18.840 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:18.840 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:18.840 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:18.840 INFO:tasks.workunit.client.0.smithi096.stderr: "tunables": { 2024-09-16T03:26:18.840 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_local_tries": 0, 2024-09-16T03:26:18.840 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_local_fallback_tries": 0, 2024-09-16T03:26:18.840 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_total_tries": 50, 2024-09-16T03:26:18.840 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_descend_once": 1, 2024-09-16T03:26:18.840 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_vary_r": 1, 2024-09-16T03:26:18.841 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_stable": 1, 2024-09-16T03:26:18.841 INFO:tasks.workunit.client.0.smithi096.stderr: "msr_descents": 100, 2024-09-16T03:26:18.841 INFO:tasks.workunit.client.0.smithi096.stderr: "msr_collision_tries": 100, 2024-09-16T03:26:18.841 INFO:tasks.workunit.client.0.smithi096.stderr: "straw_calc_version": 1, 2024-09-16T03:26:18.841 INFO:tasks.workunit.client.0.smithi096.stderr: "allowed_bucket_algs": 54, 2024-09-16T03:26:18.841 INFO:tasks.workunit.client.0.smithi096.stderr: "profile": "jewel", 2024-09-16T03:26:18.841 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_tunables": 1, 2024-09-16T03:26:18.841 INFO:tasks.workunit.client.0.smithi096.stderr: "legacy_tunables": 0, 2024-09-16T03:26:18.841 INFO:tasks.workunit.client.0.smithi096.stderr: "minimum_required_version": "jewel", 2024-09-16T03:26:18.841 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables": 1, 2024-09-16T03:26:18.841 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables2": 1, 2024-09-16T03:26:18.841 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v2_rules": 0, 2024-09-16T03:26:18.841 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables3": 1, 2024-09-16T03:26:18.841 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v3_rules": 0, 2024-09-16T03:26:18.842 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v4_buckets": 1, 2024-09-16T03:26:18.842 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables5": 1, 2024-09-16T03:26:18.842 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v5_rules": 0, 2024-09-16T03:26:18.842 INFO:tasks.workunit.client.0.smithi096.stderr: "has_msr_rules": 0 2024-09-16T03:26:18.842 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.842 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_args": {} 2024-09-16T03:26:18.842 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.842 INFO:tasks.workunit.client.0.smithi096.stderr: "fsmap": { 2024-09-16T03:26:18.842 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 1, 2024-09-16T03:26:18.842 INFO:tasks.workunit.client.0.smithi096.stderr: "btime": "2024-09-16T03:22:46:882186+0000", 2024-09-16T03:26:18.842 INFO:tasks.workunit.client.0.smithi096.stderr: "default_fscid": -1, 2024-09-16T03:26:18.842 INFO:tasks.workunit.client.0.smithi096.stderr: "compat": { 2024-09-16T03:26:18.842 INFO:tasks.workunit.client.0.smithi096.stderr: "compat": {}, 2024-09-16T03:26:18.842 INFO:tasks.workunit.client.0.smithi096.stderr: "ro_compat": {}, 2024-09-16T03:26:18.843 INFO:tasks.workunit.client.0.smithi096.stderr: "incompat": { 2024-09-16T03:26:18.843 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_1": "base v0.20", 2024-09-16T03:26:18.843 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_2": "client writeable ranges", 2024-09-16T03:26:18.843 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_3": "default file layouts on dirs", 2024-09-16T03:26:18.843 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_4": "dir inode in separate object", 2024-09-16T03:26:18.843 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_5": "mds uses versioned encoding", 2024-09-16T03:26:18.843 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_6": "dirfrag is stored in omap", 2024-09-16T03:26:18.843 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_8": "no anchor table", 2024-09-16T03:26:18.843 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_9": "file layout v2", 2024-09-16T03:26:18.843 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_10": "snaprealm v2", 2024-09-16T03:26:18.843 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_11": "minor log segments", 2024-09-16T03:26:18.843 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_12": "quiesce subvolumes" 2024-09-16T03:26:18.843 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:18.843 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.844 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_flags": { 2024-09-16T03:26:18.844 INFO:tasks.workunit.client.0.smithi096.stderr: "enable_multiple": true, 2024-09-16T03:26:18.844 INFO:tasks.workunit.client.0.smithi096.stderr: "ever_enabled_multiple": true 2024-09-16T03:26:18.844 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.844 INFO:tasks.workunit.client.0.smithi096.stderr: "standbys": [], 2024-09-16T03:26:18.844 INFO:tasks.workunit.client.0.smithi096.stderr: "filesystems": [] 2024-09-16T03:26:18.844 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.844 INFO:tasks.workunit.client.0.smithi096.stderr: "mdsmap_first_committed": 1, 2024-09-16T03:26:18.844 INFO:tasks.workunit.client.0.smithi096.stderr: "mdsmap_last_committed": 1, 2024-09-16T03:26:18.844 INFO:tasks.workunit.client.0.smithi096.stderr: "auth": { 2024-09-16T03:26:18.844 INFO:tasks.workunit.client.0.smithi096.stderr: "first_committed": 1, 2024-09-16T03:26:18.844 INFO:tasks.workunit.client.0.smithi096.stderr: "last_committed": 5, 2024-09-16T03:26:18.844 INFO:tasks.workunit.client.0.smithi096.stderr: "num_secrets": 3 2024-09-16T03:26:18.845 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.845 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 64, 2024-09-16T03:26:18.845 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_active": 64, 2024-09-16T03:26:18.845 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_unknown": 0, 2024-09-16T03:26:18.845 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osd": 3, 2024-09-16T03:26:18.845 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_sum": { 2024-09-16T03:26:18.845 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:26:18.845 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:26:18.845 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:26:18.845 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:26:18.845 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:26:18.845 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:26:18.845 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:26:18.845 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:26:18.846 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:26:18.846 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:26:18.846 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:26:18.846 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:26:18.846 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:26:18.846 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:26:18.846 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:26:18.846 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:26:18.846 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:26:18.846 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:26:18.846 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:26:18.846 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:26:18.846 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:26:18.846 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:26:18.847 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:26:18.847 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:26:18.847 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:26:18.847 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:26:18.847 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:26:18.847 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:26:18.847 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:26:18.847 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:26:18.847 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:26:18.847 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:26:18.847 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:26:18.847 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:26:18.847 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:26:18.848 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:26:18.848 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:26:18.848 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:26:18.848 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:26:18.848 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:26:18.848 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:26:18.848 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.848 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:26:18.848 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:26:18.848 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:26:18.848 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:26:18.848 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:26:18.848 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:26:18.848 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:26:18.849 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:26:18.849 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:26:18.849 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:26:18.849 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:26:18.849 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.849 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:26:18.849 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:26:18.849 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 128, 2024-09-16T03:26:18.849 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 128, 2024-09-16T03:26:18.849 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 0 2024-09-16T03:26:18.849 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.849 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_sum": { 2024-09-16T03:26:18.849 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 0, 2024-09-16T03:26:18.850 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 0, 2024-09-16T03:26:18.850 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pgs": 128, 2024-09-16T03:26:18.850 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osds": 2, 2024-09-16T03:26:18.850 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_osds": 2, 2024-09-16T03:26:18.850 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_omap_osds": 2, 2024-09-16T03:26:18.850 INFO:tasks.workunit.client.0.smithi096.stderr: "kb": 209715200, 2024-09-16T03:26:18.850 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used": 54660, 2024-09-16T03:26:18.850 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_data": 888, 2024-09-16T03:26:18.850 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_omap": 3, 2024-09-16T03:26:18.850 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_meta": 53628, 2024-09-16T03:26:18.850 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_avail": 209660540, 2024-09-16T03:26:18.850 INFO:tasks.workunit.client.0.smithi096.stderr: "statfs": { 2024-09-16T03:26:18.850 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 214748364800, 2024-09-16T03:26:18.850 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 214692392960, 2024-09-16T03:26:18.850 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:26:18.851 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 909312, 2024-09-16T03:26:18.851 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 340707, 2024-09-16T03:26:18.851 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:26:18.851 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:26:18.851 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:26:18.851 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 3190, 2024-09-16T03:26:18.851 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 54915978 2024-09-16T03:26:18.851 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.851 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_peers": [], 2024-09-16T03:26:18.851 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_trim_queue_len": 0, 2024-09-16T03:26:18.851 INFO:tasks.workunit.client.0.smithi096.stderr: "num_snap_trimming": 0, 2024-09-16T03:26:18.851 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shards_repaired": 0, 2024-09-16T03:26:18.851 INFO:tasks.workunit.client.0.smithi096.stderr: "op_queue_age_hist": { 2024-09-16T03:26:18.852 INFO:tasks.workunit.client.0.smithi096.stderr: "histogram": [], 2024-09-16T03:26:18.852 INFO:tasks.workunit.client.0.smithi096.stderr: "upper_bound": 1 2024-09-16T03:26:18.852 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.852 INFO:tasks.workunit.client.0.smithi096.stderr: "perf_stat": { 2024-09-16T03:26:18.852 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ms": 121, 2024-09-16T03:26:18.852 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ms": 121, 2024-09-16T03:26:18.852 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ns": 121000000, 2024-09-16T03:26:18.852 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ns": 121000000 2024-09-16T03:26:18.852 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.852 INFO:tasks.workunit.client.0.smithi096.stderr: "alerts": [], 2024-09-16T03:26:18.852 INFO:tasks.workunit.client.0.smithi096.stderr: "network_ping_times": [] 2024-09-16T03:26:18.852 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.852 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_sum_by_class": { 2024-09-16T03:26:18.852 INFO:tasks.workunit.client.0.smithi096.stderr: "hdd": { 2024-09-16T03:26:18.853 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 0, 2024-09-16T03:26:18.853 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 0, 2024-09-16T03:26:18.853 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pgs": 128, 2024-09-16T03:26:18.853 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osds": 2, 2024-09-16T03:26:18.853 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_osds": 2, 2024-09-16T03:26:18.853 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_omap_osds": 2, 2024-09-16T03:26:18.853 INFO:tasks.workunit.client.0.smithi096.stderr: "kb": 209715200, 2024-09-16T03:26:18.853 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used": 54660, 2024-09-16T03:26:18.853 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_data": 888, 2024-09-16T03:26:18.853 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_omap": 3, 2024-09-16T03:26:18.853 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_meta": 53628, 2024-09-16T03:26:18.853 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_avail": 209660540, 2024-09-16T03:26:18.853 INFO:tasks.workunit.client.0.smithi096.stderr: "statfs": { 2024-09-16T03:26:18.853 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 214748364800, 2024-09-16T03:26:18.854 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 214692392960, 2024-09-16T03:26:18.854 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:26:18.854 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 909312, 2024-09-16T03:26:18.854 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 340707, 2024-09-16T03:26:18.854 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:26:18.854 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:26:18.854 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:26:18.854 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 3190, 2024-09-16T03:26:18.854 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 54915978 2024-09-16T03:26:18.854 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.854 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_peers": [], 2024-09-16T03:26:18.854 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_trim_queue_len": 0, 2024-09-16T03:26:18.854 INFO:tasks.workunit.client.0.smithi096.stderr: "num_snap_trimming": 0, 2024-09-16T03:26:18.854 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shards_repaired": 0, 2024-09-16T03:26:18.855 INFO:tasks.workunit.client.0.smithi096.stderr: "op_queue_age_hist": { 2024-09-16T03:26:18.855 INFO:tasks.workunit.client.0.smithi096.stderr: "histogram": [], 2024-09-16T03:26:18.855 INFO:tasks.workunit.client.0.smithi096.stderr: "upper_bound": 1 2024-09-16T03:26:18.855 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.855 INFO:tasks.workunit.client.0.smithi096.stderr: "perf_stat": { 2024-09-16T03:26:18.855 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ms": 121, 2024-09-16T03:26:18.855 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ms": 121, 2024-09-16T03:26:18.855 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ns": 121000000, 2024-09-16T03:26:18.855 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ns": 121000000 2024-09-16T03:26:18.856 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.856 INFO:tasks.workunit.client.0.smithi096.stderr: "alerts": [], 2024-09-16T03:26:18.856 INFO:tasks.workunit.client.0.smithi096.stderr: "network_ping_times": [] 2024-09-16T03:26:18.856 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:18.856 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.856 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_stats": [ 2024-09-16T03:26:18.856 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.856 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 2, 2024-09-16T03:26:18.856 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 32, 2024-09-16T03:26:18.856 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:26:18.856 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:26:18.856 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:26:18.856 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:26:18.857 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:26:18.857 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:26:18.857 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:26:18.857 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:26:18.857 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:26:18.857 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:26:18.857 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:26:18.857 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:26:18.857 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:26:18.857 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:26:18.857 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:26:18.857 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:26:18.857 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:26:18.857 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:26:18.858 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:26:18.858 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:26:18.858 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:26:18.858 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:26:18.858 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:26:18.858 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:26:18.858 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:26:18.858 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:26:18.858 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:26:18.858 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:26:18.858 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:26:18.858 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:26:18.858 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:26:18.858 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:26:18.859 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:26:18.859 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:26:18.859 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:26:18.859 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:26:18.859 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:26:18.859 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:26:18.859 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:26:18.859 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:26:18.859 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:26:18.859 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.859 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:26:18.859 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:26:18.859 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:26:18.859 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:26:18.860 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:26:18.860 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:26:18.860 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:26:18.860 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:26:18.860 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:26:18.860 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:26:18.860 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:26:18.860 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.860 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:26:18.860 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:26:18.860 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 64, 2024-09-16T03:26:18.860 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 64, 2024-09-16T03:26:18.860 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 3 2024-09-16T03:26:18.861 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.861 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.861 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 1, 2024-09-16T03:26:18.861 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 32, 2024-09-16T03:26:18.861 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:26:18.861 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:26:18.861 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:26:18.861 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:26:18.861 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:26:18.861 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:26:18.861 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:26:18.861 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:26:18.861 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:26:18.862 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:26:18.862 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:26:18.862 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:26:18.862 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:26:18.862 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:26:18.862 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:26:18.862 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:26:18.862 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:26:18.862 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:26:18.862 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:26:18.862 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:26:18.862 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:26:18.862 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:26:18.862 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:26:18.863 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:26:18.863 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:26:18.863 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:26:18.863 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:26:18.863 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:26:18.863 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:26:18.863 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:26:18.863 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:26:18.863 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:26:18.863 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:26:18.863 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:26:18.863 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:26:18.863 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:26:18.863 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:26:18.864 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:26:18.864 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:26:18.864 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:26:18.864 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:26:18.864 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.864 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:26:18.864 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:26:18.864 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:26:18.864 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:26:18.864 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:26:18.864 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:26:18.864 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:26:18.864 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:26:18.864 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:26:18.865 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:26:18.865 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:26:18.865 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.865 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:26:18.865 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:26:18.865 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 64, 2024-09-16T03:26:18.865 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 64, 2024-09-16T03:26:18.865 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 3 2024-09-16T03:26:18.865 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:18.865 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:18.865 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_stats": [ 2024-09-16T03:26:18.865 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.865 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:26:18.865 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 21474836523 2024-09-16T03:26:18.866 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.866 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.866 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:26:18.866 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 42949672995 2024-09-16T03:26:18.866 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.866 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.866 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:26:18.866 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 1 2024-09-16T03:26:18.866 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:18.866 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:18.866 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_by_state": [ 2024-09-16T03:26:18.866 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.866 INFO:tasks.workunit.client.0.smithi096.stderr: "state": "active+clean", 2024-09-16T03:26:18.866 INFO:tasks.workunit.client.0.smithi096.stderr: "num": 64 2024-09-16T03:26:18.867 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:18.867 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:18.867 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_by_osd": [ 2024-09-16T03:26:18.867 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.867 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:26:18.867 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 0, 2024-09-16T03:26:18.867 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 0, 2024-09-16T03:26:18.867 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:26:18.867 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.867 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.867 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:26:18.867 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 28, 2024-09-16T03:26:18.867 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 64, 2024-09-16T03:26:18.867 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:26:18.868 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.868 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.868 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:26:18.868 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 36, 2024-09-16T03:26:18.868 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 64, 2024-09-16T03:26:18.868 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:26:18.868 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:18.868 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:18.868 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": [ 2024-09-16T03:26:18.868 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.868 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 1, 2024-09-16T03:26:18.868 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": {} 2024-09-16T03:26:18.868 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.869 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:18.869 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 2, 2024-09-16T03:26:18.869 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": {} 2024-09-16T03:26:18.869 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:18.869 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:18.869 INFO:tasks.workunit.client.0.smithi096.stderr: "servicemap": { 2024-09-16T03:26:18.869 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 5, 2024-09-16T03:26:18.869 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:25:38.422788+0000", 2024-09-16T03:26:18.869 INFO:tasks.workunit.client.0.smithi096.stderr: "services": {} 2024-09-16T03:26:18.869 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:18.869 INFO:tasks.workunit.client.0.smithi096.stderr: "mgrstat_first_committed": 89, 2024-09-16T03:26:18.869 INFO:tasks.workunit.client.0.smithi096.stderr: "mgrstat_last_committed": 95, 2024-09-16T03:26:18.869 INFO:tasks.workunit.client.0.smithi096.stderr: "logm_first_committed": 1, 2024-09-16T03:26:18.869 INFO:tasks.workunit.client.0.smithi096.stderr: "logm_last_committed": 430, 2024-09-16T03:26:18.869 INFO:tasks.workunit.client.0.smithi096.stderr: "paxos": { 2024-09-16T03:26:18.870 INFO:tasks.workunit.client.0.smithi096.stderr: "first_committed": 1, 2024-09-16T03:26:18.870 INFO:tasks.workunit.client.0.smithi096.stderr: "last_committed": 633, 2024-09-16T03:26:18.870 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pn": 0, 2024-09-16T03:26:18.870 INFO:tasks.workunit.client.0.smithi096.stderr: "accepted_pn": 0 2024-09-16T03:26:18.870 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:18.870 INFO:tasks.workunit.client.0.smithi096.stderr:}' 2024-09-16T03:26:18.874 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:30: check_lec_equals_pools: jq .osdmap_clean_epochs.min_last_epoch_clean 2024-09-16T03:26:18.874 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:30: check_lec_equals_pools: echo '{' '"cluster_fingerprint":' '"fda2fc64-07ed-4add-8224-2e527e11d427",' '"version":' '"19.3.0-4930-gfc3e0bff",' '"commit":' '"fc3e0bff7468fd55478adbae7f75508b749124b6",' '"timestamp":' '"2024-09-16T03:26:18.748590+0000",' '"tag":' '"",' '"health":' '{' '"status":' '"HEALTH_OK",' '"checks":' '{},' '"mutes":' '[]' '},' '"monmap_first_committed":' 1, '"monmap_last_committed":' 1, '"monmap":' '{' '"epoch":' 1, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"modified":' '"2024-09-16T03:22:45.872880Z",' '"created":' '"2024-09-16T03:22:45.872880Z",' '"min_mon_release":' 19, '"min_mon_release_name":' '"squid",' '"election_strategy":' 1, '"disallowed_leaders:' '":' '"",' '"stretch_mode":' false, '"tiebreaker_mon":' '"",' '"removed_ranks:' '":' '"",' '"features":' '{' '"persistent":' '[' '"kraken",' '"luminous",' '"mimic",' '"osdmap-prune",' '"nautilus",' '"octopus",' '"pacific",' '"elector-pinging",' '"quincy",' '"reef",' '"squid"' '],' '"optional":' '[]' '},' '"mons":' '[' '{' '"rank":' 0, '"name":' '"a",' '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:7302",' '"nonce":' 0 '}' ']' '},' '"addr":' '"127.0.0.1:7302/0",' '"public_addr":' '"127.0.0.1:7302/0",' '"priority":' 0, '"weight":' 0, '"crush_location":' '"{}"' '}' ']' '},' '"quorum":' '[' 0 '],' '"osdmap":' '{' '"epoch":' 88, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"created":' '"2024-09-16T03:22:46.906117+0000",' '"modified":' '"2024-09-16T03:26:15.120212+0000",' '"last_up_change":' '"2024-09-16T03:26:15.120212+0000",' '"last_in_change":' '"2024-09-16T03:25:09.839444+0000",' '"flags":' '"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit",' '"flags_num":' 5799936, '"flags_set":' '[' '"pglog_hardlimit",' '"purged_snapdirs",' '"recovery_deletes",' '"sortbitwise"' '],' '"crush_version":' 8, '"full_ratio":' 0.97000002861022949, '"backfillfull_ratio":' 0.97000002861022949, '"nearfull_ratio":' 0.85000002384185791, '"cluster_snapshot":' '"",' '"pool_max":' 2, '"max_osd":' 3, '"require_min_compat_client":' '"luminous",' '"min_compat_client":' '"jewel",' '"require_osd_release":' '"squid",' '"allow_crimson":' false, '"pools":' '[' '{' '"pool":' 1, '"pool_name":' '"foo",' '"create_time":' '"2024-09-16T03:24:44.525189+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 2, '"min_size":' 1, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"85",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.8700000047683716, '"score_stable":' 1.8700000047683716, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1.25, '"raw_score_stable":' 1.25, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '},' '{' '"pool":' 2, '"pool_name":' '"bar",' '"create_time":' '"2024-09-16T03:24:46.226575+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 2, '"min_size":' 1, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"83",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.4900000095367432, '"score_stable":' 1.4900000095367432, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1, '"raw_score_stable":' 1, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '}' '],' '"osds":' '[' '{' '"osd":' 0, '"uuid":' '"64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 5, '"up_thru":' 84, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6802",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6803",' '"nonce":' 3375787448 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6804",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6805",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6808",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6809",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6806",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6807",' '"nonce":' 3375787448 '}' ']' '},' '"public_addr":' '"127.0.0.1:6803/3375787448",' '"cluster_addr":' '"127.0.0.1:6805/3375787448",' '"heartbeat_back_addr":' '"127.0.0.1:6809/3375787448",' '"heartbeat_front_addr":' '"127.0.0.1:6807/3375787448",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 1, '"uuid":' '"74b26727-75c9-444d-8782-719e4197a382",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 10, '"up_thru":' 84, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6810",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6811",' '"nonce":' 3733255132 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6812",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6813",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6816",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6817",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6814",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6815",' '"nonce":' 3733255132 '}' ']' '},' '"public_addr":' '"127.0.0.1:6811/3733255132",' '"cluster_addr":' '"127.0.0.1:6813/3733255132",' '"heartbeat_back_addr":' '"127.0.0.1:6817/3733255132",' '"heartbeat_front_addr":' '"127.0.0.1:6815/3733255132",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 2, '"uuid":' '"143da3a7-dad9-4b1e-966b-76cf5bdd3c82",' '"up":' 1, '"in":' 0, '"weight":' 0, '"primary_affinity":' 1, '"last_clean_begin":' 15, '"last_clean_end":' 32, '"up_from":' 88, '"up_thru":' 21, '"down_at":' 33, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6818",' '"nonce":' 2576002244 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6819",' '"nonce":' 2576002244 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6820",' '"nonce":' 2576002244 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6821",' '"nonce":' 2576002244 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6824",' '"nonce":' 2576002244 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6825",' '"nonce":' 2576002244 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6822",' '"nonce":' 2576002244 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6823",' '"nonce":' 2576002244 '}' ']' '},' '"public_addr":' '"127.0.0.1:6819/2576002244",' '"cluster_addr":' '"127.0.0.1:6821/2576002244",' '"heartbeat_back_addr":' '"127.0.0.1:6825/2576002244",' '"heartbeat_front_addr":' '"127.0.0.1:6823/2576002244",' '"state":' '[' '"exists",' '"up"' ']' '}' '],' '"osd_xinfo":' '[' '{' '"osd":' 0, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:22.481942+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 1, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:59.663703+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 2, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 65536, '"last_purged_snaps_scrub":' '"2024-09-16T03:24:37.320822+0000",' '"dead_epoch":' 32 '}' '],' '"pg_upmap":' '[],' '"pg_upmap_items":' '[],' '"pg_upmap_primaries":' '[],' '"pg_temp":' '[],' '"primary_temp":' '[],' '"blocklist":' '{},' '"range_blocklist":' '{},' '"erasure_code_profiles":' '{' '"default":' '{' '"k":' '"2",' '"m":' '"2",' '"plugin":' '"jerasure",' '"technique":' '"reed_sol_van"' '}' '},' '"removed_snaps_queue":' '[],' '"new_removed_snaps":' '[],' '"new_purged_snaps":' '[],' '"crush_node_flags":' '{},' '"device_class_flags":' '{},' '"stretch_mode":' '{' '"stretch_mode_enabled":' false, '"stretch_bucket_count":' 0, '"degraded_stretch_mode":' 0, '"recovering_stretch_mode":' 0, '"stretch_mode_bucket":' 0 '}' '},' '"osd_metadata":' '[' '{' '"id":' 0, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/0/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:22:53.662571Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]",' '"hb_front_addr":' '"[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/0",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 1, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/1/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:23:30.129885Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]",' '"hb_front_addr":' '"[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/1",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 2, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6820/2576002244,v1:127.0.0.1:6821/2576002244]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/2/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:24:07.764502Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6818/2576002244,v1:127.0.0.1:6819/2576002244]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6824/2576002244,v1:127.0.0.1:6825/2576002244]",' '"hb_front_addr":' '"[v2:127.0.0.1:6822/2576002244,v1:127.0.0.1:6823/2576002244]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/2",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '}' '],' '"osdmap_clean_epochs":' '{' '"min_last_epoch_clean":' 86, '"last_epoch_clean":' '{' '"per_pool":' '[' '{' '"poolid":' 1, '"floor":' 86 '},' '{' '"poolid":' 2, '"floor":' 86 '}' ']' '},' '"osd_epochs":' '[' '{' '"id":' 0, '"epoch":' 86 '},' '{' '"id":' 1, '"epoch":' 88 '},' '{' '"id":' 2, '"epoch":' 88 '}' ']' '},' '"osdmap_first_committed":' 86, '"osdmap_last_committed":' 88, '"crushmap":' '{' '"devices":' '[' '{' '"id":' 0, '"name":' '"osd.0",' '"class":' '"hdd"' '},' '{' '"id":' 1, '"name":' '"osd.1",' '"class":' '"hdd"' '},' '{' '"id":' 2, '"name":' '"osd.2",' '"class":' '"hdd"' '}' '],' '"types":' '[' '{' '"type_id":' 0, '"name":' '"osd"' '},' '{' '"type_id":' 1, '"name":' '"host"' '},' '{' '"type_id":' 2, '"name":' '"chassis"' '},' '{' '"type_id":' 3, '"name":' '"rack"' '},' '{' '"type_id":' 4, '"name":' '"row"' '},' '{' '"type_id":' 5, '"name":' '"pdu"' '},' '{' '"type_id":' 6, '"name":' '"pod"' '},' '{' '"type_id":' 7, '"name":' '"room"' '},' '{' '"type_id":' 8, '"name":' '"datacenter"' '},' '{' '"type_id":' 9, '"name":' '"zone"' '},' '{' '"type_id":' 10, '"name":' '"region"' '},' '{' '"type_id":' 11, '"name":' '"root"' '}' '],' '"buckets":' '[' '{' '"id":' -1, '"name":' '"default",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -3, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -2, '"name":' '"default~hdd",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -4, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -3, '"name":' '"smithi096",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '},' '{' '"id":' -4, '"name":' '"smithi096~hdd",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '}' '],' '"rules":' '[' '{' '"rule_id":' 0, '"rule_name":' '"replicated_rule",' '"type":' 1, '"steps":' '[' '{' '"op":' '"take",' '"item":' -1, '"item_name":' '"default"' '},' '{' '"op":' '"choose_firstn",' '"num":' 0, '"type":' '"osd"' '},' '{' '"op":' '"emit"' '}' ']' '}' '],' '"tunables":' '{' '"choose_local_tries":' 0, '"choose_local_fallback_tries":' 0, '"choose_total_tries":' 50, '"chooseleaf_descend_once":' 1, '"chooseleaf_vary_r":' 1, '"chooseleaf_stable":' 1, '"msr_descents":' 100, '"msr_collision_tries":' 100, '"straw_calc_version":' 1, '"allowed_bucket_algs":' 54, '"profile":' '"jewel",' '"optimal_tunables":' 1, '"legacy_tunables":' 0, '"minimum_required_version":' '"jewel",' '"require_feature_tunables":' 1, '"require_feature_tunables2":' 1, '"has_v2_rules":' 0, '"require_feature_tunables3":' 1, '"has_v3_rules":' 0, '"has_v4_buckets":' 1, '"require_feature_tunables5":' 1, '"has_v5_rules":' 0, '"has_msr_rules":' 0 '},' '"choose_args":' '{}' '},' '"fsmap":' '{' '"epoch":' 1, '"btime":' '"2024-09-16T03:22:46:882186+0000",' '"default_fscid":' -1, '"compat":' '{' '"compat":' '{},' '"ro_compat":' '{},' '"incompat":' '{' '"feature_1":' '"base' 'v0.20",' '"feature_2":' '"client' writeable 'ranges",' '"feature_3":' '"default' file layouts on 'dirs",' '"feature_4":' '"dir' inode in separate 'object",' '"feature_5":' '"mds' uses versioned 'encoding",' '"feature_6":' '"dirfrag' is stored in 'omap",' '"feature_8":' '"no' anchor 'table",' '"feature_9":' '"file' layout 'v2",' '"feature_10":' '"snaprealm' 'v2",' '"feature_11":' '"minor' log 'segments",' '"feature_12":' '"quiesce' 'subvolumes"' '}' '},' '"feature_flags":' '{' '"enable_multiple":' true, '"ever_enabled_multiple":' true '},' '"standbys":' '[],' '"filesystems":' '[]' '},' '"mdsmap_first_committed":' 1, '"mdsmap_last_committed":' 1, '"auth":' '{' '"first_committed":' 1, '"last_committed":' 5, '"num_secrets":' 3 '},' '"num_pg":' 64, '"num_pg_active":' 64, '"num_pg_unknown":' 0, '"num_osd":' 3, '"pool_sum":' '{' '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 128, '"acting":' 128, '"num_store_stats":' 0 '},' '"osd_sum":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54660, '"kb_used_data":' 888, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660540, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692392960, '"internally_reserved":' 0, '"allocated":' 909312, '"data_stored":' 340707, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 121, '"apply_latency_ms":' 121, '"commit_latency_ns":' 121000000, '"apply_latency_ns":' 121000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '},' '"osd_sum_by_class":' '{' '"hdd":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54660, '"kb_used_data":' 888, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660540, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692392960, '"internally_reserved":' 0, '"allocated":' 909312, '"data_stored":' 340707, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 121, '"apply_latency_ms":' 121, '"commit_latency_ns":' 121000000, '"apply_latency_ns":' 121000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '}' '},' '"pool_stats":' '[' '{' '"poolid":' 2, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '},' '{' '"poolid":' 1, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '}' '],' '"osd_stats":' '[' '{' '"osd":' 0, '"seq":' 21474836523 '},' '{' '"osd":' 1, '"seq":' 42949672995 '},' '{' '"osd":' 2, '"seq":' 1 '}' '],' '"num_pg_by_state":' '[' '{' '"state":' '"active+clean",' '"num":' 64 '}' '],' '"num_pg_by_osd":' '[' '{' '"osd":' 2, '"num_primary_pg":' 0, '"num_acting_pg":' 0, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 0, '"num_primary_pg":' 28, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 1, '"num_primary_pg":' 36, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '}' '],' '"purged_snaps":' '[' '{' '"pool":' 1, '"purged_snaps":' '{}' '},' '{' '"pool":' 2, '"purged_snaps":' '{}' '}' '],' '"servicemap":' '{' '"epoch":' 5, '"modified":' '"2024-09-16T03:25:38.422788+0000",' '"services":' '{}' '},' '"mgrstat_first_committed":' 89, '"mgrstat_last_committed":' 95, '"logm_first_committed":' 1, '"logm_last_committed":' 430, '"paxos":' '{' '"first_committed":' 1, '"last_committed":' 633, '"last_pn":' 0, '"accepted_pn":' 0 '}' '}' 2024-09-16T03:26:18.875 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:30: check_lec_equals_pools: lec=86 2024-09-16T03:26:18.875 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:32: check_lec_equals_pools: [[ -z '' ]] 2024-09-16T03:26:18.875 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:36: check_lec_equals_pools: pools=($(echo $report | jq ".osdmap_clean_epochs.last_epoch_clean.per_pool[] |" " select(.floor == $lec) | .poolid")) 2024-09-16T03:26:18.875 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:36: check_lec_equals_pools: jq '.osdmap_clean_epochs.last_epoch_clean.per_pool[] |' ' select(.floor == 86) | .poolid' 2024-09-16T03:26:18.875 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:36: check_lec_equals_pools: echo '{' '"cluster_fingerprint":' '"fda2fc64-07ed-4add-8224-2e527e11d427",' '"version":' '"19.3.0-4930-gfc3e0bff",' '"commit":' '"fc3e0bff7468fd55478adbae7f75508b749124b6",' '"timestamp":' '"2024-09-16T03:26:18.748590+0000",' '"tag":' '"",' '"health":' '{' '"status":' '"HEALTH_OK",' '"checks":' '{},' '"mutes":' '[]' '},' '"monmap_first_committed":' 1, '"monmap_last_committed":' 1, '"monmap":' '{' '"epoch":' 1, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"modified":' '"2024-09-16T03:22:45.872880Z",' '"created":' '"2024-09-16T03:22:45.872880Z",' '"min_mon_release":' 19, '"min_mon_release_name":' '"squid",' '"election_strategy":' 1, '"disallowed_leaders:' '":' '"",' '"stretch_mode":' false, '"tiebreaker_mon":' '"",' '"removed_ranks:' '":' '"",' '"features":' '{' '"persistent":' '[' '"kraken",' '"luminous",' '"mimic",' '"osdmap-prune",' '"nautilus",' '"octopus",' '"pacific",' '"elector-pinging",' '"quincy",' '"reef",' '"squid"' '],' '"optional":' '[]' '},' '"mons":' '[' '{' '"rank":' 0, '"name":' '"a",' '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:7302",' '"nonce":' 0 '}' ']' '},' '"addr":' '"127.0.0.1:7302/0",' '"public_addr":' '"127.0.0.1:7302/0",' '"priority":' 0, '"weight":' 0, '"crush_location":' '"{}"' '}' ']' '},' '"quorum":' '[' 0 '],' '"osdmap":' '{' '"epoch":' 88, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"created":' '"2024-09-16T03:22:46.906117+0000",' '"modified":' '"2024-09-16T03:26:15.120212+0000",' '"last_up_change":' '"2024-09-16T03:26:15.120212+0000",' '"last_in_change":' '"2024-09-16T03:25:09.839444+0000",' '"flags":' '"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit",' '"flags_num":' 5799936, '"flags_set":' '[' '"pglog_hardlimit",' '"purged_snapdirs",' '"recovery_deletes",' '"sortbitwise"' '],' '"crush_version":' 8, '"full_ratio":' 0.97000002861022949, '"backfillfull_ratio":' 0.97000002861022949, '"nearfull_ratio":' 0.85000002384185791, '"cluster_snapshot":' '"",' '"pool_max":' 2, '"max_osd":' 3, '"require_min_compat_client":' '"luminous",' '"min_compat_client":' '"jewel",' '"require_osd_release":' '"squid",' '"allow_crimson":' false, '"pools":' '[' '{' '"pool":' 1, '"pool_name":' '"foo",' '"create_time":' '"2024-09-16T03:24:44.525189+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 2, '"min_size":' 1, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"85",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.8700000047683716, '"score_stable":' 1.8700000047683716, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1.25, '"raw_score_stable":' 1.25, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '},' '{' '"pool":' 2, '"pool_name":' '"bar",' '"create_time":' '"2024-09-16T03:24:46.226575+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 2, '"min_size":' 1, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"83",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.4900000095367432, '"score_stable":' 1.4900000095367432, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1, '"raw_score_stable":' 1, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '}' '],' '"osds":' '[' '{' '"osd":' 0, '"uuid":' '"64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 5, '"up_thru":' 84, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6802",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6803",' '"nonce":' 3375787448 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6804",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6805",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6808",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6809",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6806",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6807",' '"nonce":' 3375787448 '}' ']' '},' '"public_addr":' '"127.0.0.1:6803/3375787448",' '"cluster_addr":' '"127.0.0.1:6805/3375787448",' '"heartbeat_back_addr":' '"127.0.0.1:6809/3375787448",' '"heartbeat_front_addr":' '"127.0.0.1:6807/3375787448",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 1, '"uuid":' '"74b26727-75c9-444d-8782-719e4197a382",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 10, '"up_thru":' 84, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6810",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6811",' '"nonce":' 3733255132 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6812",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6813",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6816",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6817",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6814",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6815",' '"nonce":' 3733255132 '}' ']' '},' '"public_addr":' '"127.0.0.1:6811/3733255132",' '"cluster_addr":' '"127.0.0.1:6813/3733255132",' '"heartbeat_back_addr":' '"127.0.0.1:6817/3733255132",' '"heartbeat_front_addr":' '"127.0.0.1:6815/3733255132",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 2, '"uuid":' '"143da3a7-dad9-4b1e-966b-76cf5bdd3c82",' '"up":' 1, '"in":' 0, '"weight":' 0, '"primary_affinity":' 1, '"last_clean_begin":' 15, '"last_clean_end":' 32, '"up_from":' 88, '"up_thru":' 21, '"down_at":' 33, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6818",' '"nonce":' 2576002244 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6819",' '"nonce":' 2576002244 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6820",' '"nonce":' 2576002244 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6821",' '"nonce":' 2576002244 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6824",' '"nonce":' 2576002244 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6825",' '"nonce":' 2576002244 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6822",' '"nonce":' 2576002244 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6823",' '"nonce":' 2576002244 '}' ']' '},' '"public_addr":' '"127.0.0.1:6819/2576002244",' '"cluster_addr":' '"127.0.0.1:6821/2576002244",' '"heartbeat_back_addr":' '"127.0.0.1:6825/2576002244",' '"heartbeat_front_addr":' '"127.0.0.1:6823/2576002244",' '"state":' '[' '"exists",' '"up"' ']' '}' '],' '"osd_xinfo":' '[' '{' '"osd":' 0, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:22.481942+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 1, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:59.663703+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 2, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 65536, '"last_purged_snaps_scrub":' '"2024-09-16T03:24:37.320822+0000",' '"dead_epoch":' 32 '}' '],' '"pg_upmap":' '[],' '"pg_upmap_items":' '[],' '"pg_upmap_primaries":' '[],' '"pg_temp":' '[],' '"primary_temp":' '[],' '"blocklist":' '{},' '"range_blocklist":' '{},' '"erasure_code_profiles":' '{' '"default":' '{' '"k":' '"2",' '"m":' '"2",' '"plugin":' '"jerasure",' '"technique":' '"reed_sol_van"' '}' '},' '"removed_snaps_queue":' '[],' '"new_removed_snaps":' '[],' '"new_purged_snaps":' '[],' '"crush_node_flags":' '{},' '"device_class_flags":' '{},' '"stretch_mode":' '{' '"stretch_mode_enabled":' false, '"stretch_bucket_count":' 0, '"degraded_stretch_mode":' 0, '"recovering_stretch_mode":' 0, '"stretch_mode_bucket":' 0 '}' '},' '"osd_metadata":' '[' '{' '"id":' 0, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/0/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:22:53.662571Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]",' '"hb_front_addr":' '"[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/0",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 1, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/1/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:23:30.129885Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]",' '"hb_front_addr":' '"[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/1",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 2, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6820/2576002244,v1:127.0.0.1:6821/2576002244]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/2/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:24:07.764502Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6818/2576002244,v1:127.0.0.1:6819/2576002244]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6824/2576002244,v1:127.0.0.1:6825/2576002244]",' '"hb_front_addr":' '"[v2:127.0.0.1:6822/2576002244,v1:127.0.0.1:6823/2576002244]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/2",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '}' '],' '"osdmap_clean_epochs":' '{' '"min_last_epoch_clean":' 86, '"last_epoch_clean":' '{' '"per_pool":' '[' '{' '"poolid":' 1, '"floor":' 86 '},' '{' '"poolid":' 2, '"floor":' 86 '}' ']' '},' '"osd_epochs":' '[' '{' '"id":' 0, '"epoch":' 86 '},' '{' '"id":' 1, '"epoch":' 88 '},' '{' '"id":' 2, '"epoch":' 88 '}' ']' '},' '"osdmap_first_committed":' 86, '"osdmap_last_committed":' 88, '"crushmap":' '{' '"devices":' '[' '{' '"id":' 0, '"name":' '"osd.0",' '"class":' '"hdd"' '},' '{' '"id":' 1, '"name":' '"osd.1",' '"class":' '"hdd"' '},' '{' '"id":' 2, '"name":' '"osd.2",' '"class":' '"hdd"' '}' '],' '"types":' '[' '{' '"type_id":' 0, '"name":' '"osd"' '},' '{' '"type_id":' 1, '"name":' '"host"' '},' '{' '"type_id":' 2, '"name":' '"chassis"' '},' '{' '"type_id":' 3, '"name":' '"rack"' '},' '{' '"type_id":' 4, '"name":' '"row"' '},' '{' '"type_id":' 5, '"name":' '"pdu"' '},' '{' '"type_id":' 6, '"name":' '"pod"' '},' '{' '"type_id":' 7, '"name":' '"room"' '},' '{' '"type_id":' 8, '"name":' '"datacenter"' '},' '{' '"type_id":' 9, '"name":' '"zone"' '},' '{' '"type_id":' 10, '"name":' '"region"' '},' '{' '"type_id":' 11, '"name":' '"root"' '}' '],' '"buckets":' '[' '{' '"id":' -1, '"name":' '"default",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -3, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -2, '"name":' '"default~hdd",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -4, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -3, '"name":' '"smithi096",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '},' '{' '"id":' -4, '"name":' '"smithi096~hdd",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '}' '],' '"rules":' '[' '{' '"rule_id":' 0, '"rule_name":' '"replicated_rule",' '"type":' 1, '"steps":' '[' '{' '"op":' '"take",' '"item":' -1, '"item_name":' '"default"' '},' '{' '"op":' '"choose_firstn",' '"num":' 0, '"type":' '"osd"' '},' '{' '"op":' '"emit"' '}' ']' '}' '],' '"tunables":' '{' '"choose_local_tries":' 0, '"choose_local_fallback_tries":' 0, '"choose_total_tries":' 50, '"chooseleaf_descend_once":' 1, '"chooseleaf_vary_r":' 1, '"chooseleaf_stable":' 1, '"msr_descents":' 100, '"msr_collision_tries":' 100, '"straw_calc_version":' 1, '"allowed_bucket_algs":' 54, '"profile":' '"jewel",' '"optimal_tunables":' 1, '"legacy_tunables":' 0, '"minimum_required_version":' '"jewel",' '"require_feature_tunables":' 1, '"require_feature_tunables2":' 1, '"has_v2_rules":' 0, '"require_feature_tunables3":' 1, '"has_v3_rules":' 0, '"has_v4_buckets":' 1, '"require_feature_tunables5":' 1, '"has_v5_rules":' 0, '"has_msr_rules":' 0 '},' '"choose_args":' '{}' '},' '"fsmap":' '{' '"epoch":' 1, '"btime":' '"2024-09-16T03:22:46:882186+0000",' '"default_fscid":' -1, '"compat":' '{' '"compat":' '{},' '"ro_compat":' '{},' '"incompat":' '{' '"feature_1":' '"base' 'v0.20",' '"feature_2":' '"client' writeable 'ranges",' '"feature_3":' '"default' file layouts on 'dirs",' '"feature_4":' '"dir' inode in separate 'object",' '"feature_5":' '"mds' uses versioned 'encoding",' '"feature_6":' '"dirfrag' is stored in 'omap",' '"feature_8":' '"no' anchor 'table",' '"feature_9":' '"file' layout 'v2",' '"feature_10":' '"snaprealm' 'v2",' '"feature_11":' '"minor' log 'segments",' '"feature_12":' '"quiesce' 'subvolumes"' '}' '},' '"feature_flags":' '{' '"enable_multiple":' true, '"ever_enabled_multiple":' true '},' '"standbys":' '[],' '"filesystems":' '[]' '},' '"mdsmap_first_committed":' 1, '"mdsmap_last_committed":' 1, '"auth":' '{' '"first_committed":' 1, '"last_committed":' 5, '"num_secrets":' 3 '},' '"num_pg":' 64, '"num_pg_active":' 64, '"num_pg_unknown":' 0, '"num_osd":' 3, '"pool_sum":' '{' '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 128, '"acting":' 128, '"num_store_stats":' 0 '},' '"osd_sum":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54660, '"kb_used_data":' 888, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660540, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692392960, '"internally_reserved":' 0, '"allocated":' 909312, '"data_stored":' 340707, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 121, '"apply_latency_ms":' 121, '"commit_latency_ns":' 121000000, '"apply_latency_ns":' 121000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '},' '"osd_sum_by_class":' '{' '"hdd":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54660, '"kb_used_data":' 888, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660540, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692392960, '"internally_reserved":' 0, '"allocated":' 909312, '"data_stored":' 340707, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 121, '"apply_latency_ms":' 121, '"commit_latency_ns":' 121000000, '"apply_latency_ns":' 121000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '}' '},' '"pool_stats":' '[' '{' '"poolid":' 2, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '},' '{' '"poolid":' 1, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '}' '],' '"osd_stats":' '[' '{' '"osd":' 0, '"seq":' 21474836523 '},' '{' '"osd":' 1, '"seq":' 42949672995 '},' '{' '"osd":' 2, '"seq":' 1 '}' '],' '"num_pg_by_state":' '[' '{' '"state":' '"active+clean",' '"num":' 64 '}' '],' '"num_pg_by_osd":' '[' '{' '"osd":' 2, '"num_primary_pg":' 0, '"num_acting_pg":' 0, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 0, '"num_primary_pg":' 28, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 1, '"num_primary_pg":' 36, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '}' '],' '"purged_snaps":' '[' '{' '"pool":' 1, '"purged_snaps":' '{}' '},' '{' '"pool":' 2, '"purged_snaps":' '{}' '}' '],' '"servicemap":' '{' '"epoch":' 5, '"modified":' '"2024-09-16T03:25:38.422788+0000",' '"services":' '{}' '},' '"mgrstat_first_committed":' 89, '"mgrstat_last_committed":' 95, '"logm_first_committed":' 1, '"logm_last_committed":' 430, '"paxos":' '{' '"first_committed":' 1, '"last_committed":' 633, '"last_pn":' 0, '"accepted_pn":' 0 '}' '}' 2024-09-16T03:26:18.875 INFO:tasks.workunit.client.0.smithi096.stderr:jq: error: syntax error, unexpected $end (Unix shell quoting issues?) at , line 1: 2024-09-16T03:26:18.875 INFO:tasks.workunit.client.0.smithi096.stderr:.osdmap_clean_epochs.last_epoch_clean.per_pool[] | 2024-09-16T03:26:18.875 INFO:tasks.workunit.client.0.smithi096.stderr:jq: 1 compile error 2024-09-16T03:26:18.875 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:38: check_lec_equals_pools: [[ 0 -eq 2 ]] 2024-09-16T03:26:18.875 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:38: check_lec_equals_pools: echo '{' '"cluster_fingerprint":' '"fda2fc64-07ed-4add-8224-2e527e11d427",' '"version":' '"19.3.0-4930-gfc3e0bff",' '"commit":' '"fc3e0bff7468fd55478adbae7f75508b749124b6",' '"timestamp":' '"2024-09-16T03:26:18.748590+0000",' '"tag":' '"",' '"health":' '{' '"status":' '"HEALTH_OK",' '"checks":' '{},' '"mutes":' '[]' '},' '"monmap_first_committed":' 1, '"monmap_last_committed":' 1, '"monmap":' '{' '"epoch":' 1, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"modified":' '"2024-09-16T03:22:45.872880Z",' '"created":' '"2024-09-16T03:22:45.872880Z",' '"min_mon_release":' 19, '"min_mon_release_name":' '"squid",' '"election_strategy":' 1, '"disallowed_leaders:' '":' '"",' '"stretch_mode":' false, '"tiebreaker_mon":' '"",' '"removed_ranks:' '":' '"",' '"features":' '{' '"persistent":' '[' '"kraken",' '"luminous",' '"mimic",' '"osdmap-prune",' '"nautilus",' '"octopus",' '"pacific",' '"elector-pinging",' '"quincy",' '"reef",' '"squid"' '],' '"optional":' '[]' '},' '"mons":' '[' '{' '"rank":' 0, '"name":' '"a",' '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:7302",' '"nonce":' 0 '}' ']' '},' '"addr":' '"127.0.0.1:7302/0",' '"public_addr":' '"127.0.0.1:7302/0",' '"priority":' 0, '"weight":' 0, '"crush_location":' '"{}"' '}' ']' '},' '"quorum":' '[' 0 '],' '"osdmap":' '{' '"epoch":' 88, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"created":' '"2024-09-16T03:22:46.906117+0000",' '"modified":' '"2024-09-16T03:26:15.120212+0000",' '"last_up_change":' '"2024-09-16T03:26:15.120212+0000",' '"last_in_change":' '"2024-09-16T03:25:09.839444+0000",' '"flags":' '"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit",' '"flags_num":' 5799936, '"flags_set":' '[' '"pglog_hardlimit",' '"purged_snapdirs",' '"recovery_deletes",' '"sortbitwise"' '],' '"crush_version":' 8, '"full_ratio":' 0.97000002861022949, '"backfillfull_ratio":' 0.97000002861022949, '"nearfull_ratio":' 0.85000002384185791, '"cluster_snapshot":' '"",' '"pool_max":' 2, '"max_osd":' 3, '"require_min_compat_client":' '"luminous",' '"min_compat_client":' '"jewel",' '"require_osd_release":' '"squid",' '"allow_crimson":' false, '"pools":' '[' '{' '"pool":' 1, '"pool_name":' '"foo",' '"create_time":' '"2024-09-16T03:24:44.525189+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 2, '"min_size":' 1, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"85",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.8700000047683716, '"score_stable":' 1.8700000047683716, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1.25, '"raw_score_stable":' 1.25, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '},' '{' '"pool":' 2, '"pool_name":' '"bar",' '"create_time":' '"2024-09-16T03:24:46.226575+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 2, '"min_size":' 1, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"83",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.4900000095367432, '"score_stable":' 1.4900000095367432, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1, '"raw_score_stable":' 1, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '}' '],' '"osds":' '[' '{' '"osd":' 0, '"uuid":' '"64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 5, '"up_thru":' 84, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6802",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6803",' '"nonce":' 3375787448 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6804",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6805",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6808",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6809",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6806",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6807",' '"nonce":' 3375787448 '}' ']' '},' '"public_addr":' '"127.0.0.1:6803/3375787448",' '"cluster_addr":' '"127.0.0.1:6805/3375787448",' '"heartbeat_back_addr":' '"127.0.0.1:6809/3375787448",' '"heartbeat_front_addr":' '"127.0.0.1:6807/3375787448",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 1, '"uuid":' '"74b26727-75c9-444d-8782-719e4197a382",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 10, '"up_thru":' 84, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6810",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6811",' '"nonce":' 3733255132 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6812",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6813",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6816",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6817",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6814",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6815",' '"nonce":' 3733255132 '}' ']' '},' '"public_addr":' '"127.0.0.1:6811/3733255132",' '"cluster_addr":' '"127.0.0.1:6813/3733255132",' '"heartbeat_back_addr":' '"127.0.0.1:6817/3733255132",' '"heartbeat_front_addr":' '"127.0.0.1:6815/3733255132",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 2, '"uuid":' '"143da3a7-dad9-4b1e-966b-76cf5bdd3c82",' '"up":' 1, '"in":' 0, '"weight":' 0, '"primary_affinity":' 1, '"last_clean_begin":' 15, '"last_clean_end":' 32, '"up_from":' 88, '"up_thru":' 21, '"down_at":' 33, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6818",' '"nonce":' 2576002244 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6819",' '"nonce":' 2576002244 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6820",' '"nonce":' 2576002244 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6821",' '"nonce":' 2576002244 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6824",' '"nonce":' 2576002244 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6825",' '"nonce":' 2576002244 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6822",' '"nonce":' 2576002244 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6823",' '"nonce":' 2576002244 '}' ']' '},' '"public_addr":' '"127.0.0.1:6819/2576002244",' '"cluster_addr":' '"127.0.0.1:6821/2576002244",' '"heartbeat_back_addr":' '"127.0.0.1:6825/2576002244",' '"heartbeat_front_addr":' '"127.0.0.1:6823/2576002244",' '"state":' '[' '"exists",' '"up"' ']' '}' '],' '"osd_xinfo":' '[' '{' '"osd":' 0, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:22.481942+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 1, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:59.663703+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 2, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 65536, '"last_purged_snaps_scrub":' '"2024-09-16T03:24:37.320822+0000",' '"dead_epoch":' 32 '}' '],' '"pg_upmap":' '[],' '"pg_upmap_items":' '[],' '"pg_upmap_primaries":' '[],' '"pg_temp":' '[],' '"primary_temp":' '[],' '"blocklist":' '{},' '"range_blocklist":' '{},' '"erasure_code_profiles":' '{' '"default":' '{' '"k":' '"2",' '"m":' '"2",' '"plugin":' '"jerasure",' '"technique":' '"reed_sol_van"' '}' '},' '"removed_snaps_queue":' '[],' '"new_removed_snaps":' '[],' '"new_purged_snaps":' '[],' '"crush_node_flags":' '{},' '"device_class_flags":' '{},' '"stretch_mode":' '{' '"stretch_mode_enabled":' false, '"stretch_bucket_count":' 0, '"degraded_stretch_mode":' 0, '"recovering_stretch_mode":' 0, '"stretch_mode_bucket":' 0 '}' '},' '"osd_metadata":' '[' '{' '"id":' 0, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/0/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:22:53.662571Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]",' '"hb_front_addr":' '"[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/0",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 1, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/1/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:23:30.129885Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]",' '"hb_front_addr":' '"[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/1",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 2, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6820/2576002244,v1:127.0.0.1:6821/2576002244]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/2/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:24:07.764502Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6818/2576002244,v1:127.0.0.1:6819/2576002244]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6824/2576002244,v1:127.0.0.1:6825/2576002244]",' '"hb_front_addr":' '"[v2:127.0.0.1:6822/2576002244,v1:127.0.0.1:6823/2576002244]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/2",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '}' '],' '"osdmap_clean_epochs":' '{' '"min_last_epoch_clean":' 86, '"last_epoch_clean":' '{' '"per_pool":' '[' '{' '"poolid":' 1, '"floor":' 86 '},' '{' '"poolid":' 2, '"floor":' 86 '}' ']' '},' '"osd_epochs":' '[' '{' '"id":' 0, '"epoch":' 86 '},' '{' '"id":' 1, '"epoch":' 88 '},' '{' '"id":' 2, '"epoch":' 88 '}' ']' '},' '"osdmap_first_committed":' 86, '"osdmap_last_committed":' 88, '"crushmap":' '{' '"devices":' '[' '{' '"id":' 0, '"name":' '"osd.0",' '"class":' '"hdd"' '},' '{' '"id":' 1, '"name":' '"osd.1",' '"class":' '"hdd"' '},' '{' '"id":' 2, '"name":' '"osd.2",' '"class":' '"hdd"' '}' '],' '"types":' '[' '{' '"type_id":' 0, '"name":' '"osd"' '},' '{' '"type_id":' 1, '"name":' '"host"' '},' '{' '"type_id":' 2, '"name":' '"chassis"' '},' '{' '"type_id":' 3, '"name":' '"rack"' '},' '{' '"type_id":' 4, '"name":' '"row"' '},' '{' '"type_id":' 5, '"name":' '"pdu"' '},' '{' '"type_id":' 6, '"name":' '"pod"' '},' '{' '"type_id":' 7, '"name":' '"room"' '},' '{' '"type_id":' 8, '"name":' '"datacenter"' '},' '{' '"type_id":' 9, '"name":' '"zone"' '},' '{' '"type_id":' 10, '"name":' '"region"' '},' '{' '"type_id":' 11, '"name":' '"root"' '}' '],' '"buckets":' '[' '{' '"id":' -1, '"name":' '"default",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -3, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -2, '"name":' '"default~hdd",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -4, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -3, '"name":' '"smithi096",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '},' '{' '"id":' -4, '"name":' '"smithi096~hdd",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '}' '],' '"rules":' '[' '{' '"rule_id":' 0, '"rule_name":' '"replicated_rule",' '"type":' 1, '"steps":' '[' '{' '"op":' '"take",' '"item":' -1, '"item_name":' '"default"' '},' '{' '"op":' '"choose_firstn",' '"num":' 0, '"type":' '"osd"' '},' '{' '"op":' '"emit"' '}' ']' '}' '],' '"tunables":' '{' '"choose_local_tries":' 0, '"choose_local_fallback_tries":' 0, '"choose_total_tries":' 50, '"chooseleaf_descend_once":' 1, '"chooseleaf_vary_r":' 1, '"chooseleaf_stable":' 1, '"msr_descents":' 100, '"msr_collision_tries":' 100, '"straw_calc_version":' 1, '"allowed_bucket_algs":' 54, '"profile":' '"jewel",' '"optimal_tunables":' 1, '"legacy_tunables":' 0, '"minimum_required_version":' '"jewel",' '"require_feature_tunables":' 1, '"require_feature_tunables2":' 1, '"has_v2_rules":' 0, '"require_feature_tunables3":' 1, '"has_v3_rules":' 0, '"has_v4_buckets":' 1, '"require_feature_tunables5":' 1, '"has_v5_rules":' 0, '"has_msr_rules":' 0 '},' '"choose_args":' '{}' '},' '"fsmap":' '{' '"epoch":' 1, '"btime":' '"2024-09-16T03:22:46:882186+0000",' '"default_fscid":' -1, '"compat":' '{' '"compat":' '{},' '"ro_compat":' '{},' '"incompat":' '{' '"feature_1":' '"base' 'v0.20",' '"feature_2":' '"client' writeable 'ranges",' '"feature_3":' '"default' file layouts on 'dirs",' '"feature_4":' '"dir' inode in separate 'object",' '"feature_5":' '"mds' uses versioned 'encoding",' '"feature_6":' '"dirfrag' is stored in 'omap",' '"feature_8":' '"no' anchor 'table",' '"feature_9":' '"file' layout 'v2",' '"feature_10":' '"snaprealm' 'v2",' '"feature_11":' '"minor' log 'segments",' '"feature_12":' '"quiesce' 'subvolumes"' '}' '},' '"feature_flags":' '{' '"enable_multiple":' true, '"ever_enabled_multiple":' true '},' '"standbys":' '[],' '"filesystems":' '[]' '},' '"mdsmap_first_committed":' 1, '"mdsmap_last_committed":' 1, '"auth":' '{' '"first_committed":' 1, '"last_committed":' 5, '"num_secrets":' 3 '},' '"num_pg":' 64, '"num_pg_active":' 64, '"num_pg_unknown":' 0, '"num_osd":' 3, '"pool_sum":' '{' '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 128, '"acting":' 128, '"num_store_stats":' 0 '},' '"osd_sum":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54660, '"kb_used_data":' 888, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660540, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692392960, '"internally_reserved":' 0, '"allocated":' 909312, '"data_stored":' 340707, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 121, '"apply_latency_ms":' 121, '"commit_latency_ns":' 121000000, '"apply_latency_ns":' 121000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '},' '"osd_sum_by_class":' '{' '"hdd":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54660, '"kb_used_data":' 888, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660540, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692392960, '"internally_reserved":' 0, '"allocated":' 909312, '"data_stored":' 340707, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 121, '"apply_latency_ms":' 121, '"commit_latency_ns":' 121000000, '"apply_latency_ns":' 121000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '}' '},' '"pool_stats":' '[' '{' '"poolid":' 2, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '},' '{' '"poolid":' 1, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '}' '],' '"osd_stats":' '[' '{' '"osd":' 0, '"seq":' 21474836523 '},' '{' '"osd":' 1, '"seq":' 42949672995 '},' '{' '"osd":' 2, '"seq":' 1 '}' '],' '"num_pg_by_state":' '[' '{' '"state":' '"active+clean",' '"num":' 64 '}' '],' '"num_pg_by_osd":' '[' '{' '"osd":' 2, '"num_primary_pg":' 0, '"num_acting_pg":' 0, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 0, '"num_primary_pg":' 28, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 1, '"num_primary_pg":' 36, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '}' '],' '"purged_snaps":' '[' '{' '"pool":' 1, '"purged_snaps":' '{}' '},' '{' '"pool":' 2, '"purged_snaps":' '{}' '}' '],' '"servicemap":' '{' '"epoch":' 5, '"modified":' '"2024-09-16T03:25:38.422788+0000",' '"services":' '{}' '},' '"mgrstat_first_committed":' 89, '"mgrstat_last_committed":' 95, '"logm_first_committed":' 1, '"logm_last_committed":' 430, '"paxos":' '{' '"first_committed":' 1, '"last_committed":' 633, '"last_pn":' 0, '"accepted_pn":' 0 '}' '}' 2024-09-16T03:26:18.876 INFO:tasks.workunit.client.0.smithi096.stdout:{ "cluster_fingerprint": "fda2fc64-07ed-4add-8224-2e527e11d427", "version": "19.3.0-4930-gfc3e0bff", "commit": "fc3e0bff7468fd55478adbae7f75508b749124b6", "timestamp": "2024-09-16T03:26:18.748590+0000", "tag": "", "health": { "status": "HEALTH_OK", "checks": {}, "mutes": [] }, "monmap_first_committed": 1, "monmap_last_committed": 1, "monmap": { "epoch": 1, "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", "modified": "2024-09-16T03:22:45.872880Z", "created": "2024-09-16T03:22:45.872880Z", "min_mon_release": 19, "min_mon_release_name": "squid", "election_strategy": 1, "disallowed_leaders: ": "", "stretch_mode": false, "tiebreaker_mon": "", "removed_ranks: ": "", "features": { "persistent": [ "kraken", "luminous", "mimic", "osdmap-prune", "nautilus", "octopus", "pacific", "elector-pinging", "quincy", "reef", "squid" ], "optional": [] }, "mons": [ { "rank": 0, "name": "a", "public_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:7302", "nonce": 0 } ] }, "addr": "127.0.0.1:7302/0", "public_addr": "127.0.0.1:7302/0", "priority": 0, "weight": 0, "crush_location": "{}" } ] }, "quorum": [ 0 ], "osdmap": { "epoch": 88, "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", "created": "2024-09-16T03:22:46.906117+0000", "modified": "2024-09-16T03:26:15.120212+0000", "last_up_change": "2024-09-16T03:26:15.120212+0000", "last_in_change": "2024-09-16T03:25:09.839444+0000", "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", "flags_num": 5799936, "flags_set": [ "pglog_hardlimit", "purged_snapdirs", "recovery_deletes", "sortbitwise" ], "crush_version": 8, "full_ratio": 0.97000002861022949, "backfillfull_ratio": 0.97000002861022949, "nearfull_ratio": 0.85000002384185791, "cluster_snapshot": "", "pool_max": 2, "max_osd": 3, "require_min_compat_client": "luminous", "min_compat_client": "jewel", "require_osd_release": "squid", "allow_crimson": false, "pools": [ { "pool": 1, "pool_name": "foo", "create_time": "2024-09-16T03:24:44.525189+0000", "flags": 1, "flags_names": "hashpspool", "type": 1, "size": 2, "min_size": 1, "crush_rule": 0, "peering_crush_bucket_count": 0, "peering_crush_bucket_target": 0, "peering_crush_bucket_barrier": 0, "peering_crush_bucket_mandatory_member": 2147483647, "is_stretch_pool": false, "object_hash": 2, "pg_autoscale_mode": "off", "pg_num": 32, "pg_placement_num": 32, "pg_placement_num_target": 32, "pg_num_target": 32, "pg_num_pending": 32, "last_pg_merge_meta": { "source_pgid": "0.0", "ready_epoch": 0, "last_epoch_started": 0, "last_epoch_clean": 0, "source_version": "0'0", "target_version": "0'0" }, "last_change": "85", "last_force_op_resend": "0", "last_force_op_resend_prenautilus": "0", "last_force_op_resend_preluminous": "0", "auid": 0, "snap_mode": "selfmanaged", "snap_seq": 0, "snap_epoch": 0, "pool_snaps": [], "removed_snaps": "[]", "quota_max_bytes": 0, "quota_max_objects": 0, "tiers": [], "tier_of": -1, "read_tier": -1, "write_tier": -1, "cache_mode": "none", "target_max_bytes": 0, "target_max_objects": 0, "cache_target_dirty_ratio_micro": 400000, "cache_target_dirty_high_ratio_micro": 600000, "cache_target_full_ratio_micro": 800000, "cache_min_flush_age": 0, "cache_min_evict_age": 0, "erasure_code_profile": "", "hit_set_params": { "type": "none" }, "hit_set_period": 0, "hit_set_count": 0, "use_gmt_hitset": true, "min_read_recency_for_promote": 0, "min_write_recency_for_promote": 0, "hit_set_grade_decay_rate": 0, "hit_set_search_last_n": 0, "grade_table": [], "stripe_width": 0, "expected_num_objects": 0, "fast_read": false, "options": {}, "application_metadata": {}, "read_balance": { "score_type": "Fair distribution", "score_acting": 1.8700000047683716, "score_stable": 1.8700000047683716, "optimal_score": 0.67000001668930054, "raw_score_acting": 1.25, "raw_score_stable": 1.25, "primary_affinity_weighted": 1, "average_primary_affinity": 1, "average_primary_affinity_weighted": 1 } }, { "pool": 2, "pool_name": "bar", "create_time": "2024-09-16T03:24:46.226575+0000", "flags": 1, "flags_names": "hashpspool", "type": 1, "size": 2, "min_size": 1, "crush_rule": 0, "peering_crush_bucket_count": 0, "peering_crush_bucket_target": 0, "peering_crush_bucket_barrier": 0, "peering_crush_bucket_mandatory_member": 2147483647, "is_stretch_pool": false, "object_hash": 2, "pg_autoscale_mode": "off", "pg_num": 32, "pg_placement_num": 32, "pg_placement_num_target": 32, "pg_num_target": 32, "pg_num_pending": 32, "last_pg_merge_meta": { "source_pgid": "0.0", "ready_epoch": 0, "last_epoch_started": 0, "last_epoch_clean": 0, "source_version": "0'0", "target_version": "0'0" }, "last_change": "83", "last_force_op_resend": "0", "last_force_op_resend_prenautilus": "0", "last_force_op_resend_preluminous": "0", "auid": 0, "snap_mode": "selfmanaged", "snap_seq": 0, "snap_epoch": 0, "pool_snaps": [], "removed_snaps": "[]", "quota_max_bytes": 0, "quota_max_objects": 0, "tiers": [], "tier_of": -1, "read_tier": -1, "write_tier": -1, "cache_mode": "none", "target_max_bytes": 0, "target_max_objects": 0, "cache_target_dirty_ratio_micro": 400000, "cache_target_dirty_high_ratio_micro": 600000, "cache_target_full_ratio_micro": 800000, "cache_min_flush_age": 0, "cache_min_evict_age": 0, "erasure_code_profile": "", "hit_set_params": { "type": "none" }, "hit_set_period": 0, "hit_set_count": 0, "use_gmt_hitset": true, "min_read_recency_for_promote": 0, "min_write_recency_for_promote": 0, "hit_set_grade_decay_rate": 0, "hit_set_search_last_n": 0, "grade_table": [], "stripe_width": 0, "expected_num_objects": 0, "fast_read": false, "options": {}, "application_metadata": {}, "read_balance": { "score_type": "Fair distribution", "score_acting": 1.4900000095367432, "score_stable": 1.4900000095367432, "optimal_score": 0.67000001668930054, "raw_score_acting": 1, "raw_score_stable": 1, "primary_affinity_weighted": 1, "average_primary_affinity": 1, "average_primary_affinity_weighted": 1 } } ], "osds": [ { "osd": 0, "uuid": "64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6", "up": 1, "in": 1, "weight": 1, "primary_affinity": 1, "last_clean_begin": 0, "last_clean_end": 0, "up_from": 5, "up_thru": 84, "down_at": 0, "lost_at": 0, "public_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6802", "nonce": 3375787448 }, { "type": "v1", "addr": "127.0.0.1:6803", "nonce": 3375787448 } ] }, "cluster_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6804", "nonce": 3375787448 }, { "type": "v1", "addr": "127.0.0.1:6805", "nonce": 3375787448 } ] }, "heartbeat_back_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6808", "nonce": 3375787448 }, { "type": "v1", "addr": "127.0.0.1:6809", "nonce": 3375787448 } ] }, "heartbeat_front_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6806", "nonce": 3375787448 }, { "type": "v1", "addr": "127.0.0.1:6807", "nonce": 3375787448 } ] }, "public_addr": "127.0.0.1:6803/3375787448", "cluster_addr": "127.0.0.1:6805/3375787448", "heartbeat_back_addr": "127.0.0.1:6809/3375787448", "heartbeat_front_addr": "127.0.0.1:6807/3375787448", "state": [ "exists", "up" ] }, { "osd": 1, "uuid": "74b26727-75c9-444d-8782-719e4197a382", "up": 1, "in": 1, "weight": 1, "primary_affinity": 1, "last_clean_begin": 0, "last_clean_end": 0, "up_from": 10, "up_thru": 84, "down_at": 0, "lost_at": 0, "public_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6810", "nonce": 3733255132 }, { "type": "v1", "addr": "127.0.0.1:6811", "nonce": 3733255132 } ] }, "cluster_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6812", "nonce": 3733255132 }, { "type": "v1", "addr": "127.0.0.1:6813", "nonce": 3733255132 } ] }, "heartbeat_back_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6816", "nonce": 3733255132 }, { "type": "v1", "addr": "127.0.0.1:6817", "nonce": 3733255132 } ] }, "heartbeat_front_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6814", "nonce": 3733255132 }, { "type": "v1", "addr": "127.0.0.1:6815", "nonce": 3733255132 } ] }, "public_addr": "127.0.0.1:6811/3733255132", "cluster_addr": "127.0.0.1:6813/3733255132", "heartbeat_back_addr": "127.0.0.1:6817/3733255132", "heartbeat_front_addr": "127.0.0.1:6815/3733255132", "state": [ "exists", "up" ] }, { "osd": 2, "uuid": "143da3a7-dad9-4b1e-966b-76cf5bdd3c82", "up": 1, "in": 0, "weight": 0, "primary_affinity": 1, "last_clean_begin": 15, "last_clean_end": 32, "up_from": 88, "up_thru": 21, "down_at": 33, "lost_at": 0, "public_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6818", "nonce": 2576002244 }, { "type": "v1", "addr": "127.0.0.1:6819", "nonce": 2576002244 } ] }, "cluster_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6820", "nonce": 2576002244 }, { "type": "v1", "addr": "127.0.0.1:6821", "nonce": 2576002244 } ] }, "heartbeat_back_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6824", "nonce": 2576002244 }, { "type": "v1", "addr": "127.0.0.1:6825", "nonce": 2576002244 } ] }, "heartbeat_front_addrs": { "addrvec": [ { "type": "v2", "addr": "127.0.0.1:6822", "nonce": 2576002244 }, { "type": "v1", "addr": "127.0.0.1:6823", "nonce": 2576002244 } ] }, "public_addr": "127.0.0.1:6819/2576002244", "cluster_addr": "127.0.0.1:6821/2576002244", "heartbeat_back_addr": "127.0.0.1:6825/2576002244", "heartbeat_front_addr": "127.0.0.1:6823/2576002244", "state": [ "exists", "up" ] } ], "osd_xinfo": [ { "osd": 0, "down_stamp": "0.000000", "laggy_probability": 0, "laggy_interval": 0, "features": 4540719139924082687, "old_weight": 0, "last_purged_snaps_scrub": "2024-09-16T03:23:22.481942+0000", "dead_epoch": 0 }, { "osd": 1, "down_stamp": "0.000000", "laggy_probability": 0, "laggy_interval": 0, "features": 4540719139924082687, "old_weight": 0, "last_purged_snaps_scrub": "2024-09-16T03:23:59.663703+0000", "dead_epoch": 0 }, { "osd": 2, "down_stamp": "0.000000", "laggy_probability": 0, "laggy_interval": 0, "features": 4540719139924082687, "old_weight": 65536, "last_purged_snaps_scrub": "2024-09-16T03:24:37.320822+0000", "dead_epoch": 32 } ], "pg_upmap": [], "pg_upmap_items": [], "pg_upmap_primaries": [], "pg_temp": [], "primary_temp": [], "blocklist": {}, "range_blocklist": {}, "erasure_code_profiles": { "default": { "k": "2", "m": "2", "plugin": "jerasure", "technique": "reed_sol_van" } }, "removed_snaps_queue": [], "new_removed_snaps": [], "new_purged_snaps": [], "crush_node_flags": {}, "device_class_flags": {}, "stretch_mode": { "stretch_mode_enabled": false, "stretch_bucket_count": 0, "degraded_stretch_mode": 0, "recovering_stretch_mode": 0, "stretch_mode_bucket": 0 } }, "osd_metadata": [ { "id": 0, "arch": "x86_64", "back_addr": "[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]", "back_iface": "", "bluefs": "1", "bluefs_dedicated_db": "0", "bluefs_dedicated_wal": "0", "bluefs_single_shared_device": "1", "bluestore_allocation_from_file": "0", "bluestore_bdev_access_mode": "file", "bluestore_bdev_block_size": "4096", "bluestore_bdev_devices": "sda", "bluestore_bdev_driver": "KernelDevice", "bluestore_bdev_optimal_io_size": "0", "bluestore_bdev_path": "td/mon-last-clean-epoch/0/block", "bluestore_bdev_rotational": "1", "bluestore_bdev_size": "107374182400", "bluestore_bdev_support_discard": "0", "bluestore_bdev_type": "hdd", "bluestore_min_alloc_size": "4096", "ceph_release": "squid", "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", "ceph_version_short": "19.3.0-4930-gfc3e0bff", "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", "created_at": "2024-09-16T03:22:53.662571Z", "default_device_class": "hdd", "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", "devices": "sda", "distro": "ubuntu", "distro_description": "Ubuntu 22.04.1 LTS", "distro_version": "22.04", "front_addr": "[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]", "front_iface": "", "hb_back_addr": "[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]", "hb_front_addr": "[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]", "hostname": "smithi096", "journal_rotational": "1", "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", "kernel_version": "5.15.0-121-generic", "mem_swap_kb": "2097148", "mem_total_kb": "32746824", "network_numa_unknown_ifaces": "back_iface,front_iface", "objectstore_numa_unknown_devices": "sda", "os": "Linux", "osd_data": "td/mon-last-clean-epoch/0", "osd_objectstore": "bluestore", "osdspec_affinity": "", "rotational": "1" }, { "id": 1, "arch": "x86_64", "back_addr": "[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]", "back_iface": "", "bluefs": "1", "bluefs_dedicated_db": "0", "bluefs_dedicated_wal": "0", "bluefs_single_shared_device": "1", "bluestore_allocation_from_file": "0", "bluestore_bdev_access_mode": "file", "bluestore_bdev_block_size": "4096", "bluestore_bdev_devices": "sda", "bluestore_bdev_driver": "KernelDevice", "bluestore_bdev_optimal_io_size": "0", "bluestore_bdev_path": "td/mon-last-clean-epoch/1/block", "bluestore_bdev_rotational": "1", "bluestore_bdev_size": "107374182400", "bluestore_bdev_support_discard": "0", "bluestore_bdev_type": "hdd", "bluestore_min_alloc_size": "4096", "ceph_release": "squid", "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", "ceph_version_short": "19.3.0-4930-gfc3e0bff", "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", "created_at": "2024-09-16T03:23:30.129885Z", "default_device_class": "hdd", "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", "devices": "sda", "distro": "ubuntu", "distro_description": "Ubuntu 22.04.1 LTS", "distro_version": "22.04", "front_addr": "[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]", "front_iface": "", "hb_back_addr": "[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]", "hb_front_addr": "[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]", "hostname": "smithi096", "journal_rotational": "1", "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", "kernel_version": "5.15.0-121-generic", "mem_swap_kb": "2097148", "mem_total_kb": "32746824", "network_numa_unknown_ifaces": "back_iface,front_iface", "objectstore_numa_unknown_devices": "sda", "os": "Linux", "osd_data": "td/mon-last-clean-epoch/1", "osd_objectstore": "bluestore", "osdspec_affinity": "", "rotational": "1" }, { "id": 2, "arch": "x86_64", "back_addr": "[v2:127.0.0.1:6820/2576002244,v1:127.0.0.1:6821/2576002244]", "back_iface": "", "bluefs": "1", "bluefs_dedicated_db": "0", "bluefs_dedicated_wal": "0", "bluefs_single_shared_device": "1", "bluestore_allocation_from_file": "0", "bluestore_bdev_access_mode": "file", "bluestore_bdev_block_size": "4096", "bluestore_bdev_devices": "sda", "bluestore_bdev_driver": "KernelDevice", "bluestore_bdev_optimal_io_size": "0", "bluestore_bdev_path": "td/mon-last-clean-epoch/2/block", "bluestore_bdev_rotational": "1", "bluestore_bdev_size": "107374182400", "bluestore_bdev_support_discard": "0", "bluestore_bdev_type": "hdd", "bluestore_min_alloc_size": "4096", "ceph_release": "squid", "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", "ceph_version_short": "19.3.0-4930-gfc3e0bff", "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", "created_at": "2024-09-16T03:24:07.764502Z", "default_device_class": "hdd", "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", "devices": "sda", "distro": "ubuntu", "distro_description": "Ubuntu 22.04.1 LTS", "distro_version": "22.04", "front_addr": "[v2:127.0.0.1:6818/2576002244,v1:127.0.0.1:6819/2576002244]", "front_iface": "", "hb_back_addr": "[v2:127.0.0.1:6824/2576002244,v1:127.0.0.1:6825/2576002244]", "hb_front_addr": "[v2:127.0.0.1:6822/2576002244,v1:127.0.0.1:6823/2576002244]", "hostname": "smithi096", "journal_rotational": "1", "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", "kernel_version": "5.15.0-121-generic", "mem_swap_kb": "2097148", "mem_total_kb": "32746824", "network_numa_unknown_ifaces": "back_iface,front_iface", "objectstore_numa_unknown_devices": "sda", "os": "Linux", "osd_data": "td/mon-last-clean-epoch/2", "osd_objectstore": "bluestore", "osdspec_affinity": "", "rotational": "1" } ], "osdmap_clean_epochs": { "min_last_epoch_clean": 86, "last_epoch_clean": { "per_pool": [ { "poolid": 1, "floor": 86 }, { "poolid": 2, "floor": 86 } ] }, "osd_epochs": [ { "id": 0, "epoch": 86 }, { "id": 1, "epoch": 88 }, { "id": 2, "epoch": 88 } ] }, "osdmap_first_committed": 86, "osdmap_last_committed": 88, "crushmap": { "devices": [ { "id": 0, "name": "osd.0", "class": "hdd" }, { "id": 1, "name": "osd.1", "class": "hdd" }, { "id": 2, "name": "osd.2", "class": "hdd" } ], "types": [ { "type_id": 0, "name": "osd" }, { "type_id": 1, "name": "host" }, { "type_id": 2, "name": "chassis" }, { "type_id": 3, "name": "rack" }, { "type_id": 4, "name": "row" }, { "type_id": 5, "name": "pdu" }, { "type_id": 6, "name": "pod" }, { "type_id": 7, "name": "room" }, { "type_id": 8, "name": "datacenter" }, { "type_id": 9, "name": "zone" }, { "type_id": 10, "name": "region" }, { "type_id": 11, "name": "root" } ], "buckets": [ { "id": -1, "name": "default", "type_id": 11, "type_name": "root", "weight": 19206, "alg": "straw2", "hash": "rjenkins1", "items": [ { "id": -3, "weight": 19206, "pos": 0 } ] }, { "id": -2, "name": "default~hdd", "type_id": 11, "type_name": "root", "weight": 19206, "alg": "straw2", "hash": "rjenkins1", "items": [ { "id": -4, "weight": 19206, "pos": 0 } ] }, { "id": -3, "name": "smithi096", "type_id": 1, "type_name": "host", "weight": 19206, "alg": "straw2", "hash": "rjenkins1", "items": [ { "id": 0, "weight": 6402, "pos": 0 }, { "id": 1, "weight": 6402, "pos": 1 }, { "id": 2, "weight": 6402, "pos": 2 } ] }, { "id": -4, "name": "smithi096~hdd", "type_id": 1, "type_name": "host", "weight": 19206, "alg": "straw2", "hash": "rjenkins1", "items": [ { "id": 0, "weight": 6402, "pos": 0 }, { "id": 1, "weight": 6402, "pos": 1 }, { "id": 2, "weight": 6402, "pos": 2 } ] } ], "rules": [ { "rule_id": 0, "rule_name": "replicated_rule", "type": 1, "steps": [ { "op": "take", "item": -1, "item_name": "default" }, { "op": "choose_firstn", "num": 0, "type": "osd" }, { "op": "emit" } ] } ], "tunables": { "choose_local_tries": 0, "choose_local_fallback_tries": 0, "choose_total_tries": 50, "chooseleaf_descend_once": 1, "chooseleaf_vary_r": 1, "chooseleaf_stable": 1, "msr_descents": 100, "msr_collision_tries": 100, "straw_calc_version": 1, "allowed_bucket_algs": 54, "profile": "jewel", "optimal_tunables": 1, "legacy_tunables": 0, "minimum_required_version": "jewel", "require_feature_tunables": 1, "require_feature_tunables2": 1, "has_v2_rules": 0, "require_feature_tunables3": 1, "has_v3_rules": 0, "has_v4_buckets": 1, "require_feature_tunables5": 1, "has_v5_rules": 0, "has_msr_rules": 0 }, "choose_args": {} }, "fsmap": { "epoch": 1, "btime": "2024-09-16T03:22:46:882186+0000", "default_fscid": -1, "compat": { "compat": {}, "ro_compat": {}, "incompat": { "feature_1": "base v0.20", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes" } }, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "standbys": [], "filesystems": [] }, "mdsmap_first_committed": 1, "mdsmap_last_committed": 1, "auth": { "first_committed": 1, "last_committed": 5, "num_secrets": 3 }, "num_pg": 64, "num_pg_active": 64, "num_pg_unknown": 0, "num_osd": 3, "pool_sum": { "stat_sum": { "num_bytes": 0, "num_objects": 0, "num_object_clones": 0, "num_object_copies": 0, "num_objects_missing_on_primary": 0, "num_objects_missing": 0, "num_objects_degraded": 0, "num_objects_misplaced": 0, "num_objects_unfound": 0, "num_objects_dirty": 0, "num_whiteouts": 0, "num_read": 0, "num_read_kb": 0, "num_write": 0, "num_write_kb": 0, "num_scrub_errors": 0, "num_shallow_scrub_errors": 0, "num_deep_scrub_errors": 0, "num_objects_recovered": 0, "num_bytes_recovered": 0, "num_keys_recovered": 0, "num_objects_omap": 0, "num_objects_hit_set_archive": 0, "num_bytes_hit_set_archive": 0, "num_flush": 0, "num_flush_kb": 0, "num_evict": 0, "num_evict_kb": 0, "num_promote": 0, "num_flush_mode_high": 0, "num_flush_mode_low": 0, "num_evict_mode_some": 0, "num_evict_mode_full": 0, "num_objects_pinned": 0, "num_legacy_snapsets": 0, "num_large_omap_objects": 0, "num_objects_manifest": 0, "num_omap_bytes": 0, "num_omap_keys": 0, "num_objects_repaired": 0 }, "store_stats": { "total": 0, "available": 0, "internally_reserved": 0, "allocated": 0, "data_stored": 0, "data_compressed": 0, "data_compressed_allocated": 0, "data_compressed_original": 0, "omap_allocated": 0, "internal_metadata": 0 }, "log_size": 0, "ondisk_log_size": 0, "up": 128, "acting": 128, "num_store_stats": 0 }, "osd_sum": { "up_from": 0, "seq": 0, "num_pgs": 128, "num_osds": 2, "num_per_pool_osds": 2, "num_per_pool_omap_osds": 2, "kb": 209715200, "kb_used": 54660, "kb_used_data": 888, "kb_used_omap": 3, "kb_used_meta": 53628, "kb_avail": 209660540, "statfs": { "total": 214748364800, "available": 214692392960, "internally_reserved": 0, "allocated": 909312, "data_stored": 340707, "data_compressed": 0, "data_compressed_allocated": 0, "data_compressed_original": 0, "omap_allocated": 3190, "internal_metadata": 54915978 }, "hb_peers": [], "snap_trim_queue_len": 0, "num_snap_trimming": 0, "num_shards_repaired": 0, "op_queue_age_hist": { "histogram": [], "upper_bound": 1 }, "perf_stat": { "commit_latency_ms": 121, "apply_latency_ms": 121, "commit_latency_ns": 121000000, "apply_latency_ns": 121000000 }, "alerts": [], "network_ping_times": [] }, "osd_sum_by_class": { "hdd": { "up_from": 0, "seq": 0, "num_pgs": 128, "num_osds": 2, "num_per_pool_osds": 2, "num_per_pool_omap_osds": 2, "kb": 209715200, "kb_used": 54660, "kb_used_data": 888, "kb_used_omap": 3, "kb_used_meta": 53628, "kb_avail": 209660540, "statfs": { "total": 214748364800, "available": 214692392960, "internally_reserved": 0, "allocated": 909312, "data_stored": 340707, "data_compressed": 0, "data_compressed_allocated": 0, "data_compressed_original": 0, "omap_allocated": 3190, "internal_metadata": 54915978 }, "hb_peers": [], "snap_trim_queue_len": 0, "num_snap_trimming": 0, "num_shards_repaired": 0, "op_queue_age_hist": { "histogram": [], "upper_bound": 1 }, "perf_stat": { "commit_latency_ms": 121, "apply_latency_ms": 121, "commit_latency_ns": 121000000, "apply_latency_ns": 121000000 }, "alerts": [], "network_ping_times": [] } }, "pool_stats": [ { "poolid": 2, "num_pg": 32, "stat_sum": { "num_bytes": 0, "num_objects": 0, "num_object_clones": 0, "num_object_copies": 0, "num_objects_missing_on_primary": 0, "num_objects_missing": 0, "num_objects_degraded": 0, "num_objects_misplaced": 0, "num_objects_unfound": 0, "num_objects_dirty": 0, "num_whiteouts": 0, "num_read": 0, "num_read_kb": 0, "num_write": 0, "num_write_kb": 0, "num_scrub_errors": 0, "num_shallow_scrub_errors": 0, "num_deep_scrub_errors": 0, "num_objects_recovered": 0, "num_bytes_recovered": 0, "num_keys_recovered": 0, "num_objects_omap": 0, "num_objects_hit_set_archive": 0, "num_bytes_hit_set_archive": 0, "num_flush": 0, "num_flush_kb": 0, "num_evict": 0, "num_evict_kb": 0, "num_promote": 0, "num_flush_mode_high": 0, "num_flush_mode_low": 0, "num_evict_mode_some": 0, "num_evict_mode_full": 0, "num_objects_pinned": 0, "num_legacy_snapsets": 0, "num_large_omap_objects": 0, "num_objects_manifest": 0, "num_omap_bytes": 0, "num_omap_keys": 0, "num_objects_repaired": 0 }, "store_stats": { "total": 0, "available": 0, "internally_reserved": 0, "allocated": 0, "data_stored": 0, "data_compressed": 0, "data_compressed_allocated": 0, "data_compressed_original": 0, "omap_allocated": 0, "internal_metadata": 0 }, "log_size": 0, "ondisk_log_size": 0, "up": 64, "acting": 64, "num_store_stats": 3 }, { "poolid": 1, "num_pg": 32, "stat_sum": { "num_bytes": 0, "num_objects": 0, "num_object_clones": 0, "num_object_copies": 0, "num_objects_missing_on_primary": 0, "num_objects_missing": 0, "num_objects_degraded": 0, "num_objects_misplaced": 0, "num_objects_unfound": 0, "num_objects_dirty": 0, "num_whiteouts": 0, "num_read": 0, "num_read_kb": 0, "num_write": 0, "num_write_kb": 0, "num_scrub_errors": 0, "num_shallow_scrub_errors": 0, "num_deep_scrub_errors": 0, "num_objects_recovered": 0, "num_bytes_recovered": 0, "num_keys_recovered": 0, "num_objects_omap": 0, "num_objects_hit_set_archive": 0, "num_bytes_hit_set_archive": 0, "num_flush": 0, "num_flush_kb": 0, "num_evict": 0, "num_evict_kb": 0, "num_promote": 0, "num_flush_mode_high": 0, "num_flush_mode_low": 0, "num_evict_mode_some": 0, "num_evict_mode_full": 0, "num_objects_pinned": 0, "num_legacy_snapsets": 0, "num_large_omap_objects": 0, "num_objects_manifest": 0, "num_omap_bytes": 0, "num_omap_keys": 0, "num_objects_repaired": 0 }, "store_stats": { "total": 0, "available": 0, "internally_reserved": 0, "allocated": 0, "data_stored": 0, "data_compressed": 0, "data_compressed_allocated": 0, "data_compressed_original": 0, "omap_allocated": 0, "internal_metadata": 0 }, "log_size": 0, "ondisk_log_size": 0, "up": 64, "acting": 64, "num_store_stats": 3 } ], "osd_stats": [ { "osd": 0, "seq": 21474836523 }, { "osd": 1, "seq": 42949672995 }, { "osd": 2, "seq": 1 } ], "num_pg_by_state": [ { "state": "active+clean", "num": 64 } ], "num_pg_by_osd": [ { "osd": 2, "num_primary_pg": 0, "num_acting_pg": 0, "num_up_not_acting_pg": 0 }, { "osd": 0, "num_primary_pg": 28, "num_acting_pg": 64, "num_up_not_acting_pg": 0 }, { "osd": 1, "num_primary_pg": 36, "num_acting_pg": 64, "num_up_not_acting_pg": 0 } ], "purged_snaps": [ { "pool": 1, "purged_snaps": {} }, { "pool": 2, "purged_snaps": {} } ], "servicemap": { "epoch": 5, "modified": "2024-09-16T03:25:38.422788+0000", "services": {} }, "mgrstat_first_committed": 89, "mgrstat_last_committed": 95, "logm_first_committed": 1, "logm_last_committed": 430, "paxos": { "first_committed": 1, "last_committed": 633, "last_pn": 0, "accepted_pn": 0 } } 2024-09-16T03:26:18.878 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:38: check_lec_equals_pools: return 1 2024-09-16T03:26:18.878 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:47: check_lec_equals_pools: return 0 2024-09-16T03:26:18.878 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:298: TEST_mon_last_clean_epoch: wait_for_total_num_maps 2 2024-09-16T03:26:18.878 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:157: wait_for_total_num_maps: get_timeout_delays 300 .1 2024-09-16T03:26:18.878 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: shopt -q -o xtrace 2024-09-16T03:26:18.878 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: echo true 2024-09-16T03:26:18.878 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: local trace=true 2024-09-16T03:26:18.878 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: true 2024-09-16T03:26:18.878 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: shopt -u -o xtrace 2024-09-16T03:26:19.027 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:157: wait_for_total_num_maps: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '4.5') 2024-09-16T03:26:19.027 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:157: wait_for_total_num_maps: local -a delays 2024-09-16T03:26:19.028 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:158: wait_for_total_num_maps: local -i loop=0 2024-09-16T03:26:19.028 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:159: wait_for_total_num_maps: local -i v_diff=2 2024-09-16T03:26:19.028 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:161: wait_for_total_num_maps: get_fc_lc_diff 2024-09-16T03:26:19.028 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:130: get_fc_lc_diff: ceph report 2024-09-16T03:26:19.579 INFO:tasks.workunit.client.0.smithi096.stderr:report 3748878382 2024-09-16T03:26:19.595 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:130: get_fc_lc_diff: report='{ 2024-09-16T03:26:19.595 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_fingerprint": "fda2fc64-07ed-4add-8224-2e527e11d427", 2024-09-16T03:26:19.595 INFO:tasks.workunit.client.0.smithi096.stderr: "version": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:26:19.595 INFO:tasks.workunit.client.0.smithi096.stderr: "commit": "fc3e0bff7468fd55478adbae7f75508b749124b6", 2024-09-16T03:26:19.595 INFO:tasks.workunit.client.0.smithi096.stderr: "timestamp": "2024-09-16T03:26:19.579602+0000", 2024-09-16T03:26:19.596 INFO:tasks.workunit.client.0.smithi096.stderr: "tag": "", 2024-09-16T03:26:19.596 INFO:tasks.workunit.client.0.smithi096.stderr: "health": { 2024-09-16T03:26:19.596 INFO:tasks.workunit.client.0.smithi096.stderr: "status": "HEALTH_OK", 2024-09-16T03:26:19.596 INFO:tasks.workunit.client.0.smithi096.stderr: "checks": {}, 2024-09-16T03:26:19.596 INFO:tasks.workunit.client.0.smithi096.stderr: "mutes": [] 2024-09-16T03:26:19.596 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.596 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap_first_committed": 1, 2024-09-16T03:26:19.596 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap_last_committed": 1, 2024-09-16T03:26:19.596 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap": { 2024-09-16T03:26:19.596 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 1, 2024-09-16T03:26:19.596 INFO:tasks.workunit.client.0.smithi096.stderr: "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", 2024-09-16T03:26:19.596 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:22:45.872880Z", 2024-09-16T03:26:19.596 INFO:tasks.workunit.client.0.smithi096.stderr: "created": "2024-09-16T03:22:45.872880Z", 2024-09-16T03:26:19.597 INFO:tasks.workunit.client.0.smithi096.stderr: "min_mon_release": 19, 2024-09-16T03:26:19.597 INFO:tasks.workunit.client.0.smithi096.stderr: "min_mon_release_name": "squid", 2024-09-16T03:26:19.597 INFO:tasks.workunit.client.0.smithi096.stderr: "election_strategy": 1, 2024-09-16T03:26:19.597 INFO:tasks.workunit.client.0.smithi096.stderr: "disallowed_leaders: ": "", 2024-09-16T03:26:19.597 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode": false, 2024-09-16T03:26:19.597 INFO:tasks.workunit.client.0.smithi096.stderr: "tiebreaker_mon": "", 2024-09-16T03:26:19.597 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_ranks: ": "", 2024-09-16T03:26:19.597 INFO:tasks.workunit.client.0.smithi096.stderr: "features": { 2024-09-16T03:26:19.597 INFO:tasks.workunit.client.0.smithi096.stderr: "persistent": [ 2024-09-16T03:26:19.597 INFO:tasks.workunit.client.0.smithi096.stderr: "kraken", 2024-09-16T03:26:19.597 INFO:tasks.workunit.client.0.smithi096.stderr: "luminous", 2024-09-16T03:26:19.598 INFO:tasks.workunit.client.0.smithi096.stderr: "mimic", 2024-09-16T03:26:19.598 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap-prune", 2024-09-16T03:26:19.598 INFO:tasks.workunit.client.0.smithi096.stderr: "nautilus", 2024-09-16T03:26:19.598 INFO:tasks.workunit.client.0.smithi096.stderr: "octopus", 2024-09-16T03:26:19.598 INFO:tasks.workunit.client.0.smithi096.stderr: "pacific", 2024-09-16T03:26:19.598 INFO:tasks.workunit.client.0.smithi096.stderr: "elector-pinging", 2024-09-16T03:26:19.598 INFO:tasks.workunit.client.0.smithi096.stderr: "quincy", 2024-09-16T03:26:19.598 INFO:tasks.workunit.client.0.smithi096.stderr: "reef", 2024-09-16T03:26:19.598 INFO:tasks.workunit.client.0.smithi096.stderr: "squid" 2024-09-16T03:26:19.598 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:19.598 INFO:tasks.workunit.client.0.smithi096.stderr: "optional": [] 2024-09-16T03:26:19.599 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.599 INFO:tasks.workunit.client.0.smithi096.stderr: "mons": [ 2024-09-16T03:26:19.599 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.599 INFO:tasks.workunit.client.0.smithi096.stderr: "rank": 0, 2024-09-16T03:26:19.599 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "a", 2024-09-16T03:26:19.599 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:26:19.599 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:19.599 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.599 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:19.599 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:7302", 2024-09-16T03:26:19.599 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 0 2024-09-16T03:26:19.599 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:19.599 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:19.599 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.600 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:7302/0", 2024-09-16T03:26:19.600 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:7302/0", 2024-09-16T03:26:19.600 INFO:tasks.workunit.client.0.smithi096.stderr: "priority": 0, 2024-09-16T03:26:19.600 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 0, 2024-09-16T03:26:19.600 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_location": "{}" 2024-09-16T03:26:19.600 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:19.600 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:19.600 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.600 INFO:tasks.workunit.client.0.smithi096.stderr: "quorum": [ 2024-09-16T03:26:19.601 INFO:tasks.workunit.client.0.smithi096.stderr: 0 2024-09-16T03:26:19.601 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:19.601 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap": { 2024-09-16T03:26:19.601 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 88, 2024-09-16T03:26:19.601 INFO:tasks.workunit.client.0.smithi096.stderr: "fsid": "b3030d7e-4989-4f9f-a16f-63e0a549ceae", 2024-09-16T03:26:19.601 INFO:tasks.workunit.client.0.smithi096.stderr: "created": "2024-09-16T03:22:46.906117+0000", 2024-09-16T03:26:19.601 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:26:15.120212+0000", 2024-09-16T03:26:19.601 INFO:tasks.workunit.client.0.smithi096.stderr: "last_up_change": "2024-09-16T03:26:15.120212+0000", 2024-09-16T03:26:19.601 INFO:tasks.workunit.client.0.smithi096.stderr: "last_in_change": "2024-09-16T03:25:09.839444+0000", 2024-09-16T03:26:19.601 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-16T03:26:19.601 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_num": 5799936, 2024-09-16T03:26:19.601 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_set": [ 2024-09-16T03:26:19.601 INFO:tasks.workunit.client.0.smithi096.stderr: "pglog_hardlimit", 2024-09-16T03:26:19.601 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snapdirs", 2024-09-16T03:26:19.602 INFO:tasks.workunit.client.0.smithi096.stderr: "recovery_deletes", 2024-09-16T03:26:19.602 INFO:tasks.workunit.client.0.smithi096.stderr: "sortbitwise" 2024-09-16T03:26:19.602 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:19.602 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_version": 8, 2024-09-16T03:26:19.602 INFO:tasks.workunit.client.0.smithi096.stderr: "full_ratio": 0.97000002861022949, 2024-09-16T03:26:19.602 INFO:tasks.workunit.client.0.smithi096.stderr: "backfillfull_ratio": 0.97000002861022949, 2024-09-16T03:26:19.602 INFO:tasks.workunit.client.0.smithi096.stderr: "nearfull_ratio": 0.85000002384185791, 2024-09-16T03:26:19.602 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_snapshot": "", 2024-09-16T03:26:19.603 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_max": 2, 2024-09-16T03:26:19.603 INFO:tasks.workunit.client.0.smithi096.stderr: "max_osd": 3, 2024-09-16T03:26:19.603 INFO:tasks.workunit.client.0.smithi096.stderr: "require_min_compat_client": "luminous", 2024-09-16T03:26:19.603 INFO:tasks.workunit.client.0.smithi096.stderr: "min_compat_client": "jewel", 2024-09-16T03:26:19.603 INFO:tasks.workunit.client.0.smithi096.stderr: "require_osd_release": "squid", 2024-09-16T03:26:19.603 INFO:tasks.workunit.client.0.smithi096.stderr: "allow_crimson": false, 2024-09-16T03:26:19.603 INFO:tasks.workunit.client.0.smithi096.stderr: "pools": [ 2024-09-16T03:26:19.603 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.603 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 1, 2024-09-16T03:26:19.603 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_name": "foo", 2024-09-16T03:26:19.603 INFO:tasks.workunit.client.0.smithi096.stderr: "create_time": "2024-09-16T03:24:44.525189+0000", 2024-09-16T03:26:19.603 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": 1, 2024-09-16T03:26:19.603 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_names": "hashpspool", 2024-09-16T03:26:19.604 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:26:19.604 INFO:tasks.workunit.client.0.smithi096.stderr: "size": 2, 2024-09-16T03:26:19.604 INFO:tasks.workunit.client.0.smithi096.stderr: "min_size": 1, 2024-09-16T03:26:19.604 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_rule": 0, 2024-09-16T03:26:19.604 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_count": 0, 2024-09-16T03:26:19.604 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_target": 0, 2024-09-16T03:26:19.605 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_barrier": 0, 2024-09-16T03:26:19.605 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-16T03:26:19.605 INFO:tasks.workunit.client.0.smithi096.stderr: "is_stretch_pool": false, 2024-09-16T03:26:19.605 INFO:tasks.workunit.client.0.smithi096.stderr: "object_hash": 2, 2024-09-16T03:26:19.605 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_autoscale_mode": "off", 2024-09-16T03:26:19.605 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num": 32, 2024-09-16T03:26:19.605 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num": 32, 2024-09-16T03:26:19.605 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num_target": 32, 2024-09-16T03:26:19.605 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_target": 32, 2024-09-16T03:26:19.605 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_pending": 32, 2024-09-16T03:26:19.605 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pg_merge_meta": { 2024-09-16T03:26:19.605 INFO:tasks.workunit.client.0.smithi096.stderr: "source_pgid": "0.0", 2024-09-16T03:26:19.606 INFO:tasks.workunit.client.0.smithi096.stderr: "ready_epoch": 0, 2024-09-16T03:26:19.606 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_started": 0, 2024-09-16T03:26:19.606 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": 0, 2024-09-16T03:26:19.606 INFO:tasks.workunit.client.0.smithi096.stderr: "source_version": "0'\''0", 2024-09-16T03:26:19.606 INFO:tasks.workunit.client.0.smithi096.stderr: "target_version": "0'\''0" 2024-09-16T03:26:19.606 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.606 INFO:tasks.workunit.client.0.smithi096.stderr: "last_change": "85", 2024-09-16T03:26:19.606 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend": "0", 2024-09-16T03:26:19.606 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_prenautilus": "0", 2024-09-16T03:26:19.607 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_preluminous": "0", 2024-09-16T03:26:19.607 INFO:tasks.workunit.client.0.smithi096.stderr: "auid": 0, 2024-09-16T03:26:19.607 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_mode": "selfmanaged", 2024-09-16T03:26:19.607 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_seq": 0, 2024-09-16T03:26:19.607 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_epoch": 0, 2024-09-16T03:26:19.607 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_snaps": [], 2024-09-16T03:26:19.607 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps": "[]", 2024-09-16T03:26:19.607 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_bytes": 0, 2024-09-16T03:26:19.607 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_objects": 0, 2024-09-16T03:26:19.607 INFO:tasks.workunit.client.0.smithi096.stderr: "tiers": [], 2024-09-16T03:26:19.607 INFO:tasks.workunit.client.0.smithi096.stderr: "tier_of": -1, 2024-09-16T03:26:19.607 INFO:tasks.workunit.client.0.smithi096.stderr: "read_tier": -1, 2024-09-16T03:26:19.607 INFO:tasks.workunit.client.0.smithi096.stderr: "write_tier": -1, 2024-09-16T03:26:19.607 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_mode": "none", 2024-09-16T03:26:19.608 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_bytes": 0, 2024-09-16T03:26:19.608 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_objects": 0, 2024-09-16T03:26:19.608 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_ratio_micro": 400000, 2024-09-16T03:26:19.608 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-16T03:26:19.608 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_full_ratio_micro": 800000, 2024-09-16T03:26:19.608 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_flush_age": 0, 2024-09-16T03:26:19.609 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_evict_age": 0, 2024-09-16T03:26:19.609 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profile": "", 2024-09-16T03:26:19.609 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_params": { 2024-09-16T03:26:19.609 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "none" 2024-09-16T03:26:19.609 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.609 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_period": 0, 2024-09-16T03:26:19.610 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_count": 0, 2024-09-16T03:26:19.610 INFO:tasks.workunit.client.0.smithi096.stderr: "use_gmt_hitset": true, 2024-09-16T03:26:19.610 INFO:tasks.workunit.client.0.smithi096.stderr: "min_read_recency_for_promote": 0, 2024-09-16T03:26:19.610 INFO:tasks.workunit.client.0.smithi096.stderr: "min_write_recency_for_promote": 0, 2024-09-16T03:26:19.610 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_grade_decay_rate": 0, 2024-09-16T03:26:19.610 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_search_last_n": 0, 2024-09-16T03:26:19.610 INFO:tasks.workunit.client.0.smithi096.stderr: "grade_table": [], 2024-09-16T03:26:19.611 INFO:tasks.workunit.client.0.smithi096.stderr: "stripe_width": 0, 2024-09-16T03:26:19.611 INFO:tasks.workunit.client.0.smithi096.stderr: "expected_num_objects": 0, 2024-09-16T03:26:19.611 INFO:tasks.workunit.client.0.smithi096.stderr: "fast_read": false, 2024-09-16T03:26:19.611 INFO:tasks.workunit.client.0.smithi096.stderr: "options": {}, 2024-09-16T03:26:19.611 INFO:tasks.workunit.client.0.smithi096.stderr: "application_metadata": {}, 2024-09-16T03:26:19.611 INFO:tasks.workunit.client.0.smithi096.stderr: "read_balance": { 2024-09-16T03:26:19.612 INFO:tasks.workunit.client.0.smithi096.stderr: "score_type": "Fair distribution", 2024-09-16T03:26:19.612 INFO:tasks.workunit.client.0.smithi096.stderr: "score_acting": 1.8700000047683716, 2024-09-16T03:26:19.612 INFO:tasks.workunit.client.0.smithi096.stderr: "score_stable": 1.8700000047683716, 2024-09-16T03:26:19.612 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_score": 0.67000001668930054, 2024-09-16T03:26:19.612 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_acting": 1.25, 2024-09-16T03:26:19.612 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_stable": 1.25, 2024-09-16T03:26:19.613 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity_weighted": 1, 2024-09-16T03:26:19.613 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity": 1, 2024-09-16T03:26:19.613 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity_weighted": 1 2024-09-16T03:26:19.613 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:19.613 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.613 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.614 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 2, 2024-09-16T03:26:19.614 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_name": "bar", 2024-09-16T03:26:19.614 INFO:tasks.workunit.client.0.smithi096.stderr: "create_time": "2024-09-16T03:24:46.226575+0000", 2024-09-16T03:26:19.614 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": 1, 2024-09-16T03:26:19.614 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_names": "hashpspool", 2024-09-16T03:26:19.614 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:26:19.614 INFO:tasks.workunit.client.0.smithi096.stderr: "size": 2, 2024-09-16T03:26:19.615 INFO:tasks.workunit.client.0.smithi096.stderr: "min_size": 1, 2024-09-16T03:26:19.615 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_rule": 0, 2024-09-16T03:26:19.615 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_count": 0, 2024-09-16T03:26:19.615 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_target": 0, 2024-09-16T03:26:19.615 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_barrier": 0, 2024-09-16T03:26:19.615 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-16T03:26:19.616 INFO:tasks.workunit.client.0.smithi096.stderr: "is_stretch_pool": false, 2024-09-16T03:26:19.616 INFO:tasks.workunit.client.0.smithi096.stderr: "object_hash": 2, 2024-09-16T03:26:19.616 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_autoscale_mode": "off", 2024-09-16T03:26:19.616 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num": 32, 2024-09-16T03:26:19.616 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num": 32, 2024-09-16T03:26:19.616 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num_target": 32, 2024-09-16T03:26:19.617 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_target": 32, 2024-09-16T03:26:19.617 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_pending": 32, 2024-09-16T03:26:19.617 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pg_merge_meta": { 2024-09-16T03:26:19.617 INFO:tasks.workunit.client.0.smithi096.stderr: "source_pgid": "0.0", 2024-09-16T03:26:19.617 INFO:tasks.workunit.client.0.smithi096.stderr: "ready_epoch": 0, 2024-09-16T03:26:19.617 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_started": 0, 2024-09-16T03:26:19.618 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": 0, 2024-09-16T03:26:19.618 INFO:tasks.workunit.client.0.smithi096.stderr: "source_version": "0'\''0", 2024-09-16T03:26:19.618 INFO:tasks.workunit.client.0.smithi096.stderr: "target_version": "0'\''0" 2024-09-16T03:26:19.618 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.618 INFO:tasks.workunit.client.0.smithi096.stderr: "last_change": "83", 2024-09-16T03:26:19.618 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend": "0", 2024-09-16T03:26:19.619 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_prenautilus": "0", 2024-09-16T03:26:19.619 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_preluminous": "0", 2024-09-16T03:26:19.619 INFO:tasks.workunit.client.0.smithi096.stderr: "auid": 0, 2024-09-16T03:26:19.619 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_mode": "selfmanaged", 2024-09-16T03:26:19.619 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_seq": 0, 2024-09-16T03:26:19.619 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_epoch": 0, 2024-09-16T03:26:19.620 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_snaps": [], 2024-09-16T03:26:19.620 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps": "[]", 2024-09-16T03:26:19.620 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_bytes": 0, 2024-09-16T03:26:19.620 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_objects": 0, 2024-09-16T03:26:19.620 INFO:tasks.workunit.client.0.smithi096.stderr: "tiers": [], 2024-09-16T03:26:19.620 INFO:tasks.workunit.client.0.smithi096.stderr: "tier_of": -1, 2024-09-16T03:26:19.621 INFO:tasks.workunit.client.0.smithi096.stderr: "read_tier": -1, 2024-09-16T03:26:19.621 INFO:tasks.workunit.client.0.smithi096.stderr: "write_tier": -1, 2024-09-16T03:26:19.621 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_mode": "none", 2024-09-16T03:26:19.621 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_bytes": 0, 2024-09-16T03:26:19.621 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_objects": 0, 2024-09-16T03:26:19.621 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_ratio_micro": 400000, 2024-09-16T03:26:19.622 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-16T03:26:19.622 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_full_ratio_micro": 800000, 2024-09-16T03:26:19.622 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_flush_age": 0, 2024-09-16T03:26:19.622 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_evict_age": 0, 2024-09-16T03:26:19.622 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profile": "", 2024-09-16T03:26:19.623 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_params": { 2024-09-16T03:26:19.623 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "none" 2024-09-16T03:26:19.623 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.623 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_period": 0, 2024-09-16T03:26:19.623 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_count": 0, 2024-09-16T03:26:19.623 INFO:tasks.workunit.client.0.smithi096.stderr: "use_gmt_hitset": true, 2024-09-16T03:26:19.623 INFO:tasks.workunit.client.0.smithi096.stderr: "min_read_recency_for_promote": 0, 2024-09-16T03:26:19.624 INFO:tasks.workunit.client.0.smithi096.stderr: "min_write_recency_for_promote": 0, 2024-09-16T03:26:19.624 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_grade_decay_rate": 0, 2024-09-16T03:26:19.624 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_search_last_n": 0, 2024-09-16T03:26:19.624 INFO:tasks.workunit.client.0.smithi096.stderr: "grade_table": [], 2024-09-16T03:26:19.624 INFO:tasks.workunit.client.0.smithi096.stderr: "stripe_width": 0, 2024-09-16T03:26:19.624 INFO:tasks.workunit.client.0.smithi096.stderr: "expected_num_objects": 0, 2024-09-16T03:26:19.625 INFO:tasks.workunit.client.0.smithi096.stderr: "fast_read": false, 2024-09-16T03:26:19.625 INFO:tasks.workunit.client.0.smithi096.stderr: "options": {}, 2024-09-16T03:26:19.625 INFO:tasks.workunit.client.0.smithi096.stderr: "application_metadata": {}, 2024-09-16T03:26:19.625 INFO:tasks.workunit.client.0.smithi096.stderr: "read_balance": { 2024-09-16T03:26:19.625 INFO:tasks.workunit.client.0.smithi096.stderr: "score_type": "Fair distribution", 2024-09-16T03:26:19.625 INFO:tasks.workunit.client.0.smithi096.stderr: "score_acting": 1.4900000095367432, 2024-09-16T03:26:19.626 INFO:tasks.workunit.client.0.smithi096.stderr: "score_stable": 1.4900000095367432, 2024-09-16T03:26:19.626 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_score": 0.67000001668930054, 2024-09-16T03:26:19.626 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_acting": 1, 2024-09-16T03:26:19.626 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_stable": 1, 2024-09-16T03:26:19.626 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity_weighted": 1, 2024-09-16T03:26:19.626 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity": 1, 2024-09-16T03:26:19.626 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity_weighted": 1 2024-09-16T03:26:19.627 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:19.627 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:19.627 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:19.627 INFO:tasks.workunit.client.0.smithi096.stderr: "osds": [ 2024-09-16T03:26:19.627 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.627 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:26:19.627 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6", 2024-09-16T03:26:19.628 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:26:19.628 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:26:19.628 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:26:19.628 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:26:19.628 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:26:19.628 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:26:19.628 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 5, 2024-09-16T03:26:19.628 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 84, 2024-09-16T03:26:19.629 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:26:19.629 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:26:19.629 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:26:19.629 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:19.629 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.629 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:19.629 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6802", 2024-09-16T03:26:19.630 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:26:19.630 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.630 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.630 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:19.630 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6803", 2024-09-16T03:26:19.630 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:26:19.630 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:19.631 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:19.631 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.631 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:26:19.631 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:19.631 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.631 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:19.632 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6804", 2024-09-16T03:26:19.632 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:26:19.632 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.632 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.632 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:19.632 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6805", 2024-09-16T03:26:19.633 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:26:19.633 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:19.633 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:19.633 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.633 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:26:19.633 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:19.633 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.633 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:19.633 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6808", 2024-09-16T03:26:19.633 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:26:19.634 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.634 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.634 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:19.634 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6809", 2024-09-16T03:26:19.634 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:26:19.634 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:19.634 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:19.634 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.634 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:26:19.634 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:19.634 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.634 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:19.635 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6806", 2024-09-16T03:26:19.635 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:26:19.635 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.635 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.635 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:19.635 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6807", 2024-09-16T03:26:19.635 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3375787448 2024-09-16T03:26:19.635 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:19.635 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:19.635 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.635 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6803/3375787448", 2024-09-16T03:26:19.635 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6805/3375787448", 2024-09-16T03:26:19.636 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6809/3375787448", 2024-09-16T03:26:19.636 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6807/3375787448", 2024-09-16T03:26:19.636 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:26:19.636 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:26:19.636 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:26:19.636 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:19.636 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.636 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.636 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:26:19.636 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "74b26727-75c9-444d-8782-719e4197a382", 2024-09-16T03:26:19.636 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:26:19.636 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:26:19.636 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:26:19.637 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:26:19.637 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:26:19.637 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:26:19.637 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 10, 2024-09-16T03:26:19.637 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 84, 2024-09-16T03:26:19.637 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:26:19.637 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:26:19.637 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:26:19.637 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:19.637 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.637 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:19.637 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6810", 2024-09-16T03:26:19.637 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:26:19.637 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.638 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.638 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:19.638 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6811", 2024-09-16T03:26:19.638 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:26:19.638 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:19.638 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:19.638 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.638 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:26:19.638 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:19.638 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.638 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:19.638 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6812", 2024-09-16T03:26:19.638 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:26:19.638 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.639 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.639 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:19.639 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6813", 2024-09-16T03:26:19.639 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:26:19.639 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:19.639 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:19.639 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.639 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:26:19.639 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:19.639 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.639 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:19.639 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6816", 2024-09-16T03:26:19.639 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:26:19.639 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.640 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.640 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:19.640 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6817", 2024-09-16T03:26:19.640 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:26:19.640 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:19.640 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:19.640 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.640 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:26:19.640 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:19.640 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.640 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:19.640 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6814", 2024-09-16T03:26:19.640 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:26:19.641 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.641 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.641 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:19.641 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6815", 2024-09-16T03:26:19.641 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3733255132 2024-09-16T03:26:19.641 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:19.641 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:19.641 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.641 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6811/3733255132", 2024-09-16T03:26:19.641 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6813/3733255132", 2024-09-16T03:26:19.641 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6817/3733255132", 2024-09-16T03:26:19.641 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6815/3733255132", 2024-09-16T03:26:19.641 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:26:19.641 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:26:19.642 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:26:19.642 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:19.642 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.642 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.642 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:26:19.642 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "143da3a7-dad9-4b1e-966b-76cf5bdd3c82", 2024-09-16T03:26:19.642 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:26:19.642 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 0, 2024-09-16T03:26:19.642 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 0, 2024-09-16T03:26:19.642 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:26:19.642 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 15, 2024-09-16T03:26:19.643 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 32, 2024-09-16T03:26:19.643 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 88, 2024-09-16T03:26:19.643 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 21, 2024-09-16T03:26:19.643 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 33, 2024-09-16T03:26:19.643 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:26:19.643 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:26:19.643 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:19.643 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.643 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:19.643 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6818", 2024-09-16T03:26:19.643 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 2576002244 2024-09-16T03:26:19.643 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.643 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.643 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:19.644 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6819", 2024-09-16T03:26:19.644 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 2576002244 2024-09-16T03:26:19.644 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:19.644 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:19.644 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.644 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:26:19.644 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:19.644 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.644 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:19.644 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6820", 2024-09-16T03:26:19.644 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 2576002244 2024-09-16T03:26:19.644 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.644 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.644 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:19.645 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6821", 2024-09-16T03:26:19.645 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 2576002244 2024-09-16T03:26:19.645 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:19.645 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:19.645 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.645 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:26:19.645 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:19.645 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.645 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:19.645 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6824", 2024-09-16T03:26:19.645 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 2576002244 2024-09-16T03:26:19.645 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.645 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.646 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:19.646 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6825", 2024-09-16T03:26:19.646 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 2576002244 2024-09-16T03:26:19.646 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:19.646 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:19.646 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.646 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:26:19.646 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:26:19.646 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.646 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:26:19.646 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6822", 2024-09-16T03:26:19.646 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 2576002244 2024-09-16T03:26:19.646 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.646 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.647 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:26:19.647 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6823", 2024-09-16T03:26:19.647 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 2576002244 2024-09-16T03:26:19.647 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:19.647 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:19.647 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.647 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6819/2576002244", 2024-09-16T03:26:19.647 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6821/2576002244", 2024-09-16T03:26:19.647 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6825/2576002244", 2024-09-16T03:26:19.647 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6823/2576002244", 2024-09-16T03:26:19.647 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:26:19.647 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:26:19.648 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:26:19.648 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:19.648 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:19.648 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:19.648 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_xinfo": [ 2024-09-16T03:26:19.648 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.648 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:26:19.648 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:26:19.648 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:26:19.648 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:26:19.648 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:26:19.649 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:26:19.649 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:23:22.481942+0000", 2024-09-16T03:26:19.649 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:26:19.649 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.649 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.649 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:26:19.649 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:26:19.649 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:26:19.649 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:26:19.649 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:26:19.649 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:26:19.649 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:23:59.663703+0000", 2024-09-16T03:26:19.650 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:26:19.650 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.650 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.650 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:26:19.650 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:26:19.650 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:26:19.650 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:26:19.650 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:26:19.650 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 65536, 2024-09-16T03:26:19.650 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:24:37.320822+0000", 2024-09-16T03:26:19.650 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 32 2024-09-16T03:26:19.650 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:19.650 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:19.650 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap": [], 2024-09-16T03:26:19.651 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap_items": [], 2024-09-16T03:26:19.651 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap_primaries": [], 2024-09-16T03:26:19.651 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_temp": [], 2024-09-16T03:26:19.651 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_temp": [], 2024-09-16T03:26:19.651 INFO:tasks.workunit.client.0.smithi096.stderr: "blocklist": {}, 2024-09-16T03:26:19.651 INFO:tasks.workunit.client.0.smithi096.stderr: "range_blocklist": {}, 2024-09-16T03:26:19.651 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profiles": { 2024-09-16T03:26:19.651 INFO:tasks.workunit.client.0.smithi096.stderr: "default": { 2024-09-16T03:26:19.651 INFO:tasks.workunit.client.0.smithi096.stderr: "k": "2", 2024-09-16T03:26:19.651 INFO:tasks.workunit.client.0.smithi096.stderr: "m": "2", 2024-09-16T03:26:19.651 INFO:tasks.workunit.client.0.smithi096.stderr: "plugin": "jerasure", 2024-09-16T03:26:19.651 INFO:tasks.workunit.client.0.smithi096.stderr: "technique": "reed_sol_van" 2024-09-16T03:26:19.651 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:19.651 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.652 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps_queue": [], 2024-09-16T03:26:19.652 INFO:tasks.workunit.client.0.smithi096.stderr: "new_removed_snaps": [], 2024-09-16T03:26:19.652 INFO:tasks.workunit.client.0.smithi096.stderr: "new_purged_snaps": [], 2024-09-16T03:26:19.652 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_node_flags": {}, 2024-09-16T03:26:19.652 INFO:tasks.workunit.client.0.smithi096.stderr: "device_class_flags": {}, 2024-09-16T03:26:19.652 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode": { 2024-09-16T03:26:19.652 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode_enabled": false, 2024-09-16T03:26:19.652 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_bucket_count": 0, 2024-09-16T03:26:19.652 INFO:tasks.workunit.client.0.smithi096.stderr: "degraded_stretch_mode": 0, 2024-09-16T03:26:19.652 INFO:tasks.workunit.client.0.smithi096.stderr: "recovering_stretch_mode": 0, 2024-09-16T03:26:19.652 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode_bucket": 0 2024-09-16T03:26:19.652 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:19.653 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.653 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_metadata": [ 2024-09-16T03:26:19.653 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.653 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:26:19.653 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:26:19.653 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]", 2024-09-16T03:26:19.653 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:26:19.653 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:26:19.653 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:26:19.653 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:26:19.653 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:26:19.654 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:26:19.654 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:26:19.654 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:26:19.654 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:26:19.654 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:26:19.654 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:26:19.654 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/0/block", 2024-09-16T03:26:19.654 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:26:19.654 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:26:19.654 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:26:19.654 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:26:19.654 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:26:19.655 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:26:19.655 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:26:19.655 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:26:19.655 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:26:19.655 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:26:19.655 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:22:53.662571Z", 2024-09-16T03:26:19.655 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:26:19.655 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:26:19.655 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:26:19.655 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:26:19.655 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:26:19.655 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:26:19.656 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:26:19.656 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]", 2024-09-16T03:26:19.656 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:26:19.656 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]", 2024-09-16T03:26:19.656 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]", 2024-09-16T03:26:19.657 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:26:19.657 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:26:19.657 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:26:19.657 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:26:19.657 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:26:19.657 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:26:19.657 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:26:19.657 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:26:19.657 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:26:19.657 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/0", 2024-09-16T03:26:19.658 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:26:19.658 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:26:19.658 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:26:19.658 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.658 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.658 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:26:19.658 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:26:19.658 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]", 2024-09-16T03:26:19.658 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:26:19.659 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:26:19.659 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:26:19.659 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:26:19.659 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:26:19.659 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:26:19.659 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:26:19.659 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:26:19.659 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:26:19.659 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:26:19.659 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:26:19.659 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/1/block", 2024-09-16T03:26:19.659 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:26:19.659 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:26:19.659 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:26:19.660 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:26:19.660 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:26:19.660 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:26:19.660 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:26:19.660 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:26:19.660 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:26:19.660 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:26:19.660 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:23:30.129885Z", 2024-09-16T03:26:19.660 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:26:19.660 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:26:19.660 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:26:19.660 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:26:19.660 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:26:19.661 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:26:19.661 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:26:19.661 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]", 2024-09-16T03:26:19.661 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:26:19.661 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]", 2024-09-16T03:26:19.661 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]", 2024-09-16T03:26:19.661 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:26:19.661 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:26:19.661 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:26:19.661 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:26:19.662 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:26:19.662 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:26:19.662 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:26:19.662 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:26:19.662 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:26:19.662 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/1", 2024-09-16T03:26:19.662 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:26:19.662 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:26:19.662 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:26:19.662 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.662 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.662 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:26:19.662 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:26:19.662 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6820/2576002244,v1:127.0.0.1:6821/2576002244]", 2024-09-16T03:26:19.663 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:26:19.663 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:26:19.663 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:26:19.663 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:26:19.663 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:26:19.663 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:26:19.663 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:26:19.663 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:26:19.663 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:26:19.663 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:26:19.663 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:26:19.663 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-last-clean-epoch/2/block", 2024-09-16T03:26:19.663 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:26:19.664 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:26:19.664 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:26:19.664 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:26:19.664 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:26:19.664 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:26:19.664 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:26:19.664 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:26:19.664 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:26:19.664 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:26:19.664 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:24:07.764502Z", 2024-09-16T03:26:19.664 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:26:19.664 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:26:19.664 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:26:19.665 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:26:19.665 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:26:19.665 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:26:19.665 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:26:19.665 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6818/2576002244,v1:127.0.0.1:6819/2576002244]", 2024-09-16T03:26:19.665 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:26:19.665 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6824/2576002244,v1:127.0.0.1:6825/2576002244]", 2024-09-16T03:26:19.665 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6822/2576002244,v1:127.0.0.1:6823/2576002244]", 2024-09-16T03:26:19.665 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:26:19.665 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:26:19.665 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:26:19.665 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:26:19.665 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:26:19.665 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:26:19.666 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:26:19.666 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:26:19.666 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:26:19.666 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-last-clean-epoch/2", 2024-09-16T03:26:19.666 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:26:19.666 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:26:19.666 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:26:19.666 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:19.666 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:19.666 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_clean_epochs": { 2024-09-16T03:26:19.666 INFO:tasks.workunit.client.0.smithi096.stderr: "min_last_epoch_clean": 86, 2024-09-16T03:26:19.666 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": { 2024-09-16T03:26:19.666 INFO:tasks.workunit.client.0.smithi096.stderr: "per_pool": [ 2024-09-16T03:26:19.667 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.667 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 1, 2024-09-16T03:26:19.667 INFO:tasks.workunit.client.0.smithi096.stderr: "floor": 86 2024-09-16T03:26:19.667 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.667 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.667 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 2, 2024-09-16T03:26:19.667 INFO:tasks.workunit.client.0.smithi096.stderr: "floor": 86 2024-09-16T03:26:19.667 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:19.667 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:19.667 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.667 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_epochs": [ 2024-09-16T03:26:19.667 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.667 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:26:19.667 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 86 2024-09-16T03:26:19.668 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.668 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.668 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:26:19.668 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 88 2024-09-16T03:26:19.668 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.668 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.668 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:26:19.668 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 88 2024-09-16T03:26:19.668 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:19.668 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:19.668 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.668 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_first_committed": 86, 2024-09-16T03:26:19.669 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_last_committed": 88, 2024-09-16T03:26:19.669 INFO:tasks.workunit.client.0.smithi096.stderr: "crushmap": { 2024-09-16T03:26:19.669 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": [ 2024-09-16T03:26:19.669 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.669 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:26:19.669 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.0", 2024-09-16T03:26:19.669 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:26:19.669 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.669 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.669 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:26:19.670 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.1", 2024-09-16T03:26:19.670 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:26:19.670 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.670 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.670 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:26:19.670 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.2", 2024-09-16T03:26:19.670 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:26:19.670 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:19.670 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:19.670 INFO:tasks.workunit.client.0.smithi096.stderr: "types": [ 2024-09-16T03:26:19.670 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.670 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 0, 2024-09-16T03:26:19.670 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd" 2024-09-16T03:26:19.670 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.671 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.671 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:26:19.671 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "host" 2024-09-16T03:26:19.671 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.671 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.671 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 2, 2024-09-16T03:26:19.671 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "chassis" 2024-09-16T03:26:19.671 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.671 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.671 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 3, 2024-09-16T03:26:19.671 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "rack" 2024-09-16T03:26:19.671 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.671 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.672 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 4, 2024-09-16T03:26:19.672 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "row" 2024-09-16T03:26:19.672 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.672 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.672 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 5, 2024-09-16T03:26:19.672 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "pdu" 2024-09-16T03:26:19.672 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.672 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.672 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 6, 2024-09-16T03:26:19.672 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "pod" 2024-09-16T03:26:19.672 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.672 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.672 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 7, 2024-09-16T03:26:19.673 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "room" 2024-09-16T03:26:19.673 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.673 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.673 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 8, 2024-09-16T03:26:19.673 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "datacenter" 2024-09-16T03:26:19.673 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.673 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.673 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 9, 2024-09-16T03:26:19.673 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "zone" 2024-09-16T03:26:19.673 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.673 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.673 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 10, 2024-09-16T03:26:19.673 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "region" 2024-09-16T03:26:19.674 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.674 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.674 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:26:19.674 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "root" 2024-09-16T03:26:19.674 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:19.674 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:19.674 INFO:tasks.workunit.client.0.smithi096.stderr: "buckets": [ 2024-09-16T03:26:19.674 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.674 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -1, 2024-09-16T03:26:19.674 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "default", 2024-09-16T03:26:19.674 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:26:19.674 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "root", 2024-09-16T03:26:19.674 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:26:19.674 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:26:19.675 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:26:19.675 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:26:19.675 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.675 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -3, 2024-09-16T03:26:19.675 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:26:19.675 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:26:19.675 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:19.675 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:19.675 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.676 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.676 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -2, 2024-09-16T03:26:19.676 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "default~hdd", 2024-09-16T03:26:19.676 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:26:19.676 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "root", 2024-09-16T03:26:19.676 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:26:19.676 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:26:19.676 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:26:19.676 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:26:19.676 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.676 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -4, 2024-09-16T03:26:19.676 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:26:19.676 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:26:19.677 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:19.677 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:19.677 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.677 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.677 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -3, 2024-09-16T03:26:19.677 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "smithi096", 2024-09-16T03:26:19.677 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:26:19.677 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "host", 2024-09-16T03:26:19.677 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:26:19.677 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:26:19.677 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:26:19.677 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:26:19.678 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.678 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:26:19.678 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:26:19.678 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:26:19.678 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.678 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.678 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:26:19.678 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:26:19.678 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 1 2024-09-16T03:26:19.678 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.678 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.678 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:26:19.679 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:26:19.679 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 2 2024-09-16T03:26:19.679 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:19.679 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:19.679 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.679 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.679 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -4, 2024-09-16T03:26:19.679 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "smithi096~hdd", 2024-09-16T03:26:19.679 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:26:19.679 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "host", 2024-09-16T03:26:19.679 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:26:19.680 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:26:19.680 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:26:19.680 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:26:19.680 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.680 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:26:19.680 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:26:19.680 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:26:19.680 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.680 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.680 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:26:19.680 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:26:19.680 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 1 2024-09-16T03:26:19.680 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.681 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.681 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:26:19.681 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:26:19.681 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 2 2024-09-16T03:26:19.681 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:19.681 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:19.681 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:19.681 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:19.681 INFO:tasks.workunit.client.0.smithi096.stderr: "rules": [ 2024-09-16T03:26:19.681 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.681 INFO:tasks.workunit.client.0.smithi096.stderr: "rule_id": 0, 2024-09-16T03:26:19.681 INFO:tasks.workunit.client.0.smithi096.stderr: "rule_name": "replicated_rule", 2024-09-16T03:26:19.682 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:26:19.682 INFO:tasks.workunit.client.0.smithi096.stderr: "steps": [ 2024-09-16T03:26:19.682 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.682 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "take", 2024-09-16T03:26:19.682 INFO:tasks.workunit.client.0.smithi096.stderr: "item": -1, 2024-09-16T03:26:19.682 INFO:tasks.workunit.client.0.smithi096.stderr: "item_name": "default" 2024-09-16T03:26:19.682 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.682 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.682 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "choose_firstn", 2024-09-16T03:26:19.682 INFO:tasks.workunit.client.0.smithi096.stderr: "num": 0, 2024-09-16T03:26:19.682 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "osd" 2024-09-16T03:26:19.683 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.683 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.683 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "emit" 2024-09-16T03:26:19.683 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:19.683 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:26:19.683 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:19.683 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:19.683 INFO:tasks.workunit.client.0.smithi096.stderr: "tunables": { 2024-09-16T03:26:19.683 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_local_tries": 0, 2024-09-16T03:26:19.683 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_local_fallback_tries": 0, 2024-09-16T03:26:19.683 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_total_tries": 50, 2024-09-16T03:26:19.683 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_descend_once": 1, 2024-09-16T03:26:19.683 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_vary_r": 1, 2024-09-16T03:26:19.683 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_stable": 1, 2024-09-16T03:26:19.684 INFO:tasks.workunit.client.0.smithi096.stderr: "msr_descents": 100, 2024-09-16T03:26:19.684 INFO:tasks.workunit.client.0.smithi096.stderr: "msr_collision_tries": 100, 2024-09-16T03:26:19.684 INFO:tasks.workunit.client.0.smithi096.stderr: "straw_calc_version": 1, 2024-09-16T03:26:19.684 INFO:tasks.workunit.client.0.smithi096.stderr: "allowed_bucket_algs": 54, 2024-09-16T03:26:19.684 INFO:tasks.workunit.client.0.smithi096.stderr: "profile": "jewel", 2024-09-16T03:26:19.684 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_tunables": 1, 2024-09-16T03:26:19.684 INFO:tasks.workunit.client.0.smithi096.stderr: "legacy_tunables": 0, 2024-09-16T03:26:19.684 INFO:tasks.workunit.client.0.smithi096.stderr: "minimum_required_version": "jewel", 2024-09-16T03:26:19.684 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables": 1, 2024-09-16T03:26:19.684 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables2": 1, 2024-09-16T03:26:19.685 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v2_rules": 0, 2024-09-16T03:26:19.685 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables3": 1, 2024-09-16T03:26:19.685 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v3_rules": 0, 2024-09-16T03:26:19.685 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v4_buckets": 1, 2024-09-16T03:26:19.685 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables5": 1, 2024-09-16T03:26:19.685 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v5_rules": 0, 2024-09-16T03:26:19.685 INFO:tasks.workunit.client.0.smithi096.stderr: "has_msr_rules": 0 2024-09-16T03:26:19.686 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.686 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_args": {} 2024-09-16T03:26:19.686 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.686 INFO:tasks.workunit.client.0.smithi096.stderr: "fsmap": { 2024-09-16T03:26:19.686 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 1, 2024-09-16T03:26:19.686 INFO:tasks.workunit.client.0.smithi096.stderr: "btime": "2024-09-16T03:22:46:882186+0000", 2024-09-16T03:26:19.686 INFO:tasks.workunit.client.0.smithi096.stderr: "default_fscid": -1, 2024-09-16T03:26:19.686 INFO:tasks.workunit.client.0.smithi096.stderr: "compat": { 2024-09-16T03:26:19.686 INFO:tasks.workunit.client.0.smithi096.stderr: "compat": {}, 2024-09-16T03:26:19.686 INFO:tasks.workunit.client.0.smithi096.stderr: "ro_compat": {}, 2024-09-16T03:26:19.686 INFO:tasks.workunit.client.0.smithi096.stderr: "incompat": { 2024-09-16T03:26:19.686 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_1": "base v0.20", 2024-09-16T03:26:19.686 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_2": "client writeable ranges", 2024-09-16T03:26:19.687 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_3": "default file layouts on dirs", 2024-09-16T03:26:19.687 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_4": "dir inode in separate object", 2024-09-16T03:26:19.687 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_5": "mds uses versioned encoding", 2024-09-16T03:26:19.687 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_6": "dirfrag is stored in omap", 2024-09-16T03:26:19.687 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_8": "no anchor table", 2024-09-16T03:26:19.687 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_9": "file layout v2", 2024-09-16T03:26:19.687 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_10": "snaprealm v2", 2024-09-16T03:26:19.687 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_11": "minor log segments", 2024-09-16T03:26:19.687 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_12": "quiesce subvolumes" 2024-09-16T03:26:19.687 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:19.687 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.687 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_flags": { 2024-09-16T03:26:19.687 INFO:tasks.workunit.client.0.smithi096.stderr: "enable_multiple": true, 2024-09-16T03:26:19.687 INFO:tasks.workunit.client.0.smithi096.stderr: "ever_enabled_multiple": true 2024-09-16T03:26:19.688 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.688 INFO:tasks.workunit.client.0.smithi096.stderr: "standbys": [], 2024-09-16T03:26:19.688 INFO:tasks.workunit.client.0.smithi096.stderr: "filesystems": [] 2024-09-16T03:26:19.688 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.688 INFO:tasks.workunit.client.0.smithi096.stderr: "mdsmap_first_committed": 1, 2024-09-16T03:26:19.688 INFO:tasks.workunit.client.0.smithi096.stderr: "mdsmap_last_committed": 1, 2024-09-16T03:26:19.688 INFO:tasks.workunit.client.0.smithi096.stderr: "auth": { 2024-09-16T03:26:19.688 INFO:tasks.workunit.client.0.smithi096.stderr: "first_committed": 1, 2024-09-16T03:26:19.688 INFO:tasks.workunit.client.0.smithi096.stderr: "last_committed": 5, 2024-09-16T03:26:19.688 INFO:tasks.workunit.client.0.smithi096.stderr: "num_secrets": 3 2024-09-16T03:26:19.688 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.688 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 64, 2024-09-16T03:26:19.688 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_active": 64, 2024-09-16T03:26:19.689 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_unknown": 0, 2024-09-16T03:26:19.689 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osd": 3, 2024-09-16T03:26:19.689 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_sum": { 2024-09-16T03:26:19.689 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:26:19.689 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:26:19.689 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:26:19.689 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:26:19.689 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:26:19.689 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:26:19.689 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:26:19.689 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:26:19.689 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:26:19.689 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:26:19.690 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:26:19.690 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:26:19.690 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:26:19.690 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:26:19.690 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:26:19.690 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:26:19.690 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:26:19.690 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:26:19.690 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:26:19.690 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:26:19.691 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:26:19.691 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:26:19.691 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:26:19.691 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:26:19.691 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:26:19.691 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:26:19.691 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:26:19.691 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:26:19.691 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:26:19.691 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:26:19.691 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:26:19.691 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:26:19.691 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:26:19.691 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:26:19.692 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:26:19.692 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:26:19.692 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:26:19.692 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:26:19.692 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:26:19.692 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:26:19.692 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:26:19.692 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.692 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:26:19.692 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:26:19.693 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:26:19.693 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:26:19.695 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:26:19.696 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:26:19.696 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:26:19.696 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:26:19.696 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:26:19.696 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:26:19.696 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:26:19.696 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.696 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:26:19.696 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:26:19.696 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 128, 2024-09-16T03:26:19.696 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 128, 2024-09-16T03:26:19.696 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 0 2024-09-16T03:26:19.697 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.697 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_sum": { 2024-09-16T03:26:19.697 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 0, 2024-09-16T03:26:19.697 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 0, 2024-09-16T03:26:19.697 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pgs": 128, 2024-09-16T03:26:19.697 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osds": 2, 2024-09-16T03:26:19.697 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_osds": 2, 2024-09-16T03:26:19.697 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_omap_osds": 2, 2024-09-16T03:26:19.697 INFO:tasks.workunit.client.0.smithi096.stderr: "kb": 209715200, 2024-09-16T03:26:19.697 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used": 54660, 2024-09-16T03:26:19.697 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_data": 888, 2024-09-16T03:26:19.697 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_omap": 3, 2024-09-16T03:26:19.697 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_meta": 53628, 2024-09-16T03:26:19.697 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_avail": 209660540, 2024-09-16T03:26:19.698 INFO:tasks.workunit.client.0.smithi096.stderr: "statfs": { 2024-09-16T03:26:19.698 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 214748364800, 2024-09-16T03:26:19.698 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 214692392960, 2024-09-16T03:26:19.698 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:26:19.698 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 909312, 2024-09-16T03:26:19.698 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 340707, 2024-09-16T03:26:19.698 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:26:19.698 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:26:19.698 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:26:19.698 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 3190, 2024-09-16T03:26:19.699 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 54915978 2024-09-16T03:26:19.699 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.699 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_peers": [], 2024-09-16T03:26:19.699 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_trim_queue_len": 0, 2024-09-16T03:26:19.699 INFO:tasks.workunit.client.0.smithi096.stderr: "num_snap_trimming": 0, 2024-09-16T03:26:19.699 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shards_repaired": 0, 2024-09-16T03:26:19.699 INFO:tasks.workunit.client.0.smithi096.stderr: "op_queue_age_hist": { 2024-09-16T03:26:19.699 INFO:tasks.workunit.client.0.smithi096.stderr: "histogram": [], 2024-09-16T03:26:19.699 INFO:tasks.workunit.client.0.smithi096.stderr: "upper_bound": 1 2024-09-16T03:26:19.699 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.700 INFO:tasks.workunit.client.0.smithi096.stderr: "perf_stat": { 2024-09-16T03:26:19.700 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ms": 121, 2024-09-16T03:26:19.700 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ms": 121, 2024-09-16T03:26:19.700 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ns": 121000000, 2024-09-16T03:26:19.700 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ns": 121000000 2024-09-16T03:26:19.700 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.700 INFO:tasks.workunit.client.0.smithi096.stderr: "alerts": [], 2024-09-16T03:26:19.700 INFO:tasks.workunit.client.0.smithi096.stderr: "network_ping_times": [] 2024-09-16T03:26:19.700 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.701 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_sum_by_class": { 2024-09-16T03:26:19.701 INFO:tasks.workunit.client.0.smithi096.stderr: "hdd": { 2024-09-16T03:26:19.701 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 0, 2024-09-16T03:26:19.701 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 0, 2024-09-16T03:26:19.701 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pgs": 128, 2024-09-16T03:26:19.701 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osds": 2, 2024-09-16T03:26:19.701 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_osds": 2, 2024-09-16T03:26:19.701 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_omap_osds": 2, 2024-09-16T03:26:19.701 INFO:tasks.workunit.client.0.smithi096.stderr: "kb": 209715200, 2024-09-16T03:26:19.701 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used": 54660, 2024-09-16T03:26:19.701 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_data": 888, 2024-09-16T03:26:19.701 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_omap": 3, 2024-09-16T03:26:19.701 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_meta": 53628, 2024-09-16T03:26:19.701 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_avail": 209660540, 2024-09-16T03:26:19.702 INFO:tasks.workunit.client.0.smithi096.stderr: "statfs": { 2024-09-16T03:26:19.702 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 214748364800, 2024-09-16T03:26:19.702 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 214692392960, 2024-09-16T03:26:19.702 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:26:19.702 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 909312, 2024-09-16T03:26:19.702 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 340707, 2024-09-16T03:26:19.702 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:26:19.702 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:26:19.702 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:26:19.702 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 3190, 2024-09-16T03:26:19.702 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 54915978 2024-09-16T03:26:19.702 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.702 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_peers": [], 2024-09-16T03:26:19.703 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_trim_queue_len": 0, 2024-09-16T03:26:19.703 INFO:tasks.workunit.client.0.smithi096.stderr: "num_snap_trimming": 0, 2024-09-16T03:26:19.703 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shards_repaired": 0, 2024-09-16T03:26:19.703 INFO:tasks.workunit.client.0.smithi096.stderr: "op_queue_age_hist": { 2024-09-16T03:26:19.703 INFO:tasks.workunit.client.0.smithi096.stderr: "histogram": [], 2024-09-16T03:26:19.703 INFO:tasks.workunit.client.0.smithi096.stderr: "upper_bound": 1 2024-09-16T03:26:19.703 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.703 INFO:tasks.workunit.client.0.smithi096.stderr: "perf_stat": { 2024-09-16T03:26:19.703 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ms": 121, 2024-09-16T03:26:19.703 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ms": 121, 2024-09-16T03:26:19.703 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ns": 121000000, 2024-09-16T03:26:19.703 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ns": 121000000 2024-09-16T03:26:19.703 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.703 INFO:tasks.workunit.client.0.smithi096.stderr: "alerts": [], 2024-09-16T03:26:19.704 INFO:tasks.workunit.client.0.smithi096.stderr: "network_ping_times": [] 2024-09-16T03:26:19.704 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:19.704 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.704 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_stats": [ 2024-09-16T03:26:19.704 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.704 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 2, 2024-09-16T03:26:19.704 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 32, 2024-09-16T03:26:19.704 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:26:19.704 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:26:19.704 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:26:19.704 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:26:19.704 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:26:19.704 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:26:19.705 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:26:19.705 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:26:19.705 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:26:19.705 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:26:19.705 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:26:19.705 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:26:19.705 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:26:19.705 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:26:19.705 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:26:19.705 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:26:19.705 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:26:19.706 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:26:19.706 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:26:19.706 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:26:19.706 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:26:19.706 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:26:19.706 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:26:19.706 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:26:19.706 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:26:19.706 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:26:19.706 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:26:19.706 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:26:19.707 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:26:19.707 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:26:19.707 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:26:19.707 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:26:19.707 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:26:19.707 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:26:19.707 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:26:19.707 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:26:19.707 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:26:19.707 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:26:19.708 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:26:19.708 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:26:19.708 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:26:19.708 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.708 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:26:19.708 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:26:19.708 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:26:19.708 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:26:19.708 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:26:19.708 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:26:19.708 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:26:19.708 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:26:19.709 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:26:19.709 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:26:19.709 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:26:19.709 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.709 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:26:19.709 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:26:19.709 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 64, 2024-09-16T03:26:19.709 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 64, 2024-09-16T03:26:19.709 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 3 2024-09-16T03:26:19.709 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.709 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.709 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 1, 2024-09-16T03:26:19.710 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 32, 2024-09-16T03:26:19.710 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:26:19.710 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:26:19.710 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:26:19.710 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:26:19.710 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:26:19.710 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:26:19.711 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:26:19.711 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:26:19.711 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:26:19.711 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:26:19.711 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:26:19.711 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:26:19.711 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:26:19.711 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:26:19.711 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:26:19.712 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:26:19.712 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:26:19.712 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:26:19.712 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:26:19.712 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:26:19.712 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:26:19.712 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:26:19.712 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:26:19.712 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:26:19.712 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:26:19.712 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:26:19.712 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:26:19.712 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:26:19.713 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:26:19.713 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:26:19.713 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:26:19.713 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:26:19.713 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:26:19.713 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:26:19.714 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:26:19.714 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:26:19.714 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:26:19.714 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:26:19.714 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:26:19.714 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:26:19.714 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:26:19.714 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.714 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:26:19.714 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:26:19.714 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:26:19.715 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:26:19.715 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:26:19.715 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:26:19.715 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:26:19.715 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:26:19.715 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:26:19.715 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:26:19.715 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:26:19.715 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.715 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:26:19.715 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:26:19.715 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 64, 2024-09-16T03:26:19.715 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 64, 2024-09-16T03:26:19.715 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 3 2024-09-16T03:26:19.716 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:19.716 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:19.716 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_stats": [ 2024-09-16T03:26:19.716 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.716 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:26:19.716 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 21474836523 2024-09-16T03:26:19.716 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.716 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.716 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:26:19.716 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 42949672995 2024-09-16T03:26:19.716 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.716 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.716 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:26:19.716 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 1 2024-09-16T03:26:19.717 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:19.717 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:19.717 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_by_state": [ 2024-09-16T03:26:19.717 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.717 INFO:tasks.workunit.client.0.smithi096.stderr: "state": "active+clean", 2024-09-16T03:26:19.717 INFO:tasks.workunit.client.0.smithi096.stderr: "num": 64 2024-09-16T03:26:19.717 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:19.717 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:19.717 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_by_osd": [ 2024-09-16T03:26:19.717 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.717 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:26:19.717 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 0, 2024-09-16T03:26:19.717 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 0, 2024-09-16T03:26:19.718 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:26:19.718 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.718 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.718 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:26:19.718 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 28, 2024-09-16T03:26:19.718 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 64, 2024-09-16T03:26:19.718 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:26:19.718 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.718 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.718 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:26:19.718 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 36, 2024-09-16T03:26:19.718 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 64, 2024-09-16T03:26:19.718 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:26:19.718 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:19.719 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:19.719 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": [ 2024-09-16T03:26:19.719 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.719 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 1, 2024-09-16T03:26:19.719 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": {} 2024-09-16T03:26:19.719 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.719 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:26:19.719 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 2, 2024-09-16T03:26:19.719 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": {} 2024-09-16T03:26:19.719 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:19.719 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:26:19.719 INFO:tasks.workunit.client.0.smithi096.stderr: "servicemap": { 2024-09-16T03:26:19.719 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 5, 2024-09-16T03:26:19.719 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:25:38.422788+0000", 2024-09-16T03:26:19.720 INFO:tasks.workunit.client.0.smithi096.stderr: "services": {} 2024-09-16T03:26:19.720 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:26:19.720 INFO:tasks.workunit.client.0.smithi096.stderr: "mgrstat_first_committed": 89, 2024-09-16T03:26:19.720 INFO:tasks.workunit.client.0.smithi096.stderr: "mgrstat_last_committed": 95, 2024-09-16T03:26:19.720 INFO:tasks.workunit.client.0.smithi096.stderr: "logm_first_committed": 1, 2024-09-16T03:26:19.720 INFO:tasks.workunit.client.0.smithi096.stderr: "logm_last_committed": 433, 2024-09-16T03:26:19.720 INFO:tasks.workunit.client.0.smithi096.stderr: "paxos": { 2024-09-16T03:26:19.720 INFO:tasks.workunit.client.0.smithi096.stderr: "first_committed": 1, 2024-09-16T03:26:19.720 INFO:tasks.workunit.client.0.smithi096.stderr: "last_committed": 636, 2024-09-16T03:26:19.720 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pn": 0, 2024-09-16T03:26:19.720 INFO:tasks.workunit.client.0.smithi096.stderr: "accepted_pn": 0 2024-09-16T03:26:19.721 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:26:19.721 INFO:tasks.workunit.client.0.smithi096.stderr:}' 2024-09-16T03:26:19.724 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:132: get_fc_lc_diff: jq .osdmap_first_committed 2024-09-16T03:26:19.725 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:132: get_fc_lc_diff: echo '{' '"cluster_fingerprint":' '"fda2fc64-07ed-4add-8224-2e527e11d427",' '"version":' '"19.3.0-4930-gfc3e0bff",' '"commit":' '"fc3e0bff7468fd55478adbae7f75508b749124b6",' '"timestamp":' '"2024-09-16T03:26:19.579602+0000",' '"tag":' '"",' '"health":' '{' '"status":' '"HEALTH_OK",' '"checks":' '{},' '"mutes":' '[]' '},' '"monmap_first_committed":' 1, '"monmap_last_committed":' 1, '"monmap":' '{' '"epoch":' 1, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"modified":' '"2024-09-16T03:22:45.872880Z",' '"created":' '"2024-09-16T03:22:45.872880Z",' '"min_mon_release":' 19, '"min_mon_release_name":' '"squid",' '"election_strategy":' 1, '"disallowed_leaders:' '":' '"",' '"stretch_mode":' false, '"tiebreaker_mon":' '"",' '"removed_ranks:' '":' '"",' '"features":' '{' '"persistent":' '[' '"kraken",' '"luminous",' '"mimic",' '"osdmap-prune",' '"nautilus",' '"octopus",' '"pacific",' '"elector-pinging",' '"quincy",' '"reef",' '"squid"' '],' '"optional":' '[]' '},' '"mons":' '[' '{' '"rank":' 0, '"name":' '"a",' '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:7302",' '"nonce":' 0 '}' ']' '},' '"addr":' '"127.0.0.1:7302/0",' '"public_addr":' '"127.0.0.1:7302/0",' '"priority":' 0, '"weight":' 0, '"crush_location":' '"{}"' '}' ']' '},' '"quorum":' '[' 0 '],' '"osdmap":' '{' '"epoch":' 88, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"created":' '"2024-09-16T03:22:46.906117+0000",' '"modified":' '"2024-09-16T03:26:15.120212+0000",' '"last_up_change":' '"2024-09-16T03:26:15.120212+0000",' '"last_in_change":' '"2024-09-16T03:25:09.839444+0000",' '"flags":' '"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit",' '"flags_num":' 5799936, '"flags_set":' '[' '"pglog_hardlimit",' '"purged_snapdirs",' '"recovery_deletes",' '"sortbitwise"' '],' '"crush_version":' 8, '"full_ratio":' 0.97000002861022949, '"backfillfull_ratio":' 0.97000002861022949, '"nearfull_ratio":' 0.85000002384185791, '"cluster_snapshot":' '"",' '"pool_max":' 2, '"max_osd":' 3, '"require_min_compat_client":' '"luminous",' '"min_compat_client":' '"jewel",' '"require_osd_release":' '"squid",' '"allow_crimson":' false, '"pools":' '[' '{' '"pool":' 1, '"pool_name":' '"foo",' '"create_time":' '"2024-09-16T03:24:44.525189+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 2, '"min_size":' 1, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"85",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.8700000047683716, '"score_stable":' 1.8700000047683716, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1.25, '"raw_score_stable":' 1.25, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '},' '{' '"pool":' 2, '"pool_name":' '"bar",' '"create_time":' '"2024-09-16T03:24:46.226575+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 2, '"min_size":' 1, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"83",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.4900000095367432, '"score_stable":' 1.4900000095367432, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1, '"raw_score_stable":' 1, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '}' '],' '"osds":' '[' '{' '"osd":' 0, '"uuid":' '"64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 5, '"up_thru":' 84, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6802",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6803",' '"nonce":' 3375787448 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6804",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6805",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6808",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6809",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6806",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6807",' '"nonce":' 3375787448 '}' ']' '},' '"public_addr":' '"127.0.0.1:6803/3375787448",' '"cluster_addr":' '"127.0.0.1:6805/3375787448",' '"heartbeat_back_addr":' '"127.0.0.1:6809/3375787448",' '"heartbeat_front_addr":' '"127.0.0.1:6807/3375787448",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 1, '"uuid":' '"74b26727-75c9-444d-8782-719e4197a382",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 10, '"up_thru":' 84, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6810",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6811",' '"nonce":' 3733255132 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6812",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6813",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6816",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6817",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6814",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6815",' '"nonce":' 3733255132 '}' ']' '},' '"public_addr":' '"127.0.0.1:6811/3733255132",' '"cluster_addr":' '"127.0.0.1:6813/3733255132",' '"heartbeat_back_addr":' '"127.0.0.1:6817/3733255132",' '"heartbeat_front_addr":' '"127.0.0.1:6815/3733255132",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 2, '"uuid":' '"143da3a7-dad9-4b1e-966b-76cf5bdd3c82",' '"up":' 1, '"in":' 0, '"weight":' 0, '"primary_affinity":' 1, '"last_clean_begin":' 15, '"last_clean_end":' 32, '"up_from":' 88, '"up_thru":' 21, '"down_at":' 33, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6818",' '"nonce":' 2576002244 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6819",' '"nonce":' 2576002244 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6820",' '"nonce":' 2576002244 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6821",' '"nonce":' 2576002244 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6824",' '"nonce":' 2576002244 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6825",' '"nonce":' 2576002244 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6822",' '"nonce":' 2576002244 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6823",' '"nonce":' 2576002244 '}' ']' '},' '"public_addr":' '"127.0.0.1:6819/2576002244",' '"cluster_addr":' '"127.0.0.1:6821/2576002244",' '"heartbeat_back_addr":' '"127.0.0.1:6825/2576002244",' '"heartbeat_front_addr":' '"127.0.0.1:6823/2576002244",' '"state":' '[' '"exists",' '"up"' ']' '}' '],' '"osd_xinfo":' '[' '{' '"osd":' 0, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:22.481942+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 1, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:59.663703+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 2, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 65536, '"last_purged_snaps_scrub":' '"2024-09-16T03:24:37.320822+0000",' '"dead_epoch":' 32 '}' '],' '"pg_upmap":' '[],' '"pg_upmap_items":' '[],' '"pg_upmap_primaries":' '[],' '"pg_temp":' '[],' '"primary_temp":' '[],' '"blocklist":' '{},' '"range_blocklist":' '{},' '"erasure_code_profiles":' '{' '"default":' '{' '"k":' '"2",' '"m":' '"2",' '"plugin":' '"jerasure",' '"technique":' '"reed_sol_van"' '}' '},' '"removed_snaps_queue":' '[],' '"new_removed_snaps":' '[],' '"new_purged_snaps":' '[],' '"crush_node_flags":' '{},' '"device_class_flags":' '{},' '"stretch_mode":' '{' '"stretch_mode_enabled":' false, '"stretch_bucket_count":' 0, '"degraded_stretch_mode":' 0, '"recovering_stretch_mode":' 0, '"stretch_mode_bucket":' 0 '}' '},' '"osd_metadata":' '[' '{' '"id":' 0, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/0/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:22:53.662571Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]",' '"hb_front_addr":' '"[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/0",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 1, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/1/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:23:30.129885Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]",' '"hb_front_addr":' '"[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/1",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 2, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6820/2576002244,v1:127.0.0.1:6821/2576002244]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/2/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:24:07.764502Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6818/2576002244,v1:127.0.0.1:6819/2576002244]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6824/2576002244,v1:127.0.0.1:6825/2576002244]",' '"hb_front_addr":' '"[v2:127.0.0.1:6822/2576002244,v1:127.0.0.1:6823/2576002244]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/2",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '}' '],' '"osdmap_clean_epochs":' '{' '"min_last_epoch_clean":' 86, '"last_epoch_clean":' '{' '"per_pool":' '[' '{' '"poolid":' 1, '"floor":' 86 '},' '{' '"poolid":' 2, '"floor":' 86 '}' ']' '},' '"osd_epochs":' '[' '{' '"id":' 0, '"epoch":' 86 '},' '{' '"id":' 1, '"epoch":' 88 '},' '{' '"id":' 2, '"epoch":' 88 '}' ']' '},' '"osdmap_first_committed":' 86, '"osdmap_last_committed":' 88, '"crushmap":' '{' '"devices":' '[' '{' '"id":' 0, '"name":' '"osd.0",' '"class":' '"hdd"' '},' '{' '"id":' 1, '"name":' '"osd.1",' '"class":' '"hdd"' '},' '{' '"id":' 2, '"name":' '"osd.2",' '"class":' '"hdd"' '}' '],' '"types":' '[' '{' '"type_id":' 0, '"name":' '"osd"' '},' '{' '"type_id":' 1, '"name":' '"host"' '},' '{' '"type_id":' 2, '"name":' '"chassis"' '},' '{' '"type_id":' 3, '"name":' '"rack"' '},' '{' '"type_id":' 4, '"name":' '"row"' '},' '{' '"type_id":' 5, '"name":' '"pdu"' '},' '{' '"type_id":' 6, '"name":' '"pod"' '},' '{' '"type_id":' 7, '"name":' '"room"' '},' '{' '"type_id":' 8, '"name":' '"datacenter"' '},' '{' '"type_id":' 9, '"name":' '"zone"' '},' '{' '"type_id":' 10, '"name":' '"region"' '},' '{' '"type_id":' 11, '"name":' '"root"' '}' '],' '"buckets":' '[' '{' '"id":' -1, '"name":' '"default",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -3, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -2, '"name":' '"default~hdd",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -4, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -3, '"name":' '"smithi096",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '},' '{' '"id":' -4, '"name":' '"smithi096~hdd",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '}' '],' '"rules":' '[' '{' '"rule_id":' 0, '"rule_name":' '"replicated_rule",' '"type":' 1, '"steps":' '[' '{' '"op":' '"take",' '"item":' -1, '"item_name":' '"default"' '},' '{' '"op":' '"choose_firstn",' '"num":' 0, '"type":' '"osd"' '},' '{' '"op":' '"emit"' '}' ']' '}' '],' '"tunables":' '{' '"choose_local_tries":' 0, '"choose_local_fallback_tries":' 0, '"choose_total_tries":' 50, '"chooseleaf_descend_once":' 1, '"chooseleaf_vary_r":' 1, '"chooseleaf_stable":' 1, '"msr_descents":' 100, '"msr_collision_tries":' 100, '"straw_calc_version":' 1, '"allowed_bucket_algs":' 54, '"profile":' '"jewel",' '"optimal_tunables":' 1, '"legacy_tunables":' 0, '"minimum_required_version":' '"jewel",' '"require_feature_tunables":' 1, '"require_feature_tunables2":' 1, '"has_v2_rules":' 0, '"require_feature_tunables3":' 1, '"has_v3_rules":' 0, '"has_v4_buckets":' 1, '"require_feature_tunables5":' 1, '"has_v5_rules":' 0, '"has_msr_rules":' 0 '},' '"choose_args":' '{}' '},' '"fsmap":' '{' '"epoch":' 1, '"btime":' '"2024-09-16T03:22:46:882186+0000",' '"default_fscid":' -1, '"compat":' '{' '"compat":' '{},' '"ro_compat":' '{},' '"incompat":' '{' '"feature_1":' '"base' 'v0.20",' '"feature_2":' '"client' writeable 'ranges",' '"feature_3":' '"default' file layouts on 'dirs",' '"feature_4":' '"dir' inode in separate 'object",' '"feature_5":' '"mds' uses versioned 'encoding",' '"feature_6":' '"dirfrag' is stored in 'omap",' '"feature_8":' '"no' anchor 'table",' '"feature_9":' '"file' layout 'v2",' '"feature_10":' '"snaprealm' 'v2",' '"feature_11":' '"minor' log 'segments",' '"feature_12":' '"quiesce' 'subvolumes"' '}' '},' '"feature_flags":' '{' '"enable_multiple":' true, '"ever_enabled_multiple":' true '},' '"standbys":' '[],' '"filesystems":' '[]' '},' '"mdsmap_first_committed":' 1, '"mdsmap_last_committed":' 1, '"auth":' '{' '"first_committed":' 1, '"last_committed":' 5, '"num_secrets":' 3 '},' '"num_pg":' 64, '"num_pg_active":' 64, '"num_pg_unknown":' 0, '"num_osd":' 3, '"pool_sum":' '{' '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 128, '"acting":' 128, '"num_store_stats":' 0 '},' '"osd_sum":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54660, '"kb_used_data":' 888, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660540, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692392960, '"internally_reserved":' 0, '"allocated":' 909312, '"data_stored":' 340707, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 121, '"apply_latency_ms":' 121, '"commit_latency_ns":' 121000000, '"apply_latency_ns":' 121000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '},' '"osd_sum_by_class":' '{' '"hdd":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54660, '"kb_used_data":' 888, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660540, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692392960, '"internally_reserved":' 0, '"allocated":' 909312, '"data_stored":' 340707, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 121, '"apply_latency_ms":' 121, '"commit_latency_ns":' 121000000, '"apply_latency_ns":' 121000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '}' '},' '"pool_stats":' '[' '{' '"poolid":' 2, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '},' '{' '"poolid":' 1, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '}' '],' '"osd_stats":' '[' '{' '"osd":' 0, '"seq":' 21474836523 '},' '{' '"osd":' 1, '"seq":' 42949672995 '},' '{' '"osd":' 2, '"seq":' 1 '}' '],' '"num_pg_by_state":' '[' '{' '"state":' '"active+clean",' '"num":' 64 '}' '],' '"num_pg_by_osd":' '[' '{' '"osd":' 2, '"num_primary_pg":' 0, '"num_acting_pg":' 0, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 0, '"num_primary_pg":' 28, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 1, '"num_primary_pg":' 36, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '}' '],' '"purged_snaps":' '[' '{' '"pool":' 1, '"purged_snaps":' '{}' '},' '{' '"pool":' 2, '"purged_snaps":' '{}' '}' '],' '"servicemap":' '{' '"epoch":' 5, '"modified":' '"2024-09-16T03:25:38.422788+0000",' '"services":' '{}' '},' '"mgrstat_first_committed":' 89, '"mgrstat_last_committed":' 95, '"logm_first_committed":' 1, '"logm_last_committed":' 433, '"paxos":' '{' '"first_committed":' 1, '"last_committed":' 636, '"last_pn":' 0, '"accepted_pn":' 0 '}' '}' 2024-09-16T03:26:19.725 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:132: get_fc_lc_diff: osdm_fc=86 2024-09-16T03:26:19.725 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:134: get_fc_lc_diff: jq .osdmap_last_committed 2024-09-16T03:26:19.725 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:134: get_fc_lc_diff: echo '{' '"cluster_fingerprint":' '"fda2fc64-07ed-4add-8224-2e527e11d427",' '"version":' '"19.3.0-4930-gfc3e0bff",' '"commit":' '"fc3e0bff7468fd55478adbae7f75508b749124b6",' '"timestamp":' '"2024-09-16T03:26:19.579602+0000",' '"tag":' '"",' '"health":' '{' '"status":' '"HEALTH_OK",' '"checks":' '{},' '"mutes":' '[]' '},' '"monmap_first_committed":' 1, '"monmap_last_committed":' 1, '"monmap":' '{' '"epoch":' 1, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"modified":' '"2024-09-16T03:22:45.872880Z",' '"created":' '"2024-09-16T03:22:45.872880Z",' '"min_mon_release":' 19, '"min_mon_release_name":' '"squid",' '"election_strategy":' 1, '"disallowed_leaders:' '":' '"",' '"stretch_mode":' false, '"tiebreaker_mon":' '"",' '"removed_ranks:' '":' '"",' '"features":' '{' '"persistent":' '[' '"kraken",' '"luminous",' '"mimic",' '"osdmap-prune",' '"nautilus",' '"octopus",' '"pacific",' '"elector-pinging",' '"quincy",' '"reef",' '"squid"' '],' '"optional":' '[]' '},' '"mons":' '[' '{' '"rank":' 0, '"name":' '"a",' '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:7302",' '"nonce":' 0 '}' ']' '},' '"addr":' '"127.0.0.1:7302/0",' '"public_addr":' '"127.0.0.1:7302/0",' '"priority":' 0, '"weight":' 0, '"crush_location":' '"{}"' '}' ']' '},' '"quorum":' '[' 0 '],' '"osdmap":' '{' '"epoch":' 88, '"fsid":' '"b3030d7e-4989-4f9f-a16f-63e0a549ceae",' '"created":' '"2024-09-16T03:22:46.906117+0000",' '"modified":' '"2024-09-16T03:26:15.120212+0000",' '"last_up_change":' '"2024-09-16T03:26:15.120212+0000",' '"last_in_change":' '"2024-09-16T03:25:09.839444+0000",' '"flags":' '"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit",' '"flags_num":' 5799936, '"flags_set":' '[' '"pglog_hardlimit",' '"purged_snapdirs",' '"recovery_deletes",' '"sortbitwise"' '],' '"crush_version":' 8, '"full_ratio":' 0.97000002861022949, '"backfillfull_ratio":' 0.97000002861022949, '"nearfull_ratio":' 0.85000002384185791, '"cluster_snapshot":' '"",' '"pool_max":' 2, '"max_osd":' 3, '"require_min_compat_client":' '"luminous",' '"min_compat_client":' '"jewel",' '"require_osd_release":' '"squid",' '"allow_crimson":' false, '"pools":' '[' '{' '"pool":' 1, '"pool_name":' '"foo",' '"create_time":' '"2024-09-16T03:24:44.525189+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 2, '"min_size":' 1, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"85",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.8700000047683716, '"score_stable":' 1.8700000047683716, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1.25, '"raw_score_stable":' 1.25, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '},' '{' '"pool":' 2, '"pool_name":' '"bar",' '"create_time":' '"2024-09-16T03:24:46.226575+0000",' '"flags":' 1, '"flags_names":' '"hashpspool",' '"type":' 1, '"size":' 2, '"min_size":' 1, '"crush_rule":' 0, '"peering_crush_bucket_count":' 0, '"peering_crush_bucket_target":' 0, '"peering_crush_bucket_barrier":' 0, '"peering_crush_bucket_mandatory_member":' 2147483647, '"is_stretch_pool":' false, '"object_hash":' 2, '"pg_autoscale_mode":' '"off",' '"pg_num":' 32, '"pg_placement_num":' 32, '"pg_placement_num_target":' 32, '"pg_num_target":' 32, '"pg_num_pending":' 32, '"last_pg_merge_meta":' '{' '"source_pgid":' '"0.0",' '"ready_epoch":' 0, '"last_epoch_started":' 0, '"last_epoch_clean":' 0, '"source_version":' '"0'\''0",' '"target_version":' '"0'\''0"' '},' '"last_change":' '"83",' '"last_force_op_resend":' '"0",' '"last_force_op_resend_prenautilus":' '"0",' '"last_force_op_resend_preluminous":' '"0",' '"auid":' 0, '"snap_mode":' '"selfmanaged",' '"snap_seq":' 0, '"snap_epoch":' 0, '"pool_snaps":' '[],' '"removed_snaps":' '"[]",' '"quota_max_bytes":' 0, '"quota_max_objects":' 0, '"tiers":' '[],' '"tier_of":' -1, '"read_tier":' -1, '"write_tier":' -1, '"cache_mode":' '"none",' '"target_max_bytes":' 0, '"target_max_objects":' 0, '"cache_target_dirty_ratio_micro":' 400000, '"cache_target_dirty_high_ratio_micro":' 600000, '"cache_target_full_ratio_micro":' 800000, '"cache_min_flush_age":' 0, '"cache_min_evict_age":' 0, '"erasure_code_profile":' '"",' '"hit_set_params":' '{' '"type":' '"none"' '},' '"hit_set_period":' 0, '"hit_set_count":' 0, '"use_gmt_hitset":' true, '"min_read_recency_for_promote":' 0, '"min_write_recency_for_promote":' 0, '"hit_set_grade_decay_rate":' 0, '"hit_set_search_last_n":' 0, '"grade_table":' '[],' '"stripe_width":' 0, '"expected_num_objects":' 0, '"fast_read":' false, '"options":' '{},' '"application_metadata":' '{},' '"read_balance":' '{' '"score_type":' '"Fair' 'distribution",' '"score_acting":' 1.4900000095367432, '"score_stable":' 1.4900000095367432, '"optimal_score":' 0.67000001668930054, '"raw_score_acting":' 1, '"raw_score_stable":' 1, '"primary_affinity_weighted":' 1, '"average_primary_affinity":' 1, '"average_primary_affinity_weighted":' 1 '}' '}' '],' '"osds":' '[' '{' '"osd":' 0, '"uuid":' '"64d0cb52-dfd2-48fc-99d2-f29da3ae8dd6",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 5, '"up_thru":' 84, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6802",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6803",' '"nonce":' 3375787448 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6804",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6805",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6808",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6809",' '"nonce":' 3375787448 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6806",' '"nonce":' 3375787448 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6807",' '"nonce":' 3375787448 '}' ']' '},' '"public_addr":' '"127.0.0.1:6803/3375787448",' '"cluster_addr":' '"127.0.0.1:6805/3375787448",' '"heartbeat_back_addr":' '"127.0.0.1:6809/3375787448",' '"heartbeat_front_addr":' '"127.0.0.1:6807/3375787448",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 1, '"uuid":' '"74b26727-75c9-444d-8782-719e4197a382",' '"up":' 1, '"in":' 1, '"weight":' 1, '"primary_affinity":' 1, '"last_clean_begin":' 0, '"last_clean_end":' 0, '"up_from":' 10, '"up_thru":' 84, '"down_at":' 0, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6810",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6811",' '"nonce":' 3733255132 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6812",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6813",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6816",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6817",' '"nonce":' 3733255132 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6814",' '"nonce":' 3733255132 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6815",' '"nonce":' 3733255132 '}' ']' '},' '"public_addr":' '"127.0.0.1:6811/3733255132",' '"cluster_addr":' '"127.0.0.1:6813/3733255132",' '"heartbeat_back_addr":' '"127.0.0.1:6817/3733255132",' '"heartbeat_front_addr":' '"127.0.0.1:6815/3733255132",' '"state":' '[' '"exists",' '"up"' ']' '},' '{' '"osd":' 2, '"uuid":' '"143da3a7-dad9-4b1e-966b-76cf5bdd3c82",' '"up":' 1, '"in":' 0, '"weight":' 0, '"primary_affinity":' 1, '"last_clean_begin":' 15, '"last_clean_end":' 32, '"up_from":' 88, '"up_thru":' 21, '"down_at":' 33, '"lost_at":' 0, '"public_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6818",' '"nonce":' 2576002244 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6819",' '"nonce":' 2576002244 '}' ']' '},' '"cluster_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6820",' '"nonce":' 2576002244 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6821",' '"nonce":' 2576002244 '}' ']' '},' '"heartbeat_back_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6824",' '"nonce":' 2576002244 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6825",' '"nonce":' 2576002244 '}' ']' '},' '"heartbeat_front_addrs":' '{' '"addrvec":' '[' '{' '"type":' '"v2",' '"addr":' '"127.0.0.1:6822",' '"nonce":' 2576002244 '},' '{' '"type":' '"v1",' '"addr":' '"127.0.0.1:6823",' '"nonce":' 2576002244 '}' ']' '},' '"public_addr":' '"127.0.0.1:6819/2576002244",' '"cluster_addr":' '"127.0.0.1:6821/2576002244",' '"heartbeat_back_addr":' '"127.0.0.1:6825/2576002244",' '"heartbeat_front_addr":' '"127.0.0.1:6823/2576002244",' '"state":' '[' '"exists",' '"up"' ']' '}' '],' '"osd_xinfo":' '[' '{' '"osd":' 0, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:22.481942+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 1, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 0, '"last_purged_snaps_scrub":' '"2024-09-16T03:23:59.663703+0000",' '"dead_epoch":' 0 '},' '{' '"osd":' 2, '"down_stamp":' '"0.000000",' '"laggy_probability":' 0, '"laggy_interval":' 0, '"features":' 4540719139924082687, '"old_weight":' 65536, '"last_purged_snaps_scrub":' '"2024-09-16T03:24:37.320822+0000",' '"dead_epoch":' 32 '}' '],' '"pg_upmap":' '[],' '"pg_upmap_items":' '[],' '"pg_upmap_primaries":' '[],' '"pg_temp":' '[],' '"primary_temp":' '[],' '"blocklist":' '{},' '"range_blocklist":' '{},' '"erasure_code_profiles":' '{' '"default":' '{' '"k":' '"2",' '"m":' '"2",' '"plugin":' '"jerasure",' '"technique":' '"reed_sol_van"' '}' '},' '"removed_snaps_queue":' '[],' '"new_removed_snaps":' '[],' '"new_purged_snaps":' '[],' '"crush_node_flags":' '{},' '"device_class_flags":' '{},' '"stretch_mode":' '{' '"stretch_mode_enabled":' false, '"stretch_bucket_count":' 0, '"degraded_stretch_mode":' 0, '"recovering_stretch_mode":' 0, '"stretch_mode_bucket":' 0 '}' '},' '"osd_metadata":' '[' '{' '"id":' 0, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6804/3375787448,v1:127.0.0.1:6805/3375787448]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/0/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:22:53.662571Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6802/3375787448,v1:127.0.0.1:6803/3375787448]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6808/3375787448,v1:127.0.0.1:6809/3375787448]",' '"hb_front_addr":' '"[v2:127.0.0.1:6806/3375787448,v1:127.0.0.1:6807/3375787448]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/0",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 1, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6812/3733255132,v1:127.0.0.1:6813/3733255132]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/1/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:23:30.129885Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6810/3733255132,v1:127.0.0.1:6811/3733255132]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6816/3733255132,v1:127.0.0.1:6817/3733255132]",' '"hb_front_addr":' '"[v2:127.0.0.1:6814/3733255132,v1:127.0.0.1:6815/3733255132]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/1",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '},' '{' '"id":' 2, '"arch":' '"x86_64",' '"back_addr":' '"[v2:127.0.0.1:6820/2576002244,v1:127.0.0.1:6821/2576002244]",' '"back_iface":' '"",' '"bluefs":' '"1",' '"bluefs_dedicated_db":' '"0",' '"bluefs_dedicated_wal":' '"0",' '"bluefs_single_shared_device":' '"1",' '"bluestore_allocation_from_file":' '"0",' '"bluestore_bdev_access_mode":' '"file",' '"bluestore_bdev_block_size":' '"4096",' '"bluestore_bdev_devices":' '"sda",' '"bluestore_bdev_driver":' '"KernelDevice",' '"bluestore_bdev_optimal_io_size":' '"0",' '"bluestore_bdev_path":' '"td/mon-last-clean-epoch/2/block",' '"bluestore_bdev_rotational":' '"1",' '"bluestore_bdev_size":' '"107374182400",' '"bluestore_bdev_support_discard":' '"0",' '"bluestore_bdev_type":' '"hdd",' '"bluestore_min_alloc_size":' '"4096",' '"ceph_release":' '"squid",' '"ceph_version":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"ceph_version_short":' '"19.3.0-4930-gfc3e0bff",' '"ceph_version_when_created":' '"ceph' version 19.3.0-4930-gfc3e0bff '(fc3e0bff7468fd55478adbae7f75508b749124b6)' squid '(dev)",' '"cpu":' '"Intel(R)' 'Xeon(R)' CPU E5-1620 v4 @ '3.50GHz",' '"created_at":' '"2024-09-16T03:24:07.764502Z",' '"default_device_class":' '"hdd",' '"device_ids":' '"sda=ST1000NM0033-9ZM173_Z1W5QGMP",' '"device_paths":' '"sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1",' '"devices":' '"sda",' '"distro":' '"ubuntu",' '"distro_description":' '"Ubuntu' 22.04.1 'LTS",' '"distro_version":' '"22.04",' '"front_addr":' '"[v2:127.0.0.1:6818/2576002244,v1:127.0.0.1:6819/2576002244]",' '"front_iface":' '"",' '"hb_back_addr":' '"[v2:127.0.0.1:6824/2576002244,v1:127.0.0.1:6825/2576002244]",' '"hb_front_addr":' '"[v2:127.0.0.1:6822/2576002244,v1:127.0.0.1:6823/2576002244]",' '"hostname":' '"smithi096",' '"journal_rotational":' '"1",' '"kernel_description":' '"#131-Ubuntu' SMP Fri Aug 9 08:29:53 UTC '2024",' '"kernel_version":' '"5.15.0-121-generic",' '"mem_swap_kb":' '"2097148",' '"mem_total_kb":' '"32746824",' '"network_numa_unknown_ifaces":' '"back_iface,front_iface",' '"objectstore_numa_unknown_devices":' '"sda",' '"os":' '"Linux",' '"osd_data":' '"td/mon-last-clean-epoch/2",' '"osd_objectstore":' '"bluestore",' '"osdspec_affinity":' '"",' '"rotational":' '"1"' '}' '],' '"osdmap_clean_epochs":' '{' '"min_last_epoch_clean":' 86, '"last_epoch_clean":' '{' '"per_pool":' '[' '{' '"poolid":' 1, '"floor":' 86 '},' '{' '"poolid":' 2, '"floor":' 86 '}' ']' '},' '"osd_epochs":' '[' '{' '"id":' 0, '"epoch":' 86 '},' '{' '"id":' 1, '"epoch":' 88 '},' '{' '"id":' 2, '"epoch":' 88 '}' ']' '},' '"osdmap_first_committed":' 86, '"osdmap_last_committed":' 88, '"crushmap":' '{' '"devices":' '[' '{' '"id":' 0, '"name":' '"osd.0",' '"class":' '"hdd"' '},' '{' '"id":' 1, '"name":' '"osd.1",' '"class":' '"hdd"' '},' '{' '"id":' 2, '"name":' '"osd.2",' '"class":' '"hdd"' '}' '],' '"types":' '[' '{' '"type_id":' 0, '"name":' '"osd"' '},' '{' '"type_id":' 1, '"name":' '"host"' '},' '{' '"type_id":' 2, '"name":' '"chassis"' '},' '{' '"type_id":' 3, '"name":' '"rack"' '},' '{' '"type_id":' 4, '"name":' '"row"' '},' '{' '"type_id":' 5, '"name":' '"pdu"' '},' '{' '"type_id":' 6, '"name":' '"pod"' '},' '{' '"type_id":' 7, '"name":' '"room"' '},' '{' '"type_id":' 8, '"name":' '"datacenter"' '},' '{' '"type_id":' 9, '"name":' '"zone"' '},' '{' '"type_id":' 10, '"name":' '"region"' '},' '{' '"type_id":' 11, '"name":' '"root"' '}' '],' '"buckets":' '[' '{' '"id":' -1, '"name":' '"default",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -3, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -2, '"name":' '"default~hdd",' '"type_id":' 11, '"type_name":' '"root",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' -4, '"weight":' 19206, '"pos":' 0 '}' ']' '},' '{' '"id":' -3, '"name":' '"smithi096",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '},' '{' '"id":' -4, '"name":' '"smithi096~hdd",' '"type_id":' 1, '"type_name":' '"host",' '"weight":' 19206, '"alg":' '"straw2",' '"hash":' '"rjenkins1",' '"items":' '[' '{' '"id":' 0, '"weight":' 6402, '"pos":' 0 '},' '{' '"id":' 1, '"weight":' 6402, '"pos":' 1 '},' '{' '"id":' 2, '"weight":' 6402, '"pos":' 2 '}' ']' '}' '],' '"rules":' '[' '{' '"rule_id":' 0, '"rule_name":' '"replicated_rule",' '"type":' 1, '"steps":' '[' '{' '"op":' '"take",' '"item":' -1, '"item_name":' '"default"' '},' '{' '"op":' '"choose_firstn",' '"num":' 0, '"type":' '"osd"' '},' '{' '"op":' '"emit"' '}' ']' '}' '],' '"tunables":' '{' '"choose_local_tries":' 0, '"choose_local_fallback_tries":' 0, '"choose_total_tries":' 50, '"chooseleaf_descend_once":' 1, '"chooseleaf_vary_r":' 1, '"chooseleaf_stable":' 1, '"msr_descents":' 100, '"msr_collision_tries":' 100, '"straw_calc_version":' 1, '"allowed_bucket_algs":' 54, '"profile":' '"jewel",' '"optimal_tunables":' 1, '"legacy_tunables":' 0, '"minimum_required_version":' '"jewel",' '"require_feature_tunables":' 1, '"require_feature_tunables2":' 1, '"has_v2_rules":' 0, '"require_feature_tunables3":' 1, '"has_v3_rules":' 0, '"has_v4_buckets":' 1, '"require_feature_tunables5":' 1, '"has_v5_rules":' 0, '"has_msr_rules":' 0 '},' '"choose_args":' '{}' '},' '"fsmap":' '{' '"epoch":' 1, '"btime":' '"2024-09-16T03:22:46:882186+0000",' '"default_fscid":' -1, '"compat":' '{' '"compat":' '{},' '"ro_compat":' '{},' '"incompat":' '{' '"feature_1":' '"base' 'v0.20",' '"feature_2":' '"client' writeable 'ranges",' '"feature_3":' '"default' file layouts on 'dirs",' '"feature_4":' '"dir' inode in separate 'object",' '"feature_5":' '"mds' uses versioned 'encoding",' '"feature_6":' '"dirfrag' is stored in 'omap",' '"feature_8":' '"no' anchor 'table",' '"feature_9":' '"file' layout 'v2",' '"feature_10":' '"snaprealm' 'v2",' '"feature_11":' '"minor' log 'segments",' '"feature_12":' '"quiesce' 'subvolumes"' '}' '},' '"feature_flags":' '{' '"enable_multiple":' true, '"ever_enabled_multiple":' true '},' '"standbys":' '[],' '"filesystems":' '[]' '},' '"mdsmap_first_committed":' 1, '"mdsmap_last_committed":' 1, '"auth":' '{' '"first_committed":' 1, '"last_committed":' 5, '"num_secrets":' 3 '},' '"num_pg":' 64, '"num_pg_active":' 64, '"num_pg_unknown":' 0, '"num_osd":' 3, '"pool_sum":' '{' '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 128, '"acting":' 128, '"num_store_stats":' 0 '},' '"osd_sum":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54660, '"kb_used_data":' 888, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660540, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692392960, '"internally_reserved":' 0, '"allocated":' 909312, '"data_stored":' 340707, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 121, '"apply_latency_ms":' 121, '"commit_latency_ns":' 121000000, '"apply_latency_ns":' 121000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '},' '"osd_sum_by_class":' '{' '"hdd":' '{' '"up_from":' 0, '"seq":' 0, '"num_pgs":' 128, '"num_osds":' 2, '"num_per_pool_osds":' 2, '"num_per_pool_omap_osds":' 2, '"kb":' 209715200, '"kb_used":' 54660, '"kb_used_data":' 888, '"kb_used_omap":' 3, '"kb_used_meta":' 53628, '"kb_avail":' 209660540, '"statfs":' '{' '"total":' 214748364800, '"available":' 214692392960, '"internally_reserved":' 0, '"allocated":' 909312, '"data_stored":' 340707, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 3190, '"internal_metadata":' 54915978 '},' '"hb_peers":' '[],' '"snap_trim_queue_len":' 0, '"num_snap_trimming":' 0, '"num_shards_repaired":' 0, '"op_queue_age_hist":' '{' '"histogram":' '[],' '"upper_bound":' 1 '},' '"perf_stat":' '{' '"commit_latency_ms":' 121, '"apply_latency_ms":' 121, '"commit_latency_ns":' 121000000, '"apply_latency_ns":' 121000000 '},' '"alerts":' '[],' '"network_ping_times":' '[]' '}' '},' '"pool_stats":' '[' '{' '"poolid":' 2, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '},' '{' '"poolid":' 1, '"num_pg":' 32, '"stat_sum":' '{' '"num_bytes":' 0, '"num_objects":' 0, '"num_object_clones":' 0, '"num_object_copies":' 0, '"num_objects_missing_on_primary":' 0, '"num_objects_missing":' 0, '"num_objects_degraded":' 0, '"num_objects_misplaced":' 0, '"num_objects_unfound":' 0, '"num_objects_dirty":' 0, '"num_whiteouts":' 0, '"num_read":' 0, '"num_read_kb":' 0, '"num_write":' 0, '"num_write_kb":' 0, '"num_scrub_errors":' 0, '"num_shallow_scrub_errors":' 0, '"num_deep_scrub_errors":' 0, '"num_objects_recovered":' 0, '"num_bytes_recovered":' 0, '"num_keys_recovered":' 0, '"num_objects_omap":' 0, '"num_objects_hit_set_archive":' 0, '"num_bytes_hit_set_archive":' 0, '"num_flush":' 0, '"num_flush_kb":' 0, '"num_evict":' 0, '"num_evict_kb":' 0, '"num_promote":' 0, '"num_flush_mode_high":' 0, '"num_flush_mode_low":' 0, '"num_evict_mode_some":' 0, '"num_evict_mode_full":' 0, '"num_objects_pinned":' 0, '"num_legacy_snapsets":' 0, '"num_large_omap_objects":' 0, '"num_objects_manifest":' 0, '"num_omap_bytes":' 0, '"num_omap_keys":' 0, '"num_objects_repaired":' 0 '},' '"store_stats":' '{' '"total":' 0, '"available":' 0, '"internally_reserved":' 0, '"allocated":' 0, '"data_stored":' 0, '"data_compressed":' 0, '"data_compressed_allocated":' 0, '"data_compressed_original":' 0, '"omap_allocated":' 0, '"internal_metadata":' 0 '},' '"log_size":' 0, '"ondisk_log_size":' 0, '"up":' 64, '"acting":' 64, '"num_store_stats":' 3 '}' '],' '"osd_stats":' '[' '{' '"osd":' 0, '"seq":' 21474836523 '},' '{' '"osd":' 1, '"seq":' 42949672995 '},' '{' '"osd":' 2, '"seq":' 1 '}' '],' '"num_pg_by_state":' '[' '{' '"state":' '"active+clean",' '"num":' 64 '}' '],' '"num_pg_by_osd":' '[' '{' '"osd":' 2, '"num_primary_pg":' 0, '"num_acting_pg":' 0, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 0, '"num_primary_pg":' 28, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '},' '{' '"osd":' 1, '"num_primary_pg":' 36, '"num_acting_pg":' 64, '"num_up_not_acting_pg":' 0 '}' '],' '"purged_snaps":' '[' '{' '"pool":' 1, '"purged_snaps":' '{}' '},' '{' '"pool":' 2, '"purged_snaps":' '{}' '}' '],' '"servicemap":' '{' '"epoch":' 5, '"modified":' '"2024-09-16T03:25:38.422788+0000",' '"services":' '{}' '},' '"mgrstat_first_committed":' 89, '"mgrstat_last_committed":' 95, '"logm_first_committed":' 1, '"logm_last_committed":' 433, '"paxos":' '{' '"first_committed":' 1, '"last_committed":' 636, '"last_pn":' 0, '"accepted_pn":' 0 '}' '}' 2024-09-16T03:26:19.725 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:134: get_fc_lc_diff: osdm_lc=88 2024-09-16T03:26:19.725 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:136: get_fc_lc_diff: echo 2 2024-09-16T03:26:19.726 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:161: wait_for_total_num_maps: [[ 2 -gt 2 ]] 2024-09-16T03:26:19.726 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:304: TEST_mon_last_clean_epoch: return 0 2024-09-16T03:26:19.726 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh:19: run: teardown td/mon-last-clean-epoch 2024-09-16T03:26:19.726 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/mon-last-clean-epoch 2024-09-16T03:26:19.726 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:26:19.726 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/mon-last-clean-epoch KILL 2024-09-16T03:26:19.726 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:26:19.726 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:26:19.726 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:26:19.726 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:26:19.726 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:26:19.768 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:26:19.768 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:26:19.768 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:26:19.768 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:26:19.769 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:26:19.769 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:26:19.770 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:26:19.770 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:26:19.770 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:26:19.771 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:26:19.771 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:26:19.771 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:26:19.772 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:26:19.772 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/mon-last-clean-epoch 2024-09-16T03:26:19.800 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:26:19.800 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:26:19.800 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.47455 2024-09-16T03:26:19.801 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.47455 2024-09-16T03:26:19.802 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:26:19.802 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:26:19.802 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2322: main: code=0 2024-09-16T03:26:19.802 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2326: main: teardown td/mon-last-clean-epoch 0 2024-09-16T03:26:19.802 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/mon-last-clean-epoch 2024-09-16T03:26:19.802 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2024-09-16T03:26:19.802 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/mon-last-clean-epoch KILL 2024-09-16T03:26:19.802 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:26:19.802 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:26:19.802 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:26:19.802 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:26:19.802 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:26:19.803 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:26:19.803 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:26:19.804 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:26:19.804 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:26:19.805 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:26:19.806 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:26:19.806 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:26:19.806 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:26:19.806 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:26:19.806 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:26:19.807 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:26:19.807 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:26:19.808 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2024-09-16T03:26:19.808 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/mon-last-clean-epoch 2024-09-16T03:26:19.809 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:26:19.809 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:26:19.809 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.47455 2024-09-16T03:26:19.809 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.47455 2024-09-16T03:26:19.811 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:26:19.811 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:26:19.811 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2327: main: return 0 2024-09-16T03:26:19.812 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-16T03:26:19.812 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-16T03:26:19.865 INFO:tasks.workunit:Running workunit mon/mon-osdmap-prune.sh... 2024-09-16T03:26:19.865 DEBUG:teuthology.orchestra.run.smithi096:workunit test mon/mon-osdmap-prune.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7498493279982dfe87f00616198a5967475f6169 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-osdmap-prune.sh 2024-09-16T03:26:19.919 INFO:tasks.workunit.client.0.smithi096.stderr:stty: 'standard input': Inappropriate ioctl for device 2024-09-16T03:26:19.924 INFO:tasks.workunit.client.0.smithi096.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2024-09-16T03:26:19.924 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2315: main: export PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-16T03:26:19.924 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2315: main: PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-16T03:26:19.924 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2316: main: export PYTHONWARNINGS=ignore 2024-09-16T03:26:19.924 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2316: main: PYTHONWARNINGS=ignore 2024-09-16T03:26:19.924 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2317: main: export CEPH_CONF=/dev/null 2024-09-16T03:26:19.924 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2317: main: CEPH_CONF=/dev/null 2024-09-16T03:26:19.924 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2318: main: unset CEPH_ARGS 2024-09-16T03:26:19.924 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2320: main: local code 2024-09-16T03:26:19.925 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2321: main: run td/mon-osdmap-prune 2024-09-16T03:26:19.925 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-osdmap-prune.sh:9: run: local dir=td/mon-osdmap-prune 2024-09-16T03:26:19.925 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-osdmap-prune.sh:10: run: shift 2024-09-16T03:26:19.925 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-osdmap-prune.sh:12: run: export CEPH_MON=127.0.0.1:7115 2024-09-16T03:26:19.925 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-osdmap-prune.sh:12: run: CEPH_MON=127.0.0.1:7115 2024-09-16T03:26:19.925 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-osdmap-prune.sh:13: run: export CEPH_ARGS 2024-09-16T03:26:19.925 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-osdmap-prune.sh:14: run: uuidgen 2024-09-16T03:26:19.926 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-osdmap-prune.sh:14: run: CEPH_ARGS+='--fsid=08dc5a0f-381e-4717-8c90-55791ebeecfd --auth-supported=none --mon-host=127.0.0.1:7115 ' 2024-09-16T03:26:19.926 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-osdmap-prune.sh:16: run: set 2024-09-16T03:26:19.926 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-osdmap-prune.sh:16: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2024-09-16T03:26:19.928 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-osdmap-prune.sh:16: run: local funcs=TEST_osdmap_prune 2024-09-16T03:26:19.928 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-osdmap-prune.sh:17: run: for func in $funcs 2024-09-16T03:26:19.928 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-osdmap-prune.sh:18: run: setup td/mon-osdmap-prune 2024-09-16T03:26:19.928 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/mon-osdmap-prune 2024-09-16T03:26:19.928 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/mon-osdmap-prune 2024-09-16T03:26:19.928 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/mon-osdmap-prune 2024-09-16T03:26:19.928 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:26:19.928 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/mon-osdmap-prune KILL 2024-09-16T03:26:19.928 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:26:19.928 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:26:19.928 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:26:19.929 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:26:19.929 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:26:19.930 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:26:19.930 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:26:19.930 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:26:19.930 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:26:19.931 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:26:19.931 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:26:19.931 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:26:19.932 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:26:19.932 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:26:19.932 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:26:19.932 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:26:19.933 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:26:19.934 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:26:19.934 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/mon-osdmap-prune 2024-09-16T03:26:19.935 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:26:19.935 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:26:19.935 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.56415 2024-09-16T03:26:19.935 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.56415 2024-09-16T03:26:19.935 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:26:19.936 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:26:19.936 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/mon-osdmap-prune 2024-09-16T03:26:19.937 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T03:26:19.937 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:26:19.937 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.56415 2024-09-16T03:26:19.937 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.56415 2024-09-16T03:26:19.939 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T03:26:19.939 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2024-09-16T03:26:19.939 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2024-09-16T03:26:19.939 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T03:26:19.939 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/mon-osdmap-prune 1' TERM HUP INT 2024-09-16T03:26:19.939 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-osdmap-prune.sh:19: run: TEST_osdmap_prune td/mon-osdmap-prune 2024-09-16T03:26:19.939 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-osdmap-prune.sh:26: TEST_osdmap_prune: local dir=td/mon-osdmap-prune 2024-09-16T03:26:19.939 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-osdmap-prune.sh:28: TEST_osdmap_prune: run_mon td/mon-osdmap-prune a 2024-09-16T03:26:19.939 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/mon-osdmap-prune 2024-09-16T03:26:19.939 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T03:26:19.940 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T03:26:19.940 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T03:26:19.940 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/mon-osdmap-prune/a 2024-09-16T03:26:19.940 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/mon-osdmap-prune/a --run-dir=td/mon-osdmap-prune 2024-09-16T03:26:20.380 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T03:26:20.381 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:26:20.381 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:26:20.381 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:26:20.381 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:26:20.381 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.56415 2024-09-16T03:26:20.382 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.56415/$cluster-$name.asok' 2024-09-16T03:26:20.382 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/mon-osdmap-prune/a '--log-file=td/mon-osdmap-prune/$name.log' '--admin-socket=/tmp/ceph-asok.56415/$cluster-$name.asok' --mon-cluster-log-file=td/mon-osdmap-prune/log --run-dir=td/mon-osdmap-prune '--pid-file=td/mon-osdmap-prune/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-09-16T03:26:20.575 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T03:26:20.576 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T03:26:20.576 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:26:20.576 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:26:20.576 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T03:26:20.577 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T03:26:20.577 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:26:20.578 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:26:20.578 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:26:20.578 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:26:20.578 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:26:20.578 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.56415 2024-09-16T03:26:20.578 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.56415/ceph-mon.a.asok 2024-09-16T03:26:20.578 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:26:20.578 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.56415/ceph-mon.a.asok config get fsid 2024-09-16T03:26:20.694 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T03:26:20.694 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:26:20.694 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:26:20.694 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T03:26:20.695 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T03:26:20.696 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:26:20.696 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:26:20.696 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:26:20.696 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:26:20.696 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:26:20.696 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.56415 2024-09-16T03:26:20.696 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.56415/ceph-mon.a.asok 2024-09-16T03:26:20.696 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:26:20.696 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.56415/ceph-mon.a.asok config get mon_host 2024-09-16T03:26:20.805 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-osdmap-prune.sh:29: TEST_osdmap_prune: run_mgr td/mon-osdmap-prune x 2024-09-16T03:26:20.805 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/mon-osdmap-prune 2024-09-16T03:26:20.806 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2024-09-16T03:26:20.806 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2024-09-16T03:26:20.806 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2024-09-16T03:26:20.806 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/mon-osdmap-prune/x 2024-09-16T03:26:20.806 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2024-09-16T03:26:21.713 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2024-09-16T03:26:21.713 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:26:21.713 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:26:21.713 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:26:21.713 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:26:21.713 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.56415 2024-09-16T03:26:21.714 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.56415/$cluster-$name.asok' 2024-09-16T03:26:21.714 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T03:26:21.715 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/mon-osdmap-prune/x '--log-file=td/mon-osdmap-prune/$name.log' '--admin-socket=/tmp/ceph-asok.56415/$cluster-$name.asok' --run-dir=td/mon-osdmap-prune '--pid-file=td/mon-osdmap-prune/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T03:26:21.745 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-osdmap-prune.sh:30: TEST_osdmap_prune: run_osd td/mon-osdmap-prune 0 2024-09-16T03:26:21.746 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/mon-osdmap-prune 2024-09-16T03:26:21.746 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T03:26:21.746 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2024-09-16T03:26:21.746 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T03:26:21.746 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/mon-osdmap-prune/0 2024-09-16T03:26:21.746 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=08dc5a0f-381e-4717-8c90-55791ebeecfd --auth-supported=none --mon-host=127.0.0.1:7115 ' 2024-09-16T03:26:21.746 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T03:26:21.746 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T03:26:21.746 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T03:26:21.746 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/mon-osdmap-prune/0' 2024-09-16T03:26:21.746 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/mon-osdmap-prune/0/journal' 2024-09-16T03:26:21.746 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T03:26:21.746 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T03:26:21.747 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/mon-osdmap-prune' 2024-09-16T03:26:21.747 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T03:26:21.747 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:26:21.747 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:26:21.747 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:26:21.747 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:26:21.747 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.56415 2024-09-16T03:26:21.747 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.56415/$cluster-$name.asok' 2024-09-16T03:26:21.747 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.56415/$cluster-$name.asok' 2024-09-16T03:26:21.747 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T03:26:21.747 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T03:26:21.747 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T03:26:21.747 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/mon-osdmap-prune/$name.log' 2024-09-16T03:26:21.748 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/mon-osdmap-prune/$name.pid' 2024-09-16T03:26:21.748 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T03:26:21.748 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T03:26:21.748 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T03:26:21.748 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T03:26:21.748 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T03:26:21.748 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T03:26:21.748 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/mon-osdmap-prune/0 2024-09-16T03:26:21.749 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T03:26:21.749 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=cf18d22c-4700-44bd-90f9-a7f9263a145b 2024-09-16T03:26:21.749 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 cf18d22c-4700-44bd-90f9-a7f9263a145b' 2024-09-16T03:26:21.749 INFO:tasks.workunit.client.0.smithi096.stdout:add osd0 cf18d22c-4700-44bd-90f9-a7f9263a145b 2024-09-16T03:26:21.750 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T03:26:21.763 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBdpedm3X2fLRAA+Vh48G4l2sKBd832CfSnmw== 2024-09-16T03:26:21.764 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBdpedm3X2fLRAA+Vh48G4l2sKBd832CfSnmw=="}' 2024-09-16T03:26:21.764 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new cf18d22c-4700-44bd-90f9-a7f9263a145b -i td/mon-osdmap-prune/0/new.json 2024-09-16T03:26:22.095 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T03:26:22.111 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/mon-osdmap-prune/0/new.json 2024-09-16T03:26:22.111 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=08dc5a0f-381e-4717-8c90-55791ebeecfd --auth-supported=none --mon-host=127.0.0.1:7115 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/mon-osdmap-prune/0 --osd-journal=td/mon-osdmap-prune/0/journal --chdir= --run-dir=td/mon-osdmap-prune '--admin-socket=/tmp/ceph-asok.56415/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/mon-osdmap-prune/$name.log' '--pid-file=td/mon-osdmap-prune/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBdpedm3X2fLRAA+Vh48G4l2sKBd832CfSnmw== --osd-uuid cf18d22c-4700-44bd-90f9-a7f9263a145b 2024-09-16T03:26:22.143 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:26:22.141+0000 7fc4b12f77c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:26:22.164 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:26:22.165+0000 7fc4b12f77c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:26:22.165 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:26:22.165+0000 7fc4b12f77c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:26:22.166 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:26:22.165+0000 7fc4b12f77c0 -1 bdev(0x557fcc5a5c00 td/mon-osdmap-prune/0/block) open stat got: (1) Operation not permitted 2024-09-16T03:26:22.166 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:26:22.165+0000 7fc4b12f77c0 -1 bluestore(td/mon-osdmap-prune/0) _read_fsid unparsable uuid 2024-09-16T03:26:28.410 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/mon-osdmap-prune/0/keyring 2024-09-16T03:26:28.410 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T03:26:28.412 INFO:tasks.workunit.client.0.smithi096.stdout:adding osd0 key to auth repository 2024-09-16T03:26:28.412 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2024-09-16T03:26:28.412 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/mon-osdmap-prune/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T03:26:28.978 INFO:tasks.workunit.client.0.smithi096.stdout:start osd.0 2024-09-16T03:26:28.979 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2024-09-16T03:26:28.979 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=08dc5a0f-381e-4717-8c90-55791ebeecfd --auth-supported=none --mon-host=127.0.0.1:7115 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/mon-osdmap-prune/0 --osd-journal=td/mon-osdmap-prune/0/journal --chdir= --run-dir=td/mon-osdmap-prune '--admin-socket=/tmp/ceph-asok.56415/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/mon-osdmap-prune/$name.log' '--pid-file=td/mon-osdmap-prune/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T03:26:28.979 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T03:26:28.979 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T03:26:28.980 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T03:26:29.008 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:26:29.009+0000 7f5a4c91b7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:26:29.041 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:26:29.041+0000 7f5a4c91b7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:26:29.042 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:26:29.041+0000 7f5a4c91b7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:26:29.440 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2024-09-16T03:26:29.441 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:26:29.441 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2024-09-16T03:26:29.441 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T03:26:29.442 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:26:29.442 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:26:29.442 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:26:29.442 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:26:29.443 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:26:29.443 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:26:29.889 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:26:30.266 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:26:30.265+0000 7f5a4c91b7c0 -1 Falling back to public interface 2024-09-16T03:26:30.891 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:26:30.891 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:26:30.891 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T03:26:30.891 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T03:26:30.892 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:26:30.892 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:26:31.356 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:26:32.356 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:26:32.356 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:26:32.357 INFO:tasks.workunit.client.0.smithi096.stdout:2 2024-09-16T03:26:32.357 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T03:26:32.357 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:26:32.357 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:26:32.794 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:26:33.215 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:26:33.217+0000 7f5a4c91b7c0 -1 osd.0 0 log_to_monitors true 2024-09-16T03:26:33.796 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:26:33.796 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:26:33.796 INFO:tasks.workunit.client.0.smithi096.stdout:3 2024-09-16T03:26:33.797 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T03:26:33.797 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:26:33.797 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:26:34.349 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:26:35.350 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:26:35.351 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:26:35.351 INFO:tasks.workunit.client.0.smithi096.stdout:4 2024-09-16T03:26:35.351 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T03:26:35.351 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:26:35.351 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:26:35.790 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:26:36.792 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:26:36.792 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:26:36.792 INFO:tasks.workunit.client.0.smithi096.stdout:5 2024-09-16T03:26:36.793 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T03:26:36.793 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:26:36.793 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:26:37.315 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:26:38.317 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:26:38.317 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:26:38.318 INFO:tasks.workunit.client.0.smithi096.stdout:6 2024-09-16T03:26:38.318 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T03:26:38.318 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:26:38.318 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:26:38.760 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:26:39.762 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:26:39.762 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:26:39.763 INFO:tasks.workunit.client.0.smithi096.stdout:7 2024-09-16T03:26:39.763 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T03:26:39.764 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:26:39.764 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:26:40.284 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:26:41.286 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:26:41.286 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:26:41.286 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T03:26:41.286 INFO:tasks.workunit.client.0.smithi096.stdout:8 2024-09-16T03:26:41.286 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:26:41.287 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:26:41.739 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:26:42.742 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:26:42.743 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:26:42.743 INFO:tasks.workunit.client.0.smithi096.stdout:9 2024-09-16T03:26:42.743 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T03:26:42.743 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:26:42.744 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:26:43.190 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:26:44.192 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:26:44.192 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:26:44.192 INFO:tasks.workunit.client.0.smithi096.stdout:10 2024-09-16T03:26:44.193 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T03:26:44.193 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:26:44.193 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:26:44.627 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:26:45.629 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:26:45.629 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:26:45.630 INFO:tasks.workunit.client.0.smithi096.stdout:11 2024-09-16T03:26:45.630 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T03:26:45.630 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:26:45.630 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:26:46.346 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:26:47.348 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:26:47.348 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:26:47.348 INFO:tasks.workunit.client.0.smithi096.stdout:12 2024-09-16T03:26:47.349 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T03:26:47.349 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:26:47.349 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:26:48.243 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:26:49.244 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:26:49.245 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:26:49.245 INFO:tasks.workunit.client.0.smithi096.stdout:13 2024-09-16T03:26:49.245 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T03:26:49.245 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:26:49.246 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:26:50.305 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:26:51.307 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:26:51.307 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:26:51.307 INFO:tasks.workunit.client.0.smithi096.stdout:14 2024-09-16T03:26:51.308 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T03:26:51.308 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:26:51.308 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:26:52.134 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:26:53.136 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:26:53.136 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:26:53.137 INFO:tasks.workunit.client.0.smithi096.stdout:15 2024-09-16T03:26:53.137 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T03:26:53.137 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:26:53.137 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:26:53.897 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:26:54.899 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:26:54.900 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:26:54.900 INFO:tasks.workunit.client.0.smithi096.stdout:16 2024-09-16T03:26:54.900 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T03:26:54.900 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:26:54.900 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:26:55.341 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:26:56.343 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:26:56.343 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:26:56.344 INFO:tasks.workunit.client.0.smithi096.stdout:17 2024-09-16T03:26:56.344 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T03:26:56.344 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:26:56.344 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:26:56.970 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:26:57.972 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:26:57.972 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:26:57.972 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 18 2024-09-16T03:26:57.973 INFO:tasks.workunit.client.0.smithi096.stdout:18 2024-09-16T03:26:57.973 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:26:57.973 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:26:58.407 INFO:tasks.workunit.client.0.smithi096.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/3449414971,v1:127.0.0.1:6803/3449414971] [v2:127.0.0.1:6804/3449414971,v1:127.0.0.1:6805/3449414971] exists,up cf18d22c-4700-44bd-90f9-a7f9263a145b 2024-09-16T03:26:58.409 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:26:58.409 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:26:58.409 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:26:58.410 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-osdmap-prune.sh:31: TEST_osdmap_prune: run_osd td/mon-osdmap-prune 1 2024-09-16T03:26:58.410 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/mon-osdmap-prune 2024-09-16T03:26:58.410 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T03:26:58.410 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2024-09-16T03:26:58.410 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T03:26:58.410 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/mon-osdmap-prune/1 2024-09-16T03:26:58.410 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=08dc5a0f-381e-4717-8c90-55791ebeecfd --auth-supported=none --mon-host=127.0.0.1:7115 ' 2024-09-16T03:26:58.410 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T03:26:58.410 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T03:26:58.410 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T03:26:58.411 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/mon-osdmap-prune/1' 2024-09-16T03:26:58.411 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/mon-osdmap-prune/1/journal' 2024-09-16T03:26:58.411 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T03:26:58.411 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T03:26:58.411 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/mon-osdmap-prune' 2024-09-16T03:26:58.411 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T03:26:58.411 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:26:58.411 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:26:58.413 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:26:58.413 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:26:58.414 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.56415 2024-09-16T03:26:58.414 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.56415/$cluster-$name.asok' 2024-09-16T03:26:58.414 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.56415/$cluster-$name.asok' 2024-09-16T03:26:58.414 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T03:26:58.414 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T03:26:58.414 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T03:26:58.414 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/mon-osdmap-prune/$name.log' 2024-09-16T03:26:58.414 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/mon-osdmap-prune/$name.pid' 2024-09-16T03:26:58.414 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T03:26:58.414 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T03:26:58.414 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T03:26:58.414 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T03:26:58.414 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T03:26:58.415 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T03:26:58.415 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/mon-osdmap-prune/1 2024-09-16T03:26:58.415 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T03:26:58.415 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=1ed2d78f-1635-4234-83aa-7c0b7e3c87dc 2024-09-16T03:26:58.415 INFO:tasks.workunit.client.0.smithi096.stdout:add osd1 1ed2d78f-1635-4234-83aa-7c0b7e3c87dc 2024-09-16T03:26:58.415 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 1ed2d78f-1635-4234-83aa-7c0b7e3c87dc' 2024-09-16T03:26:58.415 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T03:26:58.433 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCCpedm2v/zGRAAu2wke4vj8/3ht5EbC/Nk2Q== 2024-09-16T03:26:58.434 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCCpedm2v/zGRAAu2wke4vj8/3ht5EbC/Nk2Q=="}' 2024-09-16T03:26:58.434 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 1ed2d78f-1635-4234-83aa-7c0b7e3c87dc -i td/mon-osdmap-prune/1/new.json 2024-09-16T03:26:58.913 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T03:26:58.928 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/mon-osdmap-prune/1/new.json 2024-09-16T03:26:58.930 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=08dc5a0f-381e-4717-8c90-55791ebeecfd --auth-supported=none --mon-host=127.0.0.1:7115 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/mon-osdmap-prune/1 --osd-journal=td/mon-osdmap-prune/1/journal --chdir= --run-dir=td/mon-osdmap-prune '--admin-socket=/tmp/ceph-asok.56415/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/mon-osdmap-prune/$name.log' '--pid-file=td/mon-osdmap-prune/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCCpedm2v/zGRAAu2wke4vj8/3ht5EbC/Nk2Q== --osd-uuid 1ed2d78f-1635-4234-83aa-7c0b7e3c87dc 2024-09-16T03:26:58.962 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:26:58.960+0000 7f488a8717c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:26:58.976 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:26:58.976+0000 7f488a8717c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:26:58.978 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:26:58.976+0000 7f488a8717c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:26:58.978 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:26:58.976+0000 7f488a8717c0 -1 bdev(0x55c229b0dc00 td/mon-osdmap-prune/1/block) open stat got: (1) Operation not permitted 2024-09-16T03:26:58.978 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:26:58.976+0000 7f488a8717c0 -1 bluestore(td/mon-osdmap-prune/1) _read_fsid unparsable uuid 2024-09-16T03:27:05.456 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/mon-osdmap-prune/1/keyring 2024-09-16T03:27:05.456 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T03:27:05.457 INFO:tasks.workunit.client.0.smithi096.stdout:adding osd1 key to auth repository 2024-09-16T03:27:05.457 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2024-09-16T03:27:05.458 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/mon-osdmap-prune/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T03:27:06.020 INFO:tasks.workunit.client.0.smithi096.stdout:start osd.1 2024-09-16T03:27:06.024 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2024-09-16T03:27:06.024 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=08dc5a0f-381e-4717-8c90-55791ebeecfd --auth-supported=none --mon-host=127.0.0.1:7115 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/mon-osdmap-prune/1 --osd-journal=td/mon-osdmap-prune/1/journal --chdir= --run-dir=td/mon-osdmap-prune '--admin-socket=/tmp/ceph-asok.56415/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/mon-osdmap-prune/$name.log' '--pid-file=td/mon-osdmap-prune/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T03:27:06.024 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T03:27:06.024 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T03:27:06.024 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T03:27:06.050 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:27:06.048+0000 7fde6c1ea7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:27:06.061 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:27:06.060+0000 7fde6c1ea7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:27:06.062 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:27:06.060+0000 7fde6c1ea7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:27:06.514 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2024-09-16T03:27:06.514 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:27:06.514 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2024-09-16T03:27:06.514 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:27:06.514 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:27:06.515 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T03:27:06.515 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:27:06.515 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:27:06.515 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:27:06.515 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:27:06.947 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:27:07.114 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:27:07.112+0000 7fde6c1ea7c0 -1 Falling back to public interface 2024-09-16T03:27:07.949 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:27:07.949 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:27:07.949 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T03:27:07.949 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T03:27:07.950 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:27:07.950 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:27:08.400 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:27:09.401 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:27:09.401 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:27:09.401 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T03:27:09.401 INFO:tasks.workunit.client.0.smithi096.stdout:2 2024-09-16T03:27:09.402 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:27:09.402 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:27:09.813 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:27:09.926 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:27:09.924+0000 7fde6c1ea7c0 -1 osd.1 0 log_to_monitors true 2024-09-16T03:27:10.815 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:27:10.815 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:27:10.815 INFO:tasks.workunit.client.0.smithi096.stdout:3 2024-09-16T03:27:10.815 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T03:27:10.816 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:27:10.816 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:27:11.404 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:27:12.406 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:27:12.406 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:27:12.406 INFO:tasks.workunit.client.0.smithi096.stdout:4 2024-09-16T03:27:12.407 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T03:27:12.407 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:27:12.407 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:27:13.035 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:27:14.037 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:27:14.037 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:27:14.037 INFO:tasks.workunit.client.0.smithi096.stdout:5 2024-09-16T03:27:14.037 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T03:27:14.038 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:27:14.038 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:27:14.482 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:27:15.483 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:27:15.484 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:27:15.484 INFO:tasks.workunit.client.0.smithi096.stdout:6 2024-09-16T03:27:15.484 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T03:27:15.484 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:27:15.484 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:27:15.941 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:27:16.943 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:27:16.943 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:27:16.943 INFO:tasks.workunit.client.0.smithi096.stdout:7 2024-09-16T03:27:16.943 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T03:27:16.943 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:27:16.944 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:27:17.472 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:27:18.473 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:27:18.473 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:27:18.473 INFO:tasks.workunit.client.0.smithi096.stdout:8 2024-09-16T03:27:18.474 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T03:27:18.474 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:27:18.474 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:27:19.031 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:27:20.032 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:27:20.032 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:27:20.033 INFO:tasks.workunit.client.0.smithi096.stdout:9 2024-09-16T03:27:20.033 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T03:27:20.033 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:27:20.033 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:27:20.483 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:27:21.485 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:27:21.485 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:27:21.485 INFO:tasks.workunit.client.0.smithi096.stdout:10 2024-09-16T03:27:21.486 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T03:27:21.486 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:27:21.486 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:27:22.062 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:27:23.064 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:27:23.064 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:27:23.065 INFO:tasks.workunit.client.0.smithi096.stdout:11 2024-09-16T03:27:23.065 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T03:27:23.065 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:27:23.065 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:27:23.972 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:27:24.974 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:27:24.975 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:27:24.975 INFO:tasks.workunit.client.0.smithi096.stdout:12 2024-09-16T03:27:24.975 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T03:27:24.975 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:27:24.975 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:27:25.752 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:27:26.753 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:27:26.753 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:27:26.754 INFO:tasks.workunit.client.0.smithi096.stdout:13 2024-09-16T03:27:26.754 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T03:27:26.754 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:27:26.754 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:27:27.318 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:27:28.320 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:27:28.320 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:27:28.321 INFO:tasks.workunit.client.0.smithi096.stdout:14 2024-09-16T03:27:28.321 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T03:27:28.321 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:27:28.321 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:27:28.951 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:27:29.953 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:27:29.953 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:27:29.954 INFO:tasks.workunit.client.0.smithi096.stdout:15 2024-09-16T03:27:29.954 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T03:27:29.954 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:27:29.954 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:27:30.596 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:27:31.597 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:27:31.598 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:27:31.598 INFO:tasks.workunit.client.0.smithi096.stdout:16 2024-09-16T03:27:31.599 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T03:27:31.599 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:27:31.599 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:27:32.403 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:27:33.404 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:27:33.404 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:27:33.405 INFO:tasks.workunit.client.0.smithi096.stdout:17 2024-09-16T03:27:33.405 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T03:27:33.405 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:27:33.405 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:27:34.294 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:27:35.296 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:27:35.296 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:27:35.296 INFO:tasks.workunit.client.0.smithi096.stdout:18 2024-09-16T03:27:35.297 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 18 2024-09-16T03:27:35.297 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:27:35.297 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:27:35.770 INFO:tasks.workunit.client.0.smithi096.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/4240988863,v1:127.0.0.1:6811/4240988863] [v2:127.0.0.1:6812/4240988863,v1:127.0.0.1:6813/4240988863] exists,up 1ed2d78f-1635-4234-83aa-7c0b7e3c87dc 2024-09-16T03:27:35.772 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:27:35.772 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:27:35.772 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:27:35.772 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-osdmap-prune.sh:32: TEST_osdmap_prune: run_osd td/mon-osdmap-prune 2 2024-09-16T03:27:35.772 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/mon-osdmap-prune 2024-09-16T03:27:35.772 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T03:27:35.773 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2024-09-16T03:27:35.773 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T03:27:35.773 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/mon-osdmap-prune/2 2024-09-16T03:27:35.773 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=08dc5a0f-381e-4717-8c90-55791ebeecfd --auth-supported=none --mon-host=127.0.0.1:7115 ' 2024-09-16T03:27:35.773 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T03:27:35.773 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T03:27:35.773 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T03:27:35.773 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/mon-osdmap-prune/2' 2024-09-16T03:27:35.773 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/mon-osdmap-prune/2/journal' 2024-09-16T03:27:35.773 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T03:27:35.773 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T03:27:35.774 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/mon-osdmap-prune' 2024-09-16T03:27:35.775 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T03:27:35.775 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:27:35.775 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:27:35.776 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:27:35.776 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:27:35.776 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.56415 2024-09-16T03:27:35.776 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.56415/$cluster-$name.asok' 2024-09-16T03:27:35.776 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.56415/$cluster-$name.asok' 2024-09-16T03:27:35.776 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T03:27:35.776 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T03:27:35.776 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T03:27:35.776 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/mon-osdmap-prune/$name.log' 2024-09-16T03:27:35.777 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/mon-osdmap-prune/$name.pid' 2024-09-16T03:27:35.777 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T03:27:35.777 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T03:27:35.777 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T03:27:35.777 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T03:27:35.777 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T03:27:35.777 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T03:27:35.777 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/mon-osdmap-prune/2 2024-09-16T03:27:35.777 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T03:27:35.778 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=c4febd52-73d0-4470-af74-9bb5e7ac65da 2024-09-16T03:27:35.778 INFO:tasks.workunit.client.0.smithi096.stdout:add osd2 c4febd52-73d0-4470-af74-9bb5e7ac65da 2024-09-16T03:27:35.778 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 c4febd52-73d0-4470-af74-9bb5e7ac65da' 2024-09-16T03:27:35.778 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T03:27:35.798 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCnpedme4atLxAAd7XWQ6fMMvmPFWwW+1biDA== 2024-09-16T03:27:35.798 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCnpedme4atLxAAd7XWQ6fMMvmPFWwW+1biDA=="}' 2024-09-16T03:27:35.798 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new c4febd52-73d0-4470-af74-9bb5e7ac65da -i td/mon-osdmap-prune/2/new.json 2024-09-16T03:27:36.319 INFO:tasks.workunit.client.0.smithi096.stdout:2 2024-09-16T03:27:36.335 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/mon-osdmap-prune/2/new.json 2024-09-16T03:27:36.337 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=08dc5a0f-381e-4717-8c90-55791ebeecfd --auth-supported=none --mon-host=127.0.0.1:7115 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/mon-osdmap-prune/2 --osd-journal=td/mon-osdmap-prune/2/journal --chdir= --run-dir=td/mon-osdmap-prune '--admin-socket=/tmp/ceph-asok.56415/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/mon-osdmap-prune/$name.log' '--pid-file=td/mon-osdmap-prune/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCnpedme4atLxAAd7XWQ6fMMvmPFWwW+1biDA== --osd-uuid c4febd52-73d0-4470-af74-9bb5e7ac65da 2024-09-16T03:27:36.364 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:27:36.363+0000 7f21f94067c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:27:36.432 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:27:36.431+0000 7f21f94067c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:27:36.433 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:27:36.431+0000 7f21f94067c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:27:36.434 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:27:36.431+0000 7f21f94067c0 -1 bdev(0x55a695bb5c00 td/mon-osdmap-prune/2/block) open stat got: (1) Operation not permitted 2024-09-16T03:27:36.434 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:27:36.431+0000 7f21f94067c0 -1 bluestore(td/mon-osdmap-prune/2) _read_fsid unparsable uuid 2024-09-16T03:27:42.655 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/mon-osdmap-prune/2/keyring 2024-09-16T03:27:42.655 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T03:27:42.656 INFO:tasks.workunit.client.0.smithi096.stdout:adding osd2 key to auth repository 2024-09-16T03:27:42.657 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2024-09-16T03:27:42.657 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/mon-osdmap-prune/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T03:27:43.231 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2024-09-16T03:27:43.232 INFO:tasks.workunit.client.0.smithi096.stdout:start osd.2 2024-09-16T03:27:43.232 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=08dc5a0f-381e-4717-8c90-55791ebeecfd --auth-supported=none --mon-host=127.0.0.1:7115 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/mon-osdmap-prune/2 --osd-journal=td/mon-osdmap-prune/2/journal --chdir= --run-dir=td/mon-osdmap-prune '--admin-socket=/tmp/ceph-asok.56415/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/mon-osdmap-prune/$name.log' '--pid-file=td/mon-osdmap-prune/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T03:27:43.232 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T03:27:43.232 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T03:27:43.232 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T03:27:43.255 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:27:43.255+0000 7fdd2e2c37c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:27:43.258 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:27:43.255+0000 7fdd2e2c37c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:27:43.259 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:27:43.259+0000 7fdd2e2c37c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:27:43.627 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2024-09-16T03:27:43.628 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:27:43.628 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2024-09-16T03:27:43.628 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:27:43.628 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:27:43.628 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:27:43.628 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:27:43.628 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T03:27:43.629 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:27:43.629 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:27:44.035 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:27:44.738 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:27:44.735+0000 7fdd2e2c37c0 -1 Falling back to public interface 2024-09-16T03:27:45.037 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:27:45.037 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:27:45.037 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T03:27:45.038 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T03:27:45.038 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:27:45.038 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:27:45.459 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:27:46.460 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:27:46.460 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:27:46.461 INFO:tasks.workunit.client.0.smithi096.stdout:2 2024-09-16T03:27:46.461 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T03:27:46.461 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:27:46.461 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:27:46.929 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:27:47.664 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:27:47.663+0000 7fdd2e2c37c0 -1 osd.2 0 log_to_monitors true 2024-09-16T03:27:47.931 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:27:47.931 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:27:47.931 INFO:tasks.workunit.client.0.smithi096.stdout:3 2024-09-16T03:27:47.932 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T03:27:47.932 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:27:47.932 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:27:48.501 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:27:49.502 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:27:49.503 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:27:49.503 INFO:tasks.workunit.client.0.smithi096.stdout:4 2024-09-16T03:27:49.504 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T03:27:49.504 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:27:49.504 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:27:49.951 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:27:50.952 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:27:50.952 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:27:50.953 INFO:tasks.workunit.client.0.smithi096.stdout:5 2024-09-16T03:27:50.953 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T03:27:50.953 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:27:50.953 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:27:51.494 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:27:52.496 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:27:52.496 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:27:52.496 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T03:27:52.496 INFO:tasks.workunit.client.0.smithi096.stdout:6 2024-09-16T03:27:52.497 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:27:52.497 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:27:53.075 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:27:54.077 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:27:54.078 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:27:54.078 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T03:27:54.078 INFO:tasks.workunit.client.0.smithi096.stdout:7 2024-09-16T03:27:54.078 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:27:54.079 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:27:54.639 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:27:55.641 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:27:55.641 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:27:55.641 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T03:27:55.642 INFO:tasks.workunit.client.0.smithi096.stdout:8 2024-09-16T03:27:55.642 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:27:55.642 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:27:56.121 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:27:57.123 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:27:57.123 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:27:57.123 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T03:27:57.124 INFO:tasks.workunit.client.0.smithi096.stdout:9 2024-09-16T03:27:57.124 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:27:57.124 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:27:57.634 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:27:58.635 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:27:58.636 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:27:58.636 INFO:tasks.workunit.client.0.smithi096.stdout:10 2024-09-16T03:27:58.636 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T03:27:58.637 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:27:58.637 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:27:59.188 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:28:00.189 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:28:00.190 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:28:00.190 INFO:tasks.workunit.client.0.smithi096.stdout:11 2024-09-16T03:28:00.190 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T03:28:00.191 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:28:00.191 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:28:00.709 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:28:01.710 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:28:01.711 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:28:01.711 INFO:tasks.workunit.client.0.smithi096.stdout:12 2024-09-16T03:28:01.711 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T03:28:01.711 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:28:01.712 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:28:02.417 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:28:03.419 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:28:03.419 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:28:03.419 INFO:tasks.workunit.client.0.smithi096.stdout:13 2024-09-16T03:28:03.420 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T03:28:03.420 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:28:03.420 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:28:04.363 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:28:05.365 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:28:05.365 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:28:05.366 INFO:tasks.workunit.client.0.smithi096.stdout:14 2024-09-16T03:28:05.366 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T03:28:05.366 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:28:05.366 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:28:06.406 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:28:07.408 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:28:07.408 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:28:07.409 INFO:tasks.workunit.client.0.smithi096.stdout:15 2024-09-16T03:28:07.409 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T03:28:07.409 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:28:07.409 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:28:08.308 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:28:09.309 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:28:09.309 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:28:09.310 INFO:tasks.workunit.client.0.smithi096.stdout:16 2024-09-16T03:28:09.310 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T03:28:09.310 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:28:09.310 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:28:09.895 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:28:10.896 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:28:10.896 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:28:10.897 INFO:tasks.workunit.client.0.smithi096.stdout:17 2024-09-16T03:28:10.897 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T03:28:10.897 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:28:10.897 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:28:11.785 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:28:12.786 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:28:12.786 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:28:12.787 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 18 2024-09-16T03:28:12.787 INFO:tasks.workunit.client.0.smithi096.stdout:18 2024-09-16T03:28:12.787 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:28:12.787 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:28:13.210 INFO:tasks.workunit.client.0.smithi096.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/2239695978,v1:127.0.0.1:6819/2239695978] [v2:127.0.0.1:6820/2239695978,v1:127.0.0.1:6821/2239695978] exists,up c4febd52-73d0-4470-af74-9bb5e7ac65da 2024-09-16T03:28:13.211 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:28:13.211 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:28:13.211 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:28:13.211 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-osdmap-prune.sh:34: TEST_osdmap_prune: sleep 5 2024-09-16T03:28:18.212 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-osdmap-prune.sh:38: TEST_osdmap_prune: ceph osd set-full-ratio 0.97 2024-09-16T03:28:18.880 INFO:tasks.workunit.client.0.smithi096.stderr:osd set-full-ratio 0.97 2024-09-16T03:28:18.898 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-osdmap-prune.sh:39: TEST_osdmap_prune: ceph osd set-backfillfull-ratio 0.97 2024-09-16T03:28:19.558 INFO:tasks.workunit.client.0.smithi096.stderr:osd set-backfillfull-ratio 0.97 2024-09-16T03:28:19.576 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-osdmap-prune.sh:41: TEST_osdmap_prune: ceph config set osd osd_beacon_report_interval 10 2024-09-16T03:28:20.143 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-osdmap-prune.sh:42: TEST_osdmap_prune: ceph config set mon mon_debug_extra_checks true 2024-09-16T03:28:20.694 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-osdmap-prune.sh:44: TEST_osdmap_prune: ceph config set mon mon_min_osdmap_epochs 100 2024-09-16T03:28:21.170 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-osdmap-prune.sh:45: TEST_osdmap_prune: ceph config set mon mon_osdmap_full_prune_enabled true 2024-09-16T03:28:21.672 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-osdmap-prune.sh:46: TEST_osdmap_prune: ceph config set mon mon_osdmap_full_prune_min 200 2024-09-16T03:28:22.156 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-osdmap-prune.sh:47: TEST_osdmap_prune: ceph config set mon mon_osdmap_full_prune_interval 10 2024-09-16T03:28:22.664 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-osdmap-prune.sh:48: TEST_osdmap_prune: ceph config set mon mon_osdmap_full_prune_txsize 100 2024-09-16T03:28:23.209 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-osdmap-prune.sh:51: TEST_osdmap_prune: bash -x /home/ubuntu/cephtest/clone.client.0/qa/workunits/mon/test_mon_osdmap_prune.sh 2024-09-16T03:28:23.211 INFO:tasks.workunit.client.0.smithi096.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/mon/test_mon_osdmap_prune.sh 2024-09-16T03:28:23.213 INFO:tasks.workunit.client.0.smithi096.stderr:+ . /home/ubuntu/cephtest/clone.client.0/qa/workunits/mon/../../standalone/ceph-helpers.sh 2024-09-16T03:28:23.213 INFO:tasks.workunit.client.0.smithi096.stderr:++ TIMEOUT=300 2024-09-16T03:28:23.213 INFO:tasks.workunit.client.0.smithi096.stderr:++ WAIT_FOR_CLEAN_TIMEOUT=90 2024-09-16T03:28:23.213 INFO:tasks.workunit.client.0.smithi096.stderr:++ MAX_TIMEOUT=15 2024-09-16T03:28:23.213 INFO:tasks.workunit.client.0.smithi096.stderr:++ PG_NUM=4 2024-09-16T03:28:23.213 INFO:tasks.workunit.client.0.smithi096.stderr:++ TMPDIR=/tmp 2024-09-16T03:28:23.213 INFO:tasks.workunit.client.0.smithi096.stderr:++ CEPH_BUILD_VIRTUALENV=/tmp 2024-09-16T03:28:23.213 INFO:tasks.workunit.client.0.smithi096.stderr:++ TESTDIR=/home/ubuntu/cephtest 2024-09-16T03:28:23.214 INFO:tasks.workunit.client.0.smithi096.stderr:+++ uname 2024-09-16T03:28:23.214 INFO:tasks.workunit.client.0.smithi096.stderr:++ '[' Linux = FreeBSD ']' 2024-09-16T03:28:23.214 INFO:tasks.workunit.client.0.smithi096.stderr:++ SED=sed 2024-09-16T03:28:23.214 INFO:tasks.workunit.client.0.smithi096.stderr:++ AWK=awk 2024-09-16T03:28:23.215 INFO:tasks.workunit.client.0.smithi096.stderr:+++ stty -a 2024-09-16T03:28:23.215 INFO:tasks.workunit.client.0.smithi096.stderr:+++ head -1 2024-09-16T03:28:23.215 INFO:tasks.workunit.client.0.smithi096.stderr:+++ sed -e 's/.*columns \([0-9]*\).*/\1/' 2024-09-16T03:28:23.215 INFO:tasks.workunit.client.0.smithi096.stderr:stty: 'standard input': Inappropriate ioctl for device 2024-09-16T03:28:23.216 INFO:tasks.workunit.client.0.smithi096.stderr:++ termwidth= 2024-09-16T03:28:23.216 INFO:tasks.workunit.client.0.smithi096.stderr:++ '[' -n '' -a '' '!=' 0 ']' 2024-09-16T03:28:23.216 INFO:tasks.workunit.client.0.smithi096.stderr:++ DIFFCOLOPTS='-y ' 2024-09-16T03:28:23.216 INFO:tasks.workunit.client.0.smithi096.stderr:++ KERNCORE=kernel.core_pattern 2024-09-16T03:28:23.216 INFO:tasks.workunit.client.0.smithi096.stderr:++ EXTRA_OPTS= 2024-09-16T03:28:23.219 INFO:tasks.workunit.client.0.smithi096.stderr:++ test '' = TESTS 2024-09-16T03:28:23.220 INFO:tasks.workunit.client.0.smithi096.stderr:+ set -x 2024-09-16T03:28:23.220 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_mon_osdmap_prune 2024-09-16T03:28:23.220 INFO:tasks.workunit.client.0.smithi096.stderr:+ create_pool foo 32 2024-09-16T03:28:23.220 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd pool create foo 32 2024-09-16T03:28:23.764 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'foo' already exists 2024-09-16T03:28:23.779 INFO:tasks.workunit.client.0.smithi096.stderr:+ sleep 1 2024-09-16T03:28:24.781 INFO:tasks.workunit.client.0.smithi096.stderr:+ wait_for_clean 2024-09-16T03:28:24.781 INFO:tasks.workunit.client.0.smithi096.stderr:+ local cmd= 2024-09-16T03:28:24.781 INFO:tasks.workunit.client.0.smithi096.stderr:+ local num_active_clean=-1 2024-09-16T03:28:24.781 INFO:tasks.workunit.client.0.smithi096.stderr:+ local cur_active_clean 2024-09-16T03:28:24.782 INFO:tasks.workunit.client.0.smithi096.stderr:++ get_timeout_delays 90 .1 2024-09-16T03:28:24.782 INFO:tasks.workunit.client.0.smithi096.stderr:+++ shopt -q -o xtrace 2024-09-16T03:28:24.782 INFO:tasks.workunit.client.0.smithi096.stderr:+++ echo true 2024-09-16T03:28:24.783 INFO:tasks.workunit.client.0.smithi096.stderr:++ local trace=true 2024-09-16T03:28:24.783 INFO:tasks.workunit.client.0.smithi096.stderr:++ true 2024-09-16T03:28:24.783 INFO:tasks.workunit.client.0.smithi096.stderr:++ shopt -u -o xtrace 2024-09-16T03:28:24.886 INFO:tasks.workunit.client.0.smithi096.stderr:+ delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-09-16T03:28:24.886 INFO:tasks.workunit.client.0.smithi096.stderr:+ local -a delays 2024-09-16T03:28:24.886 INFO:tasks.workunit.client.0.smithi096.stderr:+ local -i loop=0 2024-09-16T03:28:24.887 INFO:tasks.workunit.client.0.smithi096.stderr:+ flush_pg_stats 2024-09-16T03:28:24.887 INFO:tasks.workunit.client.0.smithi096.stderr:+ local timeout=300 2024-09-16T03:28:24.887 INFO:tasks.workunit.client.0.smithi096.stderr:++ ceph osd ls 2024-09-16T03:28:25.554 INFO:tasks.workunit.client.0.smithi096.stderr:+ ids='0 2024-09-16T03:28:25.554 INFO:tasks.workunit.client.0.smithi096.stderr:1 2024-09-16T03:28:25.554 INFO:tasks.workunit.client.0.smithi096.stderr:2' 2024-09-16T03:28:25.554 INFO:tasks.workunit.client.0.smithi096.stderr:+ seqs= 2024-09-16T03:28:25.554 INFO:tasks.workunit.client.0.smithi096.stderr:+ for osd in $ids 2024-09-16T03:28:25.554 INFO:tasks.workunit.client.0.smithi096.stderr:++ ceph tell osd.0 flush_pg_stats 2024-09-16T03:28:25.704 INFO:tasks.workunit.client.0.smithi096.stderr:+ seq=21474836507 2024-09-16T03:28:25.705 INFO:tasks.workunit.client.0.smithi096.stderr:+ test -z 21474836507 2024-09-16T03:28:25.705 INFO:tasks.workunit.client.0.smithi096.stderr:+ seqs=' 0-21474836507' 2024-09-16T03:28:25.705 INFO:tasks.workunit.client.0.smithi096.stderr:+ for osd in $ids 2024-09-16T03:28:25.705 INFO:tasks.workunit.client.0.smithi096.stderr:++ ceph tell osd.1 flush_pg_stats 2024-09-16T03:28:25.906 INFO:tasks.workunit.client.0.smithi096.stderr:+ seq=42949672973 2024-09-16T03:28:25.906 INFO:tasks.workunit.client.0.smithi096.stderr:+ test -z 42949672973 2024-09-16T03:28:25.906 INFO:tasks.workunit.client.0.smithi096.stderr:+ seqs=' 0-21474836507 1-42949672973' 2024-09-16T03:28:25.906 INFO:tasks.workunit.client.0.smithi096.stderr:+ for osd in $ids 2024-09-16T03:28:25.906 INFO:tasks.workunit.client.0.smithi096.stderr:++ ceph tell osd.2 flush_pg_stats 2024-09-16T03:28:26.072 INFO:tasks.workunit.client.0.smithi096.stderr:+ seq=64424509448 2024-09-16T03:28:26.072 INFO:tasks.workunit.client.0.smithi096.stderr:+ test -z 64424509448 2024-09-16T03:28:26.072 INFO:tasks.workunit.client.0.smithi096.stderr:+ seqs=' 0-21474836507 1-42949672973 2-64424509448' 2024-09-16T03:28:26.073 INFO:tasks.workunit.client.0.smithi096.stderr:+ for s in $seqs 2024-09-16T03:28:26.073 INFO:tasks.workunit.client.0.smithi096.stderr:++ echo 0-21474836507 2024-09-16T03:28:26.073 INFO:tasks.workunit.client.0.smithi096.stderr:++ cut -d - -f 1 2024-09-16T03:28:26.074 INFO:tasks.workunit.client.0.smithi096.stderr:+ osd=0 2024-09-16T03:28:26.074 INFO:tasks.workunit.client.0.smithi096.stderr:++ echo 0-21474836507 2024-09-16T03:28:26.074 INFO:tasks.workunit.client.0.smithi096.stderr:++ cut -d - -f 2 2024-09-16T03:28:26.075 INFO:tasks.workunit.client.0.smithi096.stderr:+ seq=21474836507 2024-09-16T03:28:26.075 INFO:tasks.workunit.client.0.smithi096.stderr:+ echo 'waiting osd.0 seq 21474836507' 2024-09-16T03:28:26.076 INFO:tasks.workunit.client.0.smithi096.stdout:waiting osd.0 seq 21474836507 2024-09-16T03:28:26.076 INFO:tasks.workunit.client.0.smithi096.stderr:++ ceph osd last-stat-seq 0 2024-09-16T03:28:26.559 INFO:tasks.workunit.client.0.smithi096.stderr:+ test 21474836505 -lt 21474836507 2024-09-16T03:28:26.559 INFO:tasks.workunit.client.0.smithi096.stderr:+ sleep 1 2024-09-16T03:28:27.560 INFO:tasks.workunit.client.0.smithi096.stderr:+ '[' 300 -eq 0 ']' 2024-09-16T03:28:27.561 INFO:tasks.workunit.client.0.smithi096.stderr:++ ceph osd last-stat-seq 0 2024-09-16T03:28:28.000 INFO:tasks.workunit.client.0.smithi096.stderr:+ test 21474836507 -lt 21474836507 2024-09-16T03:28:28.001 INFO:tasks.workunit.client.0.smithi096.stderr:+ for s in $seqs 2024-09-16T03:28:28.001 INFO:tasks.workunit.client.0.smithi096.stderr:++ echo 1-42949672973 2024-09-16T03:28:28.001 INFO:tasks.workunit.client.0.smithi096.stderr:++ cut -d - -f 1 2024-09-16T03:28:28.002 INFO:tasks.workunit.client.0.smithi096.stderr:+ osd=1 2024-09-16T03:28:28.003 INFO:tasks.workunit.client.0.smithi096.stderr:++ echo 1-42949672973 2024-09-16T03:28:28.003 INFO:tasks.workunit.client.0.smithi096.stderr:++ cut -d - -f 2 2024-09-16T03:28:28.004 INFO:tasks.workunit.client.0.smithi096.stderr:+ seq=42949672973 2024-09-16T03:28:28.005 INFO:tasks.workunit.client.0.smithi096.stdout:waiting osd.1 seq 42949672973 2024-09-16T03:28:28.005 INFO:tasks.workunit.client.0.smithi096.stderr:+ echo 'waiting osd.1 seq 42949672973' 2024-09-16T03:28:28.005 INFO:tasks.workunit.client.0.smithi096.stderr:++ ceph osd last-stat-seq 1 2024-09-16T03:28:28.481 INFO:tasks.workunit.client.0.smithi096.stderr:+ test 42949672973 -lt 42949672973 2024-09-16T03:28:28.481 INFO:tasks.workunit.client.0.smithi096.stderr:+ for s in $seqs 2024-09-16T03:28:28.482 INFO:tasks.workunit.client.0.smithi096.stderr:++ echo 2-64424509448 2024-09-16T03:28:28.482 INFO:tasks.workunit.client.0.smithi096.stderr:++ cut -d - -f 1 2024-09-16T03:28:28.483 INFO:tasks.workunit.client.0.smithi096.stderr:+ osd=2 2024-09-16T03:28:28.484 INFO:tasks.workunit.client.0.smithi096.stderr:++ echo 2-64424509448 2024-09-16T03:28:28.484 INFO:tasks.workunit.client.0.smithi096.stderr:++ cut -d - -f 2 2024-09-16T03:28:28.485 INFO:tasks.workunit.client.0.smithi096.stdout:waiting osd.2 seq 64424509448 2024-09-16T03:28:28.485 INFO:tasks.workunit.client.0.smithi096.stderr:+ seq=64424509448 2024-09-16T03:28:28.485 INFO:tasks.workunit.client.0.smithi096.stderr:+ echo 'waiting osd.2 seq 64424509448' 2024-09-16T03:28:28.485 INFO:tasks.workunit.client.0.smithi096.stderr:++ ceph osd last-stat-seq 2 2024-09-16T03:28:28.923 INFO:tasks.workunit.client.0.smithi096.stderr:+ test 64424509449 -lt 64424509448 2024-09-16T03:28:28.923 INFO:tasks.workunit.client.0.smithi096.stderr:++ get_num_pgs 2024-09-16T03:28:28.923 INFO:tasks.workunit.client.0.smithi096.stderr:++ ceph --format json status 2024-09-16T03:28:28.923 INFO:tasks.workunit.client.0.smithi096.stderr:++ jq .pgmap.num_pgs 2024-09-16T03:28:29.502 INFO:tasks.workunit.client.0.smithi096.stderr:+ test 32 == 0 2024-09-16T03:28:29.502 INFO:tasks.workunit.client.0.smithi096.stderr:+ true 2024-09-16T03:28:29.502 INFO:tasks.workunit.client.0.smithi096.stderr:++ get_num_active_clean 2024-09-16T03:28:29.502 INFO:tasks.workunit.client.0.smithi096.stderr:++ local expression 2024-09-16T03:28:29.503 INFO:tasks.workunit.client.0.smithi096.stderr:++ expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:28:29.503 INFO:tasks.workunit.client.0.smithi096.stderr:++ expression+='select(contains("stale") | not)' 2024-09-16T03:28:29.503 INFO:tasks.workunit.client.0.smithi096.stderr:++ ceph --format json pg dump pgs 2024-09-16T03:28:29.503 INFO:tasks.workunit.client.0.smithi096.stderr:++ jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:28:29.911 INFO:tasks.workunit.client.0.smithi096.stderr:+ cur_active_clean=32 2024-09-16T03:28:29.911 INFO:tasks.workunit.client.0.smithi096.stderr:++ get_num_pgs 2024-09-16T03:28:29.911 INFO:tasks.workunit.client.0.smithi096.stderr:++ ceph --format json status 2024-09-16T03:28:29.911 INFO:tasks.workunit.client.0.smithi096.stderr:++ jq .pgmap.num_pgs 2024-09-16T03:28:30.449 INFO:tasks.workunit.client.0.smithi096.stderr:+ test 32 = 32 2024-09-16T03:28:30.449 INFO:tasks.workunit.client.0.smithi096.stderr:+ break 2024-09-16T03:28:30.449 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:28:30.449 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph config set mon mon_debug_block_osdmap_trim true 2024-09-16T03:28:30.953 INFO:tasks.workunit.client.0.smithi096.stderr:+ generate_osdmaps 500 2024-09-16T03:28:30.953 INFO:tasks.workunit.client.0.smithi096.stderr:+ local -i num=500 2024-09-16T03:28:30.953 INFO:tasks.workunit.client.0.smithi096.stderr:+ cmds=(set unset) 2024-09-16T03:28:30.953 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i=0 )) 2024-09-16T03:28:30.953 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:28:30.953 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:28:31.726 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:28:31.749 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:28:31.749 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:28:31.749 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:28:32.480 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:28:32.502 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:28:32.502 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:28:32.502 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:28:33.250 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:28:33.272 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:28:33.272 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:28:33.272 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:28:34.071 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:28:34.090 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:28:34.091 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:28:34.091 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:28:34.866 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:28:34.884 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:28:34.884 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:28:34.884 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:28:35.737 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:28:35.757 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:28:35.757 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:28:35.757 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:28:36.599 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:28:36.624 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:28:36.624 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:28:36.624 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:28:37.504 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:28:37.525 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:28:37.525 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:28:37.525 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:28:38.224 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:28:38.244 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:28:38.244 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:28:38.244 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:28:38.985 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:28:39.006 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:28:39.006 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:28:39.006 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:28:39.656 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:28:39.674 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:28:39.675 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:28:39.675 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:28:40.359 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:28:40.380 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:28:40.380 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:28:40.380 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:28:41.172 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:28:41.193 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:28:41.193 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:28:41.193 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:28:41.876 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:28:41.899 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:28:41.899 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:28:41.899 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:28:42.729 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:28:42.751 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:28:42.751 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:28:42.751 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:28:43.524 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:28:43.547 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:28:43.548 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:28:43.548 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:28:44.261 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:28:44.279 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:28:44.279 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:28:44.280 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:28:45.123 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:28:45.147 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:28:45.147 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:28:45.147 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:28:45.968 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:28:45.991 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:28:45.991 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:28:45.991 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:28:46.899 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:28:46.921 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:28:46.921 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:28:46.921 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:28:47.653 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:28:47.675 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:28:47.675 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:28:47.675 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:28:48.773 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:28:48.795 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:28:48.796 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:28:48.796 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:28:49.669 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:28:49.692 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:28:49.693 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:28:49.693 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:28:50.458 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:28:50.480 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:28:50.480 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:28:50.481 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:28:51.212 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:28:51.232 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:28:51.232 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:28:51.232 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:28:51.999 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:28:52.015 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:28:52.016 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:28:52.016 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:28:52.886 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:28:52.904 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:28:52.905 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:28:52.905 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:28:53.672 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:28:53.693 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:28:53.693 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:28:53.693 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:28:54.402 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:28:54.422 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:28:54.422 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:28:54.422 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:28:55.172 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:28:55.195 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:28:55.195 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:28:55.195 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:28:55.984 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:28:56.004 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:28:56.005 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:28:56.005 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:28:56.880 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:28:56.904 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:28:56.904 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:28:56.904 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:28:57.658 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:28:57.681 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:28:57.681 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:28:57.681 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:28:58.454 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:28:58.473 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:28:58.473 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:28:58.474 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:28:59.291 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:28:59.312 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:28:59.313 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:28:59.313 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:28:59.978 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:28:59.997 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:28:59.997 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:28:59.997 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:29:00.807 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:29:00.829 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:29:00.829 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:29:00.829 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:29:01.720 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:29:01.744 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:29:01.744 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:29:01.744 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:29:02.507 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:29:02.524 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:29:02.524 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:29:02.524 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:29:03.294 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:29:03.312 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:29:03.312 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:29:03.312 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:29:04.290 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:29:04.313 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:29:04.313 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:29:04.313 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:29:05.111 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:29:05.135 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:29:05.135 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:29:05.136 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:29:05.948 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:29:05.969 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:29:05.969 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:29:05.969 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:29:06.828 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:29:06.851 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:29:06.852 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:29:06.852 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:29:07.765 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:29:07.787 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:29:07.787 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:29:07.787 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:29:08.426 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:29:08.448 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:29:08.448 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:29:08.448 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:29:09.163 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:29:09.182 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:29:09.182 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:29:09.182 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:29:10.025 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:29:10.045 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:29:10.046 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:29:10.046 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:29:10.736 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:29:10.757 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:29:10.757 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:29:10.757 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:29:11.702 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:29:11.724 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:29:11.724 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:29:11.724 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:29:12.528 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:29:12.549 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:29:12.549 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:29:12.549 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:29:13.307 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:29:13.329 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:29:13.329 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:29:13.329 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:29:14.061 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:29:14.081 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:29:14.081 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:29:14.081 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:29:14.982 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:29:15.004 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:29:15.004 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:29:15.004 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:29:15.702 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:29:15.721 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:29:15.721 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:29:15.721 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:29:16.455 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:29:16.478 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:29:16.479 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:29:16.479 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:29:17.133 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:29:17.155 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:29:17.155 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:29:17.155 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:29:17.937 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:29:17.958 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:29:17.958 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:29:17.958 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:29:18.903 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:29:18.924 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:29:18.924 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:29:18.924 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:29:19.811 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:29:19.830 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:29:19.830 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:29:19.830 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:29:20.691 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:29:20.713 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:29:20.714 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:29:20.714 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:29:21.487 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:29:21.509 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:29:21.509 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:29:21.509 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:29:22.402 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:29:22.424 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:29:22.424 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:29:22.424 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:29:23.087 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:29:23.106 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:29:23.106 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:29:23.106 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:29:23.899 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:29:23.920 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:29:23.920 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:29:23.920 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:29:24.636 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:29:24.657 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:29:24.657 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:29:24.657 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:29:25.415 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:29:25.431 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:29:25.431 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:29:25.432 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:29:26.109 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:29:26.126 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:29:26.126 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:29:26.126 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:29:26.896 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:29:26.914 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:29:26.914 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:29:26.914 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:29:27.691 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:29:27.712 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:29:27.712 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:29:27.712 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:29:28.386 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:29:28.404 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:29:28.404 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:29:28.404 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:29:29.274 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:29:29.291 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:29:29.291 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:29:29.291 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:29:30.061 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:29:30.081 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:29:30.082 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:29:30.082 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:29:31.084 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:29:31.107 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:29:31.107 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:29:31.107 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:29:31.736 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:29:31.754 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:29:31.754 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:29:31.754 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:29:32.549 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:29:32.569 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:29:32.569 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:29:32.570 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:29:33.353 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:29:33.374 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:29:33.374 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:29:33.374 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:29:34.233 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:29:34.255 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:29:34.255 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:29:34.255 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:29:35.096 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:29:35.118 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:29:35.118 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:29:35.118 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:29:35.943 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:29:35.962 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:29:35.963 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:29:35.963 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:29:36.771 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:29:36.790 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:29:36.790 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:29:36.790 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:29:37.567 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:29:37.587 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:29:37.588 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:29:37.588 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:29:38.476 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:29:38.496 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:29:38.497 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:29:38.497 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:29:39.193 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:29:39.215 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:29:39.215 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:29:39.215 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:29:39.904 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:29:39.924 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:29:39.924 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:29:39.924 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:29:40.834 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:29:40.854 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:29:40.854 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:29:40.854 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:29:41.537 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:29:41.557 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:29:41.557 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:29:41.557 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:29:42.291 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:29:42.312 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:29:42.312 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:29:42.312 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:29:43.095 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:29:43.118 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:29:43.118 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:29:43.118 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:29:44.010 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:29:44.034 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:29:44.034 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:29:44.034 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:29:44.713 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:29:44.734 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:29:44.734 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:29:44.734 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:29:45.454 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:29:45.474 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:29:45.474 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:29:45.474 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:29:46.228 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:29:46.249 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:29:46.249 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:29:46.249 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:29:47.058 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:29:47.079 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:29:47.079 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:29:47.079 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:29:47.953 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:29:47.976 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:29:47.977 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:29:47.977 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:29:48.664 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:29:48.687 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:29:48.687 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:29:48.687 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:29:49.585 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:29:49.605 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:29:49.605 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:29:49.605 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:29:50.295 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:29:50.313 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:29:50.313 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:29:50.313 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:29:51.116 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:29:51.134 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:29:51.134 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:29:51.134 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:29:51.861 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:29:51.880 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:29:51.880 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:29:51.880 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:29:52.782 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:29:52.808 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:29:52.808 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:29:52.808 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:29:53.444 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:29:53.464 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:29:53.464 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:29:53.465 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:29:54.280 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:29:54.301 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:29:54.301 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:29:54.302 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:29:55.109 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:29:55.128 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:29:55.128 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:29:55.128 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:29:55.871 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:29:55.894 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:29:55.894 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:29:55.894 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:29:56.650 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:29:56.673 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:29:56.673 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:29:56.673 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:29:57.327 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:29:57.349 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:29:57.349 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:29:57.349 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:29:58.030 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:29:58.051 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:29:58.051 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:29:58.051 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:29:58.725 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:29:58.742 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:29:58.743 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:29:58.743 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:29:59.504 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:29:59.527 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:29:59.527 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:29:59.527 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:30:00.232 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:30:00.253 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:30:00.253 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:30:00.253 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:30:00.893 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:30:00.912 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:30:00.912 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:30:00.912 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:30:01.706 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:30:01.725 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:30:01.726 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:30:01.726 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:30:02.376 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:30:02.396 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:30:02.397 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:30:02.397 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:30:03.087 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:30:03.103 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:30:03.104 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:30:03.104 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:30:03.832 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:30:03.854 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:30:03.854 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:30:03.854 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:30:04.871 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:30:04.896 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:30:04.896 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:30:04.896 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:30:05.632 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:30:05.651 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:30:05.651 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:30:05.651 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:30:06.419 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:30:06.445 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:30:06.445 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:30:06.445 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:30:07.105 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:30:07.122 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:30:07.122 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:30:07.123 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:30:07.808 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:30:07.826 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:30:07.826 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:30:07.826 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:30:08.486 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:30:08.502 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:30:08.502 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:30:08.502 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:30:09.316 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:30:09.341 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:30:09.341 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:30:09.341 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:30:10.118 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:30:10.144 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:30:10.145 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:30:10.145 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:30:11.173 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:30:11.195 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:30:11.196 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:30:11.196 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:30:11.867 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:30:11.883 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:30:11.884 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:30:11.884 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:30:12.755 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:30:12.775 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:30:12.775 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:30:12.775 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:30:13.441 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:30:13.461 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:30:13.461 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:30:13.461 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:30:14.077 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:30:14.096 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:30:14.096 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:30:14.096 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:30:14.872 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:30:14.894 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:30:14.894 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:30:14.894 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:30:15.533 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:30:15.550 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:30:15.550 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:30:15.550 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:30:16.251 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:30:16.273 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:30:16.273 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:30:16.273 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:30:16.939 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:30:16.959 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:30:16.959 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:30:16.959 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:30:17.651 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:30:17.672 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:30:17.672 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:30:17.672 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:30:18.346 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:30:18.364 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:30:18.364 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:30:18.365 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:30:19.233 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:30:19.256 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:30:19.256 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:30:19.256 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:30:20.169 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:30:20.189 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:30:20.189 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:30:20.189 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:30:21.064 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:30:21.088 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:30:21.088 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:30:21.088 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:30:21.960 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:30:21.983 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:30:21.984 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:30:21.984 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:30:22.730 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:30:22.749 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:30:22.750 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:30:22.750 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:30:23.441 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:30:23.461 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:30:23.461 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:30:23.461 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:30:24.186 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:30:24.208 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:30:24.208 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:30:24.208 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:30:24.947 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:30:24.971 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:30:24.971 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:30:24.971 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:30:25.768 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:30:25.790 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:30:25.790 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:30:25.790 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:30:26.645 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:30:26.669 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:30:26.669 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:30:26.669 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:30:27.390 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:30:27.410 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:30:27.410 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:30:27.411 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:30:28.143 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:30:28.162 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:30:28.162 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:30:28.163 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:30:29.047 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:30:29.071 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:30:29.071 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:30:29.071 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:30:29.859 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:30:29.881 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:30:29.881 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:30:29.881 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:30:30.619 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:30:30.639 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:30:30.639 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:30:30.639 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:30:31.448 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:30:31.471 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:30:31.471 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:30:31.471 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:30:32.184 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:30:32.204 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:30:32.204 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:30:32.204 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:30:32.854 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:30:32.872 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:30:32.872 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:30:32.873 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:30:33.590 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:30:33.611 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:30:33.611 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:30:33.611 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:30:34.351 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:30:34.370 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:30:34.370 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:30:34.371 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:30:35.155 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:30:35.178 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:30:35.178 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:30:35.178 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:30:35.993 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:30:36.012 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:30:36.012 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:30:36.012 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:30:36.763 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:30:36.782 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:30:36.782 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:30:36.782 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:30:37.508 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:30:37.528 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:30:37.528 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:30:37.528 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:30:38.364 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:30:38.386 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:30:38.386 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:30:38.387 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:30:39.075 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:30:39.097 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:30:39.097 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:30:39.097 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:30:39.938 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:30:39.958 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:30:39.958 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:30:39.958 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:30:40.782 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:30:40.807 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:30:40.807 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:30:40.807 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:30:41.444 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:30:41.462 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:30:41.463 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:30:41.463 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:30:42.315 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:30:42.333 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:30:42.334 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:30:42.334 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:30:43.143 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:30:43.167 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:30:43.168 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:30:43.168 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:30:43.863 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:30:43.884 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:30:43.885 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:30:43.885 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:30:44.625 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:30:44.645 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:30:44.645 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:30:44.645 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:30:45.395 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:30:45.417 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:30:45.417 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:30:45.417 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:30:46.081 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:30:46.098 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:30:46.098 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:30:46.098 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:30:46.897 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:30:46.918 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:30:46.919 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:30:46.919 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:30:47.721 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:30:47.743 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:30:47.743 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:30:47.743 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:30:48.431 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:30:48.451 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:30:48.451 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:30:48.451 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:30:49.210 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:30:49.228 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:30:49.228 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:30:49.228 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:30:50.005 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:30:50.026 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:30:50.026 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:30:50.026 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:30:50.733 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:30:50.754 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:30:50.754 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:30:50.754 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:30:51.620 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:30:51.644 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:30:51.644 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:30:51.644 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:30:52.500 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:30:52.519 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:30:52.520 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:30:52.520 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:30:53.302 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:30:53.327 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:30:53.327 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:30:53.327 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:30:54.097 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:30:54.117 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:30:54.117 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:30:54.117 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:30:54.917 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:30:54.939 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:30:54.939 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:30:54.939 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:30:55.696 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:30:55.715 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:30:55.716 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:30:55.716 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:30:56.524 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:30:56.543 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:30:56.543 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:30:56.543 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:30:57.319 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:30:57.341 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:30:57.341 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:30:57.341 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:30:58.072 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:30:58.090 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:30:58.090 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:30:58.090 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:30:58.934 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:30:58.956 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:30:58.956 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:30:58.956 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:30:59.666 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:30:59.687 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:30:59.687 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:30:59.687 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:31:00.440 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:31:00.461 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:31:00.461 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:31:00.461 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:31:01.235 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:31:01.258 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:31:01.258 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:31:01.258 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:31:01.963 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:31:01.982 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:31:01.982 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:31:01.982 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:31:02.766 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:31:02.786 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:31:02.786 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:31:02.787 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:31:03.410 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:31:03.431 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:31:03.431 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:31:03.431 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:31:04.197 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:31:04.217 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:31:04.217 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:31:04.217 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:31:05.051 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:31:05.075 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:31:05.075 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:31:05.075 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:31:05.838 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:31:05.855 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:31:05.856 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:31:05.856 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:31:06.727 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:31:06.748 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:31:06.748 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:31:06.748 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:31:07.486 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:31:07.508 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:31:07.508 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:31:07.509 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:31:08.282 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:31:08.304 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:31:08.304 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:31:08.304 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:31:09.117 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:31:09.139 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:31:09.140 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:31:09.140 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:31:09.837 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:31:09.855 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:31:09.855 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:31:09.855 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:31:10.657 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:31:10.678 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:31:10.679 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:31:10.679 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:31:11.326 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:31:11.347 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:31:11.348 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:31:11.348 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:31:12.170 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:31:12.196 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:31:12.197 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:31:12.197 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:31:13.032 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:31:13.052 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:31:13.052 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:31:13.052 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:31:13.777 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:31:13.795 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:31:13.795 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:31:13.796 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:31:14.714 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:31:14.740 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:31:14.741 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:31:14.741 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:31:15.492 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:31:15.513 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:31:15.513 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:31:15.513 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:31:16.279 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:31:16.301 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:31:16.301 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:31:16.301 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:31:16.914 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:31:16.930 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:31:16.930 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:31:16.930 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:31:17.869 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:31:17.887 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:31:17.888 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:31:17.888 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:31:18.621 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:31:18.643 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:31:18.643 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:31:18.643 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:31:19.449 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:31:19.469 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:31:19.469 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:31:19.470 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:31:20.177 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:31:20.195 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:31:20.195 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:31:20.195 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:31:20.897 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:31:20.917 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:31:20.917 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:31:20.917 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:31:21.634 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:31:21.655 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:31:21.655 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:31:21.655 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:31:22.587 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:31:22.610 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:31:22.610 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:31:22.610 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:31:23.281 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:31:23.300 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:31:23.300 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:31:23.300 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:31:24.151 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:31:24.174 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:31:24.174 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:31:24.174 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:31:24.878 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:31:24.895 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:31:24.896 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:31:24.896 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:31:25.564 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:31:25.584 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:31:25.584 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:31:25.584 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:31:26.284 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:31:26.304 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:31:26.304 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:31:26.304 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:31:27.129 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:31:27.152 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:31:27.152 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:31:27.152 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:31:27.916 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:31:27.938 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:31:27.938 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:31:27.938 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:31:28.770 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:31:28.790 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:31:28.790 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:31:28.790 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:31:29.430 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:31:29.451 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:31:29.451 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:31:29.451 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:31:30.150 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:31:30.170 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:31:30.171 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:31:30.171 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:31:30.895 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:31:30.917 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:31:30.917 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:31:30.917 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:31:31.740 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:31:31.762 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:31:31.762 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:31:31.762 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:31:32.434 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:31:32.450 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:31:32.451 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:31:32.451 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:31:33.229 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:31:33.248 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:31:33.248 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:31:33.248 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:31:33.999 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:31:34.018 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:31:34.018 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:31:34.018 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:31:34.777 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:31:34.799 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:31:34.799 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:31:34.799 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:31:35.480 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:31:35.498 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:31:35.498 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:31:35.498 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:31:36.270 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:31:36.289 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:31:36.290 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:31:36.290 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:31:36.995 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:31:37.014 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:31:37.014 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:31:37.014 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:31:37.966 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:31:37.990 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:31:37.990 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:31:37.990 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:31:38.835 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:31:38.862 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:31:38.862 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:31:38.862 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:31:39.545 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:31:39.564 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:31:39.565 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:31:39.565 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:31:40.459 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:31:40.481 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:31:40.481 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:31:40.481 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:31:41.161 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:31:41.179 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:31:41.179 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:31:41.179 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:31:41.898 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:31:41.913 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:31:41.913 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:31:41.913 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:31:42.686 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:31:42.704 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:31:42.704 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:31:42.704 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:31:43.446 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:31:43.466 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:31:43.467 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:31:43.467 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:31:44.182 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:31:44.205 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:31:44.206 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:31:44.206 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:31:44.906 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:31:44.926 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:31:44.927 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:31:44.927 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:31:45.781 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:31:45.801 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:31:45.801 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:31:45.801 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:31:46.601 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:31:46.622 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:31:46.622 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:31:46.622 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:31:47.655 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:31:47.684 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:31:47.685 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:31:47.685 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:31:48.483 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:31:48.506 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:31:48.506 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:31:48.506 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:31:49.480 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:31:49.505 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:31:49.505 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:31:49.505 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:31:50.283 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:31:50.304 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:31:50.304 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:31:50.304 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:31:51.111 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:31:51.135 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:31:51.135 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:31:51.135 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:31:51.882 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:31:51.901 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:31:51.901 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:31:51.902 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:31:52.750 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:31:52.770 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:31:52.770 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:31:52.770 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:31:53.705 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:31:53.725 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:31:53.725 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:31:53.725 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:31:54.509 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:31:54.530 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:31:54.530 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:31:54.530 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:31:55.262 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:31:55.284 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:31:55.285 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:31:55.285 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:31:56.041 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:31:56.063 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:31:56.063 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:31:56.063 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:31:56.819 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:31:56.840 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:31:56.841 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:31:56.841 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:31:57.521 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:31:57.541 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:31:57.541 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:31:57.541 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:31:58.224 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:31:58.249 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:31:58.249 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:31:58.249 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:31:59.229 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:31:59.253 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:31:59.253 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:31:59.253 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:31:59.956 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:31:59.974 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:31:59.974 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:31:59.974 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:32:00.710 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:32:00.731 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:32:00.731 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:32:00.731 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:32:01.437 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:32:01.454 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:32:01.454 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:32:01.454 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:32:02.285 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:32:02.302 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:32:02.302 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:32:02.302 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:32:03.212 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:32:03.235 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:32:03.235 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:32:03.235 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:32:03.897 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:32:03.916 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:32:03.917 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:32:03.917 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:32:04.827 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:32:04.849 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:32:04.849 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:32:04.849 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:32:05.613 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:32:05.635 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:32:05.635 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:32:05.635 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:32:06.450 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:32:06.472 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:32:06.472 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:32:06.472 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:32:07.261 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:32:07.284 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:32:07.284 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:32:07.284 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:32:07.922 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:32:07.945 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:32:07.945 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:32:07.945 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:32:08.767 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:32:08.790 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:32:08.790 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:32:08.791 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:32:09.696 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:32:09.719 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:32:09.719 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:32:09.719 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:32:10.475 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:32:10.499 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:32:10.499 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:32:10.499 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:32:11.172 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:32:11.190 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:32:11.190 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:32:11.190 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:32:11.957 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:32:11.974 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:32:11.974 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:32:11.974 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:32:12.672 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:32:12.688 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:32:12.689 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:32:12.689 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:32:13.529 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:32:13.550 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:32:13.550 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:32:13.551 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:32:14.433 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:32:14.453 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:32:14.453 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:32:14.453 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:32:15.287 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:32:15.311 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:32:15.311 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:32:15.311 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:32:16.149 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:32:16.166 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:32:16.167 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:32:16.167 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:32:16.977 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:32:16.999 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:32:16.999 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:32:16.999 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:32:17.693 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:32:17.713 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:32:17.713 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:32:17.713 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:32:18.442 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:32:18.463 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:32:18.463 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:32:18.463 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:32:19.255 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:32:19.277 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:32:19.277 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:32:19.277 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:32:20.159 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:32:20.188 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:32:20.189 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:32:20.189 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:32:21.154 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:32:21.176 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:32:21.176 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:32:21.176 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:32:21.881 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:32:21.901 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:32:21.902 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:32:21.902 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:32:22.778 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:32:22.798 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:32:22.799 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:32:22.799 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:32:23.430 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:32:23.450 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:32:23.450 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:32:23.450 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:32:24.544 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:32:24.567 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:32:24.567 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:32:24.568 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:32:25.331 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:32:25.352 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:32:25.353 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:32:25.353 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:32:26.119 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:32:26.139 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:32:26.140 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:32:26.140 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:32:26.838 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:32:26.857 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:32:26.858 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:32:26.858 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:32:27.701 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:32:27.724 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:32:27.724 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:32:27.724 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:32:28.412 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:32:28.433 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:32:28.433 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:32:28.433 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:32:29.132 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:32:29.150 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:32:29.151 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:32:29.151 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:32:29.978 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:32:30.000 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:32:30.000 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:32:30.000 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:32:30.705 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:32:30.726 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:32:30.726 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:32:30.726 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:32:31.492 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:32:31.514 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:32:31.514 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:32:31.514 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:32:32.254 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:32:32.274 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:32:32.275 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:32:32.275 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:32:33.049 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:32:33.069 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:32:33.069 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:32:33.069 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:32:33.777 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:32:33.795 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:32:33.795 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:32:33.795 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:32:34.515 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:32:34.537 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:32:34.537 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:32:34.537 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:32:35.226 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:32:35.248 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:32:35.248 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:32:35.248 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:32:35.946 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:32:35.965 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:32:35.965 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:32:35.965 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:32:36.716 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:32:36.736 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:32:36.736 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:32:36.737 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:32:37.403 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:32:37.424 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:32:37.424 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:32:37.424 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:32:38.165 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:32:38.182 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:32:38.182 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:32:38.182 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:32:38.994 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:32:39.015 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:32:39.015 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:32:39.015 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:32:39.655 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:32:39.675 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:32:39.675 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:32:39.675 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:32:40.333 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:32:40.352 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:32:40.353 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:32:40.353 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:32:41.137 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:32:41.154 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:32:41.154 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:32:41.155 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:32:41.882 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:32:41.902 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:32:41.902 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:32:41.903 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:32:42.660 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:32:42.678 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:32:42.679 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:32:42.679 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:32:43.497 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:32:43.518 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:32:43.519 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:32:43.519 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:32:44.226 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:32:44.247 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:32:44.247 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:32:44.247 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:32:44.879 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:32:44.898 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:32:44.898 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:32:44.899 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:32:45.776 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:32:45.795 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:32:45.795 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:32:45.796 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:32:46.578 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:32:46.598 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:32:46.599 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:32:46.599 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:32:47.421 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:32:47.444 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:32:47.444 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:32:47.444 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:32:48.253 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:32:48.272 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:32:48.272 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:32:48.272 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:32:49.282 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:32:49.304 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:32:49.304 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:32:49.304 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:32:49.977 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:32:49.993 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:32:49.994 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:32:49.994 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:32:50.913 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:32:50.933 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:32:50.933 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:32:50.933 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:32:51.708 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:32:51.731 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:32:51.731 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:32:51.731 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:32:52.486 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:32:52.509 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:32:52.509 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:32:52.510 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:32:53.206 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:32:53.223 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:32:53.223 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:32:53.224 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:32:53.959 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:32:53.982 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:32:53.982 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:32:53.982 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:32:54.871 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:32:54.896 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:32:54.897 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:32:54.897 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:32:55.624 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:32:55.645 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:32:55.645 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:32:55.645 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:32:56.452 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:32:56.470 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:32:56.470 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:32:56.470 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:32:57.365 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:32:57.381 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:32:57.381 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:32:57.381 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:32:58.362 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:32:58.386 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:32:58.386 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:32:58.386 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:32:59.308 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:32:59.330 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:32:59.330 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:32:59.330 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:33:00.061 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:33:00.084 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:33:00.084 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:33:00.084 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:33:00.806 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:33:00.828 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:33:00.828 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:33:00.828 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:33:01.719 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:33:01.741 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:33:01.741 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:33:01.741 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:33:02.363 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:33:02.380 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:33:02.381 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:33:02.381 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:33:03.142 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:33:03.160 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:33:03.160 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:33:03.160 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:33:03.811 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:33:03.829 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:33:03.829 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:33:03.829 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:33:04.497 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:33:04.520 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:33:04.520 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:33:04.520 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:33:05.410 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:33:05.430 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:33:05.430 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:33:05.430 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:33:06.121 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:33:06.141 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:33:06.141 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:33:06.141 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:33:07.008 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:33:07.030 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:33:07.031 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:33:07.031 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:33:07.685 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:33:07.704 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:33:07.704 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:33:07.704 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:33:08.422 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:33:08.441 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:33:08.441 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:33:08.441 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:33:09.150 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:33:09.170 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:33:09.170 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:33:09.170 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:33:09.869 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:33:09.887 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:33:09.887 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:33:09.887 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:33:10.681 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:33:10.703 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:33:10.704 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:33:10.704 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:33:11.569 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:33:11.588 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:33:11.588 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:33:11.588 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:33:12.347 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:33:12.368 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:33:12.368 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:33:12.368 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:33:13.192 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:33:13.215 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:33:13.215 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:33:13.215 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:33:13.970 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:33:13.988 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:33:13.988 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:33:13.988 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:33:14.682 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:33:14.702 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:33:14.703 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:33:14.703 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:33:15.435 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:33:15.453 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:33:15.453 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:33:15.453 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:33:16.254 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:33:16.273 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:33:16.274 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:33:16.274 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:33:17.058 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:33:17.077 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:33:17.077 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:33:17.077 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:33:17.761 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:33:17.780 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:33:17.780 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:33:17.780 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:33:18.461 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:33:18.481 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:33:18.481 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:33:18.481 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:33:19.201 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:33:19.221 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:33:19.221 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:33:19.221 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:33:20.080 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:33:20.102 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:33:20.103 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:33:20.103 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:33:20.799 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:33:20.825 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:33:20.825 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:33:20.826 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:33:21.519 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:33:21.545 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:33:21.545 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:33:21.545 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:33:22.257 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:33:22.275 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:33:22.275 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:33:22.275 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:33:23.177 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:33:23.200 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:33:23.200 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:33:23.200 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:33:23.854 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:33:23.871 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:33:23.871 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:33:23.871 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:33:24.674 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:33:24.696 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:33:24.696 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:33:24.696 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:33:25.537 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:33:25.559 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:33:25.559 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:33:25.559 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:33:26.491 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:33:26.517 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:33:26.517 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:33:26.517 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:33:27.237 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:33:27.257 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:33:27.257 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:33:27.257 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:33:27.931 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:33:27.952 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:33:27.952 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:33:27.953 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:33:28.777 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:33:28.799 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:33:28.799 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:33:28.800 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:33:29.438 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:33:29.458 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:33:29.458 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:33:29.459 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:33:30.124 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:33:30.144 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:33:30.144 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:33:30.144 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:33:30.953 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:33:30.976 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:33:30.976 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:33:30.976 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:33:31.699 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:33:31.719 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:33:31.719 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:33:31.719 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:33:32.502 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:33:32.521 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:33:32.522 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:33:32.522 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:33:33.272 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:33:33.293 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:33:33.294 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:33:33.294 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:33:34.042 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:33:34.063 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:33:34.063 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:33:34.063 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:33:34.879 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:33:34.906 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:33:34.906 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:33:34.906 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:33:35.574 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:33:35.593 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:33:35.593 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:33:35.593 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:33:36.469 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:33:36.489 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:33:36.489 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:33:36.489 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:33:37.163 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:33:37.184 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:33:37.184 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:33:37.184 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:33:38.042 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:33:38.062 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:33:38.062 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:33:38.062 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:33:38.761 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:33:38.783 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:33:38.783 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:33:38.783 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:33:39.463 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:33:39.481 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:33:39.482 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:33:39.482 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:33:40.242 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:33:40.259 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:33:40.261 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:33:40.261 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:33:41.171 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:33:41.191 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:33:41.191 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:33:41.192 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:33:42.025 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:33:42.051 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:33:42.051 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:33:42.052 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:33:42.945 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:33:42.967 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:33:42.968 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:33:42.968 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:33:43.766 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:33:43.789 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:33:43.789 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:33:43.789 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:33:44.586 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:33:44.608 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:33:44.608 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:33:44.608 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:33:45.418 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:33:45.437 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:33:45.437 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:33:45.437 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:33:46.277 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:33:46.296 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:33:46.296 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:33:46.296 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:33:47.248 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:33:47.272 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:33:47.272 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:33:47.272 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:33:47.993 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:33:48.015 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:33:48.015 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:33:48.015 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:33:48.939 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:33:48.961 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:33:48.961 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:33:48.961 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:33:49.650 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:33:49.669 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:33:49.669 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:33:49.669 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:33:50.478 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:33:50.499 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:33:50.499 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:33:50.499 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:33:51.299 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:33:51.320 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:33:51.320 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:33:51.320 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:33:52.203 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:33:52.225 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:33:52.225 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:33:52.225 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:33:53.025 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:33:53.046 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:33:53.047 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:33:53.047 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:33:53.829 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:33:53.845 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:33:53.846 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:33:53.846 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:33:54.574 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:33:54.593 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:33:54.593 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:33:54.594 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:33:55.385 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:33:55.406 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:33:55.406 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:33:55.406 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:33:56.197 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:33:56.216 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:33:56.216 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:33:56.216 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:33:57.025 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:33:57.045 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:33:57.046 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:33:57.046 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:33:57.819 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:33:57.838 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:33:57.838 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:33:57.838 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:33:58.866 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:33:58.886 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:33:58.886 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:33:58.886 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:33:59.702 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:33:59.722 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:33:59.722 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:33:59.722 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:34:00.564 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:34:00.585 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:34:00.585 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:34:00.585 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:34:01.452 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:34:01.473 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:34:01.473 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:34:01.473 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:34:02.322 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:34:02.344 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:34:02.345 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:34:02.345 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:34:03.041 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:34:03.063 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:34:03.063 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:34:03.063 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:34:03.811 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:34:03.833 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:34:03.833 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:34:03.833 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:34:04.589 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:34:04.607 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:34:04.607 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:34:04.607 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:34:05.259 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:34:05.281 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:34:05.281 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:34:05.281 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:34:06.137 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:34:06.151 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:34:06.151 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:34:06.151 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:34:06.983 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:34:07.006 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:34:07.006 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:34:07.006 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:34:07.929 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:34:07.952 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:34:07.952 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:34:07.952 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:34:08.757 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:34:08.782 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:34:08.783 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:34:08.783 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:34:09.552 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:34:09.577 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:34:09.577 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:34:09.578 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:34:10.229 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:34:10.249 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:34:10.249 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:34:10.249 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:34:10.974 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:34:10.992 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:34:10.992 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:34:10.992 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:34:11.721 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:34:11.744 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:34:11.744 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:34:11.745 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:34:12.555 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:34:12.573 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:34:12.573 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:34:12.573 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:34:13.501 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:34:13.525 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:34:13.525 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:34:13.525 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:34:14.204 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:34:14.224 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:34:14.224 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:34:14.224 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:34:14.865 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:34:14.886 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:34:14.886 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:34:14.886 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:34:15.576 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:34:15.593 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:34:15.593 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:34:15.593 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:34:16.404 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:34:16.425 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:34:16.425 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:34:16.425 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:34:17.409 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:34:17.430 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:34:17.431 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:34:17.431 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:34:18.233 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:34:18.256 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:34:18.256 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:34:18.256 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:34:19.108 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:34:19.128 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:34:19.128 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:34:19.128 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:34:19.768 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:34:19.785 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:34:19.786 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:34:19.786 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:34:20.630 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:34:20.655 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:34:20.655 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:34:20.655 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:34:21.426 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:34:21.448 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:34:21.448 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:34:21.448 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:34:22.170 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:34:22.189 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:34:22.190 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:34:22.190 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:34:22.948 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:34:22.966 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:34:22.966 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:34:22.966 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:34:23.667 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:34:23.690 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:34:23.690 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:34:23.691 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:34:24.494 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:34:24.514 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:34:24.514 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:34:24.514 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:34:25.332 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:34:25.354 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:34:25.354 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:34:25.354 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:34:26.043 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:34:26.062 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:34:26.062 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:34:26.062 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:34:26.879 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:34:26.900 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:34:26.900 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:34:26.900 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:34:27.684 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:34:27.704 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:34:27.704 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:34:27.704 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:34:28.712 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:34:28.735 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:34:28.736 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:34:28.736 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:34:29.398 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:34:29.418 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:34:29.418 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:34:29.418 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:34:30.176 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:34:30.197 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:34:30.197 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:34:30.198 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:34:30.971 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:34:30.992 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:34:30.992 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:34:30.992 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:34:31.663 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:34:31.682 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:34:31.682 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:34:31.682 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:34:32.652 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:34:32.678 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:34:32.678 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:34:32.678 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:34:33.540 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:34:33.562 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:34:33.563 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:34:33.563 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:34:34.402 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:34:34.426 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:34:34.426 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:34:34.426 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:34:35.130 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:34:35.148 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:34:35.148 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:34:35.148 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:34:35.932 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:34:35.953 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:34:35.953 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:34:35.953 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:34:36.694 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:34:36.714 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:34:36.715 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:34:36.715 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:34:37.405 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:34:37.425 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:34:37.425 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:34:37.425 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:34:38.217 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:34:38.238 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:34:38.238 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:34:38.238 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:34:39.045 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:34:39.066 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:34:39.066 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:34:39.066 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:34:39.714 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:34:39.733 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:34:39.734 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:34:39.734 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:34:40.417 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:34:40.434 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:34:40.434 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:34:40.434 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:34:41.313 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:34:41.336 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:34:41.336 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:34:41.336 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:34:42.015 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:34:42.038 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:34:42.038 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:34:42.038 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:34:42.903 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:34:42.922 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:34:42.922 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:34:42.922 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:34:43.731 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:34:43.753 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:34:43.753 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:34:43.753 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:34:44.484 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:34:44.504 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:34:44.504 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:34:44.504 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:34:45.170 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:34:45.187 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:34:45.187 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:34:45.187 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:34:45.898 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:34:45.917 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:34:45.917 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:34:45.917 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:34:46.617 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:34:46.638 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:34:46.638 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:34:46.638 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:34:47.329 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:34:47.347 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:34:47.347 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:34:47.347 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:34:48.267 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:34:48.291 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:34:48.291 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:34:48.291 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:34:49.053 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:34:49.076 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:34:49.076 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:34:49.076 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:34:49.865 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:34:49.882 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:34:49.883 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:34:49.883 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:34:50.785 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:34:50.808 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:34:50.808 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:34:50.808 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:34:51.488 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:34:51.511 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:34:51.512 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:34:51.512 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:34:52.325 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:34:52.346 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:34:52.346 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:34:52.346 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:34:53.209 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:34:53.233 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:34:53.234 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:34:53.234 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:34:53.899 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:34:53.918 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:34:53.918 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:34:53.918 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:34:54.778 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:34:54.800 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:34:54.800 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:34:54.800 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:34:55.472 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:34:55.491 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:34:55.491 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:34:55.491 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:34:56.301 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:34:56.318 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:34:56.319 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:34:56.319 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:34:57.138 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:34:57.157 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:34:57.157 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:34:57.157 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:34:57.857 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:34:57.879 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:34:57.879 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:34:57.879 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:34:58.694 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:34:58.714 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:34:58.714 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:34:58.714 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:34:59.472 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:34:59.491 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:34:59.491 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:34:59.492 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:35:00.292 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:35:00.309 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:00.310 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:35:00.310 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:35:01.146 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:35:01.164 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:01.164 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:35:01.165 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:35:01.874 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:35:01.894 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:01.894 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:35:01.894 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:35:02.779 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:35:02.800 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:02.800 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:35:02.800 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:35:03.497 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:35:03.516 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:03.516 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:35:03.516 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:35:04.259 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:35:04.281 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:04.281 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:35:04.281 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:35:05.046 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:35:05.067 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:05.067 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:35:05.067 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:35:05.816 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:35:05.834 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:05.834 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:35:05.834 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:35:06.745 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:35:06.770 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:06.770 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:35:06.770 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:35:07.465 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:35:07.488 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:07.488 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:35:07.488 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:35:08.276 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:35:08.842 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:08.842 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:35:08.842 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:35:09.004 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:35:09.027 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:09.027 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < num )) 2024-09-16T03:35:09.027 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:09.027 INFO:tasks.workunit.client.0.smithi096.stderr:++ ceph report 2024-09-16T03:35:09.611 INFO:tasks.workunit.client.0.smithi096.stderr:report 4067364590 2024-09-16T03:35:09.627 INFO:tasks.workunit.client.0.smithi096.stderr:+ report='{ 2024-09-16T03:35:09.628 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_fingerprint": "eaf2fd8a-7c8d-4abd-8137-a2b360091b66", 2024-09-16T03:35:09.628 INFO:tasks.workunit.client.0.smithi096.stderr: "version": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:35:09.628 INFO:tasks.workunit.client.0.smithi096.stderr: "commit": "fc3e0bff7468fd55478adbae7f75508b749124b6", 2024-09-16T03:35:09.628 INFO:tasks.workunit.client.0.smithi096.stderr: "timestamp": "2024-09-16T03:35:09.612664+0000", 2024-09-16T03:35:09.628 INFO:tasks.workunit.client.0.smithi096.stderr: "tag": "", 2024-09-16T03:35:09.628 INFO:tasks.workunit.client.0.smithi096.stderr: "health": { 2024-09-16T03:35:09.628 INFO:tasks.workunit.client.0.smithi096.stderr: "status": "HEALTH_WARN", 2024-09-16T03:35:09.628 INFO:tasks.workunit.client.0.smithi096.stderr: "checks": { 2024-09-16T03:35:09.628 INFO:tasks.workunit.client.0.smithi096.stderr: "POOL_APP_NOT_ENABLED": { 2024-09-16T03:35:09.628 INFO:tasks.workunit.client.0.smithi096.stderr: "severity": "HEALTH_WARN", 2024-09-16T03:35:09.628 INFO:tasks.workunit.client.0.smithi096.stderr: "summary": { 2024-09-16T03:35:09.628 INFO:tasks.workunit.client.0.smithi096.stderr: "message": "1 pool(s) do not have an application enabled", 2024-09-16T03:35:09.629 INFO:tasks.workunit.client.0.smithi096.stderr: "count": 1 2024-09-16T03:35:09.629 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.629 INFO:tasks.workunit.client.0.smithi096.stderr: "detail": [ 2024-09-16T03:35:09.629 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:35:09.629 INFO:tasks.workunit.client.0.smithi096.stderr: "message": "application not enabled on pool '\''foo'\''" 2024-09-16T03:35:09.629 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.629 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:35:09.629 INFO:tasks.workunit.client.0.smithi096.stderr: "message": "use '\''ceph osd pool application enable '\'', where is '\''cephfs'\'', '\''rbd'\'', '\''rgw'\'', or freeform for custom applications." 2024-09-16T03:35:09.629 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:35:09.629 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:35:09.629 INFO:tasks.workunit.client.0.smithi096.stderr: "muted": false 2024-09-16T03:35:09.629 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:35:09.629 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.630 INFO:tasks.workunit.client.0.smithi096.stderr: "mutes": [] 2024-09-16T03:35:09.630 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.630 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap_first_committed": 1, 2024-09-16T03:35:09.630 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap_last_committed": 1, 2024-09-16T03:35:09.630 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap": { 2024-09-16T03:35:09.630 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 1, 2024-09-16T03:35:09.630 INFO:tasks.workunit.client.0.smithi096.stderr: "fsid": "08dc5a0f-381e-4717-8c90-55791ebeecfd", 2024-09-16T03:35:09.630 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:26:19.960858Z", 2024-09-16T03:35:09.630 INFO:tasks.workunit.client.0.smithi096.stderr: "created": "2024-09-16T03:26:19.960858Z", 2024-09-16T03:35:09.630 INFO:tasks.workunit.client.0.smithi096.stderr: "min_mon_release": 19, 2024-09-16T03:35:09.630 INFO:tasks.workunit.client.0.smithi096.stderr: "min_mon_release_name": "squid", 2024-09-16T03:35:09.630 INFO:tasks.workunit.client.0.smithi096.stderr: "election_strategy": 1, 2024-09-16T03:35:09.630 INFO:tasks.workunit.client.0.smithi096.stderr: "disallowed_leaders: ": "", 2024-09-16T03:35:09.631 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode": false, 2024-09-16T03:35:09.631 INFO:tasks.workunit.client.0.smithi096.stderr: "tiebreaker_mon": "", 2024-09-16T03:35:09.631 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_ranks: ": "", 2024-09-16T03:35:09.631 INFO:tasks.workunit.client.0.smithi096.stderr: "features": { 2024-09-16T03:35:09.631 INFO:tasks.workunit.client.0.smithi096.stderr: "persistent": [ 2024-09-16T03:35:09.631 INFO:tasks.workunit.client.0.smithi096.stderr: "kraken", 2024-09-16T03:35:09.631 INFO:tasks.workunit.client.0.smithi096.stderr: "luminous", 2024-09-16T03:35:09.631 INFO:tasks.workunit.client.0.smithi096.stderr: "mimic", 2024-09-16T03:35:09.631 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap-prune", 2024-09-16T03:35:09.631 INFO:tasks.workunit.client.0.smithi096.stderr: "nautilus", 2024-09-16T03:35:09.631 INFO:tasks.workunit.client.0.smithi096.stderr: "octopus", 2024-09-16T03:35:09.631 INFO:tasks.workunit.client.0.smithi096.stderr: "pacific", 2024-09-16T03:35:09.631 INFO:tasks.workunit.client.0.smithi096.stderr: "elector-pinging", 2024-09-16T03:35:09.632 INFO:tasks.workunit.client.0.smithi096.stderr: "quincy", 2024-09-16T03:35:09.632 INFO:tasks.workunit.client.0.smithi096.stderr: "reef", 2024-09-16T03:35:09.632 INFO:tasks.workunit.client.0.smithi096.stderr: "squid" 2024-09-16T03:35:09.632 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:35:09.632 INFO:tasks.workunit.client.0.smithi096.stderr: "optional": [] 2024-09-16T03:35:09.632 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.632 INFO:tasks.workunit.client.0.smithi096.stderr: "mons": [ 2024-09-16T03:35:09.632 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:35:09.632 INFO:tasks.workunit.client.0.smithi096.stderr: "rank": 0, 2024-09-16T03:35:09.633 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "a", 2024-09-16T03:35:09.633 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:35:09.633 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:35:09.633 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:35:09.633 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:35:09.633 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:7115", 2024-09-16T03:35:09.633 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 0 2024-09-16T03:35:09.633 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:35:09.634 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:35:09.634 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.634 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:7115/0", 2024-09-16T03:35:09.634 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:7115/0", 2024-09-16T03:35:09.634 INFO:tasks.workunit.client.0.smithi096.stderr: "priority": 0, 2024-09-16T03:35:09.634 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 0, 2024-09-16T03:35:09.634 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_location": "{}" 2024-09-16T03:35:09.634 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:35:09.634 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:35:09.635 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.635 INFO:tasks.workunit.client.0.smithi096.stderr: "quorum": [ 2024-09-16T03:35:09.635 INFO:tasks.workunit.client.0.smithi096.stderr: 0 2024-09-16T03:35:09.635 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:35:09.635 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap": { 2024-09-16T03:35:09.635 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 1030, 2024-09-16T03:35:09.635 INFO:tasks.workunit.client.0.smithi096.stderr: "fsid": "08dc5a0f-381e-4717-8c90-55791ebeecfd", 2024-09-16T03:35:09.635 INFO:tasks.workunit.client.0.smithi096.stderr: "created": "2024-09-16T03:26:20.886850+0000", 2024-09-16T03:35:09.635 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:35:08.956259+0000", 2024-09-16T03:35:09.635 INFO:tasks.workunit.client.0.smithi096.stderr: "last_up_change": "2024-09-16T03:28:12.669817+0000", 2024-09-16T03:35:09.635 INFO:tasks.workunit.client.0.smithi096.stderr: "last_in_change": "2024-09-16T03:27:36.130692+0000", 2024-09-16T03:35:09.636 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-16T03:35:09.636 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_num": 5799936, 2024-09-16T03:35:09.636 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_set": [ 2024-09-16T03:35:09.636 INFO:tasks.workunit.client.0.smithi096.stderr: "pglog_hardlimit", 2024-09-16T03:35:09.636 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snapdirs", 2024-09-16T03:35:09.636 INFO:tasks.workunit.client.0.smithi096.stderr: "recovery_deletes", 2024-09-16T03:35:09.636 INFO:tasks.workunit.client.0.smithi096.stderr: "sortbitwise" 2024-09-16T03:35:09.636 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:35:09.636 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_version": 7, 2024-09-16T03:35:09.637 INFO:tasks.workunit.client.0.smithi096.stderr: "full_ratio": 0.97000002861022949, 2024-09-16T03:35:09.637 INFO:tasks.workunit.client.0.smithi096.stderr: "backfillfull_ratio": 0.97000002861022949, 2024-09-16T03:35:09.637 INFO:tasks.workunit.client.0.smithi096.stderr: "nearfull_ratio": 0.85000002384185791, 2024-09-16T03:35:09.637 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_snapshot": "", 2024-09-16T03:35:09.637 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_max": 1, 2024-09-16T03:35:09.637 INFO:tasks.workunit.client.0.smithi096.stderr: "max_osd": 3, 2024-09-16T03:35:09.637 INFO:tasks.workunit.client.0.smithi096.stderr: "require_min_compat_client": "luminous", 2024-09-16T03:35:09.637 INFO:tasks.workunit.client.0.smithi096.stderr: "min_compat_client": "jewel", 2024-09-16T03:35:09.637 INFO:tasks.workunit.client.0.smithi096.stderr: "require_osd_release": "squid", 2024-09-16T03:35:09.637 INFO:tasks.workunit.client.0.smithi096.stderr: "allow_crimson": false, 2024-09-16T03:35:09.637 INFO:tasks.workunit.client.0.smithi096.stderr: "pools": [ 2024-09-16T03:35:09.637 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:35:09.638 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 1, 2024-09-16T03:35:09.638 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_name": "foo", 2024-09-16T03:35:09.638 INFO:tasks.workunit.client.0.smithi096.stderr: "create_time": "2024-09-16T03:28:23.539340+0000", 2024-09-16T03:35:09.638 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": 1, 2024-09-16T03:35:09.638 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_names": "hashpspool", 2024-09-16T03:35:09.638 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:35:09.638 INFO:tasks.workunit.client.0.smithi096.stderr: "size": 3, 2024-09-16T03:35:09.638 INFO:tasks.workunit.client.0.smithi096.stderr: "min_size": 2, 2024-09-16T03:35:09.638 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_rule": 0, 2024-09-16T03:35:09.639 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_count": 0, 2024-09-16T03:35:09.639 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_target": 0, 2024-09-16T03:35:09.639 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_barrier": 0, 2024-09-16T03:35:09.639 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-16T03:35:09.639 INFO:tasks.workunit.client.0.smithi096.stderr: "is_stretch_pool": false, 2024-09-16T03:35:09.639 INFO:tasks.workunit.client.0.smithi096.stderr: "object_hash": 2, 2024-09-16T03:35:09.639 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_autoscale_mode": "off", 2024-09-16T03:35:09.639 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num": 32, 2024-09-16T03:35:09.639 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num": 32, 2024-09-16T03:35:09.639 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num_target": 32, 2024-09-16T03:35:09.639 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_target": 32, 2024-09-16T03:35:09.640 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_pending": 32, 2024-09-16T03:35:09.640 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pg_merge_meta": { 2024-09-16T03:35:09.640 INFO:tasks.workunit.client.0.smithi096.stderr: "source_pgid": "0.0", 2024-09-16T03:35:09.640 INFO:tasks.workunit.client.0.smithi096.stderr: "ready_epoch": 0, 2024-09-16T03:35:09.640 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_started": 0, 2024-09-16T03:35:09.640 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": 0, 2024-09-16T03:35:09.640 INFO:tasks.workunit.client.0.smithi096.stderr: "source_version": "0'\''0", 2024-09-16T03:35:09.640 INFO:tasks.workunit.client.0.smithi096.stderr: "target_version": "0'\''0" 2024-09-16T03:35:09.641 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.641 INFO:tasks.workunit.client.0.smithi096.stderr: "last_change": "25", 2024-09-16T03:35:09.641 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend": "0", 2024-09-16T03:35:09.641 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_prenautilus": "0", 2024-09-16T03:35:09.641 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_preluminous": "0", 2024-09-16T03:35:09.641 INFO:tasks.workunit.client.0.smithi096.stderr: "auid": 0, 2024-09-16T03:35:09.641 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_mode": "selfmanaged", 2024-09-16T03:35:09.641 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_seq": 0, 2024-09-16T03:35:09.641 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_epoch": 0, 2024-09-16T03:35:09.641 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_snaps": [], 2024-09-16T03:35:09.641 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps": "[]", 2024-09-16T03:35:09.641 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_bytes": 0, 2024-09-16T03:35:09.641 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_objects": 0, 2024-09-16T03:35:09.642 INFO:tasks.workunit.client.0.smithi096.stderr: "tiers": [], 2024-09-16T03:35:09.642 INFO:tasks.workunit.client.0.smithi096.stderr: "tier_of": -1, 2024-09-16T03:35:09.642 INFO:tasks.workunit.client.0.smithi096.stderr: "read_tier": -1, 2024-09-16T03:35:09.642 INFO:tasks.workunit.client.0.smithi096.stderr: "write_tier": -1, 2024-09-16T03:35:09.642 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_mode": "none", 2024-09-16T03:35:09.642 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_bytes": 0, 2024-09-16T03:35:09.642 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_objects": 0, 2024-09-16T03:35:09.642 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_ratio_micro": 400000, 2024-09-16T03:35:09.642 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-16T03:35:09.642 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_full_ratio_micro": 800000, 2024-09-16T03:35:09.643 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_flush_age": 0, 2024-09-16T03:35:09.643 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_evict_age": 0, 2024-09-16T03:35:09.643 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profile": "", 2024-09-16T03:35:09.643 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_params": { 2024-09-16T03:35:09.643 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "none" 2024-09-16T03:35:09.643 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.643 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_period": 0, 2024-09-16T03:35:09.643 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_count": 0, 2024-09-16T03:35:09.643 INFO:tasks.workunit.client.0.smithi096.stderr: "use_gmt_hitset": true, 2024-09-16T03:35:09.643 INFO:tasks.workunit.client.0.smithi096.stderr: "min_read_recency_for_promote": 0, 2024-09-16T03:35:09.643 INFO:tasks.workunit.client.0.smithi096.stderr: "min_write_recency_for_promote": 0, 2024-09-16T03:35:09.643 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_grade_decay_rate": 0, 2024-09-16T03:35:09.643 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_search_last_n": 0, 2024-09-16T03:35:09.644 INFO:tasks.workunit.client.0.smithi096.stderr: "grade_table": [], 2024-09-16T03:35:09.644 INFO:tasks.workunit.client.0.smithi096.stderr: "stripe_width": 0, 2024-09-16T03:35:09.644 INFO:tasks.workunit.client.0.smithi096.stderr: "expected_num_objects": 0, 2024-09-16T03:35:09.644 INFO:tasks.workunit.client.0.smithi096.stderr: "fast_read": false, 2024-09-16T03:35:09.644 INFO:tasks.workunit.client.0.smithi096.stderr: "options": {}, 2024-09-16T03:35:09.644 INFO:tasks.workunit.client.0.smithi096.stderr: "application_metadata": {}, 2024-09-16T03:35:09.644 INFO:tasks.workunit.client.0.smithi096.stderr: "read_balance": { 2024-09-16T03:35:09.644 INFO:tasks.workunit.client.0.smithi096.stderr: "score_type": "Fair distribution", 2024-09-16T03:35:09.645 INFO:tasks.workunit.client.0.smithi096.stderr: "score_acting": 1.690000057220459, 2024-09-16T03:35:09.645 INFO:tasks.workunit.client.0.smithi096.stderr: "score_stable": 1.690000057220459, 2024-09-16T03:35:09.645 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_score": 1, 2024-09-16T03:35:09.645 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_acting": 1.690000057220459, 2024-09-16T03:35:09.645 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_stable": 1.690000057220459, 2024-09-16T03:35:09.645 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity_weighted": 1, 2024-09-16T03:35:09.647 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity": 1, 2024-09-16T03:35:09.647 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity_weighted": 1 2024-09-16T03:35:09.648 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:35:09.648 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:35:09.648 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:35:09.648 INFO:tasks.workunit.client.0.smithi096.stderr: "osds": [ 2024-09-16T03:35:09.648 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:35:09.648 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:35:09.648 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "cf18d22c-4700-44bd-90f9-a7f9263a145b", 2024-09-16T03:35:09.648 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:35:09.649 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:35:09.649 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:35:09.649 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:35:09.649 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:35:09.649 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:35:09.649 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 5, 2024-09-16T03:35:09.649 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 21, 2024-09-16T03:35:09.649 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:35:09.649 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:35:09.650 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:35:09.650 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:35:09.650 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:35:09.650 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:35:09.650 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6802", 2024-09-16T03:35:09.650 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3449414971 2024-09-16T03:35:09.650 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.650 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:35:09.650 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:35:09.651 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6803", 2024-09-16T03:35:09.651 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3449414971 2024-09-16T03:35:09.651 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:35:09.651 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:35:09.651 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.651 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:35:09.651 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:35:09.651 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:35:09.651 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:35:09.651 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6804", 2024-09-16T03:35:09.651 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3449414971 2024-09-16T03:35:09.651 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.651 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:35:09.652 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:35:09.652 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6805", 2024-09-16T03:35:09.652 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3449414971 2024-09-16T03:35:09.652 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:35:09.652 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:35:09.652 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.652 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:35:09.652 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:35:09.652 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:35:09.652 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:35:09.652 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6808", 2024-09-16T03:35:09.652 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3449414971 2024-09-16T03:35:09.652 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.653 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:35:09.653 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:35:09.653 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6809", 2024-09-16T03:35:09.653 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3449414971 2024-09-16T03:35:09.653 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:35:09.653 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:35:09.653 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.653 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:35:09.653 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:35:09.653 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:35:09.653 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:35:09.653 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6806", 2024-09-16T03:35:09.653 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3449414971 2024-09-16T03:35:09.653 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.654 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:35:09.654 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:35:09.654 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6807", 2024-09-16T03:35:09.654 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3449414971 2024-09-16T03:35:09.654 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:35:09.654 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:35:09.654 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.654 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6803/3449414971", 2024-09-16T03:35:09.654 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6805/3449414971", 2024-09-16T03:35:09.654 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6809/3449414971", 2024-09-16T03:35:09.654 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6807/3449414971", 2024-09-16T03:35:09.654 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:35:09.654 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:35:09.654 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:35:09.655 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:35:09.655 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.656 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:35:09.656 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:35:09.656 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "1ed2d78f-1635-4234-83aa-7c0b7e3c87dc", 2024-09-16T03:35:09.656 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:35:09.656 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:35:09.656 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:35:09.656 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:35:09.656 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:35:09.656 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:35:09.656 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 10, 2024-09-16T03:35:09.656 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 21, 2024-09-16T03:35:09.656 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:35:09.656 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:35:09.657 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:35:09.657 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:35:09.657 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:35:09.657 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:35:09.657 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6810", 2024-09-16T03:35:09.657 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 4240988863 2024-09-16T03:35:09.657 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.657 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:35:09.657 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:35:09.657 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6811", 2024-09-16T03:35:09.657 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 4240988863 2024-09-16T03:35:09.657 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:35:09.657 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:35:09.658 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.658 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:35:09.658 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:35:09.658 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:35:09.658 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:35:09.658 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6812", 2024-09-16T03:35:09.658 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 4240988863 2024-09-16T03:35:09.658 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.658 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:35:09.658 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:35:09.658 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6813", 2024-09-16T03:35:09.658 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 4240988863 2024-09-16T03:35:09.658 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:35:09.658 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:35:09.659 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.659 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:35:09.659 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:35:09.659 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:35:09.659 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:35:09.659 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6816", 2024-09-16T03:35:09.659 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 4240988863 2024-09-16T03:35:09.659 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.659 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:35:09.659 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:35:09.659 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6817", 2024-09-16T03:35:09.659 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 4240988863 2024-09-16T03:35:09.659 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:35:09.659 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:35:09.660 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.660 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:35:09.660 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:35:09.660 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:35:09.660 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:35:09.660 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6814", 2024-09-16T03:35:09.660 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 4240988863 2024-09-16T03:35:09.660 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.660 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:35:09.660 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:35:09.660 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6815", 2024-09-16T03:35:09.660 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 4240988863 2024-09-16T03:35:09.660 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:35:09.660 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:35:09.661 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.661 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6811/4240988863", 2024-09-16T03:35:09.661 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6813/4240988863", 2024-09-16T03:35:09.661 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6817/4240988863", 2024-09-16T03:35:09.661 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6815/4240988863", 2024-09-16T03:35:09.661 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:35:09.661 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:35:09.661 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:35:09.661 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:35:09.661 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.661 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:35:09.661 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:35:09.661 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "c4febd52-73d0-4470-af74-9bb5e7ac65da", 2024-09-16T03:35:09.662 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:35:09.662 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:35:09.662 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:35:09.662 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:35:09.662 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:35:09.662 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:35:09.662 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 15, 2024-09-16T03:35:09.662 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 21, 2024-09-16T03:35:09.662 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:35:09.662 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:35:09.662 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:35:09.662 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:35:09.662 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:35:09.663 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:35:09.663 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6818", 2024-09-16T03:35:09.663 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 2239695978 2024-09-16T03:35:09.663 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.663 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:35:09.663 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:35:09.663 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6819", 2024-09-16T03:35:09.663 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 2239695978 2024-09-16T03:35:09.663 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:35:09.663 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:35:09.663 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.663 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:35:09.663 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:35:09.664 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:35:09.664 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:35:09.664 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6820", 2024-09-16T03:35:09.664 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 2239695978 2024-09-16T03:35:09.664 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.664 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:35:09.664 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:35:09.664 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6821", 2024-09-16T03:35:09.664 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 2239695978 2024-09-16T03:35:09.664 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:35:09.664 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:35:09.664 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.664 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:35:09.665 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:35:09.665 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:35:09.665 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:35:09.665 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6824", 2024-09-16T03:35:09.665 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 2239695978 2024-09-16T03:35:09.665 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.665 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:35:09.665 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:35:09.665 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6825", 2024-09-16T03:35:09.665 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 2239695978 2024-09-16T03:35:09.665 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:35:09.665 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:35:09.665 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.665 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:35:09.666 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:35:09.666 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:35:09.666 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:35:09.666 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6822", 2024-09-16T03:35:09.666 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 2239695978 2024-09-16T03:35:09.666 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.666 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:35:09.666 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:35:09.666 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6823", 2024-09-16T03:35:09.667 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 2239695978 2024-09-16T03:35:09.667 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:35:09.667 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:35:09.667 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.668 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6819/2239695978", 2024-09-16T03:35:09.668 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6821/2239695978", 2024-09-16T03:35:09.668 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6825/2239695978", 2024-09-16T03:35:09.668 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6823/2239695978", 2024-09-16T03:35:09.668 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:35:09.668 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:35:09.668 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:35:09.668 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:35:09.668 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:35:09.669 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:35:09.669 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_xinfo": [ 2024-09-16T03:35:09.669 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:35:09.669 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:35:09.669 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:35:09.669 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:35:09.669 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:35:09.669 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:35:09.669 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:35:09.669 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:26:56.992065+0000", 2024-09-16T03:35:09.669 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:35:09.669 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.669 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:35:09.670 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:35:09.670 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:35:09.670 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:35:09.670 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:35:09.670 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:35:09.670 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:35:09.670 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:27:34.030155+0000", 2024-09-16T03:35:09.670 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:35:09.670 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.670 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:35:09.670 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:35:09.670 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:35:09.670 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:35:09.670 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:35:09.671 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:35:09.671 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:35:09.671 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:28:12.174041+0000", 2024-09-16T03:35:09.671 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:35:09.671 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:35:09.671 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:35:09.671 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap": [], 2024-09-16T03:35:09.671 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap_items": [], 2024-09-16T03:35:09.671 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap_primaries": [], 2024-09-16T03:35:09.671 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_temp": [], 2024-09-16T03:35:09.671 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_temp": [], 2024-09-16T03:35:09.671 INFO:tasks.workunit.client.0.smithi096.stderr: "blocklist": {}, 2024-09-16T03:35:09.671 INFO:tasks.workunit.client.0.smithi096.stderr: "range_blocklist": {}, 2024-09-16T03:35:09.672 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profiles": { 2024-09-16T03:35:09.672 INFO:tasks.workunit.client.0.smithi096.stderr: "default": { 2024-09-16T03:35:09.672 INFO:tasks.workunit.client.0.smithi096.stderr: "k": "2", 2024-09-16T03:35:09.672 INFO:tasks.workunit.client.0.smithi096.stderr: "m": "2", 2024-09-16T03:35:09.672 INFO:tasks.workunit.client.0.smithi096.stderr: "plugin": "jerasure", 2024-09-16T03:35:09.672 INFO:tasks.workunit.client.0.smithi096.stderr: "technique": "reed_sol_van" 2024-09-16T03:35:09.672 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:35:09.672 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.672 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps_queue": [], 2024-09-16T03:35:09.672 INFO:tasks.workunit.client.0.smithi096.stderr: "new_removed_snaps": [], 2024-09-16T03:35:09.672 INFO:tasks.workunit.client.0.smithi096.stderr: "new_purged_snaps": [], 2024-09-16T03:35:09.672 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_node_flags": {}, 2024-09-16T03:35:09.672 INFO:tasks.workunit.client.0.smithi096.stderr: "device_class_flags": {}, 2024-09-16T03:35:09.672 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode": { 2024-09-16T03:35:09.673 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode_enabled": false, 2024-09-16T03:35:09.673 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_bucket_count": 0, 2024-09-16T03:35:09.673 INFO:tasks.workunit.client.0.smithi096.stderr: "degraded_stretch_mode": 0, 2024-09-16T03:35:09.673 INFO:tasks.workunit.client.0.smithi096.stderr: "recovering_stretch_mode": 0, 2024-09-16T03:35:09.673 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode_bucket": 0 2024-09-16T03:35:09.673 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:35:09.673 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.673 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_metadata": [ 2024-09-16T03:35:09.673 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:35:09.673 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:35:09.673 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:35:09.673 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6804/3449414971,v1:127.0.0.1:6805/3449414971]", 2024-09-16T03:35:09.673 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:35:09.673 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:35:09.674 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:35:09.674 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:35:09.674 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:35:09.674 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:35:09.674 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:35:09.674 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:35:09.674 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:35:09.674 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:35:09.674 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:35:09.674 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-osdmap-prune/0/block", 2024-09-16T03:35:09.674 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:35:09.674 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:35:09.674 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:35:09.674 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:35:09.675 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:35:09.675 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:35:09.675 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:35:09.675 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:35:09.675 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:35:09.675 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:35:09.675 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:26:27.749490Z", 2024-09-16T03:35:09.675 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:35:09.675 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:35:09.675 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:35:09.675 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:35:09.675 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:35:09.675 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:35:09.675 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:35:09.676 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6802/3449414971,v1:127.0.0.1:6803/3449414971]", 2024-09-16T03:35:09.676 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:35:09.676 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6808/3449414971,v1:127.0.0.1:6809/3449414971]", 2024-09-16T03:35:09.676 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6806/3449414971,v1:127.0.0.1:6807/3449414971]", 2024-09-16T03:35:09.676 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:35:09.676 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:35:09.676 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:35:09.676 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:35:09.676 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:35:09.676 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:35:09.676 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:35:09.676 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:35:09.676 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:35:09.677 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-osdmap-prune/0", 2024-09-16T03:35:09.677 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:35:09.677 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:35:09.677 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:35:09.677 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.677 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:35:09.677 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:35:09.677 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:35:09.677 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6812/4240988863,v1:127.0.0.1:6813/4240988863]", 2024-09-16T03:35:09.677 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:35:09.677 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:35:09.677 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:35:09.677 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:35:09.677 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:35:09.678 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:35:09.678 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:35:09.678 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:35:09.678 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:35:09.678 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:35:09.678 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:35:09.678 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-osdmap-prune/1/block", 2024-09-16T03:35:09.678 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:35:09.678 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:35:09.678 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:35:09.678 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:35:09.678 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:35:09.678 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:35:09.678 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:35:09.679 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:35:09.679 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:35:09.679 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:35:09.679 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:27:04.728300Z", 2024-09-16T03:35:09.679 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:35:09.679 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:35:09.679 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:35:09.679 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:35:09.679 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:35:09.679 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:35:09.679 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:35:09.679 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6810/4240988863,v1:127.0.0.1:6811/4240988863]", 2024-09-16T03:35:09.679 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:35:09.679 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6816/4240988863,v1:127.0.0.1:6817/4240988863]", 2024-09-16T03:35:09.680 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6814/4240988863,v1:127.0.0.1:6815/4240988863]", 2024-09-16T03:35:09.680 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:35:09.680 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:35:09.680 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:35:09.680 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:35:09.680 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:35:09.680 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:35:09.680 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:35:09.680 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:35:09.680 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:35:09.680 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-osdmap-prune/1", 2024-09-16T03:35:09.680 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:35:09.680 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:35:09.681 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:35:09.681 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.681 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:35:09.681 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:35:09.681 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:35:09.681 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6820/2239695978,v1:127.0.0.1:6821/2239695978]", 2024-09-16T03:35:09.681 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:35:09.681 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:35:09.681 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:35:09.681 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:35:09.681 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:35:09.681 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:35:09.681 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:35:09.681 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:35:09.682 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:35:09.682 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:35:09.682 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:35:09.682 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-osdmap-prune/2/block", 2024-09-16T03:35:09.682 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:35:09.682 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:35:09.682 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:35:09.682 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:35:09.682 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:35:09.682 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:35:09.682 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:35:09.682 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:35:09.682 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:35:09.682 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:35:09.683 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:27:42.002291Z", 2024-09-16T03:35:09.683 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:35:09.683 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:35:09.683 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:35:09.683 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:35:09.683 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:35:09.683 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:35:09.683 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:35:09.683 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6818/2239695978,v1:127.0.0.1:6819/2239695978]", 2024-09-16T03:35:09.683 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:35:09.683 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6824/2239695978,v1:127.0.0.1:6825/2239695978]", 2024-09-16T03:35:09.683 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6822/2239695978,v1:127.0.0.1:6823/2239695978]", 2024-09-16T03:35:09.683 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:35:09.684 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:35:09.684 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:35:09.684 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:35:09.684 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:35:09.684 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:35:09.684 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:35:09.684 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:35:09.684 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:35:09.684 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-osdmap-prune/2", 2024-09-16T03:35:09.684 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:35:09.684 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:35:09.684 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:35:09.684 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:35:09.684 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:35:09.685 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_clean_epochs": { 2024-09-16T03:35:09.685 INFO:tasks.workunit.client.0.smithi096.stderr: "min_last_epoch_clean": 1008, 2024-09-16T03:35:09.685 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": { 2024-09-16T03:35:09.685 INFO:tasks.workunit.client.0.smithi096.stderr: "per_pool": [ 2024-09-16T03:35:09.685 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:35:09.685 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 1, 2024-09-16T03:35:09.685 INFO:tasks.workunit.client.0.smithi096.stderr: "floor": 1008 2024-09-16T03:35:09.685 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:35:09.685 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:35:09.685 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.685 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_epochs": [ 2024-09-16T03:35:09.685 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:35:09.685 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:35:09.685 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 1012 2024-09-16T03:35:09.686 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.686 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:35:09.686 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:35:09.686 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 1017 2024-09-16T03:35:09.686 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.686 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:35:09.686 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:35:09.686 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 1020 2024-09-16T03:35:09.686 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:35:09.686 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:35:09.686 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.686 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_first_committed": 1, 2024-09-16T03:35:09.686 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_last_committed": 1030, 2024-09-16T03:35:09.686 INFO:tasks.workunit.client.0.smithi096.stderr: "crushmap": { 2024-09-16T03:35:09.687 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": [ 2024-09-16T03:35:09.687 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:35:09.687 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:35:09.687 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.0", 2024-09-16T03:35:09.687 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:35:09.687 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.687 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:35:09.687 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:35:09.687 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.1", 2024-09-16T03:35:09.687 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:35:09.687 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.687 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:35:09.687 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:35:09.688 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.2", 2024-09-16T03:35:09.688 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:35:09.688 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:35:09.688 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:35:09.688 INFO:tasks.workunit.client.0.smithi096.stderr: "types": [ 2024-09-16T03:35:09.688 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:35:09.688 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 0, 2024-09-16T03:35:09.688 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd" 2024-09-16T03:35:09.688 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.688 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:35:09.688 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:35:09.688 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "host" 2024-09-16T03:35:09.688 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.688 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:35:09.689 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 2, 2024-09-16T03:35:09.689 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "chassis" 2024-09-16T03:35:09.689 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.689 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:35:09.689 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 3, 2024-09-16T03:35:09.689 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "rack" 2024-09-16T03:35:09.689 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.689 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:35:09.689 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 4, 2024-09-16T03:35:09.689 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "row" 2024-09-16T03:35:09.689 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.689 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:35:09.689 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 5, 2024-09-16T03:35:09.689 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "pdu" 2024-09-16T03:35:09.690 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.690 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:35:09.690 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 6, 2024-09-16T03:35:09.690 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "pod" 2024-09-16T03:35:09.690 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.690 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:35:09.690 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 7, 2024-09-16T03:35:09.690 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "room" 2024-09-16T03:35:09.690 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.690 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:35:09.690 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 8, 2024-09-16T03:35:09.690 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "datacenter" 2024-09-16T03:35:09.690 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.690 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:35:09.691 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 9, 2024-09-16T03:35:09.691 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "zone" 2024-09-16T03:35:09.691 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.691 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:35:09.691 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 10, 2024-09-16T03:35:09.691 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "region" 2024-09-16T03:35:09.691 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.691 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:35:09.691 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:35:09.691 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "root" 2024-09-16T03:35:09.691 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:35:09.691 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:35:09.691 INFO:tasks.workunit.client.0.smithi096.stderr: "buckets": [ 2024-09-16T03:35:09.691 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:35:09.692 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -1, 2024-09-16T03:35:09.692 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "default", 2024-09-16T03:35:09.692 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:35:09.692 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "root", 2024-09-16T03:35:09.692 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:35:09.692 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:35:09.692 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:35:09.692 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:35:09.692 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:35:09.692 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -3, 2024-09-16T03:35:09.692 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:35:09.692 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:35:09.692 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:35:09.693 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:35:09.693 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.693 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:35:09.693 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -2, 2024-09-16T03:35:09.693 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "default~hdd", 2024-09-16T03:35:09.693 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:35:09.693 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "root", 2024-09-16T03:35:09.693 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:35:09.693 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:35:09.693 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:35:09.693 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:35:09.693 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:35:09.693 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -4, 2024-09-16T03:35:09.693 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:35:09.694 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:35:09.694 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:35:09.694 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:35:09.694 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.694 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:35:09.694 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -3, 2024-09-16T03:35:09.694 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "smithi096", 2024-09-16T03:35:09.694 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:35:09.694 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "host", 2024-09-16T03:35:09.694 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:35:09.694 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:35:09.694 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:35:09.694 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:35:09.694 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:35:09.695 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:35:09.695 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:35:09.695 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:35:09.695 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.695 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:35:09.695 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:35:09.695 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:35:09.695 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 1 2024-09-16T03:35:09.695 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.695 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:35:09.695 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:35:09.695 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:35:09.695 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 2 2024-09-16T03:35:09.695 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:35:09.696 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:35:09.696 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.696 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:35:09.696 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -4, 2024-09-16T03:35:09.696 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "smithi096~hdd", 2024-09-16T03:35:09.696 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:35:09.696 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "host", 2024-09-16T03:35:09.696 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:35:09.696 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:35:09.696 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:35:09.696 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:35:09.696 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:35:09.696 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:35:09.696 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:35:09.697 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:35:09.697 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.697 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:35:09.697 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:35:09.697 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:35:09.697 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 1 2024-09-16T03:35:09.697 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.697 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:35:09.697 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:35:09.697 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:35:09.697 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 2 2024-09-16T03:35:09.697 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:35:09.697 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:35:09.697 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:35:09.698 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:35:09.698 INFO:tasks.workunit.client.0.smithi096.stderr: "rules": [ 2024-09-16T03:35:09.698 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:35:09.698 INFO:tasks.workunit.client.0.smithi096.stderr: "rule_id": 0, 2024-09-16T03:35:09.698 INFO:tasks.workunit.client.0.smithi096.stderr: "rule_name": "replicated_rule", 2024-09-16T03:35:09.698 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:35:09.698 INFO:tasks.workunit.client.0.smithi096.stderr: "steps": [ 2024-09-16T03:35:09.698 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:35:09.698 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "take", 2024-09-16T03:35:09.698 INFO:tasks.workunit.client.0.smithi096.stderr: "item": -1, 2024-09-16T03:35:09.698 INFO:tasks.workunit.client.0.smithi096.stderr: "item_name": "default" 2024-09-16T03:35:09.698 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.698 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:35:09.699 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "choose_firstn", 2024-09-16T03:35:09.699 INFO:tasks.workunit.client.0.smithi096.stderr: "num": 0, 2024-09-16T03:35:09.699 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "osd" 2024-09-16T03:35:09.699 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.699 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:35:09.699 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "emit" 2024-09-16T03:35:09.699 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:35:09.699 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:35:09.699 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:35:09.699 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:35:09.699 INFO:tasks.workunit.client.0.smithi096.stderr: "tunables": { 2024-09-16T03:35:09.699 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_local_tries": 0, 2024-09-16T03:35:09.699 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_local_fallback_tries": 0, 2024-09-16T03:35:09.699 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_total_tries": 50, 2024-09-16T03:35:09.700 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_descend_once": 1, 2024-09-16T03:35:09.700 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_vary_r": 1, 2024-09-16T03:35:09.700 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_stable": 1, 2024-09-16T03:35:09.700 INFO:tasks.workunit.client.0.smithi096.stderr: "msr_descents": 100, 2024-09-16T03:35:09.700 INFO:tasks.workunit.client.0.smithi096.stderr: "msr_collision_tries": 100, 2024-09-16T03:35:09.700 INFO:tasks.workunit.client.0.smithi096.stderr: "straw_calc_version": 1, 2024-09-16T03:35:09.700 INFO:tasks.workunit.client.0.smithi096.stderr: "allowed_bucket_algs": 54, 2024-09-16T03:35:09.700 INFO:tasks.workunit.client.0.smithi096.stderr: "profile": "jewel", 2024-09-16T03:35:09.700 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_tunables": 1, 2024-09-16T03:35:09.700 INFO:tasks.workunit.client.0.smithi096.stderr: "legacy_tunables": 0, 2024-09-16T03:35:09.700 INFO:tasks.workunit.client.0.smithi096.stderr: "minimum_required_version": "jewel", 2024-09-16T03:35:09.700 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables": 1, 2024-09-16T03:35:09.700 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables2": 1, 2024-09-16T03:35:09.701 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v2_rules": 0, 2024-09-16T03:35:09.701 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables3": 1, 2024-09-16T03:35:09.701 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v3_rules": 0, 2024-09-16T03:35:09.701 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v4_buckets": 1, 2024-09-16T03:35:09.701 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables5": 1, 2024-09-16T03:35:09.701 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v5_rules": 0, 2024-09-16T03:35:09.701 INFO:tasks.workunit.client.0.smithi096.stderr: "has_msr_rules": 0 2024-09-16T03:35:09.701 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.701 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_args": {} 2024-09-16T03:35:09.701 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.701 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_manifest": { 2024-09-16T03:35:09.701 INFO:tasks.workunit.client.0.smithi096.stderr: "first_pinned": 1, 2024-09-16T03:35:09.701 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pinned": 921, 2024-09-16T03:35:09.701 INFO:tasks.workunit.client.0.smithi096.stderr: "pinned_maps": [ 2024-09-16T03:35:09.702 INFO:tasks.workunit.client.0.smithi096.stderr: 1, 2024-09-16T03:35:09.702 INFO:tasks.workunit.client.0.smithi096.stderr: 11, 2024-09-16T03:35:09.702 INFO:tasks.workunit.client.0.smithi096.stderr: 21, 2024-09-16T03:35:09.702 INFO:tasks.workunit.client.0.smithi096.stderr: 31, 2024-09-16T03:35:09.702 INFO:tasks.workunit.client.0.smithi096.stderr: 41, 2024-09-16T03:35:09.702 INFO:tasks.workunit.client.0.smithi096.stderr: 51, 2024-09-16T03:35:09.702 INFO:tasks.workunit.client.0.smithi096.stderr: 61, 2024-09-16T03:35:09.702 INFO:tasks.workunit.client.0.smithi096.stderr: 71, 2024-09-16T03:35:09.702 INFO:tasks.workunit.client.0.smithi096.stderr: 81, 2024-09-16T03:35:09.702 INFO:tasks.workunit.client.0.smithi096.stderr: 91, 2024-09-16T03:35:09.702 INFO:tasks.workunit.client.0.smithi096.stderr: 101, 2024-09-16T03:35:09.702 INFO:tasks.workunit.client.0.smithi096.stderr: 111, 2024-09-16T03:35:09.702 INFO:tasks.workunit.client.0.smithi096.stderr: 121, 2024-09-16T03:35:09.702 INFO:tasks.workunit.client.0.smithi096.stderr: 131, 2024-09-16T03:35:09.703 INFO:tasks.workunit.client.0.smithi096.stderr: 141, 2024-09-16T03:35:09.703 INFO:tasks.workunit.client.0.smithi096.stderr: 151, 2024-09-16T03:35:09.703 INFO:tasks.workunit.client.0.smithi096.stderr: 161, 2024-09-16T03:35:09.703 INFO:tasks.workunit.client.0.smithi096.stderr: 171, 2024-09-16T03:35:09.703 INFO:tasks.workunit.client.0.smithi096.stderr: 181, 2024-09-16T03:35:09.703 INFO:tasks.workunit.client.0.smithi096.stderr: 191, 2024-09-16T03:35:09.703 INFO:tasks.workunit.client.0.smithi096.stderr: 201, 2024-09-16T03:35:09.703 INFO:tasks.workunit.client.0.smithi096.stderr: 211, 2024-09-16T03:35:09.703 INFO:tasks.workunit.client.0.smithi096.stderr: 221, 2024-09-16T03:35:09.703 INFO:tasks.workunit.client.0.smithi096.stderr: 231, 2024-09-16T03:35:09.703 INFO:tasks.workunit.client.0.smithi096.stderr: 241, 2024-09-16T03:35:09.703 INFO:tasks.workunit.client.0.smithi096.stderr: 251, 2024-09-16T03:35:09.703 INFO:tasks.workunit.client.0.smithi096.stderr: 261, 2024-09-16T03:35:09.703 INFO:tasks.workunit.client.0.smithi096.stderr: 271, 2024-09-16T03:35:09.703 INFO:tasks.workunit.client.0.smithi096.stderr: 281, 2024-09-16T03:35:09.704 INFO:tasks.workunit.client.0.smithi096.stderr: 291, 2024-09-16T03:35:09.704 INFO:tasks.workunit.client.0.smithi096.stderr: 301, 2024-09-16T03:35:09.704 INFO:tasks.workunit.client.0.smithi096.stderr: 311, 2024-09-16T03:35:09.704 INFO:tasks.workunit.client.0.smithi096.stderr: 321, 2024-09-16T03:35:09.704 INFO:tasks.workunit.client.0.smithi096.stderr: 331, 2024-09-16T03:35:09.704 INFO:tasks.workunit.client.0.smithi096.stderr: 341, 2024-09-16T03:35:09.704 INFO:tasks.workunit.client.0.smithi096.stderr: 351, 2024-09-16T03:35:09.704 INFO:tasks.workunit.client.0.smithi096.stderr: 361, 2024-09-16T03:35:09.704 INFO:tasks.workunit.client.0.smithi096.stderr: 371, 2024-09-16T03:35:09.704 INFO:tasks.workunit.client.0.smithi096.stderr: 381, 2024-09-16T03:35:09.704 INFO:tasks.workunit.client.0.smithi096.stderr: 391, 2024-09-16T03:35:09.704 INFO:tasks.workunit.client.0.smithi096.stderr: 401, 2024-09-16T03:35:09.704 INFO:tasks.workunit.client.0.smithi096.stderr: 411, 2024-09-16T03:35:09.705 INFO:tasks.workunit.client.0.smithi096.stderr: 421, 2024-09-16T03:35:09.705 INFO:tasks.workunit.client.0.smithi096.stderr: 431, 2024-09-16T03:35:09.705 INFO:tasks.workunit.client.0.smithi096.stderr: 441, 2024-09-16T03:35:09.705 INFO:tasks.workunit.client.0.smithi096.stderr: 451, 2024-09-16T03:35:09.705 INFO:tasks.workunit.client.0.smithi096.stderr: 461, 2024-09-16T03:35:09.705 INFO:tasks.workunit.client.0.smithi096.stderr: 471, 2024-09-16T03:35:09.705 INFO:tasks.workunit.client.0.smithi096.stderr: 481, 2024-09-16T03:35:09.705 INFO:tasks.workunit.client.0.smithi096.stderr: 491, 2024-09-16T03:35:09.705 INFO:tasks.workunit.client.0.smithi096.stderr: 501, 2024-09-16T03:35:09.705 INFO:tasks.workunit.client.0.smithi096.stderr: 511, 2024-09-16T03:35:09.706 INFO:tasks.workunit.client.0.smithi096.stderr: 521, 2024-09-16T03:35:09.706 INFO:tasks.workunit.client.0.smithi096.stderr: 531, 2024-09-16T03:35:09.706 INFO:tasks.workunit.client.0.smithi096.stderr: 541, 2024-09-16T03:35:09.706 INFO:tasks.workunit.client.0.smithi096.stderr: 551, 2024-09-16T03:35:09.706 INFO:tasks.workunit.client.0.smithi096.stderr: 561, 2024-09-16T03:35:09.706 INFO:tasks.workunit.client.0.smithi096.stderr: 571, 2024-09-16T03:35:09.706 INFO:tasks.workunit.client.0.smithi096.stderr: 581, 2024-09-16T03:35:09.706 INFO:tasks.workunit.client.0.smithi096.stderr: 591, 2024-09-16T03:35:09.706 INFO:tasks.workunit.client.0.smithi096.stderr: 601, 2024-09-16T03:35:09.706 INFO:tasks.workunit.client.0.smithi096.stderr: 611, 2024-09-16T03:35:09.706 INFO:tasks.workunit.client.0.smithi096.stderr: 621, 2024-09-16T03:35:09.707 INFO:tasks.workunit.client.0.smithi096.stderr: 631, 2024-09-16T03:35:09.707 INFO:tasks.workunit.client.0.smithi096.stderr: 641, 2024-09-16T03:35:09.707 INFO:tasks.workunit.client.0.smithi096.stderr: 651, 2024-09-16T03:35:09.707 INFO:tasks.workunit.client.0.smithi096.stderr: 661, 2024-09-16T03:35:09.707 INFO:tasks.workunit.client.0.smithi096.stderr: 671, 2024-09-16T03:35:09.707 INFO:tasks.workunit.client.0.smithi096.stderr: 681, 2024-09-16T03:35:09.707 INFO:tasks.workunit.client.0.smithi096.stderr: 691, 2024-09-16T03:35:09.707 INFO:tasks.workunit.client.0.smithi096.stderr: 701, 2024-09-16T03:35:09.707 INFO:tasks.workunit.client.0.smithi096.stderr: 711, 2024-09-16T03:35:09.707 INFO:tasks.workunit.client.0.smithi096.stderr: 721, 2024-09-16T03:35:09.707 INFO:tasks.workunit.client.0.smithi096.stderr: 731, 2024-09-16T03:35:09.707 INFO:tasks.workunit.client.0.smithi096.stderr: 741, 2024-09-16T03:35:09.707 INFO:tasks.workunit.client.0.smithi096.stderr: 751, 2024-09-16T03:35:09.708 INFO:tasks.workunit.client.0.smithi096.stderr: 761, 2024-09-16T03:35:09.708 INFO:tasks.workunit.client.0.smithi096.stderr: 771, 2024-09-16T03:35:09.708 INFO:tasks.workunit.client.0.smithi096.stderr: 781, 2024-09-16T03:35:09.708 INFO:tasks.workunit.client.0.smithi096.stderr: 791, 2024-09-16T03:35:09.708 INFO:tasks.workunit.client.0.smithi096.stderr: 801, 2024-09-16T03:35:09.708 INFO:tasks.workunit.client.0.smithi096.stderr: 811, 2024-09-16T03:35:09.708 INFO:tasks.workunit.client.0.smithi096.stderr: 821, 2024-09-16T03:35:09.708 INFO:tasks.workunit.client.0.smithi096.stderr: 831, 2024-09-16T03:35:09.708 INFO:tasks.workunit.client.0.smithi096.stderr: 841, 2024-09-16T03:35:09.708 INFO:tasks.workunit.client.0.smithi096.stderr: 851, 2024-09-16T03:35:09.708 INFO:tasks.workunit.client.0.smithi096.stderr: 861, 2024-09-16T03:35:09.709 INFO:tasks.workunit.client.0.smithi096.stderr: 871, 2024-09-16T03:35:09.709 INFO:tasks.workunit.client.0.smithi096.stderr: 881, 2024-09-16T03:35:09.709 INFO:tasks.workunit.client.0.smithi096.stderr: 891, 2024-09-16T03:35:09.709 INFO:tasks.workunit.client.0.smithi096.stderr: 901, 2024-09-16T03:35:09.709 INFO:tasks.workunit.client.0.smithi096.stderr: 911, 2024-09-16T03:35:09.709 INFO:tasks.workunit.client.0.smithi096.stderr: 921 2024-09-16T03:35:09.709 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:35:09.709 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.709 INFO:tasks.workunit.client.0.smithi096.stderr: "fsmap": { 2024-09-16T03:35:09.709 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 1, 2024-09-16T03:35:09.709 INFO:tasks.workunit.client.0.smithi096.stderr: "btime": "2024-09-16T03:26:20:863172+0000", 2024-09-16T03:35:09.710 INFO:tasks.workunit.client.0.smithi096.stderr: "default_fscid": -1, 2024-09-16T03:35:09.710 INFO:tasks.workunit.client.0.smithi096.stderr: "compat": { 2024-09-16T03:35:09.710 INFO:tasks.workunit.client.0.smithi096.stderr: "compat": {}, 2024-09-16T03:35:09.710 INFO:tasks.workunit.client.0.smithi096.stderr: "ro_compat": {}, 2024-09-16T03:35:09.710 INFO:tasks.workunit.client.0.smithi096.stderr: "incompat": { 2024-09-16T03:35:09.710 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_1": "base v0.20", 2024-09-16T03:35:09.710 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_2": "client writeable ranges", 2024-09-16T03:35:09.710 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_3": "default file layouts on dirs", 2024-09-16T03:35:09.710 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_4": "dir inode in separate object", 2024-09-16T03:35:09.711 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_5": "mds uses versioned encoding", 2024-09-16T03:35:09.711 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_6": "dirfrag is stored in omap", 2024-09-16T03:35:09.711 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_8": "no anchor table", 2024-09-16T03:35:09.711 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_9": "file layout v2", 2024-09-16T03:35:09.711 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_10": "snaprealm v2", 2024-09-16T03:35:09.711 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_11": "minor log segments", 2024-09-16T03:35:09.711 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_12": "quiesce subvolumes" 2024-09-16T03:35:09.711 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:35:09.711 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.711 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_flags": { 2024-09-16T03:35:09.711 INFO:tasks.workunit.client.0.smithi096.stderr: "enable_multiple": true, 2024-09-16T03:35:09.711 INFO:tasks.workunit.client.0.smithi096.stderr: "ever_enabled_multiple": true 2024-09-16T03:35:09.711 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.712 INFO:tasks.workunit.client.0.smithi096.stderr: "standbys": [], 2024-09-16T03:35:09.712 INFO:tasks.workunit.client.0.smithi096.stderr: "filesystems": [] 2024-09-16T03:35:09.712 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.712 INFO:tasks.workunit.client.0.smithi096.stderr: "mdsmap_first_committed": 1, 2024-09-16T03:35:09.712 INFO:tasks.workunit.client.0.smithi096.stderr: "mdsmap_last_committed": 1, 2024-09-16T03:35:09.712 INFO:tasks.workunit.client.0.smithi096.stderr: "auth": { 2024-09-16T03:35:09.712 INFO:tasks.workunit.client.0.smithi096.stderr: "first_committed": 1, 2024-09-16T03:35:09.712 INFO:tasks.workunit.client.0.smithi096.stderr: "last_committed": 5, 2024-09-16T03:35:09.712 INFO:tasks.workunit.client.0.smithi096.stderr: "num_secrets": 3 2024-09-16T03:35:09.712 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.712 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 32, 2024-09-16T03:35:09.713 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_active": 32, 2024-09-16T03:35:09.713 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_unknown": 0, 2024-09-16T03:35:09.713 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osd": 3, 2024-09-16T03:35:09.713 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_sum": { 2024-09-16T03:35:09.713 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:35:09.713 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:35:09.713 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:35:09.713 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:35:09.713 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:35:09.713 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:35:09.713 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:35:09.713 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:35:09.713 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:35:09.713 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:35:09.714 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:35:09.714 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:35:09.714 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:35:09.714 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:35:09.714 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:35:09.714 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:35:09.714 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:35:09.714 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:35:09.714 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:35:09.714 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:35:09.714 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:35:09.714 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:35:09.714 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:35:09.715 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:35:09.715 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:35:09.715 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:35:09.715 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:35:09.715 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:35:09.715 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:35:09.715 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:35:09.715 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:35:09.715 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:35:09.715 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:35:09.715 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:35:09.715 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:35:09.715 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:35:09.715 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:35:09.716 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:35:09.716 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:35:09.716 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:35:09.716 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:35:09.716 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.716 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:35:09.716 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:35:09.716 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:35:09.716 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:35:09.716 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:35:09.716 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:35:09.716 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:35:09.716 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:35:09.716 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:35:09.717 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:35:09.717 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:35:09.717 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.717 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:35:09.717 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:35:09.717 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 96, 2024-09-16T03:35:09.717 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 96, 2024-09-16T03:35:09.717 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 0 2024-09-16T03:35:09.717 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.717 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_sum": { 2024-09-16T03:35:09.717 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 0, 2024-09-16T03:35:09.717 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 0, 2024-09-16T03:35:09.717 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pgs": 96, 2024-09-16T03:35:09.717 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osds": 3, 2024-09-16T03:35:09.718 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_osds": 3, 2024-09-16T03:35:09.718 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_omap_osds": 3, 2024-09-16T03:35:09.718 INFO:tasks.workunit.client.0.smithi096.stderr: "kb": 314572800, 2024-09-16T03:35:09.718 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used": 225892, 2024-09-16T03:35:09.718 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_data": 24568, 2024-09-16T03:35:09.718 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_omap": 4, 2024-09-16T03:35:09.718 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_meta": 201211, 2024-09-16T03:35:09.718 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_avail": 314346908, 2024-09-16T03:35:09.718 INFO:tasks.workunit.client.0.smithi096.stderr: "statfs": { 2024-09-16T03:35:09.718 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 322122547200, 2024-09-16T03:35:09.718 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 321891233792, 2024-09-16T03:35:09.718 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:35:09.718 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 25157632, 2024-09-16T03:35:09.719 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 8287800, 2024-09-16T03:35:09.719 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:35:09.719 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:35:09.719 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:35:09.719 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 4785, 2024-09-16T03:35:09.719 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 206040399 2024-09-16T03:35:09.719 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.719 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_peers": [], 2024-09-16T03:35:09.719 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_trim_queue_len": 0, 2024-09-16T03:35:09.719 INFO:tasks.workunit.client.0.smithi096.stderr: "num_snap_trimming": 0, 2024-09-16T03:35:09.719 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shards_repaired": 0, 2024-09-16T03:35:09.719 INFO:tasks.workunit.client.0.smithi096.stderr: "op_queue_age_hist": { 2024-09-16T03:35:09.720 INFO:tasks.workunit.client.0.smithi096.stderr: "histogram": [], 2024-09-16T03:35:09.720 INFO:tasks.workunit.client.0.smithi096.stderr: "upper_bound": 1 2024-09-16T03:35:09.720 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.720 INFO:tasks.workunit.client.0.smithi096.stderr: "perf_stat": { 2024-09-16T03:35:09.720 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ms": 277, 2024-09-16T03:35:09.720 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ms": 277, 2024-09-16T03:35:09.720 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ns": 277000000, 2024-09-16T03:35:09.720 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ns": 277000000 2024-09-16T03:35:09.720 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.720 INFO:tasks.workunit.client.0.smithi096.stderr: "alerts": [], 2024-09-16T03:35:09.720 INFO:tasks.workunit.client.0.smithi096.stderr: "network_ping_times": [] 2024-09-16T03:35:09.720 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.720 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_sum_by_class": { 2024-09-16T03:35:09.720 INFO:tasks.workunit.client.0.smithi096.stderr: "hdd": { 2024-09-16T03:35:09.721 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 0, 2024-09-16T03:35:09.721 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 0, 2024-09-16T03:35:09.721 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pgs": 96, 2024-09-16T03:35:09.721 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osds": 3, 2024-09-16T03:35:09.721 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_osds": 3, 2024-09-16T03:35:09.721 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_omap_osds": 3, 2024-09-16T03:35:09.721 INFO:tasks.workunit.client.0.smithi096.stderr: "kb": 314572800, 2024-09-16T03:35:09.721 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used": 225892, 2024-09-16T03:35:09.721 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_data": 24568, 2024-09-16T03:35:09.721 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_omap": 4, 2024-09-16T03:35:09.721 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_meta": 201211, 2024-09-16T03:35:09.721 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_avail": 314346908, 2024-09-16T03:35:09.721 INFO:tasks.workunit.client.0.smithi096.stderr: "statfs": { 2024-09-16T03:35:09.721 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 322122547200, 2024-09-16T03:35:09.722 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 321891233792, 2024-09-16T03:35:09.722 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:35:09.722 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 25157632, 2024-09-16T03:35:09.722 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 8287800, 2024-09-16T03:35:09.722 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:35:09.722 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:35:09.722 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:35:09.722 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 4785, 2024-09-16T03:35:09.722 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 206040399 2024-09-16T03:35:09.722 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.722 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_peers": [], 2024-09-16T03:35:09.722 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_trim_queue_len": 0, 2024-09-16T03:35:09.722 INFO:tasks.workunit.client.0.smithi096.stderr: "num_snap_trimming": 0, 2024-09-16T03:35:09.722 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shards_repaired": 0, 2024-09-16T03:35:09.723 INFO:tasks.workunit.client.0.smithi096.stderr: "op_queue_age_hist": { 2024-09-16T03:35:09.723 INFO:tasks.workunit.client.0.smithi096.stderr: "histogram": [], 2024-09-16T03:35:09.723 INFO:tasks.workunit.client.0.smithi096.stderr: "upper_bound": 1 2024-09-16T03:35:09.723 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.723 INFO:tasks.workunit.client.0.smithi096.stderr: "perf_stat": { 2024-09-16T03:35:09.723 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ms": 277, 2024-09-16T03:35:09.723 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ms": 277, 2024-09-16T03:35:09.723 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ns": 277000000, 2024-09-16T03:35:09.723 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ns": 277000000 2024-09-16T03:35:09.723 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.723 INFO:tasks.workunit.client.0.smithi096.stderr: "alerts": [], 2024-09-16T03:35:09.723 INFO:tasks.workunit.client.0.smithi096.stderr: "network_ping_times": [] 2024-09-16T03:35:09.723 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:35:09.724 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.724 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_stats": [ 2024-09-16T03:35:09.724 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:35:09.724 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 1, 2024-09-16T03:35:09.724 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 32, 2024-09-16T03:35:09.724 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:35:09.724 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:35:09.724 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:35:09.724 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:35:09.724 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:35:09.724 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:35:09.724 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:35:09.724 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:35:09.724 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:35:09.725 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:35:09.725 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:35:09.725 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:35:09.725 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:35:09.725 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:35:09.725 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:35:09.725 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:35:09.725 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:35:09.725 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:35:09.725 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:35:09.725 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:35:09.725 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:35:09.725 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:35:09.725 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:35:09.726 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:35:09.726 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:35:09.726 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:35:09.726 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:35:09.726 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:35:09.726 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:35:09.726 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:35:09.726 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:35:09.726 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:35:09.726 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:35:09.726 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:35:09.726 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:35:09.726 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:35:09.726 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:35:09.727 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:35:09.727 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:35:09.727 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:35:09.727 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:35:09.727 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.727 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:35:09.727 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:35:09.727 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:35:09.727 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:35:09.727 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:35:09.727 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:35:09.727 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:35:09.727 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:35:09.728 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:35:09.728 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:35:09.728 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:35:09.728 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.728 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:35:09.728 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:35:09.728 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 96, 2024-09-16T03:35:09.728 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 96, 2024-09-16T03:35:09.728 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 3 2024-09-16T03:35:09.728 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:35:09.728 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:35:09.728 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_stats": [ 2024-09-16T03:35:09.728 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:35:09.729 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:35:09.729 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 21474836588 2024-09-16T03:35:09.729 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.729 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:35:09.729 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:35:09.729 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 42949673053 2024-09-16T03:35:09.729 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.729 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:35:09.729 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:35:09.729 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 64424509529 2024-09-16T03:35:09.729 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:35:09.729 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:35:09.729 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_by_state": [ 2024-09-16T03:35:09.729 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:35:09.730 INFO:tasks.workunit.client.0.smithi096.stderr: "state": "active+clean", 2024-09-16T03:35:09.730 INFO:tasks.workunit.client.0.smithi096.stderr: "num": 32 2024-09-16T03:35:09.730 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:35:09.730 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:35:09.730 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_by_osd": [ 2024-09-16T03:35:09.730 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:35:09.730 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:35:09.730 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 6, 2024-09-16T03:35:09.730 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 32, 2024-09-16T03:35:09.730 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:35:09.730 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.730 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:35:09.730 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:35:09.730 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 8, 2024-09-16T03:35:09.730 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 32, 2024-09-16T03:35:09.731 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:35:09.731 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.731 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:35:09.731 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:35:09.731 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 18, 2024-09-16T03:35:09.731 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 32, 2024-09-16T03:35:09.731 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:35:09.731 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:35:09.731 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:35:09.731 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": [ 2024-09-16T03:35:09.731 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:35:09.731 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 1, 2024-09-16T03:35:09.731 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": {} 2024-09-16T03:35:09.732 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:35:09.732 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:35:09.732 INFO:tasks.workunit.client.0.smithi096.stderr: "servicemap": { 2024-09-16T03:35:09.732 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 5, 2024-09-16T03:35:09.732 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:29:14.445298+0000", 2024-09-16T03:35:09.732 INFO:tasks.workunit.client.0.smithi096.stderr: "services": {} 2024-09-16T03:35:09.732 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:35:09.732 INFO:tasks.workunit.client.0.smithi096.stderr: "mgrstat_first_committed": 1, 2024-09-16T03:35:09.732 INFO:tasks.workunit.client.0.smithi096.stderr: "mgrstat_last_committed": 253, 2024-09-16T03:35:09.732 INFO:tasks.workunit.client.0.smithi096.stderr: "logm_first_committed": 1384, 2024-09-16T03:35:09.732 INFO:tasks.workunit.client.0.smithi096.stderr: "logm_last_committed": 1978, 2024-09-16T03:35:09.732 INFO:tasks.workunit.client.0.smithi096.stderr: "paxos": { 2024-09-16T03:35:09.732 INFO:tasks.workunit.client.0.smithi096.stderr: "first_committed": 2511, 2024-09-16T03:35:09.732 INFO:tasks.workunit.client.0.smithi096.stderr: "last_committed": 3208, 2024-09-16T03:35:09.733 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pn": 0, 2024-09-16T03:35:09.733 INFO:tasks.workunit.client.0.smithi096.stderr: "accepted_pn": 0 2024-09-16T03:35:09.733 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:35:09.733 INFO:tasks.workunit.client.0.smithi096.stderr:}' 2024-09-16T03:35:09.733 INFO:tasks.workunit.client.0.smithi096.stderr:++ jq .osdmap_first_committed 2024-09-16T03:35:09.734 INFO:tasks.workunit.client.0.smithi096.stderr:+ fc=1 2024-09-16T03:35:09.734 INFO:tasks.workunit.client.0.smithi096.stderr:++ jq .osdmap_last_committed 2024-09-16T03:35:09.734 INFO:tasks.workunit.client.0.smithi096.stderr:+ lc=1030 2024-09-16T03:35:09.734 INFO:tasks.workunit.client.0.smithi096.stderr:+ [[ 1029 -ge 500 ]] 2024-09-16T03:35:09.734 INFO:tasks.workunit.client.0.smithi096.stderr:+ wait_for_osdmap_manifest 2024-09-16T03:35:09.734 INFO:tasks.workunit.client.0.smithi096.stderr:+ local what=true 2024-09-16T03:35:09.735 INFO:tasks.workunit.client.0.smithi096.stderr:++ get_timeout_delays 300 .1 2024-09-16T03:35:09.735 INFO:tasks.workunit.client.0.smithi096.stderr:+++ shopt -q -o xtrace 2024-09-16T03:35:09.735 INFO:tasks.workunit.client.0.smithi096.stderr:+++ echo true 2024-09-16T03:35:09.735 INFO:tasks.workunit.client.0.smithi096.stderr:++ local trace=true 2024-09-16T03:35:09.735 INFO:tasks.workunit.client.0.smithi096.stderr:++ true 2024-09-16T03:35:09.735 INFO:tasks.workunit.client.0.smithi096.stderr:++ shopt -u -o xtrace 2024-09-16T03:35:09.897 INFO:tasks.workunit.client.0.smithi096.stderr:+ delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '4.5') 2024-09-16T03:35:09.898 INFO:tasks.workunit.client.0.smithi096.stderr:+ local -a delays 2024-09-16T03:35:09.898 INFO:tasks.workunit.client.0.smithi096.stderr:+ local -i loop=0 2024-09-16T03:35:09.898 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i=0 )) 2024-09-16T03:35:09.898 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < 27 )) 2024-09-16T03:35:09.898 INFO:tasks.workunit.client.0.smithi096.stderr:++ ceph report 2024-09-16T03:35:09.898 INFO:tasks.workunit.client.0.smithi096.stderr:++ jq 'has("osdmap_manifest")' 2024-09-16T03:35:10.420 INFO:tasks.workunit.client.0.smithi096.stderr:report 3740348673 2024-09-16T03:35:10.437 INFO:tasks.workunit.client.0.smithi096.stderr:+ has_manifest=true 2024-09-16T03:35:10.437 INFO:tasks.workunit.client.0.smithi096.stderr:+ [[ true == \t\r\u\e ]] 2024-09-16T03:35:10.437 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:10.437 INFO:tasks.workunit.client.0.smithi096.stderr:++ ceph report 2024-09-16T03:35:10.437 INFO:tasks.workunit.client.0.smithi096.stderr:++ jq .osdmap_manifest 2024-09-16T03:35:11.141 INFO:tasks.workunit.client.0.smithi096.stderr:report 1185395112 2024-09-16T03:35:11.158 INFO:tasks.workunit.client.0.smithi096.stderr:+ manifest='{ 2024-09-16T03:35:11.158 INFO:tasks.workunit.client.0.smithi096.stderr: "first_pinned": 1, 2024-09-16T03:35:11.158 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pinned": 921, 2024-09-16T03:35:11.158 INFO:tasks.workunit.client.0.smithi096.stderr: "pinned_maps": [ 2024-09-16T03:35:11.158 INFO:tasks.workunit.client.0.smithi096.stderr: 1, 2024-09-16T03:35:11.158 INFO:tasks.workunit.client.0.smithi096.stderr: 11, 2024-09-16T03:35:11.158 INFO:tasks.workunit.client.0.smithi096.stderr: 21, 2024-09-16T03:35:11.158 INFO:tasks.workunit.client.0.smithi096.stderr: 31, 2024-09-16T03:35:11.158 INFO:tasks.workunit.client.0.smithi096.stderr: 41, 2024-09-16T03:35:11.158 INFO:tasks.workunit.client.0.smithi096.stderr: 51, 2024-09-16T03:35:11.159 INFO:tasks.workunit.client.0.smithi096.stderr: 61, 2024-09-16T03:35:11.159 INFO:tasks.workunit.client.0.smithi096.stderr: 71, 2024-09-16T03:35:11.159 INFO:tasks.workunit.client.0.smithi096.stderr: 81, 2024-09-16T03:35:11.159 INFO:tasks.workunit.client.0.smithi096.stderr: 91, 2024-09-16T03:35:11.159 INFO:tasks.workunit.client.0.smithi096.stderr: 101, 2024-09-16T03:35:11.159 INFO:tasks.workunit.client.0.smithi096.stderr: 111, 2024-09-16T03:35:11.159 INFO:tasks.workunit.client.0.smithi096.stderr: 121, 2024-09-16T03:35:11.159 INFO:tasks.workunit.client.0.smithi096.stderr: 131, 2024-09-16T03:35:11.159 INFO:tasks.workunit.client.0.smithi096.stderr: 141, 2024-09-16T03:35:11.159 INFO:tasks.workunit.client.0.smithi096.stderr: 151, 2024-09-16T03:35:11.159 INFO:tasks.workunit.client.0.smithi096.stderr: 161, 2024-09-16T03:35:11.159 INFO:tasks.workunit.client.0.smithi096.stderr: 171, 2024-09-16T03:35:11.160 INFO:tasks.workunit.client.0.smithi096.stderr: 181, 2024-09-16T03:35:11.160 INFO:tasks.workunit.client.0.smithi096.stderr: 191, 2024-09-16T03:35:11.160 INFO:tasks.workunit.client.0.smithi096.stderr: 201, 2024-09-16T03:35:11.160 INFO:tasks.workunit.client.0.smithi096.stderr: 211, 2024-09-16T03:35:11.160 INFO:tasks.workunit.client.0.smithi096.stderr: 221, 2024-09-16T03:35:11.160 INFO:tasks.workunit.client.0.smithi096.stderr: 231, 2024-09-16T03:35:11.160 INFO:tasks.workunit.client.0.smithi096.stderr: 241, 2024-09-16T03:35:11.160 INFO:tasks.workunit.client.0.smithi096.stderr: 251, 2024-09-16T03:35:11.160 INFO:tasks.workunit.client.0.smithi096.stderr: 261, 2024-09-16T03:35:11.160 INFO:tasks.workunit.client.0.smithi096.stderr: 271, 2024-09-16T03:35:11.160 INFO:tasks.workunit.client.0.smithi096.stderr: 281, 2024-09-16T03:35:11.160 INFO:tasks.workunit.client.0.smithi096.stderr: 291, 2024-09-16T03:35:11.160 INFO:tasks.workunit.client.0.smithi096.stderr: 301, 2024-09-16T03:35:11.160 INFO:tasks.workunit.client.0.smithi096.stderr: 311, 2024-09-16T03:35:11.161 INFO:tasks.workunit.client.0.smithi096.stderr: 321, 2024-09-16T03:35:11.161 INFO:tasks.workunit.client.0.smithi096.stderr: 331, 2024-09-16T03:35:11.161 INFO:tasks.workunit.client.0.smithi096.stderr: 341, 2024-09-16T03:35:11.161 INFO:tasks.workunit.client.0.smithi096.stderr: 351, 2024-09-16T03:35:11.161 INFO:tasks.workunit.client.0.smithi096.stderr: 361, 2024-09-16T03:35:11.161 INFO:tasks.workunit.client.0.smithi096.stderr: 371, 2024-09-16T03:35:11.161 INFO:tasks.workunit.client.0.smithi096.stderr: 381, 2024-09-16T03:35:11.161 INFO:tasks.workunit.client.0.smithi096.stderr: 391, 2024-09-16T03:35:11.161 INFO:tasks.workunit.client.0.smithi096.stderr: 401, 2024-09-16T03:35:11.161 INFO:tasks.workunit.client.0.smithi096.stderr: 411, 2024-09-16T03:35:11.161 INFO:tasks.workunit.client.0.smithi096.stderr: 421, 2024-09-16T03:35:11.161 INFO:tasks.workunit.client.0.smithi096.stderr: 431, 2024-09-16T03:35:11.162 INFO:tasks.workunit.client.0.smithi096.stderr: 441, 2024-09-16T03:35:11.162 INFO:tasks.workunit.client.0.smithi096.stderr: 451, 2024-09-16T03:35:11.162 INFO:tasks.workunit.client.0.smithi096.stderr: 461, 2024-09-16T03:35:11.162 INFO:tasks.workunit.client.0.smithi096.stderr: 471, 2024-09-16T03:35:11.162 INFO:tasks.workunit.client.0.smithi096.stderr: 481, 2024-09-16T03:35:11.162 INFO:tasks.workunit.client.0.smithi096.stderr: 491, 2024-09-16T03:35:11.162 INFO:tasks.workunit.client.0.smithi096.stderr: 501, 2024-09-16T03:35:11.163 INFO:tasks.workunit.client.0.smithi096.stderr: 511, 2024-09-16T03:35:11.163 INFO:tasks.workunit.client.0.smithi096.stderr: 521, 2024-09-16T03:35:11.163 INFO:tasks.workunit.client.0.smithi096.stderr: 531, 2024-09-16T03:35:11.163 INFO:tasks.workunit.client.0.smithi096.stderr: 541, 2024-09-16T03:35:11.163 INFO:tasks.workunit.client.0.smithi096.stderr: 551, 2024-09-16T03:35:11.163 INFO:tasks.workunit.client.0.smithi096.stderr: 561, 2024-09-16T03:35:11.163 INFO:tasks.workunit.client.0.smithi096.stderr: 571, 2024-09-16T03:35:11.163 INFO:tasks.workunit.client.0.smithi096.stderr: 581, 2024-09-16T03:35:11.163 INFO:tasks.workunit.client.0.smithi096.stderr: 591, 2024-09-16T03:35:11.163 INFO:tasks.workunit.client.0.smithi096.stderr: 601, 2024-09-16T03:35:11.163 INFO:tasks.workunit.client.0.smithi096.stderr: 611, 2024-09-16T03:35:11.163 INFO:tasks.workunit.client.0.smithi096.stderr: 621, 2024-09-16T03:35:11.163 INFO:tasks.workunit.client.0.smithi096.stderr: 631, 2024-09-16T03:35:11.164 INFO:tasks.workunit.client.0.smithi096.stderr: 641, 2024-09-16T03:35:11.164 INFO:tasks.workunit.client.0.smithi096.stderr: 651, 2024-09-16T03:35:11.164 INFO:tasks.workunit.client.0.smithi096.stderr: 661, 2024-09-16T03:35:11.164 INFO:tasks.workunit.client.0.smithi096.stderr: 671, 2024-09-16T03:35:11.164 INFO:tasks.workunit.client.0.smithi096.stderr: 681, 2024-09-16T03:35:11.164 INFO:tasks.workunit.client.0.smithi096.stderr: 691, 2024-09-16T03:35:11.164 INFO:tasks.workunit.client.0.smithi096.stderr: 701, 2024-09-16T03:35:11.164 INFO:tasks.workunit.client.0.smithi096.stderr: 711, 2024-09-16T03:35:11.164 INFO:tasks.workunit.client.0.smithi096.stderr: 721, 2024-09-16T03:35:11.164 INFO:tasks.workunit.client.0.smithi096.stderr: 731, 2024-09-16T03:35:11.164 INFO:tasks.workunit.client.0.smithi096.stderr: 741, 2024-09-16T03:35:11.164 INFO:tasks.workunit.client.0.smithi096.stderr: 751, 2024-09-16T03:35:11.164 INFO:tasks.workunit.client.0.smithi096.stderr: 761, 2024-09-16T03:35:11.164 INFO:tasks.workunit.client.0.smithi096.stderr: 771, 2024-09-16T03:35:11.164 INFO:tasks.workunit.client.0.smithi096.stderr: 781, 2024-09-16T03:35:11.165 INFO:tasks.workunit.client.0.smithi096.stderr: 791, 2024-09-16T03:35:11.165 INFO:tasks.workunit.client.0.smithi096.stderr: 801, 2024-09-16T03:35:11.165 INFO:tasks.workunit.client.0.smithi096.stderr: 811, 2024-09-16T03:35:11.165 INFO:tasks.workunit.client.0.smithi096.stderr: 821, 2024-09-16T03:35:11.165 INFO:tasks.workunit.client.0.smithi096.stderr: 831, 2024-09-16T03:35:11.165 INFO:tasks.workunit.client.0.smithi096.stderr: 841, 2024-09-16T03:35:11.165 INFO:tasks.workunit.client.0.smithi096.stderr: 851, 2024-09-16T03:35:11.165 INFO:tasks.workunit.client.0.smithi096.stderr: 861, 2024-09-16T03:35:11.165 INFO:tasks.workunit.client.0.smithi096.stderr: 871, 2024-09-16T03:35:11.165 INFO:tasks.workunit.client.0.smithi096.stderr: 881, 2024-09-16T03:35:11.165 INFO:tasks.workunit.client.0.smithi096.stderr: 891, 2024-09-16T03:35:11.165 INFO:tasks.workunit.client.0.smithi096.stderr: 901, 2024-09-16T03:35:11.165 INFO:tasks.workunit.client.0.smithi096.stderr: 911, 2024-09-16T03:35:11.165 INFO:tasks.workunit.client.0.smithi096.stderr: 921 2024-09-16T03:35:11.166 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:35:11.166 INFO:tasks.workunit.client.0.smithi096.stderr:}' 2024-09-16T03:35:11.166 INFO:tasks.workunit.client.0.smithi096.stderr:++ jq .first_pinned 2024-09-16T03:35:11.193 INFO:tasks.workunit.client.0.smithi096.stderr:+ first_pinned=1 2024-09-16T03:35:11.193 INFO:tasks.workunit.client.0.smithi096.stderr:++ jq .last_pinned 2024-09-16T03:35:11.231 INFO:tasks.workunit.client.0.smithi096.stderr:+ last_pinned=921 2024-09-16T03:35:11.232 INFO:tasks.workunit.client.0.smithi096.stderr:+ pinned_maps=($(jq '.pinned_maps[]' <<< $manifest)) 2024-09-16T03:35:11.232 INFO:tasks.workunit.client.0.smithi096.stderr:++ jq '.pinned_maps[]' 2024-09-16T03:35:11.269 INFO:tasks.workunit.client.0.smithi096.stderr:+ [[ 1 -eq 1 ]] 2024-09-16T03:35:11.269 INFO:tasks.workunit.client.0.smithi096.stderr:+ [[ 921 -eq 921 ]] 2024-09-16T03:35:11.269 INFO:tasks.workunit.client.0.smithi096.stderr:+ [[ 1 -lt 921 ]] 2024-09-16T03:35:11.269 INFO:tasks.workunit.client.0.smithi096.stderr:+ [[ 921 -lt 1030 ]] 2024-09-16T03:35:11.269 INFO:tasks.workunit.client.0.smithi096.stderr:+ [[ 1 -eq 1 ]] 2024-09-16T03:35:11.269 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i=1 )) 2024-09-16T03:35:11.269 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:11.270 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 1 2024-09-16T03:35:11.270 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=1 2024-09-16T03:35:11.270 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:11.270 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:11.270 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.ATGkw0VtoH 2024-09-16T03:35:11.270 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 1 -o /tmp/tmp.ATGkw0VtoH 2024-09-16T03:35:11.706 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 1 2024-09-16T03:35:11.722 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.ATGkw0VtoH 2024-09-16T03:35:11.722 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 1' 2024-09-16T03:35:11.742 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.ATGkw0VtoH' 2024-09-16T03:35:11.743 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 1 2024-09-16T03:35:11.743 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.ATGkw0VtoH 2024-09-16T03:35:11.745 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:11.745 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:11.745 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:11.745 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 2 2024-09-16T03:35:11.745 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=2 2024-09-16T03:35:11.745 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:11.745 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:11.745 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.QlH1AiERua 2024-09-16T03:35:11.746 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 2 -o /tmp/tmp.QlH1AiERua 2024-09-16T03:35:12.208 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 2 2024-09-16T03:35:12.227 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 2' 2024-09-16T03:35:12.227 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.QlH1AiERua 2024-09-16T03:35:12.247 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.QlH1AiERua' 2024-09-16T03:35:12.248 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 2 2024-09-16T03:35:12.249 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.QlH1AiERua 2024-09-16T03:35:12.251 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:12.251 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:12.251 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:12.251 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 3 2024-09-16T03:35:12.252 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=3 2024-09-16T03:35:12.252 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:12.252 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:12.253 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.s3o4Tq8t0C 2024-09-16T03:35:12.253 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 3 -o /tmp/tmp.s3o4Tq8t0C 2024-09-16T03:35:12.647 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 3 2024-09-16T03:35:12.663 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 3' 2024-09-16T03:35:12.663 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.s3o4Tq8t0C 2024-09-16T03:35:12.683 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.s3o4Tq8t0C' 2024-09-16T03:35:12.684 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 3 2024-09-16T03:35:12.684 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.s3o4Tq8t0C 2024-09-16T03:35:12.685 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:12.685 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:12.685 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:12.685 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 4 2024-09-16T03:35:12.685 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=4 2024-09-16T03:35:12.685 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:12.686 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:12.686 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.cKJH26Ou8v 2024-09-16T03:35:12.686 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 4 -o /tmp/tmp.cKJH26Ou8v 2024-09-16T03:35:13.102 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 4 2024-09-16T03:35:13.119 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.cKJH26Ou8v 2024-09-16T03:35:13.119 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 4' 2024-09-16T03:35:13.139 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.cKJH26Ou8v' 2024-09-16T03:35:13.141 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 4 2024-09-16T03:35:13.141 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.cKJH26Ou8v 2024-09-16T03:35:13.142 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:13.142 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:13.142 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:13.142 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 5 2024-09-16T03:35:13.142 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=5 2024-09-16T03:35:13.142 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:13.142 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:13.143 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.WhZCYZYMrX 2024-09-16T03:35:13.143 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 5 -o /tmp/tmp.WhZCYZYMrX 2024-09-16T03:35:13.595 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 5 2024-09-16T03:35:13.613 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.WhZCYZYMrX 2024-09-16T03:35:13.613 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 5' 2024-09-16T03:35:13.632 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.WhZCYZYMrX' 2024-09-16T03:35:13.634 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 5 2024-09-16T03:35:13.634 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.WhZCYZYMrX 2024-09-16T03:35:13.635 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:13.635 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:13.636 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:13.636 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 6 2024-09-16T03:35:13.636 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=6 2024-09-16T03:35:13.636 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:13.636 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:13.636 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.18UVIbLi7y 2024-09-16T03:35:13.636 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 6 -o /tmp/tmp.18UVIbLi7y 2024-09-16T03:35:14.072 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 6 2024-09-16T03:35:14.089 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.18UVIbLi7y 2024-09-16T03:35:14.089 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 6' 2024-09-16T03:35:14.108 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.18UVIbLi7y' 2024-09-16T03:35:14.109 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 6 2024-09-16T03:35:14.110 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.18UVIbLi7y 2024-09-16T03:35:14.111 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:14.111 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:14.111 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:14.111 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 7 2024-09-16T03:35:14.111 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=7 2024-09-16T03:35:14.111 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:14.111 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:14.112 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.U4NkXYQgm2 2024-09-16T03:35:14.112 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 7 -o /tmp/tmp.U4NkXYQgm2 2024-09-16T03:35:14.505 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 7 2024-09-16T03:35:14.521 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.U4NkXYQgm2 2024-09-16T03:35:14.522 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 7' 2024-09-16T03:35:14.541 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.U4NkXYQgm2' 2024-09-16T03:35:14.542 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 7 2024-09-16T03:35:14.542 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.U4NkXYQgm2 2024-09-16T03:35:14.543 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:14.544 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:14.544 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:14.544 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 8 2024-09-16T03:35:14.544 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=8 2024-09-16T03:35:14.544 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:14.544 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:14.544 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.YUrUWJfkwo 2024-09-16T03:35:14.545 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 8 -o /tmp/tmp.YUrUWJfkwo 2024-09-16T03:35:14.944 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 8 2024-09-16T03:35:14.959 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.YUrUWJfkwo 2024-09-16T03:35:14.960 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 8' 2024-09-16T03:35:14.979 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.YUrUWJfkwo' 2024-09-16T03:35:14.980 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 8 2024-09-16T03:35:14.980 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.YUrUWJfkwo 2024-09-16T03:35:14.981 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:14.981 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:14.982 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:14.982 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 9 2024-09-16T03:35:14.982 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=9 2024-09-16T03:35:14.982 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:14.982 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:14.982 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.SLmiM6e0m3 2024-09-16T03:35:14.982 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 9 -o /tmp/tmp.SLmiM6e0m3 2024-09-16T03:35:15.382 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 9 2024-09-16T03:35:15.398 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.SLmiM6e0m3 2024-09-16T03:35:15.398 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 9' 2024-09-16T03:35:15.418 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.SLmiM6e0m3' 2024-09-16T03:35:15.419 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 9 2024-09-16T03:35:15.420 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.SLmiM6e0m3 2024-09-16T03:35:15.422 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:15.422 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:15.422 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:15.422 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 10 2024-09-16T03:35:15.422 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=10 2024-09-16T03:35:15.422 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:15.422 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:15.423 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.jOmMpPwpJQ 2024-09-16T03:35:15.423 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 10 -o /tmp/tmp.jOmMpPwpJQ 2024-09-16T03:35:15.868 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 10 2024-09-16T03:35:15.884 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.jOmMpPwpJQ 2024-09-16T03:35:15.884 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 10' 2024-09-16T03:35:15.904 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.jOmMpPwpJQ' 2024-09-16T03:35:15.905 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 10 2024-09-16T03:35:15.905 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.jOmMpPwpJQ 2024-09-16T03:35:15.907 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:15.907 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:15.907 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:15.907 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 11 2024-09-16T03:35:15.907 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=11 2024-09-16T03:35:15.907 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:15.908 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:15.908 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.pUdNwEICxd 2024-09-16T03:35:15.908 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 11 -o /tmp/tmp.pUdNwEICxd 2024-09-16T03:35:16.346 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 11 2024-09-16T03:35:16.363 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.pUdNwEICxd 2024-09-16T03:35:16.363 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 11' 2024-09-16T03:35:16.382 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.pUdNwEICxd' 2024-09-16T03:35:16.384 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 11 2024-09-16T03:35:16.384 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.pUdNwEICxd 2024-09-16T03:35:16.385 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:16.385 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:16.386 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:16.386 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 12 2024-09-16T03:35:16.386 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=12 2024-09-16T03:35:16.386 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:16.386 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:16.386 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.BbuTdK4fKS 2024-09-16T03:35:16.386 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 12 -o /tmp/tmp.BbuTdK4fKS 2024-09-16T03:35:16.797 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 12 2024-09-16T03:35:16.814 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.BbuTdK4fKS 2024-09-16T03:35:16.814 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 12' 2024-09-16T03:35:16.833 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.BbuTdK4fKS' 2024-09-16T03:35:16.835 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 12 2024-09-16T03:35:16.835 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.BbuTdK4fKS 2024-09-16T03:35:16.836 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:16.836 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:16.836 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:16.836 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 13 2024-09-16T03:35:16.836 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=13 2024-09-16T03:35:16.836 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:16.837 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:16.837 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.ZteXpByzmH 2024-09-16T03:35:16.837 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 13 -o /tmp/tmp.ZteXpByzmH 2024-09-16T03:35:17.229 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 13 2024-09-16T03:35:17.245 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.ZteXpByzmH 2024-09-16T03:35:17.246 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 13' 2024-09-16T03:35:17.266 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.ZteXpByzmH' 2024-09-16T03:35:17.267 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 13 2024-09-16T03:35:17.268 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.ZteXpByzmH 2024-09-16T03:35:17.269 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:17.269 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:17.269 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:17.269 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 14 2024-09-16T03:35:17.269 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=14 2024-09-16T03:35:17.269 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:17.269 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:17.270 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.C7oK7PycsI 2024-09-16T03:35:17.270 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 14 -o /tmp/tmp.C7oK7PycsI 2024-09-16T03:35:17.689 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 14 2024-09-16T03:35:17.706 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.C7oK7PycsI 2024-09-16T03:35:17.707 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 14' 2024-09-16T03:35:17.727 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.C7oK7PycsI' 2024-09-16T03:35:17.728 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 14 2024-09-16T03:35:17.728 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.C7oK7PycsI 2024-09-16T03:35:17.729 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:17.729 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:17.729 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:17.729 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 15 2024-09-16T03:35:17.730 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=15 2024-09-16T03:35:17.730 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:17.730 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:17.731 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.kEDYMDISEL 2024-09-16T03:35:17.731 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 15 -o /tmp/tmp.kEDYMDISEL 2024-09-16T03:35:18.148 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 15 2024-09-16T03:35:18.164 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.kEDYMDISEL 2024-09-16T03:35:18.164 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 15' 2024-09-16T03:35:18.186 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.kEDYMDISEL' 2024-09-16T03:35:18.187 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 15 2024-09-16T03:35:18.187 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.kEDYMDISEL 2024-09-16T03:35:18.188 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:18.189 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:18.189 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:18.189 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 16 2024-09-16T03:35:18.189 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=16 2024-09-16T03:35:18.189 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:18.189 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:18.189 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.qa2s7OCINZ 2024-09-16T03:35:18.189 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 16 -o /tmp/tmp.qa2s7OCINZ 2024-09-16T03:35:18.615 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 16 2024-09-16T03:35:18.631 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.qa2s7OCINZ 2024-09-16T03:35:18.632 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 16' 2024-09-16T03:35:18.647 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.qa2s7OCINZ' 2024-09-16T03:35:18.648 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 16 2024-09-16T03:35:18.648 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.qa2s7OCINZ 2024-09-16T03:35:18.649 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:18.649 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:18.649 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:18.649 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 17 2024-09-16T03:35:18.649 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=17 2024-09-16T03:35:18.650 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:18.650 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:18.650 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.VQOsiqRo7Q 2024-09-16T03:35:18.650 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 17 -o /tmp/tmp.VQOsiqRo7Q 2024-09-16T03:35:19.123 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 17 2024-09-16T03:35:19.139 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.VQOsiqRo7Q 2024-09-16T03:35:19.139 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 17' 2024-09-16T03:35:19.158 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.VQOsiqRo7Q' 2024-09-16T03:35:19.160 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 17 2024-09-16T03:35:19.160 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.VQOsiqRo7Q 2024-09-16T03:35:19.161 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:19.161 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:19.161 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:19.161 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 18 2024-09-16T03:35:19.161 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=18 2024-09-16T03:35:19.161 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:19.161 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:19.162 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.XtuquaBkJF 2024-09-16T03:35:19.162 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 18 -o /tmp/tmp.XtuquaBkJF 2024-09-16T03:35:19.595 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 18 2024-09-16T03:35:19.611 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.XtuquaBkJF 2024-09-16T03:35:19.611 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 18' 2024-09-16T03:35:19.631 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.XtuquaBkJF' 2024-09-16T03:35:19.632 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 18 2024-09-16T03:35:19.633 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.XtuquaBkJF 2024-09-16T03:35:19.636 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:19.636 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:19.636 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:19.636 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 19 2024-09-16T03:35:19.636 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=19 2024-09-16T03:35:19.636 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:19.636 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:19.636 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.ehjOALIcb1 2024-09-16T03:35:19.636 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 19 -o /tmp/tmp.ehjOALIcb1 2024-09-16T03:35:20.039 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 19 2024-09-16T03:35:20.055 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.ehjOALIcb1 2024-09-16T03:35:20.055 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 19' 2024-09-16T03:35:20.074 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.ehjOALIcb1' 2024-09-16T03:35:20.076 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 19 2024-09-16T03:35:20.076 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.ehjOALIcb1 2024-09-16T03:35:20.077 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:20.078 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:20.078 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:20.078 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 20 2024-09-16T03:35:20.078 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=20 2024-09-16T03:35:20.078 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:20.078 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:20.079 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.g6Z0RQfhOW 2024-09-16T03:35:20.079 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 20 -o /tmp/tmp.g6Z0RQfhOW 2024-09-16T03:35:20.508 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 20 2024-09-16T03:35:20.523 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.g6Z0RQfhOW 2024-09-16T03:35:20.523 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 20' 2024-09-16T03:35:20.539 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.g6Z0RQfhOW' 2024-09-16T03:35:20.540 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 20 2024-09-16T03:35:20.540 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.g6Z0RQfhOW 2024-09-16T03:35:20.542 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:20.542 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:20.542 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:20.542 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 21 2024-09-16T03:35:20.542 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=21 2024-09-16T03:35:20.542 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:20.542 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:20.543 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.Q0RHTEN7eo 2024-09-16T03:35:20.543 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 21 -o /tmp/tmp.Q0RHTEN7eo 2024-09-16T03:35:20.950 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 21 2024-09-16T03:35:20.966 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 21' 2024-09-16T03:35:20.967 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.Q0RHTEN7eo 2024-09-16T03:35:20.986 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.Q0RHTEN7eo' 2024-09-16T03:35:20.988 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 21 2024-09-16T03:35:20.989 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.Q0RHTEN7eo 2024-09-16T03:35:20.989 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:20.990 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:20.990 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:20.990 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 22 2024-09-16T03:35:20.990 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=22 2024-09-16T03:35:20.990 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:20.990 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:20.990 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.Wgf0nhrN3a 2024-09-16T03:35:20.990 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 22 -o /tmp/tmp.Wgf0nhrN3a 2024-09-16T03:35:21.420 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 22 2024-09-16T03:35:21.436 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.Wgf0nhrN3a 2024-09-16T03:35:21.436 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 22' 2024-09-16T03:35:21.455 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.Wgf0nhrN3a' 2024-09-16T03:35:21.458 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 22 2024-09-16T03:35:21.459 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.Wgf0nhrN3a 2024-09-16T03:35:21.459 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:21.459 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:21.459 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:21.459 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 23 2024-09-16T03:35:21.460 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=23 2024-09-16T03:35:21.460 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:21.460 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:21.460 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.B3DFu7mq37 2024-09-16T03:35:21.460 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 23 -o /tmp/tmp.B3DFu7mq37 2024-09-16T03:35:21.922 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 23 2024-09-16T03:35:21.939 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.B3DFu7mq37 2024-09-16T03:35:21.940 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 23' 2024-09-16T03:35:21.958 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.B3DFu7mq37' 2024-09-16T03:35:21.960 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 23 2024-09-16T03:35:21.960 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.B3DFu7mq37 2024-09-16T03:35:21.961 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:21.962 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:21.962 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:21.962 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 24 2024-09-16T03:35:21.962 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=24 2024-09-16T03:35:21.962 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:21.962 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:21.962 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.kzObMIjKFx 2024-09-16T03:35:21.962 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 24 -o /tmp/tmp.kzObMIjKFx 2024-09-16T03:35:22.400 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 24 2024-09-16T03:35:22.416 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.kzObMIjKFx 2024-09-16T03:35:22.416 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 24' 2024-09-16T03:35:22.436 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.kzObMIjKFx' 2024-09-16T03:35:22.438 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 24 2024-09-16T03:35:22.438 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.kzObMIjKFx 2024-09-16T03:35:22.439 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:22.439 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:22.439 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:22.439 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 25 2024-09-16T03:35:22.439 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=25 2024-09-16T03:35:22.440 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:22.440 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:22.440 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.u7L0pWB1KT 2024-09-16T03:35:22.440 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 25 -o /tmp/tmp.u7L0pWB1KT 2024-09-16T03:35:22.860 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 25 2024-09-16T03:35:22.877 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.u7L0pWB1KT 2024-09-16T03:35:22.877 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 25' 2024-09-16T03:35:22.896 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.u7L0pWB1KT' 2024-09-16T03:35:22.898 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 25 2024-09-16T03:35:22.898 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.u7L0pWB1KT 2024-09-16T03:35:22.899 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:22.900 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:22.900 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:22.900 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 26 2024-09-16T03:35:22.900 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=26 2024-09-16T03:35:22.900 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:22.900 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:22.901 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.k35hXx5I0L 2024-09-16T03:35:22.901 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 26 -o /tmp/tmp.k35hXx5I0L 2024-09-16T03:35:23.373 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 26 2024-09-16T03:35:23.386 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.k35hXx5I0L 2024-09-16T03:35:23.387 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 26' 2024-09-16T03:35:23.401 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.k35hXx5I0L' 2024-09-16T03:35:23.403 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 26 2024-09-16T03:35:23.404 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.k35hXx5I0L 2024-09-16T03:35:23.404 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:23.404 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:23.404 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:23.404 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 27 2024-09-16T03:35:23.404 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=27 2024-09-16T03:35:23.404 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:23.404 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:23.405 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.cvDdaLRNNw 2024-09-16T03:35:23.405 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 27 -o /tmp/tmp.cvDdaLRNNw 2024-09-16T03:35:23.836 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 27 2024-09-16T03:35:23.852 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.cvDdaLRNNw 2024-09-16T03:35:23.852 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 27' 2024-09-16T03:35:23.873 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.cvDdaLRNNw' 2024-09-16T03:35:23.875 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 27 2024-09-16T03:35:23.875 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.cvDdaLRNNw 2024-09-16T03:35:23.876 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:23.876 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:23.876 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:23.876 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 28 2024-09-16T03:35:23.876 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=28 2024-09-16T03:35:23.877 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:23.877 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:23.877 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.DVn7pkz5Fj 2024-09-16T03:35:23.877 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 28 -o /tmp/tmp.DVn7pkz5Fj 2024-09-16T03:35:24.270 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 28 2024-09-16T03:35:24.285 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.DVn7pkz5Fj 2024-09-16T03:35:24.285 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 28' 2024-09-16T03:35:24.305 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.DVn7pkz5Fj' 2024-09-16T03:35:24.306 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 28 2024-09-16T03:35:24.307 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.DVn7pkz5Fj 2024-09-16T03:35:24.308 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:24.308 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:24.308 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:24.308 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 29 2024-09-16T03:35:24.308 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=29 2024-09-16T03:35:24.308 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:24.308 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:24.309 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.WQOZU2r0gz 2024-09-16T03:35:24.309 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 29 -o /tmp/tmp.WQOZU2r0gz 2024-09-16T03:35:24.720 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 29 2024-09-16T03:35:24.736 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.WQOZU2r0gz 2024-09-16T03:35:24.736 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 29' 2024-09-16T03:35:24.756 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.WQOZU2r0gz' 2024-09-16T03:35:24.757 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 29 2024-09-16T03:35:24.758 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.WQOZU2r0gz 2024-09-16T03:35:24.759 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:24.759 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:24.759 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:24.759 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 30 2024-09-16T03:35:24.759 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=30 2024-09-16T03:35:24.759 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:24.759 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:24.760 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.wKCcixuc5z 2024-09-16T03:35:24.760 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 30 -o /tmp/tmp.wKCcixuc5z 2024-09-16T03:35:25.217 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 30 2024-09-16T03:35:25.234 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.wKCcixuc5z 2024-09-16T03:35:25.234 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 30' 2024-09-16T03:35:25.254 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.wKCcixuc5z' 2024-09-16T03:35:25.255 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 30 2024-09-16T03:35:25.256 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.wKCcixuc5z 2024-09-16T03:35:25.257 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:25.257 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:25.257 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:25.257 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 31 2024-09-16T03:35:25.257 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=31 2024-09-16T03:35:25.257 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:25.257 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:25.258 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.bS0iUkERbC 2024-09-16T03:35:25.258 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 31 -o /tmp/tmp.bS0iUkERbC 2024-09-16T03:35:25.647 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 31 2024-09-16T03:35:25.663 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 31' 2024-09-16T03:35:25.663 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.bS0iUkERbC 2024-09-16T03:35:25.682 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.bS0iUkERbC' 2024-09-16T03:35:25.684 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 31 2024-09-16T03:35:25.684 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.bS0iUkERbC 2024-09-16T03:35:25.685 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:25.685 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:25.685 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:25.685 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 32 2024-09-16T03:35:25.686 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=32 2024-09-16T03:35:25.686 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:25.686 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:25.687 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.Ofs8eWsmnl 2024-09-16T03:35:25.687 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 32 -o /tmp/tmp.Ofs8eWsmnl 2024-09-16T03:35:26.203 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 32 2024-09-16T03:35:26.222 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.Ofs8eWsmnl 2024-09-16T03:35:26.222 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 32' 2024-09-16T03:35:26.241 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.Ofs8eWsmnl' 2024-09-16T03:35:26.243 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 32 2024-09-16T03:35:26.243 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.Ofs8eWsmnl 2024-09-16T03:35:26.244 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:26.244 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:26.244 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:26.244 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 33 2024-09-16T03:35:26.244 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=33 2024-09-16T03:35:26.245 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:26.245 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:26.245 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.6iPnwkvFph 2024-09-16T03:35:26.245 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 33 -o /tmp/tmp.6iPnwkvFph 2024-09-16T03:35:26.644 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 33 2024-09-16T03:35:26.658 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.6iPnwkvFph 2024-09-16T03:35:26.659 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 33' 2024-09-16T03:35:26.678 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.6iPnwkvFph' 2024-09-16T03:35:26.679 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 33 2024-09-16T03:35:26.679 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.6iPnwkvFph 2024-09-16T03:35:26.681 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:26.681 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:26.681 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:26.681 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 34 2024-09-16T03:35:26.681 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=34 2024-09-16T03:35:26.681 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:26.681 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:26.682 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.a3BsoWLWw9 2024-09-16T03:35:26.682 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 34 -o /tmp/tmp.a3BsoWLWw9 2024-09-16T03:35:27.123 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 34 2024-09-16T03:35:27.138 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 34' 2024-09-16T03:35:27.139 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.a3BsoWLWw9 2024-09-16T03:35:27.158 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.a3BsoWLWw9' 2024-09-16T03:35:27.160 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 34 2024-09-16T03:35:27.160 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.a3BsoWLWw9 2024-09-16T03:35:27.161 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:27.161 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:27.161 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:27.161 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 35 2024-09-16T03:35:27.161 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=35 2024-09-16T03:35:27.161 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:27.162 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:27.162 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.zXsHrHw7RB 2024-09-16T03:35:27.162 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 35 -o /tmp/tmp.zXsHrHw7RB 2024-09-16T03:35:27.590 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 35 2024-09-16T03:35:27.607 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.zXsHrHw7RB 2024-09-16T03:35:27.607 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 35' 2024-09-16T03:35:27.627 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.zXsHrHw7RB' 2024-09-16T03:35:27.628 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 35 2024-09-16T03:35:27.629 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.zXsHrHw7RB 2024-09-16T03:35:27.630 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:27.631 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:27.631 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:27.631 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 36 2024-09-16T03:35:27.631 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=36 2024-09-16T03:35:27.631 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:27.631 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:27.631 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.kxpO99sJKq 2024-09-16T03:35:27.632 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 36 -o /tmp/tmp.kxpO99sJKq 2024-09-16T03:35:28.075 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 36 2024-09-16T03:35:28.091 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.kxpO99sJKq 2024-09-16T03:35:28.091 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 36' 2024-09-16T03:35:28.111 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.kxpO99sJKq' 2024-09-16T03:35:28.112 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 36 2024-09-16T03:35:28.112 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.kxpO99sJKq 2024-09-16T03:35:28.113 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:28.113 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:28.114 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:28.114 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 37 2024-09-16T03:35:28.114 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=37 2024-09-16T03:35:28.114 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:28.114 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:28.115 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.em4tNrE07p 2024-09-16T03:35:28.115 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 37 -o /tmp/tmp.em4tNrE07p 2024-09-16T03:35:28.517 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 37 2024-09-16T03:35:28.533 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.em4tNrE07p 2024-09-16T03:35:28.533 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 37' 2024-09-16T03:35:28.552 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.em4tNrE07p' 2024-09-16T03:35:28.554 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 37 2024-09-16T03:35:28.554 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.em4tNrE07p 2024-09-16T03:35:28.555 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:28.556 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:28.556 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:28.556 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 38 2024-09-16T03:35:28.556 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=38 2024-09-16T03:35:28.556 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:28.556 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:28.557 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.QXybafgDRV 2024-09-16T03:35:28.557 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 38 -o /tmp/tmp.QXybafgDRV 2024-09-16T03:35:28.995 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 38 2024-09-16T03:35:29.012 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 38' 2024-09-16T03:35:29.012 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.QXybafgDRV 2024-09-16T03:35:29.033 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.QXybafgDRV' 2024-09-16T03:35:29.035 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 38 2024-09-16T03:35:29.035 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.QXybafgDRV 2024-09-16T03:35:29.036 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:29.036 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:29.036 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:29.037 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 39 2024-09-16T03:35:29.037 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=39 2024-09-16T03:35:29.037 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:29.037 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:29.037 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.9rRBSgKsa2 2024-09-16T03:35:29.037 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 39 -o /tmp/tmp.9rRBSgKsa2 2024-09-16T03:35:29.487 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 39 2024-09-16T03:35:29.503 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.9rRBSgKsa2 2024-09-16T03:35:29.504 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 39' 2024-09-16T03:35:29.523 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.9rRBSgKsa2' 2024-09-16T03:35:29.524 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 39 2024-09-16T03:35:29.525 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.9rRBSgKsa2 2024-09-16T03:35:29.526 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:29.526 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:29.526 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:29.526 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 40 2024-09-16T03:35:29.526 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=40 2024-09-16T03:35:29.526 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:29.526 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:29.527 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.Xb5g8IPkmJ 2024-09-16T03:35:29.527 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 40 -o /tmp/tmp.Xb5g8IPkmJ 2024-09-16T03:35:29.965 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 40 2024-09-16T03:35:29.982 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.Xb5g8IPkmJ 2024-09-16T03:35:29.982 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 40' 2024-09-16T03:35:30.002 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.Xb5g8IPkmJ' 2024-09-16T03:35:30.003 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 40 2024-09-16T03:35:30.004 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.Xb5g8IPkmJ 2024-09-16T03:35:30.005 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:30.005 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:30.005 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:30.005 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 41 2024-09-16T03:35:30.005 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=41 2024-09-16T03:35:30.005 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:30.005 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:30.006 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.YZ37jEO5ff 2024-09-16T03:35:30.006 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 41 -o /tmp/tmp.YZ37jEO5ff 2024-09-16T03:35:30.403 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 41 2024-09-16T03:35:30.419 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.YZ37jEO5ff 2024-09-16T03:35:30.419 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 41' 2024-09-16T03:35:30.439 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.YZ37jEO5ff' 2024-09-16T03:35:30.440 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 41 2024-09-16T03:35:30.440 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.YZ37jEO5ff 2024-09-16T03:35:30.442 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:30.442 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:30.442 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:30.442 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 42 2024-09-16T03:35:30.442 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=42 2024-09-16T03:35:30.442 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:30.442 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:30.443 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.EfXhUwP6cS 2024-09-16T03:35:30.443 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 42 -o /tmp/tmp.EfXhUwP6cS 2024-09-16T03:35:30.842 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 42 2024-09-16T03:35:30.858 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.EfXhUwP6cS 2024-09-16T03:35:30.858 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 42' 2024-09-16T03:35:30.878 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.EfXhUwP6cS' 2024-09-16T03:35:30.880 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 42 2024-09-16T03:35:30.882 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.EfXhUwP6cS 2024-09-16T03:35:30.882 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:30.882 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:30.882 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:30.882 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 43 2024-09-16T03:35:30.882 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=43 2024-09-16T03:35:30.882 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:30.882 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:30.882 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.oDVZANafwG 2024-09-16T03:35:30.882 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 43 -o /tmp/tmp.oDVZANafwG 2024-09-16T03:35:31.305 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 43 2024-09-16T03:35:31.322 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.oDVZANafwG 2024-09-16T03:35:31.323 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 43' 2024-09-16T03:35:31.342 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.oDVZANafwG' 2024-09-16T03:35:31.344 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 43 2024-09-16T03:35:31.344 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.oDVZANafwG 2024-09-16T03:35:31.345 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:31.345 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:31.346 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:31.346 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 44 2024-09-16T03:35:31.346 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=44 2024-09-16T03:35:31.346 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:31.346 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:31.347 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.fnbjloUT9A 2024-09-16T03:35:31.347 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 44 -o /tmp/tmp.fnbjloUT9A 2024-09-16T03:35:31.729 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 44 2024-09-16T03:35:31.745 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 44' 2024-09-16T03:35:31.745 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.fnbjloUT9A 2024-09-16T03:35:31.765 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.fnbjloUT9A' 2024-09-16T03:35:31.767 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 44 2024-09-16T03:35:31.767 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.fnbjloUT9A 2024-09-16T03:35:31.768 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:31.768 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:31.768 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:31.768 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 45 2024-09-16T03:35:31.769 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=45 2024-09-16T03:35:31.769 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:31.769 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:31.769 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.QlbwCYgD7W 2024-09-16T03:35:31.769 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 45 -o /tmp/tmp.QlbwCYgD7W 2024-09-16T03:35:32.205 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 45 2024-09-16T03:35:32.221 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.QlbwCYgD7W 2024-09-16T03:35:32.221 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 45' 2024-09-16T03:35:32.241 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.QlbwCYgD7W' 2024-09-16T03:35:32.242 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 45 2024-09-16T03:35:32.242 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.QlbwCYgD7W 2024-09-16T03:35:32.244 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:32.244 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:32.244 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:32.244 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 46 2024-09-16T03:35:32.244 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=46 2024-09-16T03:35:32.244 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:32.244 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:32.245 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.jtVdexCTTX 2024-09-16T03:35:32.245 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 46 -o /tmp/tmp.jtVdexCTTX 2024-09-16T03:35:32.661 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 46 2024-09-16T03:35:32.677 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 46' 2024-09-16T03:35:32.677 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.jtVdexCTTX 2024-09-16T03:35:32.697 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.jtVdexCTTX' 2024-09-16T03:35:32.699 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 46 2024-09-16T03:35:32.699 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.jtVdexCTTX 2024-09-16T03:35:32.700 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:32.700 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:32.700 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:32.700 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 47 2024-09-16T03:35:32.700 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=47 2024-09-16T03:35:32.700 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:32.701 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:32.701 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.r4BbzJyUsR 2024-09-16T03:35:32.701 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 47 -o /tmp/tmp.r4BbzJyUsR 2024-09-16T03:35:33.144 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 47 2024-09-16T03:35:33.160 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.r4BbzJyUsR 2024-09-16T03:35:33.160 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 47' 2024-09-16T03:35:33.181 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.r4BbzJyUsR' 2024-09-16T03:35:33.182 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 47 2024-09-16T03:35:33.182 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.r4BbzJyUsR 2024-09-16T03:35:33.184 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:33.184 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:33.184 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:33.184 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 48 2024-09-16T03:35:33.184 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=48 2024-09-16T03:35:33.184 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:33.184 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:33.185 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.IuPzqQOswg 2024-09-16T03:35:33.185 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 48 -o /tmp/tmp.IuPzqQOswg 2024-09-16T03:35:33.650 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 48 2024-09-16T03:35:33.667 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.IuPzqQOswg 2024-09-16T03:35:33.667 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 48' 2024-09-16T03:35:33.687 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.IuPzqQOswg' 2024-09-16T03:35:33.689 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 48 2024-09-16T03:35:33.689 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.IuPzqQOswg 2024-09-16T03:35:33.690 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:33.691 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:33.691 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:33.691 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 49 2024-09-16T03:35:33.691 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=49 2024-09-16T03:35:33.691 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:33.691 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:33.691 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.V9VSCbzq8z 2024-09-16T03:35:33.691 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 49 -o /tmp/tmp.V9VSCbzq8z 2024-09-16T03:35:34.126 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 49 2024-09-16T03:35:34.144 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.V9VSCbzq8z 2024-09-16T03:35:34.144 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 49' 2024-09-16T03:35:34.164 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.V9VSCbzq8z' 2024-09-16T03:35:34.166 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 49 2024-09-16T03:35:34.167 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.V9VSCbzq8z 2024-09-16T03:35:34.167 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:34.167 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:34.167 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:34.167 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 50 2024-09-16T03:35:34.167 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=50 2024-09-16T03:35:34.167 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:34.167 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:34.168 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.W7B4KA027x 2024-09-16T03:35:34.168 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 50 -o /tmp/tmp.W7B4KA027x 2024-09-16T03:35:34.635 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 50 2024-09-16T03:35:34.655 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.W7B4KA027x 2024-09-16T03:35:34.655 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 50' 2024-09-16T03:35:34.675 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.W7B4KA027x' 2024-09-16T03:35:34.676 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 50 2024-09-16T03:35:34.677 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.W7B4KA027x 2024-09-16T03:35:34.678 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:34.678 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:34.678 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:34.679 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 51 2024-09-16T03:35:34.679 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=51 2024-09-16T03:35:34.679 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:34.679 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:34.679 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.tYh4zXojA6 2024-09-16T03:35:34.679 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 51 -o /tmp/tmp.tYh4zXojA6 2024-09-16T03:35:35.132 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 51 2024-09-16T03:35:35.149 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.tYh4zXojA6 2024-09-16T03:35:35.150 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 51' 2024-09-16T03:35:35.169 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.tYh4zXojA6' 2024-09-16T03:35:35.171 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 51 2024-09-16T03:35:35.171 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.tYh4zXojA6 2024-09-16T03:35:35.172 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:35.172 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:35.172 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:35.173 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 52 2024-09-16T03:35:35.173 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=52 2024-09-16T03:35:35.173 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:35.173 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:35.173 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.S4rxjHEnzr 2024-09-16T03:35:35.173 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 52 -o /tmp/tmp.S4rxjHEnzr 2024-09-16T03:35:35.633 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 52 2024-09-16T03:35:35.651 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.S4rxjHEnzr 2024-09-16T03:35:35.652 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 52' 2024-09-16T03:35:35.671 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.S4rxjHEnzr' 2024-09-16T03:35:35.673 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 52 2024-09-16T03:35:35.673 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.S4rxjHEnzr 2024-09-16T03:35:35.674 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:35.674 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:35.675 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:35.675 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 53 2024-09-16T03:35:35.675 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=53 2024-09-16T03:35:35.675 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:35.675 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:35.676 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.BEdYzVgmpG 2024-09-16T03:35:35.676 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 53 -o /tmp/tmp.BEdYzVgmpG 2024-09-16T03:35:36.080 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 53 2024-09-16T03:35:36.096 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.BEdYzVgmpG 2024-09-16T03:35:36.096 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 53' 2024-09-16T03:35:36.115 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.BEdYzVgmpG' 2024-09-16T03:35:36.117 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 53 2024-09-16T03:35:36.117 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.BEdYzVgmpG 2024-09-16T03:35:36.118 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:36.118 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:36.119 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:36.119 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 54 2024-09-16T03:35:36.119 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=54 2024-09-16T03:35:36.119 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:36.119 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:36.119 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.fdGqkA1ahi 2024-09-16T03:35:36.119 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 54 -o /tmp/tmp.fdGqkA1ahi 2024-09-16T03:35:36.531 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 54 2024-09-16T03:35:36.549 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.fdGqkA1ahi 2024-09-16T03:35:36.549 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 54' 2024-09-16T03:35:36.571 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.fdGqkA1ahi' 2024-09-16T03:35:36.573 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 54 2024-09-16T03:35:36.573 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.fdGqkA1ahi 2024-09-16T03:35:36.574 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:36.574 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:36.574 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:36.575 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 55 2024-09-16T03:35:36.575 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=55 2024-09-16T03:35:36.575 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:36.575 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:36.575 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.yOxH0rN33I 2024-09-16T03:35:36.575 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 55 -o /tmp/tmp.yOxH0rN33I 2024-09-16T03:35:36.997 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 55 2024-09-16T03:35:37.013 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.yOxH0rN33I 2024-09-16T03:35:37.013 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 55' 2024-09-16T03:35:37.033 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.yOxH0rN33I' 2024-09-16T03:35:37.034 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 55 2024-09-16T03:35:37.035 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.yOxH0rN33I 2024-09-16T03:35:37.036 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:37.036 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:37.036 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:37.036 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 56 2024-09-16T03:35:37.036 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=56 2024-09-16T03:35:37.036 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:37.036 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:37.037 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.T4H7kfSbWe 2024-09-16T03:35:37.037 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 56 -o /tmp/tmp.T4H7kfSbWe 2024-09-16T03:35:37.418 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 56 2024-09-16T03:35:37.434 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.T4H7kfSbWe 2024-09-16T03:35:37.434 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 56' 2024-09-16T03:35:37.454 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.T4H7kfSbWe' 2024-09-16T03:35:37.455 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 56 2024-09-16T03:35:37.456 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.T4H7kfSbWe 2024-09-16T03:35:37.457 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:37.457 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:37.457 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:37.457 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 57 2024-09-16T03:35:37.457 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=57 2024-09-16T03:35:37.457 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:37.457 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:37.458 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.B02mnsrdWQ 2024-09-16T03:35:37.458 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 57 -o /tmp/tmp.B02mnsrdWQ 2024-09-16T03:35:37.909 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 57 2024-09-16T03:35:37.924 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.B02mnsrdWQ 2024-09-16T03:35:37.925 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 57' 2024-09-16T03:35:37.945 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.B02mnsrdWQ' 2024-09-16T03:35:37.946 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 57 2024-09-16T03:35:37.947 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.B02mnsrdWQ 2024-09-16T03:35:37.948 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:37.948 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:37.948 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:37.948 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 58 2024-09-16T03:35:37.948 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=58 2024-09-16T03:35:37.949 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:37.949 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:37.949 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.BigQOxR5BB 2024-09-16T03:35:37.949 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 58 -o /tmp/tmp.BigQOxR5BB 2024-09-16T03:35:38.368 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 58 2024-09-16T03:35:38.385 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.BigQOxR5BB 2024-09-16T03:35:38.385 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 58' 2024-09-16T03:35:38.401 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.BigQOxR5BB' 2024-09-16T03:35:38.402 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 58 2024-09-16T03:35:38.402 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.BigQOxR5BB 2024-09-16T03:35:38.403 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:38.404 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:38.404 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:38.404 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 59 2024-09-16T03:35:38.404 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=59 2024-09-16T03:35:38.404 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:38.404 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:38.404 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.cQZyszjAet 2024-09-16T03:35:38.404 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 59 -o /tmp/tmp.cQZyszjAet 2024-09-16T03:35:38.831 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 59 2024-09-16T03:35:38.847 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.cQZyszjAet 2024-09-16T03:35:38.847 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 59' 2024-09-16T03:35:38.867 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.cQZyszjAet' 2024-09-16T03:35:38.868 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 59 2024-09-16T03:35:38.869 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.cQZyszjAet 2024-09-16T03:35:38.870 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:38.870 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:38.870 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:38.870 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 60 2024-09-16T03:35:38.870 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=60 2024-09-16T03:35:38.870 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:38.871 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:38.871 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.HtFfhmYgAY 2024-09-16T03:35:38.871 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 60 -o /tmp/tmp.HtFfhmYgAY 2024-09-16T03:35:39.306 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 60 2024-09-16T03:35:39.323 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.HtFfhmYgAY 2024-09-16T03:35:39.323 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 60' 2024-09-16T03:35:39.343 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.HtFfhmYgAY' 2024-09-16T03:35:39.344 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 60 2024-09-16T03:35:39.345 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.HtFfhmYgAY 2024-09-16T03:35:39.347 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:39.347 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:39.347 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:39.347 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 61 2024-09-16T03:35:39.347 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=61 2024-09-16T03:35:39.347 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:39.347 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:39.347 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.irGAHA2fZ8 2024-09-16T03:35:39.347 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 61 -o /tmp/tmp.irGAHA2fZ8 2024-09-16T03:35:39.804 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 61 2024-09-16T03:35:39.823 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.irGAHA2fZ8 2024-09-16T03:35:39.823 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 61' 2024-09-16T03:35:39.842 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.irGAHA2fZ8' 2024-09-16T03:35:39.843 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 61 2024-09-16T03:35:39.844 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.irGAHA2fZ8 2024-09-16T03:35:39.845 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:39.845 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:39.845 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:39.845 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 62 2024-09-16T03:35:39.845 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=62 2024-09-16T03:35:39.845 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:39.845 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:39.846 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.Pjz3JvTR3i 2024-09-16T03:35:39.846 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 62 -o /tmp/tmp.Pjz3JvTR3i 2024-09-16T03:35:40.280 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 62 2024-09-16T03:35:40.297 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.Pjz3JvTR3i 2024-09-16T03:35:40.297 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 62' 2024-09-16T03:35:40.317 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.Pjz3JvTR3i' 2024-09-16T03:35:40.319 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 62 2024-09-16T03:35:40.319 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.Pjz3JvTR3i 2024-09-16T03:35:40.320 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:40.321 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:40.321 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:40.321 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 63 2024-09-16T03:35:40.321 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=63 2024-09-16T03:35:40.321 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:40.322 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:40.322 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.LtewaDFskb 2024-09-16T03:35:40.322 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 63 -o /tmp/tmp.LtewaDFskb 2024-09-16T03:35:40.757 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 63 2024-09-16T03:35:40.773 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.LtewaDFskb 2024-09-16T03:35:40.773 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 63' 2024-09-16T03:35:40.793 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.LtewaDFskb' 2024-09-16T03:35:40.795 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 63 2024-09-16T03:35:40.795 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.LtewaDFskb 2024-09-16T03:35:40.796 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:40.796 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:40.796 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:40.796 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 64 2024-09-16T03:35:40.797 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=64 2024-09-16T03:35:40.797 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:40.803 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:40.804 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.wy9CNjdICM 2024-09-16T03:35:40.804 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 64 -o /tmp/tmp.wy9CNjdICM 2024-09-16T03:35:41.250 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 64 2024-09-16T03:35:41.268 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.wy9CNjdICM 2024-09-16T03:35:41.268 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 64' 2024-09-16T03:35:41.288 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.wy9CNjdICM' 2024-09-16T03:35:41.290 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 64 2024-09-16T03:35:41.290 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.wy9CNjdICM 2024-09-16T03:35:41.291 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:41.292 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:41.292 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:41.292 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 65 2024-09-16T03:35:41.292 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=65 2024-09-16T03:35:41.292 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:41.292 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:41.292 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.KaFAOToWpn 2024-09-16T03:35:41.292 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 65 -o /tmp/tmp.KaFAOToWpn 2024-09-16T03:35:41.700 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 65 2024-09-16T03:35:41.716 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.KaFAOToWpn 2024-09-16T03:35:41.716 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 65' 2024-09-16T03:35:41.736 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.KaFAOToWpn' 2024-09-16T03:35:41.737 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 65 2024-09-16T03:35:41.738 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.KaFAOToWpn 2024-09-16T03:35:41.739 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:41.739 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:41.739 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:41.739 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 66 2024-09-16T03:35:41.739 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=66 2024-09-16T03:35:41.739 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:41.739 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:41.740 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.cq1CZawdBL 2024-09-16T03:35:41.740 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 66 -o /tmp/tmp.cq1CZawdBL 2024-09-16T03:35:42.178 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 66 2024-09-16T03:35:42.195 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.cq1CZawdBL 2024-09-16T03:35:42.195 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 66' 2024-09-16T03:35:42.214 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.cq1CZawdBL' 2024-09-16T03:35:42.216 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 66 2024-09-16T03:35:42.216 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.cq1CZawdBL 2024-09-16T03:35:42.217 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:42.217 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:42.217 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:42.217 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 67 2024-09-16T03:35:42.217 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=67 2024-09-16T03:35:42.218 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:42.218 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:42.218 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.FL2J3Zjdrz 2024-09-16T03:35:42.218 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 67 -o /tmp/tmp.FL2J3Zjdrz 2024-09-16T03:35:42.693 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 67 2024-09-16T03:35:42.710 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.FL2J3Zjdrz 2024-09-16T03:35:42.711 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 67' 2024-09-16T03:35:42.730 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.FL2J3Zjdrz' 2024-09-16T03:35:42.732 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 67 2024-09-16T03:35:42.732 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.FL2J3Zjdrz 2024-09-16T03:35:42.733 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:42.733 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:42.733 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:42.734 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 68 2024-09-16T03:35:42.734 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=68 2024-09-16T03:35:42.734 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:42.734 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:42.735 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.2aONpc7313 2024-09-16T03:35:42.735 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 68 -o /tmp/tmp.2aONpc7313 2024-09-16T03:35:43.190 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 68 2024-09-16T03:35:43.209 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.2aONpc7313 2024-09-16T03:35:43.209 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 68' 2024-09-16T03:35:43.229 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.2aONpc7313' 2024-09-16T03:35:43.235 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 68 2024-09-16T03:35:43.236 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.2aONpc7313 2024-09-16T03:35:43.236 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:43.236 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:43.236 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:43.236 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 69 2024-09-16T03:35:43.236 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=69 2024-09-16T03:35:43.236 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:43.236 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:43.236 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.flsCmTd1SY 2024-09-16T03:35:43.236 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 69 -o /tmp/tmp.flsCmTd1SY 2024-09-16T03:35:43.633 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 69 2024-09-16T03:35:43.649 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.flsCmTd1SY 2024-09-16T03:35:43.649 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 69' 2024-09-16T03:35:43.668 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.flsCmTd1SY' 2024-09-16T03:35:43.669 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 69 2024-09-16T03:35:43.670 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.flsCmTd1SY 2024-09-16T03:35:43.672 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:43.672 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:43.672 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:43.672 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 70 2024-09-16T03:35:43.672 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=70 2024-09-16T03:35:43.672 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:43.672 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:43.673 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.uxWkVgRhMO 2024-09-16T03:35:43.673 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 70 -o /tmp/tmp.uxWkVgRhMO 2024-09-16T03:35:44.060 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 70 2024-09-16T03:35:44.077 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.uxWkVgRhMO 2024-09-16T03:35:44.077 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 70' 2024-09-16T03:35:44.097 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.uxWkVgRhMO' 2024-09-16T03:35:44.098 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 70 2024-09-16T03:35:44.100 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.uxWkVgRhMO 2024-09-16T03:35:44.100 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:44.100 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:44.101 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:44.101 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 71 2024-09-16T03:35:44.101 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=71 2024-09-16T03:35:44.101 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:44.102 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:44.102 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.YsvJtLH4Y7 2024-09-16T03:35:44.102 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 71 -o /tmp/tmp.YsvJtLH4Y7 2024-09-16T03:35:44.500 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 71 2024-09-16T03:35:44.516 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.YsvJtLH4Y7 2024-09-16T03:35:44.516 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 71' 2024-09-16T03:35:44.537 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.YsvJtLH4Y7' 2024-09-16T03:35:44.539 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 71 2024-09-16T03:35:44.539 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.YsvJtLH4Y7 2024-09-16T03:35:44.540 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:44.541 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:44.541 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:44.543 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 72 2024-09-16T03:35:44.543 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=72 2024-09-16T03:35:44.543 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:44.544 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:44.544 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.w7eO3jX5In 2024-09-16T03:35:44.544 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 72 -o /tmp/tmp.w7eO3jX5In 2024-09-16T03:35:44.979 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 72 2024-09-16T03:35:44.995 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.w7eO3jX5In 2024-09-16T03:35:44.996 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 72' 2024-09-16T03:35:45.015 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.w7eO3jX5In' 2024-09-16T03:35:45.016 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 72 2024-09-16T03:35:45.017 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.w7eO3jX5In 2024-09-16T03:35:45.018 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:45.018 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:45.018 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:45.018 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 73 2024-09-16T03:35:45.019 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=73 2024-09-16T03:35:45.019 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:45.019 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:45.019 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.DnedoURa6Z 2024-09-16T03:35:45.019 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 73 -o /tmp/tmp.DnedoURa6Z 2024-09-16T03:35:45.480 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 73 2024-09-16T03:35:45.497 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.DnedoURa6Z 2024-09-16T03:35:45.497 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 73' 2024-09-16T03:35:45.517 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.DnedoURa6Z' 2024-09-16T03:35:45.519 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 73 2024-09-16T03:35:45.519 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.DnedoURa6Z 2024-09-16T03:35:45.520 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:45.520 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:45.520 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:45.520 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 74 2024-09-16T03:35:45.521 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=74 2024-09-16T03:35:45.521 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:45.521 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:45.522 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.3w0Rb7Pn5C 2024-09-16T03:35:45.522 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 74 -o /tmp/tmp.3w0Rb7Pn5C 2024-09-16T03:35:45.915 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 74 2024-09-16T03:35:45.930 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.3w0Rb7Pn5C 2024-09-16T03:35:45.931 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 74' 2024-09-16T03:35:45.950 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.3w0Rb7Pn5C' 2024-09-16T03:35:45.951 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 74 2024-09-16T03:35:45.951 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.3w0Rb7Pn5C 2024-09-16T03:35:45.952 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:45.952 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:45.953 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:45.953 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 75 2024-09-16T03:35:45.953 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=75 2024-09-16T03:35:45.953 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:45.953 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:45.953 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.PCpx9iWSRb 2024-09-16T03:35:45.953 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 75 -o /tmp/tmp.PCpx9iWSRb 2024-09-16T03:35:46.334 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 75 2024-09-16T03:35:46.350 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.PCpx9iWSRb 2024-09-16T03:35:46.350 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 75' 2024-09-16T03:35:46.369 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.PCpx9iWSRb' 2024-09-16T03:35:46.371 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 75 2024-09-16T03:35:46.371 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.PCpx9iWSRb 2024-09-16T03:35:46.372 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:46.372 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:46.372 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:46.372 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 76 2024-09-16T03:35:46.372 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=76 2024-09-16T03:35:46.372 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:46.373 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:46.374 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.9W0VBAyRbB 2024-09-16T03:35:46.374 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 76 -o /tmp/tmp.9W0VBAyRbB 2024-09-16T03:35:46.763 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 76 2024-09-16T03:35:46.779 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.9W0VBAyRbB 2024-09-16T03:35:46.779 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 76' 2024-09-16T03:35:46.798 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.9W0VBAyRbB' 2024-09-16T03:35:46.800 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 76 2024-09-16T03:35:46.800 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.9W0VBAyRbB 2024-09-16T03:35:46.801 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:46.801 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:46.802 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:46.802 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 77 2024-09-16T03:35:46.802 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=77 2024-09-16T03:35:46.802 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:46.802 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:46.803 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.RZqaTmb4XD 2024-09-16T03:35:46.803 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 77 -o /tmp/tmp.RZqaTmb4XD 2024-09-16T03:35:47.261 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 77 2024-09-16T03:35:47.277 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.RZqaTmb4XD 2024-09-16T03:35:47.277 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 77' 2024-09-16T03:35:47.296 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.RZqaTmb4XD' 2024-09-16T03:35:47.298 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 77 2024-09-16T03:35:47.298 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.RZqaTmb4XD 2024-09-16T03:35:47.299 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:47.299 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:47.300 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:47.300 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 78 2024-09-16T03:35:47.300 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=78 2024-09-16T03:35:47.300 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:47.300 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:47.300 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.h9hpon2jr4 2024-09-16T03:35:47.300 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 78 -o /tmp/tmp.h9hpon2jr4 2024-09-16T03:35:47.697 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 78 2024-09-16T03:35:47.713 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.h9hpon2jr4 2024-09-16T03:35:47.713 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 78' 2024-09-16T03:35:47.732 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.h9hpon2jr4' 2024-09-16T03:35:47.734 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 78 2024-09-16T03:35:47.734 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.h9hpon2jr4 2024-09-16T03:35:47.736 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:47.736 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:47.737 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:47.737 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 79 2024-09-16T03:35:47.737 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=79 2024-09-16T03:35:47.737 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:47.737 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:47.737 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.L6Pr8DPBth 2024-09-16T03:35:47.737 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 79 -o /tmp/tmp.L6Pr8DPBth 2024-09-16T03:35:48.149 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 79 2024-09-16T03:35:48.165 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.L6Pr8DPBth 2024-09-16T03:35:48.165 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 79' 2024-09-16T03:35:48.184 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.L6Pr8DPBth' 2024-09-16T03:35:48.186 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 79 2024-09-16T03:35:48.186 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.L6Pr8DPBth 2024-09-16T03:35:48.187 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:48.187 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:48.187 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:48.187 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 80 2024-09-16T03:35:48.188 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=80 2024-09-16T03:35:48.188 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:48.188 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:48.188 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.60I6nyGG0s 2024-09-16T03:35:48.188 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 80 -o /tmp/tmp.60I6nyGG0s 2024-09-16T03:35:48.579 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 80 2024-09-16T03:35:48.595 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.60I6nyGG0s 2024-09-16T03:35:48.596 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 80' 2024-09-16T03:35:48.615 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.60I6nyGG0s' 2024-09-16T03:35:48.616 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 80 2024-09-16T03:35:48.616 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.60I6nyGG0s 2024-09-16T03:35:48.617 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:48.618 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:48.618 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:48.618 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 81 2024-09-16T03:35:48.618 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=81 2024-09-16T03:35:48.618 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:48.618 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:48.619 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.hNlfFkG5Gc 2024-09-16T03:35:48.620 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 81 -o /tmp/tmp.hNlfFkG5Gc 2024-09-16T03:35:49.046 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 81 2024-09-16T03:35:49.061 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.hNlfFkG5Gc 2024-09-16T03:35:49.062 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 81' 2024-09-16T03:35:49.081 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.hNlfFkG5Gc' 2024-09-16T03:35:49.083 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 81 2024-09-16T03:35:49.083 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.hNlfFkG5Gc 2024-09-16T03:35:49.084 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:49.084 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:49.084 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:49.084 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 82 2024-09-16T03:35:49.084 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=82 2024-09-16T03:35:49.084 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:49.084 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:49.085 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.xJWZxxAlNH 2024-09-16T03:35:49.085 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 82 -o /tmp/tmp.xJWZxxAlNH 2024-09-16T03:35:49.475 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 82 2024-09-16T03:35:49.491 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.xJWZxxAlNH 2024-09-16T03:35:49.491 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 82' 2024-09-16T03:35:49.511 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.xJWZxxAlNH' 2024-09-16T03:35:49.512 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 82 2024-09-16T03:35:49.512 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.xJWZxxAlNH 2024-09-16T03:35:49.513 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:49.514 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:49.514 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:49.514 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 83 2024-09-16T03:35:49.514 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=83 2024-09-16T03:35:49.514 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:49.514 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:49.515 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.sIPJiRiPe9 2024-09-16T03:35:49.515 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 83 -o /tmp/tmp.sIPJiRiPe9 2024-09-16T03:35:49.929 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 83 2024-09-16T03:35:49.946 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.sIPJiRiPe9 2024-09-16T03:35:49.947 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 83' 2024-09-16T03:35:49.966 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.sIPJiRiPe9' 2024-09-16T03:35:49.968 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 83 2024-09-16T03:35:49.968 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.sIPJiRiPe9 2024-09-16T03:35:49.969 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:49.969 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:49.969 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:49.969 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 84 2024-09-16T03:35:49.969 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=84 2024-09-16T03:35:49.969 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:49.970 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:49.971 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.GzKHvdgU0c 2024-09-16T03:35:49.971 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 84 -o /tmp/tmp.GzKHvdgU0c 2024-09-16T03:35:50.422 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 84 2024-09-16T03:35:50.440 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.GzKHvdgU0c 2024-09-16T03:35:50.441 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 84' 2024-09-16T03:35:50.462 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.GzKHvdgU0c' 2024-09-16T03:35:50.463 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 84 2024-09-16T03:35:50.463 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.GzKHvdgU0c 2024-09-16T03:35:50.464 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:50.465 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:50.465 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:50.465 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 85 2024-09-16T03:35:50.465 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=85 2024-09-16T03:35:50.465 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:50.465 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:50.467 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.i9Bh1HQdis 2024-09-16T03:35:50.467 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 85 -o /tmp/tmp.i9Bh1HQdis 2024-09-16T03:35:50.882 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 85 2024-09-16T03:35:50.898 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.i9Bh1HQdis 2024-09-16T03:35:50.899 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 85' 2024-09-16T03:35:50.918 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.i9Bh1HQdis' 2024-09-16T03:35:50.919 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 85 2024-09-16T03:35:50.919 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.i9Bh1HQdis 2024-09-16T03:35:50.921 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:50.921 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:50.921 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:50.921 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 86 2024-09-16T03:35:50.921 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=86 2024-09-16T03:35:50.921 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:50.921 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:50.922 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.dxIV03ntiw 2024-09-16T03:35:50.922 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 86 -o /tmp/tmp.dxIV03ntiw 2024-09-16T03:35:51.345 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 86 2024-09-16T03:35:51.363 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.dxIV03ntiw 2024-09-16T03:35:51.363 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 86' 2024-09-16T03:35:51.383 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.dxIV03ntiw' 2024-09-16T03:35:51.384 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 86 2024-09-16T03:35:51.385 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.dxIV03ntiw 2024-09-16T03:35:51.386 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:51.386 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:51.386 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:51.386 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 87 2024-09-16T03:35:51.386 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=87 2024-09-16T03:35:51.386 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:51.386 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:51.388 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.HOwElXfzif 2024-09-16T03:35:51.388 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 87 -o /tmp/tmp.HOwElXfzif 2024-09-16T03:35:51.826 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 87 2024-09-16T03:35:51.842 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.HOwElXfzif 2024-09-16T03:35:51.843 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 87' 2024-09-16T03:35:51.862 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.HOwElXfzif' 2024-09-16T03:35:51.863 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 87 2024-09-16T03:35:51.863 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.HOwElXfzif 2024-09-16T03:35:51.865 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:51.865 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:51.865 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:51.865 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 88 2024-09-16T03:35:51.865 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=88 2024-09-16T03:35:51.865 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:51.865 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:51.867 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.3dOOvohvMc 2024-09-16T03:35:51.867 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 88 -o /tmp/tmp.3dOOvohvMc 2024-09-16T03:35:52.303 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 88 2024-09-16T03:35:52.326 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 88' 2024-09-16T03:35:52.326 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.3dOOvohvMc 2024-09-16T03:35:52.342 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.3dOOvohvMc' 2024-09-16T03:35:52.343 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 88 2024-09-16T03:35:52.344 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.3dOOvohvMc 2024-09-16T03:35:52.345 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:52.345 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:52.345 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:52.345 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 89 2024-09-16T03:35:52.345 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=89 2024-09-16T03:35:52.345 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:52.345 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:52.346 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.ECrnwePC2c 2024-09-16T03:35:52.346 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 89 -o /tmp/tmp.ECrnwePC2c 2024-09-16T03:35:52.769 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 89 2024-09-16T03:35:52.787 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.ECrnwePC2c 2024-09-16T03:35:52.787 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 89' 2024-09-16T03:35:52.807 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.ECrnwePC2c' 2024-09-16T03:35:52.814 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 89 2024-09-16T03:35:52.815 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.ECrnwePC2c 2024-09-16T03:35:52.816 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:52.816 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:52.816 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:52.816 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 90 2024-09-16T03:35:52.816 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=90 2024-09-16T03:35:52.816 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:52.816 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:52.816 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.wg0gj3PfZk 2024-09-16T03:35:52.816 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 90 -o /tmp/tmp.wg0gj3PfZk 2024-09-16T03:35:53.216 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 90 2024-09-16T03:35:53.233 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.wg0gj3PfZk 2024-09-16T03:35:53.233 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 90' 2024-09-16T03:35:53.254 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.wg0gj3PfZk' 2024-09-16T03:35:53.255 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 90 2024-09-16T03:35:53.255 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.wg0gj3PfZk 2024-09-16T03:35:53.256 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:53.257 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:53.257 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:53.257 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 91 2024-09-16T03:35:53.257 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=91 2024-09-16T03:35:53.257 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:53.257 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:53.257 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.rudFGqV57G 2024-09-16T03:35:53.257 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 91 -o /tmp/tmp.rudFGqV57G 2024-09-16T03:35:53.718 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 91 2024-09-16T03:35:53.734 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.rudFGqV57G 2024-09-16T03:35:53.734 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 91' 2024-09-16T03:35:53.751 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.rudFGqV57G' 2024-09-16T03:35:53.752 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 91 2024-09-16T03:35:53.753 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.rudFGqV57G 2024-09-16T03:35:53.754 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:53.754 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:53.754 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:53.754 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 92 2024-09-16T03:35:53.754 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=92 2024-09-16T03:35:53.754 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:53.755 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:53.755 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.pyLaPSMHDP 2024-09-16T03:35:53.755 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 92 -o /tmp/tmp.pyLaPSMHDP 2024-09-16T03:35:54.136 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 92 2024-09-16T03:35:54.151 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.pyLaPSMHDP 2024-09-16T03:35:54.152 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 92' 2024-09-16T03:35:54.171 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.pyLaPSMHDP' 2024-09-16T03:35:54.172 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 92 2024-09-16T03:35:54.173 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.pyLaPSMHDP 2024-09-16T03:35:54.174 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:54.174 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:54.174 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:54.174 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 93 2024-09-16T03:35:54.174 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=93 2024-09-16T03:35:54.174 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:54.174 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:54.175 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.Tl7WfmlghV 2024-09-16T03:35:54.175 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 93 -o /tmp/tmp.Tl7WfmlghV 2024-09-16T03:35:54.699 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 93 2024-09-16T03:35:54.718 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.Tl7WfmlghV 2024-09-16T03:35:54.718 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 93' 2024-09-16T03:35:54.739 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.Tl7WfmlghV' 2024-09-16T03:35:54.741 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 93 2024-09-16T03:35:54.741 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.Tl7WfmlghV 2024-09-16T03:35:54.742 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:54.743 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:54.743 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:54.743 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 94 2024-09-16T03:35:54.743 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=94 2024-09-16T03:35:54.743 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:54.743 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:54.743 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.SE9IfvUccN 2024-09-16T03:35:54.743 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 94 -o /tmp/tmp.SE9IfvUccN 2024-09-16T03:35:55.193 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 94 2024-09-16T03:35:55.210 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.SE9IfvUccN 2024-09-16T03:35:55.210 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 94' 2024-09-16T03:35:55.231 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.SE9IfvUccN' 2024-09-16T03:35:55.232 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 94 2024-09-16T03:35:55.232 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.SE9IfvUccN 2024-09-16T03:35:55.233 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:55.233 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:55.233 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:55.234 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 95 2024-09-16T03:35:55.234 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=95 2024-09-16T03:35:55.234 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:55.234 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:55.234 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.3jIXSaKhd9 2024-09-16T03:35:55.234 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 95 -o /tmp/tmp.3jIXSaKhd9 2024-09-16T03:35:55.681 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 95 2024-09-16T03:35:55.698 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.3jIXSaKhd9 2024-09-16T03:35:55.698 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 95' 2024-09-16T03:35:55.717 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.3jIXSaKhd9' 2024-09-16T03:35:55.719 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 95 2024-09-16T03:35:55.719 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.3jIXSaKhd9 2024-09-16T03:35:55.720 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:55.720 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:55.720 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:55.720 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 96 2024-09-16T03:35:55.720 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=96 2024-09-16T03:35:55.721 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:55.721 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:55.721 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.s2H0y7oyyB 2024-09-16T03:35:55.721 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 96 -o /tmp/tmp.s2H0y7oyyB 2024-09-16T03:35:56.191 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 96 2024-09-16T03:35:56.210 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.s2H0y7oyyB 2024-09-16T03:35:56.210 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 96' 2024-09-16T03:35:56.230 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.s2H0y7oyyB' 2024-09-16T03:35:56.232 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 96 2024-09-16T03:35:56.232 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.s2H0y7oyyB 2024-09-16T03:35:56.233 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:56.233 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:56.233 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:56.234 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 97 2024-09-16T03:35:56.234 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=97 2024-09-16T03:35:56.234 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:56.234 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:56.234 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.8JyIqyw7XN 2024-09-16T03:35:56.234 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 97 -o /tmp/tmp.8JyIqyw7XN 2024-09-16T03:35:56.672 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 97 2024-09-16T03:35:56.689 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.8JyIqyw7XN 2024-09-16T03:35:56.689 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 97' 2024-09-16T03:35:56.708 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.8JyIqyw7XN' 2024-09-16T03:35:56.710 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 97 2024-09-16T03:35:56.710 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.8JyIqyw7XN 2024-09-16T03:35:56.711 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:56.711 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:56.711 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:56.711 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 98 2024-09-16T03:35:56.712 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=98 2024-09-16T03:35:56.712 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:56.712 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:56.712 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.PGOIvwHCTj 2024-09-16T03:35:56.712 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 98 -o /tmp/tmp.PGOIvwHCTj 2024-09-16T03:35:57.194 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 98 2024-09-16T03:35:57.212 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 98' 2024-09-16T03:35:57.213 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.PGOIvwHCTj 2024-09-16T03:35:57.230 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.PGOIvwHCTj' 2024-09-16T03:35:57.231 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 98 2024-09-16T03:35:57.231 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.PGOIvwHCTj 2024-09-16T03:35:57.232 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:57.232 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:57.232 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:57.233 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 99 2024-09-16T03:35:57.233 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=99 2024-09-16T03:35:57.233 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:57.233 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:57.233 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.rAKE6lyfSS 2024-09-16T03:35:57.233 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 99 -o /tmp/tmp.rAKE6lyfSS 2024-09-16T03:35:57.696 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 99 2024-09-16T03:35:57.714 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 99' 2024-09-16T03:35:57.714 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.rAKE6lyfSS 2024-09-16T03:35:57.734 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.rAKE6lyfSS' 2024-09-16T03:35:57.736 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 99 2024-09-16T03:35:57.736 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.rAKE6lyfSS 2024-09-16T03:35:57.737 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:57.738 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:57.738 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:57.738 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 100 2024-09-16T03:35:57.738 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=100 2024-09-16T03:35:57.738 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:57.738 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:57.738 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.WwlD0nIsYN 2024-09-16T03:35:57.738 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 100 -o /tmp/tmp.WwlD0nIsYN 2024-09-16T03:35:58.214 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 100 2024-09-16T03:35:58.232 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.WwlD0nIsYN 2024-09-16T03:35:58.232 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 100' 2024-09-16T03:35:58.252 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.WwlD0nIsYN' 2024-09-16T03:35:58.254 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 100 2024-09-16T03:35:58.254 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.WwlD0nIsYN 2024-09-16T03:35:58.255 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:58.255 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:58.255 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:58.255 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 101 2024-09-16T03:35:58.255 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=101 2024-09-16T03:35:58.255 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:58.255 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:58.256 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.e1UPttRvIV 2024-09-16T03:35:58.256 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 101 -o /tmp/tmp.e1UPttRvIV 2024-09-16T03:35:58.670 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 101 2024-09-16T03:35:58.686 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.e1UPttRvIV 2024-09-16T03:35:58.687 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 101' 2024-09-16T03:35:58.706 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.e1UPttRvIV' 2024-09-16T03:35:58.707 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 101 2024-09-16T03:35:58.707 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.e1UPttRvIV 2024-09-16T03:35:58.708 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:58.709 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:58.709 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:58.709 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 102 2024-09-16T03:35:58.709 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=102 2024-09-16T03:35:58.709 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:58.709 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:58.710 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.OVwheMiPQV 2024-09-16T03:35:58.710 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 102 -o /tmp/tmp.OVwheMiPQV 2024-09-16T03:35:59.209 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 102 2024-09-16T03:35:59.227 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.OVwheMiPQV 2024-09-16T03:35:59.228 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 102' 2024-09-16T03:35:59.248 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.OVwheMiPQV' 2024-09-16T03:35:59.249 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 102 2024-09-16T03:35:59.249 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.OVwheMiPQV 2024-09-16T03:35:59.251 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:59.251 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:59.251 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:59.251 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 103 2024-09-16T03:35:59.251 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=103 2024-09-16T03:35:59.251 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:59.251 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:59.251 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.gM3fKqAS2e 2024-09-16T03:35:59.252 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 103 -o /tmp/tmp.gM3fKqAS2e 2024-09-16T03:35:59.695 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 103 2024-09-16T03:35:59.712 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.gM3fKqAS2e 2024-09-16T03:35:59.712 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 103' 2024-09-16T03:35:59.732 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.gM3fKqAS2e' 2024-09-16T03:35:59.734 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 103 2024-09-16T03:35:59.734 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.gM3fKqAS2e 2024-09-16T03:35:59.735 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:35:59.736 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:35:59.736 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:35:59.736 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 104 2024-09-16T03:35:59.736 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=104 2024-09-16T03:35:59.736 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:35:59.736 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:35:59.736 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.r5SShMhcc4 2024-09-16T03:35:59.740 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 104 -o /tmp/tmp.r5SShMhcc4 2024-09-16T03:36:00.187 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 104 2024-09-16T03:36:00.206 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.r5SShMhcc4 2024-09-16T03:36:00.206 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 104' 2024-09-16T03:36:00.224 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.r5SShMhcc4' 2024-09-16T03:36:00.225 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 104 2024-09-16T03:36:00.226 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.r5SShMhcc4 2024-09-16T03:36:00.227 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:00.227 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:00.227 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:00.228 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 105 2024-09-16T03:36:00.228 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=105 2024-09-16T03:36:00.228 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:00.228 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:00.228 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.OAoRgZ55U5 2024-09-16T03:36:00.228 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 105 -o /tmp/tmp.OAoRgZ55U5 2024-09-16T03:36:00.651 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 105 2024-09-16T03:36:00.668 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.OAoRgZ55U5 2024-09-16T03:36:00.668 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 105' 2024-09-16T03:36:00.688 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.OAoRgZ55U5' 2024-09-16T03:36:00.689 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 105 2024-09-16T03:36:00.689 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.OAoRgZ55U5 2024-09-16T03:36:00.690 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:00.691 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:00.691 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:00.691 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 106 2024-09-16T03:36:00.691 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=106 2024-09-16T03:36:00.691 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:00.691 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:00.691 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.UMhSU1jD83 2024-09-16T03:36:00.691 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 106 -o /tmp/tmp.UMhSU1jD83 2024-09-16T03:36:01.128 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 106 2024-09-16T03:36:01.144 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.UMhSU1jD83 2024-09-16T03:36:01.144 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 106' 2024-09-16T03:36:01.163 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.UMhSU1jD83' 2024-09-16T03:36:01.164 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 106 2024-09-16T03:36:01.165 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.UMhSU1jD83 2024-09-16T03:36:01.166 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:01.166 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:01.166 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:01.166 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 107 2024-09-16T03:36:01.166 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=107 2024-09-16T03:36:01.166 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:01.166 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:01.167 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.oROutoFO7t 2024-09-16T03:36:01.167 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 107 -o /tmp/tmp.oROutoFO7t 2024-09-16T03:36:01.676 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 107 2024-09-16T03:36:01.695 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.oROutoFO7t 2024-09-16T03:36:01.695 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 107' 2024-09-16T03:36:01.715 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.oROutoFO7t' 2024-09-16T03:36:01.716 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 107 2024-09-16T03:36:01.716 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.oROutoFO7t 2024-09-16T03:36:01.722 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:01.722 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:01.722 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:01.722 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 108 2024-09-16T03:36:01.722 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=108 2024-09-16T03:36:01.722 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:01.722 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:01.722 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.6nq6AbbzyD 2024-09-16T03:36:01.722 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 108 -o /tmp/tmp.6nq6AbbzyD 2024-09-16T03:36:02.144 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 108 2024-09-16T03:36:02.161 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.6nq6AbbzyD 2024-09-16T03:36:02.161 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 108' 2024-09-16T03:36:02.181 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.6nq6AbbzyD' 2024-09-16T03:36:02.182 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 108 2024-09-16T03:36:02.183 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.6nq6AbbzyD 2024-09-16T03:36:02.184 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:02.184 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:02.184 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:02.184 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 109 2024-09-16T03:36:02.184 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=109 2024-09-16T03:36:02.184 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:02.184 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:02.185 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.4gY4EmfQFX 2024-09-16T03:36:02.185 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 109 -o /tmp/tmp.4gY4EmfQFX 2024-09-16T03:36:02.659 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 109 2024-09-16T03:36:02.676 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.4gY4EmfQFX 2024-09-16T03:36:02.676 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 109' 2024-09-16T03:36:02.696 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.4gY4EmfQFX' 2024-09-16T03:36:02.697 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 109 2024-09-16T03:36:02.698 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.4gY4EmfQFX 2024-09-16T03:36:02.699 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:02.699 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:02.699 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:02.699 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 110 2024-09-16T03:36:02.699 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=110 2024-09-16T03:36:02.699 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:02.699 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:02.700 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.eWItyo3uiT 2024-09-16T03:36:02.700 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 110 -o /tmp/tmp.eWItyo3uiT 2024-09-16T03:36:03.091 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 110 2024-09-16T03:36:03.108 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.eWItyo3uiT 2024-09-16T03:36:03.108 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 110' 2024-09-16T03:36:03.127 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.eWItyo3uiT' 2024-09-16T03:36:03.128 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 110 2024-09-16T03:36:03.129 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.eWItyo3uiT 2024-09-16T03:36:03.130 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:03.130 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:03.130 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:03.130 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 111 2024-09-16T03:36:03.131 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=111 2024-09-16T03:36:03.131 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:03.131 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:03.131 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.dBPZHVMH9u 2024-09-16T03:36:03.131 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 111 -o /tmp/tmp.dBPZHVMH9u 2024-09-16T03:36:03.539 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 111 2024-09-16T03:36:03.555 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.dBPZHVMH9u 2024-09-16T03:36:03.555 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 111' 2024-09-16T03:36:03.575 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.dBPZHVMH9u' 2024-09-16T03:36:03.576 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 111 2024-09-16T03:36:03.577 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.dBPZHVMH9u 2024-09-16T03:36:03.578 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:03.578 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:03.578 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:03.578 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 112 2024-09-16T03:36:03.579 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=112 2024-09-16T03:36:03.579 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:03.579 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:03.580 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.CgvTKeRcE6 2024-09-16T03:36:03.580 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 112 -o /tmp/tmp.CgvTKeRcE6 2024-09-16T03:36:03.976 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 112 2024-09-16T03:36:03.991 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 112' 2024-09-16T03:36:03.991 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.CgvTKeRcE6 2024-09-16T03:36:04.011 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.CgvTKeRcE6' 2024-09-16T03:36:04.012 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 112 2024-09-16T03:36:04.012 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.CgvTKeRcE6 2024-09-16T03:36:04.014 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:04.014 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:04.014 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:04.014 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 113 2024-09-16T03:36:04.014 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=113 2024-09-16T03:36:04.014 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:04.014 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:04.014 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.l9upK0fLTn 2024-09-16T03:36:04.015 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 113 -o /tmp/tmp.l9upK0fLTn 2024-09-16T03:36:04.443 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 113 2024-09-16T03:36:04.461 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.l9upK0fLTn 2024-09-16T03:36:04.461 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 113' 2024-09-16T03:36:04.481 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.l9upK0fLTn' 2024-09-16T03:36:04.483 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 113 2024-09-16T03:36:04.483 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.l9upK0fLTn 2024-09-16T03:36:04.484 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:04.484 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:04.484 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:04.484 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 114 2024-09-16T03:36:04.485 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=114 2024-09-16T03:36:04.485 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:04.485 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:04.485 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.WJ4Uszn4c6 2024-09-16T03:36:04.485 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 114 -o /tmp/tmp.WJ4Uszn4c6 2024-09-16T03:36:04.887 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 114 2024-09-16T03:36:04.903 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.WJ4Uszn4c6 2024-09-16T03:36:04.903 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 114' 2024-09-16T03:36:04.922 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.WJ4Uszn4c6' 2024-09-16T03:36:04.923 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 114 2024-09-16T03:36:04.923 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.WJ4Uszn4c6 2024-09-16T03:36:04.926 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:04.926 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:04.926 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:04.926 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 115 2024-09-16T03:36:04.926 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=115 2024-09-16T03:36:04.926 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:04.926 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:04.926 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.CurvYSeolG 2024-09-16T03:36:04.926 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 115 -o /tmp/tmp.CurvYSeolG 2024-09-16T03:36:05.335 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 115 2024-09-16T03:36:05.354 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.CurvYSeolG 2024-09-16T03:36:05.354 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 115' 2024-09-16T03:36:05.374 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.CurvYSeolG' 2024-09-16T03:36:05.375 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 115 2024-09-16T03:36:05.375 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.CurvYSeolG 2024-09-16T03:36:05.387 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:05.387 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:05.387 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:05.387 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 116 2024-09-16T03:36:05.387 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=116 2024-09-16T03:36:05.387 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:05.387 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:05.388 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.hfezNXW4Ww 2024-09-16T03:36:05.388 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 116 -o /tmp/tmp.hfezNXW4Ww 2024-09-16T03:36:05.793 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 116 2024-09-16T03:36:05.809 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.hfezNXW4Ww 2024-09-16T03:36:05.809 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 116' 2024-09-16T03:36:05.830 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.hfezNXW4Ww' 2024-09-16T03:36:05.831 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 116 2024-09-16T03:36:05.831 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.hfezNXW4Ww 2024-09-16T03:36:05.833 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:05.833 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:05.833 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:05.833 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 117 2024-09-16T03:36:05.833 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=117 2024-09-16T03:36:05.833 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:05.833 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:05.833 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.3fdqZ4Buo1 2024-09-16T03:36:05.833 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 117 -o /tmp/tmp.3fdqZ4Buo1 2024-09-16T03:36:06.237 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 117 2024-09-16T03:36:06.253 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.3fdqZ4Buo1 2024-09-16T03:36:06.253 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 117' 2024-09-16T03:36:06.273 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.3fdqZ4Buo1' 2024-09-16T03:36:06.274 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 117 2024-09-16T03:36:06.274 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.3fdqZ4Buo1 2024-09-16T03:36:06.276 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:06.276 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:06.276 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:06.276 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 118 2024-09-16T03:36:06.276 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=118 2024-09-16T03:36:06.276 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:06.276 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:06.276 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.agcEy6Ps0l 2024-09-16T03:36:06.276 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 118 -o /tmp/tmp.agcEy6Ps0l 2024-09-16T03:36:06.667 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 118 2024-09-16T03:36:06.683 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.agcEy6Ps0l 2024-09-16T03:36:06.684 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 118' 2024-09-16T03:36:06.699 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.agcEy6Ps0l' 2024-09-16T03:36:06.700 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 118 2024-09-16T03:36:06.700 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.agcEy6Ps0l 2024-09-16T03:36:06.701 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:06.701 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:06.701 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:06.701 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 119 2024-09-16T03:36:06.701 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=119 2024-09-16T03:36:06.702 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:06.702 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:06.702 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.23v1ncm80u 2024-09-16T03:36:06.702 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 119 -o /tmp/tmp.23v1ncm80u 2024-09-16T03:36:07.178 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 119 2024-09-16T03:36:07.195 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.23v1ncm80u 2024-09-16T03:36:07.195 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 119' 2024-09-16T03:36:07.214 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.23v1ncm80u' 2024-09-16T03:36:07.215 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 119 2024-09-16T03:36:07.216 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.23v1ncm80u 2024-09-16T03:36:07.217 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:07.218 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:07.218 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:07.218 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 120 2024-09-16T03:36:07.218 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=120 2024-09-16T03:36:07.218 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:07.218 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:07.219 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.qK5mCqvEOd 2024-09-16T03:36:07.219 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 120 -o /tmp/tmp.qK5mCqvEOd 2024-09-16T03:36:07.680 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 120 2024-09-16T03:36:07.697 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.qK5mCqvEOd 2024-09-16T03:36:07.698 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 120' 2024-09-16T03:36:07.718 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.qK5mCqvEOd' 2024-09-16T03:36:07.719 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 120 2024-09-16T03:36:07.719 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.qK5mCqvEOd 2024-09-16T03:36:07.720 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:07.720 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:07.720 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:07.720 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 121 2024-09-16T03:36:07.720 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=121 2024-09-16T03:36:07.721 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:07.721 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:07.721 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.y0tlo1X7JY 2024-09-16T03:36:07.721 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 121 -o /tmp/tmp.y0tlo1X7JY 2024-09-16T03:36:08.110 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 121 2024-09-16T03:36:08.126 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 121' 2024-09-16T03:36:08.126 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.y0tlo1X7JY 2024-09-16T03:36:08.147 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.y0tlo1X7JY' 2024-09-16T03:36:08.148 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 121 2024-09-16T03:36:08.149 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.y0tlo1X7JY 2024-09-16T03:36:08.150 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:08.150 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:08.150 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:08.150 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 122 2024-09-16T03:36:08.150 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=122 2024-09-16T03:36:08.150 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:08.150 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:08.151 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.5UAjWkjDlp 2024-09-16T03:36:08.151 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 122 -o /tmp/tmp.5UAjWkjDlp 2024-09-16T03:36:08.542 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 122 2024-09-16T03:36:08.558 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.5UAjWkjDlp 2024-09-16T03:36:08.558 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 122' 2024-09-16T03:36:08.578 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.5UAjWkjDlp' 2024-09-16T03:36:08.580 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 122 2024-09-16T03:36:08.580 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.5UAjWkjDlp 2024-09-16T03:36:08.582 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:08.582 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:08.582 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:08.582 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 123 2024-09-16T03:36:08.582 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=123 2024-09-16T03:36:08.582 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:08.582 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:08.583 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.XpOrrhFzm8 2024-09-16T03:36:08.583 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 123 -o /tmp/tmp.XpOrrhFzm8 2024-09-16T03:36:08.998 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 123 2024-09-16T03:36:09.013 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.XpOrrhFzm8 2024-09-16T03:36:09.014 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 123' 2024-09-16T03:36:09.033 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.XpOrrhFzm8' 2024-09-16T03:36:09.034 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 123 2024-09-16T03:36:09.035 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.XpOrrhFzm8 2024-09-16T03:36:09.036 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:09.036 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:09.036 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:09.036 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 124 2024-09-16T03:36:09.036 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=124 2024-09-16T03:36:09.036 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:09.036 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:09.037 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.M6SpoYTqTs 2024-09-16T03:36:09.037 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 124 -o /tmp/tmp.M6SpoYTqTs 2024-09-16T03:36:09.485 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 124 2024-09-16T03:36:09.502 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.M6SpoYTqTs 2024-09-16T03:36:09.503 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 124' 2024-09-16T03:36:09.522 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.M6SpoYTqTs' 2024-09-16T03:36:09.524 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 124 2024-09-16T03:36:09.524 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.M6SpoYTqTs 2024-09-16T03:36:09.525 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:09.525 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:09.525 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:09.525 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 125 2024-09-16T03:36:09.525 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=125 2024-09-16T03:36:09.526 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:09.526 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:09.526 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.KcNJglTO6f 2024-09-16T03:36:09.526 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 125 -o /tmp/tmp.KcNJglTO6f 2024-09-16T03:36:09.931 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 125 2024-09-16T03:36:09.948 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.KcNJglTO6f 2024-09-16T03:36:09.948 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 125' 2024-09-16T03:36:09.967 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.KcNJglTO6f' 2024-09-16T03:36:09.968 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 125 2024-09-16T03:36:09.969 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.KcNJglTO6f 2024-09-16T03:36:09.970 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:09.970 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:09.971 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:09.971 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 126 2024-09-16T03:36:09.971 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=126 2024-09-16T03:36:09.971 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:09.971 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:09.971 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.MQA4d8py21 2024-09-16T03:36:09.972 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 126 -o /tmp/tmp.MQA4d8py21 2024-09-16T03:36:10.398 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 126 2024-09-16T03:36:10.426 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.MQA4d8py21 2024-09-16T03:36:10.426 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 126' 2024-09-16T03:36:10.433 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.MQA4d8py21' 2024-09-16T03:36:10.435 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 126 2024-09-16T03:36:10.435 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.MQA4d8py21 2024-09-16T03:36:10.436 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:10.437 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:10.437 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:10.437 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 127 2024-09-16T03:36:10.437 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=127 2024-09-16T03:36:10.437 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:10.437 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:10.438 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.DuWQ9v43Td 2024-09-16T03:36:10.438 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 127 -o /tmp/tmp.DuWQ9v43Td 2024-09-16T03:36:10.889 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 127 2024-09-16T03:36:10.905 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.DuWQ9v43Td 2024-09-16T03:36:10.906 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 127' 2024-09-16T03:36:10.926 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.DuWQ9v43Td' 2024-09-16T03:36:10.927 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 127 2024-09-16T03:36:10.927 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.DuWQ9v43Td 2024-09-16T03:36:10.929 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:10.929 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:10.929 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:10.929 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 128 2024-09-16T03:36:10.929 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=128 2024-09-16T03:36:10.929 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:10.929 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:10.930 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.G6VilcisVB 2024-09-16T03:36:10.930 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 128 -o /tmp/tmp.G6VilcisVB 2024-09-16T03:36:11.456 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 128 2024-09-16T03:36:11.470 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.G6VilcisVB 2024-09-16T03:36:11.471 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 128' 2024-09-16T03:36:11.491 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.G6VilcisVB' 2024-09-16T03:36:11.492 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 128 2024-09-16T03:36:11.492 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.G6VilcisVB 2024-09-16T03:36:11.494 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:11.494 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:11.494 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:11.494 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 129 2024-09-16T03:36:11.494 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=129 2024-09-16T03:36:11.494 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:11.494 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:11.495 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.KOmF1HYVQG 2024-09-16T03:36:11.495 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 129 -o /tmp/tmp.KOmF1HYVQG 2024-09-16T03:36:11.904 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 129 2024-09-16T03:36:11.920 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.KOmF1HYVQG 2024-09-16T03:36:11.920 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 129' 2024-09-16T03:36:11.934 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.KOmF1HYVQG' 2024-09-16T03:36:11.935 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 129 2024-09-16T03:36:11.936 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.KOmF1HYVQG 2024-09-16T03:36:11.938 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:11.938 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:11.938 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:11.938 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 130 2024-09-16T03:36:11.938 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=130 2024-09-16T03:36:11.938 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:11.938 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:11.938 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.7ytRxSnTZ3 2024-09-16T03:36:11.939 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 130 -o /tmp/tmp.7ytRxSnTZ3 2024-09-16T03:36:12.345 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 130 2024-09-16T03:36:12.362 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.7ytRxSnTZ3 2024-09-16T03:36:12.362 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 130' 2024-09-16T03:36:12.382 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.7ytRxSnTZ3' 2024-09-16T03:36:12.384 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 130 2024-09-16T03:36:12.384 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.7ytRxSnTZ3 2024-09-16T03:36:12.386 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:12.386 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:12.386 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:12.386 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 131 2024-09-16T03:36:12.386 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=131 2024-09-16T03:36:12.386 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:12.386 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:12.387 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.LslJg0gLsw 2024-09-16T03:36:12.387 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 131 -o /tmp/tmp.LslJg0gLsw 2024-09-16T03:36:12.794 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 131 2024-09-16T03:36:12.810 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 131' 2024-09-16T03:36:12.810 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.LslJg0gLsw 2024-09-16T03:36:12.830 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.LslJg0gLsw' 2024-09-16T03:36:12.832 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 131 2024-09-16T03:36:12.832 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.LslJg0gLsw 2024-09-16T03:36:12.833 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:12.833 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:12.833 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:12.833 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 132 2024-09-16T03:36:12.833 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=132 2024-09-16T03:36:12.834 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:12.834 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:12.834 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.11jDuuGvB1 2024-09-16T03:36:12.834 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 132 -o /tmp/tmp.11jDuuGvB1 2024-09-16T03:36:13.350 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 132 2024-09-16T03:36:13.369 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.11jDuuGvB1 2024-09-16T03:36:13.369 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 132' 2024-09-16T03:36:13.393 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.11jDuuGvB1' 2024-09-16T03:36:13.394 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 132 2024-09-16T03:36:13.395 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.11jDuuGvB1 2024-09-16T03:36:13.395 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:13.396 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:13.396 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:13.396 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 133 2024-09-16T03:36:13.396 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=133 2024-09-16T03:36:13.396 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:13.396 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:13.397 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.lXAUrDAuJZ 2024-09-16T03:36:13.397 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 133 -o /tmp/tmp.lXAUrDAuJZ 2024-09-16T03:36:13.794 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 133 2024-09-16T03:36:13.812 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.lXAUrDAuJZ 2024-09-16T03:36:13.812 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 133' 2024-09-16T03:36:13.831 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.lXAUrDAuJZ' 2024-09-16T03:36:13.832 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 133 2024-09-16T03:36:13.833 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.lXAUrDAuJZ 2024-09-16T03:36:13.834 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:13.834 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:13.834 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:13.834 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 134 2024-09-16T03:36:13.834 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=134 2024-09-16T03:36:13.834 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:13.834 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:13.835 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.Eled89IW7r 2024-09-16T03:36:13.835 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 134 -o /tmp/tmp.Eled89IW7r 2024-09-16T03:36:14.334 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 134 2024-09-16T03:36:14.352 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.Eled89IW7r 2024-09-16T03:36:14.352 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 134' 2024-09-16T03:36:14.372 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.Eled89IW7r' 2024-09-16T03:36:14.373 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 134 2024-09-16T03:36:14.374 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.Eled89IW7r 2024-09-16T03:36:14.375 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:14.375 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:14.375 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:14.375 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 135 2024-09-16T03:36:14.375 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=135 2024-09-16T03:36:14.375 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:14.375 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:14.376 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.LCd9InWiRM 2024-09-16T03:36:14.376 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 135 -o /tmp/tmp.LCd9InWiRM 2024-09-16T03:36:14.812 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 135 2024-09-16T03:36:14.828 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.LCd9InWiRM 2024-09-16T03:36:14.828 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 135' 2024-09-16T03:36:14.848 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.LCd9InWiRM' 2024-09-16T03:36:14.850 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 135 2024-09-16T03:36:14.850 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.LCd9InWiRM 2024-09-16T03:36:14.851 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:14.851 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:14.852 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:14.852 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 136 2024-09-16T03:36:14.852 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=136 2024-09-16T03:36:14.852 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:14.852 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:14.852 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.b1R1mishXT 2024-09-16T03:36:14.852 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 136 -o /tmp/tmp.b1R1mishXT 2024-09-16T03:36:15.288 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 136 2024-09-16T03:36:15.305 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.b1R1mishXT 2024-09-16T03:36:15.305 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 136' 2024-09-16T03:36:15.325 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.b1R1mishXT' 2024-09-16T03:36:15.327 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 136 2024-09-16T03:36:15.327 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.b1R1mishXT 2024-09-16T03:36:15.328 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:15.328 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:15.329 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:15.329 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 137 2024-09-16T03:36:15.329 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=137 2024-09-16T03:36:15.329 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:15.329 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:15.330 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.OYHba689m3 2024-09-16T03:36:15.331 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 137 -o /tmp/tmp.OYHba689m3 2024-09-16T03:36:15.771 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 137 2024-09-16T03:36:15.789 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.OYHba689m3 2024-09-16T03:36:15.790 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 137' 2024-09-16T03:36:15.809 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.OYHba689m3' 2024-09-16T03:36:15.810 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 137 2024-09-16T03:36:15.810 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.OYHba689m3 2024-09-16T03:36:15.811 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:15.812 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:15.812 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:15.812 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 138 2024-09-16T03:36:15.812 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=138 2024-09-16T03:36:15.812 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:15.812 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:15.812 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.tz4rWrcwpj 2024-09-16T03:36:15.812 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 138 -o /tmp/tmp.tz4rWrcwpj 2024-09-16T03:36:16.274 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 138 2024-09-16T03:36:16.291 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.tz4rWrcwpj 2024-09-16T03:36:16.291 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 138' 2024-09-16T03:36:16.310 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.tz4rWrcwpj' 2024-09-16T03:36:16.312 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 138 2024-09-16T03:36:16.312 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.tz4rWrcwpj 2024-09-16T03:36:16.314 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:16.314 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:16.314 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:16.314 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 139 2024-09-16T03:36:16.314 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=139 2024-09-16T03:36:16.314 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:16.314 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:16.315 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.ynHtXgNvWj 2024-09-16T03:36:16.315 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 139 -o /tmp/tmp.ynHtXgNvWj 2024-09-16T03:36:16.767 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 139 2024-09-16T03:36:16.785 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.ynHtXgNvWj 2024-09-16T03:36:16.785 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 139' 2024-09-16T03:36:16.805 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.ynHtXgNvWj' 2024-09-16T03:36:16.806 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 139 2024-09-16T03:36:16.806 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.ynHtXgNvWj 2024-09-16T03:36:16.808 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:16.808 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:16.808 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:16.808 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 140 2024-09-16T03:36:16.808 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=140 2024-09-16T03:36:16.808 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:16.808 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:16.808 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.g28OmBZ6Y7 2024-09-16T03:36:16.809 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 140 -o /tmp/tmp.g28OmBZ6Y7 2024-09-16T03:36:17.261 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 140 2024-09-16T03:36:17.278 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.g28OmBZ6Y7 2024-09-16T03:36:17.279 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 140' 2024-09-16T03:36:17.298 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.g28OmBZ6Y7' 2024-09-16T03:36:17.301 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 140 2024-09-16T03:36:17.301 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.g28OmBZ6Y7 2024-09-16T03:36:17.302 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:17.302 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:17.302 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:17.302 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 141 2024-09-16T03:36:17.302 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=141 2024-09-16T03:36:17.302 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:17.302 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:17.302 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.tfHuEdkEBd 2024-09-16T03:36:17.302 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 141 -o /tmp/tmp.tfHuEdkEBd 2024-09-16T03:36:17.746 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 141 2024-09-16T03:36:17.762 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.tfHuEdkEBd 2024-09-16T03:36:17.762 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 141' 2024-09-16T03:36:17.782 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.tfHuEdkEBd' 2024-09-16T03:36:17.783 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 141 2024-09-16T03:36:17.783 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.tfHuEdkEBd 2024-09-16T03:36:17.785 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:17.785 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:17.785 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:17.785 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 142 2024-09-16T03:36:17.785 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=142 2024-09-16T03:36:17.785 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:17.785 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:17.785 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.Xj37pioLrx 2024-09-16T03:36:17.786 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 142 -o /tmp/tmp.Xj37pioLrx 2024-09-16T03:36:18.188 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 142 2024-09-16T03:36:18.204 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.Xj37pioLrx 2024-09-16T03:36:18.204 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 142' 2024-09-16T03:36:18.225 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.Xj37pioLrx' 2024-09-16T03:36:18.227 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 142 2024-09-16T03:36:18.227 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.Xj37pioLrx 2024-09-16T03:36:18.228 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:18.228 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:18.228 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:18.228 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 143 2024-09-16T03:36:18.229 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=143 2024-09-16T03:36:18.229 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:18.229 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:18.230 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.uSuGwnbbTD 2024-09-16T03:36:18.230 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 143 -o /tmp/tmp.uSuGwnbbTD 2024-09-16T03:36:18.625 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 143 2024-09-16T03:36:18.642 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.uSuGwnbbTD 2024-09-16T03:36:18.642 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 143' 2024-09-16T03:36:18.657 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.uSuGwnbbTD' 2024-09-16T03:36:18.658 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 143 2024-09-16T03:36:18.658 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.uSuGwnbbTD 2024-09-16T03:36:18.660 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:18.660 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:18.660 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:18.660 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 144 2024-09-16T03:36:18.660 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=144 2024-09-16T03:36:18.660 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:18.660 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:18.661 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.AMFDfuNXbi 2024-09-16T03:36:18.661 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 144 -o /tmp/tmp.AMFDfuNXbi 2024-09-16T03:36:19.103 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 144 2024-09-16T03:36:19.121 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.AMFDfuNXbi 2024-09-16T03:36:19.122 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 144' 2024-09-16T03:36:19.139 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.AMFDfuNXbi' 2024-09-16T03:36:19.141 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 144 2024-09-16T03:36:19.141 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.AMFDfuNXbi 2024-09-16T03:36:19.143 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:19.143 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:19.143 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:19.143 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 145 2024-09-16T03:36:19.143 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=145 2024-09-16T03:36:19.144 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:19.144 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:19.144 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.DLBD28sq5D 2024-09-16T03:36:19.144 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 145 -o /tmp/tmp.DLBD28sq5D 2024-09-16T03:36:19.528 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 145 2024-09-16T03:36:19.543 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.DLBD28sq5D 2024-09-16T03:36:19.544 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 145' 2024-09-16T03:36:19.563 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.DLBD28sq5D' 2024-09-16T03:36:19.564 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 145 2024-09-16T03:36:19.565 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.DLBD28sq5D 2024-09-16T03:36:19.566 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:19.566 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:19.566 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:19.566 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 146 2024-09-16T03:36:19.566 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=146 2024-09-16T03:36:19.566 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:19.566 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:19.567 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.vfIjFTUg68 2024-09-16T03:36:19.567 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 146 -o /tmp/tmp.vfIjFTUg68 2024-09-16T03:36:20.019 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 146 2024-09-16T03:36:20.036 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.vfIjFTUg68 2024-09-16T03:36:20.036 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 146' 2024-09-16T03:36:20.056 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.vfIjFTUg68' 2024-09-16T03:36:20.057 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 146 2024-09-16T03:36:20.058 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.vfIjFTUg68 2024-09-16T03:36:20.059 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:20.060 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:20.060 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:20.060 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 147 2024-09-16T03:36:20.060 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=147 2024-09-16T03:36:20.060 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:20.060 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:20.060 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.m7vfbpxaF5 2024-09-16T03:36:20.060 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 147 -o /tmp/tmp.m7vfbpxaF5 2024-09-16T03:36:20.503 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 147 2024-09-16T03:36:20.519 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 147' 2024-09-16T03:36:20.520 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.m7vfbpxaF5 2024-09-16T03:36:20.541 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.m7vfbpxaF5' 2024-09-16T03:36:20.542 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 147 2024-09-16T03:36:20.543 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.m7vfbpxaF5 2024-09-16T03:36:20.544 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:20.544 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:20.544 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:20.544 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 148 2024-09-16T03:36:20.545 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=148 2024-09-16T03:36:20.545 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:20.545 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:20.545 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.nboWXxTeZb 2024-09-16T03:36:20.545 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 148 -o /tmp/tmp.nboWXxTeZb 2024-09-16T03:36:21.014 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 148 2024-09-16T03:36:21.031 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.nboWXxTeZb 2024-09-16T03:36:21.031 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 148' 2024-09-16T03:36:21.051 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.nboWXxTeZb' 2024-09-16T03:36:21.052 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 148 2024-09-16T03:36:21.052 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.nboWXxTeZb 2024-09-16T03:36:21.054 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:21.054 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:21.054 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:21.054 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 149 2024-09-16T03:36:21.054 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=149 2024-09-16T03:36:21.054 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:21.054 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:21.055 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.gCCU0pXokk 2024-09-16T03:36:21.055 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 149 -o /tmp/tmp.gCCU0pXokk 2024-09-16T03:36:21.442 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 149 2024-09-16T03:36:21.458 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.gCCU0pXokk 2024-09-16T03:36:21.458 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 149' 2024-09-16T03:36:21.478 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.gCCU0pXokk' 2024-09-16T03:36:21.480 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 149 2024-09-16T03:36:21.480 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.gCCU0pXokk 2024-09-16T03:36:21.481 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:21.481 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:21.482 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:21.482 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 150 2024-09-16T03:36:21.482 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=150 2024-09-16T03:36:21.482 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:21.482 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:21.482 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.xG3BxDYV7j 2024-09-16T03:36:21.482 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 150 -o /tmp/tmp.xG3BxDYV7j 2024-09-16T03:36:21.860 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 150 2024-09-16T03:36:21.876 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.xG3BxDYV7j 2024-09-16T03:36:21.876 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 150' 2024-09-16T03:36:21.897 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.xG3BxDYV7j' 2024-09-16T03:36:21.898 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 150 2024-09-16T03:36:21.899 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.xG3BxDYV7j 2024-09-16T03:36:21.900 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:21.900 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:21.900 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:21.900 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 151 2024-09-16T03:36:21.901 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=151 2024-09-16T03:36:21.901 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:21.901 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:21.901 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.sYk5urwpA3 2024-09-16T03:36:21.901 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 151 -o /tmp/tmp.sYk5urwpA3 2024-09-16T03:36:22.293 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 151 2024-09-16T03:36:22.310 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.sYk5urwpA3 2024-09-16T03:36:22.310 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 151' 2024-09-16T03:36:22.329 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.sYk5urwpA3' 2024-09-16T03:36:22.331 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 151 2024-09-16T03:36:22.331 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.sYk5urwpA3 2024-09-16T03:36:22.332 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:22.332 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:22.332 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:22.333 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 152 2024-09-16T03:36:22.333 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=152 2024-09-16T03:36:22.333 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:22.333 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:22.333 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.yrxyre1hbz 2024-09-16T03:36:22.333 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 152 -o /tmp/tmp.yrxyre1hbz 2024-09-16T03:36:22.715 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 152 2024-09-16T03:36:22.731 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.yrxyre1hbz 2024-09-16T03:36:22.731 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 152' 2024-09-16T03:36:22.746 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.yrxyre1hbz' 2024-09-16T03:36:22.748 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 152 2024-09-16T03:36:22.748 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.yrxyre1hbz 2024-09-16T03:36:22.750 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:22.750 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:22.750 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:22.750 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 153 2024-09-16T03:36:22.750 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=153 2024-09-16T03:36:22.750 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:22.750 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:22.751 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.udggTdOyDx 2024-09-16T03:36:22.751 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 153 -o /tmp/tmp.udggTdOyDx 2024-09-16T03:36:23.166 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 153 2024-09-16T03:36:23.182 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.udggTdOyDx 2024-09-16T03:36:23.182 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 153' 2024-09-16T03:36:23.202 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.udggTdOyDx' 2024-09-16T03:36:23.203 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 153 2024-09-16T03:36:23.203 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.udggTdOyDx 2024-09-16T03:36:23.205 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:23.205 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:23.205 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:23.205 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 154 2024-09-16T03:36:23.205 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=154 2024-09-16T03:36:23.205 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:23.205 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:23.206 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.jGfjeAmeom 2024-09-16T03:36:23.206 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 154 -o /tmp/tmp.jGfjeAmeom 2024-09-16T03:36:23.724 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 154 2024-09-16T03:36:23.743 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 154' 2024-09-16T03:36:23.743 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.jGfjeAmeom 2024-09-16T03:36:23.763 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.jGfjeAmeom' 2024-09-16T03:36:23.765 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 154 2024-09-16T03:36:23.765 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.jGfjeAmeom 2024-09-16T03:36:23.766 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:23.767 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:23.767 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:23.767 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 155 2024-09-16T03:36:23.767 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=155 2024-09-16T03:36:23.767 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:23.767 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:23.767 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.GzkEvVRdh5 2024-09-16T03:36:23.767 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 155 -o /tmp/tmp.GzkEvVRdh5 2024-09-16T03:36:24.225 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 155 2024-09-16T03:36:24.243 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.GzkEvVRdh5 2024-09-16T03:36:24.243 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 155' 2024-09-16T03:36:24.262 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.GzkEvVRdh5' 2024-09-16T03:36:24.264 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 155 2024-09-16T03:36:24.264 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.GzkEvVRdh5 2024-09-16T03:36:24.266 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:24.266 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:24.266 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:24.266 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 156 2024-09-16T03:36:24.266 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=156 2024-09-16T03:36:24.266 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:24.266 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:24.266 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.MpmYdAHDOb 2024-09-16T03:36:24.266 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 156 -o /tmp/tmp.MpmYdAHDOb 2024-09-16T03:36:24.688 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 156 2024-09-16T03:36:24.705 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.MpmYdAHDOb 2024-09-16T03:36:24.706 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 156' 2024-09-16T03:36:24.727 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.MpmYdAHDOb' 2024-09-16T03:36:24.729 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 156 2024-09-16T03:36:24.729 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.MpmYdAHDOb 2024-09-16T03:36:24.730 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:24.730 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:24.730 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:24.730 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 157 2024-09-16T03:36:24.730 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=157 2024-09-16T03:36:24.731 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:24.731 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:24.731 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.M4hME0OSpM 2024-09-16T03:36:24.731 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 157 -o /tmp/tmp.M4hME0OSpM 2024-09-16T03:36:25.211 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 157 2024-09-16T03:36:25.228 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.M4hME0OSpM 2024-09-16T03:36:25.228 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 157' 2024-09-16T03:36:25.247 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.M4hME0OSpM' 2024-09-16T03:36:25.249 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 157 2024-09-16T03:36:25.249 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.M4hME0OSpM 2024-09-16T03:36:25.250 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:25.250 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:25.250 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:25.250 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 158 2024-09-16T03:36:25.251 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=158 2024-09-16T03:36:25.251 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:25.251 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:25.251 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.P10aJPeE8g 2024-09-16T03:36:25.252 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 158 -o /tmp/tmp.P10aJPeE8g 2024-09-16T03:36:25.705 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 158 2024-09-16T03:36:25.723 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.P10aJPeE8g 2024-09-16T03:36:25.723 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 158' 2024-09-16T03:36:25.743 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.P10aJPeE8g' 2024-09-16T03:36:25.745 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 158 2024-09-16T03:36:25.745 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.P10aJPeE8g 2024-09-16T03:36:25.746 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:25.747 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:25.747 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:25.747 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 159 2024-09-16T03:36:25.747 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=159 2024-09-16T03:36:25.747 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:25.747 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:25.747 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.bsuKAOOOJl 2024-09-16T03:36:25.747 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 159 -o /tmp/tmp.bsuKAOOOJl 2024-09-16T03:36:26.198 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 159 2024-09-16T03:36:26.216 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.bsuKAOOOJl 2024-09-16T03:36:26.216 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 159' 2024-09-16T03:36:26.236 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.bsuKAOOOJl' 2024-09-16T03:36:26.238 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 159 2024-09-16T03:36:26.238 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.bsuKAOOOJl 2024-09-16T03:36:26.239 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:26.239 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:26.239 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:26.239 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 160 2024-09-16T03:36:26.239 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=160 2024-09-16T03:36:26.239 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:26.239 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:26.240 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.QxbWIZA3B1 2024-09-16T03:36:26.240 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 160 -o /tmp/tmp.QxbWIZA3B1 2024-09-16T03:36:26.696 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 160 2024-09-16T03:36:26.712 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 160' 2024-09-16T03:36:26.713 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.QxbWIZA3B1 2024-09-16T03:36:26.734 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.QxbWIZA3B1' 2024-09-16T03:36:26.736 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 160 2024-09-16T03:36:26.736 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.QxbWIZA3B1 2024-09-16T03:36:26.738 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:26.738 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:26.738 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:26.738 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 161 2024-09-16T03:36:26.738 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=161 2024-09-16T03:36:26.738 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:26.739 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:26.739 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.5QWwgyHHNL 2024-09-16T03:36:26.739 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 161 -o /tmp/tmp.5QWwgyHHNL 2024-09-16T03:36:27.192 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 161 2024-09-16T03:36:27.211 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.5QWwgyHHNL 2024-09-16T03:36:27.211 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 161' 2024-09-16T03:36:27.231 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.5QWwgyHHNL' 2024-09-16T03:36:27.233 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 161 2024-09-16T03:36:27.233 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.5QWwgyHHNL 2024-09-16T03:36:27.234 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:27.234 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:27.234 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:27.234 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 162 2024-09-16T03:36:27.234 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=162 2024-09-16T03:36:27.235 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:27.235 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:27.235 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.hv3pdwP18B 2024-09-16T03:36:27.235 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 162 -o /tmp/tmp.hv3pdwP18B 2024-09-16T03:36:27.669 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 162 2024-09-16T03:36:27.685 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.hv3pdwP18B 2024-09-16T03:36:27.686 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 162' 2024-09-16T03:36:27.705 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.hv3pdwP18B' 2024-09-16T03:36:27.707 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 162 2024-09-16T03:36:27.707 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.hv3pdwP18B 2024-09-16T03:36:27.708 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:27.708 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:27.708 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:27.708 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 163 2024-09-16T03:36:27.709 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=163 2024-09-16T03:36:27.709 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:27.709 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:27.709 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.9KSqlKSbjB 2024-09-16T03:36:27.709 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 163 -o /tmp/tmp.9KSqlKSbjB 2024-09-16T03:36:28.145 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 163 2024-09-16T03:36:28.161 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.9KSqlKSbjB 2024-09-16T03:36:28.162 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 163' 2024-09-16T03:36:28.181 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.9KSqlKSbjB' 2024-09-16T03:36:28.182 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 163 2024-09-16T03:36:28.183 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.9KSqlKSbjB 2024-09-16T03:36:28.184 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:28.184 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:28.184 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:28.184 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 164 2024-09-16T03:36:28.184 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=164 2024-09-16T03:36:28.184 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:28.184 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:28.185 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.viGxeDQEnq 2024-09-16T03:36:28.185 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 164 -o /tmp/tmp.viGxeDQEnq 2024-09-16T03:36:28.668 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 164 2024-09-16T03:36:28.689 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.viGxeDQEnq 2024-09-16T03:36:28.689 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 164' 2024-09-16T03:36:28.710 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.viGxeDQEnq' 2024-09-16T03:36:28.712 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 164 2024-09-16T03:36:28.712 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.viGxeDQEnq 2024-09-16T03:36:28.713 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:28.713 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:28.714 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:28.714 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 165 2024-09-16T03:36:28.714 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=165 2024-09-16T03:36:28.714 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:28.714 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:28.714 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.m4b0lGInfB 2024-09-16T03:36:28.714 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 165 -o /tmp/tmp.m4b0lGInfB 2024-09-16T03:36:29.116 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 165 2024-09-16T03:36:29.131 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.m4b0lGInfB 2024-09-16T03:36:29.132 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 165' 2024-09-16T03:36:29.151 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.m4b0lGInfB' 2024-09-16T03:36:29.153 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 165 2024-09-16T03:36:29.153 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.m4b0lGInfB 2024-09-16T03:36:29.154 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:29.154 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:29.154 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:29.154 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 166 2024-09-16T03:36:29.154 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=166 2024-09-16T03:36:29.154 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:29.155 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:29.155 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.ZxrZJrzubJ 2024-09-16T03:36:29.155 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 166 -o /tmp/tmp.ZxrZJrzubJ 2024-09-16T03:36:29.549 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 166 2024-09-16T03:36:29.562 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.ZxrZJrzubJ 2024-09-16T03:36:29.562 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 166' 2024-09-16T03:36:29.582 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.ZxrZJrzubJ' 2024-09-16T03:36:29.583 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 166 2024-09-16T03:36:29.584 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.ZxrZJrzubJ 2024-09-16T03:36:29.585 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:29.585 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:29.585 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:29.585 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 167 2024-09-16T03:36:29.585 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=167 2024-09-16T03:36:29.585 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:29.585 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:29.585 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.1IZvs0xv34 2024-09-16T03:36:29.586 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 167 -o /tmp/tmp.1IZvs0xv34 2024-09-16T03:36:30.018 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 167 2024-09-16T03:36:30.034 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.1IZvs0xv34 2024-09-16T03:36:30.034 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 167' 2024-09-16T03:36:30.053 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.1IZvs0xv34' 2024-09-16T03:36:30.055 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 167 2024-09-16T03:36:30.055 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.1IZvs0xv34 2024-09-16T03:36:30.056 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:30.056 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:30.056 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:30.057 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 168 2024-09-16T03:36:30.057 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=168 2024-09-16T03:36:30.057 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:30.057 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:30.057 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.tIFVNikOCS 2024-09-16T03:36:30.057 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 168 -o /tmp/tmp.tIFVNikOCS 2024-09-16T03:36:30.486 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 168 2024-09-16T03:36:30.503 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.tIFVNikOCS 2024-09-16T03:36:30.503 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 168' 2024-09-16T03:36:30.522 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.tIFVNikOCS' 2024-09-16T03:36:30.523 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 168 2024-09-16T03:36:30.524 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.tIFVNikOCS 2024-09-16T03:36:30.525 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:30.525 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:30.525 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:30.525 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 169 2024-09-16T03:36:30.525 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=169 2024-09-16T03:36:30.525 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:30.525 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:30.526 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.kmF07R9uq8 2024-09-16T03:36:30.526 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 169 -o /tmp/tmp.kmF07R9uq8 2024-09-16T03:36:30.951 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 169 2024-09-16T03:36:30.967 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.kmF07R9uq8 2024-09-16T03:36:30.967 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 169' 2024-09-16T03:36:30.987 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.kmF07R9uq8' 2024-09-16T03:36:30.989 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 169 2024-09-16T03:36:30.989 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.kmF07R9uq8 2024-09-16T03:36:30.990 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:30.990 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:30.990 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:30.990 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 170 2024-09-16T03:36:30.990 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=170 2024-09-16T03:36:30.991 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:30.991 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:30.991 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.miMnorUL85 2024-09-16T03:36:30.991 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 170 -o /tmp/tmp.miMnorUL85 2024-09-16T03:36:31.439 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 170 2024-09-16T03:36:31.458 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.miMnorUL85 2024-09-16T03:36:31.458 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 170' 2024-09-16T03:36:31.478 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.miMnorUL85' 2024-09-16T03:36:31.480 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 170 2024-09-16T03:36:31.480 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.miMnorUL85 2024-09-16T03:36:31.482 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:31.482 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:31.482 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:31.482 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 171 2024-09-16T03:36:31.482 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=171 2024-09-16T03:36:31.482 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:31.483 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:31.483 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.Xz52nJ16zT 2024-09-16T03:36:31.483 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 171 -o /tmp/tmp.Xz52nJ16zT 2024-09-16T03:36:31.885 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 171 2024-09-16T03:36:31.901 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.Xz52nJ16zT 2024-09-16T03:36:31.901 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 171' 2024-09-16T03:36:31.921 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.Xz52nJ16zT' 2024-09-16T03:36:31.922 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 171 2024-09-16T03:36:31.922 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.Xz52nJ16zT 2024-09-16T03:36:31.923 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:31.923 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:31.924 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:31.924 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 172 2024-09-16T03:36:31.924 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=172 2024-09-16T03:36:31.924 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:31.924 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:31.924 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.bNKTfeTimU 2024-09-16T03:36:31.924 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 172 -o /tmp/tmp.bNKTfeTimU 2024-09-16T03:36:32.335 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 172 2024-09-16T03:36:32.351 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.bNKTfeTimU 2024-09-16T03:36:32.351 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 172' 2024-09-16T03:36:32.370 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.bNKTfeTimU' 2024-09-16T03:36:32.372 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 172 2024-09-16T03:36:32.372 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.bNKTfeTimU 2024-09-16T03:36:32.373 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:32.373 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:32.373 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:32.373 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 173 2024-09-16T03:36:32.374 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=173 2024-09-16T03:36:32.374 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:32.374 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:32.374 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.Rvine3qbi5 2024-09-16T03:36:32.374 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 173 -o /tmp/tmp.Rvine3qbi5 2024-09-16T03:36:32.811 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 173 2024-09-16T03:36:32.829 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.Rvine3qbi5 2024-09-16T03:36:32.829 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 173' 2024-09-16T03:36:32.850 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.Rvine3qbi5' 2024-09-16T03:36:32.852 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 173 2024-09-16T03:36:32.852 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.Rvine3qbi5 2024-09-16T03:36:32.853 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:32.854 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:32.854 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:32.854 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 174 2024-09-16T03:36:32.854 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=174 2024-09-16T03:36:32.854 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:32.854 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:32.855 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.x3L6IAk8Yx 2024-09-16T03:36:32.855 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 174 -o /tmp/tmp.x3L6IAk8Yx 2024-09-16T03:36:33.286 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 174 2024-09-16T03:36:33.303 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.x3L6IAk8Yx 2024-09-16T03:36:33.303 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 174' 2024-09-16T03:36:33.322 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.x3L6IAk8Yx' 2024-09-16T03:36:33.324 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 174 2024-09-16T03:36:33.324 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.x3L6IAk8Yx 2024-09-16T03:36:33.326 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:33.327 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:33.327 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:33.327 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 175 2024-09-16T03:36:33.327 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=175 2024-09-16T03:36:33.327 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:33.327 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:33.328 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.pePaWFwt2V 2024-09-16T03:36:33.328 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 175 -o /tmp/tmp.pePaWFwt2V 2024-09-16T03:36:33.762 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 175 2024-09-16T03:36:33.779 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.pePaWFwt2V 2024-09-16T03:36:33.779 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 175' 2024-09-16T03:36:33.793 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.pePaWFwt2V' 2024-09-16T03:36:33.795 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 175 2024-09-16T03:36:33.795 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.pePaWFwt2V 2024-09-16T03:36:33.796 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:33.796 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:33.796 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:33.796 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 176 2024-09-16T03:36:33.796 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=176 2024-09-16T03:36:33.796 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:33.797 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:33.797 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.E1aGujD1SY 2024-09-16T03:36:33.797 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 176 -o /tmp/tmp.E1aGujD1SY 2024-09-16T03:36:34.247 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 176 2024-09-16T03:36:34.264 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.E1aGujD1SY 2024-09-16T03:36:34.264 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 176' 2024-09-16T03:36:34.283 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.E1aGujD1SY' 2024-09-16T03:36:34.285 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 176 2024-09-16T03:36:34.285 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.E1aGujD1SY 2024-09-16T03:36:34.286 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:34.286 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:34.286 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:34.287 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 177 2024-09-16T03:36:34.287 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=177 2024-09-16T03:36:34.287 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:34.287 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:34.288 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.MJxCqKG6ma 2024-09-16T03:36:34.288 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 177 -o /tmp/tmp.MJxCqKG6ma 2024-09-16T03:36:34.689 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 177 2024-09-16T03:36:34.705 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.MJxCqKG6ma 2024-09-16T03:36:34.705 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 177' 2024-09-16T03:36:34.726 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.MJxCqKG6ma' 2024-09-16T03:36:34.727 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 177 2024-09-16T03:36:34.727 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.MJxCqKG6ma 2024-09-16T03:36:34.729 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:34.729 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:34.729 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:34.729 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 178 2024-09-16T03:36:34.729 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=178 2024-09-16T03:36:34.729 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:34.729 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:34.730 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.ulVaRS9DWJ 2024-09-16T03:36:34.730 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 178 -o /tmp/tmp.ulVaRS9DWJ 2024-09-16T03:36:35.199 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 178 2024-09-16T03:36:35.215 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 178' 2024-09-16T03:36:35.215 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.ulVaRS9DWJ 2024-09-16T03:36:35.235 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.ulVaRS9DWJ' 2024-09-16T03:36:35.236 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 178 2024-09-16T03:36:35.237 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.ulVaRS9DWJ 2024-09-16T03:36:35.238 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:35.238 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:35.238 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:35.238 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 179 2024-09-16T03:36:35.238 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=179 2024-09-16T03:36:35.238 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:35.238 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:35.239 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.msWGJyTzij 2024-09-16T03:36:35.239 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 179 -o /tmp/tmp.msWGJyTzij 2024-09-16T03:36:35.660 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 179 2024-09-16T03:36:35.677 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.msWGJyTzij 2024-09-16T03:36:35.677 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 179' 2024-09-16T03:36:35.697 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.msWGJyTzij' 2024-09-16T03:36:35.699 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 179 2024-09-16T03:36:35.701 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.msWGJyTzij 2024-09-16T03:36:35.701 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:35.701 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:35.701 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:35.701 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 180 2024-09-16T03:36:35.702 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=180 2024-09-16T03:36:35.702 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:35.702 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:35.702 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.ue0V0zJBYm 2024-09-16T03:36:35.702 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 180 -o /tmp/tmp.ue0V0zJBYm 2024-09-16T03:36:36.133 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 180 2024-09-16T03:36:36.151 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.ue0V0zJBYm 2024-09-16T03:36:36.151 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 180' 2024-09-16T03:36:36.171 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.ue0V0zJBYm' 2024-09-16T03:36:36.173 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 180 2024-09-16T03:36:36.173 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.ue0V0zJBYm 2024-09-16T03:36:36.175 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:36.175 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:36.175 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:36.175 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 181 2024-09-16T03:36:36.175 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=181 2024-09-16T03:36:36.175 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:36.175 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:36.176 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.qkcUvyUG5J 2024-09-16T03:36:36.176 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 181 -o /tmp/tmp.qkcUvyUG5J 2024-09-16T03:36:36.652 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 181 2024-09-16T03:36:36.668 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 181' 2024-09-16T03:36:36.668 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.qkcUvyUG5J 2024-09-16T03:36:36.689 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.qkcUvyUG5J' 2024-09-16T03:36:36.691 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 181 2024-09-16T03:36:36.691 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.qkcUvyUG5J 2024-09-16T03:36:36.692 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:36.692 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:36.692 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:36.692 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 182 2024-09-16T03:36:36.692 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=182 2024-09-16T03:36:36.693 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:36.693 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:36.694 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.LwXDAQu9CH 2024-09-16T03:36:36.694 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 182 -o /tmp/tmp.LwXDAQu9CH 2024-09-16T03:36:37.101 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 182 2024-09-16T03:36:37.117 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.LwXDAQu9CH 2024-09-16T03:36:37.117 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 182' 2024-09-16T03:36:37.136 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.LwXDAQu9CH' 2024-09-16T03:36:37.138 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 182 2024-09-16T03:36:37.138 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.LwXDAQu9CH 2024-09-16T03:36:37.139 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:37.139 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:37.139 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:37.139 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 183 2024-09-16T03:36:37.139 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=183 2024-09-16T03:36:37.140 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:37.140 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:37.140 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.nWeMxmZRdN 2024-09-16T03:36:37.140 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 183 -o /tmp/tmp.nWeMxmZRdN 2024-09-16T03:36:37.575 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 183 2024-09-16T03:36:37.592 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.nWeMxmZRdN 2024-09-16T03:36:37.592 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 183' 2024-09-16T03:36:37.611 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.nWeMxmZRdN' 2024-09-16T03:36:37.612 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 183 2024-09-16T03:36:37.613 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.nWeMxmZRdN 2024-09-16T03:36:37.614 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:37.614 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:37.614 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:37.614 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 184 2024-09-16T03:36:37.614 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=184 2024-09-16T03:36:37.615 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:37.615 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:37.616 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.sJ5twtXKfY 2024-09-16T03:36:37.616 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 184 -o /tmp/tmp.sJ5twtXKfY 2024-09-16T03:36:38.067 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 184 2024-09-16T03:36:38.083 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.sJ5twtXKfY 2024-09-16T03:36:38.083 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 184' 2024-09-16T03:36:38.103 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.sJ5twtXKfY' 2024-09-16T03:36:38.105 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 184 2024-09-16T03:36:38.105 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.sJ5twtXKfY 2024-09-16T03:36:38.106 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:38.106 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:38.106 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:38.107 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 185 2024-09-16T03:36:38.107 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=185 2024-09-16T03:36:38.107 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:38.107 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:38.107 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.zPei2OWl7P 2024-09-16T03:36:38.107 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 185 -o /tmp/tmp.zPei2OWl7P 2024-09-16T03:36:38.560 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 185 2024-09-16T03:36:38.578 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.zPei2OWl7P 2024-09-16T03:36:38.578 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 185' 2024-09-16T03:36:38.597 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.zPei2OWl7P' 2024-09-16T03:36:38.599 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 185 2024-09-16T03:36:38.599 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.zPei2OWl7P 2024-09-16T03:36:38.600 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:38.600 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:38.600 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:38.600 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 186 2024-09-16T03:36:38.600 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=186 2024-09-16T03:36:38.601 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:38.601 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:38.601 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.8DX1aac4Ke 2024-09-16T03:36:38.601 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 186 -o /tmp/tmp.8DX1aac4Ke 2024-09-16T03:36:39.004 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 186 2024-09-16T03:36:39.020 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.8DX1aac4Ke 2024-09-16T03:36:39.020 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 186' 2024-09-16T03:36:39.039 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.8DX1aac4Ke' 2024-09-16T03:36:39.040 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 186 2024-09-16T03:36:39.041 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.8DX1aac4Ke 2024-09-16T03:36:39.042 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:39.042 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:39.042 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:39.042 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 187 2024-09-16T03:36:39.042 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=187 2024-09-16T03:36:39.042 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:39.042 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:39.043 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.7pIQO1rWM0 2024-09-16T03:36:39.043 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 187 -o /tmp/tmp.7pIQO1rWM0 2024-09-16T03:36:39.467 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 187 2024-09-16T03:36:39.483 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 187' 2024-09-16T03:36:39.483 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.7pIQO1rWM0 2024-09-16T03:36:39.503 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.7pIQO1rWM0' 2024-09-16T03:36:39.504 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 187 2024-09-16T03:36:39.504 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.7pIQO1rWM0 2024-09-16T03:36:39.505 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:39.505 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:39.505 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:39.506 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 188 2024-09-16T03:36:39.506 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=188 2024-09-16T03:36:39.506 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:39.506 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:39.506 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.6VeJn6cg1A 2024-09-16T03:36:39.506 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 188 -o /tmp/tmp.6VeJn6cg1A 2024-09-16T03:36:39.889 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 188 2024-09-16T03:36:39.905 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.6VeJn6cg1A 2024-09-16T03:36:39.905 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 188' 2024-09-16T03:36:39.924 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.6VeJn6cg1A' 2024-09-16T03:36:39.926 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 188 2024-09-16T03:36:39.926 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.6VeJn6cg1A 2024-09-16T03:36:39.927 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:39.927 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:39.927 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:39.927 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 189 2024-09-16T03:36:39.927 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=189 2024-09-16T03:36:39.927 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:39.927 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:39.928 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.MrOCwkSJjJ 2024-09-16T03:36:39.928 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 189 -o /tmp/tmp.MrOCwkSJjJ 2024-09-16T03:36:40.366 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 189 2024-09-16T03:36:40.383 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.MrOCwkSJjJ 2024-09-16T03:36:40.383 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 189' 2024-09-16T03:36:40.402 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.MrOCwkSJjJ' 2024-09-16T03:36:40.404 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 189 2024-09-16T03:36:40.404 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.MrOCwkSJjJ 2024-09-16T03:36:40.405 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:40.406 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:40.406 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:40.406 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 190 2024-09-16T03:36:40.406 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=190 2024-09-16T03:36:40.406 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:40.406 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:40.406 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.5rHUrZSSYn 2024-09-16T03:36:40.406 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 190 -o /tmp/tmp.5rHUrZSSYn 2024-09-16T03:36:40.860 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 190 2024-09-16T03:36:40.878 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.5rHUrZSSYn 2024-09-16T03:36:40.878 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 190' 2024-09-16T03:36:40.892 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.5rHUrZSSYn' 2024-09-16T03:36:40.894 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 190 2024-09-16T03:36:40.895 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.5rHUrZSSYn 2024-09-16T03:36:40.895 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:40.895 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:40.895 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:40.896 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 191 2024-09-16T03:36:40.896 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=191 2024-09-16T03:36:40.896 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:40.896 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:40.896 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.Sbq4EgyIza 2024-09-16T03:36:40.897 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 191 -o /tmp/tmp.Sbq4EgyIza 2024-09-16T03:36:41.336 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 191 2024-09-16T03:36:41.352 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.Sbq4EgyIza 2024-09-16T03:36:41.352 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 191' 2024-09-16T03:36:41.372 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.Sbq4EgyIza' 2024-09-16T03:36:41.373 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 191 2024-09-16T03:36:41.373 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.Sbq4EgyIza 2024-09-16T03:36:41.375 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:41.375 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:41.375 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:41.375 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 192 2024-09-16T03:36:41.375 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=192 2024-09-16T03:36:41.375 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:41.376 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:41.376 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.pbsH3IaTwG 2024-09-16T03:36:41.376 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 192 -o /tmp/tmp.pbsH3IaTwG 2024-09-16T03:36:41.770 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 192 2024-09-16T03:36:41.786 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 192' 2024-09-16T03:36:41.787 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.pbsH3IaTwG 2024-09-16T03:36:41.806 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.pbsH3IaTwG' 2024-09-16T03:36:41.808 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 192 2024-09-16T03:36:41.808 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.pbsH3IaTwG 2024-09-16T03:36:41.809 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:41.809 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:41.809 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:41.809 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 193 2024-09-16T03:36:41.809 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=193 2024-09-16T03:36:41.810 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:41.810 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:41.810 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.4wyWBkbQq2 2024-09-16T03:36:41.810 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 193 -o /tmp/tmp.4wyWBkbQq2 2024-09-16T03:36:42.257 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 193 2024-09-16T03:36:42.273 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.4wyWBkbQq2 2024-09-16T03:36:42.273 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 193' 2024-09-16T03:36:42.294 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.4wyWBkbQq2' 2024-09-16T03:36:42.295 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 193 2024-09-16T03:36:42.296 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.4wyWBkbQq2 2024-09-16T03:36:42.297 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:42.297 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:42.297 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:42.297 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 194 2024-09-16T03:36:42.297 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=194 2024-09-16T03:36:42.297 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:42.297 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:42.298 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.TTkehrfKEw 2024-09-16T03:36:42.299 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 194 -o /tmp/tmp.TTkehrfKEw 2024-09-16T03:36:42.773 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 194 2024-09-16T03:36:42.791 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.TTkehrfKEw 2024-09-16T03:36:42.792 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 194' 2024-09-16T03:36:42.812 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.TTkehrfKEw' 2024-09-16T03:36:42.813 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 194 2024-09-16T03:36:42.813 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.TTkehrfKEw 2024-09-16T03:36:42.815 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:42.815 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:42.815 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:42.815 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 195 2024-09-16T03:36:42.815 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=195 2024-09-16T03:36:42.815 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:42.815 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:42.816 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.5Uhd8kAIHE 2024-09-16T03:36:42.816 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 195 -o /tmp/tmp.5Uhd8kAIHE 2024-09-16T03:36:43.284 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 195 2024-09-16T03:36:43.301 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.5Uhd8kAIHE 2024-09-16T03:36:43.301 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 195' 2024-09-16T03:36:43.321 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.5Uhd8kAIHE' 2024-09-16T03:36:43.323 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 195 2024-09-16T03:36:43.323 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.5Uhd8kAIHE 2024-09-16T03:36:43.324 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:43.324 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:43.324 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:43.324 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 196 2024-09-16T03:36:43.324 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=196 2024-09-16T03:36:43.324 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:43.325 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:43.326 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.K8IefQ75pk 2024-09-16T03:36:43.326 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 196 -o /tmp/tmp.K8IefQ75pk 2024-09-16T03:36:43.706 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 196 2024-09-16T03:36:43.722 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.K8IefQ75pk 2024-09-16T03:36:43.722 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 196' 2024-09-16T03:36:43.742 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.K8IefQ75pk' 2024-09-16T03:36:43.744 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 196 2024-09-16T03:36:43.744 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.K8IefQ75pk 2024-09-16T03:36:43.745 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:43.746 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:43.746 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:43.746 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 197 2024-09-16T03:36:43.746 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=197 2024-09-16T03:36:43.746 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:43.747 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:43.747 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.v4ak4wkQMt 2024-09-16T03:36:43.747 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 197 -o /tmp/tmp.v4ak4wkQMt 2024-09-16T03:36:44.253 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 197 2024-09-16T03:36:44.273 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.v4ak4wkQMt 2024-09-16T03:36:44.273 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 197' 2024-09-16T03:36:44.294 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.v4ak4wkQMt' 2024-09-16T03:36:44.295 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 197 2024-09-16T03:36:44.295 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.v4ak4wkQMt 2024-09-16T03:36:44.297 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:44.297 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:44.297 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:44.297 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 198 2024-09-16T03:36:44.297 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=198 2024-09-16T03:36:44.297 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:44.297 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:44.297 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.LAkqisbDgd 2024-09-16T03:36:44.298 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 198 -o /tmp/tmp.LAkqisbDgd 2024-09-16T03:36:44.704 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 198 2024-09-16T03:36:44.721 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.LAkqisbDgd 2024-09-16T03:36:44.721 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 198' 2024-09-16T03:36:44.736 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.LAkqisbDgd' 2024-09-16T03:36:44.737 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 198 2024-09-16T03:36:44.737 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.LAkqisbDgd 2024-09-16T03:36:44.738 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:44.739 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:44.739 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:44.739 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 199 2024-09-16T03:36:44.739 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=199 2024-09-16T03:36:44.739 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:44.739 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:44.739 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.DsycAqDzBd 2024-09-16T03:36:44.739 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 199 -o /tmp/tmp.DsycAqDzBd 2024-09-16T03:36:45.169 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 199 2024-09-16T03:36:45.185 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.DsycAqDzBd 2024-09-16T03:36:45.185 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 199' 2024-09-16T03:36:45.204 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.DsycAqDzBd' 2024-09-16T03:36:45.206 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 199 2024-09-16T03:36:45.206 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.DsycAqDzBd 2024-09-16T03:36:45.207 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:45.207 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:45.208 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:45.208 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 200 2024-09-16T03:36:45.208 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=200 2024-09-16T03:36:45.208 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:45.208 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:45.208 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.xiNdW9oshf 2024-09-16T03:36:45.208 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 200 -o /tmp/tmp.xiNdW9oshf 2024-09-16T03:36:45.642 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 200 2024-09-16T03:36:45.659 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 200' 2024-09-16T03:36:45.659 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.xiNdW9oshf 2024-09-16T03:36:45.679 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.xiNdW9oshf' 2024-09-16T03:36:45.680 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 200 2024-09-16T03:36:45.681 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.xiNdW9oshf 2024-09-16T03:36:45.682 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:45.682 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:45.682 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:45.682 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 201 2024-09-16T03:36:45.682 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=201 2024-09-16T03:36:45.682 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:45.682 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:45.682 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.bBsEFXAjKD 2024-09-16T03:36:45.683 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 201 -o /tmp/tmp.bBsEFXAjKD 2024-09-16T03:36:46.159 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 201 2024-09-16T03:36:46.176 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.bBsEFXAjKD 2024-09-16T03:36:46.176 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 201' 2024-09-16T03:36:46.190 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.bBsEFXAjKD' 2024-09-16T03:36:46.191 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 201 2024-09-16T03:36:46.192 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.bBsEFXAjKD 2024-09-16T03:36:46.193 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:46.193 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:46.193 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:46.193 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 202 2024-09-16T03:36:46.193 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=202 2024-09-16T03:36:46.193 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:46.193 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:46.194 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.3VpK89CNem 2024-09-16T03:36:46.194 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 202 -o /tmp/tmp.3VpK89CNem 2024-09-16T03:36:46.682 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 202 2024-09-16T03:36:46.701 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.3VpK89CNem 2024-09-16T03:36:46.702 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 202' 2024-09-16T03:36:46.722 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.3VpK89CNem' 2024-09-16T03:36:46.724 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 202 2024-09-16T03:36:46.724 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.3VpK89CNem 2024-09-16T03:36:46.726 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:46.726 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:46.726 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:46.726 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 203 2024-09-16T03:36:46.726 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=203 2024-09-16T03:36:46.727 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:46.727 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:46.727 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.P9hpANSvXW 2024-09-16T03:36:46.727 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 203 -o /tmp/tmp.P9hpANSvXW 2024-09-16T03:36:47.196 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 203 2024-09-16T03:36:47.214 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.P9hpANSvXW 2024-09-16T03:36:47.214 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 203' 2024-09-16T03:36:47.234 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.P9hpANSvXW' 2024-09-16T03:36:47.236 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 203 2024-09-16T03:36:47.236 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.P9hpANSvXW 2024-09-16T03:36:47.237 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:47.237 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:47.237 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:47.237 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 204 2024-09-16T03:36:47.238 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=204 2024-09-16T03:36:47.238 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:47.238 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:47.238 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.VYBYrZ56lu 2024-09-16T03:36:47.238 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 204 -o /tmp/tmp.VYBYrZ56lu 2024-09-16T03:36:47.722 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 204 2024-09-16T03:36:47.740 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.VYBYrZ56lu 2024-09-16T03:36:47.740 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 204' 2024-09-16T03:36:47.761 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.VYBYrZ56lu' 2024-09-16T03:36:47.763 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 204 2024-09-16T03:36:47.763 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.VYBYrZ56lu 2024-09-16T03:36:47.764 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:47.764 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:47.765 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:47.765 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 205 2024-09-16T03:36:47.765 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=205 2024-09-16T03:36:47.765 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:47.765 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:47.766 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.ovnbw5BSoI 2024-09-16T03:36:47.766 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 205 -o /tmp/tmp.ovnbw5BSoI 2024-09-16T03:36:48.179 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 205 2024-09-16T03:36:48.196 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.ovnbw5BSoI 2024-09-16T03:36:48.196 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 205' 2024-09-16T03:36:48.215 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.ovnbw5BSoI' 2024-09-16T03:36:48.217 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 205 2024-09-16T03:36:48.217 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.ovnbw5BSoI 2024-09-16T03:36:48.218 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:48.218 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:48.218 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:48.218 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 206 2024-09-16T03:36:48.218 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=206 2024-09-16T03:36:48.218 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:48.218 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:48.219 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.rTqi0K72Y6 2024-09-16T03:36:48.219 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 206 -o /tmp/tmp.rTqi0K72Y6 2024-09-16T03:36:48.698 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 206 2024-09-16T03:36:48.715 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.rTqi0K72Y6 2024-09-16T03:36:48.715 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 206' 2024-09-16T03:36:48.730 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.rTqi0K72Y6' 2024-09-16T03:36:48.731 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 206 2024-09-16T03:36:48.732 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.rTqi0K72Y6 2024-09-16T03:36:48.733 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:48.733 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:48.733 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:48.733 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 207 2024-09-16T03:36:48.733 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=207 2024-09-16T03:36:48.733 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:48.733 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:48.734 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.zxh5GSa1rO 2024-09-16T03:36:48.734 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 207 -o /tmp/tmp.zxh5GSa1rO 2024-09-16T03:36:49.127 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 207 2024-09-16T03:36:49.143 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.zxh5GSa1rO 2024-09-16T03:36:49.143 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 207' 2024-09-16T03:36:49.165 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.zxh5GSa1rO' 2024-09-16T03:36:49.166 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 207 2024-09-16T03:36:49.167 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.zxh5GSa1rO 2024-09-16T03:36:49.167 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:49.167 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:49.167 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:49.167 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 208 2024-09-16T03:36:49.167 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=208 2024-09-16T03:36:49.167 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:49.167 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:49.168 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.O5UMJS7kFj 2024-09-16T03:36:49.168 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 208 -o /tmp/tmp.O5UMJS7kFj 2024-09-16T03:36:49.571 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 208 2024-09-16T03:36:49.587 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.O5UMJS7kFj 2024-09-16T03:36:49.587 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 208' 2024-09-16T03:36:49.609 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.O5UMJS7kFj' 2024-09-16T03:36:49.609 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 208 2024-09-16T03:36:49.610 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.O5UMJS7kFj 2024-09-16T03:36:49.610 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:49.610 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:49.610 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:49.610 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 209 2024-09-16T03:36:49.610 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=209 2024-09-16T03:36:49.610 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:49.610 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:49.611 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.PP1IjM9wGl 2024-09-16T03:36:49.611 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 209 -o /tmp/tmp.PP1IjM9wGl 2024-09-16T03:36:50.055 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 209 2024-09-16T03:36:50.072 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.PP1IjM9wGl 2024-09-16T03:36:50.072 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 209' 2024-09-16T03:36:50.091 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.PP1IjM9wGl' 2024-09-16T03:36:50.093 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 209 2024-09-16T03:36:50.093 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.PP1IjM9wGl 2024-09-16T03:36:50.094 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:50.094 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:50.094 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:50.094 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 210 2024-09-16T03:36:50.094 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=210 2024-09-16T03:36:50.094 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:50.094 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:50.095 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.AY66phLHnv 2024-09-16T03:36:50.095 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 210 -o /tmp/tmp.AY66phLHnv 2024-09-16T03:36:50.531 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 210 2024-09-16T03:36:50.549 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.AY66phLHnv 2024-09-16T03:36:50.549 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 210' 2024-09-16T03:36:50.570 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.AY66phLHnv' 2024-09-16T03:36:50.571 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 210 2024-09-16T03:36:50.571 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.AY66phLHnv 2024-09-16T03:36:50.572 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:50.573 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:50.573 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:50.573 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 211 2024-09-16T03:36:50.573 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=211 2024-09-16T03:36:50.573 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:50.573 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:50.573 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.iJAq7xsfPC 2024-09-16T03:36:50.574 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 211 -o /tmp/tmp.iJAq7xsfPC 2024-09-16T03:36:50.990 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 211 2024-09-16T03:36:51.006 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.iJAq7xsfPC 2024-09-16T03:36:51.006 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 211' 2024-09-16T03:36:51.026 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.iJAq7xsfPC' 2024-09-16T03:36:51.028 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 211 2024-09-16T03:36:51.028 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.iJAq7xsfPC 2024-09-16T03:36:51.029 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:51.029 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:51.029 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:51.030 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 212 2024-09-16T03:36:51.030 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=212 2024-09-16T03:36:51.030 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:51.030 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:51.031 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.bmzYW0ks7U 2024-09-16T03:36:51.031 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 212 -o /tmp/tmp.bmzYW0ks7U 2024-09-16T03:36:51.458 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 212 2024-09-16T03:36:51.476 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.bmzYW0ks7U 2024-09-16T03:36:51.476 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 212' 2024-09-16T03:36:51.496 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.bmzYW0ks7U' 2024-09-16T03:36:51.498 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 212 2024-09-16T03:36:51.498 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.bmzYW0ks7U 2024-09-16T03:36:51.499 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:51.499 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:51.500 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:51.500 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 213 2024-09-16T03:36:51.500 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=213 2024-09-16T03:36:51.500 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:51.500 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:51.500 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.aFvpy0P7Bb 2024-09-16T03:36:51.500 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 213 -o /tmp/tmp.aFvpy0P7Bb 2024-09-16T03:36:51.905 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 213 2024-09-16T03:36:51.921 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.aFvpy0P7Bb 2024-09-16T03:36:51.921 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 213' 2024-09-16T03:36:51.941 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.aFvpy0P7Bb' 2024-09-16T03:36:51.943 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 213 2024-09-16T03:36:51.943 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.aFvpy0P7Bb 2024-09-16T03:36:51.944 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:51.944 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:51.945 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:51.945 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 214 2024-09-16T03:36:51.945 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=214 2024-09-16T03:36:51.945 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:51.945 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:51.946 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.JiB1gAM5Ol 2024-09-16T03:36:51.947 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 214 -o /tmp/tmp.JiB1gAM5Ol 2024-09-16T03:36:52.388 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 214 2024-09-16T03:36:52.406 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.JiB1gAM5Ol 2024-09-16T03:36:52.407 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 214' 2024-09-16T03:36:52.427 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.JiB1gAM5Ol' 2024-09-16T03:36:52.428 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 214 2024-09-16T03:36:52.429 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.JiB1gAM5Ol 2024-09-16T03:36:52.430 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:52.430 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:52.430 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:52.430 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 215 2024-09-16T03:36:52.430 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=215 2024-09-16T03:36:52.430 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:52.431 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:52.431 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.zAArXxpCtf 2024-09-16T03:36:52.431 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 215 -o /tmp/tmp.zAArXxpCtf 2024-09-16T03:36:52.848 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 215 2024-09-16T03:36:52.864 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.zAArXxpCtf 2024-09-16T03:36:52.864 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 215' 2024-09-16T03:36:52.883 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.zAArXxpCtf' 2024-09-16T03:36:52.885 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 215 2024-09-16T03:36:52.885 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.zAArXxpCtf 2024-09-16T03:36:52.886 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:52.886 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:52.886 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:52.886 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 216 2024-09-16T03:36:52.886 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=216 2024-09-16T03:36:52.886 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:52.886 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:52.887 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.3Rql00W3xp 2024-09-16T03:36:52.887 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 216 -o /tmp/tmp.3Rql00W3xp 2024-09-16T03:36:53.301 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 216 2024-09-16T03:36:53.315 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.3Rql00W3xp 2024-09-16T03:36:53.315 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 216' 2024-09-16T03:36:53.335 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.3Rql00W3xp' 2024-09-16T03:36:53.336 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 216 2024-09-16T03:36:53.337 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.3Rql00W3xp 2024-09-16T03:36:53.338 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:53.338 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:53.338 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:53.338 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 217 2024-09-16T03:36:53.338 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=217 2024-09-16T03:36:53.338 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:53.338 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:53.339 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.V4Xwd9NgcS 2024-09-16T03:36:53.339 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 217 -o /tmp/tmp.V4Xwd9NgcS 2024-09-16T03:36:53.746 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 217 2024-09-16T03:36:53.762 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.V4Xwd9NgcS 2024-09-16T03:36:53.762 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 217' 2024-09-16T03:36:53.776 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.V4Xwd9NgcS' 2024-09-16T03:36:53.778 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 217 2024-09-16T03:36:53.778 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.V4Xwd9NgcS 2024-09-16T03:36:53.779 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:53.779 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:53.779 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:53.779 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 218 2024-09-16T03:36:53.780 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=218 2024-09-16T03:36:53.780 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:53.780 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:53.780 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.7FeeaAEE8O 2024-09-16T03:36:53.780 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 218 -o /tmp/tmp.7FeeaAEE8O 2024-09-16T03:36:54.159 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 218 2024-09-16T03:36:54.175 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.7FeeaAEE8O 2024-09-16T03:36:54.176 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 218' 2024-09-16T03:36:54.195 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.7FeeaAEE8O' 2024-09-16T03:36:54.197 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 218 2024-09-16T03:36:54.197 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.7FeeaAEE8O 2024-09-16T03:36:54.198 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:54.198 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:54.198 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:54.198 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 219 2024-09-16T03:36:54.199 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=219 2024-09-16T03:36:54.199 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:54.199 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:54.199 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.N7QAyxXlS6 2024-09-16T03:36:54.199 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 219 -o /tmp/tmp.N7QAyxXlS6 2024-09-16T03:36:54.613 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 219 2024-09-16T03:36:54.629 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.N7QAyxXlS6 2024-09-16T03:36:54.629 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 219' 2024-09-16T03:36:54.648 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.N7QAyxXlS6' 2024-09-16T03:36:54.650 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 219 2024-09-16T03:36:54.650 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.N7QAyxXlS6 2024-09-16T03:36:54.651 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:54.651 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:54.651 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:54.651 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 220 2024-09-16T03:36:54.651 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=220 2024-09-16T03:36:54.652 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:54.652 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:54.652 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.YpEy5zHx3w 2024-09-16T03:36:54.652 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 220 -o /tmp/tmp.YpEy5zHx3w 2024-09-16T03:36:55.067 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 220 2024-09-16T03:36:55.083 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.YpEy5zHx3w 2024-09-16T03:36:55.083 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 220' 2024-09-16T03:36:55.103 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.YpEy5zHx3w' 2024-09-16T03:36:55.104 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 220 2024-09-16T03:36:55.105 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.YpEy5zHx3w 2024-09-16T03:36:55.105 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:55.105 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:55.106 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:55.106 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 221 2024-09-16T03:36:55.106 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=221 2024-09-16T03:36:55.106 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:55.106 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:55.106 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.TpZ1MselaK 2024-09-16T03:36:55.107 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 221 -o /tmp/tmp.TpZ1MselaK 2024-09-16T03:36:55.565 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 221 2024-09-16T03:36:55.583 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.TpZ1MselaK 2024-09-16T03:36:55.583 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 221' 2024-09-16T03:36:55.603 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.TpZ1MselaK' 2024-09-16T03:36:55.604 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 221 2024-09-16T03:36:55.605 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.TpZ1MselaK 2024-09-16T03:36:55.606 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:55.606 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:55.606 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:55.606 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 222 2024-09-16T03:36:55.606 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=222 2024-09-16T03:36:55.606 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:55.606 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:55.607 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.uDpa5wHq4J 2024-09-16T03:36:55.608 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 222 -o /tmp/tmp.uDpa5wHq4J 2024-09-16T03:36:56.033 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 222 2024-09-16T03:36:56.049 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.uDpa5wHq4J 2024-09-16T03:36:56.049 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 222' 2024-09-16T03:36:56.068 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.uDpa5wHq4J' 2024-09-16T03:36:56.070 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 222 2024-09-16T03:36:56.070 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.uDpa5wHq4J 2024-09-16T03:36:56.072 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:56.072 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:56.072 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:56.072 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 223 2024-09-16T03:36:56.072 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=223 2024-09-16T03:36:56.072 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:56.072 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:56.073 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.RKp6u0XkSX 2024-09-16T03:36:56.073 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 223 -o /tmp/tmp.RKp6u0XkSX 2024-09-16T03:36:56.509 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 223 2024-09-16T03:36:56.526 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.RKp6u0XkSX 2024-09-16T03:36:56.527 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 223' 2024-09-16T03:36:56.546 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.RKp6u0XkSX' 2024-09-16T03:36:56.548 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 223 2024-09-16T03:36:56.548 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.RKp6u0XkSX 2024-09-16T03:36:56.549 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:56.549 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:56.549 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:56.549 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 224 2024-09-16T03:36:56.550 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=224 2024-09-16T03:36:56.550 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:56.550 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:56.550 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.1V50FDuKMo 2024-09-16T03:36:56.550 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 224 -o /tmp/tmp.1V50FDuKMo 2024-09-16T03:36:57.030 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 224 2024-09-16T03:36:57.047 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.1V50FDuKMo 2024-09-16T03:36:57.047 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 224' 2024-09-16T03:36:57.066 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.1V50FDuKMo' 2024-09-16T03:36:57.067 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 224 2024-09-16T03:36:57.068 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.1V50FDuKMo 2024-09-16T03:36:57.069 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:57.069 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:57.069 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:57.069 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 225 2024-09-16T03:36:57.069 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=225 2024-09-16T03:36:57.069 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:57.069 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:57.070 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.q9Wiv0Lix5 2024-09-16T03:36:57.071 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 225 -o /tmp/tmp.q9Wiv0Lix5 2024-09-16T03:36:57.521 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 225 2024-09-16T03:36:57.540 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.q9Wiv0Lix5 2024-09-16T03:36:57.540 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 225' 2024-09-16T03:36:57.559 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.q9Wiv0Lix5' 2024-09-16T03:36:57.561 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 225 2024-09-16T03:36:57.561 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.q9Wiv0Lix5 2024-09-16T03:36:57.562 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:57.562 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:57.562 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:57.563 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 226 2024-09-16T03:36:57.563 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=226 2024-09-16T03:36:57.563 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:57.563 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:57.563 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.iJLbcvg4Zr 2024-09-16T03:36:57.563 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 226 -o /tmp/tmp.iJLbcvg4Zr 2024-09-16T03:36:58.022 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 226 2024-09-16T03:36:58.041 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.iJLbcvg4Zr 2024-09-16T03:36:58.041 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 226' 2024-09-16T03:36:58.061 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.iJLbcvg4Zr' 2024-09-16T03:36:58.062 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 226 2024-09-16T03:36:58.062 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.iJLbcvg4Zr 2024-09-16T03:36:58.064 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:58.064 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:58.064 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:58.064 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 227 2024-09-16T03:36:58.064 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=227 2024-09-16T03:36:58.064 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:58.064 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:58.065 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.PslXUivyVR 2024-09-16T03:36:58.065 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 227 -o /tmp/tmp.PslXUivyVR 2024-09-16T03:36:58.488 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 227 2024-09-16T03:36:58.505 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.PslXUivyVR 2024-09-16T03:36:58.505 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 227' 2024-09-16T03:36:58.520 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.PslXUivyVR' 2024-09-16T03:36:58.521 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 227 2024-09-16T03:36:58.521 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.PslXUivyVR 2024-09-16T03:36:58.523 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:58.523 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:58.523 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:58.523 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 228 2024-09-16T03:36:58.524 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=228 2024-09-16T03:36:58.524 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:58.524 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:58.524 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.zmuABNOnV4 2024-09-16T03:36:58.524 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 228 -o /tmp/tmp.zmuABNOnV4 2024-09-16T03:36:58.992 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 228 2024-09-16T03:36:59.008 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 228' 2024-09-16T03:36:59.008 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.zmuABNOnV4 2024-09-16T03:36:59.029 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.zmuABNOnV4' 2024-09-16T03:36:59.030 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 228 2024-09-16T03:36:59.030 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.zmuABNOnV4 2024-09-16T03:36:59.032 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:59.032 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:59.032 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:59.032 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 229 2024-09-16T03:36:59.032 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=229 2024-09-16T03:36:59.032 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:59.032 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:59.032 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.4myBcVlgYw 2024-09-16T03:36:59.033 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 229 -o /tmp/tmp.4myBcVlgYw 2024-09-16T03:36:59.468 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 229 2024-09-16T03:36:59.485 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.4myBcVlgYw 2024-09-16T03:36:59.485 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 229' 2024-09-16T03:36:59.505 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.4myBcVlgYw' 2024-09-16T03:36:59.506 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 229 2024-09-16T03:36:59.506 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.4myBcVlgYw 2024-09-16T03:36:59.508 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:59.508 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:59.508 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:59.508 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 230 2024-09-16T03:36:59.508 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=230 2024-09-16T03:36:59.508 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:59.508 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:59.508 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.MFwxfkuHKJ 2024-09-16T03:36:59.509 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 230 -o /tmp/tmp.MFwxfkuHKJ 2024-09-16T03:36:59.913 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 230 2024-09-16T03:36:59.929 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 230' 2024-09-16T03:36:59.930 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.MFwxfkuHKJ 2024-09-16T03:36:59.951 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.MFwxfkuHKJ' 2024-09-16T03:36:59.952 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 230 2024-09-16T03:36:59.953 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.MFwxfkuHKJ 2024-09-16T03:36:59.954 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:36:59.954 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:36:59.954 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:36:59.954 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 231 2024-09-16T03:36:59.954 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=231 2024-09-16T03:36:59.954 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:36:59.954 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:36:59.954 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.k16rEhETDd 2024-09-16T03:36:59.955 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 231 -o /tmp/tmp.k16rEhETDd 2024-09-16T03:37:00.399 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 231 2024-09-16T03:37:00.415 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.k16rEhETDd 2024-09-16T03:37:00.415 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 231' 2024-09-16T03:37:00.435 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.k16rEhETDd' 2024-09-16T03:37:00.436 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 231 2024-09-16T03:37:00.436 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.k16rEhETDd 2024-09-16T03:37:00.437 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:00.437 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:00.437 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:00.437 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 232 2024-09-16T03:37:00.437 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=232 2024-09-16T03:37:00.438 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:00.438 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:00.438 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.o7iREHOLEO 2024-09-16T03:37:00.438 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 232 -o /tmp/tmp.o7iREHOLEO 2024-09-16T03:37:00.827 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 232 2024-09-16T03:37:00.843 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.o7iREHOLEO 2024-09-16T03:37:00.843 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 232' 2024-09-16T03:37:00.862 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.o7iREHOLEO' 2024-09-16T03:37:00.864 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 232 2024-09-16T03:37:00.864 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.o7iREHOLEO 2024-09-16T03:37:00.865 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:00.866 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:00.866 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:00.866 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 233 2024-09-16T03:37:00.866 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=233 2024-09-16T03:37:00.866 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:00.866 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:00.866 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.m2eVUZPWQa 2024-09-16T03:37:00.866 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 233 -o /tmp/tmp.m2eVUZPWQa 2024-09-16T03:37:01.366 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 233 2024-09-16T03:37:01.385 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.m2eVUZPWQa 2024-09-16T03:37:01.385 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 233' 2024-09-16T03:37:01.406 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.m2eVUZPWQa' 2024-09-16T03:37:01.407 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 233 2024-09-16T03:37:01.408 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.m2eVUZPWQa 2024-09-16T03:37:01.409 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:01.409 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:01.409 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:01.409 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 234 2024-09-16T03:37:01.409 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=234 2024-09-16T03:37:01.409 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:01.409 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:01.410 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.vGCKp3ZKg8 2024-09-16T03:37:01.410 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 234 -o /tmp/tmp.vGCKp3ZKg8 2024-09-16T03:37:01.863 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 234 2024-09-16T03:37:01.876 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.vGCKp3ZKg8 2024-09-16T03:37:01.876 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 234' 2024-09-16T03:37:01.895 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.vGCKp3ZKg8' 2024-09-16T03:37:01.897 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 234 2024-09-16T03:37:01.897 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.vGCKp3ZKg8 2024-09-16T03:37:01.899 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:01.899 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:01.899 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:01.899 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 235 2024-09-16T03:37:01.899 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=235 2024-09-16T03:37:01.899 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:01.899 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:01.899 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.BSnDJPF7di 2024-09-16T03:37:01.899 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 235 -o /tmp/tmp.BSnDJPF7di 2024-09-16T03:37:02.337 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 235 2024-09-16T03:37:02.353 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.BSnDJPF7di 2024-09-16T03:37:02.353 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 235' 2024-09-16T03:37:02.373 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.BSnDJPF7di' 2024-09-16T03:37:02.375 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 235 2024-09-16T03:37:02.375 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.BSnDJPF7di 2024-09-16T03:37:02.377 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:02.377 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:02.377 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:02.377 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 236 2024-09-16T03:37:02.377 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=236 2024-09-16T03:37:02.377 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:02.377 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:02.377 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.gweR91x9WZ 2024-09-16T03:37:02.377 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 236 -o /tmp/tmp.gweR91x9WZ 2024-09-16T03:37:02.812 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 236 2024-09-16T03:37:02.830 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.gweR91x9WZ 2024-09-16T03:37:02.830 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 236' 2024-09-16T03:37:02.850 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.gweR91x9WZ' 2024-09-16T03:37:02.851 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 236 2024-09-16T03:37:02.852 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.gweR91x9WZ 2024-09-16T03:37:02.853 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:02.853 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:02.853 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:02.853 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 237 2024-09-16T03:37:02.853 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=237 2024-09-16T03:37:02.853 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:02.854 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:02.854 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.fR6gYYOxo9 2024-09-16T03:37:02.854 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 237 -o /tmp/tmp.fR6gYYOxo9 2024-09-16T03:37:03.281 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 237 2024-09-16T03:37:03.297 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.fR6gYYOxo9 2024-09-16T03:37:03.297 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 237' 2024-09-16T03:37:03.318 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.fR6gYYOxo9' 2024-09-16T03:37:03.319 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 237 2024-09-16T03:37:03.319 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.fR6gYYOxo9 2024-09-16T03:37:03.320 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:03.321 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:03.321 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:03.321 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 238 2024-09-16T03:37:03.321 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=238 2024-09-16T03:37:03.321 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:03.321 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:03.321 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.oazx2uedSS 2024-09-16T03:37:03.321 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 238 -o /tmp/tmp.oazx2uedSS 2024-09-16T03:37:03.711 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 238 2024-09-16T03:37:03.726 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 238' 2024-09-16T03:37:03.726 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.oazx2uedSS 2024-09-16T03:37:03.746 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.oazx2uedSS' 2024-09-16T03:37:03.748 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 238 2024-09-16T03:37:03.748 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.oazx2uedSS 2024-09-16T03:37:03.749 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:03.749 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:03.749 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:03.749 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 239 2024-09-16T03:37:03.750 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=239 2024-09-16T03:37:03.750 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:03.750 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:03.750 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.gL7W0kwpoB 2024-09-16T03:37:03.750 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 239 -o /tmp/tmp.gL7W0kwpoB 2024-09-16T03:37:04.144 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 239 2024-09-16T03:37:04.160 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.gL7W0kwpoB 2024-09-16T03:37:04.161 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 239' 2024-09-16T03:37:04.181 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.gL7W0kwpoB' 2024-09-16T03:37:04.182 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 239 2024-09-16T03:37:04.182 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.gL7W0kwpoB 2024-09-16T03:37:04.183 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:04.183 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:04.184 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:04.184 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 240 2024-09-16T03:37:04.184 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=240 2024-09-16T03:37:04.184 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:04.184 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:04.184 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.B9VO1Wm63h 2024-09-16T03:37:04.184 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 240 -o /tmp/tmp.B9VO1Wm63h 2024-09-16T03:37:04.665 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 240 2024-09-16T03:37:04.684 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.B9VO1Wm63h 2024-09-16T03:37:04.684 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 240' 2024-09-16T03:37:04.704 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.B9VO1Wm63h' 2024-09-16T03:37:04.706 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 240 2024-09-16T03:37:04.706 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.B9VO1Wm63h 2024-09-16T03:37:04.708 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:04.708 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:04.708 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:04.708 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 241 2024-09-16T03:37:04.708 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=241 2024-09-16T03:37:04.708 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:04.708 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:04.709 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.lRjt5p6Bh2 2024-09-16T03:37:04.709 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 241 -o /tmp/tmp.lRjt5p6Bh2 2024-09-16T03:37:05.137 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 241 2024-09-16T03:37:05.155 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.lRjt5p6Bh2 2024-09-16T03:37:05.155 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 241' 2024-09-16T03:37:05.174 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.lRjt5p6Bh2' 2024-09-16T03:37:05.176 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 241 2024-09-16T03:37:05.176 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.lRjt5p6Bh2 2024-09-16T03:37:05.177 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:05.177 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:05.177 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:05.177 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 242 2024-09-16T03:37:05.178 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=242 2024-09-16T03:37:05.178 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:05.178 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:05.178 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.Og8Pccd306 2024-09-16T03:37:05.178 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 242 -o /tmp/tmp.Og8Pccd306 2024-09-16T03:37:05.614 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 242 2024-09-16T03:37:05.630 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.Og8Pccd306 2024-09-16T03:37:05.630 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 242' 2024-09-16T03:37:05.650 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.Og8Pccd306' 2024-09-16T03:37:05.652 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 242 2024-09-16T03:37:05.652 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.Og8Pccd306 2024-09-16T03:37:05.653 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:05.653 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:05.654 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:05.654 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 243 2024-09-16T03:37:05.654 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=243 2024-09-16T03:37:05.654 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:05.654 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:05.654 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.kboZ0RvZmh 2024-09-16T03:37:05.654 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 243 -o /tmp/tmp.kboZ0RvZmh 2024-09-16T03:37:06.090 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 243 2024-09-16T03:37:06.107 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.kboZ0RvZmh 2024-09-16T03:37:06.107 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 243' 2024-09-16T03:37:06.127 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.kboZ0RvZmh' 2024-09-16T03:37:06.128 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 243 2024-09-16T03:37:06.128 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.kboZ0RvZmh 2024-09-16T03:37:06.130 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:06.130 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:06.130 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:06.130 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 244 2024-09-16T03:37:06.130 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=244 2024-09-16T03:37:06.130 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:06.130 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:06.131 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.I7Yxc36yOI 2024-09-16T03:37:06.131 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 244 -o /tmp/tmp.I7Yxc36yOI 2024-09-16T03:37:06.575 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 244 2024-09-16T03:37:06.592 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 244' 2024-09-16T03:37:06.592 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.I7Yxc36yOI 2024-09-16T03:37:06.613 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.I7Yxc36yOI' 2024-09-16T03:37:06.614 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 244 2024-09-16T03:37:06.615 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.I7Yxc36yOI 2024-09-16T03:37:06.616 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:06.616 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:06.616 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:06.616 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 245 2024-09-16T03:37:06.616 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=245 2024-09-16T03:37:06.616 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:06.616 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:06.617 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.GPa5nhY4OI 2024-09-16T03:37:06.617 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 245 -o /tmp/tmp.GPa5nhY4OI 2024-09-16T03:37:07.045 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 245 2024-09-16T03:37:07.060 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 245' 2024-09-16T03:37:07.060 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.GPa5nhY4OI 2024-09-16T03:37:07.080 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.GPa5nhY4OI' 2024-09-16T03:37:07.081 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 245 2024-09-16T03:37:07.082 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.GPa5nhY4OI 2024-09-16T03:37:07.083 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:07.083 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:07.083 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:07.083 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 246 2024-09-16T03:37:07.083 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=246 2024-09-16T03:37:07.083 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:07.083 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:07.084 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.QCusiUEbh9 2024-09-16T03:37:07.084 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 246 -o /tmp/tmp.QCusiUEbh9 2024-09-16T03:37:07.473 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 246 2024-09-16T03:37:07.490 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.QCusiUEbh9 2024-09-16T03:37:07.490 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 246' 2024-09-16T03:37:07.509 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.QCusiUEbh9' 2024-09-16T03:37:07.511 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 246 2024-09-16T03:37:07.511 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.QCusiUEbh9 2024-09-16T03:37:07.512 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:07.513 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:07.513 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:07.513 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 247 2024-09-16T03:37:07.513 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=247 2024-09-16T03:37:07.513 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:07.513 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:07.513 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.XNZytJuyPf 2024-09-16T03:37:07.513 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 247 -o /tmp/tmp.XNZytJuyPf 2024-09-16T03:37:07.963 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 247 2024-09-16T03:37:07.979 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.XNZytJuyPf 2024-09-16T03:37:07.979 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 247' 2024-09-16T03:37:07.998 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.XNZytJuyPf' 2024-09-16T03:37:08.000 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 247 2024-09-16T03:37:08.000 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.XNZytJuyPf 2024-09-16T03:37:08.001 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:08.001 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:08.001 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:08.001 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 248 2024-09-16T03:37:08.001 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=248 2024-09-16T03:37:08.002 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:08.002 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:08.002 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.cz81o3yLmW 2024-09-16T03:37:08.002 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 248 -o /tmp/tmp.cz81o3yLmW 2024-09-16T03:37:08.439 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 248 2024-09-16T03:37:08.458 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.cz81o3yLmW 2024-09-16T03:37:08.458 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 248' 2024-09-16T03:37:08.477 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.cz81o3yLmW' 2024-09-16T03:37:08.478 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 248 2024-09-16T03:37:08.479 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.cz81o3yLmW 2024-09-16T03:37:08.480 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:08.480 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:08.480 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:08.480 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 249 2024-09-16T03:37:08.480 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=249 2024-09-16T03:37:08.480 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:08.480 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:08.481 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.3muzj7Kvp7 2024-09-16T03:37:08.481 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 249 -o /tmp/tmp.3muzj7Kvp7 2024-09-16T03:37:08.892 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 249 2024-09-16T03:37:08.910 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.3muzj7Kvp7 2024-09-16T03:37:08.910 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 249' 2024-09-16T03:37:08.930 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.3muzj7Kvp7' 2024-09-16T03:37:08.932 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 249 2024-09-16T03:37:08.932 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.3muzj7Kvp7 2024-09-16T03:37:08.933 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:08.933 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:08.933 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:08.933 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 250 2024-09-16T03:37:08.933 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=250 2024-09-16T03:37:08.933 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:08.933 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:08.934 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.whI0og17Ak 2024-09-16T03:37:08.934 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 250 -o /tmp/tmp.whI0og17Ak 2024-09-16T03:37:09.384 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 250 2024-09-16T03:37:09.401 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.whI0og17Ak 2024-09-16T03:37:09.402 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 250' 2024-09-16T03:37:09.422 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.whI0og17Ak' 2024-09-16T03:37:09.423 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 250 2024-09-16T03:37:09.424 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.whI0og17Ak 2024-09-16T03:37:09.425 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:09.425 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:09.425 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:09.425 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 251 2024-09-16T03:37:09.425 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=251 2024-09-16T03:37:09.425 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:09.425 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:09.426 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.kMtTpfNTpG 2024-09-16T03:37:09.426 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 251 -o /tmp/tmp.kMtTpfNTpG 2024-09-16T03:37:09.876 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 251 2024-09-16T03:37:09.892 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.kMtTpfNTpG 2024-09-16T03:37:09.892 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 251' 2024-09-16T03:37:09.911 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.kMtTpfNTpG' 2024-09-16T03:37:09.913 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 251 2024-09-16T03:37:09.913 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.kMtTpfNTpG 2024-09-16T03:37:09.914 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:09.914 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:09.915 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:09.915 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 252 2024-09-16T03:37:09.915 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=252 2024-09-16T03:37:09.915 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:09.915 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:09.916 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.LXX6XGcy65 2024-09-16T03:37:09.916 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 252 -o /tmp/tmp.LXX6XGcy65 2024-09-16T03:37:10.362 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 252 2024-09-16T03:37:10.379 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.LXX6XGcy65 2024-09-16T03:37:10.379 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 252' 2024-09-16T03:37:10.397 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.LXX6XGcy65' 2024-09-16T03:37:10.399 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 252 2024-09-16T03:37:10.399 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.LXX6XGcy65 2024-09-16T03:37:10.400 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:10.400 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:10.400 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:10.401 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 253 2024-09-16T03:37:10.401 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=253 2024-09-16T03:37:10.401 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:10.401 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:10.401 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.a5qL517Pq8 2024-09-16T03:37:10.401 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 253 -o /tmp/tmp.a5qL517Pq8 2024-09-16T03:37:10.795 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 253 2024-09-16T03:37:10.811 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.a5qL517Pq8 2024-09-16T03:37:10.811 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 253' 2024-09-16T03:37:10.831 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.a5qL517Pq8' 2024-09-16T03:37:10.833 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 253 2024-09-16T03:37:10.833 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.a5qL517Pq8 2024-09-16T03:37:10.834 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:10.834 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:10.834 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:10.834 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 254 2024-09-16T03:37:10.834 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=254 2024-09-16T03:37:10.834 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:10.835 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:10.835 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.Ht2VQGs0u4 2024-09-16T03:37:10.835 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 254 -o /tmp/tmp.Ht2VQGs0u4 2024-09-16T03:37:11.307 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 254 2024-09-16T03:37:11.325 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.Ht2VQGs0u4 2024-09-16T03:37:11.326 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 254' 2024-09-16T03:37:11.346 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.Ht2VQGs0u4' 2024-09-16T03:37:11.347 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 254 2024-09-16T03:37:11.347 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.Ht2VQGs0u4 2024-09-16T03:37:11.349 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:11.349 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:11.349 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:11.349 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 255 2024-09-16T03:37:11.349 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=255 2024-09-16T03:37:11.349 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:11.349 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:11.350 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.BhWZZWV316 2024-09-16T03:37:11.350 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 255 -o /tmp/tmp.BhWZZWV316 2024-09-16T03:37:11.745 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 255 2024-09-16T03:37:11.759 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.BhWZZWV316 2024-09-16T03:37:11.760 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 255' 2024-09-16T03:37:11.779 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.BhWZZWV316' 2024-09-16T03:37:11.780 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 255 2024-09-16T03:37:11.780 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.BhWZZWV316 2024-09-16T03:37:11.781 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:11.782 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:11.782 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:11.782 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 256 2024-09-16T03:37:11.782 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=256 2024-09-16T03:37:11.782 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:11.782 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:11.782 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.Q2LkIHF08G 2024-09-16T03:37:11.782 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 256 -o /tmp/tmp.Q2LkIHF08G 2024-09-16T03:37:12.251 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 256 2024-09-16T03:37:12.270 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.Q2LkIHF08G 2024-09-16T03:37:12.299 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 256' 2024-09-16T03:37:12.300 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.Q2LkIHF08G' 2024-09-16T03:37:12.300 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 256 2024-09-16T03:37:12.301 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.Q2LkIHF08G 2024-09-16T03:37:12.301 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:12.301 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:12.301 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:12.301 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 257 2024-09-16T03:37:12.301 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=257 2024-09-16T03:37:12.301 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:12.301 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:12.301 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.jJJzYIhVVa 2024-09-16T03:37:12.302 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 257 -o /tmp/tmp.jJJzYIhVVa 2024-09-16T03:37:12.735 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 257 2024-09-16T03:37:12.751 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 257' 2024-09-16T03:37:12.752 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.jJJzYIhVVa 2024-09-16T03:37:12.772 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.jJJzYIhVVa' 2024-09-16T03:37:12.773 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 257 2024-09-16T03:37:12.773 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.jJJzYIhVVa 2024-09-16T03:37:12.774 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:12.774 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:12.774 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:12.774 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 258 2024-09-16T03:37:12.774 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=258 2024-09-16T03:37:12.774 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:12.775 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:12.775 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.3w0omtn3ji 2024-09-16T03:37:12.775 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 258 -o /tmp/tmp.3w0omtn3ji 2024-09-16T03:37:13.183 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 258 2024-09-16T03:37:13.201 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 258' 2024-09-16T03:37:13.201 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.3w0omtn3ji 2024-09-16T03:37:13.222 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.3w0omtn3ji' 2024-09-16T03:37:13.223 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 258 2024-09-16T03:37:13.223 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.3w0omtn3ji 2024-09-16T03:37:13.225 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:13.225 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:13.225 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:13.225 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 259 2024-09-16T03:37:13.225 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=259 2024-09-16T03:37:13.225 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:13.225 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:13.226 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.RuHTUCpsgj 2024-09-16T03:37:13.226 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 259 -o /tmp/tmp.RuHTUCpsgj 2024-09-16T03:37:13.608 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 259 2024-09-16T03:37:13.624 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.RuHTUCpsgj 2024-09-16T03:37:13.624 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 259' 2024-09-16T03:37:13.643 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.RuHTUCpsgj' 2024-09-16T03:37:13.645 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 259 2024-09-16T03:37:13.645 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.RuHTUCpsgj 2024-09-16T03:37:13.646 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:13.646 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:13.646 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:13.646 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 260 2024-09-16T03:37:13.647 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=260 2024-09-16T03:37:13.647 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:13.647 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:13.647 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.8a0y1Nk93h 2024-09-16T03:37:13.647 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 260 -o /tmp/tmp.8a0y1Nk93h 2024-09-16T03:37:14.066 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 260 2024-09-16T03:37:14.083 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.8a0y1Nk93h 2024-09-16T03:37:14.083 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 260' 2024-09-16T03:37:14.103 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.8a0y1Nk93h' 2024-09-16T03:37:14.104 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 260 2024-09-16T03:37:14.104 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.8a0y1Nk93h 2024-09-16T03:37:14.106 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:14.106 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:14.106 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:14.106 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 261 2024-09-16T03:37:14.106 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=261 2024-09-16T03:37:14.107 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:14.107 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:14.107 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.TFqETk189b 2024-09-16T03:37:14.107 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 261 -o /tmp/tmp.TFqETk189b 2024-09-16T03:37:14.566 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 261 2024-09-16T03:37:14.584 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.TFqETk189b 2024-09-16T03:37:14.584 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 261' 2024-09-16T03:37:14.604 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.TFqETk189b' 2024-09-16T03:37:14.610 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 261 2024-09-16T03:37:14.611 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.TFqETk189b 2024-09-16T03:37:14.611 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:14.611 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:14.611 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:14.612 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 262 2024-09-16T03:37:14.612 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=262 2024-09-16T03:37:14.612 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:14.612 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:14.612 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.EDfEzQAmHE 2024-09-16T03:37:14.612 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 262 -o /tmp/tmp.EDfEzQAmHE 2024-09-16T03:37:15.086 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 262 2024-09-16T03:37:15.104 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.EDfEzQAmHE 2024-09-16T03:37:15.105 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 262' 2024-09-16T03:37:15.125 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.EDfEzQAmHE' 2024-09-16T03:37:15.126 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 262 2024-09-16T03:37:15.126 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.EDfEzQAmHE 2024-09-16T03:37:15.127 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:15.128 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:15.128 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:15.128 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 263 2024-09-16T03:37:15.128 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=263 2024-09-16T03:37:15.128 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:15.128 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:15.129 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.79rjSkdZQf 2024-09-16T03:37:15.129 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 263 -o /tmp/tmp.79rjSkdZQf 2024-09-16T03:37:15.579 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 263 2024-09-16T03:37:15.597 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.79rjSkdZQf 2024-09-16T03:37:15.597 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 263' 2024-09-16T03:37:15.617 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.79rjSkdZQf' 2024-09-16T03:37:15.618 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 263 2024-09-16T03:37:15.619 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.79rjSkdZQf 2024-09-16T03:37:15.620 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:15.620 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:15.620 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:15.620 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 264 2024-09-16T03:37:15.621 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=264 2024-09-16T03:37:15.621 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:15.621 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:15.621 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.3V9MkhwTYN 2024-09-16T03:37:15.621 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 264 -o /tmp/tmp.3V9MkhwTYN 2024-09-16T03:37:16.018 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 264 2024-09-16T03:37:16.033 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.3V9MkhwTYN 2024-09-16T03:37:16.034 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 264' 2024-09-16T03:37:16.054 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.3V9MkhwTYN' 2024-09-16T03:37:16.055 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 264 2024-09-16T03:37:16.056 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.3V9MkhwTYN 2024-09-16T03:37:16.057 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:16.057 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:16.057 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:16.057 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 265 2024-09-16T03:37:16.057 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=265 2024-09-16T03:37:16.057 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:16.057 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:16.058 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.rSEwxpGz3D 2024-09-16T03:37:16.058 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 265 -o /tmp/tmp.rSEwxpGz3D 2024-09-16T03:37:16.498 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 265 2024-09-16T03:37:16.514 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.rSEwxpGz3D 2024-09-16T03:37:16.514 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 265' 2024-09-16T03:37:16.534 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.rSEwxpGz3D' 2024-09-16T03:37:16.536 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 265 2024-09-16T03:37:16.536 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.rSEwxpGz3D 2024-09-16T03:37:16.537 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:16.537 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:16.537 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:16.537 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 266 2024-09-16T03:37:16.537 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=266 2024-09-16T03:37:16.538 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:16.538 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:16.538 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.qhEyFOaK3o 2024-09-16T03:37:16.538 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 266 -o /tmp/tmp.qhEyFOaK3o 2024-09-16T03:37:16.944 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 266 2024-09-16T03:37:16.960 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.qhEyFOaK3o 2024-09-16T03:37:16.960 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 266' 2024-09-16T03:37:16.979 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.qhEyFOaK3o' 2024-09-16T03:37:16.981 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 266 2024-09-16T03:37:16.981 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.qhEyFOaK3o 2024-09-16T03:37:16.982 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:16.982 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:16.982 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:16.982 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 267 2024-09-16T03:37:16.982 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=267 2024-09-16T03:37:16.983 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:16.983 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:16.984 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.vDOwXJPF9L 2024-09-16T03:37:16.984 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 267 -o /tmp/tmp.vDOwXJPF9L 2024-09-16T03:37:17.417 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 267 2024-09-16T03:37:17.434 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.vDOwXJPF9L 2024-09-16T03:37:17.435 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 267' 2024-09-16T03:37:17.455 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.vDOwXJPF9L' 2024-09-16T03:37:17.456 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 267 2024-09-16T03:37:17.456 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.vDOwXJPF9L 2024-09-16T03:37:17.458 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:17.458 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:17.458 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:17.458 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 268 2024-09-16T03:37:17.458 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=268 2024-09-16T03:37:17.458 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:17.458 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:17.459 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.GTl6LYJgrV 2024-09-16T03:37:17.459 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 268 -o /tmp/tmp.GTl6LYJgrV 2024-09-16T03:37:17.878 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 268 2024-09-16T03:37:17.894 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.GTl6LYJgrV 2024-09-16T03:37:17.895 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 268' 2024-09-16T03:37:17.914 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.GTl6LYJgrV' 2024-09-16T03:37:17.916 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 268 2024-09-16T03:37:17.916 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.GTl6LYJgrV 2024-09-16T03:37:17.918 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:17.918 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:17.918 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:17.918 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 269 2024-09-16T03:37:17.918 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=269 2024-09-16T03:37:17.918 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:17.918 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:17.919 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.vRI5OiywUI 2024-09-16T03:37:17.919 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 269 -o /tmp/tmp.vRI5OiywUI 2024-09-16T03:37:18.353 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 269 2024-09-16T03:37:18.369 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.vRI5OiywUI 2024-09-16T03:37:18.369 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 269' 2024-09-16T03:37:18.389 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.vRI5OiywUI' 2024-09-16T03:37:18.390 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 269 2024-09-16T03:37:18.390 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.vRI5OiywUI 2024-09-16T03:37:18.392 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:18.392 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:18.392 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:18.392 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 270 2024-09-16T03:37:18.392 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=270 2024-09-16T03:37:18.392 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:18.392 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:18.392 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.vojcowFyqM 2024-09-16T03:37:18.393 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 270 -o /tmp/tmp.vojcowFyqM 2024-09-16T03:37:18.789 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 270 2024-09-16T03:37:18.804 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.vojcowFyqM 2024-09-16T03:37:18.804 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 270' 2024-09-16T03:37:18.824 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.vojcowFyqM' 2024-09-16T03:37:18.825 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 270 2024-09-16T03:37:18.825 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.vojcowFyqM 2024-09-16T03:37:18.827 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:18.827 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:18.827 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:18.827 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 271 2024-09-16T03:37:18.827 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=271 2024-09-16T03:37:18.827 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:18.827 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:18.827 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.Nh752d5tSj 2024-09-16T03:37:18.828 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 271 -o /tmp/tmp.Nh752d5tSj 2024-09-16T03:37:19.230 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 271 2024-09-16T03:37:19.247 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 271' 2024-09-16T03:37:19.247 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.Nh752d5tSj 2024-09-16T03:37:19.267 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.Nh752d5tSj' 2024-09-16T03:37:19.268 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 271 2024-09-16T03:37:19.269 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.Nh752d5tSj 2024-09-16T03:37:19.270 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:19.270 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:19.270 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:19.270 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 272 2024-09-16T03:37:19.270 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=272 2024-09-16T03:37:19.271 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:19.271 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:19.271 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.HAWopuNA5E 2024-09-16T03:37:19.271 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 272 -o /tmp/tmp.HAWopuNA5E 2024-09-16T03:37:19.665 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 272 2024-09-16T03:37:19.682 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.HAWopuNA5E 2024-09-16T03:37:19.682 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 272' 2024-09-16T03:37:19.702 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.HAWopuNA5E' 2024-09-16T03:37:19.703 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 272 2024-09-16T03:37:19.703 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.HAWopuNA5E 2024-09-16T03:37:19.705 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:19.705 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:19.705 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:19.705 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 273 2024-09-16T03:37:19.705 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=273 2024-09-16T03:37:19.705 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:19.705 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:19.706 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.4yoE6la1Ma 2024-09-16T03:37:19.706 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 273 -o /tmp/tmp.4yoE6la1Ma 2024-09-16T03:37:20.219 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 273 2024-09-16T03:37:20.236 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.4yoE6la1Ma 2024-09-16T03:37:20.237 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 273' 2024-09-16T03:37:20.258 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.4yoE6la1Ma' 2024-09-16T03:37:20.259 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 273 2024-09-16T03:37:20.260 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.4yoE6la1Ma 2024-09-16T03:37:20.261 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:20.261 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:20.261 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:20.261 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 274 2024-09-16T03:37:20.261 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=274 2024-09-16T03:37:20.261 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:20.261 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:20.262 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.fCdguPFZNV 2024-09-16T03:37:20.262 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 274 -o /tmp/tmp.fCdguPFZNV 2024-09-16T03:37:20.709 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 274 2024-09-16T03:37:20.727 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.fCdguPFZNV 2024-09-16T03:37:20.727 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 274' 2024-09-16T03:37:20.747 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.fCdguPFZNV' 2024-09-16T03:37:20.748 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 274 2024-09-16T03:37:20.749 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.fCdguPFZNV 2024-09-16T03:37:20.750 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:20.750 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:20.750 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:20.750 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 275 2024-09-16T03:37:20.750 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=275 2024-09-16T03:37:20.750 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:20.751 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:20.751 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.GqMg4fyRlE 2024-09-16T03:37:20.751 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 275 -o /tmp/tmp.GqMg4fyRlE 2024-09-16T03:37:21.214 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 275 2024-09-16T03:37:21.232 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 275' 2024-09-16T03:37:21.232 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.GqMg4fyRlE 2024-09-16T03:37:21.251 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.GqMg4fyRlE' 2024-09-16T03:37:21.252 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 275 2024-09-16T03:37:21.253 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.GqMg4fyRlE 2024-09-16T03:37:21.254 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:21.254 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:21.254 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:21.254 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 276 2024-09-16T03:37:21.254 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=276 2024-09-16T03:37:21.254 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:21.254 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:21.255 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.XLrkCFT4HK 2024-09-16T03:37:21.255 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 276 -o /tmp/tmp.XLrkCFT4HK 2024-09-16T03:37:21.653 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 276 2024-09-16T03:37:21.668 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 276' 2024-09-16T03:37:21.669 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.XLrkCFT4HK 2024-09-16T03:37:21.689 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.XLrkCFT4HK' 2024-09-16T03:37:21.691 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 276 2024-09-16T03:37:21.691 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.XLrkCFT4HK 2024-09-16T03:37:21.692 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:21.692 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:21.692 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:21.693 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 277 2024-09-16T03:37:21.693 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=277 2024-09-16T03:37:21.693 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:21.693 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:21.693 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.EJS2XnISDI 2024-09-16T03:37:21.693 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 277 -o /tmp/tmp.EJS2XnISDI 2024-09-16T03:37:22.074 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 277 2024-09-16T03:37:22.090 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.EJS2XnISDI 2024-09-16T03:37:22.090 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 277' 2024-09-16T03:37:22.109 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.EJS2XnISDI' 2024-09-16T03:37:22.110 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 277 2024-09-16T03:37:22.111 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.EJS2XnISDI 2024-09-16T03:37:22.112 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:22.112 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:22.112 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:22.112 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 278 2024-09-16T03:37:22.112 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=278 2024-09-16T03:37:22.112 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:22.112 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:22.113 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.ixHMnVJTAe 2024-09-16T03:37:22.113 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 278 -o /tmp/tmp.ixHMnVJTAe 2024-09-16T03:37:22.593 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 278 2024-09-16T03:37:22.611 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.ixHMnVJTAe 2024-09-16T03:37:22.612 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 278' 2024-09-16T03:37:22.631 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.ixHMnVJTAe' 2024-09-16T03:37:22.633 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 278 2024-09-16T03:37:22.633 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.ixHMnVJTAe 2024-09-16T03:37:22.634 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:22.635 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:22.635 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:22.635 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 279 2024-09-16T03:37:22.635 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=279 2024-09-16T03:37:22.635 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:22.635 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:22.636 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.XhswJ5xab9 2024-09-16T03:37:22.636 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 279 -o /tmp/tmp.XhswJ5xab9 2024-09-16T03:37:23.045 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 279 2024-09-16T03:37:23.061 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 279' 2024-09-16T03:37:23.061 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.XhswJ5xab9 2024-09-16T03:37:23.082 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.XhswJ5xab9' 2024-09-16T03:37:23.083 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 279 2024-09-16T03:37:23.083 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.XhswJ5xab9 2024-09-16T03:37:23.085 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:23.085 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:23.085 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:23.085 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 280 2024-09-16T03:37:23.085 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=280 2024-09-16T03:37:23.085 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:23.085 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:23.086 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.miwPKJBxl1 2024-09-16T03:37:23.086 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 280 -o /tmp/tmp.miwPKJBxl1 2024-09-16T03:37:23.521 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 280 2024-09-16T03:37:23.537 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.miwPKJBxl1 2024-09-16T03:37:23.537 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 280' 2024-09-16T03:37:23.557 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.miwPKJBxl1' 2024-09-16T03:37:23.558 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 280 2024-09-16T03:37:23.558 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.miwPKJBxl1 2024-09-16T03:37:23.560 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:23.560 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:23.560 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:23.560 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 281 2024-09-16T03:37:23.560 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=281 2024-09-16T03:37:23.560 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:23.560 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:23.561 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.XDpL1CFq0m 2024-09-16T03:37:23.561 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 281 -o /tmp/tmp.XDpL1CFq0m 2024-09-16T03:37:23.951 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 281 2024-09-16T03:37:23.967 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.XDpL1CFq0m 2024-09-16T03:37:23.967 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 281' 2024-09-16T03:37:23.986 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.XDpL1CFq0m' 2024-09-16T03:37:23.988 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 281 2024-09-16T03:37:23.988 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.XDpL1CFq0m 2024-09-16T03:37:23.989 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:23.989 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:23.989 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:23.989 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 282 2024-09-16T03:37:23.990 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=282 2024-09-16T03:37:23.990 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:23.990 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:23.990 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.NCwlfTGCOQ 2024-09-16T03:37:23.990 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 282 -o /tmp/tmp.NCwlfTGCOQ 2024-09-16T03:37:24.499 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 282 2024-09-16T03:37:24.518 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.NCwlfTGCOQ 2024-09-16T03:37:24.518 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 282' 2024-09-16T03:37:24.538 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.NCwlfTGCOQ' 2024-09-16T03:37:24.539 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 282 2024-09-16T03:37:24.540 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.NCwlfTGCOQ 2024-09-16T03:37:24.541 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:24.541 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:24.541 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:24.541 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 283 2024-09-16T03:37:24.541 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=283 2024-09-16T03:37:24.542 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:24.542 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:24.542 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.X3QyDLCRdr 2024-09-16T03:37:24.542 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 283 -o /tmp/tmp.X3QyDLCRdr 2024-09-16T03:37:25.001 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 283 2024-09-16T03:37:25.017 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.X3QyDLCRdr 2024-09-16T03:37:25.017 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 283' 2024-09-16T03:37:25.037 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.X3QyDLCRdr' 2024-09-16T03:37:25.038 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 283 2024-09-16T03:37:25.038 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.X3QyDLCRdr 2024-09-16T03:37:25.039 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:25.040 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:25.040 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:25.040 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 284 2024-09-16T03:37:25.040 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=284 2024-09-16T03:37:25.040 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:25.040 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:25.040 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.nm0IdcaJLs 2024-09-16T03:37:25.041 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 284 -o /tmp/tmp.nm0IdcaJLs 2024-09-16T03:37:25.477 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 284 2024-09-16T03:37:25.495 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 284' 2024-09-16T03:37:25.495 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.nm0IdcaJLs 2024-09-16T03:37:25.515 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.nm0IdcaJLs' 2024-09-16T03:37:25.516 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 284 2024-09-16T03:37:25.517 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.nm0IdcaJLs 2024-09-16T03:37:25.518 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:25.518 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:25.518 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:25.518 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 285 2024-09-16T03:37:25.518 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=285 2024-09-16T03:37:25.518 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:25.518 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:25.519 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.TKIEXA33s2 2024-09-16T03:37:25.519 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 285 -o /tmp/tmp.TKIEXA33s2 2024-09-16T03:37:25.978 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 285 2024-09-16T03:37:25.997 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.TKIEXA33s2 2024-09-16T03:37:25.997 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 285' 2024-09-16T03:37:26.017 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.TKIEXA33s2' 2024-09-16T03:37:26.018 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 285 2024-09-16T03:37:26.019 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.TKIEXA33s2 2024-09-16T03:37:26.020 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:26.020 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:26.020 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:26.020 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 286 2024-09-16T03:37:26.020 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=286 2024-09-16T03:37:26.020 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:26.021 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:26.021 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.a1B4SYiS9L 2024-09-16T03:37:26.021 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 286 -o /tmp/tmp.a1B4SYiS9L 2024-09-16T03:37:26.472 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 286 2024-09-16T03:37:26.492 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.a1B4SYiS9L 2024-09-16T03:37:26.492 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 286' 2024-09-16T03:37:26.506 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.a1B4SYiS9L' 2024-09-16T03:37:26.507 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 286 2024-09-16T03:37:26.507 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.a1B4SYiS9L 2024-09-16T03:37:26.508 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:26.509 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:26.509 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:26.509 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 287 2024-09-16T03:37:26.509 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=287 2024-09-16T03:37:26.509 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:26.509 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:26.509 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.lZ1nRgcM73 2024-09-16T03:37:26.509 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 287 -o /tmp/tmp.lZ1nRgcM73 2024-09-16T03:37:26.990 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 287 2024-09-16T03:37:27.008 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.lZ1nRgcM73 2024-09-16T03:37:27.008 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 287' 2024-09-16T03:37:27.028 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.lZ1nRgcM73' 2024-09-16T03:37:27.029 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 287 2024-09-16T03:37:27.029 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.lZ1nRgcM73 2024-09-16T03:37:27.031 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:27.031 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:27.031 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:27.031 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 288 2024-09-16T03:37:27.031 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=288 2024-09-16T03:37:27.031 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:27.031 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:27.032 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.oc9g7kCBVZ 2024-09-16T03:37:27.032 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 288 -o /tmp/tmp.oc9g7kCBVZ 2024-09-16T03:37:27.477 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 288 2024-09-16T03:37:27.494 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 288' 2024-09-16T03:37:27.494 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.oc9g7kCBVZ 2024-09-16T03:37:27.514 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.oc9g7kCBVZ' 2024-09-16T03:37:27.516 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 288 2024-09-16T03:37:27.516 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.oc9g7kCBVZ 2024-09-16T03:37:27.517 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:27.517 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:27.517 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:27.518 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 289 2024-09-16T03:37:27.518 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=289 2024-09-16T03:37:27.518 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:27.518 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:27.518 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.zirhb2nTA3 2024-09-16T03:37:27.518 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 289 -o /tmp/tmp.zirhb2nTA3 2024-09-16T03:37:27.968 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 289 2024-09-16T03:37:27.986 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.zirhb2nTA3 2024-09-16T03:37:27.986 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 289' 2024-09-16T03:37:28.005 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.zirhb2nTA3' 2024-09-16T03:37:28.007 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 289 2024-09-16T03:37:28.007 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.zirhb2nTA3 2024-09-16T03:37:28.009 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:28.009 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:28.009 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:28.009 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 290 2024-09-16T03:37:28.009 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=290 2024-09-16T03:37:28.009 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:28.009 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:28.010 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.751Eofeyl4 2024-09-16T03:37:28.010 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 290 -o /tmp/tmp.751Eofeyl4 2024-09-16T03:37:28.437 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 290 2024-09-16T03:37:28.453 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.751Eofeyl4 2024-09-16T03:37:28.453 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 290' 2024-09-16T03:37:28.473 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.751Eofeyl4' 2024-09-16T03:37:28.475 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 290 2024-09-16T03:37:28.475 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.751Eofeyl4 2024-09-16T03:37:28.476 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:28.476 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:28.477 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:28.477 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 291 2024-09-16T03:37:28.477 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=291 2024-09-16T03:37:28.477 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:28.477 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:28.477 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.GVoXPVDpk2 2024-09-16T03:37:28.477 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 291 -o /tmp/tmp.GVoXPVDpk2 2024-09-16T03:37:28.898 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 291 2024-09-16T03:37:28.914 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.GVoXPVDpk2 2024-09-16T03:37:28.914 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 291' 2024-09-16T03:37:28.933 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.GVoXPVDpk2' 2024-09-16T03:37:28.935 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 291 2024-09-16T03:37:28.935 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.GVoXPVDpk2 2024-09-16T03:37:28.937 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:28.937 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:28.937 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:28.937 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 292 2024-09-16T03:37:28.937 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=292 2024-09-16T03:37:28.937 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:28.937 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:28.938 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.qFlMyWjyzw 2024-09-16T03:37:28.938 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 292 -o /tmp/tmp.qFlMyWjyzw 2024-09-16T03:37:29.391 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 292 2024-09-16T03:37:29.408 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 292' 2024-09-16T03:37:29.408 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.qFlMyWjyzw 2024-09-16T03:37:29.429 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.qFlMyWjyzw' 2024-09-16T03:37:29.431 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 292 2024-09-16T03:37:29.431 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.qFlMyWjyzw 2024-09-16T03:37:29.432 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:29.432 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:29.433 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:29.433 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 293 2024-09-16T03:37:29.433 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=293 2024-09-16T03:37:29.433 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:29.433 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:29.434 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.QuN1XIb0TH 2024-09-16T03:37:29.434 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 293 -o /tmp/tmp.QuN1XIb0TH 2024-09-16T03:37:29.901 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 293 2024-09-16T03:37:29.918 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.QuN1XIb0TH 2024-09-16T03:37:29.918 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 293' 2024-09-16T03:37:29.938 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.QuN1XIb0TH' 2024-09-16T03:37:29.939 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 293 2024-09-16T03:37:29.940 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.QuN1XIb0TH 2024-09-16T03:37:29.941 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:29.941 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:29.941 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:29.941 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 294 2024-09-16T03:37:29.941 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=294 2024-09-16T03:37:29.941 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:29.941 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:29.942 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.tADzFuLELN 2024-09-16T03:37:29.942 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 294 -o /tmp/tmp.tADzFuLELN 2024-09-16T03:37:30.378 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 294 2024-09-16T03:37:30.395 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.tADzFuLELN 2024-09-16T03:37:30.395 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 294' 2024-09-16T03:37:30.414 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.tADzFuLELN' 2024-09-16T03:37:30.415 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 294 2024-09-16T03:37:30.416 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.tADzFuLELN 2024-09-16T03:37:30.417 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:30.417 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:30.417 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:30.417 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 295 2024-09-16T03:37:30.418 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=295 2024-09-16T03:37:30.418 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:30.418 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:30.419 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.8Tf52h29yD 2024-09-16T03:37:30.419 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 295 -o /tmp/tmp.8Tf52h29yD 2024-09-16T03:37:30.847 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 295 2024-09-16T03:37:30.864 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.8Tf52h29yD 2024-09-16T03:37:30.864 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 295' 2024-09-16T03:37:30.883 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.8Tf52h29yD' 2024-09-16T03:37:30.885 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 295 2024-09-16T03:37:30.885 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.8Tf52h29yD 2024-09-16T03:37:30.886 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:30.887 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:30.887 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:30.887 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 296 2024-09-16T03:37:30.887 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=296 2024-09-16T03:37:30.887 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:30.887 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:30.887 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.fJuXXCWFzg 2024-09-16T03:37:30.888 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 296 -o /tmp/tmp.fJuXXCWFzg 2024-09-16T03:37:31.331 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 296 2024-09-16T03:37:31.348 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.fJuXXCWFzg 2024-09-16T03:37:31.348 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 296' 2024-09-16T03:37:31.367 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.fJuXXCWFzg' 2024-09-16T03:37:31.369 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 296 2024-09-16T03:37:31.369 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.fJuXXCWFzg 2024-09-16T03:37:31.371 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:31.371 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:31.371 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:31.371 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 297 2024-09-16T03:37:31.371 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=297 2024-09-16T03:37:31.371 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:31.371 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:31.372 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.xyZBGqWcri 2024-09-16T03:37:31.372 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 297 -o /tmp/tmp.xyZBGqWcri 2024-09-16T03:37:31.776 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 297 2024-09-16T03:37:31.791 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.xyZBGqWcri 2024-09-16T03:37:31.792 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 297' 2024-09-16T03:37:31.811 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.xyZBGqWcri' 2024-09-16T03:37:31.813 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 297 2024-09-16T03:37:31.813 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.xyZBGqWcri 2024-09-16T03:37:31.816 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:31.816 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:31.816 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:31.816 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 298 2024-09-16T03:37:31.817 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=298 2024-09-16T03:37:31.817 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:31.817 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:31.817 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.v5m021gnn3 2024-09-16T03:37:31.817 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 298 -o /tmp/tmp.v5m021gnn3 2024-09-16T03:37:32.284 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 298 2024-09-16T03:37:32.301 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.v5m021gnn3 2024-09-16T03:37:32.302 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 298' 2024-09-16T03:37:32.317 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.v5m021gnn3' 2024-09-16T03:37:32.318 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 298 2024-09-16T03:37:32.318 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.v5m021gnn3 2024-09-16T03:37:32.319 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:32.319 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:32.319 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:32.320 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 299 2024-09-16T03:37:32.320 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=299 2024-09-16T03:37:32.320 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:32.320 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:32.320 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.c2ION4jsEh 2024-09-16T03:37:32.320 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 299 -o /tmp/tmp.c2ION4jsEh 2024-09-16T03:37:32.832 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 299 2024-09-16T03:37:32.850 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.c2ION4jsEh 2024-09-16T03:37:32.850 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 299' 2024-09-16T03:37:32.869 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.c2ION4jsEh' 2024-09-16T03:37:32.871 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 299 2024-09-16T03:37:32.871 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.c2ION4jsEh 2024-09-16T03:37:32.873 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:32.873 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:32.873 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:32.873 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 300 2024-09-16T03:37:32.873 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=300 2024-09-16T03:37:32.873 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:32.873 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:32.874 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.0ndMpUGFmW 2024-09-16T03:37:32.874 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 300 -o /tmp/tmp.0ndMpUGFmW 2024-09-16T03:37:33.312 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 300 2024-09-16T03:37:33.330 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.0ndMpUGFmW 2024-09-16T03:37:33.330 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 300' 2024-09-16T03:37:33.345 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.0ndMpUGFmW' 2024-09-16T03:37:33.346 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 300 2024-09-16T03:37:33.347 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.0ndMpUGFmW 2024-09-16T03:37:33.348 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:33.348 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:33.348 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:33.348 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 301 2024-09-16T03:37:33.349 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=301 2024-09-16T03:37:33.349 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:33.349 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:33.349 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.oKSA3PYrnS 2024-09-16T03:37:33.349 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 301 -o /tmp/tmp.oKSA3PYrnS 2024-09-16T03:37:33.797 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 301 2024-09-16T03:37:33.814 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.oKSA3PYrnS 2024-09-16T03:37:33.814 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 301' 2024-09-16T03:37:33.833 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.oKSA3PYrnS' 2024-09-16T03:37:33.835 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 301 2024-09-16T03:37:33.835 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.oKSA3PYrnS 2024-09-16T03:37:33.836 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:33.836 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:33.836 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:33.836 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 302 2024-09-16T03:37:33.836 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=302 2024-09-16T03:37:33.837 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:33.837 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:33.837 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.sjtIBGBVIa 2024-09-16T03:37:33.837 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 302 -o /tmp/tmp.sjtIBGBVIa 2024-09-16T03:37:34.282 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 302 2024-09-16T03:37:34.298 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.sjtIBGBVIa 2024-09-16T03:37:34.299 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 302' 2024-09-16T03:37:34.318 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.sjtIBGBVIa' 2024-09-16T03:37:34.319 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 302 2024-09-16T03:37:34.320 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.sjtIBGBVIa 2024-09-16T03:37:34.321 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:34.321 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:34.321 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:34.321 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 303 2024-09-16T03:37:34.321 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=303 2024-09-16T03:37:34.321 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:34.321 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:34.322 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.IsngkNyFqC 2024-09-16T03:37:34.322 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 303 -o /tmp/tmp.IsngkNyFqC 2024-09-16T03:37:34.750 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 303 2024-09-16T03:37:34.767 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.IsngkNyFqC 2024-09-16T03:37:34.767 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 303' 2024-09-16T03:37:34.786 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.IsngkNyFqC' 2024-09-16T03:37:34.788 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 303 2024-09-16T03:37:34.788 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.IsngkNyFqC 2024-09-16T03:37:34.789 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:34.789 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:34.789 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:34.789 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 304 2024-09-16T03:37:34.789 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=304 2024-09-16T03:37:34.790 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:34.790 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:34.790 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.sa4X03CyF9 2024-09-16T03:37:34.790 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 304 -o /tmp/tmp.sa4X03CyF9 2024-09-16T03:37:35.253 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 304 2024-09-16T03:37:35.270 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.sa4X03CyF9 2024-09-16T03:37:35.270 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 304' 2024-09-16T03:37:35.290 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.sa4X03CyF9' 2024-09-16T03:37:35.291 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 304 2024-09-16T03:37:35.291 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.sa4X03CyF9 2024-09-16T03:37:35.293 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:35.293 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:35.293 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:35.293 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 305 2024-09-16T03:37:35.294 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=305 2024-09-16T03:37:35.294 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:35.294 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:35.294 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.F7syjbDvlo 2024-09-16T03:37:35.294 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 305 -o /tmp/tmp.F7syjbDvlo 2024-09-16T03:37:35.729 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 305 2024-09-16T03:37:35.746 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.F7syjbDvlo 2024-09-16T03:37:35.746 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 305' 2024-09-16T03:37:35.765 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.F7syjbDvlo' 2024-09-16T03:37:35.767 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 305 2024-09-16T03:37:35.767 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.F7syjbDvlo 2024-09-16T03:37:35.769 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:35.770 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:35.770 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:35.770 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 306 2024-09-16T03:37:35.770 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=306 2024-09-16T03:37:35.770 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:35.770 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:35.771 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.E938W9aZyX 2024-09-16T03:37:35.771 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 306 -o /tmp/tmp.E938W9aZyX 2024-09-16T03:37:36.180 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 306 2024-09-16T03:37:36.196 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.E938W9aZyX 2024-09-16T03:37:36.196 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 306' 2024-09-16T03:37:36.216 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.E938W9aZyX' 2024-09-16T03:37:36.217 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 306 2024-09-16T03:37:36.217 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.E938W9aZyX 2024-09-16T03:37:36.219 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:36.219 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:36.219 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:36.219 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 307 2024-09-16T03:37:36.220 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=307 2024-09-16T03:37:36.220 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:36.220 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:36.222 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.PqVuY4aIBB 2024-09-16T03:37:36.222 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 307 -o /tmp/tmp.PqVuY4aIBB 2024-09-16T03:37:36.615 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 307 2024-09-16T03:37:36.631 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.PqVuY4aIBB 2024-09-16T03:37:36.631 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 307' 2024-09-16T03:37:36.651 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.PqVuY4aIBB' 2024-09-16T03:37:36.652 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 307 2024-09-16T03:37:36.652 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.PqVuY4aIBB 2024-09-16T03:37:36.653 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:36.653 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:36.653 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:36.654 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 308 2024-09-16T03:37:36.654 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=308 2024-09-16T03:37:36.654 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:36.654 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:36.654 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.eye6fHJKyx 2024-09-16T03:37:36.654 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 308 -o /tmp/tmp.eye6fHJKyx 2024-09-16T03:37:37.153 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 308 2024-09-16T03:37:37.170 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.eye6fHJKyx 2024-09-16T03:37:37.170 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 308' 2024-09-16T03:37:37.189 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.eye6fHJKyx' 2024-09-16T03:37:37.191 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 308 2024-09-16T03:37:37.191 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.eye6fHJKyx 2024-09-16T03:37:37.192 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:37.192 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:37.192 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:37.192 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 309 2024-09-16T03:37:37.192 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=309 2024-09-16T03:37:37.193 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:37.193 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:37.194 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.hvcg083Asn 2024-09-16T03:37:37.194 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 309 -o /tmp/tmp.hvcg083Asn 2024-09-16T03:37:37.592 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 309 2024-09-16T03:37:37.609 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 309' 2024-09-16T03:37:37.609 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.hvcg083Asn 2024-09-16T03:37:37.630 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.hvcg083Asn' 2024-09-16T03:37:37.631 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 309 2024-09-16T03:37:37.632 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.hvcg083Asn 2024-09-16T03:37:37.633 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:37.633 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:37.633 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:37.633 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 310 2024-09-16T03:37:37.633 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=310 2024-09-16T03:37:37.633 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:37.633 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:37.634 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.ijiIdr2AXA 2024-09-16T03:37:37.634 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 310 -o /tmp/tmp.ijiIdr2AXA 2024-09-16T03:37:38.036 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 310 2024-09-16T03:37:38.052 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.ijiIdr2AXA 2024-09-16T03:37:38.052 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 310' 2024-09-16T03:37:38.071 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.ijiIdr2AXA' 2024-09-16T03:37:38.073 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 310 2024-09-16T03:37:38.073 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.ijiIdr2AXA 2024-09-16T03:37:38.074 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:38.074 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:38.074 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:38.074 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 311 2024-09-16T03:37:38.074 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=311 2024-09-16T03:37:38.075 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:38.075 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:38.075 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.ZRyNY42p7j 2024-09-16T03:37:38.075 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 311 -o /tmp/tmp.ZRyNY42p7j 2024-09-16T03:37:38.482 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 311 2024-09-16T03:37:38.498 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.ZRyNY42p7j 2024-09-16T03:37:38.498 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 311' 2024-09-16T03:37:38.517 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.ZRyNY42p7j' 2024-09-16T03:37:38.519 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 311 2024-09-16T03:37:38.519 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.ZRyNY42p7j 2024-09-16T03:37:38.520 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:38.520 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:38.521 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:38.521 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 312 2024-09-16T03:37:38.521 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=312 2024-09-16T03:37:38.521 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:38.521 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:38.521 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.ug47DZvtQw 2024-09-16T03:37:38.521 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 312 -o /tmp/tmp.ug47DZvtQw 2024-09-16T03:37:38.949 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 312 2024-09-16T03:37:38.965 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.ug47DZvtQw 2024-09-16T03:37:38.965 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 312' 2024-09-16T03:37:38.985 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.ug47DZvtQw' 2024-09-16T03:37:38.989 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 312 2024-09-16T03:37:38.990 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.ug47DZvtQw 2024-09-16T03:37:38.990 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:38.990 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:38.990 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:38.990 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 313 2024-09-16T03:37:38.990 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=313 2024-09-16T03:37:38.990 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:38.991 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:38.991 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.PM5KOgzzFx 2024-09-16T03:37:38.991 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 313 -o /tmp/tmp.PM5KOgzzFx 2024-09-16T03:37:39.396 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 313 2024-09-16T03:37:39.409 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.PM5KOgzzFx 2024-09-16T03:37:39.409 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 313' 2024-09-16T03:37:39.430 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.PM5KOgzzFx' 2024-09-16T03:37:39.432 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 313 2024-09-16T03:37:39.432 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.PM5KOgzzFx 2024-09-16T03:37:39.433 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:39.433 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:39.433 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:39.433 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 314 2024-09-16T03:37:39.433 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=314 2024-09-16T03:37:39.433 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:39.433 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:39.434 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.E7NqmgOw2G 2024-09-16T03:37:39.434 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 314 -o /tmp/tmp.E7NqmgOw2G 2024-09-16T03:37:39.861 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 314 2024-09-16T03:37:39.878 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.E7NqmgOw2G 2024-09-16T03:37:39.878 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 314' 2024-09-16T03:37:39.898 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.E7NqmgOw2G' 2024-09-16T03:37:39.899 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 314 2024-09-16T03:37:39.899 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.E7NqmgOw2G 2024-09-16T03:37:39.901 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:39.901 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:39.901 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:39.901 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 315 2024-09-16T03:37:39.901 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=315 2024-09-16T03:37:39.901 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:39.901 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:39.902 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.G3504biogV 2024-09-16T03:37:39.902 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 315 -o /tmp/tmp.G3504biogV 2024-09-16T03:37:40.345 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 315 2024-09-16T03:37:40.362 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.G3504biogV 2024-09-16T03:37:40.363 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 315' 2024-09-16T03:37:40.383 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.G3504biogV' 2024-09-16T03:37:40.384 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 315 2024-09-16T03:37:40.384 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.G3504biogV 2024-09-16T03:37:40.386 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:40.386 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:40.386 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:40.386 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 316 2024-09-16T03:37:40.386 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=316 2024-09-16T03:37:40.386 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:40.386 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:40.386 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.4krqlB0K22 2024-09-16T03:37:40.387 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 316 -o /tmp/tmp.4krqlB0K22 2024-09-16T03:37:40.793 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 316 2024-09-16T03:37:40.809 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.4krqlB0K22 2024-09-16T03:37:40.809 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 316' 2024-09-16T03:37:40.829 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.4krqlB0K22' 2024-09-16T03:37:40.831 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 316 2024-09-16T03:37:40.831 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.4krqlB0K22 2024-09-16T03:37:40.832 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:40.832 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:40.832 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:40.832 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 317 2024-09-16T03:37:40.833 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=317 2024-09-16T03:37:40.833 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:40.833 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:40.833 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.7DTxE37j61 2024-09-16T03:37:40.833 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 317 -o /tmp/tmp.7DTxE37j61 2024-09-16T03:37:41.273 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 317 2024-09-16T03:37:41.290 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.7DTxE37j61 2024-09-16T03:37:41.290 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 317' 2024-09-16T03:37:41.309 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.7DTxE37j61' 2024-09-16T03:37:41.310 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 317 2024-09-16T03:37:41.311 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.7DTxE37j61 2024-09-16T03:37:41.312 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:41.312 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:41.312 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:41.312 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 318 2024-09-16T03:37:41.312 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=318 2024-09-16T03:37:41.312 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:41.313 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:41.313 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.H3VLbLh2Th 2024-09-16T03:37:41.313 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 318 -o /tmp/tmp.H3VLbLh2Th 2024-09-16T03:37:41.758 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 318 2024-09-16T03:37:41.775 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.H3VLbLh2Th 2024-09-16T03:37:41.775 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 318' 2024-09-16T03:37:41.794 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.H3VLbLh2Th' 2024-09-16T03:37:41.796 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 318 2024-09-16T03:37:41.796 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.H3VLbLh2Th 2024-09-16T03:37:41.797 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:41.797 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:41.798 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:41.798 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 319 2024-09-16T03:37:41.798 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=319 2024-09-16T03:37:41.798 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:41.798 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:41.798 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.qr2GZvjvZG 2024-09-16T03:37:41.798 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 319 -o /tmp/tmp.qr2GZvjvZG 2024-09-16T03:37:42.252 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 319 2024-09-16T03:37:42.268 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.qr2GZvjvZG 2024-09-16T03:37:42.269 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 319' 2024-09-16T03:37:42.288 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.qr2GZvjvZG' 2024-09-16T03:37:42.289 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 319 2024-09-16T03:37:42.290 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.qr2GZvjvZG 2024-09-16T03:37:42.291 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:42.291 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:42.291 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:42.291 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 320 2024-09-16T03:37:42.291 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=320 2024-09-16T03:37:42.291 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:42.291 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:42.292 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.xMFEukYJUd 2024-09-16T03:37:42.292 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 320 -o /tmp/tmp.xMFEukYJUd 2024-09-16T03:37:42.691 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 320 2024-09-16T03:37:42.707 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 320' 2024-09-16T03:37:42.707 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.xMFEukYJUd 2024-09-16T03:37:42.727 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.xMFEukYJUd' 2024-09-16T03:37:42.729 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 320 2024-09-16T03:37:42.729 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.xMFEukYJUd 2024-09-16T03:37:42.730 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:42.730 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:42.730 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:42.730 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 321 2024-09-16T03:37:42.730 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=321 2024-09-16T03:37:42.731 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:42.731 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:42.731 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.Ob0ZLDilE2 2024-09-16T03:37:42.731 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 321 -o /tmp/tmp.Ob0ZLDilE2 2024-09-16T03:37:43.222 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 321 2024-09-16T03:37:43.242 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.Ob0ZLDilE2 2024-09-16T03:37:43.275 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 321' 2024-09-16T03:37:43.276 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.Ob0ZLDilE2' 2024-09-16T03:37:43.277 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 321 2024-09-16T03:37:43.277 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.Ob0ZLDilE2 2024-09-16T03:37:43.278 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:43.278 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:43.278 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:43.278 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 322 2024-09-16T03:37:43.278 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=322 2024-09-16T03:37:43.278 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:43.278 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:43.278 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.zYrI7ZWrCm 2024-09-16T03:37:43.278 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 322 -o /tmp/tmp.zYrI7ZWrCm 2024-09-16T03:37:43.700 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 322 2024-09-16T03:37:43.715 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.zYrI7ZWrCm 2024-09-16T03:37:43.715 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 322' 2024-09-16T03:37:43.734 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.zYrI7ZWrCm' 2024-09-16T03:37:43.735 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 322 2024-09-16T03:37:43.736 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.zYrI7ZWrCm 2024-09-16T03:37:43.737 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:43.737 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:43.737 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:43.737 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 323 2024-09-16T03:37:43.737 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=323 2024-09-16T03:37:43.737 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:43.737 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:43.738 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.pXsUz5y1ud 2024-09-16T03:37:43.738 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 323 -o /tmp/tmp.pXsUz5y1ud 2024-09-16T03:37:44.192 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 323 2024-09-16T03:37:44.210 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.pXsUz5y1ud 2024-09-16T03:37:44.210 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 323' 2024-09-16T03:37:44.230 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.pXsUz5y1ud' 2024-09-16T03:37:44.231 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 323 2024-09-16T03:37:44.232 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.pXsUz5y1ud 2024-09-16T03:37:44.233 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:44.233 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:44.233 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:44.233 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 324 2024-09-16T03:37:44.233 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=324 2024-09-16T03:37:44.233 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:44.234 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:44.235 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.ZM659LV3bV 2024-09-16T03:37:44.235 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 324 -o /tmp/tmp.ZM659LV3bV 2024-09-16T03:37:44.749 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 324 2024-09-16T03:37:44.768 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.ZM659LV3bV 2024-09-16T03:37:44.768 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 324' 2024-09-16T03:37:44.789 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.ZM659LV3bV' 2024-09-16T03:37:44.790 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 324 2024-09-16T03:37:44.791 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.ZM659LV3bV 2024-09-16T03:37:44.792 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:44.792 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:44.792 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:44.792 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 325 2024-09-16T03:37:44.792 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=325 2024-09-16T03:37:44.792 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:44.792 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:44.793 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.HSN7KH4XHA 2024-09-16T03:37:44.793 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 325 -o /tmp/tmp.HSN7KH4XHA 2024-09-16T03:37:45.262 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 325 2024-09-16T03:37:45.280 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.HSN7KH4XHA 2024-09-16T03:37:45.280 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 325' 2024-09-16T03:37:45.299 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.HSN7KH4XHA' 2024-09-16T03:37:45.301 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 325 2024-09-16T03:37:45.301 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.HSN7KH4XHA 2024-09-16T03:37:45.302 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:45.302 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:45.302 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:45.302 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 326 2024-09-16T03:37:45.303 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=326 2024-09-16T03:37:45.303 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:45.303 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:45.303 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.w92KAxwNw8 2024-09-16T03:37:45.303 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 326 -o /tmp/tmp.w92KAxwNw8 2024-09-16T03:37:45.747 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 326 2024-09-16T03:37:45.763 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.w92KAxwNw8 2024-09-16T03:37:45.763 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 326' 2024-09-16T03:37:45.778 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.w92KAxwNw8' 2024-09-16T03:37:45.779 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 326 2024-09-16T03:37:45.780 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.w92KAxwNw8 2024-09-16T03:37:45.781 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:45.781 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:45.781 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:45.781 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 327 2024-09-16T03:37:45.781 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=327 2024-09-16T03:37:45.781 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:45.781 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:45.782 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.cx1HkqxrNj 2024-09-16T03:37:45.782 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 327 -o /tmp/tmp.cx1HkqxrNj 2024-09-16T03:37:46.182 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 327 2024-09-16T03:37:46.197 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.cx1HkqxrNj 2024-09-16T03:37:46.197 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 327' 2024-09-16T03:37:46.217 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.cx1HkqxrNj' 2024-09-16T03:37:46.218 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 327 2024-09-16T03:37:46.219 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.cx1HkqxrNj 2024-09-16T03:37:46.220 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:46.220 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:46.220 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:46.220 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 328 2024-09-16T03:37:46.220 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=328 2024-09-16T03:37:46.220 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:46.220 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:46.221 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.ownTbBvgU4 2024-09-16T03:37:46.221 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 328 -o /tmp/tmp.ownTbBvgU4 2024-09-16T03:37:46.681 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 328 2024-09-16T03:37:46.700 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.ownTbBvgU4 2024-09-16T03:37:46.700 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 328' 2024-09-16T03:37:46.720 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.ownTbBvgU4' 2024-09-16T03:37:46.721 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 328 2024-09-16T03:37:46.722 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.ownTbBvgU4 2024-09-16T03:37:46.724 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:46.724 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:46.724 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:46.724 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 329 2024-09-16T03:37:46.724 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=329 2024-09-16T03:37:46.724 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:46.724 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:46.724 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.VLJLqQJnj0 2024-09-16T03:37:46.725 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 329 -o /tmp/tmp.VLJLqQJnj0 2024-09-16T03:37:47.128 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 329 2024-09-16T03:37:47.144 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.VLJLqQJnj0 2024-09-16T03:37:47.144 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 329' 2024-09-16T03:37:47.164 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.VLJLqQJnj0' 2024-09-16T03:37:47.165 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 329 2024-09-16T03:37:47.165 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.VLJLqQJnj0 2024-09-16T03:37:47.167 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:47.167 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:47.167 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:47.167 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 330 2024-09-16T03:37:47.167 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=330 2024-09-16T03:37:47.168 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:47.168 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:47.168 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.BnGHz11xOt 2024-09-16T03:37:47.168 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 330 -o /tmp/tmp.BnGHz11xOt 2024-09-16T03:37:47.621 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 330 2024-09-16T03:37:47.637 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.BnGHz11xOt 2024-09-16T03:37:47.638 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 330' 2024-09-16T03:37:47.657 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.BnGHz11xOt' 2024-09-16T03:37:47.658 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 330 2024-09-16T03:37:47.659 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.BnGHz11xOt 2024-09-16T03:37:47.660 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:47.660 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:47.660 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:47.660 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 331 2024-09-16T03:37:47.660 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=331 2024-09-16T03:37:47.661 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:47.661 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:47.661 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.Q4N4zR1zDf 2024-09-16T03:37:47.661 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 331 -o /tmp/tmp.Q4N4zR1zDf 2024-09-16T03:37:48.088 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 331 2024-09-16T03:37:48.106 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.Q4N4zR1zDf 2024-09-16T03:37:48.106 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 331' 2024-09-16T03:37:48.125 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.Q4N4zR1zDf' 2024-09-16T03:37:48.127 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 331 2024-09-16T03:37:48.127 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.Q4N4zR1zDf 2024-09-16T03:37:48.128 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:48.129 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:48.129 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:48.129 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 332 2024-09-16T03:37:48.129 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=332 2024-09-16T03:37:48.129 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:48.129 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:48.130 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.tRjAs5ygPw 2024-09-16T03:37:48.130 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 332 -o /tmp/tmp.tRjAs5ygPw 2024-09-16T03:37:48.722 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 332 2024-09-16T03:37:48.741 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.tRjAs5ygPw 2024-09-16T03:37:48.741 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 332' 2024-09-16T03:37:48.761 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.tRjAs5ygPw' 2024-09-16T03:37:48.762 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 332 2024-09-16T03:37:48.762 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.tRjAs5ygPw 2024-09-16T03:37:48.764 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:48.764 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:48.764 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:48.764 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 333 2024-09-16T03:37:48.764 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=333 2024-09-16T03:37:48.764 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:48.765 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:48.765 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.O7bdYXxp4p 2024-09-16T03:37:48.765 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 333 -o /tmp/tmp.O7bdYXxp4p 2024-09-16T03:37:49.176 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 333 2024-09-16T03:37:49.192 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.O7bdYXxp4p 2024-09-16T03:37:49.192 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 333' 2024-09-16T03:37:49.212 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.O7bdYXxp4p' 2024-09-16T03:37:49.213 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 333 2024-09-16T03:37:49.213 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.O7bdYXxp4p 2024-09-16T03:37:49.215 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:49.215 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:49.215 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:49.215 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 334 2024-09-16T03:37:49.215 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=334 2024-09-16T03:37:49.215 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:49.215 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:49.216 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.g0rSU4EEWJ 2024-09-16T03:37:49.216 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 334 -o /tmp/tmp.g0rSU4EEWJ 2024-09-16T03:37:49.662 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 334 2024-09-16T03:37:49.679 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.g0rSU4EEWJ 2024-09-16T03:37:49.679 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 334' 2024-09-16T03:37:49.698 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.g0rSU4EEWJ' 2024-09-16T03:37:49.700 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 334 2024-09-16T03:37:49.700 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.g0rSU4EEWJ 2024-09-16T03:37:49.701 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:49.701 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:49.701 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:49.701 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 335 2024-09-16T03:37:49.701 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=335 2024-09-16T03:37:49.701 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:49.701 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:49.702 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.YYhsyxnKZv 2024-09-16T03:37:49.702 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 335 -o /tmp/tmp.YYhsyxnKZv 2024-09-16T03:37:50.138 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 335 2024-09-16T03:37:50.155 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.YYhsyxnKZv 2024-09-16T03:37:50.155 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 335' 2024-09-16T03:37:50.175 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.YYhsyxnKZv' 2024-09-16T03:37:50.176 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 335 2024-09-16T03:37:50.177 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.YYhsyxnKZv 2024-09-16T03:37:50.178 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:50.178 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:50.178 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:50.178 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 336 2024-09-16T03:37:50.178 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=336 2024-09-16T03:37:50.178 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:50.178 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:50.178 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.yZ753lfmOj 2024-09-16T03:37:50.179 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 336 -o /tmp/tmp.yZ753lfmOj 2024-09-16T03:37:50.602 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 336 2024-09-16T03:37:50.620 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.yZ753lfmOj 2024-09-16T03:37:50.620 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 336' 2024-09-16T03:37:50.640 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.yZ753lfmOj' 2024-09-16T03:37:50.642 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 336 2024-09-16T03:37:50.642 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.yZ753lfmOj 2024-09-16T03:37:50.643 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:50.643 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:50.643 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:50.643 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 337 2024-09-16T03:37:50.643 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=337 2024-09-16T03:37:50.643 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:50.644 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:50.644 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.UHu5YIvtf5 2024-09-16T03:37:50.644 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 337 -o /tmp/tmp.UHu5YIvtf5 2024-09-16T03:37:51.118 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 337 2024-09-16T03:37:51.135 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.UHu5YIvtf5 2024-09-16T03:37:51.135 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 337' 2024-09-16T03:37:51.155 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.UHu5YIvtf5' 2024-09-16T03:37:51.157 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 337 2024-09-16T03:37:51.157 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.UHu5YIvtf5 2024-09-16T03:37:51.158 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:51.158 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:51.158 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:51.158 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 338 2024-09-16T03:37:51.158 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=338 2024-09-16T03:37:51.158 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:51.158 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:51.159 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.Y9pNe1TT3g 2024-09-16T03:37:51.159 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 338 -o /tmp/tmp.Y9pNe1TT3g 2024-09-16T03:37:51.668 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 338 2024-09-16T03:37:51.688 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.Y9pNe1TT3g 2024-09-16T03:37:51.688 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 338' 2024-09-16T03:37:51.708 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.Y9pNe1TT3g' 2024-09-16T03:37:51.709 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 338 2024-09-16T03:37:51.709 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.Y9pNe1TT3g 2024-09-16T03:37:51.711 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:51.711 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:51.711 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:51.711 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 339 2024-09-16T03:37:51.711 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=339 2024-09-16T03:37:51.712 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:51.712 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:51.712 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.pxqRxzVnt9 2024-09-16T03:37:51.712 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 339 -o /tmp/tmp.pxqRxzVnt9 2024-09-16T03:37:52.192 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 339 2024-09-16T03:37:52.211 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.pxqRxzVnt9 2024-09-16T03:37:52.212 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 339' 2024-09-16T03:37:52.232 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.pxqRxzVnt9' 2024-09-16T03:37:52.233 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 339 2024-09-16T03:37:52.234 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.pxqRxzVnt9 2024-09-16T03:37:52.235 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:52.235 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:52.235 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:52.235 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 340 2024-09-16T03:37:52.235 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=340 2024-09-16T03:37:52.235 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:52.235 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:52.236 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.wElW910Kpn 2024-09-16T03:37:52.236 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 340 -o /tmp/tmp.wElW910Kpn 2024-09-16T03:37:52.790 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 340 2024-09-16T03:37:52.807 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.wElW910Kpn 2024-09-16T03:37:52.807 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 340' 2024-09-16T03:37:52.827 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.wElW910Kpn' 2024-09-16T03:37:52.829 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 340 2024-09-16T03:37:52.829 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.wElW910Kpn 2024-09-16T03:37:52.831 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:52.831 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:52.831 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:52.831 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 341 2024-09-16T03:37:52.831 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=341 2024-09-16T03:37:52.831 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:52.832 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:52.832 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.uXiJstey3k 2024-09-16T03:37:52.832 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 341 -o /tmp/tmp.uXiJstey3k 2024-09-16T03:37:53.277 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 341 2024-09-16T03:37:53.293 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.uXiJstey3k 2024-09-16T03:37:53.294 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 341' 2024-09-16T03:37:53.314 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.uXiJstey3k' 2024-09-16T03:37:53.315 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 341 2024-09-16T03:37:53.316 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.uXiJstey3k 2024-09-16T03:37:53.317 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:53.317 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:53.317 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:53.317 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 342 2024-09-16T03:37:53.317 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=342 2024-09-16T03:37:53.317 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:53.317 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:53.318 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.uOtYScUFXN 2024-09-16T03:37:53.318 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 342 -o /tmp/tmp.uOtYScUFXN 2024-09-16T03:37:53.752 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 342 2024-09-16T03:37:53.768 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.uOtYScUFXN 2024-09-16T03:37:53.768 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 342' 2024-09-16T03:37:53.787 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.uOtYScUFXN' 2024-09-16T03:37:53.789 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 342 2024-09-16T03:37:53.789 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.uOtYScUFXN 2024-09-16T03:37:53.790 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:53.790 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:53.790 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:53.790 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 343 2024-09-16T03:37:53.791 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=343 2024-09-16T03:37:53.791 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:53.791 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:53.791 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.m2n99rbP3P 2024-09-16T03:37:53.791 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 343 -o /tmp/tmp.m2n99rbP3P 2024-09-16T03:37:54.228 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 343 2024-09-16T03:37:54.246 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.m2n99rbP3P 2024-09-16T03:37:54.246 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 343' 2024-09-16T03:37:54.266 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.m2n99rbP3P' 2024-09-16T03:37:54.268 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 343 2024-09-16T03:37:54.268 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.m2n99rbP3P 2024-09-16T03:37:54.269 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:54.269 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:54.269 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:54.269 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 344 2024-09-16T03:37:54.269 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=344 2024-09-16T03:37:54.269 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:54.269 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:54.270 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.qAb5yPWiTh 2024-09-16T03:37:54.270 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 344 -o /tmp/tmp.qAb5yPWiTh 2024-09-16T03:37:54.667 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 344 2024-09-16T03:37:54.683 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.qAb5yPWiTh 2024-09-16T03:37:54.683 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 344' 2024-09-16T03:37:54.703 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.qAb5yPWiTh' 2024-09-16T03:37:54.704 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 344 2024-09-16T03:37:54.704 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.qAb5yPWiTh 2024-09-16T03:37:54.706 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:54.706 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:54.706 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:54.706 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 345 2024-09-16T03:37:54.706 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=345 2024-09-16T03:37:54.706 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:54.706 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:54.707 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.Jj1eFE0AVz 2024-09-16T03:37:54.707 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 345 -o /tmp/tmp.Jj1eFE0AVz 2024-09-16T03:37:55.166 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 345 2024-09-16T03:37:55.183 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.Jj1eFE0AVz 2024-09-16T03:37:55.183 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 345' 2024-09-16T03:37:55.198 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.Jj1eFE0AVz' 2024-09-16T03:37:55.199 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 345 2024-09-16T03:37:55.199 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.Jj1eFE0AVz 2024-09-16T03:37:55.201 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:55.201 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:55.201 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:55.201 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 346 2024-09-16T03:37:55.201 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=346 2024-09-16T03:37:55.201 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:55.201 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:55.202 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.vnC3kE9OQh 2024-09-16T03:37:55.202 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 346 -o /tmp/tmp.vnC3kE9OQh 2024-09-16T03:37:55.667 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 346 2024-09-16T03:37:55.683 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.vnC3kE9OQh 2024-09-16T03:37:55.683 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 346' 2024-09-16T03:37:55.703 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.vnC3kE9OQh' 2024-09-16T03:37:55.704 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 346 2024-09-16T03:37:55.705 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.vnC3kE9OQh 2024-09-16T03:37:55.706 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:55.706 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:55.706 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:55.706 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 347 2024-09-16T03:37:55.706 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=347 2024-09-16T03:37:55.706 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:55.706 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:55.707 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.GgzkjRIYjm 2024-09-16T03:37:55.707 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 347 -o /tmp/tmp.GgzkjRIYjm 2024-09-16T03:37:56.143 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 347 2024-09-16T03:37:56.160 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.GgzkjRIYjm 2024-09-16T03:37:56.160 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 347' 2024-09-16T03:37:56.179 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.GgzkjRIYjm' 2024-09-16T03:37:56.180 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 347 2024-09-16T03:37:56.181 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.GgzkjRIYjm 2024-09-16T03:37:56.182 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:56.182 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:56.182 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:56.182 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 348 2024-09-16T03:37:56.182 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=348 2024-09-16T03:37:56.182 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:56.182 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:56.183 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.UhMPRNrIfn 2024-09-16T03:37:56.183 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 348 -o /tmp/tmp.UhMPRNrIfn 2024-09-16T03:37:56.658 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 348 2024-09-16T03:37:56.675 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.UhMPRNrIfn 2024-09-16T03:37:56.676 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 348' 2024-09-16T03:37:56.695 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.UhMPRNrIfn' 2024-09-16T03:37:56.697 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 348 2024-09-16T03:37:56.697 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.UhMPRNrIfn 2024-09-16T03:37:56.698 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:56.698 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:56.698 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:56.698 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 349 2024-09-16T03:37:56.698 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=349 2024-09-16T03:37:56.698 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:56.699 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:56.699 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.6N2GZlgaHR 2024-09-16T03:37:56.699 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 349 -o /tmp/tmp.6N2GZlgaHR 2024-09-16T03:37:57.132 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 349 2024-09-16T03:37:57.148 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.6N2GZlgaHR 2024-09-16T03:37:57.148 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 349' 2024-09-16T03:37:57.167 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.6N2GZlgaHR' 2024-09-16T03:37:57.168 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 349 2024-09-16T03:37:57.169 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.6N2GZlgaHR 2024-09-16T03:37:57.170 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:57.170 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:57.170 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:57.170 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 350 2024-09-16T03:37:57.170 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=350 2024-09-16T03:37:57.170 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:57.170 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:57.171 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.5enzKjgH1k 2024-09-16T03:37:57.171 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 350 -o /tmp/tmp.5enzKjgH1k 2024-09-16T03:37:57.624 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 350 2024-09-16T03:37:57.642 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.5enzKjgH1k 2024-09-16T03:37:57.642 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 350' 2024-09-16T03:37:57.662 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.5enzKjgH1k' 2024-09-16T03:37:57.663 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 350 2024-09-16T03:37:57.663 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.5enzKjgH1k 2024-09-16T03:37:57.665 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:57.665 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:57.665 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:57.665 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 351 2024-09-16T03:37:57.665 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=351 2024-09-16T03:37:57.665 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:57.665 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:57.666 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.ZOvfzUoWh8 2024-09-16T03:37:57.666 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 351 -o /tmp/tmp.ZOvfzUoWh8 2024-09-16T03:37:58.070 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 351 2024-09-16T03:37:58.086 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.ZOvfzUoWh8 2024-09-16T03:37:58.086 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 351' 2024-09-16T03:37:58.105 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.ZOvfzUoWh8' 2024-09-16T03:37:58.107 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 351 2024-09-16T03:37:58.107 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.ZOvfzUoWh8 2024-09-16T03:37:58.108 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:58.108 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:58.109 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:58.109 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 352 2024-09-16T03:37:58.109 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=352 2024-09-16T03:37:58.109 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:58.109 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:58.109 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.ckIoS9U7C0 2024-09-16T03:37:58.109 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 352 -o /tmp/tmp.ckIoS9U7C0 2024-09-16T03:37:58.602 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 352 2024-09-16T03:37:58.618 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.ckIoS9U7C0 2024-09-16T03:37:58.619 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 352' 2024-09-16T03:37:58.638 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.ckIoS9U7C0' 2024-09-16T03:37:58.639 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 352 2024-09-16T03:37:58.640 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.ckIoS9U7C0 2024-09-16T03:37:58.641 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:58.641 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:58.641 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:58.641 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 353 2024-09-16T03:37:58.641 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=353 2024-09-16T03:37:58.641 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:58.641 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:58.642 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.btUZUFOu0i 2024-09-16T03:37:58.642 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 353 -o /tmp/tmp.btUZUFOu0i 2024-09-16T03:37:59.107 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 353 2024-09-16T03:37:59.123 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 353' 2024-09-16T03:37:59.124 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.btUZUFOu0i 2024-09-16T03:37:59.143 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.btUZUFOu0i' 2024-09-16T03:37:59.145 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 353 2024-09-16T03:37:59.145 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.btUZUFOu0i 2024-09-16T03:37:59.146 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:59.146 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:59.146 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:59.146 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 354 2024-09-16T03:37:59.147 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=354 2024-09-16T03:37:59.147 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:59.147 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:59.147 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.HO9XFADlUv 2024-09-16T03:37:59.147 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 354 -o /tmp/tmp.HO9XFADlUv 2024-09-16T03:37:59.646 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 354 2024-09-16T03:37:59.664 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.HO9XFADlUv 2024-09-16T03:37:59.664 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 354' 2024-09-16T03:37:59.684 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.HO9XFADlUv' 2024-09-16T03:37:59.686 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 354 2024-09-16T03:37:59.686 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.HO9XFADlUv 2024-09-16T03:37:59.687 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:37:59.687 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:37:59.687 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:37:59.687 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 355 2024-09-16T03:37:59.687 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=355 2024-09-16T03:37:59.687 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:37:59.687 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:37:59.688 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.RPhL1yZsb8 2024-09-16T03:37:59.688 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 355 -o /tmp/tmp.RPhL1yZsb8 2024-09-16T03:38:00.124 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 355 2024-09-16T03:38:00.140 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.RPhL1yZsb8 2024-09-16T03:38:00.140 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 355' 2024-09-16T03:38:00.160 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.RPhL1yZsb8' 2024-09-16T03:38:00.162 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 355 2024-09-16T03:38:00.162 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.RPhL1yZsb8 2024-09-16T03:38:00.163 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:00.163 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:00.163 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:00.164 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 356 2024-09-16T03:38:00.164 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=356 2024-09-16T03:38:00.164 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:00.164 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:00.164 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.NjlGAh4dLD 2024-09-16T03:38:00.164 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 356 -o /tmp/tmp.NjlGAh4dLD 2024-09-16T03:38:00.592 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 356 2024-09-16T03:38:00.609 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.NjlGAh4dLD 2024-09-16T03:38:00.609 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 356' 2024-09-16T03:38:00.628 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.NjlGAh4dLD' 2024-09-16T03:38:00.629 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 356 2024-09-16T03:38:00.630 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.NjlGAh4dLD 2024-09-16T03:38:00.631 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:00.631 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:00.631 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:00.631 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 357 2024-09-16T03:38:00.631 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=357 2024-09-16T03:38:00.631 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:00.632 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:00.632 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.7SDhLCYIyZ 2024-09-16T03:38:00.632 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 357 -o /tmp/tmp.7SDhLCYIyZ 2024-09-16T03:38:01.113 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 357 2024-09-16T03:38:01.130 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.7SDhLCYIyZ 2024-09-16T03:38:01.131 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 357' 2024-09-16T03:38:01.150 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.7SDhLCYIyZ' 2024-09-16T03:38:01.152 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 357 2024-09-16T03:38:01.152 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.7SDhLCYIyZ 2024-09-16T03:38:01.153 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:01.153 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:01.153 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:01.153 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 358 2024-09-16T03:38:01.153 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=358 2024-09-16T03:38:01.154 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:01.154 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:01.154 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.9oAyTHCQ0O 2024-09-16T03:38:01.154 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 358 -o /tmp/tmp.9oAyTHCQ0O 2024-09-16T03:38:01.600 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 358 2024-09-16T03:38:01.615 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.9oAyTHCQ0O 2024-09-16T03:38:01.615 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 358' 2024-09-16T03:38:01.635 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.9oAyTHCQ0O' 2024-09-16T03:38:01.637 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 358 2024-09-16T03:38:01.637 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.9oAyTHCQ0O 2024-09-16T03:38:01.638 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:01.638 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:01.638 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:01.638 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 359 2024-09-16T03:38:01.638 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=359 2024-09-16T03:38:01.638 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:01.638 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:01.639 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.dtRch4Sbem 2024-09-16T03:38:01.639 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 359 -o /tmp/tmp.dtRch4Sbem 2024-09-16T03:38:02.055 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 359 2024-09-16T03:38:02.071 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 359' 2024-09-16T03:38:02.072 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.dtRch4Sbem 2024-09-16T03:38:02.091 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.dtRch4Sbem' 2024-09-16T03:38:02.093 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 359 2024-09-16T03:38:02.093 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.dtRch4Sbem 2024-09-16T03:38:02.095 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:02.095 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:02.095 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:02.095 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 360 2024-09-16T03:38:02.095 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=360 2024-09-16T03:38:02.095 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:02.095 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:02.095 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.bCLI9kD3JF 2024-09-16T03:38:02.095 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 360 -o /tmp/tmp.bCLI9kD3JF 2024-09-16T03:38:02.532 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 360 2024-09-16T03:38:02.548 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.bCLI9kD3JF 2024-09-16T03:38:02.548 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 360' 2024-09-16T03:38:02.563 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.bCLI9kD3JF' 2024-09-16T03:38:02.565 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 360 2024-09-16T03:38:02.565 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.bCLI9kD3JF 2024-09-16T03:38:02.566 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:02.566 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:02.566 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:02.566 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 361 2024-09-16T03:38:02.566 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=361 2024-09-16T03:38:02.567 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:02.567 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:02.567 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.90nBvLE598 2024-09-16T03:38:02.567 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 361 -o /tmp/tmp.90nBvLE598 2024-09-16T03:38:02.991 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 361 2024-09-16T03:38:03.006 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.90nBvLE598 2024-09-16T03:38:03.007 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 361' 2024-09-16T03:38:03.027 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.90nBvLE598' 2024-09-16T03:38:03.029 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 361 2024-09-16T03:38:03.029 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.90nBvLE598 2024-09-16T03:38:03.030 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:03.030 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:03.030 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:03.030 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 362 2024-09-16T03:38:03.030 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=362 2024-09-16T03:38:03.030 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:03.030 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:03.031 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.GvYBeTq9jV 2024-09-16T03:38:03.031 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 362 -o /tmp/tmp.GvYBeTq9jV 2024-09-16T03:38:03.489 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 362 2024-09-16T03:38:03.507 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.GvYBeTq9jV 2024-09-16T03:38:03.508 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 362' 2024-09-16T03:38:03.527 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.GvYBeTq9jV' 2024-09-16T03:38:03.528 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 362 2024-09-16T03:38:03.529 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.GvYBeTq9jV 2024-09-16T03:38:03.530 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:03.530 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:03.530 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:03.530 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 363 2024-09-16T03:38:03.530 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=363 2024-09-16T03:38:03.530 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:03.530 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:03.531 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.VNaAKt1cHk 2024-09-16T03:38:03.531 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 363 -o /tmp/tmp.VNaAKt1cHk 2024-09-16T03:38:03.987 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 363 2024-09-16T03:38:04.004 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.VNaAKt1cHk 2024-09-16T03:38:04.004 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 363' 2024-09-16T03:38:04.024 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.VNaAKt1cHk' 2024-09-16T03:38:04.025 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 363 2024-09-16T03:38:04.026 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.VNaAKt1cHk 2024-09-16T03:38:04.027 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:04.027 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:04.027 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:04.027 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 364 2024-09-16T03:38:04.027 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=364 2024-09-16T03:38:04.027 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:04.027 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:04.028 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.APwnpXmdM7 2024-09-16T03:38:04.028 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 364 -o /tmp/tmp.APwnpXmdM7 2024-09-16T03:38:04.471 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 364 2024-09-16T03:38:04.487 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.APwnpXmdM7 2024-09-16T03:38:04.488 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 364' 2024-09-16T03:38:04.507 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.APwnpXmdM7' 2024-09-16T03:38:04.509 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 364 2024-09-16T03:38:04.509 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.APwnpXmdM7 2024-09-16T03:38:04.510 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:04.510 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:04.510 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:04.510 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 365 2024-09-16T03:38:04.510 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=365 2024-09-16T03:38:04.511 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:04.511 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:04.511 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.h64anxSAng 2024-09-16T03:38:04.511 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 365 -o /tmp/tmp.h64anxSAng 2024-09-16T03:38:04.998 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 365 2024-09-16T03:38:05.015 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.h64anxSAng 2024-09-16T03:38:05.015 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 365' 2024-09-16T03:38:05.034 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.h64anxSAng' 2024-09-16T03:38:05.036 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 365 2024-09-16T03:38:05.036 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.h64anxSAng 2024-09-16T03:38:05.041 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:05.041 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:05.042 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:05.042 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 366 2024-09-16T03:38:05.042 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=366 2024-09-16T03:38:05.042 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:05.042 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:05.042 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.6VpkmFul8F 2024-09-16T03:38:05.042 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 366 -o /tmp/tmp.6VpkmFul8F 2024-09-16T03:38:05.491 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 366 2024-09-16T03:38:05.509 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.6VpkmFul8F 2024-09-16T03:38:05.509 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 366' 2024-09-16T03:38:05.530 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.6VpkmFul8F' 2024-09-16T03:38:05.532 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 366 2024-09-16T03:38:05.532 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.6VpkmFul8F 2024-09-16T03:38:05.533 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:05.533 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:05.533 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:05.533 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 367 2024-09-16T03:38:05.533 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=367 2024-09-16T03:38:05.533 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:05.534 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:05.534 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.Q62ZOS4mIj 2024-09-16T03:38:05.534 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 367 -o /tmp/tmp.Q62ZOS4mIj 2024-09-16T03:38:05.984 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 367 2024-09-16T03:38:06.001 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.Q62ZOS4mIj 2024-09-16T03:38:06.002 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 367' 2024-09-16T03:38:06.023 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.Q62ZOS4mIj' 2024-09-16T03:38:06.024 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 367 2024-09-16T03:38:06.024 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.Q62ZOS4mIj 2024-09-16T03:38:06.026 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:06.026 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:06.026 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:06.026 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 368 2024-09-16T03:38:06.026 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=368 2024-09-16T03:38:06.026 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:06.027 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:06.027 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.miOzGrH3a7 2024-09-16T03:38:06.027 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 368 -o /tmp/tmp.miOzGrH3a7 2024-09-16T03:38:06.486 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 368 2024-09-16T03:38:06.505 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.miOzGrH3a7 2024-09-16T03:38:06.505 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 368' 2024-09-16T03:38:06.525 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.miOzGrH3a7' 2024-09-16T03:38:06.526 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 368 2024-09-16T03:38:06.526 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.miOzGrH3a7 2024-09-16T03:38:06.528 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:06.528 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:06.528 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:06.528 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 369 2024-09-16T03:38:06.528 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=369 2024-09-16T03:38:06.528 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:06.528 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:06.529 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.Mmq6FPYHzD 2024-09-16T03:38:06.529 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 369 -o /tmp/tmp.Mmq6FPYHzD 2024-09-16T03:38:06.946 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 369 2024-09-16T03:38:06.962 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.Mmq6FPYHzD 2024-09-16T03:38:06.962 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 369' 2024-09-16T03:38:06.982 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.Mmq6FPYHzD' 2024-09-16T03:38:06.984 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 369 2024-09-16T03:38:06.984 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.Mmq6FPYHzD 2024-09-16T03:38:06.985 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:06.986 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:06.986 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:06.986 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 370 2024-09-16T03:38:06.986 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=370 2024-09-16T03:38:06.986 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:06.986 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:06.986 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.O1LmThbnIG 2024-09-16T03:38:06.986 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 370 -o /tmp/tmp.O1LmThbnIG 2024-09-16T03:38:07.473 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 370 2024-09-16T03:38:07.489 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.O1LmThbnIG 2024-09-16T03:38:07.489 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 370' 2024-09-16T03:38:07.508 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.O1LmThbnIG' 2024-09-16T03:38:07.510 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 370 2024-09-16T03:38:07.510 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.O1LmThbnIG 2024-09-16T03:38:07.511 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:07.511 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:07.512 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:07.512 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 371 2024-09-16T03:38:07.512 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=371 2024-09-16T03:38:07.512 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:07.512 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:07.512 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.hvX1NM7cJb 2024-09-16T03:38:07.512 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 371 -o /tmp/tmp.hvX1NM7cJb 2024-09-16T03:38:07.957 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 371 2024-09-16T03:38:07.974 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.hvX1NM7cJb 2024-09-16T03:38:07.974 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 371' 2024-09-16T03:38:07.994 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.hvX1NM7cJb' 2024-09-16T03:38:07.995 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 371 2024-09-16T03:38:07.996 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.hvX1NM7cJb 2024-09-16T03:38:07.997 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:07.997 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:07.997 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:07.997 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 372 2024-09-16T03:38:07.997 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=372 2024-09-16T03:38:07.997 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:07.997 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:07.998 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.3aUOVy1WHF 2024-09-16T03:38:07.998 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 372 -o /tmp/tmp.3aUOVy1WHF 2024-09-16T03:38:08.434 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 372 2024-09-16T03:38:08.451 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.3aUOVy1WHF 2024-09-16T03:38:08.451 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 372' 2024-09-16T03:38:08.470 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.3aUOVy1WHF' 2024-09-16T03:38:08.472 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 372 2024-09-16T03:38:08.472 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.3aUOVy1WHF 2024-09-16T03:38:08.473 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:08.474 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:08.474 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:08.474 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 373 2024-09-16T03:38:08.474 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=373 2024-09-16T03:38:08.474 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:08.474 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:08.474 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.p5YArb6Zk3 2024-09-16T03:38:08.475 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 373 -o /tmp/tmp.p5YArb6Zk3 2024-09-16T03:38:08.886 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 373 2024-09-16T03:38:08.902 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.p5YArb6Zk3 2024-09-16T03:38:08.902 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 373' 2024-09-16T03:38:08.922 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.p5YArb6Zk3' 2024-09-16T03:38:08.924 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 373 2024-09-16T03:38:08.924 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.p5YArb6Zk3 2024-09-16T03:38:08.925 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:08.925 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:08.925 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:08.925 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 374 2024-09-16T03:38:08.925 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=374 2024-09-16T03:38:08.925 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:08.926 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:08.926 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.HNzJZFn6zy 2024-09-16T03:38:08.926 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 374 -o /tmp/tmp.HNzJZFn6zy 2024-09-16T03:38:09.330 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 374 2024-09-16T03:38:09.346 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.HNzJZFn6zy 2024-09-16T03:38:09.346 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 374' 2024-09-16T03:38:09.367 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.HNzJZFn6zy' 2024-09-16T03:38:09.368 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 374 2024-09-16T03:38:09.368 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.HNzJZFn6zy 2024-09-16T03:38:09.370 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:09.370 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:09.371 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:09.371 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 375 2024-09-16T03:38:09.371 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=375 2024-09-16T03:38:09.371 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:09.371 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:09.371 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.5B36R4OFdv 2024-09-16T03:38:09.371 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 375 -o /tmp/tmp.5B36R4OFdv 2024-09-16T03:38:09.822 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 375 2024-09-16T03:38:09.839 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.5B36R4OFdv 2024-09-16T03:38:09.839 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 375' 2024-09-16T03:38:09.858 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.5B36R4OFdv' 2024-09-16T03:38:09.860 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 375 2024-09-16T03:38:09.860 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.5B36R4OFdv 2024-09-16T03:38:09.861 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:09.861 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:09.862 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:09.862 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 376 2024-09-16T03:38:09.862 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=376 2024-09-16T03:38:09.862 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:09.862 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:09.862 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.ubpfoyI4zL 2024-09-16T03:38:09.862 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 376 -o /tmp/tmp.ubpfoyI4zL 2024-09-16T03:38:10.298 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 376 2024-09-16T03:38:10.315 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.ubpfoyI4zL 2024-09-16T03:38:10.315 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 376' 2024-09-16T03:38:10.330 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.ubpfoyI4zL' 2024-09-16T03:38:10.332 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 376 2024-09-16T03:38:10.332 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.ubpfoyI4zL 2024-09-16T03:38:10.333 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:10.334 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:10.334 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:10.334 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 377 2024-09-16T03:38:10.334 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=377 2024-09-16T03:38:10.334 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:10.334 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:10.334 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.pXpMvw8Tj0 2024-09-16T03:38:10.335 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 377 -o /tmp/tmp.pXpMvw8Tj0 2024-09-16T03:38:10.792 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 377 2024-09-16T03:38:10.810 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.pXpMvw8Tj0 2024-09-16T03:38:10.810 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 377' 2024-09-16T03:38:10.830 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.pXpMvw8Tj0' 2024-09-16T03:38:10.832 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 377 2024-09-16T03:38:10.832 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.pXpMvw8Tj0 2024-09-16T03:38:10.834 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:10.834 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:10.834 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:10.834 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 378 2024-09-16T03:38:10.834 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=378 2024-09-16T03:38:10.834 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:10.835 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:10.835 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.k5bOwx1zwU 2024-09-16T03:38:10.835 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 378 -o /tmp/tmp.k5bOwx1zwU 2024-09-16T03:38:11.302 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 378 2024-09-16T03:38:11.320 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.k5bOwx1zwU 2024-09-16T03:38:11.321 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 378' 2024-09-16T03:38:11.340 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.k5bOwx1zwU' 2024-09-16T03:38:11.342 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 378 2024-09-16T03:38:11.342 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.k5bOwx1zwU 2024-09-16T03:38:11.343 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:11.343 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:11.343 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:11.343 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 379 2024-09-16T03:38:11.343 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=379 2024-09-16T03:38:11.343 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:11.344 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:11.344 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.EuVLIlUdDZ 2024-09-16T03:38:11.344 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 379 -o /tmp/tmp.EuVLIlUdDZ 2024-09-16T03:38:11.804 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 379 2024-09-16T03:38:11.821 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.EuVLIlUdDZ 2024-09-16T03:38:11.821 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 379' 2024-09-16T03:38:11.841 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.EuVLIlUdDZ' 2024-09-16T03:38:11.843 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 379 2024-09-16T03:38:11.843 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.EuVLIlUdDZ 2024-09-16T03:38:11.844 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:11.844 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:11.845 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:11.845 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 380 2024-09-16T03:38:11.845 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=380 2024-09-16T03:38:11.845 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:11.845 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:11.845 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.cep3T1Oq9W 2024-09-16T03:38:11.845 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 380 -o /tmp/tmp.cep3T1Oq9W 2024-09-16T03:38:12.289 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 380 2024-09-16T03:38:12.306 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.cep3T1Oq9W 2024-09-16T03:38:12.306 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 380' 2024-09-16T03:38:12.325 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.cep3T1Oq9W' 2024-09-16T03:38:12.327 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 380 2024-09-16T03:38:12.327 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.cep3T1Oq9W 2024-09-16T03:38:12.329 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:12.329 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:12.329 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:12.329 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 381 2024-09-16T03:38:12.329 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=381 2024-09-16T03:38:12.329 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:12.329 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:12.330 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.D1LOdaJhll 2024-09-16T03:38:12.330 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 381 -o /tmp/tmp.D1LOdaJhll 2024-09-16T03:38:12.790 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 381 2024-09-16T03:38:12.807 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.D1LOdaJhll 2024-09-16T03:38:12.807 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 381' 2024-09-16T03:38:12.826 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.D1LOdaJhll' 2024-09-16T03:38:12.828 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 381 2024-09-16T03:38:12.828 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.D1LOdaJhll 2024-09-16T03:38:12.829 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:12.830 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:12.830 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:12.830 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 382 2024-09-16T03:38:12.830 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=382 2024-09-16T03:38:12.830 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:12.830 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:12.830 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.Xc2j6GO429 2024-09-16T03:38:12.830 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 382 -o /tmp/tmp.Xc2j6GO429 2024-09-16T03:38:13.225 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 382 2024-09-16T03:38:13.241 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 382' 2024-09-16T03:38:13.241 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.Xc2j6GO429 2024-09-16T03:38:13.262 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.Xc2j6GO429' 2024-09-16T03:38:13.263 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 382 2024-09-16T03:38:13.264 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.Xc2j6GO429 2024-09-16T03:38:13.265 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:13.265 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:13.265 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:13.265 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 383 2024-09-16T03:38:13.265 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=383 2024-09-16T03:38:13.265 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:13.266 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:13.266 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.E7MHlBf4qF 2024-09-16T03:38:13.266 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 383 -o /tmp/tmp.E7MHlBf4qF 2024-09-16T03:38:13.735 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 383 2024-09-16T03:38:13.751 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 383' 2024-09-16T03:38:13.751 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.E7MHlBf4qF 2024-09-16T03:38:13.771 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.E7MHlBf4qF' 2024-09-16T03:38:13.772 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 383 2024-09-16T03:38:13.773 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.E7MHlBf4qF 2024-09-16T03:38:13.774 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:13.774 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:13.774 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:13.774 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 384 2024-09-16T03:38:13.774 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=384 2024-09-16T03:38:13.774 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:13.774 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:13.775 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.CT3i10TtQF 2024-09-16T03:38:13.775 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 384 -o /tmp/tmp.CT3i10TtQF 2024-09-16T03:38:14.237 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 384 2024-09-16T03:38:14.256 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.CT3i10TtQF 2024-09-16T03:38:14.256 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 384' 2024-09-16T03:38:14.276 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.CT3i10TtQF' 2024-09-16T03:38:14.277 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 384 2024-09-16T03:38:14.278 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.CT3i10TtQF 2024-09-16T03:38:14.279 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:14.279 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:14.279 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:14.279 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 385 2024-09-16T03:38:14.279 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=385 2024-09-16T03:38:14.279 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:14.280 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:14.280 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.E0XUeflGKs 2024-09-16T03:38:14.280 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 385 -o /tmp/tmp.E0XUeflGKs 2024-09-16T03:38:14.710 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 385 2024-09-16T03:38:14.727 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.E0XUeflGKs 2024-09-16T03:38:14.727 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 385' 2024-09-16T03:38:14.747 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.E0XUeflGKs' 2024-09-16T03:38:14.749 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 385 2024-09-16T03:38:14.749 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.E0XUeflGKs 2024-09-16T03:38:14.750 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:14.750 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:14.750 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:14.750 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 386 2024-09-16T03:38:14.750 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=386 2024-09-16T03:38:14.750 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:14.751 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:14.751 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.jUM3EIO9hM 2024-09-16T03:38:14.751 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 386 -o /tmp/tmp.jUM3EIO9hM 2024-09-16T03:38:15.214 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 386 2024-09-16T03:38:15.232 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.jUM3EIO9hM 2024-09-16T03:38:15.232 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 386' 2024-09-16T03:38:15.254 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.jUM3EIO9hM' 2024-09-16T03:38:15.256 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 386 2024-09-16T03:38:15.256 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.jUM3EIO9hM 2024-09-16T03:38:15.257 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:15.257 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:15.257 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:15.257 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 387 2024-09-16T03:38:15.257 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=387 2024-09-16T03:38:15.258 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:15.258 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:15.258 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.woxmhmt1GP 2024-09-16T03:38:15.258 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 387 -o /tmp/tmp.woxmhmt1GP 2024-09-16T03:38:15.709 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 387 2024-09-16T03:38:15.726 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.woxmhmt1GP 2024-09-16T03:38:15.726 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 387' 2024-09-16T03:38:15.747 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.woxmhmt1GP' 2024-09-16T03:38:15.748 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 387 2024-09-16T03:38:15.748 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.woxmhmt1GP 2024-09-16T03:38:15.750 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:15.750 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:15.750 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:15.750 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 388 2024-09-16T03:38:15.750 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=388 2024-09-16T03:38:15.750 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:15.750 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:15.751 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.xykjPEHsdh 2024-09-16T03:38:15.751 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 388 -o /tmp/tmp.xykjPEHsdh 2024-09-16T03:38:16.185 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 388 2024-09-16T03:38:16.202 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.xykjPEHsdh 2024-09-16T03:38:16.202 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 388' 2024-09-16T03:38:16.222 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.xykjPEHsdh' 2024-09-16T03:38:16.223 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 388 2024-09-16T03:38:16.223 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.xykjPEHsdh 2024-09-16T03:38:16.225 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:16.225 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:16.225 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:16.225 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 389 2024-09-16T03:38:16.225 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=389 2024-09-16T03:38:16.225 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:16.225 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:16.226 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.bgZ1PeG8by 2024-09-16T03:38:16.226 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 389 -o /tmp/tmp.bgZ1PeG8by 2024-09-16T03:38:16.676 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 389 2024-09-16T03:38:16.694 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.bgZ1PeG8by 2024-09-16T03:38:16.694 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 389' 2024-09-16T03:38:16.715 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.bgZ1PeG8by' 2024-09-16T03:38:16.716 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 389 2024-09-16T03:38:16.716 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.bgZ1PeG8by 2024-09-16T03:38:16.717 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:16.717 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:16.717 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:16.718 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 390 2024-09-16T03:38:16.718 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=390 2024-09-16T03:38:16.718 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:16.718 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:16.719 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.1DrPLWiVjk 2024-09-16T03:38:16.719 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 390 -o /tmp/tmp.1DrPLWiVjk 2024-09-16T03:38:17.115 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 390 2024-09-16T03:38:17.130 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.1DrPLWiVjk 2024-09-16T03:38:17.130 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 390' 2024-09-16T03:38:17.150 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.1DrPLWiVjk' 2024-09-16T03:38:17.151 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 390 2024-09-16T03:38:17.151 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.1DrPLWiVjk 2024-09-16T03:38:17.153 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:17.153 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:17.153 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:17.153 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 391 2024-09-16T03:38:17.153 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=391 2024-09-16T03:38:17.153 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:17.153 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:17.153 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.q5d1NvYH7X 2024-09-16T03:38:17.154 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 391 -o /tmp/tmp.q5d1NvYH7X 2024-09-16T03:38:17.582 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 391 2024-09-16T03:38:17.599 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.q5d1NvYH7X 2024-09-16T03:38:17.599 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 391' 2024-09-16T03:38:17.619 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.q5d1NvYH7X' 2024-09-16T03:38:17.620 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 391 2024-09-16T03:38:17.621 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.q5d1NvYH7X 2024-09-16T03:38:17.623 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:17.623 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:17.623 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:17.623 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 392 2024-09-16T03:38:17.623 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=392 2024-09-16T03:38:17.623 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:17.623 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:17.624 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.sMMlwyK0PS 2024-09-16T03:38:17.624 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 392 -o /tmp/tmp.sMMlwyK0PS 2024-09-16T03:38:18.075 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 392 2024-09-16T03:38:18.092 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.sMMlwyK0PS 2024-09-16T03:38:18.092 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 392' 2024-09-16T03:38:18.111 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.sMMlwyK0PS' 2024-09-16T03:38:18.113 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 392 2024-09-16T03:38:18.113 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.sMMlwyK0PS 2024-09-16T03:38:18.114 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:18.114 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:18.115 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:18.115 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 393 2024-09-16T03:38:18.115 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=393 2024-09-16T03:38:18.115 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:18.115 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:18.115 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.3xH8aOrUVF 2024-09-16T03:38:18.115 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 393 -o /tmp/tmp.3xH8aOrUVF 2024-09-16T03:38:18.569 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 393 2024-09-16T03:38:18.587 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 393' 2024-09-16T03:38:18.587 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.3xH8aOrUVF 2024-09-16T03:38:18.607 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.3xH8aOrUVF' 2024-09-16T03:38:18.609 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 393 2024-09-16T03:38:18.609 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.3xH8aOrUVF 2024-09-16T03:38:18.611 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:18.611 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:18.611 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:18.611 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 394 2024-09-16T03:38:18.611 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=394 2024-09-16T03:38:18.611 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:18.611 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:18.612 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.LWqM1IGlYY 2024-09-16T03:38:18.612 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 394 -o /tmp/tmp.LWqM1IGlYY 2024-09-16T03:38:19.012 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 394 2024-09-16T03:38:19.028 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.LWqM1IGlYY 2024-09-16T03:38:19.028 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 394' 2024-09-16T03:38:19.048 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.LWqM1IGlYY' 2024-09-16T03:38:19.049 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 394 2024-09-16T03:38:19.049 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.LWqM1IGlYY 2024-09-16T03:38:19.051 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:19.051 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:19.051 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:19.051 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 395 2024-09-16T03:38:19.051 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=395 2024-09-16T03:38:19.051 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:19.051 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:19.051 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.B1PM9QmySb 2024-09-16T03:38:19.052 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 395 -o /tmp/tmp.B1PM9QmySb 2024-09-16T03:38:19.480 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 395 2024-09-16T03:38:19.498 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.B1PM9QmySb 2024-09-16T03:38:19.498 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 395' 2024-09-16T03:38:19.517 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.B1PM9QmySb' 2024-09-16T03:38:19.519 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 395 2024-09-16T03:38:19.519 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.B1PM9QmySb 2024-09-16T03:38:19.520 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:19.520 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:19.521 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:19.521 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 396 2024-09-16T03:38:19.521 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=396 2024-09-16T03:38:19.521 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:19.521 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:19.521 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.kuLi6dax2k 2024-09-16T03:38:19.521 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 396 -o /tmp/tmp.kuLi6dax2k 2024-09-16T03:38:19.957 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 396 2024-09-16T03:38:19.975 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.kuLi6dax2k 2024-09-16T03:38:19.975 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 396' 2024-09-16T03:38:19.995 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.kuLi6dax2k' 2024-09-16T03:38:19.996 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 396 2024-09-16T03:38:19.996 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.kuLi6dax2k 2024-09-16T03:38:19.998 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:19.998 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:19.998 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:19.998 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 397 2024-09-16T03:38:19.998 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=397 2024-09-16T03:38:19.998 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:19.998 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:20.000 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.R0gNAI3KPv 2024-09-16T03:38:20.000 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 397 -o /tmp/tmp.R0gNAI3KPv 2024-09-16T03:38:20.433 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 397 2024-09-16T03:38:20.451 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.R0gNAI3KPv 2024-09-16T03:38:20.452 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 397' 2024-09-16T03:38:20.471 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.R0gNAI3KPv' 2024-09-16T03:38:20.473 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 397 2024-09-16T03:38:20.473 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.R0gNAI3KPv 2024-09-16T03:38:20.474 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:20.475 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:20.475 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:20.475 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 398 2024-09-16T03:38:20.475 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=398 2024-09-16T03:38:20.475 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:20.475 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:20.475 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.rSyeTvLc6h 2024-09-16T03:38:20.476 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 398 -o /tmp/tmp.rSyeTvLc6h 2024-09-16T03:38:20.885 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 398 2024-09-16T03:38:20.902 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.rSyeTvLc6h 2024-09-16T03:38:20.902 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 398' 2024-09-16T03:38:20.922 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.rSyeTvLc6h' 2024-09-16T03:38:20.923 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 398 2024-09-16T03:38:20.923 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.rSyeTvLc6h 2024-09-16T03:38:20.925 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:20.925 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:20.925 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:20.925 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 399 2024-09-16T03:38:20.925 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=399 2024-09-16T03:38:20.925 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:20.925 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:20.926 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.jWX77YrvSu 2024-09-16T03:38:20.926 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 399 -o /tmp/tmp.jWX77YrvSu 2024-09-16T03:38:21.379 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 399 2024-09-16T03:38:21.397 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.jWX77YrvSu 2024-09-16T03:38:21.397 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 399' 2024-09-16T03:38:21.418 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.jWX77YrvSu' 2024-09-16T03:38:21.420 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 399 2024-09-16T03:38:21.420 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.jWX77YrvSu 2024-09-16T03:38:21.421 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:21.421 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:21.421 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:21.421 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 400 2024-09-16T03:38:21.421 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=400 2024-09-16T03:38:21.421 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:21.422 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:21.422 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.RsJxEIse5I 2024-09-16T03:38:21.422 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 400 -o /tmp/tmp.RsJxEIse5I 2024-09-16T03:38:21.863 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 400 2024-09-16T03:38:21.879 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.RsJxEIse5I 2024-09-16T03:38:21.879 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 400' 2024-09-16T03:38:21.899 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.RsJxEIse5I' 2024-09-16T03:38:21.900 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 400 2024-09-16T03:38:21.901 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.RsJxEIse5I 2024-09-16T03:38:21.902 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:21.902 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:21.902 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:21.902 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 401 2024-09-16T03:38:21.902 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=401 2024-09-16T03:38:21.902 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:21.902 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:21.903 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.RH7xmhvZMe 2024-09-16T03:38:21.903 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 401 -o /tmp/tmp.RH7xmhvZMe 2024-09-16T03:38:22.340 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 401 2024-09-16T03:38:22.357 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.RH7xmhvZMe 2024-09-16T03:38:22.357 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 401' 2024-09-16T03:38:22.377 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.RH7xmhvZMe' 2024-09-16T03:38:22.379 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 401 2024-09-16T03:38:22.379 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.RH7xmhvZMe 2024-09-16T03:38:22.380 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:22.381 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:22.381 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:22.381 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 402 2024-09-16T03:38:22.381 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=402 2024-09-16T03:38:22.381 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:22.381 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:22.381 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.JtPX9TWpHP 2024-09-16T03:38:22.382 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 402 -o /tmp/tmp.JtPX9TWpHP 2024-09-16T03:38:22.804 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 402 2024-09-16T03:38:22.820 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.JtPX9TWpHP 2024-09-16T03:38:22.821 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 402' 2024-09-16T03:38:22.840 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.JtPX9TWpHP' 2024-09-16T03:38:22.841 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 402 2024-09-16T03:38:22.841 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.JtPX9TWpHP 2024-09-16T03:38:22.842 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:22.842 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:22.843 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:22.843 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 403 2024-09-16T03:38:22.843 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=403 2024-09-16T03:38:22.843 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:22.843 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:22.844 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.2TPoWdYauP 2024-09-16T03:38:22.844 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 403 -o /tmp/tmp.2TPoWdYauP 2024-09-16T03:38:23.301 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 403 2024-09-16T03:38:23.318 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.2TPoWdYauP 2024-09-16T03:38:23.319 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 403' 2024-09-16T03:38:23.338 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.2TPoWdYauP' 2024-09-16T03:38:23.339 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 403 2024-09-16T03:38:23.339 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.2TPoWdYauP 2024-09-16T03:38:23.341 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:23.341 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:23.341 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:23.341 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 404 2024-09-16T03:38:23.341 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=404 2024-09-16T03:38:23.341 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:23.341 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:23.342 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.8GwswL8EiQ 2024-09-16T03:38:23.342 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 404 -o /tmp/tmp.8GwswL8EiQ 2024-09-16T03:38:23.787 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 404 2024-09-16T03:38:23.803 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.8GwswL8EiQ 2024-09-16T03:38:23.803 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 404' 2024-09-16T03:38:23.823 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.8GwswL8EiQ' 2024-09-16T03:38:23.825 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 404 2024-09-16T03:38:23.825 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.8GwswL8EiQ 2024-09-16T03:38:23.827 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:23.827 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:23.827 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:23.827 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 405 2024-09-16T03:38:23.827 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=405 2024-09-16T03:38:23.827 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:23.828 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:23.828 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.ZXnTI940YF 2024-09-16T03:38:23.828 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 405 -o /tmp/tmp.ZXnTI940YF 2024-09-16T03:38:24.321 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 405 2024-09-16T03:38:24.340 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.ZXnTI940YF 2024-09-16T03:38:24.340 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 405' 2024-09-16T03:38:24.360 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.ZXnTI940YF' 2024-09-16T03:38:24.361 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 405 2024-09-16T03:38:24.361 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.ZXnTI940YF 2024-09-16T03:38:24.362 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:24.363 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:24.363 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:24.363 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 406 2024-09-16T03:38:24.363 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=406 2024-09-16T03:38:24.363 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:24.363 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:24.363 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.L5HnyW1ePh 2024-09-16T03:38:24.364 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 406 -o /tmp/tmp.L5HnyW1ePh 2024-09-16T03:38:24.781 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 406 2024-09-16T03:38:24.797 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 406' 2024-09-16T03:38:24.797 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.L5HnyW1ePh 2024-09-16T03:38:24.818 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.L5HnyW1ePh' 2024-09-16T03:38:24.819 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 406 2024-09-16T03:38:24.819 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.L5HnyW1ePh 2024-09-16T03:38:24.821 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:24.821 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:24.821 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:24.821 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 407 2024-09-16T03:38:24.821 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=407 2024-09-16T03:38:24.821 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:24.821 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:24.822 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.YAVd555Vkd 2024-09-16T03:38:24.822 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 407 -o /tmp/tmp.YAVd555Vkd 2024-09-16T03:38:25.291 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 407 2024-09-16T03:38:25.308 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.YAVd555Vkd 2024-09-16T03:38:25.308 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 407' 2024-09-16T03:38:25.327 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.YAVd555Vkd' 2024-09-16T03:38:25.329 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 407 2024-09-16T03:38:25.329 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.YAVd555Vkd 2024-09-16T03:38:25.330 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:25.330 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:25.331 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:25.331 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 408 2024-09-16T03:38:25.331 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=408 2024-09-16T03:38:25.331 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:25.331 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:25.331 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.g0u9th0oP7 2024-09-16T03:38:25.332 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 408 -o /tmp/tmp.g0u9th0oP7 2024-09-16T03:38:25.776 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 408 2024-09-16T03:38:25.792 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.g0u9th0oP7 2024-09-16T03:38:25.792 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 408' 2024-09-16T03:38:25.812 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.g0u9th0oP7' 2024-09-16T03:38:25.814 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 408 2024-09-16T03:38:25.814 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.g0u9th0oP7 2024-09-16T03:38:25.815 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:25.815 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:25.815 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:25.815 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 409 2024-09-16T03:38:25.815 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=409 2024-09-16T03:38:25.815 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:25.815 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:25.816 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.ztOOVeULgQ 2024-09-16T03:38:25.816 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 409 -o /tmp/tmp.ztOOVeULgQ 2024-09-16T03:38:26.212 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 409 2024-09-16T03:38:26.229 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.ztOOVeULgQ 2024-09-16T03:38:26.229 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 409' 2024-09-16T03:38:26.251 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.ztOOVeULgQ' 2024-09-16T03:38:26.252 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 409 2024-09-16T03:38:26.253 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.ztOOVeULgQ 2024-09-16T03:38:26.254 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:26.254 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:26.254 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:26.254 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 410 2024-09-16T03:38:26.254 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=410 2024-09-16T03:38:26.254 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:26.255 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:26.256 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.elm72Y8wrk 2024-09-16T03:38:26.256 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 410 -o /tmp/tmp.elm72Y8wrk 2024-09-16T03:38:26.762 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 410 2024-09-16T03:38:26.781 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.elm72Y8wrk 2024-09-16T03:38:26.781 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 410' 2024-09-16T03:38:26.802 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.elm72Y8wrk' 2024-09-16T03:38:26.803 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 410 2024-09-16T03:38:26.804 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.elm72Y8wrk 2024-09-16T03:38:26.805 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:26.805 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:26.805 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:26.805 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 411 2024-09-16T03:38:26.805 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=411 2024-09-16T03:38:26.805 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:26.805 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:26.806 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.pZITeGWk3F 2024-09-16T03:38:26.806 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 411 -o /tmp/tmp.pZITeGWk3F 2024-09-16T03:38:27.257 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 411 2024-09-16T03:38:27.272 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.pZITeGWk3F 2024-09-16T03:38:27.273 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 411' 2024-09-16T03:38:27.292 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.pZITeGWk3F' 2024-09-16T03:38:27.294 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 411 2024-09-16T03:38:27.294 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.pZITeGWk3F 2024-09-16T03:38:27.295 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:27.295 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:27.295 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:27.296 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 412 2024-09-16T03:38:27.296 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=412 2024-09-16T03:38:27.296 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:27.296 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:27.296 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.n9YhalEpHc 2024-09-16T03:38:27.296 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 412 -o /tmp/tmp.n9YhalEpHc 2024-09-16T03:38:27.700 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 412 2024-09-16T03:38:27.716 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 412' 2024-09-16T03:38:27.716 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.n9YhalEpHc 2024-09-16T03:38:27.736 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.n9YhalEpHc' 2024-09-16T03:38:27.737 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 412 2024-09-16T03:38:27.738 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.n9YhalEpHc 2024-09-16T03:38:27.738 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:27.739 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:27.739 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:27.739 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 413 2024-09-16T03:38:27.739 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=413 2024-09-16T03:38:27.739 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:27.739 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:27.740 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.iBb3gwfWTE 2024-09-16T03:38:27.740 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 413 -o /tmp/tmp.iBb3gwfWTE 2024-09-16T03:38:28.123 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 413 2024-09-16T03:38:28.139 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.iBb3gwfWTE 2024-09-16T03:38:28.139 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 413' 2024-09-16T03:38:28.158 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.iBb3gwfWTE' 2024-09-16T03:38:28.160 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 413 2024-09-16T03:38:28.160 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.iBb3gwfWTE 2024-09-16T03:38:28.161 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:28.161 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:28.161 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:28.161 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 414 2024-09-16T03:38:28.161 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=414 2024-09-16T03:38:28.161 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:28.162 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:28.162 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.YLy0uFMFYb 2024-09-16T03:38:28.162 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 414 -o /tmp/tmp.YLy0uFMFYb 2024-09-16T03:38:28.549 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 414 2024-09-16T03:38:28.563 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.YLy0uFMFYb 2024-09-16T03:38:28.563 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 414' 2024-09-16T03:38:28.582 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.YLy0uFMFYb' 2024-09-16T03:38:28.584 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 414 2024-09-16T03:38:28.584 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.YLy0uFMFYb 2024-09-16T03:38:28.585 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:28.585 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:28.586 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:28.586 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 415 2024-09-16T03:38:28.586 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=415 2024-09-16T03:38:28.586 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:28.586 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:28.586 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.kPf2uodTtG 2024-09-16T03:38:28.586 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 415 -o /tmp/tmp.kPf2uodTtG 2024-09-16T03:38:29.032 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 415 2024-09-16T03:38:29.047 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.kPf2uodTtG 2024-09-16T03:38:29.047 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 415' 2024-09-16T03:38:29.067 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.kPf2uodTtG' 2024-09-16T03:38:29.069 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 415 2024-09-16T03:38:29.069 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.kPf2uodTtG 2024-09-16T03:38:29.070 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:29.070 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:29.070 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:29.071 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 416 2024-09-16T03:38:29.071 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=416 2024-09-16T03:38:29.071 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:29.071 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:29.071 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.jsV7KxjIuy 2024-09-16T03:38:29.071 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 416 -o /tmp/tmp.jsV7KxjIuy 2024-09-16T03:38:29.483 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 416 2024-09-16T03:38:29.499 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.jsV7KxjIuy 2024-09-16T03:38:29.499 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 416' 2024-09-16T03:38:29.519 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.jsV7KxjIuy' 2024-09-16T03:38:29.520 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 416 2024-09-16T03:38:29.521 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.jsV7KxjIuy 2024-09-16T03:38:29.522 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:29.522 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:29.522 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:29.522 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 417 2024-09-16T03:38:29.522 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=417 2024-09-16T03:38:29.522 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:29.522 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:29.523 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.ApjsaXrYFJ 2024-09-16T03:38:29.523 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 417 -o /tmp/tmp.ApjsaXrYFJ 2024-09-16T03:38:29.991 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 417 2024-09-16T03:38:30.011 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.ApjsaXrYFJ 2024-09-16T03:38:30.011 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 417' 2024-09-16T03:38:30.031 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.ApjsaXrYFJ' 2024-09-16T03:38:30.032 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 417 2024-09-16T03:38:30.033 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.ApjsaXrYFJ 2024-09-16T03:38:30.034 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:30.034 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:30.034 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:30.034 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 418 2024-09-16T03:38:30.034 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=418 2024-09-16T03:38:30.034 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:30.035 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:30.035 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.fSRZsMlkDN 2024-09-16T03:38:30.035 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 418 -o /tmp/tmp.fSRZsMlkDN 2024-09-16T03:38:30.442 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 418 2024-09-16T03:38:30.458 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.fSRZsMlkDN 2024-09-16T03:38:30.459 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 418' 2024-09-16T03:38:30.473 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.fSRZsMlkDN' 2024-09-16T03:38:30.474 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 418 2024-09-16T03:38:30.475 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.fSRZsMlkDN 2024-09-16T03:38:30.476 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:30.476 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:30.476 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:30.476 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 419 2024-09-16T03:38:30.476 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=419 2024-09-16T03:38:30.476 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:30.476 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:30.477 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.Raxq6VcyAO 2024-09-16T03:38:30.477 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 419 -o /tmp/tmp.Raxq6VcyAO 2024-09-16T03:38:30.911 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 419 2024-09-16T03:38:30.928 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.Raxq6VcyAO 2024-09-16T03:38:30.928 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 419' 2024-09-16T03:38:30.947 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.Raxq6VcyAO' 2024-09-16T03:38:30.949 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 419 2024-09-16T03:38:30.949 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.Raxq6VcyAO 2024-09-16T03:38:30.950 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:30.950 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:30.950 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:30.951 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 420 2024-09-16T03:38:30.951 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=420 2024-09-16T03:38:30.951 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:30.951 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:30.951 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.veoQ1EvK7M 2024-09-16T03:38:30.951 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 420 -o /tmp/tmp.veoQ1EvK7M 2024-09-16T03:38:31.404 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 420 2024-09-16T03:38:31.422 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.veoQ1EvK7M 2024-09-16T03:38:31.422 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 420' 2024-09-16T03:38:31.441 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.veoQ1EvK7M' 2024-09-16T03:38:31.443 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 420 2024-09-16T03:38:31.443 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.veoQ1EvK7M 2024-09-16T03:38:31.444 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:31.445 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:31.445 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:31.445 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 421 2024-09-16T03:38:31.445 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=421 2024-09-16T03:38:31.445 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:31.445 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:31.445 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.1mmTY3OagD 2024-09-16T03:38:31.445 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 421 -o /tmp/tmp.1mmTY3OagD 2024-09-16T03:38:31.889 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 421 2024-09-16T03:38:31.906 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.1mmTY3OagD 2024-09-16T03:38:31.906 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 421' 2024-09-16T03:38:31.926 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.1mmTY3OagD' 2024-09-16T03:38:31.928 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 421 2024-09-16T03:38:31.928 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.1mmTY3OagD 2024-09-16T03:38:31.929 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:31.929 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:31.929 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:31.929 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 422 2024-09-16T03:38:31.929 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=422 2024-09-16T03:38:31.929 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:31.930 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:31.930 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.qvGYlV0a7A 2024-09-16T03:38:31.930 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 422 -o /tmp/tmp.qvGYlV0a7A 2024-09-16T03:38:32.341 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 422 2024-09-16T03:38:32.357 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.qvGYlV0a7A 2024-09-16T03:38:32.358 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 422' 2024-09-16T03:38:32.372 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.qvGYlV0a7A' 2024-09-16T03:38:32.373 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 422 2024-09-16T03:38:32.374 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.qvGYlV0a7A 2024-09-16T03:38:32.375 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:32.375 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:32.375 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:32.375 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 423 2024-09-16T03:38:32.375 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=423 2024-09-16T03:38:32.375 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:32.376 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:32.376 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.0mp3auMHPT 2024-09-16T03:38:32.376 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 423 -o /tmp/tmp.0mp3auMHPT 2024-09-16T03:38:32.771 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 423 2024-09-16T03:38:32.787 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.0mp3auMHPT 2024-09-16T03:38:32.787 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 423' 2024-09-16T03:38:32.807 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.0mp3auMHPT' 2024-09-16T03:38:32.808 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 423 2024-09-16T03:38:32.808 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.0mp3auMHPT 2024-09-16T03:38:32.810 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:32.810 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:32.810 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:32.810 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 424 2024-09-16T03:38:32.810 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=424 2024-09-16T03:38:32.810 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:32.810 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:32.811 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.vfpvzj3biU 2024-09-16T03:38:32.811 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 424 -o /tmp/tmp.vfpvzj3biU 2024-09-16T03:38:33.269 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 424 2024-09-16T03:38:33.286 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.vfpvzj3biU 2024-09-16T03:38:33.286 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 424' 2024-09-16T03:38:33.306 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.vfpvzj3biU' 2024-09-16T03:38:33.308 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 424 2024-09-16T03:38:33.308 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.vfpvzj3biU 2024-09-16T03:38:33.309 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:33.309 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:33.310 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:33.310 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 425 2024-09-16T03:38:33.310 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=425 2024-09-16T03:38:33.310 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:33.310 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:33.312 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.N7RGblfIPu 2024-09-16T03:38:33.312 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 425 -o /tmp/tmp.N7RGblfIPu 2024-09-16T03:38:33.787 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 425 2024-09-16T03:38:33.806 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.N7RGblfIPu 2024-09-16T03:38:33.806 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 425' 2024-09-16T03:38:33.827 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.N7RGblfIPu' 2024-09-16T03:38:33.828 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 425 2024-09-16T03:38:33.829 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.N7RGblfIPu 2024-09-16T03:38:33.830 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:33.830 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:33.830 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:33.830 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 426 2024-09-16T03:38:33.830 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=426 2024-09-16T03:38:33.830 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:33.831 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:33.832 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.iBFiRxTRH4 2024-09-16T03:38:33.832 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 426 -o /tmp/tmp.iBFiRxTRH4 2024-09-16T03:38:34.280 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 426 2024-09-16T03:38:34.299 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.iBFiRxTRH4 2024-09-16T03:38:34.299 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 426' 2024-09-16T03:38:34.320 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.iBFiRxTRH4' 2024-09-16T03:38:34.321 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 426 2024-09-16T03:38:34.321 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.iBFiRxTRH4 2024-09-16T03:38:34.323 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:34.323 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:34.323 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:34.323 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 427 2024-09-16T03:38:34.323 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=427 2024-09-16T03:38:34.323 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:34.323 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:34.324 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.W9r4Sb3tZr 2024-09-16T03:38:34.324 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 427 -o /tmp/tmp.W9r4Sb3tZr 2024-09-16T03:38:34.717 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 427 2024-09-16T03:38:34.733 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.W9r4Sb3tZr 2024-09-16T03:38:34.733 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 427' 2024-09-16T03:38:34.753 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.W9r4Sb3tZr' 2024-09-16T03:38:34.754 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 427 2024-09-16T03:38:34.754 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.W9r4Sb3tZr 2024-09-16T03:38:34.755 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:34.755 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:34.756 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:34.756 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 428 2024-09-16T03:38:34.756 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=428 2024-09-16T03:38:34.756 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:34.756 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:34.757 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.YOebfU0m5u 2024-09-16T03:38:34.757 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 428 -o /tmp/tmp.YOebfU0m5u 2024-09-16T03:38:35.186 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 428 2024-09-16T03:38:35.202 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.YOebfU0m5u 2024-09-16T03:38:35.202 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 428' 2024-09-16T03:38:35.221 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.YOebfU0m5u' 2024-09-16T03:38:35.223 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 428 2024-09-16T03:38:35.223 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.YOebfU0m5u 2024-09-16T03:38:35.224 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:35.225 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:35.225 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:35.225 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 429 2024-09-16T03:38:35.225 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=429 2024-09-16T03:38:35.225 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:35.225 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:35.225 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.wo56VWOA2H 2024-09-16T03:38:35.225 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 429 -o /tmp/tmp.wo56VWOA2H 2024-09-16T03:38:35.614 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 429 2024-09-16T03:38:35.629 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.wo56VWOA2H 2024-09-16T03:38:35.630 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 429' 2024-09-16T03:38:35.650 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.wo56VWOA2H' 2024-09-16T03:38:35.651 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 429 2024-09-16T03:38:35.652 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.wo56VWOA2H 2024-09-16T03:38:35.653 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:35.653 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:35.653 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:35.653 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 430 2024-09-16T03:38:35.653 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=430 2024-09-16T03:38:35.653 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:35.653 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:35.654 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.YRrwJpO0bb 2024-09-16T03:38:35.654 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 430 -o /tmp/tmp.YRrwJpO0bb 2024-09-16T03:38:36.087 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 430 2024-09-16T03:38:36.103 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.YRrwJpO0bb 2024-09-16T03:38:36.104 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 430' 2024-09-16T03:38:36.125 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.YRrwJpO0bb' 2024-09-16T03:38:36.126 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 430 2024-09-16T03:38:36.126 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.YRrwJpO0bb 2024-09-16T03:38:36.128 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:36.128 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:36.128 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:36.128 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 431 2024-09-16T03:38:36.128 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=431 2024-09-16T03:38:36.128 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:36.128 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:36.129 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.i4g7Cj3fC8 2024-09-16T03:38:36.129 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 431 -o /tmp/tmp.i4g7Cj3fC8 2024-09-16T03:38:36.563 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 431 2024-09-16T03:38:36.581 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.i4g7Cj3fC8 2024-09-16T03:38:36.581 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 431' 2024-09-16T03:38:36.599 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.i4g7Cj3fC8' 2024-09-16T03:38:36.601 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 431 2024-09-16T03:38:36.601 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.i4g7Cj3fC8 2024-09-16T03:38:36.602 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:36.602 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:36.602 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:36.602 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 432 2024-09-16T03:38:36.603 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=432 2024-09-16T03:38:36.603 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:36.603 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:36.604 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.vE4pzan1jV 2024-09-16T03:38:36.604 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 432 -o /tmp/tmp.vE4pzan1jV 2024-09-16T03:38:37.023 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 432 2024-09-16T03:38:37.039 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.vE4pzan1jV 2024-09-16T03:38:37.039 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 432' 2024-09-16T03:38:37.059 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.vE4pzan1jV' 2024-09-16T03:38:37.060 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 432 2024-09-16T03:38:37.061 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.vE4pzan1jV 2024-09-16T03:38:37.062 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:37.062 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:37.062 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:37.062 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 433 2024-09-16T03:38:37.062 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=433 2024-09-16T03:38:37.063 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:37.063 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:37.063 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.6BpCgbQM3c 2024-09-16T03:38:37.063 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 433 -o /tmp/tmp.6BpCgbQM3c 2024-09-16T03:38:37.525 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 433 2024-09-16T03:38:37.542 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.6BpCgbQM3c 2024-09-16T03:38:37.542 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 433' 2024-09-16T03:38:37.562 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.6BpCgbQM3c' 2024-09-16T03:38:37.564 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 433 2024-09-16T03:38:37.564 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.6BpCgbQM3c 2024-09-16T03:38:37.565 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:37.565 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:37.565 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:37.565 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 434 2024-09-16T03:38:37.565 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=434 2024-09-16T03:38:37.565 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:37.565 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:37.566 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.gKUPI53PCG 2024-09-16T03:38:37.566 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 434 -o /tmp/tmp.gKUPI53PCG 2024-09-16T03:38:37.961 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 434 2024-09-16T03:38:37.978 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.gKUPI53PCG 2024-09-16T03:38:37.978 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 434' 2024-09-16T03:38:37.992 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.gKUPI53PCG' 2024-09-16T03:38:37.994 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 434 2024-09-16T03:38:37.994 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.gKUPI53PCG 2024-09-16T03:38:37.996 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:37.996 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:37.996 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:37.996 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 435 2024-09-16T03:38:37.996 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=435 2024-09-16T03:38:37.996 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:37.996 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:37.997 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.GsG70mtkbQ 2024-09-16T03:38:37.997 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 435 -o /tmp/tmp.GsG70mtkbQ 2024-09-16T03:38:38.428 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 435 2024-09-16T03:38:38.444 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.GsG70mtkbQ 2024-09-16T03:38:38.444 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 435' 2024-09-16T03:38:38.464 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.GsG70mtkbQ' 2024-09-16T03:38:38.465 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 435 2024-09-16T03:38:38.466 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.GsG70mtkbQ 2024-09-16T03:38:38.468 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:38.468 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:38.468 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:38.469 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 436 2024-09-16T03:38:38.469 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=436 2024-09-16T03:38:38.469 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:38.469 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:38.469 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.DgHy7cDRwP 2024-09-16T03:38:38.470 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 436 -o /tmp/tmp.DgHy7cDRwP 2024-09-16T03:38:38.878 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 436 2024-09-16T03:38:38.894 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.DgHy7cDRwP 2024-09-16T03:38:38.894 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 436' 2024-09-16T03:38:38.913 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.DgHy7cDRwP' 2024-09-16T03:38:38.915 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 436 2024-09-16T03:38:38.915 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.DgHy7cDRwP 2024-09-16T03:38:38.916 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:38.916 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:38.917 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:38.917 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 437 2024-09-16T03:38:38.917 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=437 2024-09-16T03:38:38.917 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:38.917 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:38.917 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.8as543Cqna 2024-09-16T03:38:38.917 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 437 -o /tmp/tmp.8as543Cqna 2024-09-16T03:38:39.305 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 437 2024-09-16T03:38:39.321 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.8as543Cqna 2024-09-16T03:38:39.321 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 437' 2024-09-16T03:38:39.341 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.8as543Cqna' 2024-09-16T03:38:39.343 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 437 2024-09-16T03:38:39.343 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.8as543Cqna 2024-09-16T03:38:39.344 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:39.344 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:39.345 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:39.345 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 438 2024-09-16T03:38:39.345 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=438 2024-09-16T03:38:39.345 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:39.345 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:39.345 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.QhWJUm5xMN 2024-09-16T03:38:39.345 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 438 -o /tmp/tmp.QhWJUm5xMN 2024-09-16T03:38:39.808 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 438 2024-09-16T03:38:39.826 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.QhWJUm5xMN 2024-09-16T03:38:39.826 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 438' 2024-09-16T03:38:39.846 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.QhWJUm5xMN' 2024-09-16T03:38:39.847 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 438 2024-09-16T03:38:39.847 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.QhWJUm5xMN 2024-09-16T03:38:39.849 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:39.849 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:39.849 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:39.849 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 439 2024-09-16T03:38:39.849 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=439 2024-09-16T03:38:39.849 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:39.849 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:39.850 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.6wmC5oUouc 2024-09-16T03:38:39.850 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 439 -o /tmp/tmp.6wmC5oUouc 2024-09-16T03:38:40.242 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 439 2024-09-16T03:38:40.258 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.6wmC5oUouc 2024-09-16T03:38:40.258 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 439' 2024-09-16T03:38:40.278 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.6wmC5oUouc' 2024-09-16T03:38:40.279 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 439 2024-09-16T03:38:40.279 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.6wmC5oUouc 2024-09-16T03:38:40.281 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:40.281 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:40.281 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:40.281 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 440 2024-09-16T03:38:40.281 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=440 2024-09-16T03:38:40.281 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:40.281 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:40.282 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.PzZPZmpnfV 2024-09-16T03:38:40.282 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 440 -o /tmp/tmp.PzZPZmpnfV 2024-09-16T03:38:40.708 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 440 2024-09-16T03:38:40.725 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.PzZPZmpnfV 2024-09-16T03:38:40.725 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 440' 2024-09-16T03:38:40.745 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.PzZPZmpnfV' 2024-09-16T03:38:40.746 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 440 2024-09-16T03:38:40.747 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.PzZPZmpnfV 2024-09-16T03:38:40.748 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:40.748 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:40.748 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:40.748 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 441 2024-09-16T03:38:40.748 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=441 2024-09-16T03:38:40.748 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:40.748 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:40.749 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.Sc0OOvChqj 2024-09-16T03:38:40.749 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 441 -o /tmp/tmp.Sc0OOvChqj 2024-09-16T03:38:41.206 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 441 2024-09-16T03:38:41.224 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.Sc0OOvChqj 2024-09-16T03:38:41.224 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 441' 2024-09-16T03:38:41.244 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.Sc0OOvChqj' 2024-09-16T03:38:41.245 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 441 2024-09-16T03:38:41.246 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.Sc0OOvChqj 2024-09-16T03:38:41.247 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:41.247 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:41.247 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:41.247 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 442 2024-09-16T03:38:41.247 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=442 2024-09-16T03:38:41.247 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:41.247 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:41.248 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.nwwKatxenA 2024-09-16T03:38:41.248 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 442 -o /tmp/tmp.nwwKatxenA 2024-09-16T03:38:41.693 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 442 2024-09-16T03:38:41.707 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.nwwKatxenA 2024-09-16T03:38:41.707 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 442' 2024-09-16T03:38:41.727 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.nwwKatxenA' 2024-09-16T03:38:41.728 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 442 2024-09-16T03:38:41.728 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.nwwKatxenA 2024-09-16T03:38:41.730 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:41.730 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:41.730 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:41.730 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 443 2024-09-16T03:38:41.730 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=443 2024-09-16T03:38:41.730 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:41.730 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:41.731 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.yAq1HXK2DP 2024-09-16T03:38:41.731 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 443 -o /tmp/tmp.yAq1HXK2DP 2024-09-16T03:38:42.200 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 443 2024-09-16T03:38:42.217 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.yAq1HXK2DP 2024-09-16T03:38:42.218 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 443' 2024-09-16T03:38:42.238 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.yAq1HXK2DP' 2024-09-16T03:38:42.240 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 443 2024-09-16T03:38:42.240 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.yAq1HXK2DP 2024-09-16T03:38:42.242 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:42.242 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:42.243 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:42.243 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 444 2024-09-16T03:38:42.243 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=444 2024-09-16T03:38:42.243 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:42.243 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:42.243 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.lwYlxn7jHz 2024-09-16T03:38:42.243 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 444 -o /tmp/tmp.lwYlxn7jHz 2024-09-16T03:38:42.717 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 444 2024-09-16T03:38:42.735 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.lwYlxn7jHz 2024-09-16T03:38:42.735 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 444' 2024-09-16T03:38:42.755 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.lwYlxn7jHz' 2024-09-16T03:38:42.757 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 444 2024-09-16T03:38:42.757 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.lwYlxn7jHz 2024-09-16T03:38:42.758 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:42.758 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:42.758 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:42.758 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 445 2024-09-16T03:38:42.758 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=445 2024-09-16T03:38:42.758 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:42.759 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:42.759 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.gQVjv9xiDp 2024-09-16T03:38:42.759 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 445 -o /tmp/tmp.gQVjv9xiDp 2024-09-16T03:38:43.215 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 445 2024-09-16T03:38:43.232 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.gQVjv9xiDp 2024-09-16T03:38:43.232 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 445' 2024-09-16T03:38:43.251 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.gQVjv9xiDp' 2024-09-16T03:38:43.253 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 445 2024-09-16T03:38:43.253 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.gQVjv9xiDp 2024-09-16T03:38:43.254 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:43.254 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:43.254 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:43.254 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 446 2024-09-16T03:38:43.254 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=446 2024-09-16T03:38:43.255 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:43.255 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:43.255 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.mLvFXBriHv 2024-09-16T03:38:43.255 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 446 -o /tmp/tmp.mLvFXBriHv 2024-09-16T03:38:43.686 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 446 2024-09-16T03:38:43.703 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.mLvFXBriHv 2024-09-16T03:38:43.703 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 446' 2024-09-16T03:38:43.723 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.mLvFXBriHv' 2024-09-16T03:38:43.724 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 446 2024-09-16T03:38:43.725 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.mLvFXBriHv 2024-09-16T03:38:43.726 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:43.726 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:43.726 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:43.726 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 447 2024-09-16T03:38:43.726 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=447 2024-09-16T03:38:43.726 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:43.726 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:43.726 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.jXgFJ18BxV 2024-09-16T03:38:43.727 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 447 -o /tmp/tmp.jXgFJ18BxV 2024-09-16T03:38:44.372 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 447 2024-09-16T03:38:44.392 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.jXgFJ18BxV 2024-09-16T03:38:44.392 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 447' 2024-09-16T03:38:44.412 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.jXgFJ18BxV' 2024-09-16T03:38:44.413 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 447 2024-09-16T03:38:44.414 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.jXgFJ18BxV 2024-09-16T03:38:44.415 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:44.415 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:44.415 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:44.415 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 448 2024-09-16T03:38:44.415 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=448 2024-09-16T03:38:44.415 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:44.416 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:44.416 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.zxxLBoIEMY 2024-09-16T03:38:44.416 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 448 -o /tmp/tmp.zxxLBoIEMY 2024-09-16T03:38:44.832 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 448 2024-09-16T03:38:44.848 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.zxxLBoIEMY 2024-09-16T03:38:44.848 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 448' 2024-09-16T03:38:44.867 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.zxxLBoIEMY' 2024-09-16T03:38:44.869 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 448 2024-09-16T03:38:44.869 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.zxxLBoIEMY 2024-09-16T03:38:44.870 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:44.871 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:44.871 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:44.871 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 449 2024-09-16T03:38:44.871 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=449 2024-09-16T03:38:44.871 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:44.871 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:44.871 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.y1AeWgwa4x 2024-09-16T03:38:44.871 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 449 -o /tmp/tmp.y1AeWgwa4x 2024-09-16T03:38:45.337 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 449 2024-09-16T03:38:45.357 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.y1AeWgwa4x 2024-09-16T03:38:45.357 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 449' 2024-09-16T03:38:45.375 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.y1AeWgwa4x' 2024-09-16T03:38:45.376 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 449 2024-09-16T03:38:45.377 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.y1AeWgwa4x 2024-09-16T03:38:45.379 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:45.379 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:45.379 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:45.379 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 450 2024-09-16T03:38:45.379 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=450 2024-09-16T03:38:45.379 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:45.379 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:45.380 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.lpKCORQdUY 2024-09-16T03:38:45.380 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 450 -o /tmp/tmp.lpKCORQdUY 2024-09-16T03:38:45.784 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 450 2024-09-16T03:38:45.799 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.lpKCORQdUY 2024-09-16T03:38:45.799 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 450' 2024-09-16T03:38:45.819 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.lpKCORQdUY' 2024-09-16T03:38:45.820 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 450 2024-09-16T03:38:45.821 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.lpKCORQdUY 2024-09-16T03:38:45.822 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:45.822 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:45.822 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:45.822 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 451 2024-09-16T03:38:45.822 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=451 2024-09-16T03:38:45.822 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:45.822 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:45.822 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.VWUEwGVWp7 2024-09-16T03:38:45.823 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 451 -o /tmp/tmp.VWUEwGVWp7 2024-09-16T03:38:46.216 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 451 2024-09-16T03:38:46.232 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.VWUEwGVWp7 2024-09-16T03:38:46.232 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 451' 2024-09-16T03:38:46.251 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.VWUEwGVWp7' 2024-09-16T03:38:46.253 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 451 2024-09-16T03:38:46.253 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.VWUEwGVWp7 2024-09-16T03:38:46.254 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:46.254 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:46.254 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:46.255 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 452 2024-09-16T03:38:46.255 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=452 2024-09-16T03:38:46.255 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:46.255 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:46.255 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.Ij5NxZ12PX 2024-09-16T03:38:46.255 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 452 -o /tmp/tmp.Ij5NxZ12PX 2024-09-16T03:38:46.682 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 452 2024-09-16T03:38:46.699 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.Ij5NxZ12PX 2024-09-16T03:38:46.700 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 452' 2024-09-16T03:38:46.720 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.Ij5NxZ12PX' 2024-09-16T03:38:46.721 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 452 2024-09-16T03:38:46.722 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.Ij5NxZ12PX 2024-09-16T03:38:46.723 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:46.723 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:46.723 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:46.723 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 453 2024-09-16T03:38:46.723 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=453 2024-09-16T03:38:46.723 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:46.723 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:46.724 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.tazVSAVYCl 2024-09-16T03:38:46.724 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 453 -o /tmp/tmp.tazVSAVYCl 2024-09-16T03:38:47.148 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 453 2024-09-16T03:38:47.166 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 453' 2024-09-16T03:38:47.166 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.tazVSAVYCl 2024-09-16T03:38:47.186 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.tazVSAVYCl' 2024-09-16T03:38:47.188 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 453 2024-09-16T03:38:47.188 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.tazVSAVYCl 2024-09-16T03:38:47.190 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:47.190 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:47.190 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:47.190 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 454 2024-09-16T03:38:47.190 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=454 2024-09-16T03:38:47.190 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:47.191 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:47.192 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.zn5XqBha7s 2024-09-16T03:38:47.192 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 454 -o /tmp/tmp.zn5XqBha7s 2024-09-16T03:38:47.605 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 454 2024-09-16T03:38:47.621 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.zn5XqBha7s 2024-09-16T03:38:47.621 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 454' 2024-09-16T03:38:47.641 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.zn5XqBha7s' 2024-09-16T03:38:47.642 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 454 2024-09-16T03:38:47.642 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.zn5XqBha7s 2024-09-16T03:38:47.644 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:47.644 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:47.644 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:47.644 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 455 2024-09-16T03:38:47.644 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=455 2024-09-16T03:38:47.644 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:47.644 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:47.645 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.t00hkkpDxY 2024-09-16T03:38:47.645 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 455 -o /tmp/tmp.t00hkkpDxY 2024-09-16T03:38:48.080 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 455 2024-09-16T03:38:48.097 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.t00hkkpDxY 2024-09-16T03:38:48.097 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 455' 2024-09-16T03:38:48.118 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.t00hkkpDxY' 2024-09-16T03:38:48.119 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 455 2024-09-16T03:38:48.119 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.t00hkkpDxY 2024-09-16T03:38:48.121 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:48.121 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:48.121 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:48.121 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 456 2024-09-16T03:38:48.121 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=456 2024-09-16T03:38:48.121 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:48.121 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:48.122 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.7zc5NOPmRP 2024-09-16T03:38:48.122 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 456 -o /tmp/tmp.7zc5NOPmRP 2024-09-16T03:38:48.583 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 456 2024-09-16T03:38:48.601 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 456' 2024-09-16T03:38:48.601 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.7zc5NOPmRP 2024-09-16T03:38:48.622 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.7zc5NOPmRP' 2024-09-16T03:38:48.624 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 456 2024-09-16T03:38:48.624 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.7zc5NOPmRP 2024-09-16T03:38:48.626 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:48.626 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:48.626 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:48.627 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 457 2024-09-16T03:38:48.627 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=457 2024-09-16T03:38:48.627 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:48.627 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:48.627 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.hb0qc8yzlL 2024-09-16T03:38:48.628 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 457 -o /tmp/tmp.hb0qc8yzlL 2024-09-16T03:38:49.107 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 457 2024-09-16T03:38:49.125 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 457' 2024-09-16T03:38:49.125 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.hb0qc8yzlL 2024-09-16T03:38:49.146 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.hb0qc8yzlL' 2024-09-16T03:38:49.147 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 457 2024-09-16T03:38:49.148 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.hb0qc8yzlL 2024-09-16T03:38:49.149 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:49.149 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:49.149 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:49.149 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 458 2024-09-16T03:38:49.149 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=458 2024-09-16T03:38:49.149 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:49.150 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:49.150 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.WOs7m74qsa 2024-09-16T03:38:49.150 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 458 -o /tmp/tmp.WOs7m74qsa 2024-09-16T03:38:49.645 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 458 2024-09-16T03:38:49.663 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.WOs7m74qsa 2024-09-16T03:38:49.664 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 458' 2024-09-16T03:38:49.684 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.WOs7m74qsa' 2024-09-16T03:38:49.685 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 458 2024-09-16T03:38:49.685 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.WOs7m74qsa 2024-09-16T03:38:49.687 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:49.687 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:49.687 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:49.687 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 459 2024-09-16T03:38:49.687 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=459 2024-09-16T03:38:49.687 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:49.687 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:49.688 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.xAyrevCXyf 2024-09-16T03:38:49.688 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 459 -o /tmp/tmp.xAyrevCXyf 2024-09-16T03:38:50.128 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 459 2024-09-16T03:38:50.144 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.xAyrevCXyf 2024-09-16T03:38:50.144 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 459' 2024-09-16T03:38:50.163 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.xAyrevCXyf' 2024-09-16T03:38:50.165 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 459 2024-09-16T03:38:50.165 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.xAyrevCXyf 2024-09-16T03:38:50.166 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:50.166 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:50.166 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:50.166 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 460 2024-09-16T03:38:50.166 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=460 2024-09-16T03:38:50.167 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:50.167 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:50.167 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.EGVW2nSim2 2024-09-16T03:38:50.167 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 460 -o /tmp/tmp.EGVW2nSim2 2024-09-16T03:38:50.610 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 460 2024-09-16T03:38:50.627 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.EGVW2nSim2 2024-09-16T03:38:50.627 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 460' 2024-09-16T03:38:50.648 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.EGVW2nSim2' 2024-09-16T03:38:50.649 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 460 2024-09-16T03:38:50.650 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.EGVW2nSim2 2024-09-16T03:38:50.651 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:50.651 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:50.651 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:50.651 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 461 2024-09-16T03:38:50.651 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=461 2024-09-16T03:38:50.651 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:50.651 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:50.652 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.QwT09L44O6 2024-09-16T03:38:50.652 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 461 -o /tmp/tmp.QwT09L44O6 2024-09-16T03:38:51.049 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 461 2024-09-16T03:38:51.064 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.QwT09L44O6 2024-09-16T03:38:51.064 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 461' 2024-09-16T03:38:51.084 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.QwT09L44O6' 2024-09-16T03:38:51.085 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 461 2024-09-16T03:38:51.086 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.QwT09L44O6 2024-09-16T03:38:51.087 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:51.087 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:51.087 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:51.087 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 462 2024-09-16T03:38:51.087 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=462 2024-09-16T03:38:51.088 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:51.088 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:51.088 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.Fl8YIVhOcn 2024-09-16T03:38:51.088 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 462 -o /tmp/tmp.Fl8YIVhOcn 2024-09-16T03:38:51.491 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 462 2024-09-16T03:38:51.507 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.Fl8YIVhOcn 2024-09-16T03:38:51.507 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 462' 2024-09-16T03:38:51.526 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.Fl8YIVhOcn' 2024-09-16T03:38:51.528 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 462 2024-09-16T03:38:51.528 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.Fl8YIVhOcn 2024-09-16T03:38:51.530 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:51.530 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:51.530 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:51.530 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 463 2024-09-16T03:38:51.530 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=463 2024-09-16T03:38:51.530 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:51.530 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:51.531 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.PVdjDTIZ2X 2024-09-16T03:38:51.531 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 463 -o /tmp/tmp.PVdjDTIZ2X 2024-09-16T03:38:51.986 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 463 2024-09-16T03:38:52.004 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.PVdjDTIZ2X 2024-09-16T03:38:52.004 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 463' 2024-09-16T03:38:52.024 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.PVdjDTIZ2X' 2024-09-16T03:38:52.025 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 463 2024-09-16T03:38:52.026 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.PVdjDTIZ2X 2024-09-16T03:38:52.027 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:52.027 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:52.027 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:52.027 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 464 2024-09-16T03:38:52.027 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=464 2024-09-16T03:38:52.027 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:52.027 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:52.028 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.umo5rUHV37 2024-09-16T03:38:52.028 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 464 -o /tmp/tmp.umo5rUHV37 2024-09-16T03:38:52.415 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 464 2024-09-16T03:38:52.431 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.umo5rUHV37 2024-09-16T03:38:52.432 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 464' 2024-09-16T03:38:52.451 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.umo5rUHV37' 2024-09-16T03:38:52.453 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 464 2024-09-16T03:38:52.453 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.umo5rUHV37 2024-09-16T03:38:52.454 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:52.454 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:52.454 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:52.454 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 465 2024-09-16T03:38:52.454 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=465 2024-09-16T03:38:52.454 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:52.455 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:52.455 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.pXW4np8N41 2024-09-16T03:38:52.455 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 465 -o /tmp/tmp.pXW4np8N41 2024-09-16T03:38:52.912 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 465 2024-09-16T03:38:52.930 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.pXW4np8N41 2024-09-16T03:38:52.930 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 465' 2024-09-16T03:38:52.949 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.pXW4np8N41' 2024-09-16T03:38:52.951 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 465 2024-09-16T03:38:52.951 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.pXW4np8N41 2024-09-16T03:38:52.953 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:52.953 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:52.953 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:52.953 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 466 2024-09-16T03:38:52.953 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=466 2024-09-16T03:38:52.953 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:52.953 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:52.954 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.oo6mSH5XSl 2024-09-16T03:38:52.954 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 466 -o /tmp/tmp.oo6mSH5XSl 2024-09-16T03:38:53.350 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 466 2024-09-16T03:38:53.366 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.oo6mSH5XSl 2024-09-16T03:38:53.366 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 466' 2024-09-16T03:38:53.385 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.oo6mSH5XSl' 2024-09-16T03:38:53.387 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 466 2024-09-16T03:38:53.387 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.oo6mSH5XSl 2024-09-16T03:38:53.388 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:53.388 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:53.388 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:53.389 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 467 2024-09-16T03:38:53.389 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=467 2024-09-16T03:38:53.389 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:53.389 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:53.389 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.k7bphz6zB7 2024-09-16T03:38:53.389 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 467 -o /tmp/tmp.k7bphz6zB7 2024-09-16T03:38:53.782 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 467 2024-09-16T03:38:53.798 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.k7bphz6zB7 2024-09-16T03:38:53.798 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 467' 2024-09-16T03:38:53.818 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.k7bphz6zB7' 2024-09-16T03:38:53.820 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 467 2024-09-16T03:38:53.820 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.k7bphz6zB7 2024-09-16T03:38:53.821 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:53.822 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:53.822 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:53.822 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 468 2024-09-16T03:38:53.822 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=468 2024-09-16T03:38:53.822 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:53.822 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:53.822 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.qjoESA9H6k 2024-09-16T03:38:53.822 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 468 -o /tmp/tmp.qjoESA9H6k 2024-09-16T03:38:54.226 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 468 2024-09-16T03:38:54.242 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.qjoESA9H6k 2024-09-16T03:38:54.242 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 468' 2024-09-16T03:38:54.263 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.qjoESA9H6k' 2024-09-16T03:38:54.264 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 468 2024-09-16T03:38:54.264 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.qjoESA9H6k 2024-09-16T03:38:54.266 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:54.266 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:54.266 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:54.266 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 469 2024-09-16T03:38:54.266 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=469 2024-09-16T03:38:54.266 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:54.266 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:54.267 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.xMlNJr5Zs8 2024-09-16T03:38:54.267 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 469 -o /tmp/tmp.xMlNJr5Zs8 2024-09-16T03:38:54.752 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 469 2024-09-16T03:38:54.770 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.xMlNJr5Zs8 2024-09-16T03:38:54.770 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 469' 2024-09-16T03:38:54.791 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.xMlNJr5Zs8' 2024-09-16T03:38:54.792 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 469 2024-09-16T03:38:54.793 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.xMlNJr5Zs8 2024-09-16T03:38:54.794 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:54.794 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:54.794 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:54.794 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 470 2024-09-16T03:38:54.794 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=470 2024-09-16T03:38:54.794 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:54.795 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:54.795 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.1BwDbBh3Bv 2024-09-16T03:38:54.795 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 470 -o /tmp/tmp.1BwDbBh3Bv 2024-09-16T03:38:55.199 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 470 2024-09-16T03:38:55.215 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.1BwDbBh3Bv 2024-09-16T03:38:55.216 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 470' 2024-09-16T03:38:55.235 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.1BwDbBh3Bv' 2024-09-16T03:38:55.236 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 470 2024-09-16T03:38:55.237 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.1BwDbBh3Bv 2024-09-16T03:38:55.238 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:55.238 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:55.239 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:55.239 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 471 2024-09-16T03:38:55.239 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=471 2024-09-16T03:38:55.239 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:55.239 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:55.239 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.LRgDmFV3ww 2024-09-16T03:38:55.239 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 471 -o /tmp/tmp.LRgDmFV3ww 2024-09-16T03:38:55.646 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 471 2024-09-16T03:38:55.662 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.LRgDmFV3ww 2024-09-16T03:38:55.662 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 471' 2024-09-16T03:38:55.682 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.LRgDmFV3ww' 2024-09-16T03:38:55.683 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 471 2024-09-16T03:38:55.684 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.LRgDmFV3ww 2024-09-16T03:38:55.685 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:55.685 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:55.685 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:55.685 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 472 2024-09-16T03:38:55.685 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=472 2024-09-16T03:38:55.686 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:55.686 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:55.686 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.pFlNKUeJOY 2024-09-16T03:38:55.686 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 472 -o /tmp/tmp.pFlNKUeJOY 2024-09-16T03:38:56.158 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 472 2024-09-16T03:38:56.176 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.pFlNKUeJOY 2024-09-16T03:38:56.176 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 472' 2024-09-16T03:38:56.197 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.pFlNKUeJOY' 2024-09-16T03:38:56.197 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 472 2024-09-16T03:38:56.197 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.pFlNKUeJOY 2024-09-16T03:38:56.198 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:56.198 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:56.198 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:56.198 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 473 2024-09-16T03:38:56.198 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=473 2024-09-16T03:38:56.199 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:56.199 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:56.199 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.0Lux36u2EF 2024-09-16T03:38:56.199 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 473 -o /tmp/tmp.0Lux36u2EF 2024-09-16T03:38:56.698 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 473 2024-09-16T03:38:56.718 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.0Lux36u2EF 2024-09-16T03:38:56.718 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 473' 2024-09-16T03:38:56.739 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.0Lux36u2EF' 2024-09-16T03:38:56.741 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 473 2024-09-16T03:38:56.741 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.0Lux36u2EF 2024-09-16T03:38:56.742 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:56.742 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:56.742 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:56.742 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 474 2024-09-16T03:38:56.742 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=474 2024-09-16T03:38:56.742 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:56.742 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:56.743 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.XncNNsjNJ1 2024-09-16T03:38:56.743 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 474 -o /tmp/tmp.XncNNsjNJ1 2024-09-16T03:38:57.139 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 474 2024-09-16T03:38:57.156 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.XncNNsjNJ1 2024-09-16T03:38:57.156 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 474' 2024-09-16T03:38:57.175 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.XncNNsjNJ1' 2024-09-16T03:38:57.177 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 474 2024-09-16T03:38:57.177 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.XncNNsjNJ1 2024-09-16T03:38:57.178 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:57.179 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:57.179 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:57.179 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 475 2024-09-16T03:38:57.179 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=475 2024-09-16T03:38:57.179 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:57.179 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:57.179 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.jmLJP3rVXY 2024-09-16T03:38:57.179 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 475 -o /tmp/tmp.jmLJP3rVXY 2024-09-16T03:38:57.559 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 475 2024-09-16T03:38:57.574 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.jmLJP3rVXY 2024-09-16T03:38:57.575 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 475' 2024-09-16T03:38:57.594 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.jmLJP3rVXY' 2024-09-16T03:38:57.595 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 475 2024-09-16T03:38:57.595 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.jmLJP3rVXY 2024-09-16T03:38:57.597 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:57.597 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:57.597 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:57.597 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 476 2024-09-16T03:38:57.597 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=476 2024-09-16T03:38:57.597 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:57.597 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:57.597 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.65NrAoHJpB 2024-09-16T03:38:57.598 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 476 -o /tmp/tmp.65NrAoHJpB 2024-09-16T03:38:57.986 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 476 2024-09-16T03:38:58.003 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.65NrAoHJpB 2024-09-16T03:38:58.003 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 476' 2024-09-16T03:38:58.022 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.65NrAoHJpB' 2024-09-16T03:38:58.024 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 476 2024-09-16T03:38:58.024 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.65NrAoHJpB 2024-09-16T03:38:58.025 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:58.025 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:58.025 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:58.025 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 477 2024-09-16T03:38:58.025 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=477 2024-09-16T03:38:58.025 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:58.026 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:58.026 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.ldS7PwToIR 2024-09-16T03:38:58.026 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 477 -o /tmp/tmp.ldS7PwToIR 2024-09-16T03:38:58.427 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 477 2024-09-16T03:38:58.443 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.ldS7PwToIR 2024-09-16T03:38:58.443 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 477' 2024-09-16T03:38:58.463 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.ldS7PwToIR' 2024-09-16T03:38:58.464 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 477 2024-09-16T03:38:58.464 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.ldS7PwToIR 2024-09-16T03:38:58.466 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:58.466 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:58.466 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:58.466 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 478 2024-09-16T03:38:58.466 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=478 2024-09-16T03:38:58.466 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:58.466 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:58.466 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.7uszCSca3E 2024-09-16T03:38:58.467 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 478 -o /tmp/tmp.7uszCSca3E 2024-09-16T03:38:58.910 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 478 2024-09-16T03:38:58.926 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 478' 2024-09-16T03:38:58.927 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.7uszCSca3E 2024-09-16T03:38:58.947 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.7uszCSca3E' 2024-09-16T03:38:58.948 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 478 2024-09-16T03:38:58.948 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.7uszCSca3E 2024-09-16T03:38:58.949 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:58.950 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:58.950 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:58.950 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 479 2024-09-16T03:38:58.950 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=479 2024-09-16T03:38:58.950 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:58.950 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:58.950 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.q0aB2KhKUB 2024-09-16T03:38:58.951 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 479 -o /tmp/tmp.q0aB2KhKUB 2024-09-16T03:38:59.343 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 479 2024-09-16T03:38:59.360 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.q0aB2KhKUB 2024-09-16T03:38:59.360 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 479' 2024-09-16T03:38:59.380 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.q0aB2KhKUB' 2024-09-16T03:38:59.382 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 479 2024-09-16T03:38:59.382 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.q0aB2KhKUB 2024-09-16T03:38:59.383 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:59.383 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:59.383 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:59.384 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 480 2024-09-16T03:38:59.384 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=480 2024-09-16T03:38:59.384 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:59.384 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:59.384 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.vokd4Erkzl 2024-09-16T03:38:59.384 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 480 -o /tmp/tmp.vokd4Erkzl 2024-09-16T03:38:59.773 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 480 2024-09-16T03:38:59.789 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.vokd4Erkzl 2024-09-16T03:38:59.789 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 480' 2024-09-16T03:38:59.811 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.vokd4Erkzl' 2024-09-16T03:38:59.812 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 480 2024-09-16T03:38:59.813 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.vokd4Erkzl 2024-09-16T03:38:59.814 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:38:59.814 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:38:59.814 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:38:59.814 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 481 2024-09-16T03:38:59.814 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=481 2024-09-16T03:38:59.814 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:38:59.814 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:38:59.815 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.mdv6c1Kgk4 2024-09-16T03:38:59.815 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 481 -o /tmp/tmp.mdv6c1Kgk4 2024-09-16T03:39:00.200 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 481 2024-09-16T03:39:00.216 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 481' 2024-09-16T03:39:00.216 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.mdv6c1Kgk4 2024-09-16T03:39:00.235 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.mdv6c1Kgk4' 2024-09-16T03:39:00.237 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 481 2024-09-16T03:39:00.237 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.mdv6c1Kgk4 2024-09-16T03:39:00.239 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:00.239 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:00.239 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:00.239 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 482 2024-09-16T03:39:00.239 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=482 2024-09-16T03:39:00.239 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:00.239 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:00.240 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.gaZbXi1slz 2024-09-16T03:39:00.240 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 482 -o /tmp/tmp.gaZbXi1slz 2024-09-16T03:39:00.635 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 482 2024-09-16T03:39:00.651 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.gaZbXi1slz 2024-09-16T03:39:00.651 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 482' 2024-09-16T03:39:00.671 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.gaZbXi1slz' 2024-09-16T03:39:00.672 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 482 2024-09-16T03:39:00.672 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.gaZbXi1slz 2024-09-16T03:39:00.674 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:00.674 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:00.674 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:00.674 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 483 2024-09-16T03:39:00.674 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=483 2024-09-16T03:39:00.674 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:00.674 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:00.675 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.ktdishdPuk 2024-09-16T03:39:00.675 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 483 -o /tmp/tmp.ktdishdPuk 2024-09-16T03:39:01.121 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 483 2024-09-16T03:39:01.137 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.ktdishdPuk 2024-09-16T03:39:01.137 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 483' 2024-09-16T03:39:01.156 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.ktdishdPuk' 2024-09-16T03:39:01.158 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 483 2024-09-16T03:39:01.158 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.ktdishdPuk 2024-09-16T03:39:01.159 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:01.159 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:01.159 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:01.159 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 484 2024-09-16T03:39:01.159 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=484 2024-09-16T03:39:01.160 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:01.160 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:01.160 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.NpkbqvcCCk 2024-09-16T03:39:01.160 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 484 -o /tmp/tmp.NpkbqvcCCk 2024-09-16T03:39:01.612 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 484 2024-09-16T03:39:01.628 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.NpkbqvcCCk 2024-09-16T03:39:01.628 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 484' 2024-09-16T03:39:01.647 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.NpkbqvcCCk' 2024-09-16T03:39:01.649 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 484 2024-09-16T03:39:01.649 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.NpkbqvcCCk 2024-09-16T03:39:01.650 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:01.650 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:01.651 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:01.651 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 485 2024-09-16T03:39:01.651 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=485 2024-09-16T03:39:01.651 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:01.651 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:01.651 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.on67lyXyzr 2024-09-16T03:39:01.652 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 485 -o /tmp/tmp.on67lyXyzr 2024-09-16T03:39:02.046 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 485 2024-09-16T03:39:02.062 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.on67lyXyzr 2024-09-16T03:39:02.062 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 485' 2024-09-16T03:39:02.082 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.on67lyXyzr' 2024-09-16T03:39:02.084 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 485 2024-09-16T03:39:02.084 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.on67lyXyzr 2024-09-16T03:39:02.085 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:02.085 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:02.085 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:02.085 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 486 2024-09-16T03:39:02.085 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=486 2024-09-16T03:39:02.085 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:02.085 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:02.086 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.eBmXbPCpRK 2024-09-16T03:39:02.086 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 486 -o /tmp/tmp.eBmXbPCpRK 2024-09-16T03:39:02.521 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 486 2024-09-16T03:39:02.537 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.eBmXbPCpRK 2024-09-16T03:39:02.537 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 486' 2024-09-16T03:39:02.554 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.eBmXbPCpRK' 2024-09-16T03:39:02.555 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 486 2024-09-16T03:39:02.556 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.eBmXbPCpRK 2024-09-16T03:39:02.557 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:02.557 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:02.557 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:02.557 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 487 2024-09-16T03:39:02.558 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=487 2024-09-16T03:39:02.558 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:02.558 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:02.558 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.ago6EH3oZC 2024-09-16T03:39:02.558 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 487 -o /tmp/tmp.ago6EH3oZC 2024-09-16T03:39:03.008 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 487 2024-09-16T03:39:03.024 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.ago6EH3oZC 2024-09-16T03:39:03.024 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 487' 2024-09-16T03:39:03.039 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.ago6EH3oZC' 2024-09-16T03:39:03.041 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 487 2024-09-16T03:39:03.041 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.ago6EH3oZC 2024-09-16T03:39:03.043 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:03.043 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:03.043 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:03.043 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 488 2024-09-16T03:39:03.043 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=488 2024-09-16T03:39:03.043 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:03.043 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:03.043 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.roILkpAkei 2024-09-16T03:39:03.044 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 488 -o /tmp/tmp.roILkpAkei 2024-09-16T03:39:03.476 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 488 2024-09-16T03:39:03.494 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.roILkpAkei 2024-09-16T03:39:03.494 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 488' 2024-09-16T03:39:03.514 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.roILkpAkei' 2024-09-16T03:39:03.516 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 488 2024-09-16T03:39:03.516 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.roILkpAkei 2024-09-16T03:39:03.518 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:03.518 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:03.518 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:03.518 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 489 2024-09-16T03:39:03.518 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=489 2024-09-16T03:39:03.518 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:03.518 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:03.519 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.5eXnOGa22d 2024-09-16T03:39:03.519 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 489 -o /tmp/tmp.5eXnOGa22d 2024-09-16T03:39:03.939 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 489 2024-09-16T03:39:03.955 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.5eXnOGa22d 2024-09-16T03:39:03.955 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 489' 2024-09-16T03:39:03.974 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.5eXnOGa22d' 2024-09-16T03:39:03.976 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 489 2024-09-16T03:39:03.976 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.5eXnOGa22d 2024-09-16T03:39:03.977 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:03.978 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:03.978 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:03.978 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 490 2024-09-16T03:39:03.978 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=490 2024-09-16T03:39:03.978 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:03.978 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:03.978 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.MOS5HlHCWT 2024-09-16T03:39:03.978 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 490 -o /tmp/tmp.MOS5HlHCWT 2024-09-16T03:39:04.363 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 490 2024-09-16T03:39:04.379 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 490' 2024-09-16T03:39:04.379 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.MOS5HlHCWT 2024-09-16T03:39:04.401 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.MOS5HlHCWT' 2024-09-16T03:39:04.402 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 490 2024-09-16T03:39:04.403 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.MOS5HlHCWT 2024-09-16T03:39:04.404 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:04.404 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:04.404 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:04.404 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 491 2024-09-16T03:39:04.405 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=491 2024-09-16T03:39:04.405 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:04.405 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:04.405 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.lwlZc6HHNa 2024-09-16T03:39:04.405 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 491 -o /tmp/tmp.lwlZc6HHNa 2024-09-16T03:39:04.795 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 491 2024-09-16T03:39:04.828 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.lwlZc6HHNa 2024-09-16T03:39:04.828 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 491' 2024-09-16T03:39:04.848 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.lwlZc6HHNa' 2024-09-16T03:39:04.849 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 491 2024-09-16T03:39:04.849 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.lwlZc6HHNa 2024-09-16T03:39:04.874 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:04.874 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:04.874 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:04.874 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 492 2024-09-16T03:39:04.874 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=492 2024-09-16T03:39:04.874 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:04.874 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:04.874 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.MMifVIdzvL 2024-09-16T03:39:04.875 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 492 -o /tmp/tmp.MMifVIdzvL 2024-09-16T03:39:05.324 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 492 2024-09-16T03:39:05.342 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.MMifVIdzvL 2024-09-16T03:39:05.342 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 492' 2024-09-16T03:39:05.359 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.MMifVIdzvL' 2024-09-16T03:39:05.361 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 492 2024-09-16T03:39:05.361 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.MMifVIdzvL 2024-09-16T03:39:05.362 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:05.362 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:05.362 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:05.362 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 493 2024-09-16T03:39:05.362 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=493 2024-09-16T03:39:05.362 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:05.363 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:05.363 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.qP57QWQTSN 2024-09-16T03:39:05.363 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 493 -o /tmp/tmp.qP57QWQTSN 2024-09-16T03:39:05.757 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 493 2024-09-16T03:39:05.773 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 493' 2024-09-16T03:39:05.773 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.qP57QWQTSN 2024-09-16T03:39:05.794 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.qP57QWQTSN' 2024-09-16T03:39:05.795 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 493 2024-09-16T03:39:05.796 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.qP57QWQTSN 2024-09-16T03:39:05.797 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:05.797 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:05.797 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:05.797 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 494 2024-09-16T03:39:05.797 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=494 2024-09-16T03:39:05.797 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:05.798 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:05.798 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.dyH14CXoni 2024-09-16T03:39:05.798 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 494 -o /tmp/tmp.dyH14CXoni 2024-09-16T03:39:06.181 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 494 2024-09-16T03:39:06.196 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.dyH14CXoni 2024-09-16T03:39:06.196 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 494' 2024-09-16T03:39:06.216 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.dyH14CXoni' 2024-09-16T03:39:06.217 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 494 2024-09-16T03:39:06.218 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.dyH14CXoni 2024-09-16T03:39:06.219 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:06.219 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:06.219 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:06.219 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 495 2024-09-16T03:39:06.219 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=495 2024-09-16T03:39:06.219 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:06.220 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:06.220 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.pgSHx30shJ 2024-09-16T03:39:06.220 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 495 -o /tmp/tmp.pgSHx30shJ 2024-09-16T03:39:06.631 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 495 2024-09-16T03:39:06.647 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.pgSHx30shJ 2024-09-16T03:39:06.647 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 495' 2024-09-16T03:39:06.667 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.pgSHx30shJ' 2024-09-16T03:39:06.669 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 495 2024-09-16T03:39:06.669 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.pgSHx30shJ 2024-09-16T03:39:06.670 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:06.671 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:06.671 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:06.671 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 496 2024-09-16T03:39:06.671 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=496 2024-09-16T03:39:06.671 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:06.671 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:06.671 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.pamCM9kxuQ 2024-09-16T03:39:06.672 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 496 -o /tmp/tmp.pamCM9kxuQ 2024-09-16T03:39:07.065 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 496 2024-09-16T03:39:07.081 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.pamCM9kxuQ 2024-09-16T03:39:07.081 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 496' 2024-09-16T03:39:07.101 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.pamCM9kxuQ' 2024-09-16T03:39:07.102 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 496 2024-09-16T03:39:07.103 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.pamCM9kxuQ 2024-09-16T03:39:07.104 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:07.104 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:07.104 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:07.104 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 497 2024-09-16T03:39:07.104 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=497 2024-09-16T03:39:07.104 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:07.104 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:07.105 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.g36wxu1W6l 2024-09-16T03:39:07.105 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 497 -o /tmp/tmp.g36wxu1W6l 2024-09-16T03:39:07.524 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 497 2024-09-16T03:39:07.540 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.g36wxu1W6l 2024-09-16T03:39:07.541 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 497' 2024-09-16T03:39:07.562 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.g36wxu1W6l' 2024-09-16T03:39:07.563 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 497 2024-09-16T03:39:07.564 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.g36wxu1W6l 2024-09-16T03:39:07.564 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:07.565 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:07.565 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:07.565 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 498 2024-09-16T03:39:07.565 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=498 2024-09-16T03:39:07.565 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:07.565 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:07.566 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.iBVTkwcXFh 2024-09-16T03:39:07.566 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 498 -o /tmp/tmp.iBVTkwcXFh 2024-09-16T03:39:08.007 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 498 2024-09-16T03:39:08.023 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.iBVTkwcXFh 2024-09-16T03:39:08.023 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 498' 2024-09-16T03:39:08.039 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.iBVTkwcXFh' 2024-09-16T03:39:08.041 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 498 2024-09-16T03:39:08.041 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.iBVTkwcXFh 2024-09-16T03:39:08.042 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:08.042 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:08.042 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:08.042 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 499 2024-09-16T03:39:08.042 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=499 2024-09-16T03:39:08.042 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:08.042 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:08.043 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.mxB1tFel8j 2024-09-16T03:39:08.043 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 499 -o /tmp/tmp.mxB1tFel8j 2024-09-16T03:39:08.451 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 499 2024-09-16T03:39:08.467 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.mxB1tFel8j 2024-09-16T03:39:08.467 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 499' 2024-09-16T03:39:08.487 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.mxB1tFel8j' 2024-09-16T03:39:08.488 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 499 2024-09-16T03:39:08.489 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.mxB1tFel8j 2024-09-16T03:39:08.490 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:08.490 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:08.490 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:08.490 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 500 2024-09-16T03:39:08.491 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=500 2024-09-16T03:39:08.491 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:08.491 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:08.491 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.PxsbknWAfK 2024-09-16T03:39:08.491 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 500 -o /tmp/tmp.PxsbknWAfK 2024-09-16T03:39:08.895 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 500 2024-09-16T03:39:08.911 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.PxsbknWAfK 2024-09-16T03:39:08.911 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 500' 2024-09-16T03:39:08.931 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.PxsbknWAfK' 2024-09-16T03:39:08.932 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 500 2024-09-16T03:39:08.933 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.PxsbknWAfK 2024-09-16T03:39:08.934 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:08.934 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:08.934 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:08.934 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 501 2024-09-16T03:39:08.934 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=501 2024-09-16T03:39:08.934 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:08.934 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:08.935 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.9vPHYLim7q 2024-09-16T03:39:08.935 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 501 -o /tmp/tmp.9vPHYLim7q 2024-09-16T03:39:09.341 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 501 2024-09-16T03:39:09.358 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.9vPHYLim7q 2024-09-16T03:39:09.358 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 501' 2024-09-16T03:39:09.378 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.9vPHYLim7q' 2024-09-16T03:39:09.379 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 501 2024-09-16T03:39:09.380 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.9vPHYLim7q 2024-09-16T03:39:09.381 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:09.381 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:09.381 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:09.381 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 502 2024-09-16T03:39:09.381 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=502 2024-09-16T03:39:09.381 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:09.381 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:09.383 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.MiOAH7F41K 2024-09-16T03:39:09.383 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 502 -o /tmp/tmp.MiOAH7F41K 2024-09-16T03:39:09.771 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 502 2024-09-16T03:39:09.787 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.MiOAH7F41K 2024-09-16T03:39:09.787 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 502' 2024-09-16T03:39:09.807 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.MiOAH7F41K' 2024-09-16T03:39:09.809 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 502 2024-09-16T03:39:09.809 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.MiOAH7F41K 2024-09-16T03:39:09.810 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:09.810 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:09.810 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:09.810 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 503 2024-09-16T03:39:09.810 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=503 2024-09-16T03:39:09.810 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:09.811 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:09.811 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.oHRzlsicst 2024-09-16T03:39:09.811 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 503 -o /tmp/tmp.oHRzlsicst 2024-09-16T03:39:10.349 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 503 2024-09-16T03:39:10.411 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.oHRzlsicst 2024-09-16T03:39:10.411 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 503' 2024-09-16T03:39:10.411 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.oHRzlsicst' 2024-09-16T03:39:10.411 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 503 2024-09-16T03:39:10.412 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.oHRzlsicst 2024-09-16T03:39:10.412 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:10.412 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:10.413 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:10.413 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 504 2024-09-16T03:39:10.413 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=504 2024-09-16T03:39:10.413 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:10.413 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:10.413 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.iBktt5yfz4 2024-09-16T03:39:10.413 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 504 -o /tmp/tmp.iBktt5yfz4 2024-09-16T03:39:10.834 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 504 2024-09-16T03:39:10.850 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.iBktt5yfz4 2024-09-16T03:39:10.850 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 504' 2024-09-16T03:39:10.870 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.iBktt5yfz4' 2024-09-16T03:39:10.871 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 504 2024-09-16T03:39:10.872 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.iBktt5yfz4 2024-09-16T03:39:10.873 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:10.873 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:10.873 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:10.873 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 505 2024-09-16T03:39:10.873 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=505 2024-09-16T03:39:10.873 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:10.873 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:10.874 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.as7uXkmdU1 2024-09-16T03:39:10.874 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 505 -o /tmp/tmp.as7uXkmdU1 2024-09-16T03:39:11.335 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 505 2024-09-16T03:39:11.354 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.as7uXkmdU1 2024-09-16T03:39:11.354 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 505' 2024-09-16T03:39:11.374 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.as7uXkmdU1' 2024-09-16T03:39:11.376 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 505 2024-09-16T03:39:11.376 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.as7uXkmdU1 2024-09-16T03:39:11.377 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:11.377 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:11.377 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:11.377 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 506 2024-09-16T03:39:11.378 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=506 2024-09-16T03:39:11.378 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:11.378 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:11.378 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.hvarsdFkMp 2024-09-16T03:39:11.378 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 506 -o /tmp/tmp.hvarsdFkMp 2024-09-16T03:39:11.820 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 506 2024-09-16T03:39:11.839 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.hvarsdFkMp 2024-09-16T03:39:11.839 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 506' 2024-09-16T03:39:11.859 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.hvarsdFkMp' 2024-09-16T03:39:11.861 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 506 2024-09-16T03:39:11.861 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.hvarsdFkMp 2024-09-16T03:39:11.862 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:11.862 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:11.862 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:11.862 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 507 2024-09-16T03:39:11.862 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=507 2024-09-16T03:39:11.862 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:11.862 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:11.863 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.CMspghpkKb 2024-09-16T03:39:11.863 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 507 -o /tmp/tmp.CMspghpkKb 2024-09-16T03:39:12.284 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 507 2024-09-16T03:39:12.301 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.CMspghpkKb 2024-09-16T03:39:12.301 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 507' 2024-09-16T03:39:12.322 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.CMspghpkKb' 2024-09-16T03:39:12.323 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 507 2024-09-16T03:39:12.323 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.CMspghpkKb 2024-09-16T03:39:12.325 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:12.325 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:12.325 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:12.325 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 508 2024-09-16T03:39:12.325 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=508 2024-09-16T03:39:12.325 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:12.325 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:12.326 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.zHksyTr1a1 2024-09-16T03:39:12.326 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 508 -o /tmp/tmp.zHksyTr1a1 2024-09-16T03:39:12.781 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 508 2024-09-16T03:39:12.800 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.zHksyTr1a1 2024-09-16T03:39:12.800 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 508' 2024-09-16T03:39:12.820 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.zHksyTr1a1' 2024-09-16T03:39:12.821 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 508 2024-09-16T03:39:12.822 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.zHksyTr1a1 2024-09-16T03:39:12.823 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:12.823 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:12.823 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:12.823 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 509 2024-09-16T03:39:12.823 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=509 2024-09-16T03:39:12.823 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:12.823 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:12.824 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.sFG8FrqCp3 2024-09-16T03:39:12.825 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 509 -o /tmp/tmp.sFG8FrqCp3 2024-09-16T03:39:13.250 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 509 2024-09-16T03:39:13.266 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.sFG8FrqCp3 2024-09-16T03:39:13.266 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 509' 2024-09-16T03:39:13.286 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.sFG8FrqCp3' 2024-09-16T03:39:13.287 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 509 2024-09-16T03:39:13.287 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.sFG8FrqCp3 2024-09-16T03:39:13.289 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:13.289 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:13.289 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:13.289 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 510 2024-09-16T03:39:13.289 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=510 2024-09-16T03:39:13.289 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:13.289 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:13.289 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.ZLHEqtg1Mr 2024-09-16T03:39:13.290 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 510 -o /tmp/tmp.ZLHEqtg1Mr 2024-09-16T03:39:13.727 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 510 2024-09-16T03:39:13.743 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.ZLHEqtg1Mr 2024-09-16T03:39:13.743 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 510' 2024-09-16T03:39:13.762 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.ZLHEqtg1Mr' 2024-09-16T03:39:13.764 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 510 2024-09-16T03:39:13.764 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.ZLHEqtg1Mr 2024-09-16T03:39:13.765 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:13.765 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:13.765 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:13.765 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 511 2024-09-16T03:39:13.765 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=511 2024-09-16T03:39:13.765 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:13.766 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:13.766 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.EbK6I8dEGW 2024-09-16T03:39:13.766 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 511 -o /tmp/tmp.EbK6I8dEGW 2024-09-16T03:39:14.162 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 511 2024-09-16T03:39:14.178 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.EbK6I8dEGW 2024-09-16T03:39:14.178 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 511' 2024-09-16T03:39:14.198 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.EbK6I8dEGW' 2024-09-16T03:39:14.200 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 511 2024-09-16T03:39:14.200 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.EbK6I8dEGW 2024-09-16T03:39:14.201 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:14.201 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:14.201 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:14.201 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 512 2024-09-16T03:39:14.201 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=512 2024-09-16T03:39:14.201 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:14.202 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:14.202 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.HaSvOjMIKT 2024-09-16T03:39:14.202 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 512 -o /tmp/tmp.HaSvOjMIKT 2024-09-16T03:39:14.631 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 512 2024-09-16T03:39:14.649 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.HaSvOjMIKT 2024-09-16T03:39:14.649 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 512' 2024-09-16T03:39:14.668 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.HaSvOjMIKT' 2024-09-16T03:39:14.670 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 512 2024-09-16T03:39:14.670 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.HaSvOjMIKT 2024-09-16T03:39:14.671 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:14.671 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:14.671 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:14.671 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 513 2024-09-16T03:39:14.671 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=513 2024-09-16T03:39:14.671 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:14.672 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:14.672 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.sWBlbmwEvh 2024-09-16T03:39:14.672 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 513 -o /tmp/tmp.sWBlbmwEvh 2024-09-16T03:39:15.111 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 513 2024-09-16T03:39:15.127 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.sWBlbmwEvh 2024-09-16T03:39:15.127 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 513' 2024-09-16T03:39:15.146 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.sWBlbmwEvh' 2024-09-16T03:39:15.148 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 513 2024-09-16T03:39:15.148 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.sWBlbmwEvh 2024-09-16T03:39:15.149 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:15.149 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:15.149 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:15.149 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 514 2024-09-16T03:39:15.150 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=514 2024-09-16T03:39:15.150 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:15.150 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:15.150 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.EVwYo1qLWX 2024-09-16T03:39:15.150 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 514 -o /tmp/tmp.EVwYo1qLWX 2024-09-16T03:39:15.553 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 514 2024-09-16T03:39:15.569 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.EVwYo1qLWX 2024-09-16T03:39:15.569 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 514' 2024-09-16T03:39:15.584 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.EVwYo1qLWX' 2024-09-16T03:39:15.585 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 514 2024-09-16T03:39:15.585 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.EVwYo1qLWX 2024-09-16T03:39:15.587 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:15.587 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:15.587 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:15.587 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 515 2024-09-16T03:39:15.587 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=515 2024-09-16T03:39:15.587 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:15.587 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:15.588 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.14UQuCEk0K 2024-09-16T03:39:15.588 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 515 -o /tmp/tmp.14UQuCEk0K 2024-09-16T03:39:16.043 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 515 2024-09-16T03:39:16.062 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.14UQuCEk0K 2024-09-16T03:39:16.062 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 515' 2024-09-16T03:39:16.082 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.14UQuCEk0K' 2024-09-16T03:39:16.084 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 515 2024-09-16T03:39:16.084 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.14UQuCEk0K 2024-09-16T03:39:16.085 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:16.085 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:16.085 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:16.085 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 516 2024-09-16T03:39:16.086 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=516 2024-09-16T03:39:16.086 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:16.086 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:16.086 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.SV3HFddJz2 2024-09-16T03:39:16.086 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 516 -o /tmp/tmp.SV3HFddJz2 2024-09-16T03:39:16.545 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 516 2024-09-16T03:39:16.563 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.SV3HFddJz2 2024-09-16T03:39:16.563 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 516' 2024-09-16T03:39:16.583 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.SV3HFddJz2' 2024-09-16T03:39:16.585 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 516 2024-09-16T03:39:16.585 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.SV3HFddJz2 2024-09-16T03:39:16.587 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:16.587 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:16.587 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:16.587 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 517 2024-09-16T03:39:16.587 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=517 2024-09-16T03:39:16.588 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:16.588 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:16.588 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.Lf7901jGkM 2024-09-16T03:39:16.588 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 517 -o /tmp/tmp.Lf7901jGkM 2024-09-16T03:39:17.030 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 517 2024-09-16T03:39:17.047 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.Lf7901jGkM 2024-09-16T03:39:17.047 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 517' 2024-09-16T03:39:17.069 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.Lf7901jGkM' 2024-09-16T03:39:17.070 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 517 2024-09-16T03:39:17.070 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.Lf7901jGkM 2024-09-16T03:39:17.072 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:17.072 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:17.072 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:17.072 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 518 2024-09-16T03:39:17.072 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=518 2024-09-16T03:39:17.072 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:17.072 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:17.073 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.3idJnq2st0 2024-09-16T03:39:17.073 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 518 -o /tmp/tmp.3idJnq2st0 2024-09-16T03:39:17.540 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 518 2024-09-16T03:39:17.558 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.3idJnq2st0 2024-09-16T03:39:17.558 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 518' 2024-09-16T03:39:17.578 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.3idJnq2st0' 2024-09-16T03:39:17.579 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 518 2024-09-16T03:39:17.580 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.3idJnq2st0 2024-09-16T03:39:17.581 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:17.581 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:17.581 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:17.581 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 519 2024-09-16T03:39:17.581 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=519 2024-09-16T03:39:17.582 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:17.582 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:17.582 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.FqCbn75eOj 2024-09-16T03:39:17.582 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 519 -o /tmp/tmp.FqCbn75eOj 2024-09-16T03:39:17.971 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 519 2024-09-16T03:39:17.986 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.FqCbn75eOj 2024-09-16T03:39:17.987 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 519' 2024-09-16T03:39:18.006 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.FqCbn75eOj' 2024-09-16T03:39:18.007 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 519 2024-09-16T03:39:18.008 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.FqCbn75eOj 2024-09-16T03:39:18.009 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:18.009 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:18.009 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:18.009 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 520 2024-09-16T03:39:18.009 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=520 2024-09-16T03:39:18.009 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:18.009 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:18.010 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.MT5cnyBuQ0 2024-09-16T03:39:18.010 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 520 -o /tmp/tmp.MT5cnyBuQ0 2024-09-16T03:39:18.421 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 520 2024-09-16T03:39:18.437 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.MT5cnyBuQ0 2024-09-16T03:39:18.437 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 520' 2024-09-16T03:39:18.457 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.MT5cnyBuQ0' 2024-09-16T03:39:18.458 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 520 2024-09-16T03:39:18.458 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.MT5cnyBuQ0 2024-09-16T03:39:18.460 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:18.460 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:18.460 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:18.460 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 521 2024-09-16T03:39:18.460 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=521 2024-09-16T03:39:18.460 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:18.460 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:18.461 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.WJkccip0hZ 2024-09-16T03:39:18.461 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 521 -o /tmp/tmp.WJkccip0hZ 2024-09-16T03:39:18.865 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 521 2024-09-16T03:39:18.882 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.WJkccip0hZ 2024-09-16T03:39:18.882 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 521' 2024-09-16T03:39:18.902 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.WJkccip0hZ' 2024-09-16T03:39:18.904 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 521 2024-09-16T03:39:18.904 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.WJkccip0hZ 2024-09-16T03:39:18.905 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:18.908 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:18.908 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:18.908 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 522 2024-09-16T03:39:18.908 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=522 2024-09-16T03:39:18.908 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:18.908 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:18.909 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.VkW5JlM7LM 2024-09-16T03:39:18.909 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 522 -o /tmp/tmp.VkW5JlM7LM 2024-09-16T03:39:19.312 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 522 2024-09-16T03:39:19.328 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.VkW5JlM7LM 2024-09-16T03:39:19.328 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 522' 2024-09-16T03:39:19.347 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.VkW5JlM7LM' 2024-09-16T03:39:19.349 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 522 2024-09-16T03:39:19.350 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.VkW5JlM7LM 2024-09-16T03:39:19.351 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:19.351 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:19.351 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:19.352 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 523 2024-09-16T03:39:19.352 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=523 2024-09-16T03:39:19.352 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:19.352 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:19.353 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.xdSMzrayYq 2024-09-16T03:39:19.353 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 523 -o /tmp/tmp.xdSMzrayYq 2024-09-16T03:39:19.805 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 523 2024-09-16T03:39:19.822 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.xdSMzrayYq 2024-09-16T03:39:19.822 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 523' 2024-09-16T03:39:19.842 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.xdSMzrayYq' 2024-09-16T03:39:19.844 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 523 2024-09-16T03:39:19.844 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.xdSMzrayYq 2024-09-16T03:39:19.845 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:19.845 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:19.845 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:19.845 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 524 2024-09-16T03:39:19.845 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=524 2024-09-16T03:39:19.845 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:19.845 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:19.846 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.ZUEMKLLoG3 2024-09-16T03:39:19.846 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 524 -o /tmp/tmp.ZUEMKLLoG3 2024-09-16T03:39:20.274 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 524 2024-09-16T03:39:20.290 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.ZUEMKLLoG3 2024-09-16T03:39:20.290 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 524' 2024-09-16T03:39:20.310 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.ZUEMKLLoG3' 2024-09-16T03:39:20.312 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 524 2024-09-16T03:39:20.312 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.ZUEMKLLoG3 2024-09-16T03:39:20.313 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:20.313 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:20.313 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:20.313 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 525 2024-09-16T03:39:20.313 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=525 2024-09-16T03:39:20.314 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:20.314 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:20.314 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.psAGLbmI93 2024-09-16T03:39:20.314 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 525 -o /tmp/tmp.psAGLbmI93 2024-09-16T03:39:20.730 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 525 2024-09-16T03:39:20.748 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.psAGLbmI93 2024-09-16T03:39:20.748 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 525' 2024-09-16T03:39:20.766 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.psAGLbmI93' 2024-09-16T03:39:20.768 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 525 2024-09-16T03:39:20.768 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.psAGLbmI93 2024-09-16T03:39:20.770 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:20.770 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:20.770 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:20.770 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 526 2024-09-16T03:39:20.771 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=526 2024-09-16T03:39:20.771 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:20.771 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:20.772 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.KqF5vpP0RX 2024-09-16T03:39:20.772 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 526 -o /tmp/tmp.KqF5vpP0RX 2024-09-16T03:39:21.225 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 526 2024-09-16T03:39:21.242 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 526' 2024-09-16T03:39:21.242 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.KqF5vpP0RX 2024-09-16T03:39:21.262 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.KqF5vpP0RX' 2024-09-16T03:39:21.264 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 526 2024-09-16T03:39:21.264 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.KqF5vpP0RX 2024-09-16T03:39:21.266 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:21.266 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:21.266 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:21.267 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 527 2024-09-16T03:39:21.267 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=527 2024-09-16T03:39:21.267 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:21.267 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:21.267 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.usT7dKuzzh 2024-09-16T03:39:21.268 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 527 -o /tmp/tmp.usT7dKuzzh 2024-09-16T03:39:21.665 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 527 2024-09-16T03:39:21.681 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.usT7dKuzzh 2024-09-16T03:39:21.681 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 527' 2024-09-16T03:39:21.701 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.usT7dKuzzh' 2024-09-16T03:39:21.703 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 527 2024-09-16T03:39:21.703 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.usT7dKuzzh 2024-09-16T03:39:21.705 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:21.705 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:21.705 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:21.705 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 528 2024-09-16T03:39:21.705 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=528 2024-09-16T03:39:21.705 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:21.705 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:21.705 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.or8rEeG2gD 2024-09-16T03:39:21.706 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 528 -o /tmp/tmp.or8rEeG2gD 2024-09-16T03:39:22.155 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 528 2024-09-16T03:39:22.172 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.or8rEeG2gD 2024-09-16T03:39:22.172 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 528' 2024-09-16T03:39:22.191 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.or8rEeG2gD' 2024-09-16T03:39:22.193 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 528 2024-09-16T03:39:22.193 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.or8rEeG2gD 2024-09-16T03:39:22.194 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:22.195 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:22.195 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:22.195 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 529 2024-09-16T03:39:22.195 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=529 2024-09-16T03:39:22.195 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:22.195 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:22.195 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.H7QMPIM4jJ 2024-09-16T03:39:22.195 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 529 -o /tmp/tmp.H7QMPIM4jJ 2024-09-16T03:39:22.594 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 529 2024-09-16T03:39:22.610 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.H7QMPIM4jJ 2024-09-16T03:39:22.610 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 529' 2024-09-16T03:39:22.630 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.H7QMPIM4jJ' 2024-09-16T03:39:22.631 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 529 2024-09-16T03:39:22.632 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.H7QMPIM4jJ 2024-09-16T03:39:22.633 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:22.633 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:22.633 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:22.633 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 530 2024-09-16T03:39:22.633 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=530 2024-09-16T03:39:22.633 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:22.633 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:22.634 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.MpFJYxWGzB 2024-09-16T03:39:22.634 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 530 -o /tmp/tmp.MpFJYxWGzB 2024-09-16T03:39:23.052 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 530 2024-09-16T03:39:23.068 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.MpFJYxWGzB 2024-09-16T03:39:23.068 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 530' 2024-09-16T03:39:23.087 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.MpFJYxWGzB' 2024-09-16T03:39:23.089 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 530 2024-09-16T03:39:23.089 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.MpFJYxWGzB 2024-09-16T03:39:23.091 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:23.091 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:23.091 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:23.091 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 531 2024-09-16T03:39:23.091 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=531 2024-09-16T03:39:23.091 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:23.091 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:23.092 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.y5TG7Lyzaj 2024-09-16T03:39:23.092 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 531 -o /tmp/tmp.y5TG7Lyzaj 2024-09-16T03:39:23.493 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 531 2024-09-16T03:39:23.509 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.y5TG7Lyzaj 2024-09-16T03:39:23.509 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 531' 2024-09-16T03:39:23.530 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.y5TG7Lyzaj' 2024-09-16T03:39:23.531 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 531 2024-09-16T03:39:23.532 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.y5TG7Lyzaj 2024-09-16T03:39:23.533 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:23.533 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:23.533 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:23.533 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 532 2024-09-16T03:39:23.533 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=532 2024-09-16T03:39:23.533 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:23.534 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:23.535 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.cgPbDs2D64 2024-09-16T03:39:23.535 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 532 -o /tmp/tmp.cgPbDs2D64 2024-09-16T03:39:23.937 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 532 2024-09-16T03:39:23.953 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.cgPbDs2D64 2024-09-16T03:39:23.953 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 532' 2024-09-16T03:39:23.973 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.cgPbDs2D64' 2024-09-16T03:39:23.975 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 532 2024-09-16T03:39:23.975 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.cgPbDs2D64 2024-09-16T03:39:23.977 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:23.977 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:23.977 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:23.977 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 533 2024-09-16T03:39:23.977 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=533 2024-09-16T03:39:23.977 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:23.977 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:23.978 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.kTALKVyf5t 2024-09-16T03:39:23.978 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 533 -o /tmp/tmp.kTALKVyf5t 2024-09-16T03:39:24.414 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 533 2024-09-16T03:39:24.431 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.kTALKVyf5t 2024-09-16T03:39:24.431 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 533' 2024-09-16T03:39:24.451 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.kTALKVyf5t' 2024-09-16T03:39:24.452 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 533 2024-09-16T03:39:24.453 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.kTALKVyf5t 2024-09-16T03:39:24.454 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:24.455 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:24.455 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:24.455 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 534 2024-09-16T03:39:24.455 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=534 2024-09-16T03:39:24.455 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:24.455 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:24.455 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.2o1ZCxmUBl 2024-09-16T03:39:24.456 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 534 -o /tmp/tmp.2o1ZCxmUBl 2024-09-16T03:39:24.882 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 534 2024-09-16T03:39:24.898 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.2o1ZCxmUBl 2024-09-16T03:39:24.898 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 534' 2024-09-16T03:39:24.918 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.2o1ZCxmUBl' 2024-09-16T03:39:24.919 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 534 2024-09-16T03:39:24.919 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.2o1ZCxmUBl 2024-09-16T03:39:24.921 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:24.921 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:24.921 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:24.921 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 535 2024-09-16T03:39:24.921 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=535 2024-09-16T03:39:24.921 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:24.922 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:24.922 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.bqFOZZjr6q 2024-09-16T03:39:24.922 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 535 -o /tmp/tmp.bqFOZZjr6q 2024-09-16T03:39:25.305 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 535 2024-09-16T03:39:25.321 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.bqFOZZjr6q 2024-09-16T03:39:25.321 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 535' 2024-09-16T03:39:25.340 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.bqFOZZjr6q' 2024-09-16T03:39:25.342 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 535 2024-09-16T03:39:25.342 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.bqFOZZjr6q 2024-09-16T03:39:25.343 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:25.343 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:25.343 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:25.343 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 536 2024-09-16T03:39:25.343 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=536 2024-09-16T03:39:25.343 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:25.343 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:25.344 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.yjCeAqkKdR 2024-09-16T03:39:25.344 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 536 -o /tmp/tmp.yjCeAqkKdR 2024-09-16T03:39:25.726 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 536 2024-09-16T03:39:25.741 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.yjCeAqkKdR 2024-09-16T03:39:25.742 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 536' 2024-09-16T03:39:25.762 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.yjCeAqkKdR' 2024-09-16T03:39:25.764 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 536 2024-09-16T03:39:25.764 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.yjCeAqkKdR 2024-09-16T03:39:25.765 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:25.765 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:25.765 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:25.765 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 537 2024-09-16T03:39:25.765 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=537 2024-09-16T03:39:25.765 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:25.765 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:25.766 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.lx9yR1fBlM 2024-09-16T03:39:25.766 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 537 -o /tmp/tmp.lx9yR1fBlM 2024-09-16T03:39:26.193 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 537 2024-09-16T03:39:26.211 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.lx9yR1fBlM 2024-09-16T03:39:26.211 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 537' 2024-09-16T03:39:26.231 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.lx9yR1fBlM' 2024-09-16T03:39:26.232 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 537 2024-09-16T03:39:26.233 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.lx9yR1fBlM 2024-09-16T03:39:26.234 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:26.234 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:26.234 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:26.234 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 538 2024-09-16T03:39:26.234 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=538 2024-09-16T03:39:26.234 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:26.235 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:26.235 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.I313HqPpgO 2024-09-16T03:39:26.235 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 538 -o /tmp/tmp.I313HqPpgO 2024-09-16T03:39:26.657 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 538 2024-09-16T03:39:26.673 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.I313HqPpgO 2024-09-16T03:39:26.673 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 538' 2024-09-16T03:39:26.694 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.I313HqPpgO' 2024-09-16T03:39:26.696 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 538 2024-09-16T03:39:26.696 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.I313HqPpgO 2024-09-16T03:39:26.698 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:26.698 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:26.698 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:26.698 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 539 2024-09-16T03:39:26.698 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=539 2024-09-16T03:39:26.698 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:26.698 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:26.699 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.mk8eqxO0Xc 2024-09-16T03:39:26.699 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 539 -o /tmp/tmp.mk8eqxO0Xc 2024-09-16T03:39:27.109 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 539 2024-09-16T03:39:27.126 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.mk8eqxO0Xc 2024-09-16T03:39:27.126 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 539' 2024-09-16T03:39:27.146 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.mk8eqxO0Xc' 2024-09-16T03:39:27.148 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 539 2024-09-16T03:39:27.148 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.mk8eqxO0Xc 2024-09-16T03:39:27.149 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:27.149 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:27.149 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:27.149 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 540 2024-09-16T03:39:27.149 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=540 2024-09-16T03:39:27.150 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:27.150 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:27.150 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.9M9hQWEBqi 2024-09-16T03:39:27.151 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 540 -o /tmp/tmp.9M9hQWEBqi 2024-09-16T03:39:27.592 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 540 2024-09-16T03:39:27.609 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.9M9hQWEBqi 2024-09-16T03:39:27.609 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 540' 2024-09-16T03:39:27.624 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.9M9hQWEBqi' 2024-09-16T03:39:27.625 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 540 2024-09-16T03:39:27.626 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.9M9hQWEBqi 2024-09-16T03:39:27.627 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:27.627 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:27.627 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:27.627 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 541 2024-09-16T03:39:27.627 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=541 2024-09-16T03:39:27.627 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:27.627 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:27.628 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.OnRKNJRaSh 2024-09-16T03:39:27.628 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 541 -o /tmp/tmp.OnRKNJRaSh 2024-09-16T03:39:28.052 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 541 2024-09-16T03:39:28.068 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 541' 2024-09-16T03:39:28.068 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.OnRKNJRaSh 2024-09-16T03:39:28.089 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.OnRKNJRaSh' 2024-09-16T03:39:28.091 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 541 2024-09-16T03:39:28.091 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.OnRKNJRaSh 2024-09-16T03:39:28.092 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:28.093 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:28.093 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:28.093 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 542 2024-09-16T03:39:28.093 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=542 2024-09-16T03:39:28.093 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:28.093 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:28.093 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.CfkWUeuRCh 2024-09-16T03:39:28.093 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 542 -o /tmp/tmp.CfkWUeuRCh 2024-09-16T03:39:28.482 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 542 2024-09-16T03:39:28.498 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.CfkWUeuRCh 2024-09-16T03:39:28.498 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 542' 2024-09-16T03:39:28.519 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.CfkWUeuRCh' 2024-09-16T03:39:28.520 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 542 2024-09-16T03:39:28.520 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.CfkWUeuRCh 2024-09-16T03:39:28.525 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:28.525 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:28.525 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:28.525 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 543 2024-09-16T03:39:28.525 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=543 2024-09-16T03:39:28.525 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:28.525 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:28.525 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.AY1vnNu3xj 2024-09-16T03:39:28.525 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 543 -o /tmp/tmp.AY1vnNu3xj 2024-09-16T03:39:28.980 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 543 2024-09-16T03:39:28.998 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.AY1vnNu3xj 2024-09-16T03:39:28.998 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 543' 2024-09-16T03:39:29.018 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.AY1vnNu3xj' 2024-09-16T03:39:29.020 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 543 2024-09-16T03:39:29.020 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.AY1vnNu3xj 2024-09-16T03:39:29.021 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:29.021 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:29.021 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:29.021 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 544 2024-09-16T03:39:29.021 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=544 2024-09-16T03:39:29.022 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:29.022 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:29.022 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.cYGNab2kzZ 2024-09-16T03:39:29.022 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 544 -o /tmp/tmp.cYGNab2kzZ 2024-09-16T03:39:29.465 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 544 2024-09-16T03:39:29.481 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.cYGNab2kzZ 2024-09-16T03:39:29.481 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 544' 2024-09-16T03:39:29.501 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.cYGNab2kzZ' 2024-09-16T03:39:29.502 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 544 2024-09-16T03:39:29.502 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.cYGNab2kzZ 2024-09-16T03:39:29.504 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:29.504 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:29.504 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:29.505 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 545 2024-09-16T03:39:29.505 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=545 2024-09-16T03:39:29.505 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:29.505 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:29.505 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.lfW6yu4j3q 2024-09-16T03:39:29.505 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 545 -o /tmp/tmp.lfW6yu4j3q 2024-09-16T03:39:29.895 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 545 2024-09-16T03:39:29.911 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.lfW6yu4j3q 2024-09-16T03:39:29.911 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 545' 2024-09-16T03:39:29.930 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.lfW6yu4j3q' 2024-09-16T03:39:29.932 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 545 2024-09-16T03:39:29.932 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.lfW6yu4j3q 2024-09-16T03:39:29.933 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:29.934 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:29.934 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:29.934 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 546 2024-09-16T03:39:29.934 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=546 2024-09-16T03:39:29.934 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:29.934 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:29.934 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.Q6IxToTRYg 2024-09-16T03:39:29.935 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 546 -o /tmp/tmp.Q6IxToTRYg 2024-09-16T03:39:30.331 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 546 2024-09-16T03:39:30.347 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.Q6IxToTRYg 2024-09-16T03:39:30.347 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 546' 2024-09-16T03:39:30.367 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.Q6IxToTRYg' 2024-09-16T03:39:30.368 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 546 2024-09-16T03:39:30.369 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.Q6IxToTRYg 2024-09-16T03:39:30.370 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:30.370 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:30.370 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:30.370 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 547 2024-09-16T03:39:30.371 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=547 2024-09-16T03:39:30.371 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:30.371 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:30.371 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.VcNDDWbi1W 2024-09-16T03:39:30.371 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 547 -o /tmp/tmp.VcNDDWbi1W 2024-09-16T03:39:30.776 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 547 2024-09-16T03:39:30.792 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.VcNDDWbi1W 2024-09-16T03:39:30.792 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 547' 2024-09-16T03:39:30.811 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.VcNDDWbi1W' 2024-09-16T03:39:30.813 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 547 2024-09-16T03:39:30.813 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.VcNDDWbi1W 2024-09-16T03:39:30.814 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:30.814 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:30.814 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:30.815 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 548 2024-09-16T03:39:30.815 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=548 2024-09-16T03:39:30.815 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:30.815 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:30.815 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.ytkGrXXTmI 2024-09-16T03:39:30.815 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 548 -o /tmp/tmp.ytkGrXXTmI 2024-09-16T03:39:31.206 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 548 2024-09-16T03:39:31.222 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 548' 2024-09-16T03:39:31.222 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.ytkGrXXTmI 2024-09-16T03:39:31.242 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.ytkGrXXTmI' 2024-09-16T03:39:31.244 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 548 2024-09-16T03:39:31.244 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.ytkGrXXTmI 2024-09-16T03:39:31.245 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:31.245 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:31.245 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:31.245 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 549 2024-09-16T03:39:31.245 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=549 2024-09-16T03:39:31.246 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:31.246 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:31.246 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.oJOY0n9E19 2024-09-16T03:39:31.246 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 549 -o /tmp/tmp.oJOY0n9E19 2024-09-16T03:39:31.714 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 549 2024-09-16T03:39:31.733 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.oJOY0n9E19 2024-09-16T03:39:31.733 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 549' 2024-09-16T03:39:31.753 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.oJOY0n9E19' 2024-09-16T03:39:31.755 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 549 2024-09-16T03:39:31.755 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.oJOY0n9E19 2024-09-16T03:39:31.756 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:31.756 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:31.756 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:31.756 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 550 2024-09-16T03:39:31.756 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=550 2024-09-16T03:39:31.756 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:31.756 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:31.757 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.t613wfQpBD 2024-09-16T03:39:31.757 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 550 -o /tmp/tmp.t613wfQpBD 2024-09-16T03:39:32.215 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 550 2024-09-16T03:39:32.232 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.t613wfQpBD 2024-09-16T03:39:32.232 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 550' 2024-09-16T03:39:32.251 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.t613wfQpBD' 2024-09-16T03:39:32.253 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 550 2024-09-16T03:39:32.253 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.t613wfQpBD 2024-09-16T03:39:32.254 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:32.254 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:32.254 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:32.255 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 551 2024-09-16T03:39:32.255 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=551 2024-09-16T03:39:32.255 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:32.255 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:32.255 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.Ce2VK4rZJk 2024-09-16T03:39:32.255 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 551 -o /tmp/tmp.Ce2VK4rZJk 2024-09-16T03:39:32.679 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 551 2024-09-16T03:39:32.697 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.Ce2VK4rZJk 2024-09-16T03:39:32.697 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 551' 2024-09-16T03:39:32.717 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.Ce2VK4rZJk' 2024-09-16T03:39:32.718 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 551 2024-09-16T03:39:32.718 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.Ce2VK4rZJk 2024-09-16T03:39:32.720 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:32.720 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:32.720 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:32.720 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 552 2024-09-16T03:39:32.720 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=552 2024-09-16T03:39:32.720 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:32.720 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:32.721 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.WLQIpw0Iur 2024-09-16T03:39:32.721 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 552 -o /tmp/tmp.WLQIpw0Iur 2024-09-16T03:39:33.147 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 552 2024-09-16T03:39:33.164 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.WLQIpw0Iur 2024-09-16T03:39:33.164 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 552' 2024-09-16T03:39:33.178 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.WLQIpw0Iur' 2024-09-16T03:39:33.180 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 552 2024-09-16T03:39:33.180 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.WLQIpw0Iur 2024-09-16T03:39:33.181 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:33.181 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:33.181 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:33.181 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 553 2024-09-16T03:39:33.181 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=553 2024-09-16T03:39:33.181 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:33.182 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:33.182 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.PSRHK34oMY 2024-09-16T03:39:33.182 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 553 -o /tmp/tmp.PSRHK34oMY 2024-09-16T03:39:33.595 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 553 2024-09-16T03:39:33.612 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.PSRHK34oMY 2024-09-16T03:39:33.612 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 553' 2024-09-16T03:39:33.631 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.PSRHK34oMY' 2024-09-16T03:39:33.633 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 553 2024-09-16T03:39:33.633 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.PSRHK34oMY 2024-09-16T03:39:33.634 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:33.634 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:33.634 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:33.634 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 554 2024-09-16T03:39:33.635 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=554 2024-09-16T03:39:33.635 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:33.635 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:33.635 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.BSx8OWbTke 2024-09-16T03:39:33.635 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 554 -o /tmp/tmp.BSx8OWbTke 2024-09-16T03:39:34.072 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 554 2024-09-16T03:39:34.088 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.BSx8OWbTke 2024-09-16T03:39:34.088 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 554' 2024-09-16T03:39:34.107 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.BSx8OWbTke' 2024-09-16T03:39:34.109 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 554 2024-09-16T03:39:34.109 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.BSx8OWbTke 2024-09-16T03:39:34.110 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:34.110 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:34.111 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:34.111 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 555 2024-09-16T03:39:34.111 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=555 2024-09-16T03:39:34.111 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:34.111 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:34.111 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.hSK6rLafut 2024-09-16T03:39:34.111 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 555 -o /tmp/tmp.hSK6rLafut 2024-09-16T03:39:34.556 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 555 2024-09-16T03:39:34.574 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.hSK6rLafut 2024-09-16T03:39:34.574 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 555' 2024-09-16T03:39:34.593 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.hSK6rLafut' 2024-09-16T03:39:34.595 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 555 2024-09-16T03:39:34.595 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.hSK6rLafut 2024-09-16T03:39:34.596 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:34.596 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:34.596 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:34.596 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 556 2024-09-16T03:39:34.596 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=556 2024-09-16T03:39:34.596 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:34.597 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:34.597 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.gvksa63xCx 2024-09-16T03:39:34.597 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 556 -o /tmp/tmp.gvksa63xCx 2024-09-16T03:39:35.068 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 556 2024-09-16T03:39:35.086 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.gvksa63xCx 2024-09-16T03:39:35.086 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 556' 2024-09-16T03:39:35.107 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.gvksa63xCx' 2024-09-16T03:39:35.108 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 556 2024-09-16T03:39:35.109 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.gvksa63xCx 2024-09-16T03:39:35.110 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:35.110 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:35.110 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:35.110 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 557 2024-09-16T03:39:35.110 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=557 2024-09-16T03:39:35.111 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:35.111 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:35.111 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.JWOQCTXoX9 2024-09-16T03:39:35.111 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 557 -o /tmp/tmp.JWOQCTXoX9 2024-09-16T03:39:35.512 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 557 2024-09-16T03:39:35.536 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 557' 2024-09-16T03:39:35.536 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.JWOQCTXoX9 2024-09-16T03:39:35.555 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.JWOQCTXoX9' 2024-09-16T03:39:35.557 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 557 2024-09-16T03:39:35.557 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.JWOQCTXoX9 2024-09-16T03:39:35.579 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:35.579 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:35.579 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:35.579 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 558 2024-09-16T03:39:35.579 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=558 2024-09-16T03:39:35.579 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:35.579 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:35.579 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.IV7YfQRME0 2024-09-16T03:39:35.580 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 558 -o /tmp/tmp.IV7YfQRME0 2024-09-16T03:39:36.017 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 558 2024-09-16T03:39:36.034 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.IV7YfQRME0 2024-09-16T03:39:36.034 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 558' 2024-09-16T03:39:36.054 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.IV7YfQRME0' 2024-09-16T03:39:36.055 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 558 2024-09-16T03:39:36.056 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.IV7YfQRME0 2024-09-16T03:39:36.057 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:36.057 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:36.057 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:36.057 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 559 2024-09-16T03:39:36.057 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=559 2024-09-16T03:39:36.057 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:36.057 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:36.058 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.BaDw1QfvZy 2024-09-16T03:39:36.058 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 559 -o /tmp/tmp.BaDw1QfvZy 2024-09-16T03:39:36.488 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 559 2024-09-16T03:39:36.506 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.BaDw1QfvZy 2024-09-16T03:39:36.506 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 559' 2024-09-16T03:39:36.526 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.BaDw1QfvZy' 2024-09-16T03:39:36.527 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 559 2024-09-16T03:39:36.528 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.BaDw1QfvZy 2024-09-16T03:39:36.529 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:36.529 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:36.529 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:36.529 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 560 2024-09-16T03:39:36.529 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=560 2024-09-16T03:39:36.529 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:36.529 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:36.530 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.dWLzBtlzEO 2024-09-16T03:39:36.530 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 560 -o /tmp/tmp.dWLzBtlzEO 2024-09-16T03:39:36.973 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 560 2024-09-16T03:39:36.990 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.dWLzBtlzEO 2024-09-16T03:39:36.990 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 560' 2024-09-16T03:39:37.009 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.dWLzBtlzEO' 2024-09-16T03:39:37.011 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 560 2024-09-16T03:39:37.011 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.dWLzBtlzEO 2024-09-16T03:39:37.012 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:37.012 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:37.012 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:37.012 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 561 2024-09-16T03:39:37.012 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=561 2024-09-16T03:39:37.013 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:37.013 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:37.013 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.UUNTr937sz 2024-09-16T03:39:37.013 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 561 -o /tmp/tmp.UUNTr937sz 2024-09-16T03:39:37.425 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 561 2024-09-16T03:39:37.441 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.UUNTr937sz 2024-09-16T03:39:37.441 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 561' 2024-09-16T03:39:37.461 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.UUNTr937sz' 2024-09-16T03:39:37.462 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 561 2024-09-16T03:39:37.462 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.UUNTr937sz 2024-09-16T03:39:37.464 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:37.464 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:37.464 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:37.464 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 562 2024-09-16T03:39:37.464 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=562 2024-09-16T03:39:37.465 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:37.465 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:37.465 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.rVcJ5rv7BN 2024-09-16T03:39:37.465 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 562 -o /tmp/tmp.rVcJ5rv7BN 2024-09-16T03:39:37.851 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 562 2024-09-16T03:39:37.867 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.rVcJ5rv7BN 2024-09-16T03:39:37.867 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 562' 2024-09-16T03:39:37.887 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.rVcJ5rv7BN' 2024-09-16T03:39:37.889 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 562 2024-09-16T03:39:37.889 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.rVcJ5rv7BN 2024-09-16T03:39:37.890 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:37.890 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:37.890 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:37.890 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 563 2024-09-16T03:39:37.890 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=563 2024-09-16T03:39:37.890 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:37.891 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:37.891 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.ppCn84vojk 2024-09-16T03:39:37.891 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 563 -o /tmp/tmp.ppCn84vojk 2024-09-16T03:39:38.403 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 563 2024-09-16T03:39:38.421 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.ppCn84vojk 2024-09-16T03:39:38.421 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 563' 2024-09-16T03:39:38.436 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.ppCn84vojk' 2024-09-16T03:39:38.438 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 563 2024-09-16T03:39:38.438 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.ppCn84vojk 2024-09-16T03:39:38.439 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:38.439 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:38.439 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:38.440 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 564 2024-09-16T03:39:38.440 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=564 2024-09-16T03:39:38.440 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:38.440 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:38.440 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.14CYpcmTJq 2024-09-16T03:39:38.440 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 564 -o /tmp/tmp.14CYpcmTJq 2024-09-16T03:39:38.872 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 564 2024-09-16T03:39:38.888 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.14CYpcmTJq 2024-09-16T03:39:38.888 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 564' 2024-09-16T03:39:38.903 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.14CYpcmTJq' 2024-09-16T03:39:38.904 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 564 2024-09-16T03:39:38.904 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.14CYpcmTJq 2024-09-16T03:39:38.906 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:38.906 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:38.906 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:38.906 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 565 2024-09-16T03:39:38.906 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=565 2024-09-16T03:39:38.906 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:38.906 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:38.907 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.NcrFVQmdMN 2024-09-16T03:39:38.907 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 565 -o /tmp/tmp.NcrFVQmdMN 2024-09-16T03:39:39.297 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 565 2024-09-16T03:39:39.314 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.NcrFVQmdMN 2024-09-16T03:39:39.314 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 565' 2024-09-16T03:39:39.334 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.NcrFVQmdMN' 2024-09-16T03:39:39.336 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 565 2024-09-16T03:39:39.336 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.NcrFVQmdMN 2024-09-16T03:39:39.338 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:39.338 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:39.338 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:39.338 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 566 2024-09-16T03:39:39.338 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=566 2024-09-16T03:39:39.339 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:39.339 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:39.339 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.oj3OoOVLXu 2024-09-16T03:39:39.340 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 566 -o /tmp/tmp.oj3OoOVLXu 2024-09-16T03:39:39.850 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 566 2024-09-16T03:39:39.868 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.oj3OoOVLXu 2024-09-16T03:39:39.868 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 566' 2024-09-16T03:39:39.887 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.oj3OoOVLXu' 2024-09-16T03:39:39.889 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 566 2024-09-16T03:39:39.889 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.oj3OoOVLXu 2024-09-16T03:39:39.891 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:39.891 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:39.891 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:39.891 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 567 2024-09-16T03:39:39.891 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=567 2024-09-16T03:39:39.891 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:39.891 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:39.892 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.fUvt6C91Kw 2024-09-16T03:39:39.892 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 567 -o /tmp/tmp.fUvt6C91Kw 2024-09-16T03:39:40.309 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 567 2024-09-16T03:39:40.326 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.fUvt6C91Kw 2024-09-16T03:39:40.326 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 567' 2024-09-16T03:39:40.345 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.fUvt6C91Kw' 2024-09-16T03:39:40.347 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 567 2024-09-16T03:39:40.347 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.fUvt6C91Kw 2024-09-16T03:39:40.348 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:40.348 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:40.348 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:40.349 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 568 2024-09-16T03:39:40.349 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=568 2024-09-16T03:39:40.349 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:40.349 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:40.349 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.Ed8o5Gbyok 2024-09-16T03:39:40.349 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 568 -o /tmp/tmp.Ed8o5Gbyok 2024-09-16T03:39:40.811 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 568 2024-09-16T03:39:40.828 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.Ed8o5Gbyok 2024-09-16T03:39:40.828 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 568' 2024-09-16T03:39:40.847 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.Ed8o5Gbyok' 2024-09-16T03:39:40.849 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 568 2024-09-16T03:39:40.849 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.Ed8o5Gbyok 2024-09-16T03:39:40.850 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:40.850 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:40.850 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:40.851 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 569 2024-09-16T03:39:40.851 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=569 2024-09-16T03:39:40.851 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:40.851 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:40.851 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.DIoOUUeFAS 2024-09-16T03:39:40.851 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 569 -o /tmp/tmp.DIoOUUeFAS 2024-09-16T03:39:41.314 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 569 2024-09-16T03:39:41.329 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.DIoOUUeFAS 2024-09-16T03:39:41.329 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 569' 2024-09-16T03:39:41.350 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.DIoOUUeFAS' 2024-09-16T03:39:41.352 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 569 2024-09-16T03:39:41.352 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.DIoOUUeFAS 2024-09-16T03:39:41.353 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:41.353 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:41.353 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:41.353 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 570 2024-09-16T03:39:41.353 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=570 2024-09-16T03:39:41.354 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:41.354 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:41.354 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.KGM1xUHR5K 2024-09-16T03:39:41.354 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 570 -o /tmp/tmp.KGM1xUHR5K 2024-09-16T03:39:41.757 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 570 2024-09-16T03:39:41.773 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.KGM1xUHR5K 2024-09-16T03:39:41.773 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 570' 2024-09-16T03:39:41.793 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.KGM1xUHR5K' 2024-09-16T03:39:41.794 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 570 2024-09-16T03:39:41.795 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.KGM1xUHR5K 2024-09-16T03:39:41.795 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:41.796 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:41.796 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:41.796 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 571 2024-09-16T03:39:41.796 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=571 2024-09-16T03:39:41.796 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:41.796 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:41.796 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.pdwxFzbFHt 2024-09-16T03:39:41.797 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 571 -o /tmp/tmp.pdwxFzbFHt 2024-09-16T03:39:42.225 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 571 2024-09-16T03:39:42.242 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.pdwxFzbFHt 2024-09-16T03:39:42.242 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 571' 2024-09-16T03:39:42.262 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.pdwxFzbFHt' 2024-09-16T03:39:42.264 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 571 2024-09-16T03:39:42.264 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.pdwxFzbFHt 2024-09-16T03:39:42.265 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:42.266 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:42.266 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:42.266 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 572 2024-09-16T03:39:42.266 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=572 2024-09-16T03:39:42.266 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:42.266 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:42.266 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.0aS7NuZ4du 2024-09-16T03:39:42.267 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 572 -o /tmp/tmp.0aS7NuZ4du 2024-09-16T03:39:42.724 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 572 2024-09-16T03:39:42.739 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.0aS7NuZ4du 2024-09-16T03:39:42.740 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 572' 2024-09-16T03:39:42.759 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.0aS7NuZ4du' 2024-09-16T03:39:42.760 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 572 2024-09-16T03:39:42.761 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.0aS7NuZ4du 2024-09-16T03:39:42.762 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:42.762 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:42.762 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:42.762 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 573 2024-09-16T03:39:42.762 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=573 2024-09-16T03:39:42.762 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:42.763 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:42.763 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.ipmlY7aXYB 2024-09-16T03:39:42.763 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 573 -o /tmp/tmp.ipmlY7aXYB 2024-09-16T03:39:43.157 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 573 2024-09-16T03:39:43.173 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.ipmlY7aXYB 2024-09-16T03:39:43.173 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 573' 2024-09-16T03:39:43.192 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.ipmlY7aXYB' 2024-09-16T03:39:43.194 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 573 2024-09-16T03:39:43.194 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.ipmlY7aXYB 2024-09-16T03:39:43.195 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:43.195 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:43.195 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:43.196 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 574 2024-09-16T03:39:43.196 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=574 2024-09-16T03:39:43.196 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:43.196 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:43.196 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.OfYCUDNQeG 2024-09-16T03:39:43.196 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 574 -o /tmp/tmp.OfYCUDNQeG 2024-09-16T03:39:43.639 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 574 2024-09-16T03:39:43.655 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.OfYCUDNQeG 2024-09-16T03:39:43.655 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 574' 2024-09-16T03:39:43.675 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.OfYCUDNQeG' 2024-09-16T03:39:43.677 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 574 2024-09-16T03:39:43.677 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.OfYCUDNQeG 2024-09-16T03:39:43.678 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:43.678 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:43.678 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:43.678 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 575 2024-09-16T03:39:43.678 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=575 2024-09-16T03:39:43.678 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:43.678 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:43.679 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.RBKfYZaLjf 2024-09-16T03:39:43.679 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 575 -o /tmp/tmp.RBKfYZaLjf 2024-09-16T03:39:44.075 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 575 2024-09-16T03:39:44.091 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.RBKfYZaLjf 2024-09-16T03:39:44.091 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 575' 2024-09-16T03:39:44.111 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.RBKfYZaLjf' 2024-09-16T03:39:44.112 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 575 2024-09-16T03:39:44.113 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.RBKfYZaLjf 2024-09-16T03:39:44.114 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:44.114 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:44.114 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:44.114 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 576 2024-09-16T03:39:44.114 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=576 2024-09-16T03:39:44.114 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:44.114 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:44.115 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.cl1L2oO6Pq 2024-09-16T03:39:44.115 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 576 -o /tmp/tmp.cl1L2oO6Pq 2024-09-16T03:39:44.600 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 576 2024-09-16T03:39:44.618 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.cl1L2oO6Pq 2024-09-16T03:39:44.618 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 576' 2024-09-16T03:39:44.639 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.cl1L2oO6Pq' 2024-09-16T03:39:44.640 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 576 2024-09-16T03:39:44.641 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.cl1L2oO6Pq 2024-09-16T03:39:44.642 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:44.642 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:44.642 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:44.642 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 577 2024-09-16T03:39:44.642 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=577 2024-09-16T03:39:44.642 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:44.642 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:44.643 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.7EAc1Z11ub 2024-09-16T03:39:44.643 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 577 -o /tmp/tmp.7EAc1Z11ub 2024-09-16T03:39:45.088 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 577 2024-09-16T03:39:45.104 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.7EAc1Z11ub 2024-09-16T03:39:45.104 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 577' 2024-09-16T03:39:45.123 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.7EAc1Z11ub' 2024-09-16T03:39:45.125 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 577 2024-09-16T03:39:45.125 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.7EAc1Z11ub 2024-09-16T03:39:45.126 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:45.126 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:45.127 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:45.127 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 578 2024-09-16T03:39:45.127 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=578 2024-09-16T03:39:45.127 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:45.127 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:45.127 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.nAVWxlk7X5 2024-09-16T03:39:45.127 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 578 -o /tmp/tmp.nAVWxlk7X5 2024-09-16T03:39:45.646 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 578 2024-09-16T03:39:45.665 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.nAVWxlk7X5 2024-09-16T03:39:45.665 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 578' 2024-09-16T03:39:45.686 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.nAVWxlk7X5' 2024-09-16T03:39:45.688 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 578 2024-09-16T03:39:45.688 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.nAVWxlk7X5 2024-09-16T03:39:45.689 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:45.689 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:45.689 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:45.689 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 579 2024-09-16T03:39:45.690 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=579 2024-09-16T03:39:45.690 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:45.690 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:45.691 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.yES3P6k7WB 2024-09-16T03:39:45.691 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 579 -o /tmp/tmp.yES3P6k7WB 2024-09-16T03:39:46.157 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 579 2024-09-16T03:39:46.174 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.yES3P6k7WB 2024-09-16T03:39:46.174 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 579' 2024-09-16T03:39:46.194 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.yES3P6k7WB' 2024-09-16T03:39:46.196 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 579 2024-09-16T03:39:46.196 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.yES3P6k7WB 2024-09-16T03:39:46.198 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:46.198 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:46.198 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:46.198 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 580 2024-09-16T03:39:46.198 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=580 2024-09-16T03:39:46.198 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:46.198 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:46.198 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.zB1Z3BJ8gi 2024-09-16T03:39:46.199 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 580 -o /tmp/tmp.zB1Z3BJ8gi 2024-09-16T03:39:46.641 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 580 2024-09-16T03:39:46.657 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.zB1Z3BJ8gi 2024-09-16T03:39:46.657 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 580' 2024-09-16T03:39:46.679 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.zB1Z3BJ8gi' 2024-09-16T03:39:46.680 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 580 2024-09-16T03:39:46.681 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.zB1Z3BJ8gi 2024-09-16T03:39:46.682 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:46.682 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:46.682 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:46.682 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 581 2024-09-16T03:39:46.682 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=581 2024-09-16T03:39:46.682 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:46.682 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:46.683 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.0Hq1tflBCV 2024-09-16T03:39:46.683 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 581 -o /tmp/tmp.0Hq1tflBCV 2024-09-16T03:39:47.121 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 581 2024-09-16T03:39:47.137 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.0Hq1tflBCV 2024-09-16T03:39:47.137 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 581' 2024-09-16T03:39:47.156 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.0Hq1tflBCV' 2024-09-16T03:39:47.158 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 581 2024-09-16T03:39:47.158 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.0Hq1tflBCV 2024-09-16T03:39:47.159 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:47.159 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:47.159 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:47.159 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 582 2024-09-16T03:39:47.159 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=582 2024-09-16T03:39:47.159 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:47.160 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:47.160 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.FFlTmXK2Nm 2024-09-16T03:39:47.160 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 582 -o /tmp/tmp.FFlTmXK2Nm 2024-09-16T03:39:47.562 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 582 2024-09-16T03:39:47.579 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.FFlTmXK2Nm 2024-09-16T03:39:47.579 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 582' 2024-09-16T03:39:47.599 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.FFlTmXK2Nm' 2024-09-16T03:39:47.600 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 582 2024-09-16T03:39:47.601 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.FFlTmXK2Nm 2024-09-16T03:39:47.602 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:47.602 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:47.602 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:47.602 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 583 2024-09-16T03:39:47.602 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=583 2024-09-16T03:39:47.602 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:47.602 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:47.603 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.g0JpDkb77E 2024-09-16T03:39:47.603 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 583 -o /tmp/tmp.g0JpDkb77E 2024-09-16T03:39:48.046 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 583 2024-09-16T03:39:48.062 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.g0JpDkb77E 2024-09-16T03:39:48.062 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 583' 2024-09-16T03:39:48.082 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.g0JpDkb77E' 2024-09-16T03:39:48.083 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 583 2024-09-16T03:39:48.084 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.g0JpDkb77E 2024-09-16T03:39:48.085 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:48.085 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:48.085 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:48.085 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 584 2024-09-16T03:39:48.085 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=584 2024-09-16T03:39:48.085 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:48.085 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:48.086 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.NoycOtBDrL 2024-09-16T03:39:48.086 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 584 -o /tmp/tmp.NoycOtBDrL 2024-09-16T03:39:48.553 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 584 2024-09-16T03:39:48.572 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.NoycOtBDrL 2024-09-16T03:39:48.572 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 584' 2024-09-16T03:39:48.591 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.NoycOtBDrL' 2024-09-16T03:39:48.593 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 584 2024-09-16T03:39:48.593 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.NoycOtBDrL 2024-09-16T03:39:48.594 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:48.594 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:48.595 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:48.595 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 585 2024-09-16T03:39:48.595 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=585 2024-09-16T03:39:48.595 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:48.595 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:48.596 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.d5mcDDXhx5 2024-09-16T03:39:48.596 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 585 -o /tmp/tmp.d5mcDDXhx5 2024-09-16T03:39:49.024 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 585 2024-09-16T03:39:49.039 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.d5mcDDXhx5 2024-09-16T03:39:49.039 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 585' 2024-09-16T03:39:49.058 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.d5mcDDXhx5' 2024-09-16T03:39:49.060 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 585 2024-09-16T03:39:49.060 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.d5mcDDXhx5 2024-09-16T03:39:49.061 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:49.062 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:49.062 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:49.062 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 586 2024-09-16T03:39:49.062 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=586 2024-09-16T03:39:49.062 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:49.062 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:49.062 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.IwAVru2QN7 2024-09-16T03:39:49.062 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 586 -o /tmp/tmp.IwAVru2QN7 2024-09-16T03:39:49.527 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 586 2024-09-16T03:39:49.546 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.IwAVru2QN7 2024-09-16T03:39:49.546 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 586' 2024-09-16T03:39:49.567 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.IwAVru2QN7' 2024-09-16T03:39:49.568 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 586 2024-09-16T03:39:49.568 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.IwAVru2QN7 2024-09-16T03:39:49.570 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:49.570 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:49.570 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:49.570 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 587 2024-09-16T03:39:49.570 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=587 2024-09-16T03:39:49.570 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:49.570 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:49.571 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.1m3xl3dH38 2024-09-16T03:39:49.571 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 587 -o /tmp/tmp.1m3xl3dH38 2024-09-16T03:39:49.971 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 587 2024-09-16T03:39:49.987 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.1m3xl3dH38 2024-09-16T03:39:49.987 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 587' 2024-09-16T03:39:50.007 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.1m3xl3dH38' 2024-09-16T03:39:50.008 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 587 2024-09-16T03:39:50.009 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.1m3xl3dH38 2024-09-16T03:39:50.010 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:50.010 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:50.010 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:50.010 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 588 2024-09-16T03:39:50.010 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=588 2024-09-16T03:39:50.010 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:50.010 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:50.011 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.rJYjOwLzF4 2024-09-16T03:39:50.011 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 588 -o /tmp/tmp.rJYjOwLzF4 2024-09-16T03:39:50.472 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 588 2024-09-16T03:39:50.490 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.rJYjOwLzF4 2024-09-16T03:39:50.490 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 588' 2024-09-16T03:39:50.510 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.rJYjOwLzF4' 2024-09-16T03:39:50.512 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 588 2024-09-16T03:39:50.512 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.rJYjOwLzF4 2024-09-16T03:39:50.514 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:50.514 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:50.514 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:50.514 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 589 2024-09-16T03:39:50.514 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=589 2024-09-16T03:39:50.515 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:50.515 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:50.515 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.0MiolGddys 2024-09-16T03:39:50.515 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 589 -o /tmp/tmp.0MiolGddys 2024-09-16T03:39:50.965 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 589 2024-09-16T03:39:50.982 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.0MiolGddys 2024-09-16T03:39:50.982 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 589' 2024-09-16T03:39:51.001 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.0MiolGddys' 2024-09-16T03:39:51.003 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 589 2024-09-16T03:39:51.003 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.0MiolGddys 2024-09-16T03:39:51.004 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:51.004 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:51.004 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:51.005 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 590 2024-09-16T03:39:51.005 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=590 2024-09-16T03:39:51.005 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:51.005 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:51.005 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.Z4qhEjpyCC 2024-09-16T03:39:51.005 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 590 -o /tmp/tmp.Z4qhEjpyCC 2024-09-16T03:39:51.458 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 590 2024-09-16T03:39:51.477 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.Z4qhEjpyCC 2024-09-16T03:39:51.477 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 590' 2024-09-16T03:39:51.490 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.Z4qhEjpyCC' 2024-09-16T03:39:51.492 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 590 2024-09-16T03:39:51.492 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.Z4qhEjpyCC 2024-09-16T03:39:51.494 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:51.494 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:51.495 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:51.495 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 591 2024-09-16T03:39:51.495 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=591 2024-09-16T03:39:51.495 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:51.495 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:51.495 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.udWQS1mMO9 2024-09-16T03:39:51.496 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 591 -o /tmp/tmp.udWQS1mMO9 2024-09-16T03:39:51.960 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 591 2024-09-16T03:39:51.976 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.udWQS1mMO9 2024-09-16T03:39:51.976 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 591' 2024-09-16T03:39:51.996 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.udWQS1mMO9' 2024-09-16T03:39:51.997 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 591 2024-09-16T03:39:51.998 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.udWQS1mMO9 2024-09-16T03:39:51.999 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:51.999 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:51.999 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:51.999 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 592 2024-09-16T03:39:51.999 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=592 2024-09-16T03:39:52.000 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:52.000 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:52.000 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.2G37Jojerh 2024-09-16T03:39:52.000 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 592 -o /tmp/tmp.2G37Jojerh 2024-09-16T03:39:52.398 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 592 2024-09-16T03:39:52.414 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 592' 2024-09-16T03:39:52.414 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.2G37Jojerh 2024-09-16T03:39:52.434 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.2G37Jojerh' 2024-09-16T03:39:52.436 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 592 2024-09-16T03:39:52.436 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.2G37Jojerh 2024-09-16T03:39:52.437 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:52.437 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:52.437 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:52.437 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 593 2024-09-16T03:39:52.437 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=593 2024-09-16T03:39:52.438 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:52.438 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:52.438 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.cVnIcq6Wki 2024-09-16T03:39:52.438 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 593 -o /tmp/tmp.cVnIcq6Wki 2024-09-16T03:39:52.915 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 593 2024-09-16T03:39:52.932 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.cVnIcq6Wki 2024-09-16T03:39:52.933 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 593' 2024-09-16T03:39:52.953 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.cVnIcq6Wki' 2024-09-16T03:39:52.954 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 593 2024-09-16T03:39:52.955 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.cVnIcq6Wki 2024-09-16T03:39:52.956 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:52.956 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:52.956 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:52.956 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 594 2024-09-16T03:39:52.956 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=594 2024-09-16T03:39:52.956 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:52.956 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:52.957 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.LQVGzDbvDm 2024-09-16T03:39:52.957 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 594 -o /tmp/tmp.LQVGzDbvDm 2024-09-16T03:39:53.389 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 594 2024-09-16T03:39:53.406 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 594' 2024-09-16T03:39:53.406 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.LQVGzDbvDm 2024-09-16T03:39:53.426 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.LQVGzDbvDm' 2024-09-16T03:39:53.428 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 594 2024-09-16T03:39:53.428 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.LQVGzDbvDm 2024-09-16T03:39:53.429 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:53.429 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:53.430 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:53.430 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 595 2024-09-16T03:39:53.430 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=595 2024-09-16T03:39:53.430 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:53.430 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:53.430 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.68QGyPhBFm 2024-09-16T03:39:53.430 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 595 -o /tmp/tmp.68QGyPhBFm 2024-09-16T03:39:53.843 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 595 2024-09-16T03:39:53.858 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.68QGyPhBFm 2024-09-16T03:39:53.858 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 595' 2024-09-16T03:39:53.877 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.68QGyPhBFm' 2024-09-16T03:39:53.879 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 595 2024-09-16T03:39:53.880 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.68QGyPhBFm 2024-09-16T03:39:53.880 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:53.881 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:53.881 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:53.881 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 596 2024-09-16T03:39:53.881 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=596 2024-09-16T03:39:53.881 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:53.881 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:53.881 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.NWcgwssW31 2024-09-16T03:39:53.881 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 596 -o /tmp/tmp.NWcgwssW31 2024-09-16T03:39:54.317 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 596 2024-09-16T03:39:54.333 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.NWcgwssW31 2024-09-16T03:39:54.333 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 596' 2024-09-16T03:39:54.353 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.NWcgwssW31' 2024-09-16T03:39:54.355 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 596 2024-09-16T03:39:54.355 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.NWcgwssW31 2024-09-16T03:39:54.356 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:54.356 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:54.357 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:54.357 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 597 2024-09-16T03:39:54.357 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=597 2024-09-16T03:39:54.357 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:54.357 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:54.357 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.FQMzxFH3vp 2024-09-16T03:39:54.357 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 597 -o /tmp/tmp.FQMzxFH3vp 2024-09-16T03:39:54.827 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 597 2024-09-16T03:39:54.844 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.FQMzxFH3vp 2024-09-16T03:39:54.844 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 597' 2024-09-16T03:39:54.863 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.FQMzxFH3vp' 2024-09-16T03:39:54.865 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 597 2024-09-16T03:39:54.865 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.FQMzxFH3vp 2024-09-16T03:39:54.866 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:54.866 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:54.866 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:54.866 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 598 2024-09-16T03:39:54.867 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=598 2024-09-16T03:39:54.867 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:54.867 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:54.867 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.LlhqFKpmBB 2024-09-16T03:39:54.867 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 598 -o /tmp/tmp.LlhqFKpmBB 2024-09-16T03:39:55.279 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 598 2024-09-16T03:39:55.296 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.LlhqFKpmBB 2024-09-16T03:39:55.296 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 598' 2024-09-16T03:39:55.315 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.LlhqFKpmBB' 2024-09-16T03:39:55.317 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 598 2024-09-16T03:39:55.317 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.LlhqFKpmBB 2024-09-16T03:39:55.318 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:55.318 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:55.318 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:55.318 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 599 2024-09-16T03:39:55.318 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=599 2024-09-16T03:39:55.318 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:55.319 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:55.319 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.8cWk1jo1Qs 2024-09-16T03:39:55.319 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 599 -o /tmp/tmp.8cWk1jo1Qs 2024-09-16T03:39:55.781 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 599 2024-09-16T03:39:55.799 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 599' 2024-09-16T03:39:55.799 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.8cWk1jo1Qs 2024-09-16T03:39:55.819 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.8cWk1jo1Qs' 2024-09-16T03:39:55.821 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 599 2024-09-16T03:39:55.821 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.8cWk1jo1Qs 2024-09-16T03:39:55.822 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:55.822 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:55.822 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:55.822 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 600 2024-09-16T03:39:55.823 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=600 2024-09-16T03:39:55.823 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:55.823 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:55.823 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.uGGZipgm7K 2024-09-16T03:39:55.823 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 600 -o /tmp/tmp.uGGZipgm7K 2024-09-16T03:39:56.258 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 600 2024-09-16T03:39:56.275 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.uGGZipgm7K 2024-09-16T03:39:56.275 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 600' 2024-09-16T03:39:56.294 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.uGGZipgm7K' 2024-09-16T03:39:56.296 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 600 2024-09-16T03:39:56.296 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.uGGZipgm7K 2024-09-16T03:39:56.297 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:56.297 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:56.297 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:56.297 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 601 2024-09-16T03:39:56.298 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=601 2024-09-16T03:39:56.298 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:56.298 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:56.298 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.RBLf9GwWcs 2024-09-16T03:39:56.298 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 601 -o /tmp/tmp.RBLf9GwWcs 2024-09-16T03:39:56.781 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 601 2024-09-16T03:39:56.801 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.RBLf9GwWcs 2024-09-16T03:39:56.801 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 601' 2024-09-16T03:39:56.822 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.RBLf9GwWcs' 2024-09-16T03:39:56.824 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 601 2024-09-16T03:39:56.824 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.RBLf9GwWcs 2024-09-16T03:39:56.825 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:56.825 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:56.825 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:56.825 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 602 2024-09-16T03:39:56.825 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=602 2024-09-16T03:39:56.826 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:56.826 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:56.827 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.eR28dAlmBt 2024-09-16T03:39:56.827 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 602 -o /tmp/tmp.eR28dAlmBt 2024-09-16T03:39:57.305 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 602 2024-09-16T03:39:57.324 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.eR28dAlmBt 2024-09-16T03:39:57.324 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 602' 2024-09-16T03:39:57.340 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.eR28dAlmBt' 2024-09-16T03:39:57.341 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 602 2024-09-16T03:39:57.342 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.eR28dAlmBt 2024-09-16T03:39:57.343 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:57.343 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:57.343 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:57.344 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 603 2024-09-16T03:39:57.344 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=603 2024-09-16T03:39:57.344 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:57.344 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:57.344 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.bxxtC71hzB 2024-09-16T03:39:57.344 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 603 -o /tmp/tmp.bxxtC71hzB 2024-09-16T03:39:57.789 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 603 2024-09-16T03:39:57.806 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.bxxtC71hzB 2024-09-16T03:39:57.806 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 603' 2024-09-16T03:39:57.826 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.bxxtC71hzB' 2024-09-16T03:39:57.827 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 603 2024-09-16T03:39:57.828 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.bxxtC71hzB 2024-09-16T03:39:57.829 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:57.829 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:57.829 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:57.829 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 604 2024-09-16T03:39:57.829 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=604 2024-09-16T03:39:57.829 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:57.829 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:57.830 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.tsdtFP1J2h 2024-09-16T03:39:57.830 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 604 -o /tmp/tmp.tsdtFP1J2h 2024-09-16T03:39:58.282 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 604 2024-09-16T03:39:58.299 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.tsdtFP1J2h 2024-09-16T03:39:58.299 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 604' 2024-09-16T03:39:58.319 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.tsdtFP1J2h' 2024-09-16T03:39:58.320 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 604 2024-09-16T03:39:58.320 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.tsdtFP1J2h 2024-09-16T03:39:58.322 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:58.322 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:58.322 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:58.322 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 605 2024-09-16T03:39:58.322 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=605 2024-09-16T03:39:58.322 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:58.322 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:58.323 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.nKvtTtT8bT 2024-09-16T03:39:58.323 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 605 -o /tmp/tmp.nKvtTtT8bT 2024-09-16T03:39:58.739 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 605 2024-09-16T03:39:58.756 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.nKvtTtT8bT 2024-09-16T03:39:58.756 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 605' 2024-09-16T03:39:58.776 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.nKvtTtT8bT' 2024-09-16T03:39:58.777 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 605 2024-09-16T03:39:58.778 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.nKvtTtT8bT 2024-09-16T03:39:58.779 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:58.779 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:58.779 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:58.779 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 606 2024-09-16T03:39:58.779 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=606 2024-09-16T03:39:58.779 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:58.780 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:58.780 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.9Dh51QOGWU 2024-09-16T03:39:58.780 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 606 -o /tmp/tmp.9Dh51QOGWU 2024-09-16T03:39:59.261 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 606 2024-09-16T03:39:59.279 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.9Dh51QOGWU 2024-09-16T03:39:59.279 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 606' 2024-09-16T03:39:59.298 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.9Dh51QOGWU' 2024-09-16T03:39:59.299 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 606 2024-09-16T03:39:59.299 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.9Dh51QOGWU 2024-09-16T03:39:59.301 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:59.301 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:59.301 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:59.301 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 607 2024-09-16T03:39:59.301 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=607 2024-09-16T03:39:59.301 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:59.301 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:59.302 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.ZxrtfHblms 2024-09-16T03:39:59.302 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 607 -o /tmp/tmp.ZxrtfHblms 2024-09-16T03:39:59.697 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 607 2024-09-16T03:39:59.713 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.ZxrtfHblms 2024-09-16T03:39:59.713 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 607' 2024-09-16T03:39:59.729 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.ZxrtfHblms' 2024-09-16T03:39:59.731 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 607 2024-09-16T03:39:59.731 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.ZxrtfHblms 2024-09-16T03:39:59.732 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:39:59.732 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:39:59.732 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:39:59.732 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 608 2024-09-16T03:39:59.732 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=608 2024-09-16T03:39:59.732 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:39:59.732 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:39:59.733 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.qdsGyaYX54 2024-09-16T03:39:59.733 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 608 -o /tmp/tmp.qdsGyaYX54 2024-09-16T03:40:00.197 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 608 2024-09-16T03:40:00.214 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.qdsGyaYX54 2024-09-16T03:40:00.214 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 608' 2024-09-16T03:40:00.230 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.qdsGyaYX54' 2024-09-16T03:40:00.231 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 608 2024-09-16T03:40:00.231 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.qdsGyaYX54 2024-09-16T03:40:00.233 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:00.233 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:00.233 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:00.233 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 609 2024-09-16T03:40:00.234 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=609 2024-09-16T03:40:00.234 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:00.234 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:00.234 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.DbIAXAE4cp 2024-09-16T03:40:00.234 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 609 -o /tmp/tmp.DbIAXAE4cp 2024-09-16T03:40:00.704 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 609 2024-09-16T03:40:00.721 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.DbIAXAE4cp 2024-09-16T03:40:00.721 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 609' 2024-09-16T03:40:00.742 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.DbIAXAE4cp' 2024-09-16T03:40:00.743 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 609 2024-09-16T03:40:00.744 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.DbIAXAE4cp 2024-09-16T03:40:00.745 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:00.745 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:00.745 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:00.745 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 610 2024-09-16T03:40:00.745 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=610 2024-09-16T03:40:00.745 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:00.746 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:00.747 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.zVboedEwHA 2024-09-16T03:40:00.747 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 610 -o /tmp/tmp.zVboedEwHA 2024-09-16T03:40:01.201 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 610 2024-09-16T03:40:01.219 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 610' 2024-09-16T03:40:01.219 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.zVboedEwHA 2024-09-16T03:40:01.239 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.zVboedEwHA' 2024-09-16T03:40:01.240 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 610 2024-09-16T03:40:01.240 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.zVboedEwHA 2024-09-16T03:40:01.242 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:01.242 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:01.242 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:01.242 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 611 2024-09-16T03:40:01.242 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=611 2024-09-16T03:40:01.242 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:01.242 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:01.242 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.YlqLWDRcP2 2024-09-16T03:40:01.243 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 611 -o /tmp/tmp.YlqLWDRcP2 2024-09-16T03:40:01.685 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 611 2024-09-16T03:40:01.702 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.YlqLWDRcP2 2024-09-16T03:40:01.702 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 611' 2024-09-16T03:40:01.722 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.YlqLWDRcP2' 2024-09-16T03:40:01.723 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 611 2024-09-16T03:40:01.723 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.YlqLWDRcP2 2024-09-16T03:40:01.725 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:01.725 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:01.725 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:01.725 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 612 2024-09-16T03:40:01.725 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=612 2024-09-16T03:40:01.725 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:01.725 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:01.726 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.NL1OYJTpFy 2024-09-16T03:40:01.727 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 612 -o /tmp/tmp.NL1OYJTpFy 2024-09-16T03:40:02.162 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 612 2024-09-16T03:40:02.179 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.NL1OYJTpFy 2024-09-16T03:40:02.179 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 612' 2024-09-16T03:40:02.199 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.NL1OYJTpFy' 2024-09-16T03:40:02.200 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 612 2024-09-16T03:40:02.200 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.NL1OYJTpFy 2024-09-16T03:40:02.202 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:02.202 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:02.202 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:02.202 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 613 2024-09-16T03:40:02.203 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=613 2024-09-16T03:40:02.203 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:02.203 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:02.203 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.SVeJwNDJyk 2024-09-16T03:40:02.203 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 613 -o /tmp/tmp.SVeJwNDJyk 2024-09-16T03:40:02.630 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 613 2024-09-16T03:40:02.646 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.SVeJwNDJyk 2024-09-16T03:40:02.647 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 613' 2024-09-16T03:40:02.666 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.SVeJwNDJyk' 2024-09-16T03:40:02.667 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 613 2024-09-16T03:40:02.667 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.SVeJwNDJyk 2024-09-16T03:40:02.669 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:02.669 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:02.669 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:02.669 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 614 2024-09-16T03:40:02.669 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=614 2024-09-16T03:40:02.669 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:02.669 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:02.670 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.56CSu7jLKT 2024-09-16T03:40:02.670 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 614 -o /tmp/tmp.56CSu7jLKT 2024-09-16T03:40:03.132 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 614 2024-09-16T03:40:03.150 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 614' 2024-09-16T03:40:03.150 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.56CSu7jLKT 2024-09-16T03:40:03.170 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.56CSu7jLKT' 2024-09-16T03:40:03.172 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 614 2024-09-16T03:40:03.172 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.56CSu7jLKT 2024-09-16T03:40:03.173 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:03.173 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:03.173 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:03.173 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 615 2024-09-16T03:40:03.173 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=615 2024-09-16T03:40:03.173 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:03.174 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:03.174 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.V7bF8baG6r 2024-09-16T03:40:03.174 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 615 -o /tmp/tmp.V7bF8baG6r 2024-09-16T03:40:03.561 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 615 2024-09-16T03:40:03.577 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.V7bF8baG6r 2024-09-16T03:40:03.577 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 615' 2024-09-16T03:40:03.596 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.V7bF8baG6r' 2024-09-16T03:40:03.597 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 615 2024-09-16T03:40:03.598 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.V7bF8baG6r 2024-09-16T03:40:03.599 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:03.599 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:03.599 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:03.599 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 616 2024-09-16T03:40:03.599 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=616 2024-09-16T03:40:03.600 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:03.600 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:03.600 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.krYMAz5VlF 2024-09-16T03:40:03.600 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 616 -o /tmp/tmp.krYMAz5VlF 2024-09-16T03:40:03.990 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 616 2024-09-16T03:40:04.006 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 616' 2024-09-16T03:40:04.006 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.krYMAz5VlF 2024-09-16T03:40:04.026 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.krYMAz5VlF' 2024-09-16T03:40:04.027 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 616 2024-09-16T03:40:04.027 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.krYMAz5VlF 2024-09-16T03:40:04.029 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:04.029 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:04.029 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:04.029 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 617 2024-09-16T03:40:04.029 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=617 2024-09-16T03:40:04.029 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:04.029 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:04.029 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.44NgndLYwC 2024-09-16T03:40:04.029 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 617 -o /tmp/tmp.44NgndLYwC 2024-09-16T03:40:04.410 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 617 2024-09-16T03:40:04.427 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.44NgndLYwC 2024-09-16T03:40:04.427 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 617' 2024-09-16T03:40:04.446 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.44NgndLYwC' 2024-09-16T03:40:04.448 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 617 2024-09-16T03:40:04.448 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.44NgndLYwC 2024-09-16T03:40:04.449 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:04.449 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:04.449 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:04.450 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 618 2024-09-16T03:40:04.450 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=618 2024-09-16T03:40:04.450 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:04.450 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:04.450 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.nbDZvpztbb 2024-09-16T03:40:04.450 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 618 -o /tmp/tmp.nbDZvpztbb 2024-09-16T03:40:04.946 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 618 2024-09-16T03:40:04.963 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 618' 2024-09-16T03:40:04.963 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.nbDZvpztbb 2024-09-16T03:40:04.983 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.nbDZvpztbb' 2024-09-16T03:40:04.984 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 618 2024-09-16T03:40:04.984 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.nbDZvpztbb 2024-09-16T03:40:04.986 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:04.986 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:04.986 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:04.986 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 619 2024-09-16T03:40:04.986 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=619 2024-09-16T03:40:04.986 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:04.986 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:04.986 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.uabU5JzkDG 2024-09-16T03:40:04.987 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 619 -o /tmp/tmp.uabU5JzkDG 2024-09-16T03:40:05.439 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 619 2024-09-16T03:40:05.455 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.uabU5JzkDG 2024-09-16T03:40:05.455 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 619' 2024-09-16T03:40:05.474 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.uabU5JzkDG' 2024-09-16T03:40:05.476 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 619 2024-09-16T03:40:05.476 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.uabU5JzkDG 2024-09-16T03:40:05.477 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:05.477 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:05.478 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:05.478 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 620 2024-09-16T03:40:05.478 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=620 2024-09-16T03:40:05.478 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:05.478 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:05.478 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.lFTeFLopeT 2024-09-16T03:40:05.478 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 620 -o /tmp/tmp.lFTeFLopeT 2024-09-16T03:40:05.915 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 620 2024-09-16T03:40:05.932 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.lFTeFLopeT 2024-09-16T03:40:05.932 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 620' 2024-09-16T03:40:05.951 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.lFTeFLopeT' 2024-09-16T03:40:05.953 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 620 2024-09-16T03:40:05.953 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.lFTeFLopeT 2024-09-16T03:40:05.954 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:05.954 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:05.955 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:05.955 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 621 2024-09-16T03:40:05.955 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=621 2024-09-16T03:40:05.955 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:05.955 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:05.955 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.jlXGfoe857 2024-09-16T03:40:05.955 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 621 -o /tmp/tmp.jlXGfoe857 2024-09-16T03:40:06.371 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 621 2024-09-16T03:40:06.387 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.jlXGfoe857 2024-09-16T03:40:06.387 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 621' 2024-09-16T03:40:06.407 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.jlXGfoe857' 2024-09-16T03:40:06.408 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 621 2024-09-16T03:40:06.409 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.jlXGfoe857 2024-09-16T03:40:06.410 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:06.410 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:06.411 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:06.411 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 622 2024-09-16T03:40:06.411 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=622 2024-09-16T03:40:06.411 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:06.411 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:06.411 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.B5BrOQeLZA 2024-09-16T03:40:06.411 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 622 -o /tmp/tmp.B5BrOQeLZA 2024-09-16T03:40:06.823 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 622 2024-09-16T03:40:06.839 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.B5BrOQeLZA 2024-09-16T03:40:06.839 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 622' 2024-09-16T03:40:06.858 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.B5BrOQeLZA' 2024-09-16T03:40:06.860 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 622 2024-09-16T03:40:06.860 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.B5BrOQeLZA 2024-09-16T03:40:06.861 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:06.861 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:06.862 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:06.862 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 623 2024-09-16T03:40:06.862 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=623 2024-09-16T03:40:06.862 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:06.862 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:06.862 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.7QkUQucmwj 2024-09-16T03:40:06.862 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 623 -o /tmp/tmp.7QkUQucmwj 2024-09-16T03:40:07.270 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 623 2024-09-16T03:40:07.286 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.7QkUQucmwj 2024-09-16T03:40:07.287 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 623' 2024-09-16T03:40:07.306 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.7QkUQucmwj' 2024-09-16T03:40:07.308 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 623 2024-09-16T03:40:07.308 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.7QkUQucmwj 2024-09-16T03:40:07.310 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:07.310 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:07.310 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:07.310 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 624 2024-09-16T03:40:07.310 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=624 2024-09-16T03:40:07.310 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:07.310 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:07.311 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.O1YqGQtNyV 2024-09-16T03:40:07.311 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 624 -o /tmp/tmp.O1YqGQtNyV 2024-09-16T03:40:07.779 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 624 2024-09-16T03:40:07.797 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.O1YqGQtNyV 2024-09-16T03:40:07.797 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 624' 2024-09-16T03:40:07.818 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.O1YqGQtNyV' 2024-09-16T03:40:07.819 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 624 2024-09-16T03:40:07.819 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.O1YqGQtNyV 2024-09-16T03:40:07.821 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:07.821 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:07.821 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:07.821 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 625 2024-09-16T03:40:07.821 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=625 2024-09-16T03:40:07.821 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:07.821 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:07.822 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.AnN0b4IydJ 2024-09-16T03:40:07.822 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 625 -o /tmp/tmp.AnN0b4IydJ 2024-09-16T03:40:08.264 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 625 2024-09-16T03:40:08.280 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.AnN0b4IydJ 2024-09-16T03:40:08.281 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 625' 2024-09-16T03:40:08.302 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.AnN0b4IydJ' 2024-09-16T03:40:08.303 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 625 2024-09-16T03:40:08.303 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.AnN0b4IydJ 2024-09-16T03:40:08.305 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:08.305 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:08.305 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:08.305 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 626 2024-09-16T03:40:08.305 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=626 2024-09-16T03:40:08.305 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:08.305 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:08.306 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.xaLciXxHcp 2024-09-16T03:40:08.306 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 626 -o /tmp/tmp.xaLciXxHcp 2024-09-16T03:40:08.737 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 626 2024-09-16T03:40:08.753 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.xaLciXxHcp 2024-09-16T03:40:08.753 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 626' 2024-09-16T03:40:08.769 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.xaLciXxHcp' 2024-09-16T03:40:08.770 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 626 2024-09-16T03:40:08.771 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.xaLciXxHcp 2024-09-16T03:40:08.772 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:08.772 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:08.772 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:08.772 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 627 2024-09-16T03:40:08.772 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=627 2024-09-16T03:40:08.772 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:08.772 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:08.773 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.Po94HkXIih 2024-09-16T03:40:08.773 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 627 -o /tmp/tmp.Po94HkXIih 2024-09-16T03:40:09.184 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 627 2024-09-16T03:40:09.201 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.Po94HkXIih 2024-09-16T03:40:09.201 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 627' 2024-09-16T03:40:09.222 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.Po94HkXIih' 2024-09-16T03:40:09.223 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 627 2024-09-16T03:40:09.223 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.Po94HkXIih 2024-09-16T03:40:09.225 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:09.225 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:09.225 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:09.225 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 628 2024-09-16T03:40:09.225 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=628 2024-09-16T03:40:09.225 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:09.225 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:09.226 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.enfmGT1GMw 2024-09-16T03:40:09.226 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 628 -o /tmp/tmp.enfmGT1GMw 2024-09-16T03:40:09.613 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 628 2024-09-16T03:40:09.629 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.enfmGT1GMw 2024-09-16T03:40:09.629 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 628' 2024-09-16T03:40:09.648 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.enfmGT1GMw' 2024-09-16T03:40:09.650 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 628 2024-09-16T03:40:09.650 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.enfmGT1GMw 2024-09-16T03:40:09.651 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:09.651 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:09.651 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:09.651 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 629 2024-09-16T03:40:09.652 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=629 2024-09-16T03:40:09.652 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:09.652 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:09.652 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.1C1TSSRPBD 2024-09-16T03:40:09.652 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 629 -o /tmp/tmp.1C1TSSRPBD 2024-09-16T03:40:10.095 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 629 2024-09-16T03:40:10.113 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.1C1TSSRPBD 2024-09-16T03:40:10.113 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 629' 2024-09-16T03:40:10.135 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.1C1TSSRPBD' 2024-09-16T03:40:10.136 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 629 2024-09-16T03:40:10.136 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.1C1TSSRPBD 2024-09-16T03:40:10.138 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:10.138 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:10.138 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:10.138 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 630 2024-09-16T03:40:10.138 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=630 2024-09-16T03:40:10.138 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:10.139 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:10.139 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.RyvuB26Kqx 2024-09-16T03:40:10.139 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 630 -o /tmp/tmp.RyvuB26Kqx 2024-09-16T03:40:10.613 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 630 2024-09-16T03:40:10.631 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.RyvuB26Kqx 2024-09-16T03:40:10.632 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 630' 2024-09-16T03:40:10.652 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.RyvuB26Kqx' 2024-09-16T03:40:10.653 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 630 2024-09-16T03:40:10.654 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.RyvuB26Kqx 2024-09-16T03:40:10.655 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:10.655 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:10.655 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:10.655 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 631 2024-09-16T03:40:10.655 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=631 2024-09-16T03:40:10.655 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:10.656 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:10.656 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.nxOfWy5ZMR 2024-09-16T03:40:10.656 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 631 -o /tmp/tmp.nxOfWy5ZMR 2024-09-16T03:40:11.173 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 631 2024-09-16T03:40:11.192 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.nxOfWy5ZMR 2024-09-16T03:40:11.192 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 631' 2024-09-16T03:40:11.211 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.nxOfWy5ZMR' 2024-09-16T03:40:11.213 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 631 2024-09-16T03:40:11.213 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.nxOfWy5ZMR 2024-09-16T03:40:11.214 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:11.215 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:11.215 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:11.215 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 632 2024-09-16T03:40:11.215 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=632 2024-09-16T03:40:11.215 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:11.215 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:11.215 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.n9xtiR0yZ0 2024-09-16T03:40:11.216 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 632 -o /tmp/tmp.n9xtiR0yZ0 2024-09-16T03:40:11.640 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 632 2024-09-16T03:40:11.656 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.n9xtiR0yZ0 2024-09-16T03:40:11.656 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 632' 2024-09-16T03:40:11.675 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.n9xtiR0yZ0' 2024-09-16T03:40:11.677 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 632 2024-09-16T03:40:11.677 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.n9xtiR0yZ0 2024-09-16T03:40:11.701 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:11.701 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:11.702 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:11.702 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 633 2024-09-16T03:40:11.702 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=633 2024-09-16T03:40:11.702 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:11.702 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:11.702 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.UzoHQtKBWS 2024-09-16T03:40:11.702 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 633 -o /tmp/tmp.UzoHQtKBWS 2024-09-16T03:40:12.095 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 633 2024-09-16T03:40:12.111 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.UzoHQtKBWS 2024-09-16T03:40:12.111 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 633' 2024-09-16T03:40:12.130 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.UzoHQtKBWS' 2024-09-16T03:40:12.132 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 633 2024-09-16T03:40:12.132 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.UzoHQtKBWS 2024-09-16T03:40:12.133 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:12.133 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:12.133 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:12.133 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 634 2024-09-16T03:40:12.134 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=634 2024-09-16T03:40:12.134 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:12.134 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:12.134 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.l9XQxlwiMM 2024-09-16T03:40:12.134 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 634 -o /tmp/tmp.l9XQxlwiMM 2024-09-16T03:40:12.577 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 634 2024-09-16T03:40:12.594 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.l9XQxlwiMM 2024-09-16T03:40:12.594 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 634' 2024-09-16T03:40:12.613 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.l9XQxlwiMM' 2024-09-16T03:40:12.615 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 634 2024-09-16T03:40:12.615 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.l9XQxlwiMM 2024-09-16T03:40:12.616 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:12.617 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:12.617 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:12.617 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 635 2024-09-16T03:40:12.617 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=635 2024-09-16T03:40:12.617 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:12.617 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:12.617 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.bG9sGCbJPq 2024-09-16T03:40:12.618 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 635 -o /tmp/tmp.bG9sGCbJPq 2024-09-16T03:40:13.074 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 635 2024-09-16T03:40:13.091 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 635' 2024-09-16T03:40:13.091 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.bG9sGCbJPq 2024-09-16T03:40:13.111 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.bG9sGCbJPq' 2024-09-16T03:40:13.112 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 635 2024-09-16T03:40:13.113 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.bG9sGCbJPq 2024-09-16T03:40:13.114 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:13.115 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:13.115 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:13.115 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 636 2024-09-16T03:40:13.115 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=636 2024-09-16T03:40:13.115 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:13.115 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:13.116 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.J7I8xOnmyu 2024-09-16T03:40:13.116 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 636 -o /tmp/tmp.J7I8xOnmyu 2024-09-16T03:40:13.507 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 636 2024-09-16T03:40:13.522 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.J7I8xOnmyu 2024-09-16T03:40:13.523 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 636' 2024-09-16T03:40:13.542 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.J7I8xOnmyu' 2024-09-16T03:40:13.544 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 636 2024-09-16T03:40:13.544 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.J7I8xOnmyu 2024-09-16T03:40:13.545 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:13.545 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:13.546 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:13.546 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 637 2024-09-16T03:40:13.546 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=637 2024-09-16T03:40:13.546 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:13.546 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:13.546 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.4eqN99CmmK 2024-09-16T03:40:13.546 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 637 -o /tmp/tmp.4eqN99CmmK 2024-09-16T03:40:13.981 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 637 2024-09-16T03:40:13.998 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.4eqN99CmmK 2024-09-16T03:40:13.998 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 637' 2024-09-16T03:40:14.017 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.4eqN99CmmK' 2024-09-16T03:40:14.019 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 637 2024-09-16T03:40:14.019 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.4eqN99CmmK 2024-09-16T03:40:14.021 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:14.021 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:14.021 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:14.021 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 638 2024-09-16T03:40:14.021 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=638 2024-09-16T03:40:14.021 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:14.021 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:14.022 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.Kii9rzpEmo 2024-09-16T03:40:14.022 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 638 -o /tmp/tmp.Kii9rzpEmo 2024-09-16T03:40:14.457 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 638 2024-09-16T03:40:14.474 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.Kii9rzpEmo 2024-09-16T03:40:14.474 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 638' 2024-09-16T03:40:14.494 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.Kii9rzpEmo' 2024-09-16T03:40:14.496 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 638 2024-09-16T03:40:14.496 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.Kii9rzpEmo 2024-09-16T03:40:14.497 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:14.497 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:14.497 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:14.497 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 639 2024-09-16T03:40:14.497 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=639 2024-09-16T03:40:14.498 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:14.498 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:14.498 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.nvJmbHoUzy 2024-09-16T03:40:14.498 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 639 -o /tmp/tmp.nvJmbHoUzy 2024-09-16T03:40:14.909 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 639 2024-09-16T03:40:14.925 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.nvJmbHoUzy 2024-09-16T03:40:14.925 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 639' 2024-09-16T03:40:14.945 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.nvJmbHoUzy' 2024-09-16T03:40:14.947 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 639 2024-09-16T03:40:14.947 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.nvJmbHoUzy 2024-09-16T03:40:14.948 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:14.948 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:14.948 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:14.948 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 640 2024-09-16T03:40:14.949 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=640 2024-09-16T03:40:14.949 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:14.949 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:14.950 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.dxS5KvIUDN 2024-09-16T03:40:14.950 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 640 -o /tmp/tmp.dxS5KvIUDN 2024-09-16T03:40:15.409 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 640 2024-09-16T03:40:15.428 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.dxS5KvIUDN 2024-09-16T03:40:15.428 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 640' 2024-09-16T03:40:15.448 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.dxS5KvIUDN' 2024-09-16T03:40:15.449 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 640 2024-09-16T03:40:15.450 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.dxS5KvIUDN 2024-09-16T03:40:15.451 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:15.451 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:15.451 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:15.451 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 641 2024-09-16T03:40:15.451 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=641 2024-09-16T03:40:15.451 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:15.452 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:15.452 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.JV70VQLN8v 2024-09-16T03:40:15.452 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 641 -o /tmp/tmp.JV70VQLN8v 2024-09-16T03:40:15.886 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 641 2024-09-16T03:40:15.903 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.JV70VQLN8v 2024-09-16T03:40:15.903 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 641' 2024-09-16T03:40:15.922 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.JV70VQLN8v' 2024-09-16T03:40:15.924 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 641 2024-09-16T03:40:15.924 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.JV70VQLN8v 2024-09-16T03:40:15.925 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:15.925 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:15.925 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:15.925 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 642 2024-09-16T03:40:15.926 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=642 2024-09-16T03:40:15.926 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:15.926 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:15.926 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.rleNDupO7F 2024-09-16T03:40:15.926 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 642 -o /tmp/tmp.rleNDupO7F 2024-09-16T03:40:16.371 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 642 2024-09-16T03:40:16.388 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.rleNDupO7F 2024-09-16T03:40:16.389 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 642' 2024-09-16T03:40:16.403 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.rleNDupO7F' 2024-09-16T03:40:16.405 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 642 2024-09-16T03:40:16.405 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.rleNDupO7F 2024-09-16T03:40:16.407 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:16.407 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:16.407 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:16.407 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 643 2024-09-16T03:40:16.407 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=643 2024-09-16T03:40:16.407 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:16.407 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:16.407 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.Kzn44Uc8Lz 2024-09-16T03:40:16.408 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 643 -o /tmp/tmp.Kzn44Uc8Lz 2024-09-16T03:40:16.838 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 643 2024-09-16T03:40:16.855 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.Kzn44Uc8Lz 2024-09-16T03:40:16.855 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 643' 2024-09-16T03:40:16.875 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.Kzn44Uc8Lz' 2024-09-16T03:40:16.877 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 643 2024-09-16T03:40:16.877 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.Kzn44Uc8Lz 2024-09-16T03:40:16.878 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:16.878 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:16.878 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:16.878 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 644 2024-09-16T03:40:16.878 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=644 2024-09-16T03:40:16.878 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:16.879 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:16.879 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.UUwOizOvJ5 2024-09-16T03:40:16.879 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 644 -o /tmp/tmp.UUwOizOvJ5 2024-09-16T03:40:17.349 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 644 2024-09-16T03:40:17.366 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 644' 2024-09-16T03:40:17.367 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.UUwOizOvJ5 2024-09-16T03:40:17.386 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.UUwOizOvJ5' 2024-09-16T03:40:17.388 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 644 2024-09-16T03:40:17.388 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.UUwOizOvJ5 2024-09-16T03:40:17.389 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:17.389 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:17.390 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:17.390 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 645 2024-09-16T03:40:17.390 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=645 2024-09-16T03:40:17.390 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:17.390 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:17.390 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.FxoOsGdTjz 2024-09-16T03:40:17.391 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 645 -o /tmp/tmp.FxoOsGdTjz 2024-09-16T03:40:17.792 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 645 2024-09-16T03:40:17.808 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 645' 2024-09-16T03:40:17.808 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.FxoOsGdTjz 2024-09-16T03:40:17.828 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.FxoOsGdTjz' 2024-09-16T03:40:17.830 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 645 2024-09-16T03:40:17.830 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.FxoOsGdTjz 2024-09-16T03:40:17.832 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:17.832 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:17.832 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:17.832 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 646 2024-09-16T03:40:17.832 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=646 2024-09-16T03:40:17.832 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:17.832 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:17.833 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.nJHqJzXHNd 2024-09-16T03:40:17.833 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 646 -o /tmp/tmp.nJHqJzXHNd 2024-09-16T03:40:18.268 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 646 2024-09-16T03:40:18.286 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.nJHqJzXHNd 2024-09-16T03:40:18.286 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 646' 2024-09-16T03:40:18.306 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.nJHqJzXHNd' 2024-09-16T03:40:18.308 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 646 2024-09-16T03:40:18.308 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.nJHqJzXHNd 2024-09-16T03:40:18.309 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:18.309 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:18.310 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:18.310 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 647 2024-09-16T03:40:18.310 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=647 2024-09-16T03:40:18.310 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:18.310 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:18.310 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.ZuGGBLIphU 2024-09-16T03:40:18.310 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 647 -o /tmp/tmp.ZuGGBLIphU 2024-09-16T03:40:18.733 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 647 2024-09-16T03:40:18.750 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 647' 2024-09-16T03:40:18.750 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.ZuGGBLIphU 2024-09-16T03:40:18.772 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.ZuGGBLIphU' 2024-09-16T03:40:18.773 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 647 2024-09-16T03:40:18.773 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.ZuGGBLIphU 2024-09-16T03:40:18.775 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:18.775 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:18.775 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:18.775 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 648 2024-09-16T03:40:18.775 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=648 2024-09-16T03:40:18.775 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:18.775 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:18.776 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.bcTX2UYZoM 2024-09-16T03:40:18.776 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 648 -o /tmp/tmp.bcTX2UYZoM 2024-09-16T03:40:19.271 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 648 2024-09-16T03:40:19.289 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.bcTX2UYZoM 2024-09-16T03:40:19.289 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 648' 2024-09-16T03:40:19.309 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.bcTX2UYZoM' 2024-09-16T03:40:19.311 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 648 2024-09-16T03:40:19.311 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.bcTX2UYZoM 2024-09-16T03:40:19.312 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:19.312 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:19.312 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:19.313 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 649 2024-09-16T03:40:19.313 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=649 2024-09-16T03:40:19.313 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:19.313 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:19.313 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.go61wTB8A6 2024-09-16T03:40:19.313 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 649 -o /tmp/tmp.go61wTB8A6 2024-09-16T03:40:19.781 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 649 2024-09-16T03:40:19.799 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.go61wTB8A6 2024-09-16T03:40:19.800 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 649' 2024-09-16T03:40:19.819 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.go61wTB8A6' 2024-09-16T03:40:19.821 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 649 2024-09-16T03:40:19.821 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.go61wTB8A6 2024-09-16T03:40:19.822 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:19.823 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:19.823 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:19.823 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 650 2024-09-16T03:40:19.823 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=650 2024-09-16T03:40:19.823 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:19.823 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:19.823 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.tA9jzNzPgz 2024-09-16T03:40:19.823 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 650 -o /tmp/tmp.tA9jzNzPgz 2024-09-16T03:40:20.225 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 650 2024-09-16T03:40:20.242 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 650' 2024-09-16T03:40:20.242 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.tA9jzNzPgz 2024-09-16T03:40:20.262 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.tA9jzNzPgz' 2024-09-16T03:40:20.263 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 650 2024-09-16T03:40:20.264 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.tA9jzNzPgz 2024-09-16T03:40:20.265 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:20.265 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:20.265 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:20.265 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 651 2024-09-16T03:40:20.265 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=651 2024-09-16T03:40:20.265 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:20.265 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:20.266 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.dMsrQmaiFz 2024-09-16T03:40:20.266 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 651 -o /tmp/tmp.dMsrQmaiFz 2024-09-16T03:40:20.714 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 651 2024-09-16T03:40:20.731 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.dMsrQmaiFz 2024-09-16T03:40:20.731 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 651' 2024-09-16T03:40:20.751 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.dMsrQmaiFz' 2024-09-16T03:40:20.753 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 651 2024-09-16T03:40:20.753 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.dMsrQmaiFz 2024-09-16T03:40:20.754 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:20.754 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:20.754 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:20.754 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 652 2024-09-16T03:40:20.755 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=652 2024-09-16T03:40:20.755 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:20.755 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:20.755 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.B74NdiHza0 2024-09-16T03:40:20.755 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 652 -o /tmp/tmp.B74NdiHza0 2024-09-16T03:40:21.203 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 652 2024-09-16T03:40:21.219 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.B74NdiHza0 2024-09-16T03:40:21.220 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 652' 2024-09-16T03:40:21.239 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.B74NdiHza0' 2024-09-16T03:40:21.241 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 652 2024-09-16T03:40:21.241 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.B74NdiHza0 2024-09-16T03:40:21.242 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:21.242 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:21.242 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:21.242 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 653 2024-09-16T03:40:21.243 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=653 2024-09-16T03:40:21.243 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:21.243 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:21.243 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.USSvritvWu 2024-09-16T03:40:21.243 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 653 -o /tmp/tmp.USSvritvWu 2024-09-16T03:40:21.711 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 653 2024-09-16T03:40:21.729 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 653' 2024-09-16T03:40:21.729 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.USSvritvWu 2024-09-16T03:40:21.750 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.USSvritvWu' 2024-09-16T03:40:21.751 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 653 2024-09-16T03:40:21.752 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.USSvritvWu 2024-09-16T03:40:21.753 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:21.753 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:21.753 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:21.753 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 654 2024-09-16T03:40:21.753 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=654 2024-09-16T03:40:21.753 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:21.754 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:21.755 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.gPhJBmRiR0 2024-09-16T03:40:21.755 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 654 -o /tmp/tmp.gPhJBmRiR0 2024-09-16T03:40:22.206 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 654 2024-09-16T03:40:22.224 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.gPhJBmRiR0 2024-09-16T03:40:22.224 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 654' 2024-09-16T03:40:22.244 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.gPhJBmRiR0' 2024-09-16T03:40:22.246 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 654 2024-09-16T03:40:22.246 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.gPhJBmRiR0 2024-09-16T03:40:22.248 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:22.248 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:22.248 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:22.248 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 655 2024-09-16T03:40:22.248 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=655 2024-09-16T03:40:22.248 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:22.248 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:22.248 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.dQRo2YcWyp 2024-09-16T03:40:22.249 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 655 -o /tmp/tmp.dQRo2YcWyp 2024-09-16T03:40:22.665 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 655 2024-09-16T03:40:22.682 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.dQRo2YcWyp 2024-09-16T03:40:22.682 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 655' 2024-09-16T03:40:22.702 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.dQRo2YcWyp' 2024-09-16T03:40:22.704 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 655 2024-09-16T03:40:22.704 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.dQRo2YcWyp 2024-09-16T03:40:22.706 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:22.706 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:22.706 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:22.706 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 656 2024-09-16T03:40:22.706 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=656 2024-09-16T03:40:22.706 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:22.706 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:22.707 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.R2hbwbYGUm 2024-09-16T03:40:22.707 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 656 -o /tmp/tmp.R2hbwbYGUm 2024-09-16T03:40:23.167 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 656 2024-09-16T03:40:23.184 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.R2hbwbYGUm 2024-09-16T03:40:23.184 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 656' 2024-09-16T03:40:23.198 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.R2hbwbYGUm' 2024-09-16T03:40:23.199 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 656 2024-09-16T03:40:23.199 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.R2hbwbYGUm 2024-09-16T03:40:23.201 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:23.201 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:23.201 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:23.201 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 657 2024-09-16T03:40:23.201 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=657 2024-09-16T03:40:23.201 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:23.201 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:23.201 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.NmajOV6phT 2024-09-16T03:40:23.201 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 657 -o /tmp/tmp.NmajOV6phT 2024-09-16T03:40:23.596 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 657 2024-09-16T03:40:23.612 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.NmajOV6phT 2024-09-16T03:40:23.612 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 657' 2024-09-16T03:40:23.631 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.NmajOV6phT' 2024-09-16T03:40:23.633 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 657 2024-09-16T03:40:23.633 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.NmajOV6phT 2024-09-16T03:40:23.635 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:23.635 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:23.635 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:23.635 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 658 2024-09-16T03:40:23.635 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=658 2024-09-16T03:40:23.635 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:23.635 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:23.636 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.O63krkB1OV 2024-09-16T03:40:23.636 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 658 -o /tmp/tmp.O63krkB1OV 2024-09-16T03:40:24.130 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 658 2024-09-16T03:40:24.148 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.O63krkB1OV 2024-09-16T03:40:24.148 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 658' 2024-09-16T03:40:24.162 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.O63krkB1OV' 2024-09-16T03:40:24.164 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 658 2024-09-16T03:40:24.164 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.O63krkB1OV 2024-09-16T03:40:24.165 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:24.165 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:24.165 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:24.165 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 659 2024-09-16T03:40:24.165 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=659 2024-09-16T03:40:24.166 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:24.166 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:24.166 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.G9XgvUIdBy 2024-09-16T03:40:24.166 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 659 -o /tmp/tmp.G9XgvUIdBy 2024-09-16T03:40:24.623 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 659 2024-09-16T03:40:24.641 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.G9XgvUIdBy 2024-09-16T03:40:24.641 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 659' 2024-09-16T03:40:24.661 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.G9XgvUIdBy' 2024-09-16T03:40:24.662 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 659 2024-09-16T03:40:24.662 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.G9XgvUIdBy 2024-09-16T03:40:24.664 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:24.664 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:24.664 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:24.664 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 660 2024-09-16T03:40:24.664 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=660 2024-09-16T03:40:24.664 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:24.664 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:24.665 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.VlRKNEv4D4 2024-09-16T03:40:24.665 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 660 -o /tmp/tmp.VlRKNEv4D4 2024-09-16T03:40:25.057 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 660 2024-09-16T03:40:25.073 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.VlRKNEv4D4 2024-09-16T03:40:25.073 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 660' 2024-09-16T03:40:25.087 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.VlRKNEv4D4' 2024-09-16T03:40:25.089 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 660 2024-09-16T03:40:25.089 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.VlRKNEv4D4 2024-09-16T03:40:25.090 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:25.090 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:25.090 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:25.091 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 661 2024-09-16T03:40:25.091 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=661 2024-09-16T03:40:25.091 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:25.091 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:25.091 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.fR5Laa0R1U 2024-09-16T03:40:25.091 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 661 -o /tmp/tmp.fR5Laa0R1U 2024-09-16T03:40:25.488 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 661 2024-09-16T03:40:25.504 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.fR5Laa0R1U 2024-09-16T03:40:25.505 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 661' 2024-09-16T03:40:25.524 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.fR5Laa0R1U' 2024-09-16T03:40:25.525 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 661 2024-09-16T03:40:25.526 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.fR5Laa0R1U 2024-09-16T03:40:25.527 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:25.527 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:25.527 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:25.527 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 662 2024-09-16T03:40:25.528 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=662 2024-09-16T03:40:25.528 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:25.528 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:25.528 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.vNplUZ79DY 2024-09-16T03:40:25.528 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 662 -o /tmp/tmp.vNplUZ79DY 2024-09-16T03:40:25.977 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 662 2024-09-16T03:40:25.995 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.vNplUZ79DY 2024-09-16T03:40:25.995 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 662' 2024-09-16T03:40:26.014 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.vNplUZ79DY' 2024-09-16T03:40:26.016 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 662 2024-09-16T03:40:26.016 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.vNplUZ79DY 2024-09-16T03:40:26.018 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:26.018 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:26.018 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:26.018 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 663 2024-09-16T03:40:26.018 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=663 2024-09-16T03:40:26.018 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:26.018 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:26.018 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.FXG3euuoqf 2024-09-16T03:40:26.019 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 663 -o /tmp/tmp.FXG3euuoqf 2024-09-16T03:40:26.457 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 663 2024-09-16T03:40:26.470 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.FXG3euuoqf 2024-09-16T03:40:26.470 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 663' 2024-09-16T03:40:26.491 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.FXG3euuoqf' 2024-09-16T03:40:26.492 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 663 2024-09-16T03:40:26.492 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.FXG3euuoqf 2024-09-16T03:40:26.494 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:26.494 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:26.494 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:26.494 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 664 2024-09-16T03:40:26.494 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=664 2024-09-16T03:40:26.494 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:26.494 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:26.495 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.PnuQiQ06r1 2024-09-16T03:40:26.495 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 664 -o /tmp/tmp.PnuQiQ06r1 2024-09-16T03:40:26.938 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 664 2024-09-16T03:40:26.956 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.PnuQiQ06r1 2024-09-16T03:40:26.956 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 664' 2024-09-16T03:40:26.978 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.PnuQiQ06r1' 2024-09-16T03:40:26.979 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 664 2024-09-16T03:40:26.979 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.PnuQiQ06r1 2024-09-16T03:40:26.981 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:26.981 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:26.981 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:26.981 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 665 2024-09-16T03:40:26.981 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=665 2024-09-16T03:40:26.981 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:26.981 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:26.981 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.ArzmmrfSki 2024-09-16T03:40:26.982 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 665 -o /tmp/tmp.ArzmmrfSki 2024-09-16T03:40:27.394 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 665 2024-09-16T03:40:27.411 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 665' 2024-09-16T03:40:27.411 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.ArzmmrfSki 2024-09-16T03:40:27.430 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.ArzmmrfSki' 2024-09-16T03:40:27.432 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 665 2024-09-16T03:40:27.432 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.ArzmmrfSki 2024-09-16T03:40:27.433 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:27.433 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:27.433 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:27.433 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 666 2024-09-16T03:40:27.433 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=666 2024-09-16T03:40:27.434 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:27.434 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:27.434 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.mDNfUCoTPd 2024-09-16T03:40:27.434 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 666 -o /tmp/tmp.mDNfUCoTPd 2024-09-16T03:40:27.907 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 666 2024-09-16T03:40:27.923 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.mDNfUCoTPd 2024-09-16T03:40:27.923 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 666' 2024-09-16T03:40:27.942 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.mDNfUCoTPd' 2024-09-16T03:40:27.944 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 666 2024-09-16T03:40:27.944 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.mDNfUCoTPd 2024-09-16T03:40:27.945 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:27.945 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:27.945 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:27.946 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 667 2024-09-16T03:40:27.946 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=667 2024-09-16T03:40:27.946 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:27.946 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:27.946 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.wamS0kPmCY 2024-09-16T03:40:27.947 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 667 -o /tmp/tmp.wamS0kPmCY 2024-09-16T03:40:28.399 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 667 2024-09-16T03:40:28.417 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.wamS0kPmCY 2024-09-16T03:40:28.418 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 667' 2024-09-16T03:40:28.437 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.wamS0kPmCY' 2024-09-16T03:40:28.438 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 667 2024-09-16T03:40:28.438 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.wamS0kPmCY 2024-09-16T03:40:28.440 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:28.440 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:28.441 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:28.441 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 668 2024-09-16T03:40:28.441 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=668 2024-09-16T03:40:28.441 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:28.441 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:28.441 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.muFSiDb4iH 2024-09-16T03:40:28.441 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 668 -o /tmp/tmp.muFSiDb4iH 2024-09-16T03:40:28.885 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 668 2024-09-16T03:40:28.901 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.muFSiDb4iH 2024-09-16T03:40:28.904 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 668' 2024-09-16T03:40:28.921 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.muFSiDb4iH' 2024-09-16T03:40:28.922 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 668 2024-09-16T03:40:28.922 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.muFSiDb4iH 2024-09-16T03:40:28.923 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:28.924 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:28.924 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:28.924 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 669 2024-09-16T03:40:28.924 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=669 2024-09-16T03:40:28.924 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:28.924 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:28.924 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.OO2YrimTcn 2024-09-16T03:40:28.925 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 669 -o /tmp/tmp.OO2YrimTcn 2024-09-16T03:40:29.369 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 669 2024-09-16T03:40:29.387 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.OO2YrimTcn 2024-09-16T03:40:29.387 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 669' 2024-09-16T03:40:29.406 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.OO2YrimTcn' 2024-09-16T03:40:29.408 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 669 2024-09-16T03:40:29.408 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.OO2YrimTcn 2024-09-16T03:40:29.410 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:29.410 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:29.410 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:29.410 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 670 2024-09-16T03:40:29.410 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=670 2024-09-16T03:40:29.410 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:29.411 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:29.411 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.FBZjhLbcNC 2024-09-16T03:40:29.411 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 670 -o /tmp/tmp.FBZjhLbcNC 2024-09-16T03:40:29.880 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 670 2024-09-16T03:40:29.896 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.FBZjhLbcNC 2024-09-16T03:40:29.897 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 670' 2024-09-16T03:40:29.917 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.FBZjhLbcNC' 2024-09-16T03:40:29.919 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 670 2024-09-16T03:40:29.919 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.FBZjhLbcNC 2024-09-16T03:40:29.920 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:29.920 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:29.920 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:29.920 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 671 2024-09-16T03:40:29.921 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=671 2024-09-16T03:40:29.921 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:29.921 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:29.921 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.LjwzURgxrr 2024-09-16T03:40:29.921 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 671 -o /tmp/tmp.LjwzURgxrr 2024-09-16T03:40:30.347 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 671 2024-09-16T03:40:30.362 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.LjwzURgxrr 2024-09-16T03:40:30.363 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 671' 2024-09-16T03:40:30.383 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.LjwzURgxrr' 2024-09-16T03:40:30.384 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 671 2024-09-16T03:40:30.385 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.LjwzURgxrr 2024-09-16T03:40:30.386 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:30.386 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:30.386 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:30.387 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 672 2024-09-16T03:40:30.387 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=672 2024-09-16T03:40:30.387 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:30.387 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:30.387 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.vlVM6Rg2Al 2024-09-16T03:40:30.387 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 672 -o /tmp/tmp.vlVM6Rg2Al 2024-09-16T03:40:30.841 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 672 2024-09-16T03:40:30.858 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.vlVM6Rg2Al 2024-09-16T03:40:30.858 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 672' 2024-09-16T03:40:30.878 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.vlVM6Rg2Al' 2024-09-16T03:40:30.880 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 672 2024-09-16T03:40:30.880 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.vlVM6Rg2Al 2024-09-16T03:40:30.881 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:30.882 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:30.882 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:30.882 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 673 2024-09-16T03:40:30.882 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=673 2024-09-16T03:40:30.882 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:30.882 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:30.882 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.MVdtxsWkXJ 2024-09-16T03:40:30.882 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 673 -o /tmp/tmp.MVdtxsWkXJ 2024-09-16T03:40:31.285 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 673 2024-09-16T03:40:31.301 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.MVdtxsWkXJ 2024-09-16T03:40:31.302 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 673' 2024-09-16T03:40:31.322 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.MVdtxsWkXJ' 2024-09-16T03:40:31.323 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 673 2024-09-16T03:40:31.323 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.MVdtxsWkXJ 2024-09-16T03:40:31.325 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:31.325 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:31.325 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:31.325 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 674 2024-09-16T03:40:31.325 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=674 2024-09-16T03:40:31.325 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:31.325 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:31.325 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.GydyT1QISG 2024-09-16T03:40:31.326 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 674 -o /tmp/tmp.GydyT1QISG 2024-09-16T03:40:31.704 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 674 2024-09-16T03:40:31.720 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.GydyT1QISG 2024-09-16T03:40:31.721 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 674' 2024-09-16T03:40:31.741 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.GydyT1QISG' 2024-09-16T03:40:31.742 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 674 2024-09-16T03:40:31.742 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.GydyT1QISG 2024-09-16T03:40:31.744 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:31.744 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:31.744 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:31.744 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 675 2024-09-16T03:40:31.744 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=675 2024-09-16T03:40:31.744 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:31.744 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:31.746 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.PWSTW2OMEH 2024-09-16T03:40:31.746 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 675 -o /tmp/tmp.PWSTW2OMEH 2024-09-16T03:40:32.196 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 675 2024-09-16T03:40:32.214 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.PWSTW2OMEH 2024-09-16T03:40:32.214 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 675' 2024-09-16T03:40:32.234 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.PWSTW2OMEH' 2024-09-16T03:40:32.235 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 675 2024-09-16T03:40:32.236 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.PWSTW2OMEH 2024-09-16T03:40:32.237 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:32.237 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:32.237 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:32.237 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 676 2024-09-16T03:40:32.237 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=676 2024-09-16T03:40:32.237 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:32.237 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:32.238 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.CDJcsVoURh 2024-09-16T03:40:32.238 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 676 -o /tmp/tmp.CDJcsVoURh 2024-09-16T03:40:32.632 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 676 2024-09-16T03:40:32.648 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.CDJcsVoURh 2024-09-16T03:40:32.648 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 676' 2024-09-16T03:40:32.668 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.CDJcsVoURh' 2024-09-16T03:40:32.669 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 676 2024-09-16T03:40:32.670 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.CDJcsVoURh 2024-09-16T03:40:32.671 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:32.671 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:32.671 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:32.671 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 677 2024-09-16T03:40:32.671 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=677 2024-09-16T03:40:32.671 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:32.671 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:32.672 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.3Aq7Upqwel 2024-09-16T03:40:32.672 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 677 -o /tmp/tmp.3Aq7Upqwel 2024-09-16T03:40:33.076 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 677 2024-09-16T03:40:33.092 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.3Aq7Upqwel 2024-09-16T03:40:33.092 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 677' 2024-09-16T03:40:33.106 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.3Aq7Upqwel' 2024-09-16T03:40:33.108 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 677 2024-09-16T03:40:33.108 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.3Aq7Upqwel 2024-09-16T03:40:33.109 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:33.109 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:33.109 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:33.110 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 678 2024-09-16T03:40:33.110 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=678 2024-09-16T03:40:33.110 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:33.110 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:33.110 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.DjCYBdRS6r 2024-09-16T03:40:33.110 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 678 -o /tmp/tmp.DjCYBdRS6r 2024-09-16T03:40:33.634 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 678 2024-09-16T03:40:33.653 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.DjCYBdRS6r 2024-09-16T03:40:33.653 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 678' 2024-09-16T03:40:33.674 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.DjCYBdRS6r' 2024-09-16T03:40:33.676 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 678 2024-09-16T03:40:33.676 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.DjCYBdRS6r 2024-09-16T03:40:33.677 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:33.677 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:33.677 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:33.677 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 679 2024-09-16T03:40:33.677 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=679 2024-09-16T03:40:33.678 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:33.678 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:33.678 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.2hV1S7biLt 2024-09-16T03:40:33.678 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 679 -o /tmp/tmp.2hV1S7biLt 2024-09-16T03:40:34.144 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 679 2024-09-16T03:40:34.162 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.2hV1S7biLt 2024-09-16T03:40:34.162 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 679' 2024-09-16T03:40:34.182 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.2hV1S7biLt' 2024-09-16T03:40:34.184 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 679 2024-09-16T03:40:34.184 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.2hV1S7biLt 2024-09-16T03:40:34.186 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:34.186 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:34.186 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:34.186 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 680 2024-09-16T03:40:34.186 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=680 2024-09-16T03:40:34.186 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:34.186 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:34.187 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.o0iDy45k5i 2024-09-16T03:40:34.187 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 680 -o /tmp/tmp.o0iDy45k5i 2024-09-16T03:40:34.654 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 680 2024-09-16T03:40:34.672 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.o0iDy45k5i 2024-09-16T03:40:34.672 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 680' 2024-09-16T03:40:34.689 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.o0iDy45k5i' 2024-09-16T03:40:34.690 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 680 2024-09-16T03:40:34.690 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.o0iDy45k5i 2024-09-16T03:40:34.691 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:34.691 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:34.692 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:34.692 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 681 2024-09-16T03:40:34.692 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=681 2024-09-16T03:40:34.692 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:34.692 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:34.692 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.wHMZndicg5 2024-09-16T03:40:34.692 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 681 -o /tmp/tmp.wHMZndicg5 2024-09-16T03:40:35.108 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 681 2024-09-16T03:40:35.124 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.wHMZndicg5 2024-09-16T03:40:35.124 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 681' 2024-09-16T03:40:35.144 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.wHMZndicg5' 2024-09-16T03:40:35.146 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 681 2024-09-16T03:40:35.146 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.wHMZndicg5 2024-09-16T03:40:35.147 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:35.147 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:35.147 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:35.147 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 682 2024-09-16T03:40:35.148 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=682 2024-09-16T03:40:35.148 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:35.148 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:35.148 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.tB9J86flnl 2024-09-16T03:40:35.148 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 682 -o /tmp/tmp.tB9J86flnl 2024-09-16T03:40:35.639 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 682 2024-09-16T03:40:35.658 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.tB9J86flnl 2024-09-16T03:40:35.658 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 682' 2024-09-16T03:40:35.681 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.tB9J86flnl' 2024-09-16T03:40:35.682 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 682 2024-09-16T03:40:35.683 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.tB9J86flnl 2024-09-16T03:40:35.684 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:35.684 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:35.684 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:35.684 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 683 2024-09-16T03:40:35.684 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=683 2024-09-16T03:40:35.684 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:35.684 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:35.685 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.biNAkwieho 2024-09-16T03:40:35.685 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 683 -o /tmp/tmp.biNAkwieho 2024-09-16T03:40:36.133 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 683 2024-09-16T03:40:36.149 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.biNAkwieho 2024-09-16T03:40:36.150 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 683' 2024-09-16T03:40:36.169 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.biNAkwieho' 2024-09-16T03:40:36.170 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 683 2024-09-16T03:40:36.171 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.biNAkwieho 2024-09-16T03:40:36.172 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:36.172 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:36.172 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:36.172 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 684 2024-09-16T03:40:36.172 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=684 2024-09-16T03:40:36.172 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:36.172 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:36.173 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.vG7Q8Jvao2 2024-09-16T03:40:36.173 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 684 -o /tmp/tmp.vG7Q8Jvao2 2024-09-16T03:40:36.581 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 684 2024-09-16T03:40:36.597 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.vG7Q8Jvao2 2024-09-16T03:40:36.597 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 684' 2024-09-16T03:40:36.618 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.vG7Q8Jvao2' 2024-09-16T03:40:36.619 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 684 2024-09-16T03:40:36.619 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.vG7Q8Jvao2 2024-09-16T03:40:36.621 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:36.621 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:36.621 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:36.621 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 685 2024-09-16T03:40:36.621 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=685 2024-09-16T03:40:36.621 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:36.621 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:36.621 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.Vv9N0HA60Y 2024-09-16T03:40:36.622 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 685 -o /tmp/tmp.Vv9N0HA60Y 2024-09-16T03:40:37.033 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 685 2024-09-16T03:40:37.050 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.Vv9N0HA60Y 2024-09-16T03:40:37.050 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 685' 2024-09-16T03:40:37.070 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.Vv9N0HA60Y' 2024-09-16T03:40:37.073 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 685 2024-09-16T03:40:37.073 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.Vv9N0HA60Y 2024-09-16T03:40:37.074 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:37.074 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:37.074 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:37.074 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 686 2024-09-16T03:40:37.074 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=686 2024-09-16T03:40:37.074 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:37.074 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:37.074 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.iCVS4VgYTH 2024-09-16T03:40:37.075 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 686 -o /tmp/tmp.iCVS4VgYTH 2024-09-16T03:40:37.504 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 686 2024-09-16T03:40:37.521 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.iCVS4VgYTH 2024-09-16T03:40:37.521 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 686' 2024-09-16T03:40:37.542 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.iCVS4VgYTH' 2024-09-16T03:40:37.543 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 686 2024-09-16T03:40:37.543 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.iCVS4VgYTH 2024-09-16T03:40:37.544 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:37.544 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:37.545 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:37.545 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 687 2024-09-16T03:40:37.545 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=687 2024-09-16T03:40:37.545 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:37.545 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:37.545 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.5x69efY2dn 2024-09-16T03:40:37.545 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 687 -o /tmp/tmp.5x69efY2dn 2024-09-16T03:40:37.972 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 687 2024-09-16T03:40:37.988 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.5x69efY2dn 2024-09-16T03:40:37.988 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 687' 2024-09-16T03:40:38.003 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.5x69efY2dn' 2024-09-16T03:40:38.004 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 687 2024-09-16T03:40:38.004 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.5x69efY2dn 2024-09-16T03:40:38.005 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:38.006 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:38.006 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:38.006 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 688 2024-09-16T03:40:38.006 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=688 2024-09-16T03:40:38.006 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:38.006 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:38.006 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.UHKWLbBnfb 2024-09-16T03:40:38.006 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 688 -o /tmp/tmp.UHKWLbBnfb 2024-09-16T03:40:38.457 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 688 2024-09-16T03:40:38.473 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.UHKWLbBnfb 2024-09-16T03:40:38.474 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 688' 2024-09-16T03:40:38.492 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.UHKWLbBnfb' 2024-09-16T03:40:38.493 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 688 2024-09-16T03:40:38.494 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.UHKWLbBnfb 2024-09-16T03:40:38.495 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:38.495 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:38.495 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:38.495 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 689 2024-09-16T03:40:38.495 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=689 2024-09-16T03:40:38.495 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:38.495 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:38.496 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.54exi1QI6w 2024-09-16T03:40:38.496 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 689 -o /tmp/tmp.54exi1QI6w 2024-09-16T03:40:38.925 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 689 2024-09-16T03:40:38.942 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.54exi1QI6w 2024-09-16T03:40:38.942 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 689' 2024-09-16T03:40:38.961 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.54exi1QI6w' 2024-09-16T03:40:38.963 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 689 2024-09-16T03:40:38.963 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.54exi1QI6w 2024-09-16T03:40:38.964 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:38.965 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:38.965 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:38.965 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 690 2024-09-16T03:40:38.965 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=690 2024-09-16T03:40:38.965 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:38.965 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:38.965 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.ikzxpr14EE 2024-09-16T03:40:38.965 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 690 -o /tmp/tmp.ikzxpr14EE 2024-09-16T03:40:39.359 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 690 2024-09-16T03:40:39.374 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.ikzxpr14EE 2024-09-16T03:40:39.374 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 690' 2024-09-16T03:40:39.394 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.ikzxpr14EE' 2024-09-16T03:40:39.396 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 690 2024-09-16T03:40:39.396 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.ikzxpr14EE 2024-09-16T03:40:39.397 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:39.397 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:39.397 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:39.397 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 691 2024-09-16T03:40:39.397 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=691 2024-09-16T03:40:39.398 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:39.398 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:39.398 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.Pa7R0cLLE8 2024-09-16T03:40:39.398 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 691 -o /tmp/tmp.Pa7R0cLLE8 2024-09-16T03:40:39.797 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 691 2024-09-16T03:40:39.813 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.Pa7R0cLLE8 2024-09-16T03:40:39.813 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 691' 2024-09-16T03:40:39.832 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.Pa7R0cLLE8' 2024-09-16T03:40:39.834 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 691 2024-09-16T03:40:39.834 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.Pa7R0cLLE8 2024-09-16T03:40:39.835 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:39.835 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:39.835 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:39.835 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 692 2024-09-16T03:40:39.835 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=692 2024-09-16T03:40:39.836 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:39.836 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:39.836 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.G37u01dVp0 2024-09-16T03:40:39.836 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 692 -o /tmp/tmp.G37u01dVp0 2024-09-16T03:40:40.288 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 692 2024-09-16T03:40:40.305 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.G37u01dVp0 2024-09-16T03:40:40.305 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 692' 2024-09-16T03:40:40.326 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.G37u01dVp0' 2024-09-16T03:40:40.328 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 692 2024-09-16T03:40:40.328 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.G37u01dVp0 2024-09-16T03:40:40.330 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:40.330 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:40.330 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:40.330 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 693 2024-09-16T03:40:40.330 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=693 2024-09-16T03:40:40.330 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:40.330 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:40.331 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.5PAkmN6JeJ 2024-09-16T03:40:40.331 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 693 -o /tmp/tmp.5PAkmN6JeJ 2024-09-16T03:40:40.822 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 693 2024-09-16T03:40:40.840 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.5PAkmN6JeJ 2024-09-16T03:40:40.840 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 693' 2024-09-16T03:40:40.861 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.5PAkmN6JeJ' 2024-09-16T03:40:40.863 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 693 2024-09-16T03:40:40.863 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.5PAkmN6JeJ 2024-09-16T03:40:40.864 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:40.865 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:40.865 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:40.865 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 694 2024-09-16T03:40:40.865 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=694 2024-09-16T03:40:40.865 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:40.865 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:40.865 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.XqoVtn8Bm2 2024-09-16T03:40:40.866 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 694 -o /tmp/tmp.XqoVtn8Bm2 2024-09-16T03:40:41.276 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 694 2024-09-16T03:40:41.292 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.XqoVtn8Bm2 2024-09-16T03:40:41.292 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 694' 2024-09-16T03:40:41.313 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.XqoVtn8Bm2' 2024-09-16T03:40:41.315 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 694 2024-09-16T03:40:41.315 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.XqoVtn8Bm2 2024-09-16T03:40:41.316 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:41.316 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:41.316 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:41.316 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 695 2024-09-16T03:40:41.316 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=695 2024-09-16T03:40:41.317 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:41.317 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:41.317 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.fNiawG1805 2024-09-16T03:40:41.317 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 695 -o /tmp/tmp.fNiawG1805 2024-09-16T03:40:41.711 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 695 2024-09-16T03:40:41.727 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.fNiawG1805 2024-09-16T03:40:41.727 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 695' 2024-09-16T03:40:41.746 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.fNiawG1805' 2024-09-16T03:40:41.748 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 695 2024-09-16T03:40:41.748 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.fNiawG1805 2024-09-16T03:40:41.749 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:41.749 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:41.749 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:41.749 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 696 2024-09-16T03:40:41.749 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=696 2024-09-16T03:40:41.749 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:41.749 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:41.750 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.KFybkQX3jd 2024-09-16T03:40:41.750 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 696 -o /tmp/tmp.KFybkQX3jd 2024-09-16T03:40:42.130 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 696 2024-09-16T03:40:42.145 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.KFybkQX3jd 2024-09-16T03:40:42.145 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 696' 2024-09-16T03:40:42.166 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.KFybkQX3jd' 2024-09-16T03:40:42.167 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 696 2024-09-16T03:40:42.168 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.KFybkQX3jd 2024-09-16T03:40:42.169 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:42.169 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:42.169 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:42.169 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 697 2024-09-16T03:40:42.169 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=697 2024-09-16T03:40:42.169 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:42.169 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:42.170 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.8AZoo2I2Zj 2024-09-16T03:40:42.170 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 697 -o /tmp/tmp.8AZoo2I2Zj 2024-09-16T03:40:42.662 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 697 2024-09-16T03:40:42.680 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.8AZoo2I2Zj 2024-09-16T03:40:42.680 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 697' 2024-09-16T03:40:42.700 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.8AZoo2I2Zj' 2024-09-16T03:40:42.701 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 697 2024-09-16T03:40:42.701 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.8AZoo2I2Zj 2024-09-16T03:40:42.703 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:42.703 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:42.703 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:42.703 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 698 2024-09-16T03:40:42.704 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=698 2024-09-16T03:40:42.704 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:42.704 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:42.704 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.XxSpkDhG17 2024-09-16T03:40:42.704 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 698 -o /tmp/tmp.XxSpkDhG17 2024-09-16T03:40:43.150 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 698 2024-09-16T03:40:43.166 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.XxSpkDhG17 2024-09-16T03:40:43.166 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 698' 2024-09-16T03:40:43.185 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.XxSpkDhG17' 2024-09-16T03:40:43.187 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 698 2024-09-16T03:40:43.187 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.XxSpkDhG17 2024-09-16T03:40:43.188 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:43.188 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:43.188 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:43.188 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 699 2024-09-16T03:40:43.188 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=699 2024-09-16T03:40:43.188 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:43.189 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:43.190 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.r4pTvymH71 2024-09-16T03:40:43.190 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 699 -o /tmp/tmp.r4pTvymH71 2024-09-16T03:40:43.576 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 699 2024-09-16T03:40:43.592 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 699' 2024-09-16T03:40:43.592 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.r4pTvymH71 2024-09-16T03:40:43.616 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.r4pTvymH71' 2024-09-16T03:40:43.617 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 699 2024-09-16T03:40:43.618 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.r4pTvymH71 2024-09-16T03:40:43.618 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:43.618 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:43.618 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:43.618 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 700 2024-09-16T03:40:43.618 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=700 2024-09-16T03:40:43.618 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:43.618 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:43.618 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.hMBr6JB914 2024-09-16T03:40:43.618 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 700 -o /tmp/tmp.hMBr6JB914 2024-09-16T03:40:44.030 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 700 2024-09-16T03:40:44.046 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.hMBr6JB914 2024-09-16T03:40:44.046 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 700' 2024-09-16T03:40:44.065 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.hMBr6JB914' 2024-09-16T03:40:44.067 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 700 2024-09-16T03:40:44.067 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.hMBr6JB914 2024-09-16T03:40:44.068 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:44.068 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:44.068 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:44.068 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 701 2024-09-16T03:40:44.068 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=701 2024-09-16T03:40:44.069 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:44.069 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:44.069 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.j9IMcMUP7e 2024-09-16T03:40:44.069 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 701 -o /tmp/tmp.j9IMcMUP7e 2024-09-16T03:40:44.502 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 701 2024-09-16T03:40:44.519 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.j9IMcMUP7e 2024-09-16T03:40:44.519 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 701' 2024-09-16T03:40:44.534 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.j9IMcMUP7e' 2024-09-16T03:40:44.535 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 701 2024-09-16T03:40:44.535 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.j9IMcMUP7e 2024-09-16T03:40:44.537 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:44.537 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:44.537 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:44.537 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 702 2024-09-16T03:40:44.537 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=702 2024-09-16T03:40:44.537 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:44.537 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:44.537 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.UhMJrNRLQS 2024-09-16T03:40:44.538 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 702 -o /tmp/tmp.UhMJrNRLQS 2024-09-16T03:40:44.979 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 702 2024-09-16T03:40:44.995 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.UhMJrNRLQS 2024-09-16T03:40:44.996 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 702' 2024-09-16T03:40:45.015 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.UhMJrNRLQS' 2024-09-16T03:40:45.017 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 702 2024-09-16T03:40:45.017 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.UhMJrNRLQS 2024-09-16T03:40:45.018 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:45.018 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:45.018 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:45.018 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 703 2024-09-16T03:40:45.018 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=703 2024-09-16T03:40:45.018 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:45.018 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:45.019 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.h68OfQBvTW 2024-09-16T03:40:45.019 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 703 -o /tmp/tmp.h68OfQBvTW 2024-09-16T03:40:45.421 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 703 2024-09-16T03:40:45.437 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.h68OfQBvTW 2024-09-16T03:40:45.438 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 703' 2024-09-16T03:40:45.458 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.h68OfQBvTW' 2024-09-16T03:40:45.459 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 703 2024-09-16T03:40:45.460 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.h68OfQBvTW 2024-09-16T03:40:45.461 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:45.461 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:45.461 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:45.461 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 704 2024-09-16T03:40:45.461 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=704 2024-09-16T03:40:45.461 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:45.461 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:45.462 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.IH3Jp2qAcu 2024-09-16T03:40:45.462 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 704 -o /tmp/tmp.IH3Jp2qAcu 2024-09-16T03:40:45.915 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 704 2024-09-16T03:40:45.933 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.IH3Jp2qAcu 2024-09-16T03:40:45.933 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 704' 2024-09-16T03:40:45.954 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.IH3Jp2qAcu' 2024-09-16T03:40:45.955 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 704 2024-09-16T03:40:45.955 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.IH3Jp2qAcu 2024-09-16T03:40:45.957 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:45.957 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:45.957 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:45.957 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 705 2024-09-16T03:40:45.957 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=705 2024-09-16T03:40:45.957 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:45.957 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:45.958 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.4iJzmahu74 2024-09-16T03:40:45.958 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 705 -o /tmp/tmp.4iJzmahu74 2024-09-16T03:40:46.362 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 705 2024-09-16T03:40:46.378 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.4iJzmahu74 2024-09-16T03:40:46.378 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 705' 2024-09-16T03:40:46.398 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.4iJzmahu74' 2024-09-16T03:40:46.399 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 705 2024-09-16T03:40:46.399 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.4iJzmahu74 2024-09-16T03:40:46.400 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:46.401 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:46.401 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:46.401 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 706 2024-09-16T03:40:46.401 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=706 2024-09-16T03:40:46.401 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:46.401 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:46.402 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.OWLWFjJz5B 2024-09-16T03:40:46.402 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 706 -o /tmp/tmp.OWLWFjJz5B 2024-09-16T03:40:46.797 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 706 2024-09-16T03:40:46.814 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.OWLWFjJz5B 2024-09-16T03:40:46.814 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 706' 2024-09-16T03:40:46.834 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.OWLWFjJz5B' 2024-09-16T03:40:46.836 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 706 2024-09-16T03:40:46.836 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.OWLWFjJz5B 2024-09-16T03:40:46.837 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:46.837 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:46.837 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:46.837 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 707 2024-09-16T03:40:46.837 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=707 2024-09-16T03:40:46.837 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:46.837 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:46.838 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.OUjP6Mpabr 2024-09-16T03:40:46.838 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 707 -o /tmp/tmp.OUjP6Mpabr 2024-09-16T03:40:47.294 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 707 2024-09-16T03:40:47.312 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 707' 2024-09-16T03:40:47.313 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.OUjP6Mpabr 2024-09-16T03:40:47.334 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.OUjP6Mpabr' 2024-09-16T03:40:47.335 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 707 2024-09-16T03:40:47.335 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.OUjP6Mpabr 2024-09-16T03:40:47.336 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:47.337 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:47.337 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:47.337 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 708 2024-09-16T03:40:47.337 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=708 2024-09-16T03:40:47.337 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:47.337 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:47.337 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.GRt0cD3Lr4 2024-09-16T03:40:47.338 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 708 -o /tmp/tmp.GRt0cD3Lr4 2024-09-16T03:40:47.770 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 708 2024-09-16T03:40:47.786 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.GRt0cD3Lr4 2024-09-16T03:40:47.786 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 708' 2024-09-16T03:40:47.806 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.GRt0cD3Lr4' 2024-09-16T03:40:47.807 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 708 2024-09-16T03:40:47.808 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.GRt0cD3Lr4 2024-09-16T03:40:47.809 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:47.809 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:47.809 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:47.809 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 709 2024-09-16T03:40:47.809 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=709 2024-09-16T03:40:47.809 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:47.809 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:47.810 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.cuxIimTBXu 2024-09-16T03:40:47.810 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 709 -o /tmp/tmp.cuxIimTBXu 2024-09-16T03:40:48.272 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 709 2024-09-16T03:40:48.289 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.cuxIimTBXu 2024-09-16T03:40:48.289 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 709' 2024-09-16T03:40:48.309 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.cuxIimTBXu' 2024-09-16T03:40:48.310 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 709 2024-09-16T03:40:48.311 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.cuxIimTBXu 2024-09-16T03:40:48.312 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:48.312 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:48.312 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:48.312 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 710 2024-09-16T03:40:48.312 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=710 2024-09-16T03:40:48.312 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:48.313 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:48.313 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.zbTjdVOjDT 2024-09-16T03:40:48.313 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 710 -o /tmp/tmp.zbTjdVOjDT 2024-09-16T03:40:48.765 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 710 2024-09-16T03:40:48.779 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.zbTjdVOjDT 2024-09-16T03:40:48.779 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 710' 2024-09-16T03:40:48.798 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.zbTjdVOjDT' 2024-09-16T03:40:48.800 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 710 2024-09-16T03:40:48.800 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.zbTjdVOjDT 2024-09-16T03:40:48.801 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:48.801 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:48.801 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:48.801 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 711 2024-09-16T03:40:48.802 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=711 2024-09-16T03:40:48.802 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:48.802 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:48.802 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.oRS3WKxE1p 2024-09-16T03:40:48.802 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 711 -o /tmp/tmp.oRS3WKxE1p 2024-09-16T03:40:49.221 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 711 2024-09-16T03:40:49.237 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.oRS3WKxE1p 2024-09-16T03:40:49.237 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 711' 2024-09-16T03:40:49.256 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.oRS3WKxE1p' 2024-09-16T03:40:49.257 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 711 2024-09-16T03:40:49.258 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.oRS3WKxE1p 2024-09-16T03:40:49.259 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:49.259 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:49.259 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:49.260 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 712 2024-09-16T03:40:49.260 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=712 2024-09-16T03:40:49.260 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:49.260 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:49.260 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.wj3QXNj6UG 2024-09-16T03:40:49.260 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 712 -o /tmp/tmp.wj3QXNj6UG 2024-09-16T03:40:49.645 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 712 2024-09-16T03:40:49.661 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.wj3QXNj6UG 2024-09-16T03:40:49.661 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 712' 2024-09-16T03:40:49.680 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.wj3QXNj6UG' 2024-09-16T03:40:49.682 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 712 2024-09-16T03:40:49.682 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.wj3QXNj6UG 2024-09-16T03:40:49.684 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:49.685 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:49.685 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:49.685 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 713 2024-09-16T03:40:49.685 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=713 2024-09-16T03:40:49.685 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:49.686 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:49.686 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.Qg1dMbOl0t 2024-09-16T03:40:49.686 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 713 -o /tmp/tmp.Qg1dMbOl0t 2024-09-16T03:40:50.112 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 713 2024-09-16T03:40:50.130 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.Qg1dMbOl0t 2024-09-16T03:40:50.130 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 713' 2024-09-16T03:40:50.149 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.Qg1dMbOl0t' 2024-09-16T03:40:50.151 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 713 2024-09-16T03:40:50.151 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.Qg1dMbOl0t 2024-09-16T03:40:50.152 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:50.152 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:50.152 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:50.152 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 714 2024-09-16T03:40:50.152 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=714 2024-09-16T03:40:50.152 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:50.152 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:50.153 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.zkGrFzRBTZ 2024-09-16T03:40:50.153 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 714 -o /tmp/tmp.zkGrFzRBTZ 2024-09-16T03:40:50.589 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 714 2024-09-16T03:40:50.605 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.zkGrFzRBTZ 2024-09-16T03:40:50.606 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 714' 2024-09-16T03:40:50.625 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.zkGrFzRBTZ' 2024-09-16T03:40:50.627 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 714 2024-09-16T03:40:50.627 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.zkGrFzRBTZ 2024-09-16T03:40:50.628 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:50.628 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:50.628 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:50.629 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 715 2024-09-16T03:40:50.629 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=715 2024-09-16T03:40:50.629 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:50.629 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:50.629 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.IcZlsJXs2A 2024-09-16T03:40:50.629 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 715 -o /tmp/tmp.IcZlsJXs2A 2024-09-16T03:40:51.041 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 715 2024-09-16T03:40:51.057 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.IcZlsJXs2A 2024-09-16T03:40:51.057 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 715' 2024-09-16T03:40:51.078 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.IcZlsJXs2A' 2024-09-16T03:40:51.079 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 715 2024-09-16T03:40:51.079 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.IcZlsJXs2A 2024-09-16T03:40:51.081 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:51.081 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:51.081 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:51.081 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 716 2024-09-16T03:40:51.081 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=716 2024-09-16T03:40:51.081 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:51.081 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:51.082 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.XnfihdBNWj 2024-09-16T03:40:51.082 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 716 -o /tmp/tmp.XnfihdBNWj 2024-09-16T03:40:51.517 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 716 2024-09-16T03:40:51.534 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.XnfihdBNWj 2024-09-16T03:40:51.535 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 716' 2024-09-16T03:40:51.554 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.XnfihdBNWj' 2024-09-16T03:40:51.556 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 716 2024-09-16T03:40:51.556 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.XnfihdBNWj 2024-09-16T03:40:51.558 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:51.558 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:51.558 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:51.558 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 717 2024-09-16T03:40:51.558 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=717 2024-09-16T03:40:51.558 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:51.558 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:51.559 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.tlh93acZ2z 2024-09-16T03:40:51.559 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 717 -o /tmp/tmp.tlh93acZ2z 2024-09-16T03:40:52.001 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 717 2024-09-16T03:40:52.019 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.tlh93acZ2z 2024-09-16T03:40:52.020 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 717' 2024-09-16T03:40:52.040 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.tlh93acZ2z' 2024-09-16T03:40:52.041 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 717 2024-09-16T03:40:52.041 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.tlh93acZ2z 2024-09-16T03:40:52.043 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:52.043 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:52.043 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:52.043 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 718 2024-09-16T03:40:52.043 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=718 2024-09-16T03:40:52.043 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:52.043 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:52.044 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.gtOYtMp64g 2024-09-16T03:40:52.044 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 718 -o /tmp/tmp.gtOYtMp64g 2024-09-16T03:40:52.455 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 718 2024-09-16T03:40:52.471 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.gtOYtMp64g 2024-09-16T03:40:52.471 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 718' 2024-09-16T03:40:52.490 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.gtOYtMp64g' 2024-09-16T03:40:52.492 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 718 2024-09-16T03:40:52.492 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.gtOYtMp64g 2024-09-16T03:40:52.493 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:52.494 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:52.494 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:52.494 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 719 2024-09-16T03:40:52.494 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=719 2024-09-16T03:40:52.494 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:52.494 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:52.494 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.p57V9Xbioh 2024-09-16T03:40:52.494 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 719 -o /tmp/tmp.p57V9Xbioh 2024-09-16T03:40:52.954 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 719 2024-09-16T03:40:52.970 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.p57V9Xbioh 2024-09-16T03:40:52.970 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 719' 2024-09-16T03:40:52.985 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.p57V9Xbioh' 2024-09-16T03:40:52.986 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 719 2024-09-16T03:40:52.987 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.p57V9Xbioh 2024-09-16T03:40:52.988 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:52.988 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:52.988 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:52.988 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 720 2024-09-16T03:40:52.988 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=720 2024-09-16T03:40:52.988 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:52.988 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:52.989 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.qiuxnWUXQt 2024-09-16T03:40:52.989 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 720 -o /tmp/tmp.qiuxnWUXQt 2024-09-16T03:40:53.464 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 720 2024-09-16T03:40:53.480 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.qiuxnWUXQt 2024-09-16T03:40:53.480 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 720' 2024-09-16T03:40:53.498 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.qiuxnWUXQt' 2024-09-16T03:40:53.500 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 720 2024-09-16T03:40:53.500 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.qiuxnWUXQt 2024-09-16T03:40:53.501 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:53.501 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:53.502 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:53.502 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 721 2024-09-16T03:40:53.502 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=721 2024-09-16T03:40:53.502 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:53.502 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:53.502 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.0ZctUll7bj 2024-09-16T03:40:53.502 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 721 -o /tmp/tmp.0ZctUll7bj 2024-09-16T03:40:53.966 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 721 2024-09-16T03:40:53.984 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.0ZctUll7bj 2024-09-16T03:40:53.985 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 721' 2024-09-16T03:40:54.004 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.0ZctUll7bj' 2024-09-16T03:40:54.006 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 721 2024-09-16T03:40:54.006 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.0ZctUll7bj 2024-09-16T03:40:54.008 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:54.008 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:54.008 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:54.008 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 722 2024-09-16T03:40:54.008 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=722 2024-09-16T03:40:54.008 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:54.008 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:54.009 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.89T5DK1YER 2024-09-16T03:40:54.009 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 722 -o /tmp/tmp.89T5DK1YER 2024-09-16T03:40:54.457 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 722 2024-09-16T03:40:54.474 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.89T5DK1YER 2024-09-16T03:40:54.474 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 722' 2024-09-16T03:40:54.494 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.89T5DK1YER' 2024-09-16T03:40:54.496 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 722 2024-09-16T03:40:54.496 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.89T5DK1YER 2024-09-16T03:40:54.497 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:54.497 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:54.497 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:54.497 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 723 2024-09-16T03:40:54.497 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=723 2024-09-16T03:40:54.497 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:54.498 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:54.499 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.24E5KwAchI 2024-09-16T03:40:54.499 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 723 -o /tmp/tmp.24E5KwAchI 2024-09-16T03:40:54.882 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 723 2024-09-16T03:40:54.898 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.24E5KwAchI 2024-09-16T03:40:54.898 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 723' 2024-09-16T03:40:54.918 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.24E5KwAchI' 2024-09-16T03:40:54.919 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 723 2024-09-16T03:40:54.919 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.24E5KwAchI 2024-09-16T03:40:54.920 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:54.920 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:54.921 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:54.921 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 724 2024-09-16T03:40:54.921 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=724 2024-09-16T03:40:54.921 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:54.921 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:54.921 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.gzsOH0k5cS 2024-09-16T03:40:54.921 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 724 -o /tmp/tmp.gzsOH0k5cS 2024-09-16T03:40:55.369 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 724 2024-09-16T03:40:55.386 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.gzsOH0k5cS 2024-09-16T03:40:55.386 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 724' 2024-09-16T03:40:55.407 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.gzsOH0k5cS' 2024-09-16T03:40:55.408 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 724 2024-09-16T03:40:55.408 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.gzsOH0k5cS 2024-09-16T03:40:55.409 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:55.409 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:55.409 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:55.410 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 725 2024-09-16T03:40:55.410 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=725 2024-09-16T03:40:55.410 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:55.410 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:55.410 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.EfiEGEzKFi 2024-09-16T03:40:55.411 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 725 -o /tmp/tmp.EfiEGEzKFi 2024-09-16T03:40:55.807 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 725 2024-09-16T03:40:55.823 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.EfiEGEzKFi 2024-09-16T03:40:55.823 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 725' 2024-09-16T03:40:55.843 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.EfiEGEzKFi' 2024-09-16T03:40:55.844 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 725 2024-09-16T03:40:55.845 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.EfiEGEzKFi 2024-09-16T03:40:55.845 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:55.846 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:55.846 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:55.846 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 726 2024-09-16T03:40:55.846 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=726 2024-09-16T03:40:55.846 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:55.846 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:55.847 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.WrZ88RqlSh 2024-09-16T03:40:55.847 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 726 -o /tmp/tmp.WrZ88RqlSh 2024-09-16T03:40:56.289 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 726 2024-09-16T03:40:56.305 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 726' 2024-09-16T03:40:56.305 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.WrZ88RqlSh 2024-09-16T03:40:56.326 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.WrZ88RqlSh' 2024-09-16T03:40:56.327 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 726 2024-09-16T03:40:56.327 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.WrZ88RqlSh 2024-09-16T03:40:56.329 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:56.329 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:56.329 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:56.329 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 727 2024-09-16T03:40:56.329 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=727 2024-09-16T03:40:56.329 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:56.329 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:56.330 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.AastGBhytO 2024-09-16T03:40:56.330 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 727 -o /tmp/tmp.AastGBhytO 2024-09-16T03:40:56.753 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 727 2024-09-16T03:40:56.769 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.AastGBhytO 2024-09-16T03:40:56.769 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 727' 2024-09-16T03:40:56.790 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.AastGBhytO' 2024-09-16T03:40:56.791 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 727 2024-09-16T03:40:56.791 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.AastGBhytO 2024-09-16T03:40:56.792 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:56.792 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:56.792 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:56.793 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 728 2024-09-16T03:40:56.793 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=728 2024-09-16T03:40:56.793 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:56.793 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:56.793 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.fhIq7D6n2X 2024-09-16T03:40:56.793 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 728 -o /tmp/tmp.fhIq7D6n2X 2024-09-16T03:40:57.199 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 728 2024-09-16T03:40:57.217 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.fhIq7D6n2X 2024-09-16T03:40:57.217 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 728' 2024-09-16T03:40:57.238 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.fhIq7D6n2X' 2024-09-16T03:40:57.239 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 728 2024-09-16T03:40:57.239 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.fhIq7D6n2X 2024-09-16T03:40:57.241 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:57.241 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:57.241 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:57.241 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 729 2024-09-16T03:40:57.241 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=729 2024-09-16T03:40:57.241 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:57.241 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:57.241 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.hQcNlD4I8k 2024-09-16T03:40:57.242 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 729 -o /tmp/tmp.hQcNlD4I8k 2024-09-16T03:40:57.684 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 729 2024-09-16T03:40:57.700 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.hQcNlD4I8k 2024-09-16T03:40:57.701 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 729' 2024-09-16T03:40:57.720 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.hQcNlD4I8k' 2024-09-16T03:40:57.721 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 729 2024-09-16T03:40:57.722 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.hQcNlD4I8k 2024-09-16T03:40:57.723 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:57.723 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:57.723 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:57.723 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 730 2024-09-16T03:40:57.723 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=730 2024-09-16T03:40:57.723 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:57.723 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:57.724 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.DmY22aOyUX 2024-09-16T03:40:57.724 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 730 -o /tmp/tmp.DmY22aOyUX 2024-09-16T03:40:58.120 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 730 2024-09-16T03:40:58.136 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.DmY22aOyUX 2024-09-16T03:40:58.136 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 730' 2024-09-16T03:40:58.150 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.DmY22aOyUX' 2024-09-16T03:40:58.152 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 730 2024-09-16T03:40:58.152 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.DmY22aOyUX 2024-09-16T03:40:58.153 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:58.153 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:58.153 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:58.153 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 731 2024-09-16T03:40:58.153 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=731 2024-09-16T03:40:58.153 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:58.154 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:58.154 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.DxHEY5GFQ7 2024-09-16T03:40:58.154 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 731 -o /tmp/tmp.DxHEY5GFQ7 2024-09-16T03:40:58.594 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 731 2024-09-16T03:40:58.611 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.DxHEY5GFQ7 2024-09-16T03:40:58.612 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 731' 2024-09-16T03:40:58.630 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.DxHEY5GFQ7' 2024-09-16T03:40:58.631 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 731 2024-09-16T03:40:58.631 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.DxHEY5GFQ7 2024-09-16T03:40:58.632 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:58.633 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:58.633 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:58.633 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 732 2024-09-16T03:40:58.633 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=732 2024-09-16T03:40:58.633 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:58.633 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:58.633 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.SwwTcDZt3w 2024-09-16T03:40:58.634 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 732 -o /tmp/tmp.SwwTcDZt3w 2024-09-16T03:40:59.072 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 732 2024-09-16T03:40:59.089 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 732' 2024-09-16T03:40:59.089 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.SwwTcDZt3w 2024-09-16T03:40:59.110 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.SwwTcDZt3w' 2024-09-16T03:40:59.112 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 732 2024-09-16T03:40:59.112 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.SwwTcDZt3w 2024-09-16T03:40:59.113 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:59.113 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:59.113 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:59.114 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 733 2024-09-16T03:40:59.114 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=733 2024-09-16T03:40:59.114 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:59.114 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:59.114 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.2Ytmh9VuB7 2024-09-16T03:40:59.114 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 733 -o /tmp/tmp.2Ytmh9VuB7 2024-09-16T03:40:59.591 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 733 2024-09-16T03:40:59.608 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.2Ytmh9VuB7 2024-09-16T03:40:59.608 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 733' 2024-09-16T03:40:59.628 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.2Ytmh9VuB7' 2024-09-16T03:40:59.629 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 733 2024-09-16T03:40:59.629 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.2Ytmh9VuB7 2024-09-16T03:40:59.630 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:40:59.631 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:40:59.631 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:40:59.631 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 734 2024-09-16T03:40:59.631 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=734 2024-09-16T03:40:59.631 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:40:59.631 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:40:59.631 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.eYMd3eYDnr 2024-09-16T03:40:59.632 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 734 -o /tmp/tmp.eYMd3eYDnr 2024-09-16T03:41:00.082 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 734 2024-09-16T03:41:00.100 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.eYMd3eYDnr 2024-09-16T03:41:00.101 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 734' 2024-09-16T03:41:00.122 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.eYMd3eYDnr' 2024-09-16T03:41:00.123 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 734 2024-09-16T03:41:00.124 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.eYMd3eYDnr 2024-09-16T03:41:00.125 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:00.125 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:00.125 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:00.125 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 735 2024-09-16T03:41:00.125 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=735 2024-09-16T03:41:00.125 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:00.125 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:00.126 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.G2Q8Avu3lc 2024-09-16T03:41:00.127 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 735 -o /tmp/tmp.G2Q8Avu3lc 2024-09-16T03:41:00.522 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 735 2024-09-16T03:41:00.537 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.G2Q8Avu3lc 2024-09-16T03:41:01.062 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 735' 2024-09-16T03:41:01.063 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.G2Q8Avu3lc' 2024-09-16T03:41:01.063 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 735 2024-09-16T03:41:01.064 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.G2Q8Avu3lc 2024-09-16T03:41:01.064 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:01.065 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:01.065 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:01.065 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 736 2024-09-16T03:41:01.065 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=736 2024-09-16T03:41:01.065 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:01.065 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:01.065 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.7pBNIMnmSk 2024-09-16T03:41:01.065 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 736 -o /tmp/tmp.7pBNIMnmSk 2024-09-16T03:41:01.065 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 736 2024-09-16T03:41:01.065 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.7pBNIMnmSk 2024-09-16T03:41:01.065 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 736' 2024-09-16T03:41:01.065 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.7pBNIMnmSk' 2024-09-16T03:41:01.066 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 736 2024-09-16T03:41:01.067 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.7pBNIMnmSk 2024-09-16T03:41:01.067 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:01.067 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:01.067 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:01.067 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 737 2024-09-16T03:41:01.067 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=737 2024-09-16T03:41:01.067 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:01.067 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:01.067 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.buyr5chiJa 2024-09-16T03:41:01.067 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 737 -o /tmp/tmp.buyr5chiJa 2024-09-16T03:41:01.470 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 737 2024-09-16T03:41:01.489 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.buyr5chiJa 2024-09-16T03:41:01.489 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 737' 2024-09-16T03:41:01.509 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.buyr5chiJa' 2024-09-16T03:41:01.511 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 737 2024-09-16T03:41:01.511 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.buyr5chiJa 2024-09-16T03:41:01.512 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:01.512 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:01.513 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:01.513 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 738 2024-09-16T03:41:01.513 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=738 2024-09-16T03:41:01.513 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:01.513 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:01.513 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.KP1xmI6vqV 2024-09-16T03:41:01.513 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 738 -o /tmp/tmp.KP1xmI6vqV 2024-09-16T03:41:01.932 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 738 2024-09-16T03:41:01.948 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.KP1xmI6vqV 2024-09-16T03:41:01.948 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 738' 2024-09-16T03:41:01.965 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.KP1xmI6vqV' 2024-09-16T03:41:01.967 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 738 2024-09-16T03:41:01.967 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.KP1xmI6vqV 2024-09-16T03:41:01.969 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:01.969 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:01.969 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:01.969 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 739 2024-09-16T03:41:01.969 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=739 2024-09-16T03:41:01.969 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:01.969 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:01.970 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.bCiOh9dXnC 2024-09-16T03:41:01.970 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 739 -o /tmp/tmp.bCiOh9dXnC 2024-09-16T03:41:02.407 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 739 2024-09-16T03:41:02.424 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.bCiOh9dXnC 2024-09-16T03:41:02.424 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 739' 2024-09-16T03:41:02.443 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.bCiOh9dXnC' 2024-09-16T03:41:02.445 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 739 2024-09-16T03:41:02.445 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.bCiOh9dXnC 2024-09-16T03:41:02.447 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:02.447 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:02.447 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:02.447 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 740 2024-09-16T03:41:02.447 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=740 2024-09-16T03:41:02.447 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:02.447 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:02.448 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.lLj03h6Bpb 2024-09-16T03:41:02.448 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 740 -o /tmp/tmp.lLj03h6Bpb 2024-09-16T03:41:02.884 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 740 2024-09-16T03:41:02.902 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.lLj03h6Bpb 2024-09-16T03:41:02.902 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 740' 2024-09-16T03:41:02.921 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.lLj03h6Bpb' 2024-09-16T03:41:02.923 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 740 2024-09-16T03:41:02.923 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.lLj03h6Bpb 2024-09-16T03:41:02.924 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:02.924 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:02.924 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:02.924 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 741 2024-09-16T03:41:02.924 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=741 2024-09-16T03:41:02.924 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:02.925 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:02.925 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.3LdjjHGWt1 2024-09-16T03:41:02.925 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 741 -o /tmp/tmp.3LdjjHGWt1 2024-09-16T03:41:03.321 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 741 2024-09-16T03:41:03.337 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 741' 2024-09-16T03:41:03.337 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.3LdjjHGWt1 2024-09-16T03:41:03.357 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.3LdjjHGWt1' 2024-09-16T03:41:03.359 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 741 2024-09-16T03:41:03.359 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.3LdjjHGWt1 2024-09-16T03:41:03.360 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:03.360 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:03.361 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:03.361 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 742 2024-09-16T03:41:03.361 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=742 2024-09-16T03:41:03.361 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:03.361 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:03.361 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.G0nUPPiqsc 2024-09-16T03:41:03.361 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 742 -o /tmp/tmp.G0nUPPiqsc 2024-09-16T03:41:03.794 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 742 2024-09-16T03:41:03.810 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.G0nUPPiqsc 2024-09-16T03:41:03.810 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 742' 2024-09-16T03:41:03.830 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.G0nUPPiqsc' 2024-09-16T03:41:03.832 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 742 2024-09-16T03:41:03.832 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.G0nUPPiqsc 2024-09-16T03:41:03.833 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:03.833 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:03.833 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:03.833 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 743 2024-09-16T03:41:03.833 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=743 2024-09-16T03:41:03.833 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:03.833 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:03.834 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.xB3D7OvBSD 2024-09-16T03:41:03.834 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 743 -o /tmp/tmp.xB3D7OvBSD 2024-09-16T03:41:04.287 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 743 2024-09-16T03:41:04.303 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.xB3D7OvBSD 2024-09-16T03:41:04.304 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 743' 2024-09-16T03:41:04.323 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.xB3D7OvBSD' 2024-09-16T03:41:04.324 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 743 2024-09-16T03:41:04.325 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.xB3D7OvBSD 2024-09-16T03:41:04.326 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:04.326 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:04.326 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:04.326 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 744 2024-09-16T03:41:04.326 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=744 2024-09-16T03:41:04.326 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:04.326 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:04.327 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.bywDrVAz7Q 2024-09-16T03:41:04.327 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 744 -o /tmp/tmp.bywDrVAz7Q 2024-09-16T03:41:04.814 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 744 2024-09-16T03:41:04.833 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.bywDrVAz7Q 2024-09-16T03:41:04.833 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 744' 2024-09-16T03:41:04.853 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.bywDrVAz7Q' 2024-09-16T03:41:04.854 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 744 2024-09-16T03:41:04.855 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.bywDrVAz7Q 2024-09-16T03:41:04.856 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:04.856 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:04.856 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:04.856 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 745 2024-09-16T03:41:04.856 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=745 2024-09-16T03:41:04.856 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:04.857 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:04.857 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.YFkT3LZ5bf 2024-09-16T03:41:04.857 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 745 -o /tmp/tmp.YFkT3LZ5bf 2024-09-16T03:41:05.291 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 745 2024-09-16T03:41:05.309 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.YFkT3LZ5bf 2024-09-16T03:41:05.309 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 745' 2024-09-16T03:41:05.330 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.YFkT3LZ5bf' 2024-09-16T03:41:05.331 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 745 2024-09-16T03:41:05.331 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.YFkT3LZ5bf 2024-09-16T03:41:05.333 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:05.333 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:05.333 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:05.333 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 746 2024-09-16T03:41:05.333 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=746 2024-09-16T03:41:05.333 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:05.333 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:05.334 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.bRYzmdEjay 2024-09-16T03:41:05.334 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 746 -o /tmp/tmp.bRYzmdEjay 2024-09-16T03:41:05.762 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 746 2024-09-16T03:41:05.777 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.bRYzmdEjay 2024-09-16T03:41:05.778 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 746' 2024-09-16T03:41:05.797 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.bRYzmdEjay' 2024-09-16T03:41:05.799 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 746 2024-09-16T03:41:05.799 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.bRYzmdEjay 2024-09-16T03:41:05.800 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:05.800 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:05.800 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:05.800 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 747 2024-09-16T03:41:05.801 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=747 2024-09-16T03:41:05.801 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:05.801 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:05.801 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.6aad17hcYG 2024-09-16T03:41:05.801 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 747 -o /tmp/tmp.6aad17hcYG 2024-09-16T03:41:06.190 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 747 2024-09-16T03:41:06.206 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.6aad17hcYG 2024-09-16T03:41:06.206 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 747' 2024-09-16T03:41:06.226 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.6aad17hcYG' 2024-09-16T03:41:06.228 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 747 2024-09-16T03:41:06.228 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.6aad17hcYG 2024-09-16T03:41:06.230 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:06.230 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:06.230 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:06.230 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 748 2024-09-16T03:41:06.230 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=748 2024-09-16T03:41:06.230 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:06.230 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:06.231 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.AEEWkvaQzt 2024-09-16T03:41:06.231 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 748 -o /tmp/tmp.AEEWkvaQzt 2024-09-16T03:41:06.662 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 748 2024-09-16T03:41:06.679 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.AEEWkvaQzt 2024-09-16T03:41:06.679 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 748' 2024-09-16T03:41:06.698 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.AEEWkvaQzt' 2024-09-16T03:41:06.700 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 748 2024-09-16T03:41:06.700 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.AEEWkvaQzt 2024-09-16T03:41:06.702 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:06.702 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:06.702 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:06.702 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 749 2024-09-16T03:41:06.702 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=749 2024-09-16T03:41:06.702 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:06.702 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:06.703 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.xRKQoZTinL 2024-09-16T03:41:06.703 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 749 -o /tmp/tmp.xRKQoZTinL 2024-09-16T03:41:07.181 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 749 2024-09-16T03:41:07.198 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.xRKQoZTinL 2024-09-16T03:41:07.198 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 749' 2024-09-16T03:41:07.218 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.xRKQoZTinL' 2024-09-16T03:41:07.219 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 749 2024-09-16T03:41:07.219 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.xRKQoZTinL 2024-09-16T03:41:07.221 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:07.221 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:07.221 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:07.221 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 750 2024-09-16T03:41:07.221 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=750 2024-09-16T03:41:07.221 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:07.221 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:07.222 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.Cw6Mme0E0p 2024-09-16T03:41:07.222 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 750 -o /tmp/tmp.Cw6Mme0E0p 2024-09-16T03:41:07.658 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 750 2024-09-16T03:41:07.674 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.Cw6Mme0E0p 2024-09-16T03:41:07.675 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 750' 2024-09-16T03:41:07.694 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.Cw6Mme0E0p' 2024-09-16T03:41:07.696 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 750 2024-09-16T03:41:07.696 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.Cw6Mme0E0p 2024-09-16T03:41:07.697 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:07.697 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:07.697 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:07.697 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 751 2024-09-16T03:41:07.697 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=751 2024-09-16T03:41:07.697 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:07.698 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:07.698 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.3cfwu5u8FZ 2024-09-16T03:41:07.698 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 751 -o /tmp/tmp.3cfwu5u8FZ 2024-09-16T03:41:08.209 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 751 2024-09-16T03:41:08.225 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.3cfwu5u8FZ 2024-09-16T03:41:08.225 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 751' 2024-09-16T03:41:08.245 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.3cfwu5u8FZ' 2024-09-16T03:41:08.246 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 751 2024-09-16T03:41:08.247 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.3cfwu5u8FZ 2024-09-16T03:41:08.248 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:08.248 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:08.248 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:08.248 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 752 2024-09-16T03:41:08.248 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=752 2024-09-16T03:41:08.248 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:08.248 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:08.250 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.lwVF4Eyi01 2024-09-16T03:41:08.250 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 752 -o /tmp/tmp.lwVF4Eyi01 2024-09-16T03:41:08.707 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 752 2024-09-16T03:41:08.723 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.lwVF4Eyi01 2024-09-16T03:41:08.724 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 752' 2024-09-16T03:41:08.743 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.lwVF4Eyi01' 2024-09-16T03:41:08.745 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 752 2024-09-16T03:41:08.745 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.lwVF4Eyi01 2024-09-16T03:41:08.746 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:08.746 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:08.746 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:08.746 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 753 2024-09-16T03:41:08.746 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=753 2024-09-16T03:41:08.746 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:08.747 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:08.747 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.INpXoTNs88 2024-09-16T03:41:08.747 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 753 -o /tmp/tmp.INpXoTNs88 2024-09-16T03:41:09.154 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 753 2024-09-16T03:41:09.170 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.INpXoTNs88 2024-09-16T03:41:09.170 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 753' 2024-09-16T03:41:09.189 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.INpXoTNs88' 2024-09-16T03:41:09.191 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 753 2024-09-16T03:41:09.191 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.INpXoTNs88 2024-09-16T03:41:09.192 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:09.192 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:09.193 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:09.193 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 754 2024-09-16T03:41:09.193 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=754 2024-09-16T03:41:09.193 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:09.193 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:09.193 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.oMYunjglXP 2024-09-16T03:41:09.193 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 754 -o /tmp/tmp.oMYunjglXP 2024-09-16T03:41:09.622 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 754 2024-09-16T03:41:09.640 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.oMYunjglXP 2024-09-16T03:41:09.640 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 754' 2024-09-16T03:41:09.661 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.oMYunjglXP' 2024-09-16T03:41:09.662 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 754 2024-09-16T03:41:09.662 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.oMYunjglXP 2024-09-16T03:41:09.664 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:09.664 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:09.664 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:09.665 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 755 2024-09-16T03:41:09.665 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=755 2024-09-16T03:41:09.665 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:09.665 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:09.665 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.Kx6qaInl8S 2024-09-16T03:41:09.665 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 755 -o /tmp/tmp.Kx6qaInl8S 2024-09-16T03:41:10.090 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 755 2024-09-16T03:41:10.108 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.Kx6qaInl8S 2024-09-16T03:41:10.108 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 755' 2024-09-16T03:41:10.128 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.Kx6qaInl8S' 2024-09-16T03:41:10.130 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 755 2024-09-16T03:41:10.130 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.Kx6qaInl8S 2024-09-16T03:41:10.131 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:10.131 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:10.131 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:10.131 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 756 2024-09-16T03:41:10.131 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=756 2024-09-16T03:41:10.132 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:10.132 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:10.132 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.jejUSHDEnP 2024-09-16T03:41:10.132 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 756 -o /tmp/tmp.jejUSHDEnP 2024-09-16T03:41:10.583 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 756 2024-09-16T03:41:10.599 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 756' 2024-09-16T03:41:10.599 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.jejUSHDEnP 2024-09-16T03:41:10.619 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.jejUSHDEnP' 2024-09-16T03:41:10.621 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 756 2024-09-16T03:41:10.621 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.jejUSHDEnP 2024-09-16T03:41:10.622 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:10.622 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:10.622 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:10.623 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 757 2024-09-16T03:41:10.623 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=757 2024-09-16T03:41:10.623 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:10.623 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:10.623 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.8uO3OYokuc 2024-09-16T03:41:10.623 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 757 -o /tmp/tmp.8uO3OYokuc 2024-09-16T03:41:11.034 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 757 2024-09-16T03:41:11.051 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.8uO3OYokuc 2024-09-16T03:41:11.051 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 757' 2024-09-16T03:41:11.070 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.8uO3OYokuc' 2024-09-16T03:41:11.072 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 757 2024-09-16T03:41:11.072 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.8uO3OYokuc 2024-09-16T03:41:11.073 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:11.073 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:11.073 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:11.073 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 758 2024-09-16T03:41:11.073 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=758 2024-09-16T03:41:11.074 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:11.074 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:11.074 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.wfhsKEvK6C 2024-09-16T03:41:11.074 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 758 -o /tmp/tmp.wfhsKEvK6C 2024-09-16T03:41:11.510 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 758 2024-09-16T03:41:11.527 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.wfhsKEvK6C 2024-09-16T03:41:11.527 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 758' 2024-09-16T03:41:11.547 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.wfhsKEvK6C' 2024-09-16T03:41:11.548 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 758 2024-09-16T03:41:11.549 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.wfhsKEvK6C 2024-09-16T03:41:11.550 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:11.550 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:11.550 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:11.550 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 759 2024-09-16T03:41:11.550 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=759 2024-09-16T03:41:11.550 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:11.550 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:11.551 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.B0aDpJXG7e 2024-09-16T03:41:11.551 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 759 -o /tmp/tmp.B0aDpJXG7e 2024-09-16T03:41:11.995 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 759 2024-09-16T03:41:12.012 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.B0aDpJXG7e 2024-09-16T03:41:12.012 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 759' 2024-09-16T03:41:12.031 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.B0aDpJXG7e' 2024-09-16T03:41:12.033 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 759 2024-09-16T03:41:12.033 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.B0aDpJXG7e 2024-09-16T03:41:12.034 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:12.034 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:12.034 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:12.034 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 760 2024-09-16T03:41:12.034 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=760 2024-09-16T03:41:12.034 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:12.034 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:12.035 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.btXs7L9e2X 2024-09-16T03:41:12.035 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 760 -o /tmp/tmp.btXs7L9e2X 2024-09-16T03:41:12.497 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 760 2024-09-16T03:41:12.514 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.btXs7L9e2X 2024-09-16T03:41:12.514 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 760' 2024-09-16T03:41:12.533 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.btXs7L9e2X' 2024-09-16T03:41:12.535 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 760 2024-09-16T03:41:12.535 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.btXs7L9e2X 2024-09-16T03:41:12.536 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:12.536 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:12.537 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:12.537 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 761 2024-09-16T03:41:12.537 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=761 2024-09-16T03:41:12.537 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:12.537 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:12.538 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.thwQ55bZX6 2024-09-16T03:41:12.538 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 761 -o /tmp/tmp.thwQ55bZX6 2024-09-16T03:41:12.941 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 761 2024-09-16T03:41:12.958 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.thwQ55bZX6 2024-09-16T03:41:12.958 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 761' 2024-09-16T03:41:12.978 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.thwQ55bZX6' 2024-09-16T03:41:12.979 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 761 2024-09-16T03:41:12.980 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.thwQ55bZX6 2024-09-16T03:41:12.981 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:12.981 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:12.981 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:12.981 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 762 2024-09-16T03:41:12.981 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=762 2024-09-16T03:41:12.981 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:12.981 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:12.982 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.fsu6pIw6u2 2024-09-16T03:41:12.982 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 762 -o /tmp/tmp.fsu6pIw6u2 2024-09-16T03:41:13.401 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 762 2024-09-16T03:41:13.416 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.fsu6pIw6u2 2024-09-16T03:41:13.417 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 762' 2024-09-16T03:41:13.436 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.fsu6pIw6u2' 2024-09-16T03:41:13.437 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 762 2024-09-16T03:41:13.438 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.fsu6pIw6u2 2024-09-16T03:41:13.438 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:13.439 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:13.439 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:13.439 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 763 2024-09-16T03:41:13.439 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=763 2024-09-16T03:41:13.439 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:13.439 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:13.439 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.q5LRowrCmF 2024-09-16T03:41:13.439 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 763 -o /tmp/tmp.q5LRowrCmF 2024-09-16T03:41:13.893 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 763 2024-09-16T03:41:13.912 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.q5LRowrCmF 2024-09-16T03:41:13.912 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 763' 2024-09-16T03:41:13.929 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.q5LRowrCmF' 2024-09-16T03:41:13.931 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 763 2024-09-16T03:41:13.931 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.q5LRowrCmF 2024-09-16T03:41:13.932 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:13.932 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:13.932 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:13.933 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 764 2024-09-16T03:41:13.933 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=764 2024-09-16T03:41:13.933 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:13.933 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:13.933 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.xp62y5gZpL 2024-09-16T03:41:13.933 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 764 -o /tmp/tmp.xp62y5gZpL 2024-09-16T03:41:14.339 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 764 2024-09-16T03:41:14.355 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.xp62y5gZpL 2024-09-16T03:41:14.355 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 764' 2024-09-16T03:41:14.374 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.xp62y5gZpL' 2024-09-16T03:41:14.375 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 764 2024-09-16T03:41:14.376 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.xp62y5gZpL 2024-09-16T03:41:14.377 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:14.377 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:14.377 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:14.377 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 765 2024-09-16T03:41:14.377 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=765 2024-09-16T03:41:14.377 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:14.377 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:14.378 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.LoJhBQsTUw 2024-09-16T03:41:14.378 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 765 -o /tmp/tmp.LoJhBQsTUw 2024-09-16T03:41:14.854 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 765 2024-09-16T03:41:14.871 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.LoJhBQsTUw 2024-09-16T03:41:14.871 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 765' 2024-09-16T03:41:14.891 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.LoJhBQsTUw' 2024-09-16T03:41:14.893 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 765 2024-09-16T03:41:14.893 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.LoJhBQsTUw 2024-09-16T03:41:14.894 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:14.895 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:14.895 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:14.895 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 766 2024-09-16T03:41:14.895 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=766 2024-09-16T03:41:14.895 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:14.895 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:14.895 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.T6pAxfeZhR 2024-09-16T03:41:14.896 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 766 -o /tmp/tmp.T6pAxfeZhR 2024-09-16T03:41:15.325 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 766 2024-09-16T03:41:15.341 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.T6pAxfeZhR 2024-09-16T03:41:15.341 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 766' 2024-09-16T03:41:15.361 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.T6pAxfeZhR' 2024-09-16T03:41:15.363 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 766 2024-09-16T03:41:15.363 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.T6pAxfeZhR 2024-09-16T03:41:15.364 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:15.364 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:15.364 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:15.364 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 767 2024-09-16T03:41:15.364 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=767 2024-09-16T03:41:15.364 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:15.364 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:15.365 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.561o1CLiXR 2024-09-16T03:41:15.365 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 767 -o /tmp/tmp.561o1CLiXR 2024-09-16T03:41:15.818 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 767 2024-09-16T03:41:15.836 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.561o1CLiXR 2024-09-16T03:41:15.836 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 767' 2024-09-16T03:41:15.857 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.561o1CLiXR' 2024-09-16T03:41:15.859 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 767 2024-09-16T03:41:15.859 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.561o1CLiXR 2024-09-16T03:41:15.860 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:15.860 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:15.861 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:15.861 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 768 2024-09-16T03:41:15.861 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=768 2024-09-16T03:41:15.861 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:15.861 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:15.861 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.cIXuyEkbVn 2024-09-16T03:41:15.861 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 768 -o /tmp/tmp.cIXuyEkbVn 2024-09-16T03:41:16.256 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 768 2024-09-16T03:41:16.272 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.cIXuyEkbVn 2024-09-16T03:41:16.272 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 768' 2024-09-16T03:41:16.291 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.cIXuyEkbVn' 2024-09-16T03:41:16.293 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 768 2024-09-16T03:41:16.293 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.cIXuyEkbVn 2024-09-16T03:41:16.294 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:16.294 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:16.294 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:16.295 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 769 2024-09-16T03:41:16.295 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=769 2024-09-16T03:41:16.295 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:16.295 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:16.295 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.1hhyxKRNHM 2024-09-16T03:41:16.295 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 769 -o /tmp/tmp.1hhyxKRNHM 2024-09-16T03:41:16.812 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 769 2024-09-16T03:41:16.829 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.1hhyxKRNHM 2024-09-16T03:41:16.830 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 769' 2024-09-16T03:41:16.849 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.1hhyxKRNHM' 2024-09-16T03:41:16.850 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 769 2024-09-16T03:41:16.851 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.1hhyxKRNHM 2024-09-16T03:41:16.852 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:16.852 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:16.852 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:16.852 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 770 2024-09-16T03:41:16.852 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=770 2024-09-16T03:41:16.852 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:16.853 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:16.853 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.ENRK3zN6A5 2024-09-16T03:41:16.853 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 770 -o /tmp/tmp.ENRK3zN6A5 2024-09-16T03:41:17.265 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 770 2024-09-16T03:41:17.281 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.ENRK3zN6A5 2024-09-16T03:41:17.281 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 770' 2024-09-16T03:41:17.300 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.ENRK3zN6A5' 2024-09-16T03:41:17.302 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 770 2024-09-16T03:41:17.302 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.ENRK3zN6A5 2024-09-16T03:41:17.303 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:17.303 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:17.303 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:17.303 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 771 2024-09-16T03:41:17.303 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=771 2024-09-16T03:41:17.304 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:17.304 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:17.304 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.1BkYIcZjdZ 2024-09-16T03:41:17.304 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 771 -o /tmp/tmp.1BkYIcZjdZ 2024-09-16T03:41:17.707 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 771 2024-09-16T03:41:17.725 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 771' 2024-09-16T03:41:17.725 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.1BkYIcZjdZ 2024-09-16T03:41:17.746 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.1BkYIcZjdZ' 2024-09-16T03:41:17.747 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 771 2024-09-16T03:41:17.748 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.1BkYIcZjdZ 2024-09-16T03:41:17.749 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:17.749 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:17.749 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:17.749 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 772 2024-09-16T03:41:17.749 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=772 2024-09-16T03:41:17.749 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:17.749 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:17.750 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.GvsBucdfvt 2024-09-16T03:41:17.750 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 772 -o /tmp/tmp.GvsBucdfvt 2024-09-16T03:41:18.193 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 772 2024-09-16T03:41:18.210 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.GvsBucdfvt 2024-09-16T03:41:18.210 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 772' 2024-09-16T03:41:18.229 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.GvsBucdfvt' 2024-09-16T03:41:18.231 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 772 2024-09-16T03:41:18.231 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.GvsBucdfvt 2024-09-16T03:41:18.232 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:18.232 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:18.232 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:18.233 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 773 2024-09-16T03:41:18.233 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=773 2024-09-16T03:41:18.233 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:18.233 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:18.233 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.2gH1yMNP7a 2024-09-16T03:41:18.233 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 773 -o /tmp/tmp.2gH1yMNP7a 2024-09-16T03:41:18.630 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 773 2024-09-16T03:41:18.646 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.2gH1yMNP7a 2024-09-16T03:41:18.646 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 773' 2024-09-16T03:41:18.666 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.2gH1yMNP7a' 2024-09-16T03:41:18.667 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 773 2024-09-16T03:41:18.667 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.2gH1yMNP7a 2024-09-16T03:41:18.668 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:18.668 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:18.669 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:18.669 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 774 2024-09-16T03:41:18.669 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=774 2024-09-16T03:41:18.669 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:18.669 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:18.669 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.NvRNGPlYfg 2024-09-16T03:41:18.669 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 774 -o /tmp/tmp.NvRNGPlYfg 2024-09-16T03:41:19.113 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 774 2024-09-16T03:41:19.129 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.NvRNGPlYfg 2024-09-16T03:41:19.129 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 774' 2024-09-16T03:41:19.149 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.NvRNGPlYfg' 2024-09-16T03:41:19.151 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 774 2024-09-16T03:41:19.151 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.NvRNGPlYfg 2024-09-16T03:41:19.152 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:19.152 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:19.152 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:19.152 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 775 2024-09-16T03:41:19.152 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=775 2024-09-16T03:41:19.152 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:19.153 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:19.153 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.W9b4y9SHzN 2024-09-16T03:41:19.153 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 775 -o /tmp/tmp.W9b4y9SHzN 2024-09-16T03:41:19.590 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 775 2024-09-16T03:41:19.607 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.W9b4y9SHzN 2024-09-16T03:41:19.607 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 775' 2024-09-16T03:41:19.626 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.W9b4y9SHzN' 2024-09-16T03:41:19.628 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 775 2024-09-16T03:41:19.628 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.W9b4y9SHzN 2024-09-16T03:41:19.629 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:19.629 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:19.630 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:19.630 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 776 2024-09-16T03:41:19.630 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=776 2024-09-16T03:41:19.630 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:19.630 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:19.630 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.5ll9TRL2wk 2024-09-16T03:41:19.630 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 776 -o /tmp/tmp.5ll9TRL2wk 2024-09-16T03:41:20.099 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 776 2024-09-16T03:41:20.120 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.5ll9TRL2wk 2024-09-16T03:41:20.120 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 776' 2024-09-16T03:41:20.138 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.5ll9TRL2wk' 2024-09-16T03:41:20.139 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 776 2024-09-16T03:41:20.139 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.5ll9TRL2wk 2024-09-16T03:41:20.140 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:20.141 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:20.141 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:20.141 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 777 2024-09-16T03:41:20.141 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=777 2024-09-16T03:41:20.141 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:20.141 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:20.141 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.I52rkosOt0 2024-09-16T03:41:20.142 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 777 -o /tmp/tmp.I52rkosOt0 2024-09-16T03:41:20.584 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 777 2024-09-16T03:41:20.601 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.I52rkosOt0 2024-09-16T03:41:20.601 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 777' 2024-09-16T03:41:20.621 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.I52rkosOt0' 2024-09-16T03:41:20.623 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 777 2024-09-16T03:41:20.623 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.I52rkosOt0 2024-09-16T03:41:20.624 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:20.624 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:20.624 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:20.625 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 778 2024-09-16T03:41:20.625 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=778 2024-09-16T03:41:20.625 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:20.625 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:20.625 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.Zt5B4WaTPV 2024-09-16T03:41:20.625 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 778 -o /tmp/tmp.Zt5B4WaTPV 2024-09-16T03:41:21.044 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 778 2024-09-16T03:41:21.061 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.Zt5B4WaTPV 2024-09-16T03:41:21.062 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 778' 2024-09-16T03:41:21.081 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.Zt5B4WaTPV' 2024-09-16T03:41:21.082 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 778 2024-09-16T03:41:21.083 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.Zt5B4WaTPV 2024-09-16T03:41:21.084 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:21.084 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:21.084 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:21.084 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 779 2024-09-16T03:41:21.084 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=779 2024-09-16T03:41:21.084 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:21.084 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:21.085 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.NkrpmiFZNm 2024-09-16T03:41:21.085 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 779 -o /tmp/tmp.NkrpmiFZNm 2024-09-16T03:41:21.512 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 779 2024-09-16T03:41:21.528 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.NkrpmiFZNm 2024-09-16T03:41:21.528 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 779' 2024-09-16T03:41:21.550 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.NkrpmiFZNm' 2024-09-16T03:41:21.552 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 779 2024-09-16T03:41:21.552 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.NkrpmiFZNm 2024-09-16T03:41:21.553 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:21.553 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:21.553 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:21.554 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 780 2024-09-16T03:41:21.554 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=780 2024-09-16T03:41:21.554 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:21.554 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:21.554 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.icpT0bK07h 2024-09-16T03:41:21.554 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 780 -o /tmp/tmp.icpT0bK07h 2024-09-16T03:41:22.014 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 780 2024-09-16T03:41:22.032 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.icpT0bK07h 2024-09-16T03:41:22.032 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 780' 2024-09-16T03:41:22.052 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.icpT0bK07h' 2024-09-16T03:41:22.053 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 780 2024-09-16T03:41:22.054 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.icpT0bK07h 2024-09-16T03:41:22.055 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:22.055 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:22.055 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:22.055 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 781 2024-09-16T03:41:22.055 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=781 2024-09-16T03:41:22.055 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:22.056 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:22.056 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.9CiQ8NARH9 2024-09-16T03:41:22.056 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 781 -o /tmp/tmp.9CiQ8NARH9 2024-09-16T03:41:22.443 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 781 2024-09-16T03:41:22.459 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.9CiQ8NARH9 2024-09-16T03:41:22.459 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 781' 2024-09-16T03:41:22.479 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.9CiQ8NARH9' 2024-09-16T03:41:22.480 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 781 2024-09-16T03:41:22.481 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.9CiQ8NARH9 2024-09-16T03:41:22.482 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:22.482 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:22.482 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:22.482 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 782 2024-09-16T03:41:22.482 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=782 2024-09-16T03:41:22.482 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:22.482 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:22.483 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.p6Ww7mgblZ 2024-09-16T03:41:22.483 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 782 -o /tmp/tmp.p6Ww7mgblZ 2024-09-16T03:41:22.955 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 782 2024-09-16T03:41:22.973 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.p6Ww7mgblZ 2024-09-16T03:41:22.973 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 782' 2024-09-16T03:41:22.994 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.p6Ww7mgblZ' 2024-09-16T03:41:22.996 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 782 2024-09-16T03:41:22.996 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.p6Ww7mgblZ 2024-09-16T03:41:22.997 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:22.998 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:22.998 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:22.998 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 783 2024-09-16T03:41:22.998 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=783 2024-09-16T03:41:22.998 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:22.998 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:22.998 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.Q2pbIoet98 2024-09-16T03:41:22.999 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 783 -o /tmp/tmp.Q2pbIoet98 2024-09-16T03:41:23.477 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 783 2024-09-16T03:41:23.497 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 783' 2024-09-16T03:41:23.498 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.Q2pbIoet98 2024-09-16T03:41:23.517 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.Q2pbIoet98' 2024-09-16T03:41:23.519 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 783 2024-09-16T03:41:23.519 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.Q2pbIoet98 2024-09-16T03:41:23.521 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:23.521 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:23.521 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:23.521 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 784 2024-09-16T03:41:23.521 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=784 2024-09-16T03:41:23.521 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:23.521 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:23.522 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.JrrGdFTXgU 2024-09-16T03:41:23.522 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 784 -o /tmp/tmp.JrrGdFTXgU 2024-09-16T03:41:23.962 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 784 2024-09-16T03:41:23.978 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.JrrGdFTXgU 2024-09-16T03:41:23.978 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 784' 2024-09-16T03:41:23.999 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.JrrGdFTXgU' 2024-09-16T03:41:24.001 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 784 2024-09-16T03:41:24.001 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.JrrGdFTXgU 2024-09-16T03:41:24.002 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:24.002 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:24.003 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:24.003 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 785 2024-09-16T03:41:24.003 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=785 2024-09-16T03:41:24.003 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:24.003 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:24.003 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.pSPhJlNgko 2024-09-16T03:41:24.004 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 785 -o /tmp/tmp.pSPhJlNgko 2024-09-16T03:41:24.447 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 785 2024-09-16T03:41:24.463 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.pSPhJlNgko 2024-09-16T03:41:24.463 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 785' 2024-09-16T03:41:24.482 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.pSPhJlNgko' 2024-09-16T03:41:24.483 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 785 2024-09-16T03:41:24.484 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.pSPhJlNgko 2024-09-16T03:41:24.485 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:24.485 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:24.485 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:24.485 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 786 2024-09-16T03:41:24.485 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=786 2024-09-16T03:41:24.485 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:24.485 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:24.486 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.57UUVxJR22 2024-09-16T03:41:24.486 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 786 -o /tmp/tmp.57UUVxJR22 2024-09-16T03:41:24.910 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 786 2024-09-16T03:41:24.927 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.57UUVxJR22 2024-09-16T03:41:24.927 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 786' 2024-09-16T03:41:24.946 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.57UUVxJR22' 2024-09-16T03:41:24.948 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 786 2024-09-16T03:41:24.948 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.57UUVxJR22 2024-09-16T03:41:24.950 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:24.950 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:24.950 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:24.950 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 787 2024-09-16T03:41:24.950 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=787 2024-09-16T03:41:24.950 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:24.951 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:24.951 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.um1uWiSHHV 2024-09-16T03:41:24.951 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 787 -o /tmp/tmp.um1uWiSHHV 2024-09-16T03:41:25.408 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 787 2024-09-16T03:41:25.426 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.um1uWiSHHV 2024-09-16T03:41:25.426 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 787' 2024-09-16T03:41:25.447 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.um1uWiSHHV' 2024-09-16T03:41:25.448 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 787 2024-09-16T03:41:25.449 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.um1uWiSHHV 2024-09-16T03:41:25.453 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:25.453 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:25.454 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:25.454 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 788 2024-09-16T03:41:25.454 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=788 2024-09-16T03:41:25.454 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:25.454 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:25.454 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.mdCNyYbiHA 2024-09-16T03:41:25.454 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 788 -o /tmp/tmp.mdCNyYbiHA 2024-09-16T03:41:25.881 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 788 2024-09-16T03:41:25.898 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.mdCNyYbiHA 2024-09-16T03:41:25.898 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 788' 2024-09-16T03:41:25.917 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.mdCNyYbiHA' 2024-09-16T03:41:25.919 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 788 2024-09-16T03:41:25.919 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.mdCNyYbiHA 2024-09-16T03:41:25.921 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:25.921 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:25.921 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:25.921 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 789 2024-09-16T03:41:25.921 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=789 2024-09-16T03:41:25.921 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:25.921 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:25.922 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.d9b9TVwNHc 2024-09-16T03:41:25.922 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 789 -o /tmp/tmp.d9b9TVwNHc 2024-09-16T03:41:26.369 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 789 2024-09-16T03:41:26.385 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.d9b9TVwNHc 2024-09-16T03:41:26.385 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 789' 2024-09-16T03:41:26.405 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.d9b9TVwNHc' 2024-09-16T03:41:26.406 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 789 2024-09-16T03:41:26.406 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.d9b9TVwNHc 2024-09-16T03:41:26.408 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:26.408 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:26.408 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:26.408 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 790 2024-09-16T03:41:26.408 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=790 2024-09-16T03:41:26.408 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:26.408 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:26.408 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.MD1QfYGWjX 2024-09-16T03:41:26.409 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 790 -o /tmp/tmp.MD1QfYGWjX 2024-09-16T03:41:26.837 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 790 2024-09-16T03:41:26.853 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.MD1QfYGWjX 2024-09-16T03:41:26.853 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 790' 2024-09-16T03:41:26.874 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.MD1QfYGWjX' 2024-09-16T03:41:26.876 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 790 2024-09-16T03:41:26.876 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.MD1QfYGWjX 2024-09-16T03:41:26.877 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:26.877 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:26.878 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:26.878 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 791 2024-09-16T03:41:26.878 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=791 2024-09-16T03:41:26.878 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:26.878 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:26.878 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.ObiiIcubba 2024-09-16T03:41:26.878 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 791 -o /tmp/tmp.ObiiIcubba 2024-09-16T03:41:27.339 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 791 2024-09-16T03:41:27.357 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.ObiiIcubba 2024-09-16T03:41:27.357 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 791' 2024-09-16T03:41:27.377 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.ObiiIcubba' 2024-09-16T03:41:27.379 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 791 2024-09-16T03:41:27.379 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.ObiiIcubba 2024-09-16T03:41:27.380 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:27.381 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:27.381 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:27.381 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 792 2024-09-16T03:41:27.381 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=792 2024-09-16T03:41:27.381 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:27.381 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:27.381 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.mF701wpPKB 2024-09-16T03:41:27.381 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 792 -o /tmp/tmp.mF701wpPKB 2024-09-16T03:41:27.776 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 792 2024-09-16T03:41:27.792 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.mF701wpPKB 2024-09-16T03:41:27.792 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 792' 2024-09-16T03:41:27.813 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.mF701wpPKB' 2024-09-16T03:41:27.815 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 792 2024-09-16T03:41:27.815 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.mF701wpPKB 2024-09-16T03:41:27.816 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:27.816 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:27.816 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:27.817 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 793 2024-09-16T03:41:27.817 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=793 2024-09-16T03:41:27.817 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:27.817 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:27.817 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.NhjsuuTQ9Q 2024-09-16T03:41:27.817 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 793 -o /tmp/tmp.NhjsuuTQ9Q 2024-09-16T03:41:28.196 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 793 2024-09-16T03:41:28.212 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.NhjsuuTQ9Q 2024-09-16T03:41:28.212 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 793' 2024-09-16T03:41:28.227 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.NhjsuuTQ9Q' 2024-09-16T03:41:28.228 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 793 2024-09-16T03:41:28.228 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.NhjsuuTQ9Q 2024-09-16T03:41:28.230 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:28.230 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:28.231 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:28.231 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 794 2024-09-16T03:41:28.231 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=794 2024-09-16T03:41:28.231 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:28.231 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:28.232 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.kEgKW8eGdl 2024-09-16T03:41:28.232 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 794 -o /tmp/tmp.kEgKW8eGdl 2024-09-16T03:41:28.715 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 794 2024-09-16T03:41:28.732 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.kEgKW8eGdl 2024-09-16T03:41:28.732 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 794' 2024-09-16T03:41:28.755 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.kEgKW8eGdl' 2024-09-16T03:41:28.756 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 794 2024-09-16T03:41:28.756 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.kEgKW8eGdl 2024-09-16T03:41:28.758 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:28.758 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:28.758 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:28.758 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 795 2024-09-16T03:41:28.758 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=795 2024-09-16T03:41:28.758 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:28.758 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:28.759 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.JomyzENJ1D 2024-09-16T03:41:28.759 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 795 -o /tmp/tmp.JomyzENJ1D 2024-09-16T03:41:29.170 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 795 2024-09-16T03:41:29.186 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.JomyzENJ1D 2024-09-16T03:41:29.187 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 795' 2024-09-16T03:41:29.208 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.JomyzENJ1D' 2024-09-16T03:41:29.209 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 795 2024-09-16T03:41:29.210 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.JomyzENJ1D 2024-09-16T03:41:29.211 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:29.211 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:29.211 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:29.211 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 796 2024-09-16T03:41:29.211 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=796 2024-09-16T03:41:29.211 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:29.212 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:29.212 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.RMeg7V8LTx 2024-09-16T03:41:29.212 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 796 -o /tmp/tmp.RMeg7V8LTx 2024-09-16T03:41:29.616 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 796 2024-09-16T03:41:29.632 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.RMeg7V8LTx 2024-09-16T03:41:29.632 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 796' 2024-09-16T03:41:29.651 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.RMeg7V8LTx' 2024-09-16T03:41:29.653 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 796 2024-09-16T03:41:29.653 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.RMeg7V8LTx 2024-09-16T03:41:29.655 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:29.655 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:29.655 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:29.655 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 797 2024-09-16T03:41:29.655 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=797 2024-09-16T03:41:29.655 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:29.655 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:29.655 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.aIdAbLCUXx 2024-09-16T03:41:29.656 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 797 -o /tmp/tmp.aIdAbLCUXx 2024-09-16T03:41:30.107 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 797 2024-09-16T03:41:30.125 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.aIdAbLCUXx 2024-09-16T03:41:30.125 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 797' 2024-09-16T03:41:30.146 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.aIdAbLCUXx' 2024-09-16T03:41:30.148 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 797 2024-09-16T03:41:30.148 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.aIdAbLCUXx 2024-09-16T03:41:30.149 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:30.149 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:30.149 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:30.149 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 798 2024-09-16T03:41:30.149 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=798 2024-09-16T03:41:30.149 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:30.149 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:30.150 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.Is4UZMB8QM 2024-09-16T03:41:30.150 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 798 -o /tmp/tmp.Is4UZMB8QM 2024-09-16T03:41:30.608 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 798 2024-09-16T03:41:30.626 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.Is4UZMB8QM 2024-09-16T03:41:30.626 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 798' 2024-09-16T03:41:30.645 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.Is4UZMB8QM' 2024-09-16T03:41:30.647 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 798 2024-09-16T03:41:30.647 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.Is4UZMB8QM 2024-09-16T03:41:30.648 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:30.648 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:30.648 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:30.648 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 799 2024-09-16T03:41:30.649 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=799 2024-09-16T03:41:30.649 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:30.649 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:30.649 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.AlKK5M0haY 2024-09-16T03:41:30.649 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 799 -o /tmp/tmp.AlKK5M0haY 2024-09-16T03:41:31.038 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 799 2024-09-16T03:41:31.054 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.AlKK5M0haY 2024-09-16T03:41:31.054 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 799' 2024-09-16T03:41:31.073 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.AlKK5M0haY' 2024-09-16T03:41:31.075 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 799 2024-09-16T03:41:31.075 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.AlKK5M0haY 2024-09-16T03:41:31.076 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:31.076 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:31.076 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:31.076 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 800 2024-09-16T03:41:31.076 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=800 2024-09-16T03:41:31.076 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:31.077 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:31.077 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.9oQvmykeMe 2024-09-16T03:41:31.077 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 800 -o /tmp/tmp.9oQvmykeMe 2024-09-16T03:41:31.549 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 800 2024-09-16T03:41:31.565 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.9oQvmykeMe 2024-09-16T03:41:31.565 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 800' 2024-09-16T03:41:31.579 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.9oQvmykeMe' 2024-09-16T03:41:31.579 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 800 2024-09-16T03:41:31.580 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.9oQvmykeMe 2024-09-16T03:41:31.580 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:31.580 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:31.580 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:31.580 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 801 2024-09-16T03:41:31.580 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=801 2024-09-16T03:41:31.581 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:31.581 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:31.581 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.8t4pzAFFI5 2024-09-16T03:41:31.588 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 801 -o /tmp/tmp.8t4pzAFFI5 2024-09-16T03:41:32.013 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 801 2024-09-16T03:41:32.031 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.8t4pzAFFI5 2024-09-16T03:41:32.032 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 801' 2024-09-16T03:41:32.051 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.8t4pzAFFI5' 2024-09-16T03:41:32.053 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 801 2024-09-16T03:41:32.053 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.8t4pzAFFI5 2024-09-16T03:41:32.055 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:32.055 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:32.055 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:32.055 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 802 2024-09-16T03:41:32.055 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=802 2024-09-16T03:41:32.055 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:32.055 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:32.056 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.g2QHjQpCir 2024-09-16T03:41:32.056 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 802 -o /tmp/tmp.g2QHjQpCir 2024-09-16T03:41:32.514 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 802 2024-09-16T03:41:32.531 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.g2QHjQpCir 2024-09-16T03:41:32.531 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 802' 2024-09-16T03:41:32.550 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.g2QHjQpCir' 2024-09-16T03:41:32.551 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 802 2024-09-16T03:41:32.552 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.g2QHjQpCir 2024-09-16T03:41:32.553 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:32.553 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:32.553 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:32.553 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 803 2024-09-16T03:41:32.553 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=803 2024-09-16T03:41:32.554 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:32.554 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:32.554 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.uvdw8yDScC 2024-09-16T03:41:32.554 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 803 -o /tmp/tmp.uvdw8yDScC 2024-09-16T03:41:33.024 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 803 2024-09-16T03:41:33.041 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.uvdw8yDScC 2024-09-16T03:41:33.042 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 803' 2024-09-16T03:41:33.061 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.uvdw8yDScC' 2024-09-16T03:41:33.063 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 803 2024-09-16T03:41:33.063 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.uvdw8yDScC 2024-09-16T03:41:33.064 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:33.064 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:33.064 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:33.064 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 804 2024-09-16T03:41:33.065 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=804 2024-09-16T03:41:33.065 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:33.065 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:33.065 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.Oiwa566TGE 2024-09-16T03:41:33.065 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 804 -o /tmp/tmp.Oiwa566TGE 2024-09-16T03:41:33.467 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 804 2024-09-16T03:41:33.483 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 804' 2024-09-16T03:41:33.483 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.Oiwa566TGE 2024-09-16T03:41:33.503 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.Oiwa566TGE' 2024-09-16T03:41:33.504 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 804 2024-09-16T03:41:33.505 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.Oiwa566TGE 2024-09-16T03:41:33.506 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:33.506 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:33.506 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:33.506 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 805 2024-09-16T03:41:33.506 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=805 2024-09-16T03:41:33.506 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:33.506 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:33.507 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.4E398j4fBQ 2024-09-16T03:41:33.507 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 805 -o /tmp/tmp.4E398j4fBQ 2024-09-16T03:41:33.969 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 805 2024-09-16T03:41:33.984 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.4E398j4fBQ 2024-09-16T03:41:33.985 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 805' 2024-09-16T03:41:34.004 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.4E398j4fBQ' 2024-09-16T03:41:34.005 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 805 2024-09-16T03:41:34.006 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.4E398j4fBQ 2024-09-16T03:41:34.007 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:34.007 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:34.007 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:34.007 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 806 2024-09-16T03:41:34.007 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=806 2024-09-16T03:41:34.007 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:34.007 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:34.008 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.V8Oq9UFsng 2024-09-16T03:41:34.008 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 806 -o /tmp/tmp.V8Oq9UFsng 2024-09-16T03:41:34.487 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 806 2024-09-16T03:41:34.504 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.V8Oq9UFsng 2024-09-16T03:41:34.504 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 806' 2024-09-16T03:41:34.520 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.V8Oq9UFsng' 2024-09-16T03:41:34.521 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 806 2024-09-16T03:41:34.521 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.V8Oq9UFsng 2024-09-16T03:41:34.523 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:34.523 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:34.523 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:34.523 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 807 2024-09-16T03:41:34.523 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=807 2024-09-16T03:41:34.523 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:34.523 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:34.524 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.lFc12l8Rgg 2024-09-16T03:41:34.524 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 807 -o /tmp/tmp.lFc12l8Rgg 2024-09-16T03:41:34.938 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 807 2024-09-16T03:41:34.955 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.lFc12l8Rgg 2024-09-16T03:41:34.955 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 807' 2024-09-16T03:41:34.974 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.lFc12l8Rgg' 2024-09-16T03:41:34.976 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 807 2024-09-16T03:41:34.976 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.lFc12l8Rgg 2024-09-16T03:41:34.977 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:34.977 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:34.977 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:34.977 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 808 2024-09-16T03:41:34.977 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=808 2024-09-16T03:41:34.978 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:34.978 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:34.978 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.ALGlAADZNb 2024-09-16T03:41:34.978 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 808 -o /tmp/tmp.ALGlAADZNb 2024-09-16T03:41:35.363 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 808 2024-09-16T03:41:35.379 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.ALGlAADZNb 2024-09-16T03:41:35.379 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 808' 2024-09-16T03:41:35.399 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.ALGlAADZNb' 2024-09-16T03:41:35.400 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 808 2024-09-16T03:41:35.401 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.ALGlAADZNb 2024-09-16T03:41:35.402 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:35.402 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:35.402 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:35.402 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 809 2024-09-16T03:41:35.402 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=809 2024-09-16T03:41:35.402 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:35.402 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:35.403 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.hkqguDEhek 2024-09-16T03:41:35.403 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 809 -o /tmp/tmp.hkqguDEhek 2024-09-16T03:41:35.867 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 809 2024-09-16T03:41:35.885 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.hkqguDEhek 2024-09-16T03:41:35.886 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 809' 2024-09-16T03:41:35.906 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.hkqguDEhek' 2024-09-16T03:41:35.907 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 809 2024-09-16T03:41:35.907 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.hkqguDEhek 2024-09-16T03:41:35.908 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:35.908 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:35.908 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:35.908 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 810 2024-09-16T03:41:35.909 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=810 2024-09-16T03:41:35.909 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:35.909 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:35.909 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.5yUV4hR5Jo 2024-09-16T03:41:35.909 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 810 -o /tmp/tmp.5yUV4hR5Jo 2024-09-16T03:41:36.343 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 810 2024-09-16T03:41:36.359 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.5yUV4hR5Jo 2024-09-16T03:41:36.359 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 810' 2024-09-16T03:41:36.379 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.5yUV4hR5Jo' 2024-09-16T03:41:36.380 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 810 2024-09-16T03:41:36.381 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.5yUV4hR5Jo 2024-09-16T03:41:36.382 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:36.382 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:36.382 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:36.382 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 811 2024-09-16T03:41:36.382 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=811 2024-09-16T03:41:36.382 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:36.382 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:36.383 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.mXjMJycaRM 2024-09-16T03:41:36.383 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 811 -o /tmp/tmp.mXjMJycaRM 2024-09-16T03:41:36.853 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 811 2024-09-16T03:41:36.870 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.mXjMJycaRM 2024-09-16T03:41:36.871 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 811' 2024-09-16T03:41:36.891 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.mXjMJycaRM' 2024-09-16T03:41:36.892 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 811 2024-09-16T03:41:36.892 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.mXjMJycaRM 2024-09-16T03:41:36.894 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:36.894 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:36.895 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:36.895 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 812 2024-09-16T03:41:36.895 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=812 2024-09-16T03:41:36.895 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:36.895 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:36.895 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.IeMAS0OyyX 2024-09-16T03:41:36.895 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 812 -o /tmp/tmp.IeMAS0OyyX 2024-09-16T03:41:37.338 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 812 2024-09-16T03:41:37.355 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 812' 2024-09-16T03:41:37.355 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.IeMAS0OyyX 2024-09-16T03:41:37.375 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.IeMAS0OyyX' 2024-09-16T03:41:37.377 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 812 2024-09-16T03:41:37.377 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.IeMAS0OyyX 2024-09-16T03:41:37.378 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:37.378 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:37.378 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:37.379 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 813 2024-09-16T03:41:37.379 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=813 2024-09-16T03:41:37.379 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:37.379 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:37.379 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.X4ZthmhJyx 2024-09-16T03:41:37.379 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 813 -o /tmp/tmp.X4ZthmhJyx 2024-09-16T03:41:37.839 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 813 2024-09-16T03:41:37.858 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.X4ZthmhJyx 2024-09-16T03:41:37.858 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 813' 2024-09-16T03:41:37.878 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.X4ZthmhJyx' 2024-09-16T03:41:37.880 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 813 2024-09-16T03:41:37.880 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.X4ZthmhJyx 2024-09-16T03:41:37.882 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:37.882 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:37.882 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:37.882 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 814 2024-09-16T03:41:37.882 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=814 2024-09-16T03:41:37.882 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:37.883 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:37.884 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.zRJsTJcm0Z 2024-09-16T03:41:37.884 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 814 -o /tmp/tmp.zRJsTJcm0Z 2024-09-16T03:41:38.341 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 814 2024-09-16T03:41:38.358 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.zRJsTJcm0Z 2024-09-16T03:41:38.358 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 814' 2024-09-16T03:41:38.378 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.zRJsTJcm0Z' 2024-09-16T03:41:38.380 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 814 2024-09-16T03:41:38.380 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.zRJsTJcm0Z 2024-09-16T03:41:38.382 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:38.382 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:38.382 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:38.382 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 815 2024-09-16T03:41:38.382 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=815 2024-09-16T03:41:38.382 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:38.382 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:38.383 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.ZwrazARLO1 2024-09-16T03:41:38.383 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 815 -o /tmp/tmp.ZwrazARLO1 2024-09-16T03:41:38.884 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 815 2024-09-16T03:41:38.903 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.ZwrazARLO1 2024-09-16T03:41:38.903 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 815' 2024-09-16T03:41:38.924 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.ZwrazARLO1' 2024-09-16T03:41:38.925 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 815 2024-09-16T03:41:38.926 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.ZwrazARLO1 2024-09-16T03:41:38.927 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:38.927 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:38.928 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:38.928 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 816 2024-09-16T03:41:38.928 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=816 2024-09-16T03:41:38.928 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:38.928 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:38.929 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.4fl8tOgmot 2024-09-16T03:41:38.929 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 816 -o /tmp/tmp.4fl8tOgmot 2024-09-16T03:41:39.323 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 816 2024-09-16T03:41:39.339 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.4fl8tOgmot 2024-09-16T03:41:39.340 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 816' 2024-09-16T03:41:39.359 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.4fl8tOgmot' 2024-09-16T03:41:39.360 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 816 2024-09-16T03:41:39.361 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.4fl8tOgmot 2024-09-16T03:41:39.362 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:39.362 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:39.362 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:39.363 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 817 2024-09-16T03:41:39.363 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=817 2024-09-16T03:41:39.363 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:39.363 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:39.364 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.aoKmj97Blo 2024-09-16T03:41:39.364 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 817 -o /tmp/tmp.aoKmj97Blo 2024-09-16T03:41:39.787 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 817 2024-09-16T03:41:39.804 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.aoKmj97Blo 2024-09-16T03:41:39.804 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 817' 2024-09-16T03:41:39.823 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.aoKmj97Blo' 2024-09-16T03:41:39.824 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 817 2024-09-16T03:41:39.825 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.aoKmj97Blo 2024-09-16T03:41:39.826 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:39.826 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:39.826 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:39.826 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 818 2024-09-16T03:41:39.826 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=818 2024-09-16T03:41:39.827 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:39.827 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:39.827 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.9VBBcap8Xo 2024-09-16T03:41:39.827 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 818 -o /tmp/tmp.9VBBcap8Xo 2024-09-16T03:41:40.289 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 818 2024-09-16T03:41:40.308 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.9VBBcap8Xo 2024-09-16T03:41:40.308 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 818' 2024-09-16T03:41:40.327 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.9VBBcap8Xo' 2024-09-16T03:41:40.329 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 818 2024-09-16T03:41:40.329 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.9VBBcap8Xo 2024-09-16T03:41:40.331 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:40.331 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:40.331 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:40.331 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 819 2024-09-16T03:41:40.331 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=819 2024-09-16T03:41:40.331 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:40.331 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:40.332 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.fjSO86mndz 2024-09-16T03:41:40.332 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 819 -o /tmp/tmp.fjSO86mndz 2024-09-16T03:41:40.761 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 819 2024-09-16T03:41:40.778 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.fjSO86mndz 2024-09-16T03:41:40.778 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 819' 2024-09-16T03:41:40.798 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.fjSO86mndz' 2024-09-16T03:41:40.799 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 819 2024-09-16T03:41:40.799 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.fjSO86mndz 2024-09-16T03:41:40.801 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:40.805 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:40.805 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:40.805 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 820 2024-09-16T03:41:40.805 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=820 2024-09-16T03:41:40.805 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:40.805 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:40.806 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.RReqEi3EGs 2024-09-16T03:41:40.806 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 820 -o /tmp/tmp.RReqEi3EGs 2024-09-16T03:41:41.333 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 820 2024-09-16T03:41:41.352 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.RReqEi3EGs 2024-09-16T03:41:41.352 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 820' 2024-09-16T03:41:41.372 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.RReqEi3EGs' 2024-09-16T03:41:41.373 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 820 2024-09-16T03:41:41.374 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.RReqEi3EGs 2024-09-16T03:41:41.375 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:41.375 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:41.375 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:41.375 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 821 2024-09-16T03:41:41.375 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=821 2024-09-16T03:41:41.375 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:41.375 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:41.376 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.VyGcQDkZNQ 2024-09-16T03:41:41.376 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 821 -o /tmp/tmp.VyGcQDkZNQ 2024-09-16T03:41:41.829 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 821 2024-09-16T03:41:41.843 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.VyGcQDkZNQ 2024-09-16T03:41:41.843 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 821' 2024-09-16T03:41:41.862 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.VyGcQDkZNQ' 2024-09-16T03:41:41.864 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 821 2024-09-16T03:41:41.864 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.VyGcQDkZNQ 2024-09-16T03:41:41.866 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:41.866 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:41.866 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:41.866 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 822 2024-09-16T03:41:41.866 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=822 2024-09-16T03:41:41.866 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:41.866 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:41.867 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.tgSVnxibXG 2024-09-16T03:41:41.867 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 822 -o /tmp/tmp.tgSVnxibXG 2024-09-16T03:41:42.290 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 822 2024-09-16T03:41:42.307 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.tgSVnxibXG 2024-09-16T03:41:42.307 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 822' 2024-09-16T03:41:42.327 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.tgSVnxibXG' 2024-09-16T03:41:42.328 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 822 2024-09-16T03:41:42.329 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.tgSVnxibXG 2024-09-16T03:41:42.330 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:42.330 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:42.330 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:42.330 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 823 2024-09-16T03:41:42.330 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=823 2024-09-16T03:41:42.330 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:42.330 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:42.331 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.42WmfJTGNx 2024-09-16T03:41:42.331 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 823 -o /tmp/tmp.42WmfJTGNx 2024-09-16T03:41:42.750 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 823 2024-09-16T03:41:42.767 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 823' 2024-09-16T03:41:42.767 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.42WmfJTGNx 2024-09-16T03:41:42.786 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.42WmfJTGNx' 2024-09-16T03:41:42.788 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 823 2024-09-16T03:41:42.788 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.42WmfJTGNx 2024-09-16T03:41:42.789 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:42.789 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:42.789 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:42.789 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 824 2024-09-16T03:41:42.789 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=824 2024-09-16T03:41:42.789 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:42.790 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:42.791 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.3DQLrzwwkV 2024-09-16T03:41:42.791 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 824 -o /tmp/tmp.3DQLrzwwkV 2024-09-16T03:41:43.235 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 824 2024-09-16T03:41:43.251 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.3DQLrzwwkV 2024-09-16T03:41:43.251 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 824' 2024-09-16T03:41:43.270 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.3DQLrzwwkV' 2024-09-16T03:41:43.272 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 824 2024-09-16T03:41:43.272 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.3DQLrzwwkV 2024-09-16T03:41:43.273 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:43.273 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:43.273 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:43.273 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 825 2024-09-16T03:41:43.274 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=825 2024-09-16T03:41:43.274 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:43.274 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:43.274 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.RZTKJxOzIY 2024-09-16T03:41:43.274 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 825 -o /tmp/tmp.RZTKJxOzIY 2024-09-16T03:41:43.691 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 825 2024-09-16T03:41:43.707 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.RZTKJxOzIY 2024-09-16T03:41:43.708 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 825' 2024-09-16T03:41:43.727 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.RZTKJxOzIY' 2024-09-16T03:41:43.728 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 825 2024-09-16T03:41:43.729 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.RZTKJxOzIY 2024-09-16T03:41:43.730 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:43.730 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:43.730 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:43.730 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 826 2024-09-16T03:41:43.730 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=826 2024-09-16T03:41:43.730 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:43.730 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:43.731 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.oaky5cXQd6 2024-09-16T03:41:43.731 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 826 -o /tmp/tmp.oaky5cXQd6 2024-09-16T03:41:44.192 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 826 2024-09-16T03:41:44.212 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.oaky5cXQd6 2024-09-16T03:41:44.212 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 826' 2024-09-16T03:41:44.231 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.oaky5cXQd6' 2024-09-16T03:41:44.233 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 826 2024-09-16T03:41:44.233 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.oaky5cXQd6 2024-09-16T03:41:44.235 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:44.235 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:44.235 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:44.235 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 827 2024-09-16T03:41:44.235 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=827 2024-09-16T03:41:44.235 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:44.235 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:44.236 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.E1z5Pmet8d 2024-09-16T03:41:44.236 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 827 -o /tmp/tmp.E1z5Pmet8d 2024-09-16T03:41:44.702 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 827 2024-09-16T03:41:44.719 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.E1z5Pmet8d 2024-09-16T03:41:44.719 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 827' 2024-09-16T03:41:44.739 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.E1z5Pmet8d' 2024-09-16T03:41:44.740 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 827 2024-09-16T03:41:44.741 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.E1z5Pmet8d 2024-09-16T03:41:44.742 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:44.742 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:44.742 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:44.742 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 828 2024-09-16T03:41:44.742 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=828 2024-09-16T03:41:44.742 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:44.742 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:44.743 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.sBtgAkgE0z 2024-09-16T03:41:44.743 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 828 -o /tmp/tmp.sBtgAkgE0z 2024-09-16T03:41:45.188 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 828 2024-09-16T03:41:45.207 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.sBtgAkgE0z 2024-09-16T03:41:45.207 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 828' 2024-09-16T03:41:45.223 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.sBtgAkgE0z' 2024-09-16T03:41:45.224 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 828 2024-09-16T03:41:45.224 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.sBtgAkgE0z 2024-09-16T03:41:45.226 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:45.226 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:45.226 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:45.226 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 829 2024-09-16T03:41:45.226 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=829 2024-09-16T03:41:45.226 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:45.226 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:45.226 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.EsaTcnWDKy 2024-09-16T03:41:45.227 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 829 -o /tmp/tmp.EsaTcnWDKy 2024-09-16T03:41:45.624 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 829 2024-09-16T03:41:45.640 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.EsaTcnWDKy 2024-09-16T03:41:45.640 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 829' 2024-09-16T03:41:45.659 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.EsaTcnWDKy' 2024-09-16T03:41:45.661 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 829 2024-09-16T03:41:45.661 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.EsaTcnWDKy 2024-09-16T03:41:45.663 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:45.663 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:45.663 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:45.663 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 830 2024-09-16T03:41:45.663 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=830 2024-09-16T03:41:45.663 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:45.663 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:45.664 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.QmNVLAvcIN 2024-09-16T03:41:45.664 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 830 -o /tmp/tmp.QmNVLAvcIN 2024-09-16T03:41:46.099 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 830 2024-09-16T03:41:46.115 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.QmNVLAvcIN 2024-09-16T03:41:46.116 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 830' 2024-09-16T03:41:46.135 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.QmNVLAvcIN' 2024-09-16T03:41:46.136 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 830 2024-09-16T03:41:46.137 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.QmNVLAvcIN 2024-09-16T03:41:46.138 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:46.138 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:46.138 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:46.138 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 831 2024-09-16T03:41:46.138 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=831 2024-09-16T03:41:46.138 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:46.138 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:46.139 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.fneTE0Qzhx 2024-09-16T03:41:46.139 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 831 -o /tmp/tmp.fneTE0Qzhx 2024-09-16T03:41:46.538 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 831 2024-09-16T03:41:46.554 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.fneTE0Qzhx 2024-09-16T03:41:46.555 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 831' 2024-09-16T03:41:46.574 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.fneTE0Qzhx' 2024-09-16T03:41:46.575 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 831 2024-09-16T03:41:46.576 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.fneTE0Qzhx 2024-09-16T03:41:46.577 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:46.577 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:46.577 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:46.577 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 832 2024-09-16T03:41:46.577 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=832 2024-09-16T03:41:46.577 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:46.577 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:46.578 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.GUBFuOrh6M 2024-09-16T03:41:46.578 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 832 -o /tmp/tmp.GUBFuOrh6M 2024-09-16T03:41:47.035 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 832 2024-09-16T03:41:47.053 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.GUBFuOrh6M 2024-09-16T03:41:47.053 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 832' 2024-09-16T03:41:47.072 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.GUBFuOrh6M' 2024-09-16T03:41:47.074 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 832 2024-09-16T03:41:47.074 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.GUBFuOrh6M 2024-09-16T03:41:47.076 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:47.076 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:47.076 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:47.076 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 833 2024-09-16T03:41:47.076 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=833 2024-09-16T03:41:47.076 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:47.076 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:47.076 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.z6pgJatkMN 2024-09-16T03:41:47.076 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 833 -o /tmp/tmp.z6pgJatkMN 2024-09-16T03:41:47.489 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 833 2024-09-16T03:41:47.504 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.z6pgJatkMN 2024-09-16T03:41:47.505 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 833' 2024-09-16T03:41:47.524 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.z6pgJatkMN' 2024-09-16T03:41:47.526 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 833 2024-09-16T03:41:47.526 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.z6pgJatkMN 2024-09-16T03:41:47.527 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:47.527 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:47.527 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:47.527 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 834 2024-09-16T03:41:47.527 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=834 2024-09-16T03:41:47.527 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:47.527 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:47.528 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.lDuIgulmus 2024-09-16T03:41:47.528 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 834 -o /tmp/tmp.lDuIgulmus 2024-09-16T03:41:47.971 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 834 2024-09-16T03:41:47.989 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.lDuIgulmus 2024-09-16T03:41:47.989 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 834' 2024-09-16T03:41:48.005 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.lDuIgulmus' 2024-09-16T03:41:48.007 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 834 2024-09-16T03:41:48.007 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.lDuIgulmus 2024-09-16T03:41:48.009 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:48.009 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:48.009 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:48.009 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 835 2024-09-16T03:41:48.009 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=835 2024-09-16T03:41:48.009 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:48.010 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:48.010 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.NCMibaLRio 2024-09-16T03:41:48.010 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 835 -o /tmp/tmp.NCMibaLRio 2024-09-16T03:41:48.424 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 835 2024-09-16T03:41:48.441 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 835' 2024-09-16T03:41:48.441 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.NCMibaLRio 2024-09-16T03:41:48.462 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.NCMibaLRio' 2024-09-16T03:41:48.463 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 835 2024-09-16T03:41:48.463 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.NCMibaLRio 2024-09-16T03:41:48.465 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:48.465 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:48.465 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:48.466 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 836 2024-09-16T03:41:48.466 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=836 2024-09-16T03:41:48.466 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:48.466 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:48.466 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.M3hGwU4H9A 2024-09-16T03:41:48.466 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 836 -o /tmp/tmp.M3hGwU4H9A 2024-09-16T03:41:48.925 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 836 2024-09-16T03:41:48.941 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.M3hGwU4H9A 2024-09-16T03:41:48.942 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 836' 2024-09-16T03:41:48.962 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.M3hGwU4H9A' 2024-09-16T03:41:48.963 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 836 2024-09-16T03:41:48.964 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.M3hGwU4H9A 2024-09-16T03:41:48.965 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:48.966 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:48.966 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:48.966 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 837 2024-09-16T03:41:48.966 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=837 2024-09-16T03:41:48.966 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:48.966 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:48.967 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.SHJV9ZQRiB 2024-09-16T03:41:48.967 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 837 -o /tmp/tmp.SHJV9ZQRiB 2024-09-16T03:41:49.418 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 837 2024-09-16T03:41:49.436 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.SHJV9ZQRiB 2024-09-16T03:41:49.436 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 837' 2024-09-16T03:41:49.455 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.SHJV9ZQRiB' 2024-09-16T03:41:49.457 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 837 2024-09-16T03:41:49.457 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.SHJV9ZQRiB 2024-09-16T03:41:49.459 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:49.460 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:49.460 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:49.460 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 838 2024-09-16T03:41:49.460 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=838 2024-09-16T03:41:49.460 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:49.461 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:49.461 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.SAj1XBkikI 2024-09-16T03:41:49.461 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 838 -o /tmp/tmp.SAj1XBkikI 2024-09-16T03:41:49.859 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 838 2024-09-16T03:41:49.875 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.SAj1XBkikI 2024-09-16T03:41:49.875 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 838' 2024-09-16T03:41:49.895 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.SAj1XBkikI' 2024-09-16T03:41:49.896 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 838 2024-09-16T03:41:49.896 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.SAj1XBkikI 2024-09-16T03:41:49.898 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:49.898 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:49.898 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:49.898 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 839 2024-09-16T03:41:49.898 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=839 2024-09-16T03:41:49.898 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:49.898 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:49.899 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.d1mMAW9iA8 2024-09-16T03:41:49.899 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 839 -o /tmp/tmp.d1mMAW9iA8 2024-09-16T03:41:50.387 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 839 2024-09-16T03:41:50.404 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 839' 2024-09-16T03:41:50.404 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.d1mMAW9iA8 2024-09-16T03:41:50.425 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.d1mMAW9iA8' 2024-09-16T03:41:50.426 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 839 2024-09-16T03:41:50.426 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.d1mMAW9iA8 2024-09-16T03:41:50.427 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:50.428 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:50.428 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:50.428 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 840 2024-09-16T03:41:50.428 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=840 2024-09-16T03:41:50.428 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:50.428 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:50.428 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.YXUWjILijp 2024-09-16T03:41:50.428 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 840 -o /tmp/tmp.YXUWjILijp 2024-09-16T03:41:50.868 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 840 2024-09-16T03:41:50.885 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.YXUWjILijp 2024-09-16T03:41:50.885 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 840' 2024-09-16T03:41:50.906 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.YXUWjILijp' 2024-09-16T03:41:50.907 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 840 2024-09-16T03:41:50.908 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.YXUWjILijp 2024-09-16T03:41:50.909 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:50.909 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:50.909 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:50.909 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 841 2024-09-16T03:41:50.909 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=841 2024-09-16T03:41:50.909 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:50.910 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:50.910 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.tBgHVLxIIq 2024-09-16T03:41:50.910 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 841 -o /tmp/tmp.tBgHVLxIIq 2024-09-16T03:41:51.340 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 841 2024-09-16T03:41:51.356 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.tBgHVLxIIq 2024-09-16T03:41:51.357 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 841' 2024-09-16T03:41:51.376 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.tBgHVLxIIq' 2024-09-16T03:41:51.378 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 841 2024-09-16T03:41:51.378 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.tBgHVLxIIq 2024-09-16T03:41:51.379 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:51.379 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:51.379 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:51.379 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 842 2024-09-16T03:41:51.379 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=842 2024-09-16T03:41:51.380 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:51.380 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:51.380 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.Wpq7yzlpVj 2024-09-16T03:41:51.380 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 842 -o /tmp/tmp.Wpq7yzlpVj 2024-09-16T03:41:51.774 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 842 2024-09-16T03:41:51.790 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.Wpq7yzlpVj 2024-09-16T03:41:51.791 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 842' 2024-09-16T03:41:51.810 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.Wpq7yzlpVj' 2024-09-16T03:41:51.811 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 842 2024-09-16T03:41:51.811 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.Wpq7yzlpVj 2024-09-16T03:41:51.813 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:51.813 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:51.813 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:51.813 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 843 2024-09-16T03:41:51.813 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=843 2024-09-16T03:41:51.813 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:51.813 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:51.814 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.86KoHx9bvH 2024-09-16T03:41:51.814 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 843 -o /tmp/tmp.86KoHx9bvH 2024-09-16T03:41:52.200 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 843 2024-09-16T03:41:52.217 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.86KoHx9bvH 2024-09-16T03:41:52.217 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 843' 2024-09-16T03:41:52.236 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.86KoHx9bvH' 2024-09-16T03:41:52.238 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 843 2024-09-16T03:41:52.238 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.86KoHx9bvH 2024-09-16T03:41:52.239 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:52.239 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:52.240 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:52.240 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 844 2024-09-16T03:41:52.240 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=844 2024-09-16T03:41:52.240 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:52.240 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:52.240 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.TiiB3kxySf 2024-09-16T03:41:52.240 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 844 -o /tmp/tmp.TiiB3kxySf 2024-09-16T03:41:52.716 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 844 2024-09-16T03:41:52.735 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.TiiB3kxySf 2024-09-16T03:41:52.735 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 844' 2024-09-16T03:41:52.755 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.TiiB3kxySf' 2024-09-16T03:41:52.757 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 844 2024-09-16T03:41:52.757 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.TiiB3kxySf 2024-09-16T03:41:52.758 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:52.758 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:52.759 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:52.759 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 845 2024-09-16T03:41:52.759 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=845 2024-09-16T03:41:52.759 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:52.759 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:52.759 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.nVRWN9vLHH 2024-09-16T03:41:52.759 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 845 -o /tmp/tmp.nVRWN9vLHH 2024-09-16T03:41:53.175 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 845 2024-09-16T03:41:53.191 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.nVRWN9vLHH 2024-09-16T03:41:53.191 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 845' 2024-09-16T03:41:53.212 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.nVRWN9vLHH' 2024-09-16T03:41:53.214 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 845 2024-09-16T03:41:53.214 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.nVRWN9vLHH 2024-09-16T03:41:53.215 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:53.215 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:53.215 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:53.215 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 846 2024-09-16T03:41:53.215 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=846 2024-09-16T03:41:53.215 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:53.216 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:53.216 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.7rAs6z38pC 2024-09-16T03:41:53.216 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 846 -o /tmp/tmp.7rAs6z38pC 2024-09-16T03:41:53.662 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 846 2024-09-16T03:41:53.679 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.7rAs6z38pC 2024-09-16T03:41:53.680 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 846' 2024-09-16T03:41:53.699 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.7rAs6z38pC' 2024-09-16T03:41:53.701 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 846 2024-09-16T03:41:53.701 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.7rAs6z38pC 2024-09-16T03:41:53.702 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:53.703 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:53.703 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:53.703 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 847 2024-09-16T03:41:53.703 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=847 2024-09-16T03:41:53.703 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:53.703 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:53.703 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.WfEDVl0BrF 2024-09-16T03:41:53.703 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 847 -o /tmp/tmp.WfEDVl0BrF 2024-09-16T03:41:54.151 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 847 2024-09-16T03:41:54.168 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 847' 2024-09-16T03:41:54.168 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.WfEDVl0BrF 2024-09-16T03:41:54.187 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.WfEDVl0BrF' 2024-09-16T03:41:54.189 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 847 2024-09-16T03:41:54.189 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.WfEDVl0BrF 2024-09-16T03:41:54.190 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:54.190 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:54.190 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:54.190 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 848 2024-09-16T03:41:54.190 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=848 2024-09-16T03:41:54.190 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:54.191 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:54.191 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.GF9zeGvl0F 2024-09-16T03:41:54.191 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 848 -o /tmp/tmp.GF9zeGvl0F 2024-09-16T03:41:54.644 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 848 2024-09-16T03:41:54.660 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.GF9zeGvl0F 2024-09-16T03:41:54.661 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 848' 2024-09-16T03:41:54.680 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.GF9zeGvl0F' 2024-09-16T03:41:54.681 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 848 2024-09-16T03:41:54.682 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.GF9zeGvl0F 2024-09-16T03:41:54.683 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:54.683 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:54.683 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:54.683 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 849 2024-09-16T03:41:54.683 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=849 2024-09-16T03:41:54.683 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:54.683 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:54.684 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.rlA0D2EaP1 2024-09-16T03:41:54.684 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 849 -o /tmp/tmp.rlA0D2EaP1 2024-09-16T03:41:55.137 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 849 2024-09-16T03:41:55.154 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.rlA0D2EaP1 2024-09-16T03:41:55.154 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 849' 2024-09-16T03:41:55.173 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.rlA0D2EaP1' 2024-09-16T03:41:55.175 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 849 2024-09-16T03:41:55.175 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.rlA0D2EaP1 2024-09-16T03:41:55.176 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:55.176 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:55.176 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:55.176 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 850 2024-09-16T03:41:55.176 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=850 2024-09-16T03:41:55.177 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:55.177 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:55.177 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.y94hx63Fn2 2024-09-16T03:41:55.177 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 850 -o /tmp/tmp.y94hx63Fn2 2024-09-16T03:41:55.614 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 850 2024-09-16T03:41:55.630 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 850' 2024-09-16T03:41:55.630 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.y94hx63Fn2 2024-09-16T03:41:55.650 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.y94hx63Fn2' 2024-09-16T03:41:55.652 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 850 2024-09-16T03:41:55.652 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.y94hx63Fn2 2024-09-16T03:41:55.653 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:55.653 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:55.654 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:55.654 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 851 2024-09-16T03:41:55.654 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=851 2024-09-16T03:41:55.654 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:55.654 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:55.654 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.z5t9CyIuPv 2024-09-16T03:41:55.654 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 851 -o /tmp/tmp.z5t9CyIuPv 2024-09-16T03:41:56.060 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 851 2024-09-16T03:41:56.076 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.z5t9CyIuPv 2024-09-16T03:41:56.076 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 851' 2024-09-16T03:41:56.097 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.z5t9CyIuPv' 2024-09-16T03:41:56.098 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 851 2024-09-16T03:41:56.098 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.z5t9CyIuPv 2024-09-16T03:41:56.099 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:56.100 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:56.100 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:56.100 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 852 2024-09-16T03:41:56.100 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=852 2024-09-16T03:41:56.100 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:56.100 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:56.100 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.i47c5JGNtj 2024-09-16T03:41:56.100 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 852 -o /tmp/tmp.i47c5JGNtj 2024-09-16T03:41:56.600 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 852 2024-09-16T03:41:56.618 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.i47c5JGNtj 2024-09-16T03:41:56.618 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 852' 2024-09-16T03:41:56.638 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.i47c5JGNtj' 2024-09-16T03:41:56.640 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 852 2024-09-16T03:41:56.640 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.i47c5JGNtj 2024-09-16T03:41:56.642 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:56.642 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:56.642 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:56.642 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 853 2024-09-16T03:41:56.642 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=853 2024-09-16T03:41:56.642 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:56.642 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:56.643 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.CP1eWUNvGb 2024-09-16T03:41:56.643 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 853 -o /tmp/tmp.CP1eWUNvGb 2024-09-16T03:41:57.043 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 853 2024-09-16T03:41:57.060 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.CP1eWUNvGb 2024-09-16T03:41:57.060 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 853' 2024-09-16T03:41:57.079 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.CP1eWUNvGb' 2024-09-16T03:41:57.081 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 853 2024-09-16T03:41:57.081 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.CP1eWUNvGb 2024-09-16T03:41:57.082 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:57.082 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:57.083 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:57.083 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 854 2024-09-16T03:41:57.083 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=854 2024-09-16T03:41:57.083 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:57.083 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:57.083 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.pGr75lK79h 2024-09-16T03:41:57.083 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 854 -o /tmp/tmp.pGr75lK79h 2024-09-16T03:41:57.544 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 854 2024-09-16T03:41:57.563 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.pGr75lK79h 2024-09-16T03:41:57.563 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 854' 2024-09-16T03:41:57.582 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.pGr75lK79h' 2024-09-16T03:41:57.583 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 854 2024-09-16T03:41:57.584 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.pGr75lK79h 2024-09-16T03:41:57.585 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:57.585 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:57.585 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:57.585 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 855 2024-09-16T03:41:57.585 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=855 2024-09-16T03:41:57.585 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:57.585 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:57.586 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.JM7KSWnX0k 2024-09-16T03:41:57.586 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 855 -o /tmp/tmp.JM7KSWnX0k 2024-09-16T03:41:58.012 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 855 2024-09-16T03:41:58.028 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.JM7KSWnX0k 2024-09-16T03:41:58.029 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 855' 2024-09-16T03:41:58.048 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.JM7KSWnX0k' 2024-09-16T03:41:58.050 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 855 2024-09-16T03:41:58.050 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.JM7KSWnX0k 2024-09-16T03:41:58.052 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:58.052 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:58.052 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:58.052 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 856 2024-09-16T03:41:58.052 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=856 2024-09-16T03:41:58.052 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:58.052 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:58.053 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.Nst6NpJ4EL 2024-09-16T03:41:58.053 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 856 -o /tmp/tmp.Nst6NpJ4EL 2024-09-16T03:41:58.442 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 856 2024-09-16T03:41:58.458 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.Nst6NpJ4EL 2024-09-16T03:41:58.458 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 856' 2024-09-16T03:41:58.478 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.Nst6NpJ4EL' 2024-09-16T03:41:58.480 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 856 2024-09-16T03:41:58.480 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.Nst6NpJ4EL 2024-09-16T03:41:58.481 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:58.481 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:58.481 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:58.481 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 857 2024-09-16T03:41:58.481 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=857 2024-09-16T03:41:58.481 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:58.481 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:58.482 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.kYkGtz6mbS 2024-09-16T03:41:58.482 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 857 -o /tmp/tmp.kYkGtz6mbS 2024-09-16T03:41:58.886 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 857 2024-09-16T03:41:58.903 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.kYkGtz6mbS 2024-09-16T03:41:58.903 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 857' 2024-09-16T03:41:58.922 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.kYkGtz6mbS' 2024-09-16T03:41:58.924 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 857 2024-09-16T03:41:58.924 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.kYkGtz6mbS 2024-09-16T03:41:58.925 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:58.925 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:58.925 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:58.925 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 858 2024-09-16T03:41:58.925 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=858 2024-09-16T03:41:58.926 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:58.926 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:58.927 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.vuvBlB1xT6 2024-09-16T03:41:58.927 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 858 -o /tmp/tmp.vuvBlB1xT6 2024-09-16T03:41:59.336 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 858 2024-09-16T03:41:59.353 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.vuvBlB1xT6 2024-09-16T03:41:59.353 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 858' 2024-09-16T03:41:59.373 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.vuvBlB1xT6' 2024-09-16T03:41:59.375 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 858 2024-09-16T03:41:59.375 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.vuvBlB1xT6 2024-09-16T03:41:59.376 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:59.376 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:59.377 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:59.377 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 859 2024-09-16T03:41:59.377 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=859 2024-09-16T03:41:59.377 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:59.377 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:59.377 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.YVYzn2NwJ4 2024-09-16T03:41:59.377 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 859 -o /tmp/tmp.YVYzn2NwJ4 2024-09-16T03:41:59.801 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 859 2024-09-16T03:41:59.818 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.YVYzn2NwJ4 2024-09-16T03:41:59.818 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 859' 2024-09-16T03:41:59.838 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.YVYzn2NwJ4' 2024-09-16T03:41:59.840 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 859 2024-09-16T03:41:59.840 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.YVYzn2NwJ4 2024-09-16T03:41:59.841 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:41:59.841 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:41:59.841 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:41:59.842 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 860 2024-09-16T03:41:59.842 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=860 2024-09-16T03:41:59.842 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:41:59.842 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:41:59.842 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.e3P6wcOmVz 2024-09-16T03:41:59.842 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 860 -o /tmp/tmp.e3P6wcOmVz 2024-09-16T03:42:00.294 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 860 2024-09-16T03:42:00.311 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.e3P6wcOmVz 2024-09-16T03:42:00.312 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 860' 2024-09-16T03:42:00.331 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.e3P6wcOmVz' 2024-09-16T03:42:00.333 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 860 2024-09-16T03:42:00.333 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.e3P6wcOmVz 2024-09-16T03:42:00.334 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:42:00.334 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:42:00.334 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:42:00.334 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 861 2024-09-16T03:42:00.334 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=861 2024-09-16T03:42:00.334 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:42:00.334 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:42:00.335 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.oKIVijxfQH 2024-09-16T03:42:00.335 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 861 -o /tmp/tmp.oKIVijxfQH 2024-09-16T03:42:00.776 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 861 2024-09-16T03:42:00.796 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.oKIVijxfQH 2024-09-16T03:42:00.796 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 861' 2024-09-16T03:42:00.817 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.oKIVijxfQH' 2024-09-16T03:42:00.819 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 861 2024-09-16T03:42:00.819 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.oKIVijxfQH 2024-09-16T03:42:00.820 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:42:00.820 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:42:00.820 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:42:00.820 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 862 2024-09-16T03:42:00.820 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=862 2024-09-16T03:42:00.820 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:42:00.820 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:42:00.821 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.BiIvx3gQiO 2024-09-16T03:42:00.821 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 862 -o /tmp/tmp.BiIvx3gQiO 2024-09-16T03:42:01.264 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 862 2024-09-16T03:42:01.281 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.BiIvx3gQiO 2024-09-16T03:42:01.281 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 862' 2024-09-16T03:42:01.300 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.BiIvx3gQiO' 2024-09-16T03:42:01.301 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 862 2024-09-16T03:42:01.302 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.BiIvx3gQiO 2024-09-16T03:42:01.303 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:42:01.303 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:42:01.303 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:42:01.303 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 863 2024-09-16T03:42:01.303 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=863 2024-09-16T03:42:01.303 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:42:01.304 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:42:01.304 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.zyUSmbdsCN 2024-09-16T03:42:01.304 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 863 -o /tmp/tmp.zyUSmbdsCN 2024-09-16T03:42:01.701 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 863 2024-09-16T03:42:01.717 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.zyUSmbdsCN 2024-09-16T03:42:01.717 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 863' 2024-09-16T03:42:01.736 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.zyUSmbdsCN' 2024-09-16T03:42:01.738 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 863 2024-09-16T03:42:01.738 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.zyUSmbdsCN 2024-09-16T03:42:01.739 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:42:01.739 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:42:01.739 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:42:01.739 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 864 2024-09-16T03:42:01.739 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=864 2024-09-16T03:42:01.740 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:42:01.740 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:42:01.740 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.Ecoh3ojNoj 2024-09-16T03:42:01.740 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 864 -o /tmp/tmp.Ecoh3ojNoj 2024-09-16T03:42:02.176 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 864 2024-09-16T03:42:02.194 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 864' 2024-09-16T03:42:02.194 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.Ecoh3ojNoj 2024-09-16T03:42:02.214 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.Ecoh3ojNoj' 2024-09-16T03:42:02.216 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 864 2024-09-16T03:42:02.216 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.Ecoh3ojNoj 2024-09-16T03:42:02.217 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:42:02.217 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:42:02.217 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:42:02.217 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 865 2024-09-16T03:42:02.218 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=865 2024-09-16T03:42:02.218 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:42:02.218 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:42:02.218 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.urUZfxB2H6 2024-09-16T03:42:02.218 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 865 -o /tmp/tmp.urUZfxB2H6 2024-09-16T03:42:02.746 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 865 2024-09-16T03:42:02.759 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.urUZfxB2H6 2024-09-16T03:42:02.759 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 865' 2024-09-16T03:42:02.779 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.urUZfxB2H6' 2024-09-16T03:42:02.781 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 865 2024-09-16T03:42:02.781 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.urUZfxB2H6 2024-09-16T03:42:02.782 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:42:02.782 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:42:02.782 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:42:02.782 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 866 2024-09-16T03:42:02.782 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=866 2024-09-16T03:42:02.783 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:42:02.783 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:42:02.783 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.EFCFybu0Q5 2024-09-16T03:42:02.783 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 866 -o /tmp/tmp.EFCFybu0Q5 2024-09-16T03:42:03.211 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 866 2024-09-16T03:42:03.229 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.EFCFybu0Q5 2024-09-16T03:42:03.230 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 866' 2024-09-16T03:42:03.249 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.EFCFybu0Q5' 2024-09-16T03:42:03.251 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 866 2024-09-16T03:42:03.251 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.EFCFybu0Q5 2024-09-16T03:42:03.252 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:42:03.252 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:42:03.252 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:42:03.252 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 867 2024-09-16T03:42:03.252 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=867 2024-09-16T03:42:03.252 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:42:03.253 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:42:03.254 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.KStCpJArTN 2024-09-16T03:42:03.254 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 867 -o /tmp/tmp.KStCpJArTN 2024-09-16T03:42:03.697 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 867 2024-09-16T03:42:03.714 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.KStCpJArTN 2024-09-16T03:42:03.714 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 867' 2024-09-16T03:42:03.734 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.KStCpJArTN' 2024-09-16T03:42:03.735 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 867 2024-09-16T03:42:03.736 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.KStCpJArTN 2024-09-16T03:42:03.737 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:42:03.737 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:42:03.737 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:42:03.737 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 868 2024-09-16T03:42:03.737 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=868 2024-09-16T03:42:03.737 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:42:03.738 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:42:03.738 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.obINt9UDdB 2024-09-16T03:42:03.739 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 868 -o /tmp/tmp.obINt9UDdB 2024-09-16T03:42:04.180 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 868 2024-09-16T03:42:04.198 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 868' 2024-09-16T03:42:04.198 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.obINt9UDdB 2024-09-16T03:42:04.218 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.obINt9UDdB' 2024-09-16T03:42:04.220 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 868 2024-09-16T03:42:04.220 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.obINt9UDdB 2024-09-16T03:42:04.222 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:42:04.222 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:42:04.222 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:42:04.222 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 869 2024-09-16T03:42:04.222 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=869 2024-09-16T03:42:04.222 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:42:04.222 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:42:04.223 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.ZTzsabmbvD 2024-09-16T03:42:04.223 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 869 -o /tmp/tmp.ZTzsabmbvD 2024-09-16T03:42:04.675 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 869 2024-09-16T03:42:04.695 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.ZTzsabmbvD 2024-09-16T03:42:04.695 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 869' 2024-09-16T03:42:04.714 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.ZTzsabmbvD' 2024-09-16T03:42:04.716 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 869 2024-09-16T03:42:04.716 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.ZTzsabmbvD 2024-09-16T03:42:04.718 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:42:04.718 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:42:04.718 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:42:04.719 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 870 2024-09-16T03:42:04.719 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=870 2024-09-16T03:42:04.719 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:42:04.719 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:42:04.720 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.nWSsePMAnF 2024-09-16T03:42:04.720 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 870 -o /tmp/tmp.nWSsePMAnF 2024-09-16T03:42:05.183 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 870 2024-09-16T03:42:05.201 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.nWSsePMAnF 2024-09-16T03:42:05.202 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 870' 2024-09-16T03:42:05.221 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.nWSsePMAnF' 2024-09-16T03:42:05.222 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 870 2024-09-16T03:42:05.222 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.nWSsePMAnF 2024-09-16T03:42:05.223 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:42:05.224 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:42:05.224 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:42:05.224 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 871 2024-09-16T03:42:05.224 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=871 2024-09-16T03:42:05.224 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:42:05.224 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:42:05.224 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.CArp0lDm0B 2024-09-16T03:42:05.224 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 871 -o /tmp/tmp.CArp0lDm0B 2024-09-16T03:42:05.679 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 871 2024-09-16T03:42:05.695 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.CArp0lDm0B 2024-09-16T03:42:05.696 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 871' 2024-09-16T03:42:05.715 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.CArp0lDm0B' 2024-09-16T03:42:05.716 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 871 2024-09-16T03:42:05.716 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.CArp0lDm0B 2024-09-16T03:42:05.718 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:42:05.718 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:42:05.718 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:42:05.718 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 872 2024-09-16T03:42:05.718 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=872 2024-09-16T03:42:05.718 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:42:05.718 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:42:05.719 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.PcarJ5dPn8 2024-09-16T03:42:05.719 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 872 -o /tmp/tmp.PcarJ5dPn8 2024-09-16T03:42:06.116 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 872 2024-09-16T03:42:06.131 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.PcarJ5dPn8 2024-09-16T03:42:06.132 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 872' 2024-09-16T03:42:06.146 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.PcarJ5dPn8' 2024-09-16T03:42:06.147 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 872 2024-09-16T03:42:06.148 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.PcarJ5dPn8 2024-09-16T03:42:06.149 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:42:06.149 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:42:06.149 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:42:06.149 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 873 2024-09-16T03:42:06.149 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=873 2024-09-16T03:42:06.149 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:42:06.150 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:42:06.150 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.SbLCI8nG1g 2024-09-16T03:42:06.150 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 873 -o /tmp/tmp.SbLCI8nG1g 2024-09-16T03:42:06.566 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 873 2024-09-16T03:42:06.583 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 873' 2024-09-16T03:42:06.583 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.SbLCI8nG1g 2024-09-16T03:42:06.602 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.SbLCI8nG1g' 2024-09-16T03:42:06.604 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 873 2024-09-16T03:42:06.604 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.SbLCI8nG1g 2024-09-16T03:42:06.605 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:42:06.606 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:42:06.606 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:42:06.606 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 874 2024-09-16T03:42:06.606 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=874 2024-09-16T03:42:06.606 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:42:06.606 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:42:06.606 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.U6Ju27lbWZ 2024-09-16T03:42:06.606 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 874 -o /tmp/tmp.U6Ju27lbWZ 2024-09-16T03:42:07.034 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 874 2024-09-16T03:42:07.051 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.U6Ju27lbWZ 2024-09-16T03:42:07.051 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 874' 2024-09-16T03:42:07.070 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.U6Ju27lbWZ' 2024-09-16T03:42:07.072 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 874 2024-09-16T03:42:07.072 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.U6Ju27lbWZ 2024-09-16T03:42:07.073 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:42:07.073 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:42:07.073 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:42:07.074 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 875 2024-09-16T03:42:07.074 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=875 2024-09-16T03:42:07.074 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:42:07.074 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:42:07.074 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.GbpPvtXIBt 2024-09-16T03:42:07.075 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 875 -o /tmp/tmp.GbpPvtXIBt 2024-09-16T03:42:07.535 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 875 2024-09-16T03:42:07.554 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.GbpPvtXIBt 2024-09-16T03:42:07.554 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 875' 2024-09-16T03:42:07.574 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.GbpPvtXIBt' 2024-09-16T03:42:07.575 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 875 2024-09-16T03:42:07.576 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.GbpPvtXIBt 2024-09-16T03:42:07.577 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:42:07.577 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:42:07.577 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:42:07.577 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 876 2024-09-16T03:42:07.577 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=876 2024-09-16T03:42:07.577 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:42:07.577 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:42:07.578 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.0zaNNqAlC1 2024-09-16T03:42:07.579 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 876 -o /tmp/tmp.0zaNNqAlC1 2024-09-16T03:42:08.037 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 876 2024-09-16T03:42:08.056 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.0zaNNqAlC1 2024-09-16T03:42:08.056 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 876' 2024-09-16T03:42:08.077 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.0zaNNqAlC1' 2024-09-16T03:42:08.078 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 876 2024-09-16T03:42:08.078 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.0zaNNqAlC1 2024-09-16T03:42:08.080 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:42:08.080 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:42:08.080 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:42:08.080 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 877 2024-09-16T03:42:08.080 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=877 2024-09-16T03:42:08.080 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:42:08.080 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:42:08.080 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.rUckXibeX7 2024-09-16T03:42:08.081 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 877 -o /tmp/tmp.rUckXibeX7 2024-09-16T03:42:08.513 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 877 2024-09-16T03:42:08.530 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.rUckXibeX7 2024-09-16T03:42:08.530 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 877' 2024-09-16T03:42:08.549 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.rUckXibeX7' 2024-09-16T03:42:08.550 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 877 2024-09-16T03:42:08.551 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.rUckXibeX7 2024-09-16T03:42:08.552 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:42:08.552 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:42:08.552 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:42:08.552 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 878 2024-09-16T03:42:08.552 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=878 2024-09-16T03:42:08.552 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:42:08.552 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:42:08.553 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.IuNepT5SRW 2024-09-16T03:42:08.553 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 878 -o /tmp/tmp.IuNepT5SRW 2024-09-16T03:42:09.006 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 878 2024-09-16T03:42:09.024 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.IuNepT5SRW 2024-09-16T03:42:09.024 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 878' 2024-09-16T03:42:09.044 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.IuNepT5SRW' 2024-09-16T03:42:09.048 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 878 2024-09-16T03:42:09.049 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.IuNepT5SRW 2024-09-16T03:42:09.049 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:42:09.049 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:42:09.050 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:42:09.050 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 879 2024-09-16T03:42:09.050 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=879 2024-09-16T03:42:09.050 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:42:09.050 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:42:09.050 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.wTrw1JREdt 2024-09-16T03:42:09.050 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 879 -o /tmp/tmp.wTrw1JREdt 2024-09-16T03:42:09.508 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 879 2024-09-16T03:42:09.524 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.wTrw1JREdt 2024-09-16T03:42:09.525 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 879' 2024-09-16T03:42:09.544 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.wTrw1JREdt' 2024-09-16T03:42:09.545 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 879 2024-09-16T03:42:09.546 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.wTrw1JREdt 2024-09-16T03:42:09.547 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:42:09.547 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:42:09.547 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:42:09.547 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 880 2024-09-16T03:42:09.547 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=880 2024-09-16T03:42:09.548 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:42:09.548 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:42:09.548 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.YCd8xrfmpd 2024-09-16T03:42:09.548 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 880 -o /tmp/tmp.YCd8xrfmpd 2024-09-16T03:42:09.941 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 880 2024-09-16T03:42:09.957 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.YCd8xrfmpd 2024-09-16T03:42:09.957 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 880' 2024-09-16T03:42:09.976 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.YCd8xrfmpd' 2024-09-16T03:42:09.978 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 880 2024-09-16T03:42:09.978 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.YCd8xrfmpd 2024-09-16T03:42:09.979 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:42:09.979 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:42:09.980 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:42:09.980 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 881 2024-09-16T03:42:09.980 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=881 2024-09-16T03:42:09.980 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:42:09.980 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:42:09.980 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.e0GkTsioYr 2024-09-16T03:42:09.980 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 881 -o /tmp/tmp.e0GkTsioYr 2024-09-16T03:42:10.427 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 881 2024-09-16T03:42:10.445 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.e0GkTsioYr 2024-09-16T03:42:10.445 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 881' 2024-09-16T03:42:10.466 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.e0GkTsioYr' 2024-09-16T03:42:10.467 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 881 2024-09-16T03:42:10.468 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.e0GkTsioYr 2024-09-16T03:42:10.469 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:42:10.469 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:42:10.469 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:42:10.469 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 882 2024-09-16T03:42:10.470 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=882 2024-09-16T03:42:10.470 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:42:10.470 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:42:10.471 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.PEeUAW0fOd 2024-09-16T03:42:10.471 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 882 -o /tmp/tmp.PEeUAW0fOd 2024-09-16T03:42:10.878 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 882 2024-09-16T03:42:10.894 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.PEeUAW0fOd 2024-09-16T03:42:10.895 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 882' 2024-09-16T03:42:10.914 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.PEeUAW0fOd' 2024-09-16T03:42:10.915 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 882 2024-09-16T03:42:10.915 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.PEeUAW0fOd 2024-09-16T03:42:10.916 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:42:10.917 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:42:10.917 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:42:10.917 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 883 2024-09-16T03:42:10.917 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=883 2024-09-16T03:42:10.917 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:42:10.917 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:42:10.917 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.uhH650tPiT 2024-09-16T03:42:10.918 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 883 -o /tmp/tmp.uhH650tPiT 2024-09-16T03:42:11.378 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 883 2024-09-16T03:42:11.395 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.uhH650tPiT 2024-09-16T03:42:11.395 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 883' 2024-09-16T03:42:11.414 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.uhH650tPiT' 2024-09-16T03:42:11.416 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 883 2024-09-16T03:42:11.416 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.uhH650tPiT 2024-09-16T03:42:11.417 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:42:11.418 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:42:11.418 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:42:11.418 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 884 2024-09-16T03:42:11.418 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=884 2024-09-16T03:42:11.418 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:42:11.418 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:42:11.419 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.IzYQF7Dfh2 2024-09-16T03:42:11.419 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 884 -o /tmp/tmp.IzYQF7Dfh2 2024-09-16T03:42:11.864 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 884 2024-09-16T03:42:11.882 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.IzYQF7Dfh2 2024-09-16T03:42:11.882 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 884' 2024-09-16T03:42:11.901 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.IzYQF7Dfh2' 2024-09-16T03:42:11.902 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 884 2024-09-16T03:42:11.903 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.IzYQF7Dfh2 2024-09-16T03:42:11.904 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:42:11.904 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:42:11.904 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:42:11.904 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 885 2024-09-16T03:42:11.904 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=885 2024-09-16T03:42:11.904 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:42:11.904 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:42:11.905 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.B0LI2HhMLl 2024-09-16T03:42:11.905 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 885 -o /tmp/tmp.B0LI2HhMLl 2024-09-16T03:42:12.299 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 885 2024-09-16T03:42:12.316 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.B0LI2HhMLl 2024-09-16T03:42:12.316 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 885' 2024-09-16T03:42:12.335 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.B0LI2HhMLl' 2024-09-16T03:42:12.336 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 885 2024-09-16T03:42:12.336 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.B0LI2HhMLl 2024-09-16T03:42:12.338 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:42:12.338 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:42:12.338 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:42:12.338 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 886 2024-09-16T03:42:12.338 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=886 2024-09-16T03:42:12.338 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:42:12.338 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:42:12.338 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.JYb1bdvzyL 2024-09-16T03:42:12.339 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 886 -o /tmp/tmp.JYb1bdvzyL 2024-09-16T03:42:12.789 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 886 2024-09-16T03:42:12.807 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.JYb1bdvzyL 2024-09-16T03:42:12.807 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 886' 2024-09-16T03:42:12.827 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.JYb1bdvzyL' 2024-09-16T03:42:12.829 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 886 2024-09-16T03:42:12.829 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.JYb1bdvzyL 2024-09-16T03:42:12.830 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:42:12.830 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:42:12.830 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:42:12.830 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 887 2024-09-16T03:42:12.830 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=887 2024-09-16T03:42:12.830 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:42:12.831 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:42:12.831 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.fVvvvvTAzD 2024-09-16T03:42:12.831 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 887 -o /tmp/tmp.fVvvvvTAzD 2024-09-16T03:42:13.278 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 887 2024-09-16T03:42:13.296 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.fVvvvvTAzD 2024-09-16T03:42:13.296 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 887' 2024-09-16T03:42:13.311 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.fVvvvvTAzD' 2024-09-16T03:42:13.312 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 887 2024-09-16T03:42:13.313 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.fVvvvvTAzD 2024-09-16T03:42:13.314 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:42:13.314 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:42:13.314 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:42:13.314 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 888 2024-09-16T03:42:13.314 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=888 2024-09-16T03:42:13.314 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:42:13.314 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:42:13.315 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.3Z3Tb59X8B 2024-09-16T03:42:13.315 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 888 -o /tmp/tmp.3Z3Tb59X8B 2024-09-16T03:42:13.762 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 888 2024-09-16T03:42:13.780 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.3Z3Tb59X8B 2024-09-16T03:42:13.780 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 888' 2024-09-16T03:42:13.800 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.3Z3Tb59X8B' 2024-09-16T03:42:13.801 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 888 2024-09-16T03:42:13.802 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.3Z3Tb59X8B 2024-09-16T03:42:13.803 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:42:13.803 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:42:13.803 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:42:13.803 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 889 2024-09-16T03:42:13.803 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=889 2024-09-16T03:42:13.803 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:42:13.804 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:42:13.804 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.dXw8h56fOb 2024-09-16T03:42:13.804 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 889 -o /tmp/tmp.dXw8h56fOb 2024-09-16T03:42:14.264 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 889 2024-09-16T03:42:14.282 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.dXw8h56fOb 2024-09-16T03:42:14.282 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 889' 2024-09-16T03:42:14.297 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.dXw8h56fOb' 2024-09-16T03:42:14.298 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 889 2024-09-16T03:42:14.299 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.dXw8h56fOb 2024-09-16T03:42:14.300 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:42:14.300 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:42:14.300 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:42:14.300 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 890 2024-09-16T03:42:14.300 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=890 2024-09-16T03:42:14.301 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:42:14.301 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:42:14.301 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.TsGDVByiut 2024-09-16T03:42:14.301 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 890 -o /tmp/tmp.TsGDVByiut 2024-09-16T03:42:14.829 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 890 2024-09-16T03:42:14.848 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.TsGDVByiut 2024-09-16T03:42:14.849 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 890' 2024-09-16T03:42:14.866 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.TsGDVByiut' 2024-09-16T03:42:14.868 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 890 2024-09-16T03:42:14.868 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.TsGDVByiut 2024-09-16T03:42:14.869 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:42:14.870 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:42:14.870 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:42:14.870 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 891 2024-09-16T03:42:14.870 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=891 2024-09-16T03:42:14.870 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:42:14.870 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:42:14.870 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.FXpghOoLlO 2024-09-16T03:42:14.870 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 891 -o /tmp/tmp.FXpghOoLlO 2024-09-16T03:42:15.334 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 891 2024-09-16T03:42:15.351 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 891' 2024-09-16T03:42:15.352 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.FXpghOoLlO 2024-09-16T03:42:15.371 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.FXpghOoLlO' 2024-09-16T03:42:15.373 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 891 2024-09-16T03:42:15.373 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.FXpghOoLlO 2024-09-16T03:42:15.375 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:42:15.375 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:42:15.375 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:42:15.375 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 892 2024-09-16T03:42:15.375 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=892 2024-09-16T03:42:15.375 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:42:15.375 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:42:15.376 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.8BrlFUdTaX 2024-09-16T03:42:15.376 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 892 -o /tmp/tmp.8BrlFUdTaX 2024-09-16T03:42:15.778 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 892 2024-09-16T03:42:15.796 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.8BrlFUdTaX 2024-09-16T03:42:15.796 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 892' 2024-09-16T03:42:15.813 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.8BrlFUdTaX' 2024-09-16T03:42:15.815 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 892 2024-09-16T03:42:15.815 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.8BrlFUdTaX 2024-09-16T03:42:15.816 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:42:15.816 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:42:15.816 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:42:15.816 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 893 2024-09-16T03:42:15.816 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=893 2024-09-16T03:42:15.816 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:42:15.816 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:42:15.817 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.wQthoiPDzY 2024-09-16T03:42:15.817 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 893 -o /tmp/tmp.wQthoiPDzY 2024-09-16T03:42:16.345 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 893 2024-09-16T03:42:16.362 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.wQthoiPDzY 2024-09-16T03:42:16.362 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 893' 2024-09-16T03:42:16.382 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.wQthoiPDzY' 2024-09-16T03:42:16.384 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 893 2024-09-16T03:42:16.384 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.wQthoiPDzY 2024-09-16T03:42:16.385 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:42:16.385 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:42:16.385 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:42:16.385 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 894 2024-09-16T03:42:16.385 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=894 2024-09-16T03:42:16.386 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:42:16.386 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:42:16.387 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.7t03UMVXlW 2024-09-16T03:42:16.387 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 894 -o /tmp/tmp.7t03UMVXlW 2024-09-16T03:42:16.772 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 894 2024-09-16T03:42:16.788 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.7t03UMVXlW 2024-09-16T03:42:16.788 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 894' 2024-09-16T03:42:16.809 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.7t03UMVXlW' 2024-09-16T03:42:16.810 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 894 2024-09-16T03:42:16.810 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.7t03UMVXlW 2024-09-16T03:42:16.812 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:42:16.812 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:42:16.812 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:42:16.812 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 895 2024-09-16T03:42:16.812 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=895 2024-09-16T03:42:16.812 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:42:16.812 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:42:16.813 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.zq27XeHDVF 2024-09-16T03:42:16.813 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 895 -o /tmp/tmp.zq27XeHDVF 2024-09-16T03:42:17.263 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 895 2024-09-16T03:42:17.278 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.zq27XeHDVF 2024-09-16T03:42:17.278 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 895' 2024-09-16T03:42:17.298 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.zq27XeHDVF' 2024-09-16T03:42:17.299 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 895 2024-09-16T03:42:17.300 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.zq27XeHDVF 2024-09-16T03:42:17.301 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:42:17.301 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:42:17.301 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:42:17.301 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 896 2024-09-16T03:42:17.301 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=896 2024-09-16T03:42:17.301 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:42:17.301 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:42:17.302 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.E4aQqbPntW 2024-09-16T03:42:17.302 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 896 -o /tmp/tmp.E4aQqbPntW 2024-09-16T03:42:17.759 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 896 2024-09-16T03:42:17.777 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.E4aQqbPntW 2024-09-16T03:42:17.777 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 896' 2024-09-16T03:42:17.798 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.E4aQqbPntW' 2024-09-16T03:42:17.799 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 896 2024-09-16T03:42:17.800 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.E4aQqbPntW 2024-09-16T03:42:17.801 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:42:17.801 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:42:17.801 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:42:17.801 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 897 2024-09-16T03:42:17.801 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=897 2024-09-16T03:42:17.801 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:42:17.802 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:42:17.802 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.jznqCvuGRy 2024-09-16T03:42:17.802 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 897 -o /tmp/tmp.jznqCvuGRy 2024-09-16T03:42:18.243 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 897 2024-09-16T03:42:18.260 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.jznqCvuGRy 2024-09-16T03:42:18.260 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 897' 2024-09-16T03:42:18.279 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.jznqCvuGRy' 2024-09-16T03:42:18.281 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 897 2024-09-16T03:42:18.281 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.jznqCvuGRy 2024-09-16T03:42:18.282 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:42:18.282 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:42:18.282 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:42:18.282 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 898 2024-09-16T03:42:18.282 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=898 2024-09-16T03:42:18.282 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:42:18.283 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:42:18.283 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.9ZC6M72rLx 2024-09-16T03:42:18.283 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 898 -o /tmp/tmp.9ZC6M72rLx 2024-09-16T03:42:18.750 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 898 2024-09-16T03:42:18.767 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.9ZC6M72rLx 2024-09-16T03:42:18.767 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 898' 2024-09-16T03:42:18.782 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.9ZC6M72rLx' 2024-09-16T03:42:18.783 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 898 2024-09-16T03:42:18.783 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.9ZC6M72rLx 2024-09-16T03:42:18.785 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:42:18.785 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:42:18.785 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:42:18.785 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 899 2024-09-16T03:42:18.785 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=899 2024-09-16T03:42:18.785 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:42:18.785 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:42:18.786 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.1cTdZCrxqT 2024-09-16T03:42:18.786 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 899 -o /tmp/tmp.1cTdZCrxqT 2024-09-16T03:42:19.238 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 899 2024-09-16T03:42:19.255 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.1cTdZCrxqT 2024-09-16T03:42:19.255 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 899' 2024-09-16T03:42:19.274 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.1cTdZCrxqT' 2024-09-16T03:42:19.275 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 899 2024-09-16T03:42:19.276 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.1cTdZCrxqT 2024-09-16T03:42:19.277 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:42:19.277 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:42:19.277 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:42:19.277 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 900 2024-09-16T03:42:19.277 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=900 2024-09-16T03:42:19.278 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:42:19.278 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:42:19.278 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.J4A9YYTl3L 2024-09-16T03:42:19.278 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 900 -o /tmp/tmp.J4A9YYTl3L 2024-09-16T03:42:19.672 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 900 2024-09-16T03:42:19.688 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.J4A9YYTl3L 2024-09-16T03:42:19.689 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 900' 2024-09-16T03:42:19.709 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.J4A9YYTl3L' 2024-09-16T03:42:19.711 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 900 2024-09-16T03:42:19.711 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.J4A9YYTl3L 2024-09-16T03:42:19.712 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:42:19.712 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:42:19.712 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:42:19.712 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 901 2024-09-16T03:42:19.713 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=901 2024-09-16T03:42:19.713 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:42:19.713 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:42:19.713 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.4DjmfxoMoN 2024-09-16T03:42:19.713 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 901 -o /tmp/tmp.4DjmfxoMoN 2024-09-16T03:42:20.158 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 901 2024-09-16T03:42:20.175 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.4DjmfxoMoN 2024-09-16T03:42:20.175 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 901' 2024-09-16T03:42:20.194 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.4DjmfxoMoN' 2024-09-16T03:42:20.196 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 901 2024-09-16T03:42:20.196 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.4DjmfxoMoN 2024-09-16T03:42:20.197 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:42:20.197 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:42:20.198 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:42:20.198 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 902 2024-09-16T03:42:20.198 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=902 2024-09-16T03:42:20.198 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:42:20.198 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:42:20.198 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.YT8ZxWXDND 2024-09-16T03:42:20.199 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 902 -o /tmp/tmp.YT8ZxWXDND 2024-09-16T03:42:20.659 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 902 2024-09-16T03:42:20.677 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.YT8ZxWXDND 2024-09-16T03:42:20.677 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 902' 2024-09-16T03:42:20.697 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.YT8ZxWXDND' 2024-09-16T03:42:20.699 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 902 2024-09-16T03:42:20.699 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.YT8ZxWXDND 2024-09-16T03:42:20.700 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:42:20.701 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:42:20.701 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:42:20.701 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 903 2024-09-16T03:42:20.701 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=903 2024-09-16T03:42:20.701 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:42:20.701 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:42:20.701 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.q6qr9rFhAG 2024-09-16T03:42:20.702 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 903 -o /tmp/tmp.q6qr9rFhAG 2024-09-16T03:42:21.169 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 903 2024-09-16T03:42:21.186 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.q6qr9rFhAG 2024-09-16T03:42:21.186 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 903' 2024-09-16T03:42:21.203 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.q6qr9rFhAG' 2024-09-16T03:42:21.204 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 903 2024-09-16T03:42:21.204 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.q6qr9rFhAG 2024-09-16T03:42:21.206 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:42:21.206 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:42:21.206 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:42:21.206 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 904 2024-09-16T03:42:21.206 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=904 2024-09-16T03:42:21.206 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:42:21.206 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:42:21.207 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.EOdXTPjdBn 2024-09-16T03:42:21.207 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 904 -o /tmp/tmp.EOdXTPjdBn 2024-09-16T03:42:21.641 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 904 2024-09-16T03:42:21.659 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.EOdXTPjdBn 2024-09-16T03:42:21.659 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 904' 2024-09-16T03:42:21.679 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.EOdXTPjdBn' 2024-09-16T03:42:21.681 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 904 2024-09-16T03:42:21.681 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.EOdXTPjdBn 2024-09-16T03:42:21.682 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:42:21.682 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:42:21.682 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:42:21.682 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 905 2024-09-16T03:42:21.683 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=905 2024-09-16T03:42:21.683 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:42:21.683 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:42:21.683 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.PbnXjirNbl 2024-09-16T03:42:21.683 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 905 -o /tmp/tmp.PbnXjirNbl 2024-09-16T03:42:22.091 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 905 2024-09-16T03:42:22.107 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.PbnXjirNbl 2024-09-16T03:42:22.107 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 905' 2024-09-16T03:42:22.127 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.PbnXjirNbl' 2024-09-16T03:42:22.128 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 905 2024-09-16T03:42:22.128 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.PbnXjirNbl 2024-09-16T03:42:22.130 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:42:22.130 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:42:22.130 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:42:22.130 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 906 2024-09-16T03:42:22.130 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=906 2024-09-16T03:42:22.130 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:42:22.130 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:42:22.131 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.L17Vl9otz5 2024-09-16T03:42:22.131 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 906 -o /tmp/tmp.L17Vl9otz5 2024-09-16T03:42:22.591 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 906 2024-09-16T03:42:22.609 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.L17Vl9otz5 2024-09-16T03:42:22.609 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 906' 2024-09-16T03:42:22.629 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.L17Vl9otz5' 2024-09-16T03:42:22.630 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 906 2024-09-16T03:42:22.631 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.L17Vl9otz5 2024-09-16T03:42:22.632 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:42:22.632 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:42:22.632 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:42:22.632 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 907 2024-09-16T03:42:22.632 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=907 2024-09-16T03:42:22.633 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:42:22.633 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:42:22.633 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.juvvtZSq8c 2024-09-16T03:42:22.633 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 907 -o /tmp/tmp.juvvtZSq8c 2024-09-16T03:42:23.051 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 907 2024-09-16T03:42:23.067 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.juvvtZSq8c 2024-09-16T03:42:23.067 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 907' 2024-09-16T03:42:23.086 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.juvvtZSq8c' 2024-09-16T03:42:23.088 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 907 2024-09-16T03:42:23.088 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.juvvtZSq8c 2024-09-16T03:42:23.089 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:42:23.089 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:42:23.089 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:42:23.090 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 908 2024-09-16T03:42:23.090 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=908 2024-09-16T03:42:23.090 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:42:23.090 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:42:23.090 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.Y8jEcog1d6 2024-09-16T03:42:23.090 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 908 -o /tmp/tmp.Y8jEcog1d6 2024-09-16T03:42:23.552 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 908 2024-09-16T03:42:23.569 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.Y8jEcog1d6 2024-09-16T03:42:23.572 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 908' 2024-09-16T03:42:23.589 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.Y8jEcog1d6' 2024-09-16T03:42:23.591 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 908 2024-09-16T03:42:23.591 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.Y8jEcog1d6 2024-09-16T03:42:23.592 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:42:23.592 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:42:23.592 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:42:23.593 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 909 2024-09-16T03:42:23.593 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=909 2024-09-16T03:42:23.593 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:42:23.593 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:42:23.593 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.E97Y5gZpNW 2024-09-16T03:42:23.593 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 909 -o /tmp/tmp.E97Y5gZpNW 2024-09-16T03:42:24.011 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 909 2024-09-16T03:42:24.027 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.E97Y5gZpNW 2024-09-16T03:42:24.028 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 909' 2024-09-16T03:42:24.047 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.E97Y5gZpNW' 2024-09-16T03:42:24.048 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 909 2024-09-16T03:42:24.049 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.E97Y5gZpNW 2024-09-16T03:42:24.050 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:42:24.050 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:42:24.050 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:42:24.050 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 910 2024-09-16T03:42:24.050 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=910 2024-09-16T03:42:24.050 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:42:24.051 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:42:24.051 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.gnJxWQYqsz 2024-09-16T03:42:24.051 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 910 -o /tmp/tmp.gnJxWQYqsz 2024-09-16T03:42:24.522 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 910 2024-09-16T03:42:24.538 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.gnJxWQYqsz 2024-09-16T03:42:24.538 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 910' 2024-09-16T03:42:24.557 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.gnJxWQYqsz' 2024-09-16T03:42:24.559 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 910 2024-09-16T03:42:24.559 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.gnJxWQYqsz 2024-09-16T03:42:24.560 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:42:24.560 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:42:24.561 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:42:24.561 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 911 2024-09-16T03:42:24.561 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=911 2024-09-16T03:42:24.561 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:42:24.561 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:42:24.561 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.2EuArmXwJ0 2024-09-16T03:42:24.561 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 911 -o /tmp/tmp.2EuArmXwJ0 2024-09-16T03:42:24.957 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 911 2024-09-16T03:42:24.974 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.2EuArmXwJ0 2024-09-16T03:42:24.974 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 911' 2024-09-16T03:42:24.993 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.2EuArmXwJ0' 2024-09-16T03:42:24.995 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 911 2024-09-16T03:42:24.995 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.2EuArmXwJ0 2024-09-16T03:42:24.996 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:42:24.996 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:42:24.997 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:42:24.997 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 912 2024-09-16T03:42:24.997 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=912 2024-09-16T03:42:24.997 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:42:24.997 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:42:24.997 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.qJyGMlJeEj 2024-09-16T03:42:24.997 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 912 -o /tmp/tmp.qJyGMlJeEj 2024-09-16T03:42:25.450 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 912 2024-09-16T03:42:25.467 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.qJyGMlJeEj 2024-09-16T03:42:25.467 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 912' 2024-09-16T03:42:25.486 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.qJyGMlJeEj' 2024-09-16T03:42:25.488 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 912 2024-09-16T03:42:25.489 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.qJyGMlJeEj 2024-09-16T03:42:25.490 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:42:25.491 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:42:25.491 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:42:25.491 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 913 2024-09-16T03:42:25.491 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=913 2024-09-16T03:42:25.491 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:42:25.492 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:42:25.492 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.j85d3Oto0F 2024-09-16T03:42:25.492 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 913 -o /tmp/tmp.j85d3Oto0F 2024-09-16T03:42:25.951 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 913 2024-09-16T03:42:25.969 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.j85d3Oto0F 2024-09-16T03:42:25.969 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 913' 2024-09-16T03:42:25.990 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.j85d3Oto0F' 2024-09-16T03:42:25.991 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 913 2024-09-16T03:42:25.991 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.j85d3Oto0F 2024-09-16T03:42:25.993 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:42:25.993 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:42:25.993 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:42:25.993 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 914 2024-09-16T03:42:25.993 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=914 2024-09-16T03:42:25.993 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:42:25.993 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:42:25.993 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.R3URfMtl22 2024-09-16T03:42:25.994 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 914 -o /tmp/tmp.R3URfMtl22 2024-09-16T03:42:26.436 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 914 2024-09-16T03:42:26.454 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.R3URfMtl22 2024-09-16T03:42:26.454 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 914' 2024-09-16T03:42:26.473 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.R3URfMtl22' 2024-09-16T03:42:26.475 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 914 2024-09-16T03:42:26.475 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.R3URfMtl22 2024-09-16T03:42:26.476 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:42:26.476 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:42:26.476 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:42:26.476 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 915 2024-09-16T03:42:26.476 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=915 2024-09-16T03:42:26.477 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:42:26.477 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:42:26.477 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.C0wGdYFAFb 2024-09-16T03:42:26.477 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 915 -o /tmp/tmp.C0wGdYFAFb 2024-09-16T03:42:26.937 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 915 2024-09-16T03:42:26.953 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.C0wGdYFAFb 2024-09-16T03:42:26.954 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 915' 2024-09-16T03:42:26.973 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.C0wGdYFAFb' 2024-09-16T03:42:26.974 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 915 2024-09-16T03:42:26.975 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.C0wGdYFAFb 2024-09-16T03:42:26.976 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:42:26.976 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:42:26.976 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:42:26.976 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 916 2024-09-16T03:42:26.976 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=916 2024-09-16T03:42:26.976 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:42:26.976 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:42:26.977 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.HBlGgj1ZY3 2024-09-16T03:42:26.977 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 916 -o /tmp/tmp.HBlGgj1ZY3 2024-09-16T03:42:27.405 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 916 2024-09-16T03:42:27.421 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.HBlGgj1ZY3 2024-09-16T03:42:27.421 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 916' 2024-09-16T03:42:27.441 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.HBlGgj1ZY3' 2024-09-16T03:42:27.442 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 916 2024-09-16T03:42:27.442 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.HBlGgj1ZY3 2024-09-16T03:42:27.444 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:42:27.444 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:42:27.444 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:42:27.444 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 917 2024-09-16T03:42:27.444 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=917 2024-09-16T03:42:27.444 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:42:27.444 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:42:27.445 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.VryRbkSk8W 2024-09-16T03:42:27.445 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 917 -o /tmp/tmp.VryRbkSk8W 2024-09-16T03:42:27.890 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 917 2024-09-16T03:42:27.907 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.VryRbkSk8W 2024-09-16T03:42:27.907 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 917' 2024-09-16T03:42:27.927 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.VryRbkSk8W' 2024-09-16T03:42:27.928 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 917 2024-09-16T03:42:27.928 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.VryRbkSk8W 2024-09-16T03:42:27.929 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:42:27.929 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:42:27.929 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:42:27.929 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 918 2024-09-16T03:42:27.930 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=918 2024-09-16T03:42:27.930 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:42:27.930 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:42:27.930 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.cz34WsTfhB 2024-09-16T03:42:27.930 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 918 -o /tmp/tmp.cz34WsTfhB 2024-09-16T03:42:28.366 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 918 2024-09-16T03:42:28.382 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.cz34WsTfhB 2024-09-16T03:42:28.382 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 918' 2024-09-16T03:42:28.402 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.cz34WsTfhB' 2024-09-16T03:42:28.404 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 918 2024-09-16T03:42:28.404 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.cz34WsTfhB 2024-09-16T03:42:28.405 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:42:28.405 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:42:28.405 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:42:28.405 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 919 2024-09-16T03:42:28.405 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=919 2024-09-16T03:42:28.406 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:42:28.406 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:42:28.406 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.1Fvlbi0nAH 2024-09-16T03:42:28.406 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 919 -o /tmp/tmp.1Fvlbi0nAH 2024-09-16T03:42:28.868 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 919 2024-09-16T03:42:28.885 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 919' 2024-09-16T03:42:28.885 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.1Fvlbi0nAH 2024-09-16T03:42:28.905 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.1Fvlbi0nAH' 2024-09-16T03:42:28.907 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 919 2024-09-16T03:42:28.907 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.1Fvlbi0nAH 2024-09-16T03:42:28.908 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:42:28.908 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:42:28.908 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:42:28.909 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 920 2024-09-16T03:42:28.909 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=920 2024-09-16T03:42:28.909 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:42:28.909 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:42:28.909 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.YyGGhKELxq 2024-09-16T03:42:28.909 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 920 -o /tmp/tmp.YyGGhKELxq 2024-09-16T03:42:29.352 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 920 2024-09-16T03:42:29.369 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.YyGGhKELxq 2024-09-16T03:42:29.369 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 920' 2024-09-16T03:42:29.383 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.YyGGhKELxq' 2024-09-16T03:42:29.385 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 920 2024-09-16T03:42:29.385 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.YyGGhKELxq 2024-09-16T03:42:29.386 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:42:29.387 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:42:29.387 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:42:29.387 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 921 2024-09-16T03:42:29.387 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=921 2024-09-16T03:42:29.387 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:42:29.387 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:42:29.387 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.IEAUmkuXey 2024-09-16T03:42:29.388 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 921 -o /tmp/tmp.IEAUmkuXey 2024-09-16T03:42:29.805 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 921 2024-09-16T03:42:29.822 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.IEAUmkuXey 2024-09-16T03:42:29.822 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 921' 2024-09-16T03:42:29.841 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.IEAUmkuXey' 2024-09-16T03:42:29.842 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 921 2024-09-16T03:42:29.843 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.IEAUmkuXey 2024-09-16T03:42:29.844 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:42:29.844 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:42:29.844 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i <= 921 )) 2024-09-16T03:42:29.844 INFO:tasks.workunit.client.0.smithi096.stderr:++ ceph report 2024-09-16T03:42:29.845 INFO:tasks.workunit.client.0.smithi096.stderr:++ jq .osdmap_manifest 2024-09-16T03:42:30.382 INFO:tasks.workunit.client.0.smithi096.stderr:report 2089123948 2024-09-16T03:42:30.397 INFO:tasks.workunit.client.0.smithi096.stderr:+ manifest='{ 2024-09-16T03:42:30.398 INFO:tasks.workunit.client.0.smithi096.stderr: "first_pinned": 1, 2024-09-16T03:42:30.398 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pinned": 921, 2024-09-16T03:42:30.398 INFO:tasks.workunit.client.0.smithi096.stderr: "pinned_maps": [ 2024-09-16T03:42:30.398 INFO:tasks.workunit.client.0.smithi096.stderr: 1, 2024-09-16T03:42:30.398 INFO:tasks.workunit.client.0.smithi096.stderr: 11, 2024-09-16T03:42:30.398 INFO:tasks.workunit.client.0.smithi096.stderr: 21, 2024-09-16T03:42:30.398 INFO:tasks.workunit.client.0.smithi096.stderr: 31, 2024-09-16T03:42:30.398 INFO:tasks.workunit.client.0.smithi096.stderr: 41, 2024-09-16T03:42:30.398 INFO:tasks.workunit.client.0.smithi096.stderr: 51, 2024-09-16T03:42:30.398 INFO:tasks.workunit.client.0.smithi096.stderr: 61, 2024-09-16T03:42:30.398 INFO:tasks.workunit.client.0.smithi096.stderr: 71, 2024-09-16T03:42:30.398 INFO:tasks.workunit.client.0.smithi096.stderr: 81, 2024-09-16T03:42:30.399 INFO:tasks.workunit.client.0.smithi096.stderr: 91, 2024-09-16T03:42:30.399 INFO:tasks.workunit.client.0.smithi096.stderr: 101, 2024-09-16T03:42:30.399 INFO:tasks.workunit.client.0.smithi096.stderr: 111, 2024-09-16T03:42:30.399 INFO:tasks.workunit.client.0.smithi096.stderr: 121, 2024-09-16T03:42:30.399 INFO:tasks.workunit.client.0.smithi096.stderr: 131, 2024-09-16T03:42:30.399 INFO:tasks.workunit.client.0.smithi096.stderr: 141, 2024-09-16T03:42:30.399 INFO:tasks.workunit.client.0.smithi096.stderr: 151, 2024-09-16T03:42:30.399 INFO:tasks.workunit.client.0.smithi096.stderr: 161, 2024-09-16T03:42:30.399 INFO:tasks.workunit.client.0.smithi096.stderr: 171, 2024-09-16T03:42:30.399 INFO:tasks.workunit.client.0.smithi096.stderr: 181, 2024-09-16T03:42:30.399 INFO:tasks.workunit.client.0.smithi096.stderr: 191, 2024-09-16T03:42:30.399 INFO:tasks.workunit.client.0.smithi096.stderr: 201, 2024-09-16T03:42:30.399 INFO:tasks.workunit.client.0.smithi096.stderr: 211, 2024-09-16T03:42:30.400 INFO:tasks.workunit.client.0.smithi096.stderr: 221, 2024-09-16T03:42:30.400 INFO:tasks.workunit.client.0.smithi096.stderr: 231, 2024-09-16T03:42:30.400 INFO:tasks.workunit.client.0.smithi096.stderr: 241, 2024-09-16T03:42:30.400 INFO:tasks.workunit.client.0.smithi096.stderr: 251, 2024-09-16T03:42:30.400 INFO:tasks.workunit.client.0.smithi096.stderr: 261, 2024-09-16T03:42:30.400 INFO:tasks.workunit.client.0.smithi096.stderr: 271, 2024-09-16T03:42:30.400 INFO:tasks.workunit.client.0.smithi096.stderr: 281, 2024-09-16T03:42:30.400 INFO:tasks.workunit.client.0.smithi096.stderr: 291, 2024-09-16T03:42:30.400 INFO:tasks.workunit.client.0.smithi096.stderr: 301, 2024-09-16T03:42:30.400 INFO:tasks.workunit.client.0.smithi096.stderr: 311, 2024-09-16T03:42:30.401 INFO:tasks.workunit.client.0.smithi096.stderr: 321, 2024-09-16T03:42:30.401 INFO:tasks.workunit.client.0.smithi096.stderr: 331, 2024-09-16T03:42:30.401 INFO:tasks.workunit.client.0.smithi096.stderr: 341, 2024-09-16T03:42:30.401 INFO:tasks.workunit.client.0.smithi096.stderr: 351, 2024-09-16T03:42:30.401 INFO:tasks.workunit.client.0.smithi096.stderr: 361, 2024-09-16T03:42:30.401 INFO:tasks.workunit.client.0.smithi096.stderr: 371, 2024-09-16T03:42:30.401 INFO:tasks.workunit.client.0.smithi096.stderr: 381, 2024-09-16T03:42:30.401 INFO:tasks.workunit.client.0.smithi096.stderr: 391, 2024-09-16T03:42:30.401 INFO:tasks.workunit.client.0.smithi096.stderr: 401, 2024-09-16T03:42:30.401 INFO:tasks.workunit.client.0.smithi096.stderr: 411, 2024-09-16T03:42:30.401 INFO:tasks.workunit.client.0.smithi096.stderr: 421, 2024-09-16T03:42:30.401 INFO:tasks.workunit.client.0.smithi096.stderr: 431, 2024-09-16T03:42:30.401 INFO:tasks.workunit.client.0.smithi096.stderr: 441, 2024-09-16T03:42:30.402 INFO:tasks.workunit.client.0.smithi096.stderr: 451, 2024-09-16T03:42:30.402 INFO:tasks.workunit.client.0.smithi096.stderr: 461, 2024-09-16T03:42:30.402 INFO:tasks.workunit.client.0.smithi096.stderr: 471, 2024-09-16T03:42:30.402 INFO:tasks.workunit.client.0.smithi096.stderr: 481, 2024-09-16T03:42:30.402 INFO:tasks.workunit.client.0.smithi096.stderr: 491, 2024-09-16T03:42:30.402 INFO:tasks.workunit.client.0.smithi096.stderr: 501, 2024-09-16T03:42:30.402 INFO:tasks.workunit.client.0.smithi096.stderr: 511, 2024-09-16T03:42:30.402 INFO:tasks.workunit.client.0.smithi096.stderr: 521, 2024-09-16T03:42:30.402 INFO:tasks.workunit.client.0.smithi096.stderr: 531, 2024-09-16T03:42:30.402 INFO:tasks.workunit.client.0.smithi096.stderr: 541, 2024-09-16T03:42:30.402 INFO:tasks.workunit.client.0.smithi096.stderr: 551, 2024-09-16T03:42:30.403 INFO:tasks.workunit.client.0.smithi096.stderr: 561, 2024-09-16T03:42:30.403 INFO:tasks.workunit.client.0.smithi096.stderr: 571, 2024-09-16T03:42:30.403 INFO:tasks.workunit.client.0.smithi096.stderr: 581, 2024-09-16T03:42:30.403 INFO:tasks.workunit.client.0.smithi096.stderr: 591, 2024-09-16T03:42:30.403 INFO:tasks.workunit.client.0.smithi096.stderr: 601, 2024-09-16T03:42:30.403 INFO:tasks.workunit.client.0.smithi096.stderr: 611, 2024-09-16T03:42:30.403 INFO:tasks.workunit.client.0.smithi096.stderr: 621, 2024-09-16T03:42:30.403 INFO:tasks.workunit.client.0.smithi096.stderr: 631, 2024-09-16T03:42:30.403 INFO:tasks.workunit.client.0.smithi096.stderr: 641, 2024-09-16T03:42:30.403 INFO:tasks.workunit.client.0.smithi096.stderr: 651, 2024-09-16T03:42:30.403 INFO:tasks.workunit.client.0.smithi096.stderr: 661, 2024-09-16T03:42:30.403 INFO:tasks.workunit.client.0.smithi096.stderr: 671, 2024-09-16T03:42:30.403 INFO:tasks.workunit.client.0.smithi096.stderr: 681, 2024-09-16T03:42:30.403 INFO:tasks.workunit.client.0.smithi096.stderr: 691, 2024-09-16T03:42:30.404 INFO:tasks.workunit.client.0.smithi096.stderr: 701, 2024-09-16T03:42:30.404 INFO:tasks.workunit.client.0.smithi096.stderr: 711, 2024-09-16T03:42:30.404 INFO:tasks.workunit.client.0.smithi096.stderr: 721, 2024-09-16T03:42:30.404 INFO:tasks.workunit.client.0.smithi096.stderr: 731, 2024-09-16T03:42:30.404 INFO:tasks.workunit.client.0.smithi096.stderr: 741, 2024-09-16T03:42:30.404 INFO:tasks.workunit.client.0.smithi096.stderr: 751, 2024-09-16T03:42:30.404 INFO:tasks.workunit.client.0.smithi096.stderr: 761, 2024-09-16T03:42:30.404 INFO:tasks.workunit.client.0.smithi096.stderr: 771, 2024-09-16T03:42:30.404 INFO:tasks.workunit.client.0.smithi096.stderr: 781, 2024-09-16T03:42:30.404 INFO:tasks.workunit.client.0.smithi096.stderr: 791, 2024-09-16T03:42:30.404 INFO:tasks.workunit.client.0.smithi096.stderr: 801, 2024-09-16T03:42:30.405 INFO:tasks.workunit.client.0.smithi096.stderr: 811, 2024-09-16T03:42:30.405 INFO:tasks.workunit.client.0.smithi096.stderr: 821, 2024-09-16T03:42:30.405 INFO:tasks.workunit.client.0.smithi096.stderr: 831, 2024-09-16T03:42:30.405 INFO:tasks.workunit.client.0.smithi096.stderr: 841, 2024-09-16T03:42:30.405 INFO:tasks.workunit.client.0.smithi096.stderr: 851, 2024-09-16T03:42:30.405 INFO:tasks.workunit.client.0.smithi096.stderr: 861, 2024-09-16T03:42:30.405 INFO:tasks.workunit.client.0.smithi096.stderr: 871, 2024-09-16T03:42:30.405 INFO:tasks.workunit.client.0.smithi096.stderr: 881, 2024-09-16T03:42:30.405 INFO:tasks.workunit.client.0.smithi096.stderr: 891, 2024-09-16T03:42:30.405 INFO:tasks.workunit.client.0.smithi096.stderr: 901, 2024-09-16T03:42:30.405 INFO:tasks.workunit.client.0.smithi096.stderr: 911, 2024-09-16T03:42:30.405 INFO:tasks.workunit.client.0.smithi096.stderr: 921 2024-09-16T03:42:30.405 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:42:30.405 INFO:tasks.workunit.client.0.smithi096.stderr:}' 2024-09-16T03:42:30.406 INFO:tasks.workunit.client.0.smithi096.stderr:++ jq .first_pinned 2024-09-16T03:42:30.430 INFO:tasks.workunit.client.0.smithi096.stderr:+ first_pinned=1 2024-09-16T03:42:30.430 INFO:tasks.workunit.client.0.smithi096.stderr:++ jq .last_pinned 2024-09-16T03:42:30.462 INFO:tasks.workunit.client.0.smithi096.stderr:+ last_pinned=921 2024-09-16T03:42:30.462 INFO:tasks.workunit.client.0.smithi096.stderr:+ pinned_maps=($(jq '.pinned_maps[]' <<< $manifest)) 2024-09-16T03:42:30.463 INFO:tasks.workunit.client.0.smithi096.stderr:++ jq '.pinned_maps[]' 2024-09-16T03:42:30.492 INFO:tasks.workunit.client.0.smithi096.stderr:+ [[ 93 -gt 10 ]] 2024-09-16T03:42:30.492 INFO:tasks.workunit.client.0.smithi096.stderr:+ trim_to=11 2024-09-16T03:42:30.492 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph config set mon mon_osd_force_trim_to 11 2024-09-16T03:42:30.985 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph config set mon mon_min_osdmap_epochs 100 2024-09-16T03:42:31.413 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph config set mon paxos_service_trim_min 1 2024-09-16T03:42:31.911 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph config set mon mon_debug_block_osdmap_trim false 2024-09-16T03:42:32.396 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:42:33.059 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:42:33.078 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:42:33.711 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:42:33.786 INFO:tasks.workunit.client.0.smithi096.stderr:+ wait_for_trim 11 2024-09-16T03:42:33.786 INFO:tasks.workunit.client.0.smithi096.stderr:+ local -i epoch=11 2024-09-16T03:42:33.786 INFO:tasks.workunit.client.0.smithi096.stderr:++ get_timeout_delays 300 .1 2024-09-16T03:42:33.786 INFO:tasks.workunit.client.0.smithi096.stderr:+++ shopt -q -o xtrace 2024-09-16T03:42:33.787 INFO:tasks.workunit.client.0.smithi096.stderr:+++ echo true 2024-09-16T03:42:33.787 INFO:tasks.workunit.client.0.smithi096.stderr:++ local trace=true 2024-09-16T03:42:33.787 INFO:tasks.workunit.client.0.smithi096.stderr:++ true 2024-09-16T03:42:33.787 INFO:tasks.workunit.client.0.smithi096.stderr:++ shopt -u -o xtrace 2024-09-16T03:42:33.943 INFO:tasks.workunit.client.0.smithi096.stderr:+ delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '4.5') 2024-09-16T03:42:33.944 INFO:tasks.workunit.client.0.smithi096.stderr:+ local -a delays 2024-09-16T03:42:33.944 INFO:tasks.workunit.client.0.smithi096.stderr:+ local -i loop=0 2024-09-16T03:42:33.944 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i=0 )) 2024-09-16T03:42:33.944 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < 27 )) 2024-09-16T03:42:33.944 INFO:tasks.workunit.client.0.smithi096.stderr:++ ceph report 2024-09-16T03:42:33.944 INFO:tasks.workunit.client.0.smithi096.stderr:++ jq .osdmap_first_committed 2024-09-16T03:42:34.562 INFO:tasks.workunit.client.0.smithi096.stderr:report 1768268833 2024-09-16T03:42:34.578 INFO:tasks.workunit.client.0.smithi096.stderr:+ fc=11 2024-09-16T03:42:34.578 INFO:tasks.workunit.client.0.smithi096.stderr:+ [[ 11 -eq 11 ]] 2024-09-16T03:42:34.578 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:42:34.578 INFO:tasks.workunit.client.0.smithi096.stderr:++ ceph report 2024-09-16T03:42:35.116 INFO:tasks.workunit.client.0.smithi096.stderr:report 1408024933 2024-09-16T03:42:35.132 INFO:tasks.workunit.client.0.smithi096.stderr:+ report='{ 2024-09-16T03:42:35.133 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_fingerprint": "eaf2fd8a-7c8d-4abd-8137-a2b360091b66", 2024-09-16T03:42:35.133 INFO:tasks.workunit.client.0.smithi096.stderr: "version": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:42:35.133 INFO:tasks.workunit.client.0.smithi096.stderr: "commit": "fc3e0bff7468fd55478adbae7f75508b749124b6", 2024-09-16T03:42:35.133 INFO:tasks.workunit.client.0.smithi096.stderr: "timestamp": "2024-09-16T03:42:35.116923+0000", 2024-09-16T03:42:35.133 INFO:tasks.workunit.client.0.smithi096.stderr: "tag": "", 2024-09-16T03:42:35.133 INFO:tasks.workunit.client.0.smithi096.stderr: "health": { 2024-09-16T03:42:35.133 INFO:tasks.workunit.client.0.smithi096.stderr: "status": "HEALTH_WARN", 2024-09-16T03:42:35.133 INFO:tasks.workunit.client.0.smithi096.stderr: "checks": { 2024-09-16T03:42:35.133 INFO:tasks.workunit.client.0.smithi096.stderr: "POOL_APP_NOT_ENABLED": { 2024-09-16T03:42:35.133 INFO:tasks.workunit.client.0.smithi096.stderr: "severity": "HEALTH_WARN", 2024-09-16T03:42:35.133 INFO:tasks.workunit.client.0.smithi096.stderr: "summary": { 2024-09-16T03:42:35.133 INFO:tasks.workunit.client.0.smithi096.stderr: "message": "1 pool(s) do not have an application enabled", 2024-09-16T03:42:35.134 INFO:tasks.workunit.client.0.smithi096.stderr: "count": 1 2024-09-16T03:42:35.134 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.134 INFO:tasks.workunit.client.0.smithi096.stderr: "detail": [ 2024-09-16T03:42:35.134 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:35.134 INFO:tasks.workunit.client.0.smithi096.stderr: "message": "application not enabled on pool '\''foo'\''" 2024-09-16T03:42:35.134 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.134 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:35.134 INFO:tasks.workunit.client.0.smithi096.stderr: "message": "use '\''ceph osd pool application enable '\'', where is '\''cephfs'\'', '\''rbd'\'', '\''rgw'\'', or freeform for custom applications." 2024-09-16T03:42:35.134 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:35.134 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:42:35.134 INFO:tasks.workunit.client.0.smithi096.stderr: "muted": false 2024-09-16T03:42:35.134 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:35.134 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.135 INFO:tasks.workunit.client.0.smithi096.stderr: "mutes": [] 2024-09-16T03:42:35.135 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.135 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap_first_committed": 1, 2024-09-16T03:42:35.135 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap_last_committed": 1, 2024-09-16T03:42:35.135 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap": { 2024-09-16T03:42:35.135 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 1, 2024-09-16T03:42:35.135 INFO:tasks.workunit.client.0.smithi096.stderr: "fsid": "08dc5a0f-381e-4717-8c90-55791ebeecfd", 2024-09-16T03:42:35.135 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:26:19.960858Z", 2024-09-16T03:42:35.135 INFO:tasks.workunit.client.0.smithi096.stderr: "created": "2024-09-16T03:26:19.960858Z", 2024-09-16T03:42:35.135 INFO:tasks.workunit.client.0.smithi096.stderr: "min_mon_release": 19, 2024-09-16T03:42:35.135 INFO:tasks.workunit.client.0.smithi096.stderr: "min_mon_release_name": "squid", 2024-09-16T03:42:35.135 INFO:tasks.workunit.client.0.smithi096.stderr: "election_strategy": 1, 2024-09-16T03:42:35.135 INFO:tasks.workunit.client.0.smithi096.stderr: "disallowed_leaders: ": "", 2024-09-16T03:42:35.135 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode": false, 2024-09-16T03:42:35.136 INFO:tasks.workunit.client.0.smithi096.stderr: "tiebreaker_mon": "", 2024-09-16T03:42:35.136 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_ranks: ": "", 2024-09-16T03:42:35.136 INFO:tasks.workunit.client.0.smithi096.stderr: "features": { 2024-09-16T03:42:35.136 INFO:tasks.workunit.client.0.smithi096.stderr: "persistent": [ 2024-09-16T03:42:35.136 INFO:tasks.workunit.client.0.smithi096.stderr: "kraken", 2024-09-16T03:42:35.136 INFO:tasks.workunit.client.0.smithi096.stderr: "luminous", 2024-09-16T03:42:35.136 INFO:tasks.workunit.client.0.smithi096.stderr: "mimic", 2024-09-16T03:42:35.136 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap-prune", 2024-09-16T03:42:35.136 INFO:tasks.workunit.client.0.smithi096.stderr: "nautilus", 2024-09-16T03:42:35.136 INFO:tasks.workunit.client.0.smithi096.stderr: "octopus", 2024-09-16T03:42:35.136 INFO:tasks.workunit.client.0.smithi096.stderr: "pacific", 2024-09-16T03:42:35.136 INFO:tasks.workunit.client.0.smithi096.stderr: "elector-pinging", 2024-09-16T03:42:35.136 INFO:tasks.workunit.client.0.smithi096.stderr: "quincy", 2024-09-16T03:42:35.137 INFO:tasks.workunit.client.0.smithi096.stderr: "reef", 2024-09-16T03:42:35.137 INFO:tasks.workunit.client.0.smithi096.stderr: "squid" 2024-09-16T03:42:35.137 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:42:35.137 INFO:tasks.workunit.client.0.smithi096.stderr: "optional": [] 2024-09-16T03:42:35.137 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.137 INFO:tasks.workunit.client.0.smithi096.stderr: "mons": [ 2024-09-16T03:42:35.137 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:35.137 INFO:tasks.workunit.client.0.smithi096.stderr: "rank": 0, 2024-09-16T03:42:35.137 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "a", 2024-09-16T03:42:35.137 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:42:35.137 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:42:35.137 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:35.137 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:42:35.137 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:7115", 2024-09-16T03:42:35.138 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 0 2024-09-16T03:42:35.138 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:35.138 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:42:35.138 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.138 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:7115/0", 2024-09-16T03:42:35.138 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:7115/0", 2024-09-16T03:42:35.138 INFO:tasks.workunit.client.0.smithi096.stderr: "priority": 0, 2024-09-16T03:42:35.138 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 0, 2024-09-16T03:42:35.138 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_location": "{}" 2024-09-16T03:42:35.138 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:35.138 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:42:35.139 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.139 INFO:tasks.workunit.client.0.smithi096.stderr: "quorum": [ 2024-09-16T03:42:35.139 INFO:tasks.workunit.client.0.smithi096.stderr: 0 2024-09-16T03:42:35.139 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:42:35.139 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap": { 2024-09-16T03:42:35.139 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 1034, 2024-09-16T03:42:35.139 INFO:tasks.workunit.client.0.smithi096.stderr: "fsid": "08dc5a0f-381e-4717-8c90-55791ebeecfd", 2024-09-16T03:42:35.139 INFO:tasks.workunit.client.0.smithi096.stderr: "created": "2024-09-16T03:26:20.886850+0000", 2024-09-16T03:42:35.139 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:42:33.658558+0000", 2024-09-16T03:42:35.139 INFO:tasks.workunit.client.0.smithi096.stderr: "last_up_change": "2024-09-16T03:28:12.669817+0000", 2024-09-16T03:42:35.139 INFO:tasks.workunit.client.0.smithi096.stderr: "last_in_change": "2024-09-16T03:27:36.130692+0000", 2024-09-16T03:42:35.139 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-16T03:42:35.140 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_num": 5799936, 2024-09-16T03:42:35.140 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_set": [ 2024-09-16T03:42:35.140 INFO:tasks.workunit.client.0.smithi096.stderr: "pglog_hardlimit", 2024-09-16T03:42:35.140 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snapdirs", 2024-09-16T03:42:35.140 INFO:tasks.workunit.client.0.smithi096.stderr: "recovery_deletes", 2024-09-16T03:42:35.140 INFO:tasks.workunit.client.0.smithi096.stderr: "sortbitwise" 2024-09-16T03:42:35.140 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:42:35.140 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_version": 7, 2024-09-16T03:42:35.140 INFO:tasks.workunit.client.0.smithi096.stderr: "full_ratio": 0.97000002861022949, 2024-09-16T03:42:35.140 INFO:tasks.workunit.client.0.smithi096.stderr: "backfillfull_ratio": 0.97000002861022949, 2024-09-16T03:42:35.140 INFO:tasks.workunit.client.0.smithi096.stderr: "nearfull_ratio": 0.85000002384185791, 2024-09-16T03:42:35.140 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_snapshot": "", 2024-09-16T03:42:35.140 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_max": 1, 2024-09-16T03:42:35.141 INFO:tasks.workunit.client.0.smithi096.stderr: "max_osd": 3, 2024-09-16T03:42:35.141 INFO:tasks.workunit.client.0.smithi096.stderr: "require_min_compat_client": "luminous", 2024-09-16T03:42:35.141 INFO:tasks.workunit.client.0.smithi096.stderr: "min_compat_client": "jewel", 2024-09-16T03:42:35.141 INFO:tasks.workunit.client.0.smithi096.stderr: "require_osd_release": "squid", 2024-09-16T03:42:35.141 INFO:tasks.workunit.client.0.smithi096.stderr: "allow_crimson": false, 2024-09-16T03:42:35.141 INFO:tasks.workunit.client.0.smithi096.stderr: "pools": [ 2024-09-16T03:42:35.141 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:35.142 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 1, 2024-09-16T03:42:35.142 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_name": "foo", 2024-09-16T03:42:35.142 INFO:tasks.workunit.client.0.smithi096.stderr: "create_time": "2024-09-16T03:28:23.539340+0000", 2024-09-16T03:42:35.142 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": 1, 2024-09-16T03:42:35.142 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_names": "hashpspool", 2024-09-16T03:42:35.143 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:42:35.143 INFO:tasks.workunit.client.0.smithi096.stderr: "size": 3, 2024-09-16T03:42:35.143 INFO:tasks.workunit.client.0.smithi096.stderr: "min_size": 2, 2024-09-16T03:42:35.143 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_rule": 0, 2024-09-16T03:42:35.143 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_count": 0, 2024-09-16T03:42:35.143 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_target": 0, 2024-09-16T03:42:35.143 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_barrier": 0, 2024-09-16T03:42:35.143 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-16T03:42:35.143 INFO:tasks.workunit.client.0.smithi096.stderr: "is_stretch_pool": false, 2024-09-16T03:42:35.143 INFO:tasks.workunit.client.0.smithi096.stderr: "object_hash": 2, 2024-09-16T03:42:35.143 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_autoscale_mode": "off", 2024-09-16T03:42:35.143 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num": 32, 2024-09-16T03:42:35.143 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num": 32, 2024-09-16T03:42:35.144 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num_target": 32, 2024-09-16T03:42:35.144 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_target": 32, 2024-09-16T03:42:35.144 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_pending": 32, 2024-09-16T03:42:35.144 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pg_merge_meta": { 2024-09-16T03:42:35.144 INFO:tasks.workunit.client.0.smithi096.stderr: "source_pgid": "0.0", 2024-09-16T03:42:35.144 INFO:tasks.workunit.client.0.smithi096.stderr: "ready_epoch": 0, 2024-09-16T03:42:35.144 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_started": 0, 2024-09-16T03:42:35.144 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": 0, 2024-09-16T03:42:35.144 INFO:tasks.workunit.client.0.smithi096.stderr: "source_version": "0'\''0", 2024-09-16T03:42:35.144 INFO:tasks.workunit.client.0.smithi096.stderr: "target_version": "0'\''0" 2024-09-16T03:42:35.144 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.144 INFO:tasks.workunit.client.0.smithi096.stderr: "last_change": "25", 2024-09-16T03:42:35.144 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend": "0", 2024-09-16T03:42:35.144 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_prenautilus": "0", 2024-09-16T03:42:35.145 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_preluminous": "0", 2024-09-16T03:42:35.145 INFO:tasks.workunit.client.0.smithi096.stderr: "auid": 0, 2024-09-16T03:42:35.145 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_mode": "selfmanaged", 2024-09-16T03:42:35.145 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_seq": 0, 2024-09-16T03:42:35.145 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_epoch": 0, 2024-09-16T03:42:35.145 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_snaps": [], 2024-09-16T03:42:35.145 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps": "[]", 2024-09-16T03:42:35.145 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_bytes": 0, 2024-09-16T03:42:35.145 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_objects": 0, 2024-09-16T03:42:35.145 INFO:tasks.workunit.client.0.smithi096.stderr: "tiers": [], 2024-09-16T03:42:35.145 INFO:tasks.workunit.client.0.smithi096.stderr: "tier_of": -1, 2024-09-16T03:42:35.145 INFO:tasks.workunit.client.0.smithi096.stderr: "read_tier": -1, 2024-09-16T03:42:35.145 INFO:tasks.workunit.client.0.smithi096.stderr: "write_tier": -1, 2024-09-16T03:42:35.146 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_mode": "none", 2024-09-16T03:42:35.146 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_bytes": 0, 2024-09-16T03:42:35.147 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_objects": 0, 2024-09-16T03:42:35.147 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_ratio_micro": 400000, 2024-09-16T03:42:35.147 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-16T03:42:35.148 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_full_ratio_micro": 800000, 2024-09-16T03:42:35.148 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_flush_age": 0, 2024-09-16T03:42:35.148 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_evict_age": 0, 2024-09-16T03:42:35.148 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profile": "", 2024-09-16T03:42:35.148 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_params": { 2024-09-16T03:42:35.148 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "none" 2024-09-16T03:42:35.148 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.148 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_period": 0, 2024-09-16T03:42:35.148 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_count": 0, 2024-09-16T03:42:35.148 INFO:tasks.workunit.client.0.smithi096.stderr: "use_gmt_hitset": true, 2024-09-16T03:42:35.148 INFO:tasks.workunit.client.0.smithi096.stderr: "min_read_recency_for_promote": 0, 2024-09-16T03:42:35.148 INFO:tasks.workunit.client.0.smithi096.stderr: "min_write_recency_for_promote": 0, 2024-09-16T03:42:35.148 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_grade_decay_rate": 0, 2024-09-16T03:42:35.149 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_search_last_n": 0, 2024-09-16T03:42:35.149 INFO:tasks.workunit.client.0.smithi096.stderr: "grade_table": [], 2024-09-16T03:42:35.149 INFO:tasks.workunit.client.0.smithi096.stderr: "stripe_width": 0, 2024-09-16T03:42:35.149 INFO:tasks.workunit.client.0.smithi096.stderr: "expected_num_objects": 0, 2024-09-16T03:42:35.149 INFO:tasks.workunit.client.0.smithi096.stderr: "fast_read": false, 2024-09-16T03:42:35.149 INFO:tasks.workunit.client.0.smithi096.stderr: "options": {}, 2024-09-16T03:42:35.149 INFO:tasks.workunit.client.0.smithi096.stderr: "application_metadata": {}, 2024-09-16T03:42:35.149 INFO:tasks.workunit.client.0.smithi096.stderr: "read_balance": { 2024-09-16T03:42:35.149 INFO:tasks.workunit.client.0.smithi096.stderr: "score_type": "Fair distribution", 2024-09-16T03:42:35.149 INFO:tasks.workunit.client.0.smithi096.stderr: "score_acting": 1.690000057220459, 2024-09-16T03:42:35.149 INFO:tasks.workunit.client.0.smithi096.stderr: "score_stable": 1.690000057220459, 2024-09-16T03:42:35.149 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_score": 1, 2024-09-16T03:42:35.149 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_acting": 1.690000057220459, 2024-09-16T03:42:35.149 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_stable": 1.690000057220459, 2024-09-16T03:42:35.150 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity_weighted": 1, 2024-09-16T03:42:35.150 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity": 1, 2024-09-16T03:42:35.150 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity_weighted": 1 2024-09-16T03:42:35.150 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:35.150 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:35.150 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:42:35.150 INFO:tasks.workunit.client.0.smithi096.stderr: "osds": [ 2024-09-16T03:42:35.150 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:35.150 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:42:35.150 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "cf18d22c-4700-44bd-90f9-a7f9263a145b", 2024-09-16T03:42:35.150 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:42:35.150 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:42:35.150 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:42:35.150 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:42:35.151 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:42:35.151 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:42:35.151 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 5, 2024-09-16T03:42:35.151 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 21, 2024-09-16T03:42:35.151 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:42:35.151 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:42:35.151 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:42:35.151 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:42:35.151 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:35.151 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:42:35.151 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6802", 2024-09-16T03:42:35.151 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3449414971 2024-09-16T03:42:35.151 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.151 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:35.151 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:42:35.152 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6803", 2024-09-16T03:42:35.152 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3449414971 2024-09-16T03:42:35.152 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:35.152 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:42:35.152 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.152 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:42:35.152 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:42:35.152 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:35.152 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:42:35.152 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6804", 2024-09-16T03:42:35.152 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3449414971 2024-09-16T03:42:35.152 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.152 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:35.153 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:42:35.153 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6805", 2024-09-16T03:42:35.153 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3449414971 2024-09-16T03:42:35.153 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:35.153 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:42:35.153 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.153 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:42:35.153 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:42:35.153 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:35.153 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:42:35.153 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6808", 2024-09-16T03:42:35.153 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3449414971 2024-09-16T03:42:35.153 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.153 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:35.154 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:42:35.154 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6809", 2024-09-16T03:42:35.154 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3449414971 2024-09-16T03:42:35.154 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:35.154 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:42:35.154 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.154 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:42:35.154 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:42:35.154 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:35.154 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:42:35.154 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6806", 2024-09-16T03:42:35.154 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3449414971 2024-09-16T03:42:35.154 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.154 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:35.154 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:42:35.155 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6807", 2024-09-16T03:42:35.155 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3449414971 2024-09-16T03:42:35.155 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:35.155 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:42:35.155 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.155 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6803/3449414971", 2024-09-16T03:42:35.155 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6805/3449414971", 2024-09-16T03:42:35.155 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6809/3449414971", 2024-09-16T03:42:35.155 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6807/3449414971", 2024-09-16T03:42:35.155 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:42:35.155 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:42:35.155 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:42:35.155 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:42:35.155 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.156 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:35.156 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:42:35.156 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "1ed2d78f-1635-4234-83aa-7c0b7e3c87dc", 2024-09-16T03:42:35.156 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:42:35.156 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:42:35.156 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:42:35.156 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:42:35.156 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:42:35.156 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:42:35.156 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 10, 2024-09-16T03:42:35.156 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 21, 2024-09-16T03:42:35.156 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:42:35.156 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:42:35.156 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:42:35.157 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:42:35.157 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:35.157 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:42:35.157 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6810", 2024-09-16T03:42:35.157 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 4240988863 2024-09-16T03:42:35.157 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.157 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:35.157 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:42:35.157 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6811", 2024-09-16T03:42:35.157 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 4240988863 2024-09-16T03:42:35.157 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:35.157 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:42:35.157 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.158 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:42:35.158 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:42:35.158 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:35.158 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:42:35.158 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6812", 2024-09-16T03:42:35.158 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 4240988863 2024-09-16T03:42:35.158 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.158 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:35.158 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:42:35.158 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6813", 2024-09-16T03:42:35.158 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 4240988863 2024-09-16T03:42:35.158 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:35.158 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:42:35.158 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.158 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:42:35.159 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:42:35.159 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:35.159 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:42:35.159 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6816", 2024-09-16T03:42:35.159 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 4240988863 2024-09-16T03:42:35.159 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.159 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:35.159 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:42:35.159 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6817", 2024-09-16T03:42:35.159 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 4240988863 2024-09-16T03:42:35.159 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:35.159 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:42:35.159 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.159 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:42:35.160 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:42:35.160 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:35.160 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:42:35.160 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6814", 2024-09-16T03:42:35.160 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 4240988863 2024-09-16T03:42:35.160 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.160 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:35.160 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:42:35.160 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6815", 2024-09-16T03:42:35.160 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 4240988863 2024-09-16T03:42:35.160 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:35.160 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:42:35.160 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.160 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6811/4240988863", 2024-09-16T03:42:35.161 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6813/4240988863", 2024-09-16T03:42:35.161 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6817/4240988863", 2024-09-16T03:42:35.161 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6815/4240988863", 2024-09-16T03:42:35.161 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:42:35.161 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:42:35.161 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:42:35.161 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:42:35.161 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.161 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:35.161 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:42:35.161 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "c4febd52-73d0-4470-af74-9bb5e7ac65da", 2024-09-16T03:42:35.161 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:42:35.161 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:42:35.161 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:42:35.162 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:42:35.162 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:42:35.162 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:42:35.162 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 15, 2024-09-16T03:42:35.162 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 21, 2024-09-16T03:42:35.162 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:42:35.162 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:42:35.162 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:42:35.162 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:42:35.162 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:35.162 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:42:35.162 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6818", 2024-09-16T03:42:35.162 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 2239695978 2024-09-16T03:42:35.162 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.163 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:35.163 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:42:35.163 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6819", 2024-09-16T03:42:35.163 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 2239695978 2024-09-16T03:42:35.163 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:35.163 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:42:35.163 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.163 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:42:35.163 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:42:35.163 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:35.163 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:42:35.163 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6820", 2024-09-16T03:42:35.163 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 2239695978 2024-09-16T03:42:35.163 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.163 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:35.164 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:42:35.164 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6821", 2024-09-16T03:42:35.164 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 2239695978 2024-09-16T03:42:35.164 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:35.164 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:42:35.164 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.164 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:42:35.164 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:42:35.164 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:35.164 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:42:35.164 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6824", 2024-09-16T03:42:35.164 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 2239695978 2024-09-16T03:42:35.164 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.164 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:35.165 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:42:35.165 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6825", 2024-09-16T03:42:35.165 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 2239695978 2024-09-16T03:42:35.165 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:35.165 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:42:35.165 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.165 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:42:35.165 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:42:35.165 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:35.165 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:42:35.165 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6822", 2024-09-16T03:42:35.165 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 2239695978 2024-09-16T03:42:35.165 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.165 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:35.166 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:42:35.166 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6823", 2024-09-16T03:42:35.166 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 2239695978 2024-09-16T03:42:35.166 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:35.166 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:42:35.166 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.166 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6819/2239695978", 2024-09-16T03:42:35.166 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6821/2239695978", 2024-09-16T03:42:35.166 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6825/2239695978", 2024-09-16T03:42:35.166 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6823/2239695978", 2024-09-16T03:42:35.166 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:42:35.166 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:42:35.166 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:42:35.166 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:42:35.167 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:35.167 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:42:35.167 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_xinfo": [ 2024-09-16T03:42:35.167 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:35.167 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:42:35.167 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:42:35.167 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:42:35.167 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:42:35.167 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:42:35.167 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:42:35.167 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:26:56.992065+0000", 2024-09-16T03:42:35.167 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:42:35.167 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.167 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:35.168 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:42:35.168 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:42:35.168 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:42:35.168 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:42:35.168 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:42:35.168 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:42:35.168 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:27:34.030155+0000", 2024-09-16T03:42:35.168 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:42:35.168 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.168 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:35.168 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:42:35.168 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:42:35.168 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:42:35.169 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:42:35.169 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:42:35.169 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:42:35.169 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:28:12.174041+0000", 2024-09-16T03:42:35.169 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:42:35.169 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:35.169 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:42:35.169 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap": [], 2024-09-16T03:42:35.169 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap_items": [], 2024-09-16T03:42:35.169 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap_primaries": [], 2024-09-16T03:42:35.169 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_temp": [], 2024-09-16T03:42:35.169 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_temp": [], 2024-09-16T03:42:35.169 INFO:tasks.workunit.client.0.smithi096.stderr: "blocklist": {}, 2024-09-16T03:42:35.170 INFO:tasks.workunit.client.0.smithi096.stderr: "range_blocklist": {}, 2024-09-16T03:42:35.170 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profiles": { 2024-09-16T03:42:35.170 INFO:tasks.workunit.client.0.smithi096.stderr: "default": { 2024-09-16T03:42:35.170 INFO:tasks.workunit.client.0.smithi096.stderr: "k": "2", 2024-09-16T03:42:35.170 INFO:tasks.workunit.client.0.smithi096.stderr: "m": "2", 2024-09-16T03:42:35.170 INFO:tasks.workunit.client.0.smithi096.stderr: "plugin": "jerasure", 2024-09-16T03:42:35.170 INFO:tasks.workunit.client.0.smithi096.stderr: "technique": "reed_sol_van" 2024-09-16T03:42:35.170 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:35.170 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.170 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps_queue": [], 2024-09-16T03:42:35.170 INFO:tasks.workunit.client.0.smithi096.stderr: "new_removed_snaps": [], 2024-09-16T03:42:35.170 INFO:tasks.workunit.client.0.smithi096.stderr: "new_purged_snaps": [], 2024-09-16T03:42:35.170 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_node_flags": {}, 2024-09-16T03:42:35.170 INFO:tasks.workunit.client.0.smithi096.stderr: "device_class_flags": {}, 2024-09-16T03:42:35.170 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode": { 2024-09-16T03:42:35.171 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode_enabled": false, 2024-09-16T03:42:35.171 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_bucket_count": 0, 2024-09-16T03:42:35.171 INFO:tasks.workunit.client.0.smithi096.stderr: "degraded_stretch_mode": 0, 2024-09-16T03:42:35.171 INFO:tasks.workunit.client.0.smithi096.stderr: "recovering_stretch_mode": 0, 2024-09-16T03:42:35.171 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode_bucket": 0 2024-09-16T03:42:35.171 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:35.171 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.171 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_metadata": [ 2024-09-16T03:42:35.171 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:35.171 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:42:35.171 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:42:35.171 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6804/3449414971,v1:127.0.0.1:6805/3449414971]", 2024-09-16T03:42:35.171 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:42:35.171 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:42:35.172 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:42:35.172 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:42:35.172 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:42:35.172 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:42:35.172 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:42:35.172 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:42:35.172 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:42:35.172 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:42:35.172 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:42:35.172 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-osdmap-prune/0/block", 2024-09-16T03:42:35.172 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:42:35.172 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:42:35.172 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:42:35.172 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:42:35.173 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:42:35.173 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:42:35.173 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:42:35.173 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:42:35.173 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:42:35.173 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:42:35.173 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:26:27.749490Z", 2024-09-16T03:42:35.173 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:42:35.173 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:42:35.173 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:42:35.173 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:42:35.173 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:42:35.173 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:42:35.173 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:42:35.174 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6802/3449414971,v1:127.0.0.1:6803/3449414971]", 2024-09-16T03:42:35.174 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:42:35.174 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6808/3449414971,v1:127.0.0.1:6809/3449414971]", 2024-09-16T03:42:35.174 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6806/3449414971,v1:127.0.0.1:6807/3449414971]", 2024-09-16T03:42:35.174 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:42:35.174 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:42:35.174 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:42:35.174 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:42:35.174 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:42:35.174 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:42:35.174 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:42:35.174 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:42:35.174 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:42:35.174 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-osdmap-prune/0", 2024-09-16T03:42:35.175 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:42:35.175 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:42:35.175 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:42:35.175 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.175 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:35.175 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:42:35.175 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:42:35.175 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6812/4240988863,v1:127.0.0.1:6813/4240988863]", 2024-09-16T03:42:35.175 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:42:35.175 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:42:35.175 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:42:35.175 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:42:35.175 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:42:35.175 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:42:35.176 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:42:35.176 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:42:35.176 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:42:35.176 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:42:35.176 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:42:35.176 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-osdmap-prune/1/block", 2024-09-16T03:42:35.176 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:42:35.176 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:42:35.176 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:42:35.176 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:42:35.176 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:42:35.176 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:42:35.176 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:42:35.176 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:42:35.177 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:42:35.177 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:42:35.177 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:27:04.728300Z", 2024-09-16T03:42:35.177 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:42:35.177 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:42:35.177 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:42:35.177 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:42:35.177 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:42:35.177 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:42:35.177 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:42:35.177 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6810/4240988863,v1:127.0.0.1:6811/4240988863]", 2024-09-16T03:42:35.177 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:42:35.177 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6816/4240988863,v1:127.0.0.1:6817/4240988863]", 2024-09-16T03:42:35.177 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6814/4240988863,v1:127.0.0.1:6815/4240988863]", 2024-09-16T03:42:35.178 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:42:35.178 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:42:35.178 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:42:35.178 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:42:35.178 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:42:35.178 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:42:35.178 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:42:35.178 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:42:35.178 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:42:35.178 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-osdmap-prune/1", 2024-09-16T03:42:35.178 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:42:35.178 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:42:35.178 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:42:35.178 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.179 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:35.179 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:42:35.179 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:42:35.179 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6820/2239695978,v1:127.0.0.1:6821/2239695978]", 2024-09-16T03:42:35.179 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:42:35.179 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:42:35.179 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:42:35.179 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:42:35.179 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:42:35.179 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:42:35.179 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:42:35.179 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:42:35.179 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:42:35.179 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:42:35.180 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:42:35.180 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-osdmap-prune/2/block", 2024-09-16T03:42:35.180 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:42:35.180 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:42:35.180 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:42:35.180 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:42:35.180 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:42:35.180 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:42:35.180 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:42:35.180 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:42:35.180 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:42:35.180 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:42:35.180 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:27:42.002291Z", 2024-09-16T03:42:35.180 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:42:35.181 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:42:35.181 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:42:35.181 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:42:35.181 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:42:35.181 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:42:35.181 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:42:35.181 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6818/2239695978,v1:127.0.0.1:6819/2239695978]", 2024-09-16T03:42:35.181 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:42:35.181 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6824/2239695978,v1:127.0.0.1:6825/2239695978]", 2024-09-16T03:42:35.181 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6822/2239695978,v1:127.0.0.1:6823/2239695978]", 2024-09-16T03:42:35.181 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:42:35.181 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:42:35.181 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:42:35.182 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:42:35.182 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:42:35.182 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:42:35.182 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:42:35.182 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:42:35.182 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:42:35.182 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-osdmap-prune/2", 2024-09-16T03:42:35.182 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:42:35.182 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:42:35.182 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:42:35.182 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:35.182 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:42:35.182 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_clean_epochs": { 2024-09-16T03:42:35.182 INFO:tasks.workunit.client.0.smithi096.stderr: "min_last_epoch_clean": 1030, 2024-09-16T03:42:35.182 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": { 2024-09-16T03:42:35.183 INFO:tasks.workunit.client.0.smithi096.stderr: "per_pool": [ 2024-09-16T03:42:35.183 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:35.183 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 1, 2024-09-16T03:42:35.183 INFO:tasks.workunit.client.0.smithi096.stderr: "floor": 1030 2024-09-16T03:42:35.183 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:35.183 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:42:35.183 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.183 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_epochs": [ 2024-09-16T03:42:35.183 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:35.183 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:42:35.183 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 1030 2024-09-16T03:42:35.183 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.183 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:35.183 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:42:35.183 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 1030 2024-09-16T03:42:35.184 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.184 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:35.184 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:42:35.184 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 1030 2024-09-16T03:42:35.184 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:35.184 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:42:35.184 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.184 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_first_committed": 11, 2024-09-16T03:42:35.184 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_last_committed": 1034, 2024-09-16T03:42:35.184 INFO:tasks.workunit.client.0.smithi096.stderr: "crushmap": { 2024-09-16T03:42:35.184 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": [ 2024-09-16T03:42:35.184 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:35.184 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:42:35.185 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.0", 2024-09-16T03:42:35.185 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:42:35.185 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.185 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:35.185 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:42:35.185 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.1", 2024-09-16T03:42:35.185 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:42:35.185 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.185 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:35.185 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:42:35.185 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.2", 2024-09-16T03:42:35.185 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:42:35.185 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:35.185 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:42:35.185 INFO:tasks.workunit.client.0.smithi096.stderr: "types": [ 2024-09-16T03:42:35.186 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:35.186 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 0, 2024-09-16T03:42:35.186 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd" 2024-09-16T03:42:35.186 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.186 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:35.186 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:42:35.186 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "host" 2024-09-16T03:42:35.186 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.186 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:35.186 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 2, 2024-09-16T03:42:35.186 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "chassis" 2024-09-16T03:42:35.186 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.186 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:35.186 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 3, 2024-09-16T03:42:35.187 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "rack" 2024-09-16T03:42:35.187 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.187 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:35.187 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 4, 2024-09-16T03:42:35.187 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "row" 2024-09-16T03:42:35.187 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.187 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:35.187 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 5, 2024-09-16T03:42:35.187 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "pdu" 2024-09-16T03:42:35.187 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.187 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:35.187 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 6, 2024-09-16T03:42:35.187 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "pod" 2024-09-16T03:42:35.188 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.188 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:35.188 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 7, 2024-09-16T03:42:35.188 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "room" 2024-09-16T03:42:35.188 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.188 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:35.188 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 8, 2024-09-16T03:42:35.188 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "datacenter" 2024-09-16T03:42:35.188 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.188 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:35.188 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 9, 2024-09-16T03:42:35.188 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "zone" 2024-09-16T03:42:35.188 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.189 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:35.189 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 10, 2024-09-16T03:42:35.189 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "region" 2024-09-16T03:42:35.189 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.189 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:35.189 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:42:35.189 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "root" 2024-09-16T03:42:35.189 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:35.189 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:42:35.189 INFO:tasks.workunit.client.0.smithi096.stderr: "buckets": [ 2024-09-16T03:42:35.189 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:35.189 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -1, 2024-09-16T03:42:35.189 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "default", 2024-09-16T03:42:35.189 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:42:35.190 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "root", 2024-09-16T03:42:35.190 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:42:35.190 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:42:35.190 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:42:35.190 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:42:35.190 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:35.190 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -3, 2024-09-16T03:42:35.190 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:42:35.190 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:42:35.190 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:35.190 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:42:35.190 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.190 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:35.190 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -2, 2024-09-16T03:42:35.190 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "default~hdd", 2024-09-16T03:42:35.191 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:42:35.191 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "root", 2024-09-16T03:42:35.191 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:42:35.191 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:42:35.191 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:42:35.191 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:42:35.191 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:35.191 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -4, 2024-09-16T03:42:35.191 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:42:35.191 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:42:35.191 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:35.191 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:42:35.191 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.191 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:35.192 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -3, 2024-09-16T03:42:35.192 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "smithi096", 2024-09-16T03:42:35.192 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:42:35.192 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "host", 2024-09-16T03:42:35.192 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:42:35.192 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:42:35.192 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:42:35.192 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:42:35.192 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:35.192 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:42:35.192 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:42:35.192 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:42:35.192 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.192 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:35.193 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:42:35.193 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:42:35.193 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 1 2024-09-16T03:42:35.193 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.193 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:35.193 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:42:35.193 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:42:35.193 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 2 2024-09-16T03:42:35.193 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:35.193 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:42:35.193 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.193 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:35.193 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -4, 2024-09-16T03:42:35.193 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "smithi096~hdd", 2024-09-16T03:42:35.194 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:42:35.194 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "host", 2024-09-16T03:42:35.194 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:42:35.194 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:42:35.194 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:42:35.194 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:42:35.194 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:35.194 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:42:35.194 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:42:35.194 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:42:35.194 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.194 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:35.194 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:42:35.194 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:42:35.195 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 1 2024-09-16T03:42:35.195 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.195 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:35.195 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:42:35.195 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:42:35.195 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 2 2024-09-16T03:42:35.195 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:35.195 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:42:35.195 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:35.195 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:42:35.195 INFO:tasks.workunit.client.0.smithi096.stderr: "rules": [ 2024-09-16T03:42:35.195 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:35.195 INFO:tasks.workunit.client.0.smithi096.stderr: "rule_id": 0, 2024-09-16T03:42:35.196 INFO:tasks.workunit.client.0.smithi096.stderr: "rule_name": "replicated_rule", 2024-09-16T03:42:35.196 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:42:35.196 INFO:tasks.workunit.client.0.smithi096.stderr: "steps": [ 2024-09-16T03:42:35.196 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:35.196 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "take", 2024-09-16T03:42:35.196 INFO:tasks.workunit.client.0.smithi096.stderr: "item": -1, 2024-09-16T03:42:35.196 INFO:tasks.workunit.client.0.smithi096.stderr: "item_name": "default" 2024-09-16T03:42:35.196 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.196 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:35.196 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "choose_firstn", 2024-09-16T03:42:35.196 INFO:tasks.workunit.client.0.smithi096.stderr: "num": 0, 2024-09-16T03:42:35.196 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "osd" 2024-09-16T03:42:35.196 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.196 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:35.197 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "emit" 2024-09-16T03:42:35.197 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:35.197 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:42:35.197 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:35.197 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:42:35.197 INFO:tasks.workunit.client.0.smithi096.stderr: "tunables": { 2024-09-16T03:42:35.197 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_local_tries": 0, 2024-09-16T03:42:35.197 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_local_fallback_tries": 0, 2024-09-16T03:42:35.197 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_total_tries": 50, 2024-09-16T03:42:35.197 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_descend_once": 1, 2024-09-16T03:42:35.197 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_vary_r": 1, 2024-09-16T03:42:35.197 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_stable": 1, 2024-09-16T03:42:35.197 INFO:tasks.workunit.client.0.smithi096.stderr: "msr_descents": 100, 2024-09-16T03:42:35.198 INFO:tasks.workunit.client.0.smithi096.stderr: "msr_collision_tries": 100, 2024-09-16T03:42:35.198 INFO:tasks.workunit.client.0.smithi096.stderr: "straw_calc_version": 1, 2024-09-16T03:42:35.198 INFO:tasks.workunit.client.0.smithi096.stderr: "allowed_bucket_algs": 54, 2024-09-16T03:42:35.198 INFO:tasks.workunit.client.0.smithi096.stderr: "profile": "jewel", 2024-09-16T03:42:35.198 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_tunables": 1, 2024-09-16T03:42:35.198 INFO:tasks.workunit.client.0.smithi096.stderr: "legacy_tunables": 0, 2024-09-16T03:42:35.198 INFO:tasks.workunit.client.0.smithi096.stderr: "minimum_required_version": "jewel", 2024-09-16T03:42:35.198 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables": 1, 2024-09-16T03:42:35.198 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables2": 1, 2024-09-16T03:42:35.198 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v2_rules": 0, 2024-09-16T03:42:35.198 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables3": 1, 2024-09-16T03:42:35.198 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v3_rules": 0, 2024-09-16T03:42:35.198 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v4_buckets": 1, 2024-09-16T03:42:35.198 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables5": 1, 2024-09-16T03:42:35.199 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v5_rules": 0, 2024-09-16T03:42:35.199 INFO:tasks.workunit.client.0.smithi096.stderr: "has_msr_rules": 0 2024-09-16T03:42:35.199 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.199 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_args": {} 2024-09-16T03:42:35.199 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.199 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_manifest": { 2024-09-16T03:42:35.199 INFO:tasks.workunit.client.0.smithi096.stderr: "first_pinned": 11, 2024-09-16T03:42:35.199 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pinned": 931, 2024-09-16T03:42:35.199 INFO:tasks.workunit.client.0.smithi096.stderr: "pinned_maps": [ 2024-09-16T03:42:35.199 INFO:tasks.workunit.client.0.smithi096.stderr: 11, 2024-09-16T03:42:35.199 INFO:tasks.workunit.client.0.smithi096.stderr: 21, 2024-09-16T03:42:35.199 INFO:tasks.workunit.client.0.smithi096.stderr: 31, 2024-09-16T03:42:35.199 INFO:tasks.workunit.client.0.smithi096.stderr: 41, 2024-09-16T03:42:35.199 INFO:tasks.workunit.client.0.smithi096.stderr: 51, 2024-09-16T03:42:35.199 INFO:tasks.workunit.client.0.smithi096.stderr: 61, 2024-09-16T03:42:35.200 INFO:tasks.workunit.client.0.smithi096.stderr: 71, 2024-09-16T03:42:35.200 INFO:tasks.workunit.client.0.smithi096.stderr: 81, 2024-09-16T03:42:35.200 INFO:tasks.workunit.client.0.smithi096.stderr: 91, 2024-09-16T03:42:35.200 INFO:tasks.workunit.client.0.smithi096.stderr: 101, 2024-09-16T03:42:35.200 INFO:tasks.workunit.client.0.smithi096.stderr: 111, 2024-09-16T03:42:35.200 INFO:tasks.workunit.client.0.smithi096.stderr: 121, 2024-09-16T03:42:35.200 INFO:tasks.workunit.client.0.smithi096.stderr: 131, 2024-09-16T03:42:35.200 INFO:tasks.workunit.client.0.smithi096.stderr: 141, 2024-09-16T03:42:35.200 INFO:tasks.workunit.client.0.smithi096.stderr: 151, 2024-09-16T03:42:35.200 INFO:tasks.workunit.client.0.smithi096.stderr: 161, 2024-09-16T03:42:35.200 INFO:tasks.workunit.client.0.smithi096.stderr: 171, 2024-09-16T03:42:35.200 INFO:tasks.workunit.client.0.smithi096.stderr: 181, 2024-09-16T03:42:35.200 INFO:tasks.workunit.client.0.smithi096.stderr: 191, 2024-09-16T03:42:35.200 INFO:tasks.workunit.client.0.smithi096.stderr: 201, 2024-09-16T03:42:35.201 INFO:tasks.workunit.client.0.smithi096.stderr: 211, 2024-09-16T03:42:35.201 INFO:tasks.workunit.client.0.smithi096.stderr: 221, 2024-09-16T03:42:35.201 INFO:tasks.workunit.client.0.smithi096.stderr: 231, 2024-09-16T03:42:35.201 INFO:tasks.workunit.client.0.smithi096.stderr: 241, 2024-09-16T03:42:35.201 INFO:tasks.workunit.client.0.smithi096.stderr: 251, 2024-09-16T03:42:35.201 INFO:tasks.workunit.client.0.smithi096.stderr: 261, 2024-09-16T03:42:35.201 INFO:tasks.workunit.client.0.smithi096.stderr: 271, 2024-09-16T03:42:35.201 INFO:tasks.workunit.client.0.smithi096.stderr: 281, 2024-09-16T03:42:35.201 INFO:tasks.workunit.client.0.smithi096.stderr: 291, 2024-09-16T03:42:35.201 INFO:tasks.workunit.client.0.smithi096.stderr: 301, 2024-09-16T03:42:35.201 INFO:tasks.workunit.client.0.smithi096.stderr: 311, 2024-09-16T03:42:35.201 INFO:tasks.workunit.client.0.smithi096.stderr: 321, 2024-09-16T03:42:35.201 INFO:tasks.workunit.client.0.smithi096.stderr: 331, 2024-09-16T03:42:35.201 INFO:tasks.workunit.client.0.smithi096.stderr: 341, 2024-09-16T03:42:35.201 INFO:tasks.workunit.client.0.smithi096.stderr: 351, 2024-09-16T03:42:35.202 INFO:tasks.workunit.client.0.smithi096.stderr: 361, 2024-09-16T03:42:35.202 INFO:tasks.workunit.client.0.smithi096.stderr: 371, 2024-09-16T03:42:35.202 INFO:tasks.workunit.client.0.smithi096.stderr: 381, 2024-09-16T03:42:35.202 INFO:tasks.workunit.client.0.smithi096.stderr: 391, 2024-09-16T03:42:35.202 INFO:tasks.workunit.client.0.smithi096.stderr: 401, 2024-09-16T03:42:35.202 INFO:tasks.workunit.client.0.smithi096.stderr: 411, 2024-09-16T03:42:35.202 INFO:tasks.workunit.client.0.smithi096.stderr: 421, 2024-09-16T03:42:35.202 INFO:tasks.workunit.client.0.smithi096.stderr: 431, 2024-09-16T03:42:35.202 INFO:tasks.workunit.client.0.smithi096.stderr: 441, 2024-09-16T03:42:35.202 INFO:tasks.workunit.client.0.smithi096.stderr: 451, 2024-09-16T03:42:35.202 INFO:tasks.workunit.client.0.smithi096.stderr: 461, 2024-09-16T03:42:35.202 INFO:tasks.workunit.client.0.smithi096.stderr: 471, 2024-09-16T03:42:35.202 INFO:tasks.workunit.client.0.smithi096.stderr: 481, 2024-09-16T03:42:35.202 INFO:tasks.workunit.client.0.smithi096.stderr: 491, 2024-09-16T03:42:35.202 INFO:tasks.workunit.client.0.smithi096.stderr: 501, 2024-09-16T03:42:35.203 INFO:tasks.workunit.client.0.smithi096.stderr: 511, 2024-09-16T03:42:35.203 INFO:tasks.workunit.client.0.smithi096.stderr: 521, 2024-09-16T03:42:35.203 INFO:tasks.workunit.client.0.smithi096.stderr: 531, 2024-09-16T03:42:35.203 INFO:tasks.workunit.client.0.smithi096.stderr: 541, 2024-09-16T03:42:35.203 INFO:tasks.workunit.client.0.smithi096.stderr: 551, 2024-09-16T03:42:35.203 INFO:tasks.workunit.client.0.smithi096.stderr: 561, 2024-09-16T03:42:35.203 INFO:tasks.workunit.client.0.smithi096.stderr: 571, 2024-09-16T03:42:35.203 INFO:tasks.workunit.client.0.smithi096.stderr: 581, 2024-09-16T03:42:35.203 INFO:tasks.workunit.client.0.smithi096.stderr: 591, 2024-09-16T03:42:35.203 INFO:tasks.workunit.client.0.smithi096.stderr: 601, 2024-09-16T03:42:35.203 INFO:tasks.workunit.client.0.smithi096.stderr: 611, 2024-09-16T03:42:35.203 INFO:tasks.workunit.client.0.smithi096.stderr: 621, 2024-09-16T03:42:35.203 INFO:tasks.workunit.client.0.smithi096.stderr: 631, 2024-09-16T03:42:35.203 INFO:tasks.workunit.client.0.smithi096.stderr: 641, 2024-09-16T03:42:35.204 INFO:tasks.workunit.client.0.smithi096.stderr: 651, 2024-09-16T03:42:35.204 INFO:tasks.workunit.client.0.smithi096.stderr: 661, 2024-09-16T03:42:35.204 INFO:tasks.workunit.client.0.smithi096.stderr: 671, 2024-09-16T03:42:35.204 INFO:tasks.workunit.client.0.smithi096.stderr: 681, 2024-09-16T03:42:35.204 INFO:tasks.workunit.client.0.smithi096.stderr: 691, 2024-09-16T03:42:35.204 INFO:tasks.workunit.client.0.smithi096.stderr: 701, 2024-09-16T03:42:35.204 INFO:tasks.workunit.client.0.smithi096.stderr: 711, 2024-09-16T03:42:35.204 INFO:tasks.workunit.client.0.smithi096.stderr: 721, 2024-09-16T03:42:35.204 INFO:tasks.workunit.client.0.smithi096.stderr: 731, 2024-09-16T03:42:35.204 INFO:tasks.workunit.client.0.smithi096.stderr: 741, 2024-09-16T03:42:35.204 INFO:tasks.workunit.client.0.smithi096.stderr: 751, 2024-09-16T03:42:35.204 INFO:tasks.workunit.client.0.smithi096.stderr: 761, 2024-09-16T03:42:35.204 INFO:tasks.workunit.client.0.smithi096.stderr: 771, 2024-09-16T03:42:35.204 INFO:tasks.workunit.client.0.smithi096.stderr: 781, 2024-09-16T03:42:35.205 INFO:tasks.workunit.client.0.smithi096.stderr: 791, 2024-09-16T03:42:35.205 INFO:tasks.workunit.client.0.smithi096.stderr: 801, 2024-09-16T03:42:35.205 INFO:tasks.workunit.client.0.smithi096.stderr: 811, 2024-09-16T03:42:35.205 INFO:tasks.workunit.client.0.smithi096.stderr: 821, 2024-09-16T03:42:35.205 INFO:tasks.workunit.client.0.smithi096.stderr: 831, 2024-09-16T03:42:35.205 INFO:tasks.workunit.client.0.smithi096.stderr: 841, 2024-09-16T03:42:35.205 INFO:tasks.workunit.client.0.smithi096.stderr: 851, 2024-09-16T03:42:35.205 INFO:tasks.workunit.client.0.smithi096.stderr: 861, 2024-09-16T03:42:35.205 INFO:tasks.workunit.client.0.smithi096.stderr: 871, 2024-09-16T03:42:35.205 INFO:tasks.workunit.client.0.smithi096.stderr: 881, 2024-09-16T03:42:35.205 INFO:tasks.workunit.client.0.smithi096.stderr: 891, 2024-09-16T03:42:35.205 INFO:tasks.workunit.client.0.smithi096.stderr: 901, 2024-09-16T03:42:35.205 INFO:tasks.workunit.client.0.smithi096.stderr: 911, 2024-09-16T03:42:35.205 INFO:tasks.workunit.client.0.smithi096.stderr: 921, 2024-09-16T03:42:35.206 INFO:tasks.workunit.client.0.smithi096.stderr: 931 2024-09-16T03:42:35.206 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:42:35.206 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.206 INFO:tasks.workunit.client.0.smithi096.stderr: "fsmap": { 2024-09-16T03:42:35.206 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 1, 2024-09-16T03:42:35.206 INFO:tasks.workunit.client.0.smithi096.stderr: "btime": "2024-09-16T03:26:20:863172+0000", 2024-09-16T03:42:35.206 INFO:tasks.workunit.client.0.smithi096.stderr: "default_fscid": -1, 2024-09-16T03:42:35.206 INFO:tasks.workunit.client.0.smithi096.stderr: "compat": { 2024-09-16T03:42:35.206 INFO:tasks.workunit.client.0.smithi096.stderr: "compat": {}, 2024-09-16T03:42:35.206 INFO:tasks.workunit.client.0.smithi096.stderr: "ro_compat": {}, 2024-09-16T03:42:35.206 INFO:tasks.workunit.client.0.smithi096.stderr: "incompat": { 2024-09-16T03:42:35.206 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_1": "base v0.20", 2024-09-16T03:42:35.206 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_2": "client writeable ranges", 2024-09-16T03:42:35.206 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_3": "default file layouts on dirs", 2024-09-16T03:42:35.207 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_4": "dir inode in separate object", 2024-09-16T03:42:35.207 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_5": "mds uses versioned encoding", 2024-09-16T03:42:35.207 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_6": "dirfrag is stored in omap", 2024-09-16T03:42:35.207 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_8": "no anchor table", 2024-09-16T03:42:35.207 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_9": "file layout v2", 2024-09-16T03:42:35.207 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_10": "snaprealm v2", 2024-09-16T03:42:35.207 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_11": "minor log segments", 2024-09-16T03:42:35.207 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_12": "quiesce subvolumes" 2024-09-16T03:42:35.207 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:35.207 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.207 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_flags": { 2024-09-16T03:42:35.207 INFO:tasks.workunit.client.0.smithi096.stderr: "enable_multiple": true, 2024-09-16T03:42:35.207 INFO:tasks.workunit.client.0.smithi096.stderr: "ever_enabled_multiple": true 2024-09-16T03:42:35.208 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.208 INFO:tasks.workunit.client.0.smithi096.stderr: "standbys": [], 2024-09-16T03:42:35.208 INFO:tasks.workunit.client.0.smithi096.stderr: "filesystems": [] 2024-09-16T03:42:35.208 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.208 INFO:tasks.workunit.client.0.smithi096.stderr: "mdsmap_first_committed": 1, 2024-09-16T03:42:35.208 INFO:tasks.workunit.client.0.smithi096.stderr: "mdsmap_last_committed": 1, 2024-09-16T03:42:35.208 INFO:tasks.workunit.client.0.smithi096.stderr: "auth": { 2024-09-16T03:42:35.208 INFO:tasks.workunit.client.0.smithi096.stderr: "first_committed": 1, 2024-09-16T03:42:35.208 INFO:tasks.workunit.client.0.smithi096.stderr: "last_committed": 5, 2024-09-16T03:42:35.208 INFO:tasks.workunit.client.0.smithi096.stderr: "num_secrets": 3 2024-09-16T03:42:35.208 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.208 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 32, 2024-09-16T03:42:35.208 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_active": 32, 2024-09-16T03:42:35.208 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_unknown": 0, 2024-09-16T03:42:35.209 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osd": 3, 2024-09-16T03:42:35.209 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_sum": { 2024-09-16T03:42:35.209 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:42:35.209 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:42:35.209 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:42:35.209 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:42:35.209 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:42:35.209 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:42:35.209 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:42:35.209 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:42:35.209 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:42:35.209 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:42:35.209 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:42:35.209 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:42:35.210 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:42:35.210 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:42:35.210 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:42:35.210 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:42:35.210 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:42:35.210 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:42:35.210 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:42:35.210 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:42:35.210 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:42:35.210 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:42:35.210 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:42:35.210 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:42:35.210 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:42:35.211 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:42:35.211 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:42:35.211 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:42:35.211 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:42:35.211 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:42:35.211 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:42:35.211 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:42:35.211 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:42:35.211 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:42:35.211 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:42:35.211 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:42:35.211 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:42:35.211 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:42:35.211 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:42:35.212 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:42:35.212 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:42:35.212 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.212 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:42:35.212 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:42:35.212 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:42:35.212 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:42:35.212 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:42:35.212 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:42:35.212 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:42:35.212 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:42:35.212 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:42:35.212 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:42:35.212 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:42:35.213 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.213 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:42:35.213 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:42:35.213 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 96, 2024-09-16T03:42:35.213 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 96, 2024-09-16T03:42:35.213 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 0 2024-09-16T03:42:35.213 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.213 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_sum": { 2024-09-16T03:42:35.213 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 0, 2024-09-16T03:42:35.213 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 0, 2024-09-16T03:42:35.213 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pgs": 96, 2024-09-16T03:42:35.213 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osds": 3, 2024-09-16T03:42:35.213 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_osds": 3, 2024-09-16T03:42:35.214 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_omap_osds": 3, 2024-09-16T03:42:35.214 INFO:tasks.workunit.client.0.smithi096.stderr: "kb": 314572800, 2024-09-16T03:42:35.214 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used": 226044, 2024-09-16T03:42:35.214 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_data": 24744, 2024-09-16T03:42:35.214 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_omap": 4, 2024-09-16T03:42:35.214 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_meta": 201211, 2024-09-16T03:42:35.214 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_avail": 314346756, 2024-09-16T03:42:35.214 INFO:tasks.workunit.client.0.smithi096.stderr: "statfs": { 2024-09-16T03:42:35.214 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 322122547200, 2024-09-16T03:42:35.214 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 321891078144, 2024-09-16T03:42:35.214 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:42:35.214 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 25337856, 2024-09-16T03:42:35.214 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 8347464, 2024-09-16T03:42:35.214 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:42:35.214 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:42:35.215 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:42:35.215 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 4785, 2024-09-16T03:42:35.215 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 206040399 2024-09-16T03:42:35.215 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.215 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_peers": [], 2024-09-16T03:42:35.215 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_trim_queue_len": 0, 2024-09-16T03:42:35.215 INFO:tasks.workunit.client.0.smithi096.stderr: "num_snap_trimming": 0, 2024-09-16T03:42:35.215 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shards_repaired": 0, 2024-09-16T03:42:35.215 INFO:tasks.workunit.client.0.smithi096.stderr: "op_queue_age_hist": { 2024-09-16T03:42:35.215 INFO:tasks.workunit.client.0.smithi096.stderr: "histogram": [], 2024-09-16T03:42:35.215 INFO:tasks.workunit.client.0.smithi096.stderr: "upper_bound": 1 2024-09-16T03:42:35.215 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.215 INFO:tasks.workunit.client.0.smithi096.stderr: "perf_stat": { 2024-09-16T03:42:35.215 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ms": 66, 2024-09-16T03:42:35.216 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ms": 66, 2024-09-16T03:42:35.216 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ns": 66000000, 2024-09-16T03:42:35.216 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ns": 66000000 2024-09-16T03:42:35.216 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.216 INFO:tasks.workunit.client.0.smithi096.stderr: "alerts": [], 2024-09-16T03:42:35.216 INFO:tasks.workunit.client.0.smithi096.stderr: "network_ping_times": [] 2024-09-16T03:42:35.216 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.216 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_sum_by_class": { 2024-09-16T03:42:35.216 INFO:tasks.workunit.client.0.smithi096.stderr: "hdd": { 2024-09-16T03:42:35.216 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 0, 2024-09-16T03:42:35.216 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 0, 2024-09-16T03:42:35.216 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pgs": 96, 2024-09-16T03:42:35.216 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osds": 3, 2024-09-16T03:42:35.216 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_osds": 3, 2024-09-16T03:42:35.217 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_omap_osds": 3, 2024-09-16T03:42:35.217 INFO:tasks.workunit.client.0.smithi096.stderr: "kb": 314572800, 2024-09-16T03:42:35.217 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used": 226044, 2024-09-16T03:42:35.217 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_data": 24744, 2024-09-16T03:42:35.217 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_omap": 4, 2024-09-16T03:42:35.217 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_meta": 201211, 2024-09-16T03:42:35.217 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_avail": 314346756, 2024-09-16T03:42:35.217 INFO:tasks.workunit.client.0.smithi096.stderr: "statfs": { 2024-09-16T03:42:35.217 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 322122547200, 2024-09-16T03:42:35.217 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 321891078144, 2024-09-16T03:42:35.217 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:42:35.217 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 25337856, 2024-09-16T03:42:35.217 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 8347464, 2024-09-16T03:42:35.217 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:42:35.218 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:42:35.218 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:42:35.218 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 4785, 2024-09-16T03:42:35.218 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 206040399 2024-09-16T03:42:35.218 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.218 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_peers": [], 2024-09-16T03:42:35.218 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_trim_queue_len": 0, 2024-09-16T03:42:35.218 INFO:tasks.workunit.client.0.smithi096.stderr: "num_snap_trimming": 0, 2024-09-16T03:42:35.218 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shards_repaired": 0, 2024-09-16T03:42:35.218 INFO:tasks.workunit.client.0.smithi096.stderr: "op_queue_age_hist": { 2024-09-16T03:42:35.218 INFO:tasks.workunit.client.0.smithi096.stderr: "histogram": [], 2024-09-16T03:42:35.218 INFO:tasks.workunit.client.0.smithi096.stderr: "upper_bound": 1 2024-09-16T03:42:35.218 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.218 INFO:tasks.workunit.client.0.smithi096.stderr: "perf_stat": { 2024-09-16T03:42:35.218 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ms": 66, 2024-09-16T03:42:35.219 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ms": 66, 2024-09-16T03:42:35.219 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ns": 66000000, 2024-09-16T03:42:35.219 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ns": 66000000 2024-09-16T03:42:35.219 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.219 INFO:tasks.workunit.client.0.smithi096.stderr: "alerts": [], 2024-09-16T03:42:35.219 INFO:tasks.workunit.client.0.smithi096.stderr: "network_ping_times": [] 2024-09-16T03:42:35.219 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:35.219 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.219 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_stats": [ 2024-09-16T03:42:35.219 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:35.219 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 1, 2024-09-16T03:42:35.219 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 32, 2024-09-16T03:42:35.219 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:42:35.220 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:42:35.220 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:42:35.220 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:42:35.220 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:42:35.220 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:42:35.220 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:42:35.220 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:42:35.220 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:42:35.220 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:42:35.220 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:42:35.220 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:42:35.220 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:42:35.220 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:42:35.220 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:42:35.221 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:42:35.221 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:42:35.221 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:42:35.221 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:42:35.221 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:42:35.221 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:42:35.221 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:42:35.221 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:42:35.221 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:42:35.221 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:42:35.221 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:42:35.221 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:42:35.221 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:42:35.221 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:42:35.221 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:42:35.222 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:42:35.222 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:42:35.222 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:42:35.222 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:42:35.222 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:42:35.222 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:42:35.222 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:42:35.222 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:42:35.222 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:42:35.222 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:42:35.222 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:42:35.222 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.222 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:42:35.222 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:42:35.223 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:42:35.223 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:42:35.223 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:42:35.223 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:42:35.223 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:42:35.223 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:42:35.223 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:42:35.223 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:42:35.223 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:42:35.223 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.223 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:42:35.223 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:42:35.223 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 96, 2024-09-16T03:42:35.223 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 96, 2024-09-16T03:42:35.224 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 3 2024-09-16T03:42:35.224 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:35.224 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:42:35.224 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_stats": [ 2024-09-16T03:42:35.224 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:35.224 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:42:35.224 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 21474836677 2024-09-16T03:42:35.224 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.224 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:35.224 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:42:35.224 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 42949673142 2024-09-16T03:42:35.224 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.224 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:35.224 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:42:35.225 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 64424509618 2024-09-16T03:42:35.225 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:35.225 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:42:35.225 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_by_state": [ 2024-09-16T03:42:35.225 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:35.225 INFO:tasks.workunit.client.0.smithi096.stderr: "state": "active+clean", 2024-09-16T03:42:35.225 INFO:tasks.workunit.client.0.smithi096.stderr: "num": 32 2024-09-16T03:42:35.225 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:35.225 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:42:35.225 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_by_osd": [ 2024-09-16T03:42:35.225 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:35.225 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:42:35.225 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 6, 2024-09-16T03:42:35.225 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 32, 2024-09-16T03:42:35.226 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:42:35.226 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.226 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:35.226 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:42:35.226 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 8, 2024-09-16T03:42:35.226 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 32, 2024-09-16T03:42:35.226 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:42:35.226 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.226 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:35.226 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:42:35.226 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 18, 2024-09-16T03:42:35.226 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 32, 2024-09-16T03:42:35.226 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:42:35.226 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:35.226 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:42:35.227 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": [ 2024-09-16T03:42:35.227 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:35.227 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 1, 2024-09-16T03:42:35.227 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": {} 2024-09-16T03:42:35.227 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:35.227 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:42:35.227 INFO:tasks.workunit.client.0.smithi096.stderr: "servicemap": { 2024-09-16T03:42:35.227 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 6, 2024-09-16T03:42:35.227 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:42:28.636220+0000", 2024-09-16T03:42:35.227 INFO:tasks.workunit.client.0.smithi096.stderr: "services": {} 2024-09-16T03:42:35.227 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:35.227 INFO:tasks.workunit.client.0.smithi096.stderr: "mgrstat_first_committed": 470, 2024-09-16T03:42:35.227 INFO:tasks.workunit.client.0.smithi096.stderr: "mgrstat_last_committed": 476, 2024-09-16T03:42:35.227 INFO:tasks.workunit.client.0.smithi096.stderr: "logm_first_committed": 3260, 2024-09-16T03:42:35.227 INFO:tasks.workunit.client.0.smithi096.stderr: "logm_last_committed": 3934, 2024-09-16T03:42:35.228 INFO:tasks.workunit.client.0.smithi096.stderr: "paxos": { 2024-09-16T03:42:35.228 INFO:tasks.workunit.client.0.smithi096.stderr: "first_committed": 4770, 2024-09-16T03:42:35.228 INFO:tasks.workunit.client.0.smithi096.stderr: "last_committed": 5412, 2024-09-16T03:42:35.228 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pn": 0, 2024-09-16T03:42:35.228 INFO:tasks.workunit.client.0.smithi096.stderr: "accepted_pn": 0 2024-09-16T03:42:35.228 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:35.228 INFO:tasks.workunit.client.0.smithi096.stderr:}' 2024-09-16T03:42:35.228 INFO:tasks.workunit.client.0.smithi096.stderr:++ jq .osdmap_first_committed 2024-09-16T03:42:35.229 INFO:tasks.workunit.client.0.smithi096.stderr:+ fc=11 2024-09-16T03:42:35.229 INFO:tasks.workunit.client.0.smithi096.stderr:+ [[ 11 -eq 11 ]] 2024-09-16T03:42:35.229 INFO:tasks.workunit.client.0.smithi096.stderr:+ old_first_pinned=1 2024-09-16T03:42:35.229 INFO:tasks.workunit.client.0.smithi096.stderr:+ old_last_pinned=921 2024-09-16T03:42:35.230 INFO:tasks.workunit.client.0.smithi096.stderr:++ jq .osdmap_manifest.first_pinned 2024-09-16T03:42:35.230 INFO:tasks.workunit.client.0.smithi096.stderr:+ first_pinned=11 2024-09-16T03:42:35.230 INFO:tasks.workunit.client.0.smithi096.stderr:++ jq .osdmap_manifest.last_pinned 2024-09-16T03:42:35.230 INFO:tasks.workunit.client.0.smithi096.stderr:+ last_pinned=931 2024-09-16T03:42:35.230 INFO:tasks.workunit.client.0.smithi096.stderr:+ [[ 11 -eq 11 ]] 2024-09-16T03:42:35.230 INFO:tasks.workunit.client.0.smithi096.stderr:+ [[ 11 -gt 1 ]] 2024-09-16T03:42:35.230 INFO:tasks.workunit.client.0.smithi096.stderr:+ [[ 931 -gt 1 ]] 2024-09-16T03:42:35.230 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 11 2024-09-16T03:42:35.230 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=11 2024-09-16T03:42:35.230 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:42:35.230 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:42:35.230 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.X5psyiLiFo 2024-09-16T03:42:35.231 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 11 -o /tmp/tmp.X5psyiLiFo 2024-09-16T03:42:35.679 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 11 2024-09-16T03:42:35.697 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.X5psyiLiFo 2024-09-16T03:42:35.697 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 11' 2024-09-16T03:42:35.718 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.X5psyiLiFo' 2024-09-16T03:42:35.719 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 11 2024-09-16T03:42:35.719 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.X5psyiLiFo 2024-09-16T03:42:35.720 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:42:35.720 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 12 2024-09-16T03:42:35.720 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=12 2024-09-16T03:42:35.721 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:42:35.721 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:42:35.721 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.7vECIAoHMr 2024-09-16T03:42:35.721 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 12 -o /tmp/tmp.7vECIAoHMr 2024-09-16T03:42:36.131 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 12 2024-09-16T03:42:36.146 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.7vECIAoHMr 2024-09-16T03:42:36.146 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 12' 2024-09-16T03:42:36.165 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.7vECIAoHMr' 2024-09-16T03:42:36.167 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 12 2024-09-16T03:42:36.167 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.7vECIAoHMr 2024-09-16T03:42:36.168 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:42:36.168 INFO:tasks.workunit.client.0.smithi096.stderr:+ pinned_maps=($(jq '.osdmap_manifest.pinned_maps[]' <<< $report)) 2024-09-16T03:42:36.168 INFO:tasks.workunit.client.0.smithi096.stderr:++ jq '.osdmap_manifest.pinned_maps[]' 2024-09-16T03:42:36.200 INFO:tasks.workunit.client.0.smithi096.stderr:+ [[ 93 -gt 2 ]] 2024-09-16T03:42:36.200 INFO:tasks.workunit.client.0.smithi096.stderr:+ trim_to=20 2024-09-16T03:42:36.200 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph config set mon mon_osd_force_trim_to 20 2024-09-16T03:42:36.762 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:42:37.431 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:42:37.453 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:42:38.201 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:42:38.220 INFO:tasks.workunit.client.0.smithi096.stderr:+ wait_for_trim 20 2024-09-16T03:42:38.221 INFO:tasks.workunit.client.0.smithi096.stderr:+ local -i epoch=20 2024-09-16T03:42:38.221 INFO:tasks.workunit.client.0.smithi096.stderr:++ get_timeout_delays 300 .1 2024-09-16T03:42:38.222 INFO:tasks.workunit.client.0.smithi096.stderr:+++ shopt -q -o xtrace 2024-09-16T03:42:38.222 INFO:tasks.workunit.client.0.smithi096.stderr:+++ echo true 2024-09-16T03:42:38.222 INFO:tasks.workunit.client.0.smithi096.stderr:++ local trace=true 2024-09-16T03:42:38.222 INFO:tasks.workunit.client.0.smithi096.stderr:++ true 2024-09-16T03:42:38.222 INFO:tasks.workunit.client.0.smithi096.stderr:++ shopt -u -o xtrace 2024-09-16T03:42:38.435 INFO:tasks.workunit.client.0.smithi096.stderr:+ delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '4.5') 2024-09-16T03:42:38.435 INFO:tasks.workunit.client.0.smithi096.stderr:+ local -a delays 2024-09-16T03:42:38.435 INFO:tasks.workunit.client.0.smithi096.stderr:+ local -i loop=0 2024-09-16T03:42:38.435 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i=0 )) 2024-09-16T03:42:38.435 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < 27 )) 2024-09-16T03:42:38.435 INFO:tasks.workunit.client.0.smithi096.stderr:++ ceph report 2024-09-16T03:42:38.436 INFO:tasks.workunit.client.0.smithi096.stderr:++ jq .osdmap_first_committed 2024-09-16T03:42:39.068 INFO:tasks.workunit.client.0.smithi096.stderr:report 2436205373 2024-09-16T03:42:39.086 INFO:tasks.workunit.client.0.smithi096.stderr:+ fc=20 2024-09-16T03:42:39.087 INFO:tasks.workunit.client.0.smithi096.stderr:+ [[ 20 -eq 20 ]] 2024-09-16T03:42:39.087 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:42:39.087 INFO:tasks.workunit.client.0.smithi096.stderr:++ ceph report 2024-09-16T03:42:39.750 INFO:tasks.workunit.client.0.smithi096.stderr:report 2239433186 2024-09-16T03:42:39.768 INFO:tasks.workunit.client.0.smithi096.stderr:+ report='{ 2024-09-16T03:42:39.769 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_fingerprint": "eaf2fd8a-7c8d-4abd-8137-a2b360091b66", 2024-09-16T03:42:39.769 INFO:tasks.workunit.client.0.smithi096.stderr: "version": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:42:39.769 INFO:tasks.workunit.client.0.smithi096.stderr: "commit": "fc3e0bff7468fd55478adbae7f75508b749124b6", 2024-09-16T03:42:39.769 INFO:tasks.workunit.client.0.smithi096.stderr: "timestamp": "2024-09-16T03:42:39.751852+0000", 2024-09-16T03:42:39.769 INFO:tasks.workunit.client.0.smithi096.stderr: "tag": "", 2024-09-16T03:42:39.769 INFO:tasks.workunit.client.0.smithi096.stderr: "health": { 2024-09-16T03:42:39.769 INFO:tasks.workunit.client.0.smithi096.stderr: "status": "HEALTH_WARN", 2024-09-16T03:42:39.769 INFO:tasks.workunit.client.0.smithi096.stderr: "checks": { 2024-09-16T03:42:39.769 INFO:tasks.workunit.client.0.smithi096.stderr: "POOL_APP_NOT_ENABLED": { 2024-09-16T03:42:39.769 INFO:tasks.workunit.client.0.smithi096.stderr: "severity": "HEALTH_WARN", 2024-09-16T03:42:39.769 INFO:tasks.workunit.client.0.smithi096.stderr: "summary": { 2024-09-16T03:42:39.770 INFO:tasks.workunit.client.0.smithi096.stderr: "message": "1 pool(s) do not have an application enabled", 2024-09-16T03:42:39.770 INFO:tasks.workunit.client.0.smithi096.stderr: "count": 1 2024-09-16T03:42:39.770 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.770 INFO:tasks.workunit.client.0.smithi096.stderr: "detail": [ 2024-09-16T03:42:39.770 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:39.770 INFO:tasks.workunit.client.0.smithi096.stderr: "message": "application not enabled on pool '\''foo'\''" 2024-09-16T03:42:39.770 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.770 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:39.770 INFO:tasks.workunit.client.0.smithi096.stderr: "message": "use '\''ceph osd pool application enable '\'', where is '\''cephfs'\'', '\''rbd'\'', '\''rgw'\'', or freeform for custom applications." 2024-09-16T03:42:39.770 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:39.770 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:42:39.771 INFO:tasks.workunit.client.0.smithi096.stderr: "muted": false 2024-09-16T03:42:39.771 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:39.771 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.771 INFO:tasks.workunit.client.0.smithi096.stderr: "mutes": [] 2024-09-16T03:42:39.771 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.771 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap_first_committed": 1, 2024-09-16T03:42:39.771 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap_last_committed": 1, 2024-09-16T03:42:39.771 INFO:tasks.workunit.client.0.smithi096.stderr: "monmap": { 2024-09-16T03:42:39.771 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 1, 2024-09-16T03:42:39.771 INFO:tasks.workunit.client.0.smithi096.stderr: "fsid": "08dc5a0f-381e-4717-8c90-55791ebeecfd", 2024-09-16T03:42:39.771 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:26:19.960858Z", 2024-09-16T03:42:39.771 INFO:tasks.workunit.client.0.smithi096.stderr: "created": "2024-09-16T03:26:19.960858Z", 2024-09-16T03:42:39.772 INFO:tasks.workunit.client.0.smithi096.stderr: "min_mon_release": 19, 2024-09-16T03:42:39.772 INFO:tasks.workunit.client.0.smithi096.stderr: "min_mon_release_name": "squid", 2024-09-16T03:42:39.772 INFO:tasks.workunit.client.0.smithi096.stderr: "election_strategy": 1, 2024-09-16T03:42:39.772 INFO:tasks.workunit.client.0.smithi096.stderr: "disallowed_leaders: ": "", 2024-09-16T03:42:39.772 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode": false, 2024-09-16T03:42:39.772 INFO:tasks.workunit.client.0.smithi096.stderr: "tiebreaker_mon": "", 2024-09-16T03:42:39.772 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_ranks: ": "", 2024-09-16T03:42:39.772 INFO:tasks.workunit.client.0.smithi096.stderr: "features": { 2024-09-16T03:42:39.772 INFO:tasks.workunit.client.0.smithi096.stderr: "persistent": [ 2024-09-16T03:42:39.772 INFO:tasks.workunit.client.0.smithi096.stderr: "kraken", 2024-09-16T03:42:39.772 INFO:tasks.workunit.client.0.smithi096.stderr: "luminous", 2024-09-16T03:42:39.772 INFO:tasks.workunit.client.0.smithi096.stderr: "mimic", 2024-09-16T03:42:39.773 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap-prune", 2024-09-16T03:42:39.773 INFO:tasks.workunit.client.0.smithi096.stderr: "nautilus", 2024-09-16T03:42:39.773 INFO:tasks.workunit.client.0.smithi096.stderr: "octopus", 2024-09-16T03:42:39.773 INFO:tasks.workunit.client.0.smithi096.stderr: "pacific", 2024-09-16T03:42:39.773 INFO:tasks.workunit.client.0.smithi096.stderr: "elector-pinging", 2024-09-16T03:42:39.773 INFO:tasks.workunit.client.0.smithi096.stderr: "quincy", 2024-09-16T03:42:39.773 INFO:tasks.workunit.client.0.smithi096.stderr: "reef", 2024-09-16T03:42:39.773 INFO:tasks.workunit.client.0.smithi096.stderr: "squid" 2024-09-16T03:42:39.773 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:42:39.773 INFO:tasks.workunit.client.0.smithi096.stderr: "optional": [] 2024-09-16T03:42:39.773 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.773 INFO:tasks.workunit.client.0.smithi096.stderr: "mons": [ 2024-09-16T03:42:39.773 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:39.774 INFO:tasks.workunit.client.0.smithi096.stderr: "rank": 0, 2024-09-16T03:42:39.774 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "a", 2024-09-16T03:42:39.774 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:42:39.774 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:42:39.774 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:39.774 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:42:39.774 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:7115", 2024-09-16T03:42:39.774 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 0 2024-09-16T03:42:39.774 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:39.774 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:42:39.774 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.774 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:7115/0", 2024-09-16T03:42:39.774 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:7115/0", 2024-09-16T03:42:39.775 INFO:tasks.workunit.client.0.smithi096.stderr: "priority": 0, 2024-09-16T03:42:39.775 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 0, 2024-09-16T03:42:39.775 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_location": "{}" 2024-09-16T03:42:39.775 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:39.775 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:42:39.775 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.775 INFO:tasks.workunit.client.0.smithi096.stderr: "quorum": [ 2024-09-16T03:42:39.775 INFO:tasks.workunit.client.0.smithi096.stderr: 0 2024-09-16T03:42:39.775 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:42:39.775 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap": { 2024-09-16T03:42:39.775 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 1038, 2024-09-16T03:42:39.775 INFO:tasks.workunit.client.0.smithi096.stderr: "fsid": "08dc5a0f-381e-4717-8c90-55791ebeecfd", 2024-09-16T03:42:39.775 INFO:tasks.workunit.client.0.smithi096.stderr: "created": "2024-09-16T03:26:20.886850+0000", 2024-09-16T03:42:39.776 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:42:38.157003+0000", 2024-09-16T03:42:39.776 INFO:tasks.workunit.client.0.smithi096.stderr: "last_up_change": "2024-09-16T03:28:12.669817+0000", 2024-09-16T03:42:39.776 INFO:tasks.workunit.client.0.smithi096.stderr: "last_in_change": "2024-09-16T03:27:36.130692+0000", 2024-09-16T03:42:39.776 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-16T03:42:39.776 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_num": 5799936, 2024-09-16T03:42:39.776 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_set": [ 2024-09-16T03:42:39.776 INFO:tasks.workunit.client.0.smithi096.stderr: "pglog_hardlimit", 2024-09-16T03:42:39.776 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snapdirs", 2024-09-16T03:42:39.776 INFO:tasks.workunit.client.0.smithi096.stderr: "recovery_deletes", 2024-09-16T03:42:39.776 INFO:tasks.workunit.client.0.smithi096.stderr: "sortbitwise" 2024-09-16T03:42:39.776 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:42:39.776 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_version": 7, 2024-09-16T03:42:39.776 INFO:tasks.workunit.client.0.smithi096.stderr: "full_ratio": 0.97000002861022949, 2024-09-16T03:42:39.777 INFO:tasks.workunit.client.0.smithi096.stderr: "backfillfull_ratio": 0.97000002861022949, 2024-09-16T03:42:39.777 INFO:tasks.workunit.client.0.smithi096.stderr: "nearfull_ratio": 0.85000002384185791, 2024-09-16T03:42:39.777 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_snapshot": "", 2024-09-16T03:42:39.777 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_max": 1, 2024-09-16T03:42:39.777 INFO:tasks.workunit.client.0.smithi096.stderr: "max_osd": 3, 2024-09-16T03:42:39.777 INFO:tasks.workunit.client.0.smithi096.stderr: "require_min_compat_client": "luminous", 2024-09-16T03:42:39.777 INFO:tasks.workunit.client.0.smithi096.stderr: "min_compat_client": "jewel", 2024-09-16T03:42:39.777 INFO:tasks.workunit.client.0.smithi096.stderr: "require_osd_release": "squid", 2024-09-16T03:42:39.777 INFO:tasks.workunit.client.0.smithi096.stderr: "allow_crimson": false, 2024-09-16T03:42:39.777 INFO:tasks.workunit.client.0.smithi096.stderr: "pools": [ 2024-09-16T03:42:39.777 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:39.777 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 1, 2024-09-16T03:42:39.777 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_name": "foo", 2024-09-16T03:42:39.778 INFO:tasks.workunit.client.0.smithi096.stderr: "create_time": "2024-09-16T03:28:23.539340+0000", 2024-09-16T03:42:39.778 INFO:tasks.workunit.client.0.smithi096.stderr: "flags": 1, 2024-09-16T03:42:39.778 INFO:tasks.workunit.client.0.smithi096.stderr: "flags_names": "hashpspool", 2024-09-16T03:42:39.778 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:42:39.778 INFO:tasks.workunit.client.0.smithi096.stderr: "size": 3, 2024-09-16T03:42:39.778 INFO:tasks.workunit.client.0.smithi096.stderr: "min_size": 2, 2024-09-16T03:42:39.778 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_rule": 0, 2024-09-16T03:42:39.778 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_count": 0, 2024-09-16T03:42:39.778 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_target": 0, 2024-09-16T03:42:39.778 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_barrier": 0, 2024-09-16T03:42:39.778 INFO:tasks.workunit.client.0.smithi096.stderr: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-16T03:42:39.778 INFO:tasks.workunit.client.0.smithi096.stderr: "is_stretch_pool": false, 2024-09-16T03:42:39.778 INFO:tasks.workunit.client.0.smithi096.stderr: "object_hash": 2, 2024-09-16T03:42:39.778 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_autoscale_mode": "off", 2024-09-16T03:42:39.779 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num": 32, 2024-09-16T03:42:39.779 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num": 32, 2024-09-16T03:42:39.779 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_placement_num_target": 32, 2024-09-16T03:42:39.779 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_target": 32, 2024-09-16T03:42:39.779 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_num_pending": 32, 2024-09-16T03:42:39.779 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pg_merge_meta": { 2024-09-16T03:42:39.779 INFO:tasks.workunit.client.0.smithi096.stderr: "source_pgid": "0.0", 2024-09-16T03:42:39.779 INFO:tasks.workunit.client.0.smithi096.stderr: "ready_epoch": 0, 2024-09-16T03:42:39.779 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_started": 0, 2024-09-16T03:42:39.779 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": 0, 2024-09-16T03:42:39.779 INFO:tasks.workunit.client.0.smithi096.stderr: "source_version": "0'\''0", 2024-09-16T03:42:39.779 INFO:tasks.workunit.client.0.smithi096.stderr: "target_version": "0'\''0" 2024-09-16T03:42:39.780 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.780 INFO:tasks.workunit.client.0.smithi096.stderr: "last_change": "25", 2024-09-16T03:42:39.780 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend": "0", 2024-09-16T03:42:39.780 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_prenautilus": "0", 2024-09-16T03:42:39.780 INFO:tasks.workunit.client.0.smithi096.stderr: "last_force_op_resend_preluminous": "0", 2024-09-16T03:42:39.780 INFO:tasks.workunit.client.0.smithi096.stderr: "auid": 0, 2024-09-16T03:42:39.780 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_mode": "selfmanaged", 2024-09-16T03:42:39.780 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_seq": 0, 2024-09-16T03:42:39.780 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_epoch": 0, 2024-09-16T03:42:39.780 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_snaps": [], 2024-09-16T03:42:39.780 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps": "[]", 2024-09-16T03:42:39.780 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_bytes": 0, 2024-09-16T03:42:39.780 INFO:tasks.workunit.client.0.smithi096.stderr: "quota_max_objects": 0, 2024-09-16T03:42:39.781 INFO:tasks.workunit.client.0.smithi096.stderr: "tiers": [], 2024-09-16T03:42:39.781 INFO:tasks.workunit.client.0.smithi096.stderr: "tier_of": -1, 2024-09-16T03:42:39.781 INFO:tasks.workunit.client.0.smithi096.stderr: "read_tier": -1, 2024-09-16T03:42:39.781 INFO:tasks.workunit.client.0.smithi096.stderr: "write_tier": -1, 2024-09-16T03:42:39.781 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_mode": "none", 2024-09-16T03:42:39.781 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_bytes": 0, 2024-09-16T03:42:39.781 INFO:tasks.workunit.client.0.smithi096.stderr: "target_max_objects": 0, 2024-09-16T03:42:39.781 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_ratio_micro": 400000, 2024-09-16T03:42:39.781 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-16T03:42:39.781 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_target_full_ratio_micro": 800000, 2024-09-16T03:42:39.781 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_flush_age": 0, 2024-09-16T03:42:39.781 INFO:tasks.workunit.client.0.smithi096.stderr: "cache_min_evict_age": 0, 2024-09-16T03:42:39.781 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profile": "", 2024-09-16T03:42:39.782 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_params": { 2024-09-16T03:42:39.782 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "none" 2024-09-16T03:42:39.782 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.782 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_period": 0, 2024-09-16T03:42:39.782 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_count": 0, 2024-09-16T03:42:39.782 INFO:tasks.workunit.client.0.smithi096.stderr: "use_gmt_hitset": true, 2024-09-16T03:42:39.782 INFO:tasks.workunit.client.0.smithi096.stderr: "min_read_recency_for_promote": 0, 2024-09-16T03:42:39.782 INFO:tasks.workunit.client.0.smithi096.stderr: "min_write_recency_for_promote": 0, 2024-09-16T03:42:39.782 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_grade_decay_rate": 0, 2024-09-16T03:42:39.782 INFO:tasks.workunit.client.0.smithi096.stderr: "hit_set_search_last_n": 0, 2024-09-16T03:42:39.782 INFO:tasks.workunit.client.0.smithi096.stderr: "grade_table": [], 2024-09-16T03:42:39.782 INFO:tasks.workunit.client.0.smithi096.stderr: "stripe_width": 0, 2024-09-16T03:42:39.782 INFO:tasks.workunit.client.0.smithi096.stderr: "expected_num_objects": 0, 2024-09-16T03:42:39.783 INFO:tasks.workunit.client.0.smithi096.stderr: "fast_read": false, 2024-09-16T03:42:39.783 INFO:tasks.workunit.client.0.smithi096.stderr: "options": {}, 2024-09-16T03:42:39.783 INFO:tasks.workunit.client.0.smithi096.stderr: "application_metadata": {}, 2024-09-16T03:42:39.783 INFO:tasks.workunit.client.0.smithi096.stderr: "read_balance": { 2024-09-16T03:42:39.783 INFO:tasks.workunit.client.0.smithi096.stderr: "score_type": "Fair distribution", 2024-09-16T03:42:39.783 INFO:tasks.workunit.client.0.smithi096.stderr: "score_acting": 1.690000057220459, 2024-09-16T03:42:39.783 INFO:tasks.workunit.client.0.smithi096.stderr: "score_stable": 1.690000057220459, 2024-09-16T03:42:39.784 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_score": 1, 2024-09-16T03:42:39.784 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_acting": 1.690000057220459, 2024-09-16T03:42:39.784 INFO:tasks.workunit.client.0.smithi096.stderr: "raw_score_stable": 1.690000057220459, 2024-09-16T03:42:39.784 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity_weighted": 1, 2024-09-16T03:42:39.784 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity": 1, 2024-09-16T03:42:39.784 INFO:tasks.workunit.client.0.smithi096.stderr: "average_primary_affinity_weighted": 1 2024-09-16T03:42:39.784 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:39.784 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:39.785 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:42:39.785 INFO:tasks.workunit.client.0.smithi096.stderr: "osds": [ 2024-09-16T03:42:39.785 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:39.785 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:42:39.785 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "cf18d22c-4700-44bd-90f9-a7f9263a145b", 2024-09-16T03:42:39.785 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:42:39.785 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:42:39.785 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:42:39.785 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:42:39.786 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:42:39.786 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:42:39.786 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 5, 2024-09-16T03:42:39.786 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 21, 2024-09-16T03:42:39.786 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:42:39.786 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:42:39.786 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:42:39.786 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:42:39.786 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:39.786 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:42:39.786 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6802", 2024-09-16T03:42:39.786 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3449414971 2024-09-16T03:42:39.787 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.787 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:39.787 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:42:39.787 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6803", 2024-09-16T03:42:39.787 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3449414971 2024-09-16T03:42:39.787 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:39.787 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:42:39.787 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.787 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:42:39.787 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:42:39.787 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:39.787 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:42:39.787 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6804", 2024-09-16T03:42:39.787 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3449414971 2024-09-16T03:42:39.788 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.788 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:39.788 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:42:39.788 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6805", 2024-09-16T03:42:39.788 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3449414971 2024-09-16T03:42:39.788 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:39.788 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:42:39.788 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.788 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:42:39.788 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:42:39.788 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:39.788 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:42:39.788 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6808", 2024-09-16T03:42:39.789 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3449414971 2024-09-16T03:42:39.789 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.789 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:39.789 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:42:39.789 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6809", 2024-09-16T03:42:39.789 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3449414971 2024-09-16T03:42:39.789 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:39.789 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:42:39.789 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.789 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:42:39.789 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:42:39.789 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:39.789 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:42:39.790 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6806", 2024-09-16T03:42:39.790 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3449414971 2024-09-16T03:42:39.790 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.790 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:39.790 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:42:39.790 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6807", 2024-09-16T03:42:39.790 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 3449414971 2024-09-16T03:42:39.790 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:39.790 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:42:39.790 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.790 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6803/3449414971", 2024-09-16T03:42:39.790 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6805/3449414971", 2024-09-16T03:42:39.790 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6809/3449414971", 2024-09-16T03:42:39.790 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6807/3449414971", 2024-09-16T03:42:39.791 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:42:39.791 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:42:39.791 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:42:39.791 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:42:39.791 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.791 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:39.791 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:42:39.791 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "1ed2d78f-1635-4234-83aa-7c0b7e3c87dc", 2024-09-16T03:42:39.791 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:42:39.791 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:42:39.791 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:42:39.791 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:42:39.791 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:42:39.792 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:42:39.792 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 10, 2024-09-16T03:42:39.792 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 21, 2024-09-16T03:42:39.792 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:42:39.792 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:42:39.792 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:42:39.792 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:42:39.792 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:39.792 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:42:39.792 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6810", 2024-09-16T03:42:39.792 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 4240988863 2024-09-16T03:42:39.792 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.792 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:39.792 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:42:39.793 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6811", 2024-09-16T03:42:39.793 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 4240988863 2024-09-16T03:42:39.793 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:39.793 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:42:39.793 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.793 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:42:39.793 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:42:39.793 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:39.793 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:42:39.793 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6812", 2024-09-16T03:42:39.793 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 4240988863 2024-09-16T03:42:39.793 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.793 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:39.794 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:42:39.794 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6813", 2024-09-16T03:42:39.794 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 4240988863 2024-09-16T03:42:39.794 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:39.794 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:42:39.794 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.794 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:42:39.794 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:42:39.794 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:39.794 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:42:39.794 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6816", 2024-09-16T03:42:39.794 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 4240988863 2024-09-16T03:42:39.794 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.795 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:39.795 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:42:39.795 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6817", 2024-09-16T03:42:39.795 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 4240988863 2024-09-16T03:42:39.795 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:39.795 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:42:39.795 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.795 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:42:39.795 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:42:39.796 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:39.796 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:42:39.796 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6814", 2024-09-16T03:42:39.796 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 4240988863 2024-09-16T03:42:39.796 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.796 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:39.796 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:42:39.796 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6815", 2024-09-16T03:42:39.796 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 4240988863 2024-09-16T03:42:39.796 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:39.796 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:42:39.796 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.796 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6811/4240988863", 2024-09-16T03:42:39.796 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6813/4240988863", 2024-09-16T03:42:39.797 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6817/4240988863", 2024-09-16T03:42:39.797 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6815/4240988863", 2024-09-16T03:42:39.797 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:42:39.797 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:42:39.797 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:42:39.797 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:42:39.797 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.797 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:39.797 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:42:39.797 INFO:tasks.workunit.client.0.smithi096.stderr: "uuid": "c4febd52-73d0-4470-af74-9bb5e7ac65da", 2024-09-16T03:42:39.797 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 1, 2024-09-16T03:42:39.797 INFO:tasks.workunit.client.0.smithi096.stderr: "in": 1, 2024-09-16T03:42:39.797 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 1, 2024-09-16T03:42:39.798 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_affinity": 1, 2024-09-16T03:42:39.798 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_begin": 0, 2024-09-16T03:42:39.798 INFO:tasks.workunit.client.0.smithi096.stderr: "last_clean_end": 0, 2024-09-16T03:42:39.798 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 15, 2024-09-16T03:42:39.798 INFO:tasks.workunit.client.0.smithi096.stderr: "up_thru": 21, 2024-09-16T03:42:39.798 INFO:tasks.workunit.client.0.smithi096.stderr: "down_at": 0, 2024-09-16T03:42:39.798 INFO:tasks.workunit.client.0.smithi096.stderr: "lost_at": 0, 2024-09-16T03:42:39.798 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addrs": { 2024-09-16T03:42:39.798 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:42:39.798 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:39.798 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:42:39.798 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6818", 2024-09-16T03:42:39.799 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 2239695978 2024-09-16T03:42:39.799 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.799 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:39.799 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:42:39.799 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6819", 2024-09-16T03:42:39.799 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 2239695978 2024-09-16T03:42:39.799 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:39.799 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:42:39.799 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.799 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addrs": { 2024-09-16T03:42:39.799 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:42:39.799 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:39.799 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:42:39.800 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6820", 2024-09-16T03:42:39.800 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 2239695978 2024-09-16T03:42:39.800 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.800 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:39.800 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:42:39.800 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6821", 2024-09-16T03:42:39.800 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 2239695978 2024-09-16T03:42:39.800 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:39.800 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:42:39.800 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.800 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addrs": { 2024-09-16T03:42:39.800 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:42:39.800 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:39.800 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:42:39.801 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6824", 2024-09-16T03:42:39.801 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 2239695978 2024-09-16T03:42:39.801 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.801 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:39.801 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:42:39.801 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6825", 2024-09-16T03:42:39.801 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 2239695978 2024-09-16T03:42:39.801 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:39.801 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:42:39.801 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.801 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addrs": { 2024-09-16T03:42:39.801 INFO:tasks.workunit.client.0.smithi096.stderr: "addrvec": [ 2024-09-16T03:42:39.801 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:39.801 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v2", 2024-09-16T03:42:39.802 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6822", 2024-09-16T03:42:39.802 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 2239695978 2024-09-16T03:42:39.802 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.802 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:39.802 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "v1", 2024-09-16T03:42:39.802 INFO:tasks.workunit.client.0.smithi096.stderr: "addr": "127.0.0.1:6823", 2024-09-16T03:42:39.802 INFO:tasks.workunit.client.0.smithi096.stderr: "nonce": 2239695978 2024-09-16T03:42:39.802 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:39.802 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:42:39.802 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.802 INFO:tasks.workunit.client.0.smithi096.stderr: "public_addr": "127.0.0.1:6819/2239695978", 2024-09-16T03:42:39.802 INFO:tasks.workunit.client.0.smithi096.stderr: "cluster_addr": "127.0.0.1:6821/2239695978", 2024-09-16T03:42:39.802 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_back_addr": "127.0.0.1:6825/2239695978", 2024-09-16T03:42:39.802 INFO:tasks.workunit.client.0.smithi096.stderr: "heartbeat_front_addr": "127.0.0.1:6823/2239695978", 2024-09-16T03:42:39.803 INFO:tasks.workunit.client.0.smithi096.stderr: "state": [ 2024-09-16T03:42:39.803 INFO:tasks.workunit.client.0.smithi096.stderr: "exists", 2024-09-16T03:42:39.803 INFO:tasks.workunit.client.0.smithi096.stderr: "up" 2024-09-16T03:42:39.803 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:42:39.803 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:39.803 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:42:39.803 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_xinfo": [ 2024-09-16T03:42:39.803 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:39.803 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:42:39.803 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:42:39.803 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:42:39.803 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:42:39.803 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:42:39.803 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:42:39.804 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:26:56.992065+0000", 2024-09-16T03:42:39.804 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:42:39.804 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.804 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:39.804 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:42:39.804 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:42:39.804 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:42:39.804 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:42:39.804 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:42:39.804 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:42:39.804 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:27:34.030155+0000", 2024-09-16T03:42:39.804 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:42:39.804 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.804 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:39.805 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:42:39.805 INFO:tasks.workunit.client.0.smithi096.stderr: "down_stamp": "0.000000", 2024-09-16T03:42:39.805 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_probability": 0, 2024-09-16T03:42:39.805 INFO:tasks.workunit.client.0.smithi096.stderr: "laggy_interval": 0, 2024-09-16T03:42:39.805 INFO:tasks.workunit.client.0.smithi096.stderr: "features": 4540719139924082687, 2024-09-16T03:42:39.805 INFO:tasks.workunit.client.0.smithi096.stderr: "old_weight": 0, 2024-09-16T03:42:39.805 INFO:tasks.workunit.client.0.smithi096.stderr: "last_purged_snaps_scrub": "2024-09-16T03:28:12.174041+0000", 2024-09-16T03:42:39.805 INFO:tasks.workunit.client.0.smithi096.stderr: "dead_epoch": 0 2024-09-16T03:42:39.805 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:39.805 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:42:39.805 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap": [], 2024-09-16T03:42:39.805 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap_items": [], 2024-09-16T03:42:39.805 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_upmap_primaries": [], 2024-09-16T03:42:39.806 INFO:tasks.workunit.client.0.smithi096.stderr: "pg_temp": [], 2024-09-16T03:42:39.806 INFO:tasks.workunit.client.0.smithi096.stderr: "primary_temp": [], 2024-09-16T03:42:39.806 INFO:tasks.workunit.client.0.smithi096.stderr: "blocklist": {}, 2024-09-16T03:42:39.806 INFO:tasks.workunit.client.0.smithi096.stderr: "range_blocklist": {}, 2024-09-16T03:42:39.806 INFO:tasks.workunit.client.0.smithi096.stderr: "erasure_code_profiles": { 2024-09-16T03:42:39.806 INFO:tasks.workunit.client.0.smithi096.stderr: "default": { 2024-09-16T03:42:39.806 INFO:tasks.workunit.client.0.smithi096.stderr: "k": "2", 2024-09-16T03:42:39.806 INFO:tasks.workunit.client.0.smithi096.stderr: "m": "2", 2024-09-16T03:42:39.806 INFO:tasks.workunit.client.0.smithi096.stderr: "plugin": "jerasure", 2024-09-16T03:42:39.806 INFO:tasks.workunit.client.0.smithi096.stderr: "technique": "reed_sol_van" 2024-09-16T03:42:39.806 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:39.806 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.806 INFO:tasks.workunit.client.0.smithi096.stderr: "removed_snaps_queue": [], 2024-09-16T03:42:39.807 INFO:tasks.workunit.client.0.smithi096.stderr: "new_removed_snaps": [], 2024-09-16T03:42:39.807 INFO:tasks.workunit.client.0.smithi096.stderr: "new_purged_snaps": [], 2024-09-16T03:42:39.807 INFO:tasks.workunit.client.0.smithi096.stderr: "crush_node_flags": {}, 2024-09-16T03:42:39.807 INFO:tasks.workunit.client.0.smithi096.stderr: "device_class_flags": {}, 2024-09-16T03:42:39.807 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode": { 2024-09-16T03:42:39.807 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode_enabled": false, 2024-09-16T03:42:39.807 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_bucket_count": 0, 2024-09-16T03:42:39.807 INFO:tasks.workunit.client.0.smithi096.stderr: "degraded_stretch_mode": 0, 2024-09-16T03:42:39.807 INFO:tasks.workunit.client.0.smithi096.stderr: "recovering_stretch_mode": 0, 2024-09-16T03:42:39.807 INFO:tasks.workunit.client.0.smithi096.stderr: "stretch_mode_bucket": 0 2024-09-16T03:42:39.807 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:39.807 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.807 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_metadata": [ 2024-09-16T03:42:39.807 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:39.808 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:42:39.808 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:42:39.808 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6804/3449414971,v1:127.0.0.1:6805/3449414971]", 2024-09-16T03:42:39.808 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:42:39.808 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:42:39.808 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:42:39.808 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:42:39.808 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:42:39.808 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:42:39.808 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:42:39.808 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:42:39.808 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:42:39.808 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:42:39.809 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:42:39.809 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-osdmap-prune/0/block", 2024-09-16T03:42:39.809 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:42:39.809 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:42:39.809 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:42:39.809 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:42:39.809 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:42:39.809 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:42:39.809 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:42:39.809 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:42:39.809 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:42:39.809 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:42:39.809 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:26:27.749490Z", 2024-09-16T03:42:39.810 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:42:39.810 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:42:39.810 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:42:39.810 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:42:39.810 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:42:39.810 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:42:39.810 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:42:39.810 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6802/3449414971,v1:127.0.0.1:6803/3449414971]", 2024-09-16T03:42:39.810 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:42:39.810 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6808/3449414971,v1:127.0.0.1:6809/3449414971]", 2024-09-16T03:42:39.810 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6806/3449414971,v1:127.0.0.1:6807/3449414971]", 2024-09-16T03:42:39.810 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:42:39.810 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:42:39.810 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:42:39.811 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:42:39.811 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:42:39.811 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:42:39.811 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:42:39.811 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:42:39.811 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:42:39.811 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-osdmap-prune/0", 2024-09-16T03:42:39.811 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:42:39.811 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:42:39.811 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:42:39.811 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.811 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:39.811 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:42:39.812 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:42:39.812 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6812/4240988863,v1:127.0.0.1:6813/4240988863]", 2024-09-16T03:42:39.812 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:42:39.812 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:42:39.812 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:42:39.812 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:42:39.812 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:42:39.812 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:42:39.812 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:42:39.812 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:42:39.812 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:42:39.812 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:42:39.812 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:42:39.813 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-osdmap-prune/1/block", 2024-09-16T03:42:39.813 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:42:39.813 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:42:39.813 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:42:39.813 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:42:39.813 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:42:39.813 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:42:39.813 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:42:39.813 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:42:39.813 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:42:39.813 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:42:39.813 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:27:04.728300Z", 2024-09-16T03:42:39.813 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:42:39.813 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:42:39.814 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:42:39.814 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:42:39.814 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:42:39.814 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:42:39.814 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:42:39.814 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6810/4240988863,v1:127.0.0.1:6811/4240988863]", 2024-09-16T03:42:39.814 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:42:39.814 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6816/4240988863,v1:127.0.0.1:6817/4240988863]", 2024-09-16T03:42:39.814 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6814/4240988863,v1:127.0.0.1:6815/4240988863]", 2024-09-16T03:42:39.814 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:42:39.814 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:42:39.815 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:42:39.815 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:42:39.815 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:42:39.815 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:42:39.815 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:42:39.815 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:42:39.815 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:42:39.815 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-osdmap-prune/1", 2024-09-16T03:42:39.815 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:42:39.815 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:42:39.816 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:42:39.816 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.816 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:39.816 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:42:39.816 INFO:tasks.workunit.client.0.smithi096.stderr: "arch": "x86_64", 2024-09-16T03:42:39.816 INFO:tasks.workunit.client.0.smithi096.stderr: "back_addr": "[v2:127.0.0.1:6820/2239695978,v1:127.0.0.1:6821/2239695978]", 2024-09-16T03:42:39.816 INFO:tasks.workunit.client.0.smithi096.stderr: "back_iface": "", 2024-09-16T03:42:39.816 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs": "1", 2024-09-16T03:42:39.816 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_db": "0", 2024-09-16T03:42:39.816 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_dedicated_wal": "0", 2024-09-16T03:42:39.816 INFO:tasks.workunit.client.0.smithi096.stderr: "bluefs_single_shared_device": "1", 2024-09-16T03:42:39.816 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_allocation_from_file": "0", 2024-09-16T03:42:39.816 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_access_mode": "file", 2024-09-16T03:42:39.817 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_block_size": "4096", 2024-09-16T03:42:39.817 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_devices": "sda", 2024-09-16T03:42:39.817 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_driver": "KernelDevice", 2024-09-16T03:42:39.817 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_optimal_io_size": "0", 2024-09-16T03:42:39.817 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_path": "td/mon-osdmap-prune/2/block", 2024-09-16T03:42:39.817 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_rotational": "1", 2024-09-16T03:42:39.817 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_size": "107374182400", 2024-09-16T03:42:39.817 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_support_discard": "0", 2024-09-16T03:42:39.817 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_bdev_type": "hdd", 2024-09-16T03:42:39.817 INFO:tasks.workunit.client.0.smithi096.stderr: "bluestore_min_alloc_size": "4096", 2024-09-16T03:42:39.817 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_release": "squid", 2024-09-16T03:42:39.817 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:42:39.817 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_short": "19.3.0-4930-gfc3e0bff", 2024-09-16T03:42:39.817 INFO:tasks.workunit.client.0.smithi096.stderr: "ceph_version_when_created": "ceph version 19.3.0-4930-gfc3e0bff (fc3e0bff7468fd55478adbae7f75508b749124b6) squid (dev)", 2024-09-16T03:42:39.818 INFO:tasks.workunit.client.0.smithi096.stderr: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-09-16T03:42:39.818 INFO:tasks.workunit.client.0.smithi096.stderr: "created_at": "2024-09-16T03:27:42.002291Z", 2024-09-16T03:42:39.818 INFO:tasks.workunit.client.0.smithi096.stderr: "default_device_class": "hdd", 2024-09-16T03:42:39.818 INFO:tasks.workunit.client.0.smithi096.stderr: "device_ids": "sda=ST1000NM0033-9ZM173_Z1W5QGMP", 2024-09-16T03:42:39.818 INFO:tasks.workunit.client.0.smithi096.stderr: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2024-09-16T03:42:39.818 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": "sda", 2024-09-16T03:42:39.818 INFO:tasks.workunit.client.0.smithi096.stderr: "distro": "ubuntu", 2024-09-16T03:42:39.818 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_description": "Ubuntu 22.04.1 LTS", 2024-09-16T03:42:39.818 INFO:tasks.workunit.client.0.smithi096.stderr: "distro_version": "22.04", 2024-09-16T03:42:39.819 INFO:tasks.workunit.client.0.smithi096.stderr: "front_addr": "[v2:127.0.0.1:6818/2239695978,v1:127.0.0.1:6819/2239695978]", 2024-09-16T03:42:39.819 INFO:tasks.workunit.client.0.smithi096.stderr: "front_iface": "", 2024-09-16T03:42:39.819 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_back_addr": "[v2:127.0.0.1:6824/2239695978,v1:127.0.0.1:6825/2239695978]", 2024-09-16T03:42:39.819 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_front_addr": "[v2:127.0.0.1:6822/2239695978,v1:127.0.0.1:6823/2239695978]", 2024-09-16T03:42:39.819 INFO:tasks.workunit.client.0.smithi096.stderr: "hostname": "smithi096", 2024-09-16T03:42:39.819 INFO:tasks.workunit.client.0.smithi096.stderr: "journal_rotational": "1", 2024-09-16T03:42:39.819 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_description": "#131-Ubuntu SMP Fri Aug 9 08:29:53 UTC 2024", 2024-09-16T03:42:39.819 INFO:tasks.workunit.client.0.smithi096.stderr: "kernel_version": "5.15.0-121-generic", 2024-09-16T03:42:39.819 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_swap_kb": "2097148", 2024-09-16T03:42:39.819 INFO:tasks.workunit.client.0.smithi096.stderr: "mem_total_kb": "32746824", 2024-09-16T03:42:39.819 INFO:tasks.workunit.client.0.smithi096.stderr: "network_numa_unknown_ifaces": "back_iface,front_iface", 2024-09-16T03:42:39.819 INFO:tasks.workunit.client.0.smithi096.stderr: "objectstore_numa_unknown_devices": "sda", 2024-09-16T03:42:39.819 INFO:tasks.workunit.client.0.smithi096.stderr: "os": "Linux", 2024-09-16T03:42:39.820 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_data": "td/mon-osdmap-prune/2", 2024-09-16T03:42:39.820 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_objectstore": "bluestore", 2024-09-16T03:42:39.820 INFO:tasks.workunit.client.0.smithi096.stderr: "osdspec_affinity": "", 2024-09-16T03:42:39.820 INFO:tasks.workunit.client.0.smithi096.stderr: "rotational": "1" 2024-09-16T03:42:39.820 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:39.820 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:42:39.820 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_clean_epochs": { 2024-09-16T03:42:39.820 INFO:tasks.workunit.client.0.smithi096.stderr: "min_last_epoch_clean": 1030, 2024-09-16T03:42:39.820 INFO:tasks.workunit.client.0.smithi096.stderr: "last_epoch_clean": { 2024-09-16T03:42:39.820 INFO:tasks.workunit.client.0.smithi096.stderr: "per_pool": [ 2024-09-16T03:42:39.820 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:39.820 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 1, 2024-09-16T03:42:39.820 INFO:tasks.workunit.client.0.smithi096.stderr: "floor": 1030 2024-09-16T03:42:39.821 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:39.821 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:42:39.821 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.821 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_epochs": [ 2024-09-16T03:42:39.821 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:39.821 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:42:39.821 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 1030 2024-09-16T03:42:39.821 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.821 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:39.821 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:42:39.821 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 1030 2024-09-16T03:42:39.821 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.821 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:39.821 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:42:39.822 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 1030 2024-09-16T03:42:39.822 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:39.822 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:42:39.822 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.822 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_first_committed": 20, 2024-09-16T03:42:39.822 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_last_committed": 1038, 2024-09-16T03:42:39.822 INFO:tasks.workunit.client.0.smithi096.stderr: "crushmap": { 2024-09-16T03:42:39.822 INFO:tasks.workunit.client.0.smithi096.stderr: "devices": [ 2024-09-16T03:42:39.822 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:39.822 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:42:39.822 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.0", 2024-09-16T03:42:39.822 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:42:39.822 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.822 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:39.823 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:42:39.823 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.1", 2024-09-16T03:42:39.823 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:42:39.823 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.823 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:39.823 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:42:39.823 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd.2", 2024-09-16T03:42:39.823 INFO:tasks.workunit.client.0.smithi096.stderr: "class": "hdd" 2024-09-16T03:42:39.823 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:39.823 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:42:39.823 INFO:tasks.workunit.client.0.smithi096.stderr: "types": [ 2024-09-16T03:42:39.823 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:39.823 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 0, 2024-09-16T03:42:39.824 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "osd" 2024-09-16T03:42:39.824 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.824 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:39.824 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:42:39.824 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "host" 2024-09-16T03:42:39.824 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.824 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:39.824 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 2, 2024-09-16T03:42:39.824 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "chassis" 2024-09-16T03:42:39.824 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.824 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:39.824 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 3, 2024-09-16T03:42:39.824 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "rack" 2024-09-16T03:42:39.824 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.825 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:39.825 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 4, 2024-09-16T03:42:39.825 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "row" 2024-09-16T03:42:39.825 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.825 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:39.825 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 5, 2024-09-16T03:42:39.825 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "pdu" 2024-09-16T03:42:39.825 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.825 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:39.825 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 6, 2024-09-16T03:42:39.825 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "pod" 2024-09-16T03:42:39.825 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.825 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:39.826 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 7, 2024-09-16T03:42:39.826 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "room" 2024-09-16T03:42:39.826 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.826 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:39.826 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 8, 2024-09-16T03:42:39.826 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "datacenter" 2024-09-16T03:42:39.826 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.826 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:39.826 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 9, 2024-09-16T03:42:39.826 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "zone" 2024-09-16T03:42:39.826 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.826 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:39.826 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 10, 2024-09-16T03:42:39.827 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "region" 2024-09-16T03:42:39.827 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.827 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:39.827 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:42:39.827 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "root" 2024-09-16T03:42:39.827 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:39.827 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:42:39.827 INFO:tasks.workunit.client.0.smithi096.stderr: "buckets": [ 2024-09-16T03:42:39.827 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:39.827 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -1, 2024-09-16T03:42:39.827 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "default", 2024-09-16T03:42:39.827 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:42:39.827 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "root", 2024-09-16T03:42:39.827 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:42:39.828 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:42:39.828 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:42:39.828 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:42:39.828 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:39.828 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -3, 2024-09-16T03:42:39.828 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:42:39.828 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:42:39.828 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:39.829 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:42:39.829 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.829 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:39.829 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -2, 2024-09-16T03:42:39.829 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "default~hdd", 2024-09-16T03:42:39.829 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 11, 2024-09-16T03:42:39.829 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "root", 2024-09-16T03:42:39.829 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:42:39.829 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:42:39.829 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:42:39.829 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:42:39.829 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:39.829 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -4, 2024-09-16T03:42:39.830 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:42:39.830 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:42:39.830 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:39.830 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:42:39.830 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.830 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:39.830 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -3, 2024-09-16T03:42:39.830 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "smithi096", 2024-09-16T03:42:39.830 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:42:39.830 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "host", 2024-09-16T03:42:39.830 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:42:39.830 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:42:39.830 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:42:39.830 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:42:39.830 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:39.831 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:42:39.831 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:42:39.831 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:42:39.831 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.831 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:39.831 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:42:39.831 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:42:39.831 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 1 2024-09-16T03:42:39.831 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.832 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:39.832 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:42:39.832 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:42:39.832 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 2 2024-09-16T03:42:39.832 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:39.832 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:42:39.832 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.832 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:39.832 INFO:tasks.workunit.client.0.smithi096.stderr: "id": -4, 2024-09-16T03:42:39.832 INFO:tasks.workunit.client.0.smithi096.stderr: "name": "smithi096~hdd", 2024-09-16T03:42:39.832 INFO:tasks.workunit.client.0.smithi096.stderr: "type_id": 1, 2024-09-16T03:42:39.832 INFO:tasks.workunit.client.0.smithi096.stderr: "type_name": "host", 2024-09-16T03:42:39.832 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 19206, 2024-09-16T03:42:39.833 INFO:tasks.workunit.client.0.smithi096.stderr: "alg": "straw2", 2024-09-16T03:42:39.833 INFO:tasks.workunit.client.0.smithi096.stderr: "hash": "rjenkins1", 2024-09-16T03:42:39.833 INFO:tasks.workunit.client.0.smithi096.stderr: "items": [ 2024-09-16T03:42:39.833 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:39.833 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 0, 2024-09-16T03:42:39.833 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:42:39.833 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 0 2024-09-16T03:42:39.833 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.833 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:39.834 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 1, 2024-09-16T03:42:39.834 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:42:39.834 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 1 2024-09-16T03:42:39.834 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.834 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:39.834 INFO:tasks.workunit.client.0.smithi096.stderr: "id": 2, 2024-09-16T03:42:39.834 INFO:tasks.workunit.client.0.smithi096.stderr: "weight": 6402, 2024-09-16T03:42:39.834 INFO:tasks.workunit.client.0.smithi096.stderr: "pos": 2 2024-09-16T03:42:39.834 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:39.834 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:42:39.834 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:39.834 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:42:39.834 INFO:tasks.workunit.client.0.smithi096.stderr: "rules": [ 2024-09-16T03:42:39.834 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:39.835 INFO:tasks.workunit.client.0.smithi096.stderr: "rule_id": 0, 2024-09-16T03:42:39.835 INFO:tasks.workunit.client.0.smithi096.stderr: "rule_name": "replicated_rule", 2024-09-16T03:42:39.835 INFO:tasks.workunit.client.0.smithi096.stderr: "type": 1, 2024-09-16T03:42:39.835 INFO:tasks.workunit.client.0.smithi096.stderr: "steps": [ 2024-09-16T03:42:39.835 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:39.835 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "take", 2024-09-16T03:42:39.835 INFO:tasks.workunit.client.0.smithi096.stderr: "item": -1, 2024-09-16T03:42:39.835 INFO:tasks.workunit.client.0.smithi096.stderr: "item_name": "default" 2024-09-16T03:42:39.835 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.835 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:39.835 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "choose_firstn", 2024-09-16T03:42:39.835 INFO:tasks.workunit.client.0.smithi096.stderr: "num": 0, 2024-09-16T03:42:39.835 INFO:tasks.workunit.client.0.smithi096.stderr: "type": "osd" 2024-09-16T03:42:39.835 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.836 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:39.836 INFO:tasks.workunit.client.0.smithi096.stderr: "op": "emit" 2024-09-16T03:42:39.836 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:39.836 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:42:39.836 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:39.836 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:42:39.836 INFO:tasks.workunit.client.0.smithi096.stderr: "tunables": { 2024-09-16T03:42:39.836 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_local_tries": 0, 2024-09-16T03:42:39.836 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_local_fallback_tries": 0, 2024-09-16T03:42:39.836 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_total_tries": 50, 2024-09-16T03:42:39.836 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_descend_once": 1, 2024-09-16T03:42:39.836 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_vary_r": 1, 2024-09-16T03:42:39.837 INFO:tasks.workunit.client.0.smithi096.stderr: "chooseleaf_stable": 1, 2024-09-16T03:42:39.837 INFO:tasks.workunit.client.0.smithi096.stderr: "msr_descents": 100, 2024-09-16T03:42:39.837 INFO:tasks.workunit.client.0.smithi096.stderr: "msr_collision_tries": 100, 2024-09-16T03:42:39.837 INFO:tasks.workunit.client.0.smithi096.stderr: "straw_calc_version": 1, 2024-09-16T03:42:39.837 INFO:tasks.workunit.client.0.smithi096.stderr: "allowed_bucket_algs": 54, 2024-09-16T03:42:39.837 INFO:tasks.workunit.client.0.smithi096.stderr: "profile": "jewel", 2024-09-16T03:42:39.837 INFO:tasks.workunit.client.0.smithi096.stderr: "optimal_tunables": 1, 2024-09-16T03:42:39.837 INFO:tasks.workunit.client.0.smithi096.stderr: "legacy_tunables": 0, 2024-09-16T03:42:39.837 INFO:tasks.workunit.client.0.smithi096.stderr: "minimum_required_version": "jewel", 2024-09-16T03:42:39.837 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables": 1, 2024-09-16T03:42:39.837 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables2": 1, 2024-09-16T03:42:39.837 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v2_rules": 0, 2024-09-16T03:42:39.837 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables3": 1, 2024-09-16T03:42:39.837 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v3_rules": 0, 2024-09-16T03:42:39.838 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v4_buckets": 1, 2024-09-16T03:42:39.838 INFO:tasks.workunit.client.0.smithi096.stderr: "require_feature_tunables5": 1, 2024-09-16T03:42:39.838 INFO:tasks.workunit.client.0.smithi096.stderr: "has_v5_rules": 0, 2024-09-16T03:42:39.838 INFO:tasks.workunit.client.0.smithi096.stderr: "has_msr_rules": 0 2024-09-16T03:42:39.838 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.838 INFO:tasks.workunit.client.0.smithi096.stderr: "choose_args": {} 2024-09-16T03:42:39.838 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.838 INFO:tasks.workunit.client.0.smithi096.stderr: "osdmap_manifest": { 2024-09-16T03:42:39.838 INFO:tasks.workunit.client.0.smithi096.stderr: "first_pinned": 20, 2024-09-16T03:42:39.838 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pinned": 931, 2024-09-16T03:42:39.838 INFO:tasks.workunit.client.0.smithi096.stderr: "pinned_maps": [ 2024-09-16T03:42:39.838 INFO:tasks.workunit.client.0.smithi096.stderr: 20, 2024-09-16T03:42:39.838 INFO:tasks.workunit.client.0.smithi096.stderr: 21, 2024-09-16T03:42:39.838 INFO:tasks.workunit.client.0.smithi096.stderr: 31, 2024-09-16T03:42:39.838 INFO:tasks.workunit.client.0.smithi096.stderr: 41, 2024-09-16T03:42:39.839 INFO:tasks.workunit.client.0.smithi096.stderr: 51, 2024-09-16T03:42:39.839 INFO:tasks.workunit.client.0.smithi096.stderr: 61, 2024-09-16T03:42:39.839 INFO:tasks.workunit.client.0.smithi096.stderr: 71, 2024-09-16T03:42:39.839 INFO:tasks.workunit.client.0.smithi096.stderr: 81, 2024-09-16T03:42:39.839 INFO:tasks.workunit.client.0.smithi096.stderr: 91, 2024-09-16T03:42:39.839 INFO:tasks.workunit.client.0.smithi096.stderr: 101, 2024-09-16T03:42:39.839 INFO:tasks.workunit.client.0.smithi096.stderr: 111, 2024-09-16T03:42:39.839 INFO:tasks.workunit.client.0.smithi096.stderr: 121, 2024-09-16T03:42:39.839 INFO:tasks.workunit.client.0.smithi096.stderr: 131, 2024-09-16T03:42:39.839 INFO:tasks.workunit.client.0.smithi096.stderr: 141, 2024-09-16T03:42:39.839 INFO:tasks.workunit.client.0.smithi096.stderr: 151, 2024-09-16T03:42:39.839 INFO:tasks.workunit.client.0.smithi096.stderr: 161, 2024-09-16T03:42:39.839 INFO:tasks.workunit.client.0.smithi096.stderr: 171, 2024-09-16T03:42:39.839 INFO:tasks.workunit.client.0.smithi096.stderr: 181, 2024-09-16T03:42:39.840 INFO:tasks.workunit.client.0.smithi096.stderr: 191, 2024-09-16T03:42:39.840 INFO:tasks.workunit.client.0.smithi096.stderr: 201, 2024-09-16T03:42:39.840 INFO:tasks.workunit.client.0.smithi096.stderr: 211, 2024-09-16T03:42:39.840 INFO:tasks.workunit.client.0.smithi096.stderr: 221, 2024-09-16T03:42:39.840 INFO:tasks.workunit.client.0.smithi096.stderr: 231, 2024-09-16T03:42:39.840 INFO:tasks.workunit.client.0.smithi096.stderr: 241, 2024-09-16T03:42:39.840 INFO:tasks.workunit.client.0.smithi096.stderr: 251, 2024-09-16T03:42:39.840 INFO:tasks.workunit.client.0.smithi096.stderr: 261, 2024-09-16T03:42:39.840 INFO:tasks.workunit.client.0.smithi096.stderr: 271, 2024-09-16T03:42:39.840 INFO:tasks.workunit.client.0.smithi096.stderr: 281, 2024-09-16T03:42:39.840 INFO:tasks.workunit.client.0.smithi096.stderr: 291, 2024-09-16T03:42:39.840 INFO:tasks.workunit.client.0.smithi096.stderr: 301, 2024-09-16T03:42:39.840 INFO:tasks.workunit.client.0.smithi096.stderr: 311, 2024-09-16T03:42:39.840 INFO:tasks.workunit.client.0.smithi096.stderr: 321, 2024-09-16T03:42:39.841 INFO:tasks.workunit.client.0.smithi096.stderr: 331, 2024-09-16T03:42:39.841 INFO:tasks.workunit.client.0.smithi096.stderr: 341, 2024-09-16T03:42:39.841 INFO:tasks.workunit.client.0.smithi096.stderr: 351, 2024-09-16T03:42:39.841 INFO:tasks.workunit.client.0.smithi096.stderr: 361, 2024-09-16T03:42:39.841 INFO:tasks.workunit.client.0.smithi096.stderr: 371, 2024-09-16T03:42:39.841 INFO:tasks.workunit.client.0.smithi096.stderr: 381, 2024-09-16T03:42:39.841 INFO:tasks.workunit.client.0.smithi096.stderr: 391, 2024-09-16T03:42:39.841 INFO:tasks.workunit.client.0.smithi096.stderr: 401, 2024-09-16T03:42:39.841 INFO:tasks.workunit.client.0.smithi096.stderr: 411, 2024-09-16T03:42:39.841 INFO:tasks.workunit.client.0.smithi096.stderr: 421, 2024-09-16T03:42:39.841 INFO:tasks.workunit.client.0.smithi096.stderr: 431, 2024-09-16T03:42:39.841 INFO:tasks.workunit.client.0.smithi096.stderr: 441, 2024-09-16T03:42:39.841 INFO:tasks.workunit.client.0.smithi096.stderr: 451, 2024-09-16T03:42:39.841 INFO:tasks.workunit.client.0.smithi096.stderr: 461, 2024-09-16T03:42:39.842 INFO:tasks.workunit.client.0.smithi096.stderr: 471, 2024-09-16T03:42:39.842 INFO:tasks.workunit.client.0.smithi096.stderr: 481, 2024-09-16T03:42:39.842 INFO:tasks.workunit.client.0.smithi096.stderr: 491, 2024-09-16T03:42:39.842 INFO:tasks.workunit.client.0.smithi096.stderr: 501, 2024-09-16T03:42:39.842 INFO:tasks.workunit.client.0.smithi096.stderr: 511, 2024-09-16T03:42:39.842 INFO:tasks.workunit.client.0.smithi096.stderr: 521, 2024-09-16T03:42:39.842 INFO:tasks.workunit.client.0.smithi096.stderr: 531, 2024-09-16T03:42:39.842 INFO:tasks.workunit.client.0.smithi096.stderr: 541, 2024-09-16T03:42:39.842 INFO:tasks.workunit.client.0.smithi096.stderr: 551, 2024-09-16T03:42:39.842 INFO:tasks.workunit.client.0.smithi096.stderr: 561, 2024-09-16T03:42:39.842 INFO:tasks.workunit.client.0.smithi096.stderr: 571, 2024-09-16T03:42:39.842 INFO:tasks.workunit.client.0.smithi096.stderr: 581, 2024-09-16T03:42:39.842 INFO:tasks.workunit.client.0.smithi096.stderr: 591, 2024-09-16T03:42:39.842 INFO:tasks.workunit.client.0.smithi096.stderr: 601, 2024-09-16T03:42:39.843 INFO:tasks.workunit.client.0.smithi096.stderr: 611, 2024-09-16T03:42:39.843 INFO:tasks.workunit.client.0.smithi096.stderr: 621, 2024-09-16T03:42:39.843 INFO:tasks.workunit.client.0.smithi096.stderr: 631, 2024-09-16T03:42:39.843 INFO:tasks.workunit.client.0.smithi096.stderr: 641, 2024-09-16T03:42:39.843 INFO:tasks.workunit.client.0.smithi096.stderr: 651, 2024-09-16T03:42:39.843 INFO:tasks.workunit.client.0.smithi096.stderr: 661, 2024-09-16T03:42:39.843 INFO:tasks.workunit.client.0.smithi096.stderr: 671, 2024-09-16T03:42:39.843 INFO:tasks.workunit.client.0.smithi096.stderr: 681, 2024-09-16T03:42:39.843 INFO:tasks.workunit.client.0.smithi096.stderr: 691, 2024-09-16T03:42:39.843 INFO:tasks.workunit.client.0.smithi096.stderr: 701, 2024-09-16T03:42:39.843 INFO:tasks.workunit.client.0.smithi096.stderr: 711, 2024-09-16T03:42:39.843 INFO:tasks.workunit.client.0.smithi096.stderr: 721, 2024-09-16T03:42:39.843 INFO:tasks.workunit.client.0.smithi096.stderr: 731, 2024-09-16T03:42:39.844 INFO:tasks.workunit.client.0.smithi096.stderr: 741, 2024-09-16T03:42:39.844 INFO:tasks.workunit.client.0.smithi096.stderr: 751, 2024-09-16T03:42:39.844 INFO:tasks.workunit.client.0.smithi096.stderr: 761, 2024-09-16T03:42:39.844 INFO:tasks.workunit.client.0.smithi096.stderr: 771, 2024-09-16T03:42:39.844 INFO:tasks.workunit.client.0.smithi096.stderr: 781, 2024-09-16T03:42:39.844 INFO:tasks.workunit.client.0.smithi096.stderr: 791, 2024-09-16T03:42:39.844 INFO:tasks.workunit.client.0.smithi096.stderr: 801, 2024-09-16T03:42:39.844 INFO:tasks.workunit.client.0.smithi096.stderr: 811, 2024-09-16T03:42:39.844 INFO:tasks.workunit.client.0.smithi096.stderr: 821, 2024-09-16T03:42:39.844 INFO:tasks.workunit.client.0.smithi096.stderr: 831, 2024-09-16T03:42:39.844 INFO:tasks.workunit.client.0.smithi096.stderr: 841, 2024-09-16T03:42:39.844 INFO:tasks.workunit.client.0.smithi096.stderr: 851, 2024-09-16T03:42:39.845 INFO:tasks.workunit.client.0.smithi096.stderr: 861, 2024-09-16T03:42:39.845 INFO:tasks.workunit.client.0.smithi096.stderr: 871, 2024-09-16T03:42:39.845 INFO:tasks.workunit.client.0.smithi096.stderr: 881, 2024-09-16T03:42:39.845 INFO:tasks.workunit.client.0.smithi096.stderr: 891, 2024-09-16T03:42:39.845 INFO:tasks.workunit.client.0.smithi096.stderr: 901, 2024-09-16T03:42:39.845 INFO:tasks.workunit.client.0.smithi096.stderr: 911, 2024-09-16T03:42:39.845 INFO:tasks.workunit.client.0.smithi096.stderr: 921, 2024-09-16T03:42:39.845 INFO:tasks.workunit.client.0.smithi096.stderr: 931 2024-09-16T03:42:39.845 INFO:tasks.workunit.client.0.smithi096.stderr: ] 2024-09-16T03:42:39.845 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.846 INFO:tasks.workunit.client.0.smithi096.stderr: "fsmap": { 2024-09-16T03:42:39.846 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 1, 2024-09-16T03:42:39.846 INFO:tasks.workunit.client.0.smithi096.stderr: "btime": "2024-09-16T03:26:20:863172+0000", 2024-09-16T03:42:39.846 INFO:tasks.workunit.client.0.smithi096.stderr: "default_fscid": -1, 2024-09-16T03:42:39.846 INFO:tasks.workunit.client.0.smithi096.stderr: "compat": { 2024-09-16T03:42:39.846 INFO:tasks.workunit.client.0.smithi096.stderr: "compat": {}, 2024-09-16T03:42:39.846 INFO:tasks.workunit.client.0.smithi096.stderr: "ro_compat": {}, 2024-09-16T03:42:39.846 INFO:tasks.workunit.client.0.smithi096.stderr: "incompat": { 2024-09-16T03:42:39.846 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_1": "base v0.20", 2024-09-16T03:42:39.846 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_2": "client writeable ranges", 2024-09-16T03:42:39.846 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_3": "default file layouts on dirs", 2024-09-16T03:42:39.846 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_4": "dir inode in separate object", 2024-09-16T03:42:39.847 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_5": "mds uses versioned encoding", 2024-09-16T03:42:39.847 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_6": "dirfrag is stored in omap", 2024-09-16T03:42:39.847 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_8": "no anchor table", 2024-09-16T03:42:39.847 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_9": "file layout v2", 2024-09-16T03:42:39.847 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_10": "snaprealm v2", 2024-09-16T03:42:39.847 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_11": "minor log segments", 2024-09-16T03:42:39.847 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_12": "quiesce subvolumes" 2024-09-16T03:42:39.847 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:39.847 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.847 INFO:tasks.workunit.client.0.smithi096.stderr: "feature_flags": { 2024-09-16T03:42:39.847 INFO:tasks.workunit.client.0.smithi096.stderr: "enable_multiple": true, 2024-09-16T03:42:39.847 INFO:tasks.workunit.client.0.smithi096.stderr: "ever_enabled_multiple": true 2024-09-16T03:42:39.847 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.847 INFO:tasks.workunit.client.0.smithi096.stderr: "standbys": [], 2024-09-16T03:42:39.848 INFO:tasks.workunit.client.0.smithi096.stderr: "filesystems": [] 2024-09-16T03:42:39.848 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.848 INFO:tasks.workunit.client.0.smithi096.stderr: "mdsmap_first_committed": 1, 2024-09-16T03:42:39.848 INFO:tasks.workunit.client.0.smithi096.stderr: "mdsmap_last_committed": 1, 2024-09-16T03:42:39.848 INFO:tasks.workunit.client.0.smithi096.stderr: "auth": { 2024-09-16T03:42:39.848 INFO:tasks.workunit.client.0.smithi096.stderr: "first_committed": 1, 2024-09-16T03:42:39.848 INFO:tasks.workunit.client.0.smithi096.stderr: "last_committed": 5, 2024-09-16T03:42:39.848 INFO:tasks.workunit.client.0.smithi096.stderr: "num_secrets": 3 2024-09-16T03:42:39.848 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.849 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 32, 2024-09-16T03:42:39.849 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_active": 32, 2024-09-16T03:42:39.849 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_unknown": 0, 2024-09-16T03:42:39.849 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osd": 3, 2024-09-16T03:42:39.849 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_sum": { 2024-09-16T03:42:39.849 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:42:39.849 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:42:39.849 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:42:39.849 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:42:39.849 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:42:39.849 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:42:39.850 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:42:39.850 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:42:39.850 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:42:39.850 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:42:39.850 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:42:39.850 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:42:39.850 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:42:39.850 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:42:39.850 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:42:39.850 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:42:39.850 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:42:39.850 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:42:39.850 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:42:39.851 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:42:39.851 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:42:39.851 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:42:39.851 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:42:39.851 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:42:39.851 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:42:39.851 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:42:39.851 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:42:39.851 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:42:39.851 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:42:39.851 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:42:39.851 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:42:39.851 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:42:39.852 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:42:39.852 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:42:39.852 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:42:39.852 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:42:39.852 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:42:39.852 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:42:39.852 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:42:39.852 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:42:39.852 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:42:39.852 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.852 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:42:39.852 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:42:39.852 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:42:39.853 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:42:39.853 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:42:39.853 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:42:39.853 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:42:39.853 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:42:39.853 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:42:39.853 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:42:39.853 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:42:39.853 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.853 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:42:39.853 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:42:39.853 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 96, 2024-09-16T03:42:39.853 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 96, 2024-09-16T03:42:39.853 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 0 2024-09-16T03:42:39.854 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.854 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_sum": { 2024-09-16T03:42:39.854 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 0, 2024-09-16T03:42:39.854 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 0, 2024-09-16T03:42:39.854 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pgs": 96, 2024-09-16T03:42:39.854 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osds": 3, 2024-09-16T03:42:39.854 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_osds": 3, 2024-09-16T03:42:39.854 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_omap_osds": 3, 2024-09-16T03:42:39.854 INFO:tasks.workunit.client.0.smithi096.stderr: "kb": 314572800, 2024-09-16T03:42:39.854 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used": 226132, 2024-09-16T03:42:39.854 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_data": 24608, 2024-09-16T03:42:39.854 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_omap": 4, 2024-09-16T03:42:39.854 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_meta": 201211, 2024-09-16T03:42:39.854 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_avail": 314346668, 2024-09-16T03:42:39.855 INFO:tasks.workunit.client.0.smithi096.stderr: "statfs": { 2024-09-16T03:42:39.855 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 322122547200, 2024-09-16T03:42:39.855 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 321890988032, 2024-09-16T03:42:39.855 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:42:39.855 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 25198592, 2024-09-16T03:42:39.855 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 8329140, 2024-09-16T03:42:39.855 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:42:39.855 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:42:39.855 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:42:39.855 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 4785, 2024-09-16T03:42:39.855 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 206040399 2024-09-16T03:42:39.855 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.855 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_peers": [], 2024-09-16T03:42:39.856 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_trim_queue_len": 0, 2024-09-16T03:42:39.856 INFO:tasks.workunit.client.0.smithi096.stderr: "num_snap_trimming": 0, 2024-09-16T03:42:39.856 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shards_repaired": 0, 2024-09-16T03:42:39.856 INFO:tasks.workunit.client.0.smithi096.stderr: "op_queue_age_hist": { 2024-09-16T03:42:39.856 INFO:tasks.workunit.client.0.smithi096.stderr: "histogram": [], 2024-09-16T03:42:39.856 INFO:tasks.workunit.client.0.smithi096.stderr: "upper_bound": 1 2024-09-16T03:42:39.856 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.856 INFO:tasks.workunit.client.0.smithi096.stderr: "perf_stat": { 2024-09-16T03:42:39.856 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ms": 207, 2024-09-16T03:42:39.856 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ms": 207, 2024-09-16T03:42:39.856 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ns": 207000000, 2024-09-16T03:42:39.856 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ns": 207000000 2024-09-16T03:42:39.856 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.857 INFO:tasks.workunit.client.0.smithi096.stderr: "alerts": [], 2024-09-16T03:42:39.857 INFO:tasks.workunit.client.0.smithi096.stderr: "network_ping_times": [] 2024-09-16T03:42:39.857 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.857 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_sum_by_class": { 2024-09-16T03:42:39.857 INFO:tasks.workunit.client.0.smithi096.stderr: "hdd": { 2024-09-16T03:42:39.857 INFO:tasks.workunit.client.0.smithi096.stderr: "up_from": 0, 2024-09-16T03:42:39.857 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 0, 2024-09-16T03:42:39.857 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pgs": 96, 2024-09-16T03:42:39.857 INFO:tasks.workunit.client.0.smithi096.stderr: "num_osds": 3, 2024-09-16T03:42:39.857 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_osds": 3, 2024-09-16T03:42:39.857 INFO:tasks.workunit.client.0.smithi096.stderr: "num_per_pool_omap_osds": 3, 2024-09-16T03:42:39.857 INFO:tasks.workunit.client.0.smithi096.stderr: "kb": 314572800, 2024-09-16T03:42:39.857 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used": 226132, 2024-09-16T03:42:39.857 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_data": 24608, 2024-09-16T03:42:39.858 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_omap": 4, 2024-09-16T03:42:39.858 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_used_meta": 201211, 2024-09-16T03:42:39.858 INFO:tasks.workunit.client.0.smithi096.stderr: "kb_avail": 314346668, 2024-09-16T03:42:39.858 INFO:tasks.workunit.client.0.smithi096.stderr: "statfs": { 2024-09-16T03:42:39.858 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 322122547200, 2024-09-16T03:42:39.858 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 321890988032, 2024-09-16T03:42:39.858 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:42:39.858 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 25198592, 2024-09-16T03:42:39.858 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 8329140, 2024-09-16T03:42:39.858 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:42:39.858 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:42:39.858 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:42:39.858 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 4785, 2024-09-16T03:42:39.858 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 206040399 2024-09-16T03:42:39.859 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.859 INFO:tasks.workunit.client.0.smithi096.stderr: "hb_peers": [], 2024-09-16T03:42:39.859 INFO:tasks.workunit.client.0.smithi096.stderr: "snap_trim_queue_len": 0, 2024-09-16T03:42:39.859 INFO:tasks.workunit.client.0.smithi096.stderr: "num_snap_trimming": 0, 2024-09-16T03:42:39.859 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shards_repaired": 0, 2024-09-16T03:42:39.859 INFO:tasks.workunit.client.0.smithi096.stderr: "op_queue_age_hist": { 2024-09-16T03:42:39.859 INFO:tasks.workunit.client.0.smithi096.stderr: "histogram": [], 2024-09-16T03:42:39.859 INFO:tasks.workunit.client.0.smithi096.stderr: "upper_bound": 1 2024-09-16T03:42:39.859 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.859 INFO:tasks.workunit.client.0.smithi096.stderr: "perf_stat": { 2024-09-16T03:42:39.859 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ms": 207, 2024-09-16T03:42:39.859 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ms": 207, 2024-09-16T03:42:39.859 INFO:tasks.workunit.client.0.smithi096.stderr: "commit_latency_ns": 207000000, 2024-09-16T03:42:39.859 INFO:tasks.workunit.client.0.smithi096.stderr: "apply_latency_ns": 207000000 2024-09-16T03:42:39.860 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.860 INFO:tasks.workunit.client.0.smithi096.stderr: "alerts": [], 2024-09-16T03:42:39.860 INFO:tasks.workunit.client.0.smithi096.stderr: "network_ping_times": [] 2024-09-16T03:42:39.860 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:39.860 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.860 INFO:tasks.workunit.client.0.smithi096.stderr: "pool_stats": [ 2024-09-16T03:42:39.860 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:39.860 INFO:tasks.workunit.client.0.smithi096.stderr: "poolid": 1, 2024-09-16T03:42:39.860 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg": 32, 2024-09-16T03:42:39.860 INFO:tasks.workunit.client.0.smithi096.stderr: "stat_sum": { 2024-09-16T03:42:39.860 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes": 0, 2024-09-16T03:42:39.860 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects": 0, 2024-09-16T03:42:39.860 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_clones": 0, 2024-09-16T03:42:39.860 INFO:tasks.workunit.client.0.smithi096.stderr: "num_object_copies": 0, 2024-09-16T03:42:39.861 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing_on_primary": 0, 2024-09-16T03:42:39.861 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_missing": 0, 2024-09-16T03:42:39.861 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_degraded": 0, 2024-09-16T03:42:39.861 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_misplaced": 0, 2024-09-16T03:42:39.861 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_unfound": 0, 2024-09-16T03:42:39.861 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_dirty": 0, 2024-09-16T03:42:39.861 INFO:tasks.workunit.client.0.smithi096.stderr: "num_whiteouts": 0, 2024-09-16T03:42:39.861 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read": 0, 2024-09-16T03:42:39.861 INFO:tasks.workunit.client.0.smithi096.stderr: "num_read_kb": 0, 2024-09-16T03:42:39.861 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write": 0, 2024-09-16T03:42:39.861 INFO:tasks.workunit.client.0.smithi096.stderr: "num_write_kb": 0, 2024-09-16T03:42:39.861 INFO:tasks.workunit.client.0.smithi096.stderr: "num_scrub_errors": 0, 2024-09-16T03:42:39.861 INFO:tasks.workunit.client.0.smithi096.stderr: "num_shallow_scrub_errors": 0, 2024-09-16T03:42:39.861 INFO:tasks.workunit.client.0.smithi096.stderr: "num_deep_scrub_errors": 0, 2024-09-16T03:42:39.862 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_recovered": 0, 2024-09-16T03:42:39.862 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_recovered": 0, 2024-09-16T03:42:39.862 INFO:tasks.workunit.client.0.smithi096.stderr: "num_keys_recovered": 0, 2024-09-16T03:42:39.862 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_omap": 0, 2024-09-16T03:42:39.862 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_hit_set_archive": 0, 2024-09-16T03:42:39.862 INFO:tasks.workunit.client.0.smithi096.stderr: "num_bytes_hit_set_archive": 0, 2024-09-16T03:42:39.862 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush": 0, 2024-09-16T03:42:39.862 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_kb": 0, 2024-09-16T03:42:39.862 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict": 0, 2024-09-16T03:42:39.862 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_kb": 0, 2024-09-16T03:42:39.862 INFO:tasks.workunit.client.0.smithi096.stderr: "num_promote": 0, 2024-09-16T03:42:39.862 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_high": 0, 2024-09-16T03:42:39.862 INFO:tasks.workunit.client.0.smithi096.stderr: "num_flush_mode_low": 0, 2024-09-16T03:42:39.863 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_some": 0, 2024-09-16T03:42:39.863 INFO:tasks.workunit.client.0.smithi096.stderr: "num_evict_mode_full": 0, 2024-09-16T03:42:39.863 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_pinned": 0, 2024-09-16T03:42:39.863 INFO:tasks.workunit.client.0.smithi096.stderr: "num_legacy_snapsets": 0, 2024-09-16T03:42:39.863 INFO:tasks.workunit.client.0.smithi096.stderr: "num_large_omap_objects": 0, 2024-09-16T03:42:39.863 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_manifest": 0, 2024-09-16T03:42:39.863 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_bytes": 0, 2024-09-16T03:42:39.863 INFO:tasks.workunit.client.0.smithi096.stderr: "num_omap_keys": 0, 2024-09-16T03:42:39.863 INFO:tasks.workunit.client.0.smithi096.stderr: "num_objects_repaired": 0 2024-09-16T03:42:39.864 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.864 INFO:tasks.workunit.client.0.smithi096.stderr: "store_stats": { 2024-09-16T03:42:39.864 INFO:tasks.workunit.client.0.smithi096.stderr: "total": 0, 2024-09-16T03:42:39.864 INFO:tasks.workunit.client.0.smithi096.stderr: "available": 0, 2024-09-16T03:42:39.864 INFO:tasks.workunit.client.0.smithi096.stderr: "internally_reserved": 0, 2024-09-16T03:42:39.864 INFO:tasks.workunit.client.0.smithi096.stderr: "allocated": 0, 2024-09-16T03:42:39.864 INFO:tasks.workunit.client.0.smithi096.stderr: "data_stored": 0, 2024-09-16T03:42:39.864 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed": 0, 2024-09-16T03:42:39.864 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_allocated": 0, 2024-09-16T03:42:39.864 INFO:tasks.workunit.client.0.smithi096.stderr: "data_compressed_original": 0, 2024-09-16T03:42:39.864 INFO:tasks.workunit.client.0.smithi096.stderr: "omap_allocated": 0, 2024-09-16T03:42:39.864 INFO:tasks.workunit.client.0.smithi096.stderr: "internal_metadata": 0 2024-09-16T03:42:39.865 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.865 INFO:tasks.workunit.client.0.smithi096.stderr: "log_size": 0, 2024-09-16T03:42:39.865 INFO:tasks.workunit.client.0.smithi096.stderr: "ondisk_log_size": 0, 2024-09-16T03:42:39.865 INFO:tasks.workunit.client.0.smithi096.stderr: "up": 96, 2024-09-16T03:42:39.865 INFO:tasks.workunit.client.0.smithi096.stderr: "acting": 96, 2024-09-16T03:42:39.865 INFO:tasks.workunit.client.0.smithi096.stderr: "num_store_stats": 3 2024-09-16T03:42:39.865 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:39.865 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:42:39.865 INFO:tasks.workunit.client.0.smithi096.stderr: "osd_stats": [ 2024-09-16T03:42:39.865 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:39.865 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:42:39.865 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 21474836678 2024-09-16T03:42:39.865 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.866 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:39.866 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:42:39.866 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 42949673143 2024-09-16T03:42:39.866 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.866 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:39.866 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:42:39.866 INFO:tasks.workunit.client.0.smithi096.stderr: "seq": 64424509619 2024-09-16T03:42:39.866 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:39.866 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:42:39.866 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_by_state": [ 2024-09-16T03:42:39.866 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:39.866 INFO:tasks.workunit.client.0.smithi096.stderr: "state": "active+clean", 2024-09-16T03:42:39.866 INFO:tasks.workunit.client.0.smithi096.stderr: "num": 32 2024-09-16T03:42:39.866 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:39.867 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:42:39.867 INFO:tasks.workunit.client.0.smithi096.stderr: "num_pg_by_osd": [ 2024-09-16T03:42:39.867 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:39.867 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 2, 2024-09-16T03:42:39.867 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 6, 2024-09-16T03:42:39.867 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 32, 2024-09-16T03:42:39.867 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:42:39.867 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.867 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:39.867 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 0, 2024-09-16T03:42:39.867 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 8, 2024-09-16T03:42:39.867 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 32, 2024-09-16T03:42:39.867 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:42:39.867 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.868 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:39.868 INFO:tasks.workunit.client.0.smithi096.stderr: "osd": 1, 2024-09-16T03:42:39.868 INFO:tasks.workunit.client.0.smithi096.stderr: "num_primary_pg": 18, 2024-09-16T03:42:39.868 INFO:tasks.workunit.client.0.smithi096.stderr: "num_acting_pg": 32, 2024-09-16T03:42:39.868 INFO:tasks.workunit.client.0.smithi096.stderr: "num_up_not_acting_pg": 0 2024-09-16T03:42:39.868 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:39.868 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:42:39.868 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": [ 2024-09-16T03:42:39.868 INFO:tasks.workunit.client.0.smithi096.stderr: { 2024-09-16T03:42:39.868 INFO:tasks.workunit.client.0.smithi096.stderr: "pool": 1, 2024-09-16T03:42:39.868 INFO:tasks.workunit.client.0.smithi096.stderr: "purged_snaps": {} 2024-09-16T03:42:39.868 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:39.868 INFO:tasks.workunit.client.0.smithi096.stderr: ], 2024-09-16T03:42:39.869 INFO:tasks.workunit.client.0.smithi096.stderr: "servicemap": { 2024-09-16T03:42:39.869 INFO:tasks.workunit.client.0.smithi096.stderr: "epoch": 6, 2024-09-16T03:42:39.869 INFO:tasks.workunit.client.0.smithi096.stderr: "modified": "2024-09-16T03:42:28.636220+0000", 2024-09-16T03:42:39.869 INFO:tasks.workunit.client.0.smithi096.stderr: "services": {} 2024-09-16T03:42:39.869 INFO:tasks.workunit.client.0.smithi096.stderr: }, 2024-09-16T03:42:39.869 INFO:tasks.workunit.client.0.smithi096.stderr: "mgrstat_first_committed": 473, 2024-09-16T03:42:39.869 INFO:tasks.workunit.client.0.smithi096.stderr: "mgrstat_last_committed": 478, 2024-09-16T03:42:39.869 INFO:tasks.workunit.client.0.smithi096.stderr: "logm_first_committed": 3448, 2024-09-16T03:42:39.869 INFO:tasks.workunit.client.0.smithi096.stderr: "logm_last_committed": 3951, 2024-09-16T03:42:39.869 INFO:tasks.workunit.client.0.smithi096.stderr: "paxos": { 2024-09-16T03:42:39.869 INFO:tasks.workunit.client.0.smithi096.stderr: "first_committed": 4770, 2024-09-16T03:42:39.869 INFO:tasks.workunit.client.0.smithi096.stderr: "last_committed": 5437, 2024-09-16T03:42:39.869 INFO:tasks.workunit.client.0.smithi096.stderr: "last_pn": 0, 2024-09-16T03:42:39.869 INFO:tasks.workunit.client.0.smithi096.stderr: "accepted_pn": 0 2024-09-16T03:42:39.870 INFO:tasks.workunit.client.0.smithi096.stderr: } 2024-09-16T03:42:39.870 INFO:tasks.workunit.client.0.smithi096.stderr:}' 2024-09-16T03:42:39.870 INFO:tasks.workunit.client.0.smithi096.stderr:++ jq .osdmap_first_committed 2024-09-16T03:42:39.871 INFO:tasks.workunit.client.0.smithi096.stderr:+ fc=20 2024-09-16T03:42:39.871 INFO:tasks.workunit.client.0.smithi096.stderr:+ [[ 20 -eq 20 ]] 2024-09-16T03:42:39.871 INFO:tasks.workunit.client.0.smithi096.stderr:+ old_first_pinned=11 2024-09-16T03:42:39.871 INFO:tasks.workunit.client.0.smithi096.stderr:+ old_last_pinned=931 2024-09-16T03:42:39.871 INFO:tasks.workunit.client.0.smithi096.stderr:++ jq .osdmap_manifest.first_pinned 2024-09-16T03:42:39.871 INFO:tasks.workunit.client.0.smithi096.stderr:+ first_pinned=20 2024-09-16T03:42:39.871 INFO:tasks.workunit.client.0.smithi096.stderr:++ jq .osdmap_manifest.last_pinned 2024-09-16T03:42:39.875 INFO:tasks.workunit.client.0.smithi096.stderr:+ last_pinned=931 2024-09-16T03:42:39.875 INFO:tasks.workunit.client.0.smithi096.stderr:+ pinned_maps=($(jq '.osdmap_manifest.pinned_maps[]' <<< $report)) 2024-09-16T03:42:39.876 INFO:tasks.workunit.client.0.smithi096.stderr:++ jq '.osdmap_manifest.pinned_maps[]' 2024-09-16T03:42:39.912 INFO:tasks.workunit.client.0.smithi096.stderr:+ [[ 20 -eq 20 ]] 2024-09-16T03:42:39.912 INFO:tasks.workunit.client.0.smithi096.stderr:+ [[ 21 -eq 21 ]] 2024-09-16T03:42:39.912 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 20 2024-09-16T03:42:39.912 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=20 2024-09-16T03:42:39.912 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:42:39.912 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:42:39.913 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.bQfeRBGuec 2024-09-16T03:42:39.913 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 20 -o /tmp/tmp.bQfeRBGuec 2024-09-16T03:42:40.369 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 20 2024-09-16T03:42:40.387 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 20' 2024-09-16T03:42:40.387 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.bQfeRBGuec 2024-09-16T03:42:40.407 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.bQfeRBGuec' 2024-09-16T03:42:40.408 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 20 2024-09-16T03:42:40.408 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.bQfeRBGuec 2024-09-16T03:42:40.409 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:42:40.410 INFO:tasks.workunit.client.0.smithi096.stderr:+ test_osdmap 21 2024-09-16T03:42:40.410 INFO:tasks.workunit.client.0.smithi096.stderr:+ local epoch=21 2024-09-16T03:42:40.410 INFO:tasks.workunit.client.0.smithi096.stderr:+ local ret=0 2024-09-16T03:42:40.410 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp 2024-09-16T03:42:40.411 INFO:tasks.workunit.client.0.smithi096.stderr:+ tmp_map=/tmp/tmp.Q5H0eqM6ay 2024-09-16T03:42:40.411 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd getmap 21 -o /tmp/tmp.Q5H0eqM6ay 2024-09-16T03:42:40.871 INFO:tasks.workunit.client.0.smithi096.stderr:got osdmap epoch 21 2024-09-16T03:42:40.890 INFO:tasks.workunit.client.0.smithi096.stderr:+ osdmaptool --print /tmp/tmp.Q5H0eqM6ay 2024-09-16T03:42:40.890 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep 'epoch 21' 2024-09-16T03:42:40.904 INFO:tasks.workunit.client.0.smithi096.stderr:osdmaptool: osdmap file '/tmp/tmp.Q5H0eqM6ay' 2024-09-16T03:42:40.905 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 21 2024-09-16T03:42:40.906 INFO:tasks.workunit.client.0.smithi096.stderr:+ rm /tmp/tmp.Q5H0eqM6ay 2024-09-16T03:42:40.907 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:42:40.907 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph config set mon mon_osd_force_trim_to 0 2024-09-16T03:42:41.402 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd set noup 2024-09-16T03:42:42.063 INFO:tasks.workunit.client.0.smithi096.stderr:noup is set 2024-09-16T03:42:42.083 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd unset noup 2024-09-16T03:42:42.741 INFO:tasks.workunit.client.0.smithi096.stderr:noup is unset 2024-09-16T03:42:42.762 INFO:tasks.workunit.client.0.smithi096.stderr:+ wait_for_osdmap_manifest false 2024-09-16T03:42:42.762 INFO:tasks.workunit.client.0.smithi096.stderr:+ local what=false 2024-09-16T03:42:42.762 INFO:tasks.workunit.client.0.smithi096.stderr:++ get_timeout_delays 300 .1 2024-09-16T03:42:42.763 INFO:tasks.workunit.client.0.smithi096.stderr:+++ shopt -q -o xtrace 2024-09-16T03:42:42.763 INFO:tasks.workunit.client.0.smithi096.stderr:+++ echo true 2024-09-16T03:42:42.763 INFO:tasks.workunit.client.0.smithi096.stderr:++ local trace=true 2024-09-16T03:42:42.763 INFO:tasks.workunit.client.0.smithi096.stderr:++ true 2024-09-16T03:42:42.764 INFO:tasks.workunit.client.0.smithi096.stderr:++ shopt -u -o xtrace 2024-09-16T03:42:42.981 INFO:tasks.workunit.client.0.smithi096.stderr:+ delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '4.5') 2024-09-16T03:42:42.981 INFO:tasks.workunit.client.0.smithi096.stderr:+ local -a delays 2024-09-16T03:42:42.981 INFO:tasks.workunit.client.0.smithi096.stderr:+ local -i loop=0 2024-09-16T03:42:42.981 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i=0 )) 2024-09-16T03:42:42.981 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < 27 )) 2024-09-16T03:42:42.982 INFO:tasks.workunit.client.0.smithi096.stderr:++ ceph report 2024-09-16T03:42:42.982 INFO:tasks.workunit.client.0.smithi096.stderr:++ jq 'has("osdmap_manifest")' 2024-09-16T03:42:43.568 INFO:tasks.workunit.client.0.smithi096.stderr:report 568710637 2024-09-16T03:42:43.585 INFO:tasks.workunit.client.0.smithi096.stderr:+ has_manifest=true 2024-09-16T03:42:43.585 INFO:tasks.workunit.client.0.smithi096.stderr:+ [[ true == \f\a\l\s\e ]] 2024-09-16T03:42:43.585 INFO:tasks.workunit.client.0.smithi096.stderr:+ sleep 0.1 2024-09-16T03:42:43.686 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:42:43.686 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < 27 )) 2024-09-16T03:42:43.687 INFO:tasks.workunit.client.0.smithi096.stderr:++ ceph report 2024-09-16T03:42:43.687 INFO:tasks.workunit.client.0.smithi096.stderr:++ jq 'has("osdmap_manifest")' 2024-09-16T03:42:44.360 INFO:tasks.workunit.client.0.smithi096.stderr:report 3239374657 2024-09-16T03:42:44.384 INFO:tasks.workunit.client.0.smithi096.stderr:+ has_manifest=true 2024-09-16T03:42:44.385 INFO:tasks.workunit.client.0.smithi096.stderr:+ [[ true == \f\a\l\s\e ]] 2024-09-16T03:42:44.385 INFO:tasks.workunit.client.0.smithi096.stderr:+ sleep 0.2 2024-09-16T03:42:44.585 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:42:44.586 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < 27 )) 2024-09-16T03:42:44.586 INFO:tasks.workunit.client.0.smithi096.stderr:++ ceph report 2024-09-16T03:42:44.587 INFO:tasks.workunit.client.0.smithi096.stderr:++ jq 'has("osdmap_manifest")' 2024-09-16T03:42:45.195 INFO:tasks.workunit.client.0.smithi096.stderr:report 351335453 2024-09-16T03:42:45.211 INFO:tasks.workunit.client.0.smithi096.stderr:+ has_manifest=true 2024-09-16T03:42:45.212 INFO:tasks.workunit.client.0.smithi096.stderr:+ [[ true == \f\a\l\s\e ]] 2024-09-16T03:42:45.212 INFO:tasks.workunit.client.0.smithi096.stderr:+ sleep 0.4 2024-09-16T03:42:45.613 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:42:45.613 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < 27 )) 2024-09-16T03:42:45.613 INFO:tasks.workunit.client.0.smithi096.stderr:++ ceph report 2024-09-16T03:42:45.614 INFO:tasks.workunit.client.0.smithi096.stderr:++ jq 'has("osdmap_manifest")' 2024-09-16T03:42:46.152 INFO:tasks.workunit.client.0.smithi096.stderr:report 2839217663 2024-09-16T03:42:46.168 INFO:tasks.workunit.client.0.smithi096.stderr:+ has_manifest=true 2024-09-16T03:42:46.168 INFO:tasks.workunit.client.0.smithi096.stderr:+ [[ true == \f\a\l\s\e ]] 2024-09-16T03:42:46.168 INFO:tasks.workunit.client.0.smithi096.stderr:+ sleep 0.8 2024-09-16T03:42:46.970 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:42:46.970 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < 27 )) 2024-09-16T03:42:46.971 INFO:tasks.workunit.client.0.smithi096.stderr:++ ceph report 2024-09-16T03:42:46.971 INFO:tasks.workunit.client.0.smithi096.stderr:++ jq 'has("osdmap_manifest")' 2024-09-16T03:42:47.504 INFO:tasks.workunit.client.0.smithi096.stderr:report 1904421880 2024-09-16T03:42:47.521 INFO:tasks.workunit.client.0.smithi096.stderr:+ has_manifest=true 2024-09-16T03:42:47.521 INFO:tasks.workunit.client.0.smithi096.stderr:+ [[ true == \f\a\l\s\e ]] 2024-09-16T03:42:47.521 INFO:tasks.workunit.client.0.smithi096.stderr:+ sleep 1.6 2024-09-16T03:42:49.122 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( ++i )) 2024-09-16T03:42:49.122 INFO:tasks.workunit.client.0.smithi096.stderr:+ (( i < 27 )) 2024-09-16T03:42:49.123 INFO:tasks.workunit.client.0.smithi096.stderr:++ ceph report 2024-09-16T03:42:49.123 INFO:tasks.workunit.client.0.smithi096.stderr:++ jq 'has("osdmap_manifest")' 2024-09-16T03:42:49.685 INFO:tasks.workunit.client.0.smithi096.stderr:report 1946798376 2024-09-16T03:42:49.702 INFO:tasks.workunit.client.0.smithi096.stderr:+ has_manifest=false 2024-09-16T03:42:49.702 INFO:tasks.workunit.client.0.smithi096.stderr:+ [[ false == \f\a\l\s\e ]] 2024-09-16T03:42:49.702 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:42:49.702 INFO:tasks.workunit.client.0.smithi096.stderr:+ return 0 2024-09-16T03:42:49.703 INFO:tasks.workunit.client.0.smithi096.stdout:OK 2024-09-16T03:42:49.704 INFO:tasks.workunit.client.0.smithi096.stderr:+ echo OK 2024-09-16T03:42:49.704 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-osdmap-prune.sh:53: TEST_osdmap_prune: return 0 2024-09-16T03:42:49.704 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-osdmap-prune.sh:20: run: teardown td/mon-osdmap-prune 2024-09-16T03:42:49.704 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/mon-osdmap-prune 2024-09-16T03:42:49.704 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:42:49.704 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/mon-osdmap-prune KILL 2024-09-16T03:42:49.704 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:42:49.704 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:42:49.704 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:42:49.705 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:42:49.705 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:42:50.013 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:42:50.013 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:42:50.014 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:42:50.015 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:42:50.016 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:42:50.016 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:42:50.016 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:42:50.017 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:42:50.017 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:42:50.018 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:42:50.018 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:42:50.019 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:42:50.020 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:42:50.020 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/mon-osdmap-prune 2024-09-16T03:42:50.153 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:42:50.153 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:42:50.153 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.56415 2024-09-16T03:42:50.153 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.56415 2024-09-16T03:42:50.154 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:42:50.154 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:42:50.155 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2322: main: code=0 2024-09-16T03:42:50.155 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2326: main: teardown td/mon-osdmap-prune 0 2024-09-16T03:42:50.155 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/mon-osdmap-prune 2024-09-16T03:42:50.155 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2024-09-16T03:42:50.155 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/mon-osdmap-prune KILL 2024-09-16T03:42:50.155 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:42:50.155 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:42:50.155 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:42:50.155 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:42:50.155 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:42:50.157 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:42:50.158 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:42:50.159 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:42:50.160 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:42:50.161 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:42:50.161 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:42:50.161 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:42:50.162 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:42:50.162 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:42:50.163 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:42:50.163 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:42:50.164 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:42:50.165 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2024-09-16T03:42:50.165 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/mon-osdmap-prune 2024-09-16T03:42:50.167 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:42:50.167 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:42:50.167 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.56415 2024-09-16T03:42:50.167 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.56415 2024-09-16T03:42:50.168 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:42:50.168 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:42:50.168 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2327: main: return 0 2024-09-16T03:42:50.169 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-16T03:42:50.170 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-16T03:42:50.222 INFO:tasks.workunit:Running workunit mon/mon-ping.sh... 2024-09-16T03:42:50.222 DEBUG:teuthology.orchestra.run.smithi096:workunit test mon/mon-ping.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7498493279982dfe87f00616198a5967475f6169 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-ping.sh 2024-09-16T03:42:50.274 INFO:tasks.workunit.client.0.smithi096.stderr:stty: 'standard input': Inappropriate ioctl for device 2024-09-16T03:42:50.278 INFO:tasks.workunit.client.0.smithi096.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2024-09-16T03:42:50.279 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2315: main: export PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-16T03:42:50.279 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2315: main: PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-16T03:42:50.279 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2316: main: export PYTHONWARNINGS=ignore 2024-09-16T03:42:50.279 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2316: main: PYTHONWARNINGS=ignore 2024-09-16T03:42:50.279 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2317: main: export CEPH_CONF=/dev/null 2024-09-16T03:42:50.279 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2317: main: CEPH_CONF=/dev/null 2024-09-16T03:42:50.279 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2318: main: unset CEPH_ARGS 2024-09-16T03:42:50.279 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2320: main: local code 2024-09-16T03:42:50.279 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2321: main: run td/mon-ping 2024-09-16T03:42:50.279 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-ping.sh:18: run: local dir=td/mon-ping 2024-09-16T03:42:50.279 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-ping.sh:19: run: shift 2024-09-16T03:42:50.280 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-ping.sh:21: run: export CEPH_MON=127.0.0.1:7119 2024-09-16T03:42:50.280 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-ping.sh:21: run: CEPH_MON=127.0.0.1:7119 2024-09-16T03:42:50.280 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-ping.sh:22: run: export CEPH_ARGS 2024-09-16T03:42:50.280 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-ping.sh:23: run: uuidgen 2024-09-16T03:42:50.280 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-ping.sh:23: run: CEPH_ARGS+='--fsid=cffd3a77-eaaa-4e57-9639-cca2ba00ac85 --auth-supported=none ' 2024-09-16T03:42:50.281 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-ping.sh:24: run: CEPH_ARGS+='--mon-host=127.0.0.1:7119 ' 2024-09-16T03:42:50.281 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-ping.sh:26: run: set 2024-09-16T03:42:50.281 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-ping.sh:26: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2024-09-16T03:42:50.283 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-ping.sh:26: run: local funcs=TEST_mon_ping 2024-09-16T03:42:50.284 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-ping.sh:27: run: for func in $funcs 2024-09-16T03:42:50.284 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-ping.sh:28: run: setup td/mon-ping 2024-09-16T03:42:50.284 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/mon-ping 2024-09-16T03:42:50.284 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/mon-ping 2024-09-16T03:42:50.284 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/mon-ping 2024-09-16T03:42:50.284 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:42:50.284 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/mon-ping KILL 2024-09-16T03:42:50.284 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:42:50.284 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:42:50.284 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:42:50.284 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:42:50.284 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:42:50.285 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:42:50.286 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:42:50.287 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:42:50.287 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:42:50.287 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:42:50.287 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:42:50.288 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:42:50.289 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:42:50.289 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:42:50.289 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:42:50.289 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:42:50.289 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:42:50.291 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:42:50.291 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/mon-ping 2024-09-16T03:42:50.292 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:42:50.292 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:42:50.292 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.102063 2024-09-16T03:42:50.292 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.102063 2024-09-16T03:42:50.292 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:42:50.293 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:42:50.293 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/mon-ping 2024-09-16T03:42:50.294 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T03:42:50.294 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:42:50.294 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.102063 2024-09-16T03:42:50.294 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.102063 2024-09-16T03:42:50.296 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T03:42:50.296 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2024-09-16T03:42:50.296 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2024-09-16T03:42:50.296 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T03:42:50.296 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/mon-ping 1' TERM HUP INT 2024-09-16T03:42:50.296 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-ping.sh:29: run: TEST_mon_ping td/mon-ping 2024-09-16T03:42:50.296 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-ping.sh:35: TEST_mon_ping: local dir=td/mon-ping 2024-09-16T03:42:50.296 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-ping.sh:37: TEST_mon_ping: run_mon td/mon-ping a 2024-09-16T03:42:50.296 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/mon-ping 2024-09-16T03:42:50.296 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T03:42:50.296 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T03:42:50.297 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T03:42:50.297 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/mon-ping/a 2024-09-16T03:42:50.297 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/mon-ping/a --run-dir=td/mon-ping 2024-09-16T03:42:50.741 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T03:42:50.741 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:42:50.741 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:42:50.742 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:42:50.742 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:42:50.742 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.102063 2024-09-16T03:42:50.742 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.102063/$cluster-$name.asok' 2024-09-16T03:42:50.743 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/mon-ping/a '--log-file=td/mon-ping/$name.log' '--admin-socket=/tmp/ceph-asok.102063/$cluster-$name.asok' --mon-cluster-log-file=td/mon-ping/log --run-dir=td/mon-ping '--pid-file=td/mon-ping/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-09-16T03:42:50.942 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T03:42:50.943 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T03:42:50.943 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:42:50.943 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:42:50.943 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T03:42:50.944 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T03:42:50.944 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:42:50.944 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:42:50.944 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:42:50.944 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:42:50.944 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:42:50.945 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.102063 2024-09-16T03:42:50.945 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.102063/ceph-mon.a.asok 2024-09-16T03:42:50.945 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:42:50.945 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.102063/ceph-mon.a.asok config get fsid 2024-09-16T03:42:51.061 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T03:42:51.061 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:42:51.061 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:42:51.061 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T03:42:51.063 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T03:42:51.063 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:42:51.063 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:42:51.063 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:42:51.063 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:42:51.063 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:42:51.063 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.102063 2024-09-16T03:42:51.063 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.102063/ceph-mon.a.asok 2024-09-16T03:42:51.063 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:42:51.064 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.102063/ceph-mon.a.asok config get mon_host 2024-09-16T03:42:51.171 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-ping.sh:39: TEST_mon_ping: ceph ping mon.a 2024-09-16T03:42:51.887 INFO:tasks.workunit.client.0.smithi096.stdout:{ 2024-09-16T03:42:51.888 INFO:tasks.workunit.client.0.smithi096.stdout: "health": { 2024-09-16T03:42:51.888 INFO:tasks.workunit.client.0.smithi096.stdout: "status": "HEALTH_OK", 2024-09-16T03:42:51.888 INFO:tasks.workunit.client.0.smithi096.stdout: "checks": {}, 2024-09-16T03:42:51.888 INFO:tasks.workunit.client.0.smithi096.stdout: "mutes": [] 2024-09-16T03:42:51.888 INFO:tasks.workunit.client.0.smithi096.stdout: }, 2024-09-16T03:42:51.888 INFO:tasks.workunit.client.0.smithi096.stdout: "mon_status": { 2024-09-16T03:42:51.888 INFO:tasks.workunit.client.0.smithi096.stdout: "name": "a", 2024-09-16T03:42:51.888 INFO:tasks.workunit.client.0.smithi096.stdout: "rank": 0, 2024-09-16T03:42:51.888 INFO:tasks.workunit.client.0.smithi096.stdout: "state": "leader", 2024-09-16T03:42:51.888 INFO:tasks.workunit.client.0.smithi096.stdout: "election_epoch": 3, 2024-09-16T03:42:51.888 INFO:tasks.workunit.client.0.smithi096.stdout: "uptime": 947, 2024-09-16T03:42:51.888 INFO:tasks.workunit.client.0.smithi096.stdout: "quorum": [ 2024-09-16T03:42:51.888 INFO:tasks.workunit.client.0.smithi096.stdout: 0 2024-09-16T03:42:51.889 INFO:tasks.workunit.client.0.smithi096.stdout: ], 2024-09-16T03:42:51.889 INFO:tasks.workunit.client.0.smithi096.stdout: "quorum_age": 0, 2024-09-16T03:42:51.889 INFO:tasks.workunit.client.0.smithi096.stdout: "features": { 2024-09-16T03:42:51.889 INFO:tasks.workunit.client.0.smithi096.stdout: "required_con": "2450521708007866372", 2024-09-16T03:42:51.889 INFO:tasks.workunit.client.0.smithi096.stdout: "required_mon": [ 2024-09-16T03:42:51.889 INFO:tasks.workunit.client.0.smithi096.stdout: "kraken", 2024-09-16T03:42:51.889 INFO:tasks.workunit.client.0.smithi096.stdout: "luminous", 2024-09-16T03:42:51.889 INFO:tasks.workunit.client.0.smithi096.stdout: "mimic", 2024-09-16T03:42:51.889 INFO:tasks.workunit.client.0.smithi096.stdout: "osdmap-prune", 2024-09-16T03:42:51.890 INFO:tasks.workunit.client.0.smithi096.stdout: "nautilus", 2024-09-16T03:42:51.890 INFO:tasks.workunit.client.0.smithi096.stdout: "octopus", 2024-09-16T03:42:51.890 INFO:tasks.workunit.client.0.smithi096.stdout: "pacific", 2024-09-16T03:42:51.890 INFO:tasks.workunit.client.0.smithi096.stdout: "elector-pinging", 2024-09-16T03:42:51.890 INFO:tasks.workunit.client.0.smithi096.stdout: "quincy", 2024-09-16T03:42:51.890 INFO:tasks.workunit.client.0.smithi096.stdout: "reef", 2024-09-16T03:42:51.890 INFO:tasks.workunit.client.0.smithi096.stdout: "squid" 2024-09-16T03:42:51.890 INFO:tasks.workunit.client.0.smithi096.stdout: ], 2024-09-16T03:42:51.890 INFO:tasks.workunit.client.0.smithi096.stdout: "quorum_con": "4540719139924082687", 2024-09-16T03:42:51.890 INFO:tasks.workunit.client.0.smithi096.stdout: "quorum_mon": [ 2024-09-16T03:42:51.890 INFO:tasks.workunit.client.0.smithi096.stdout: "kraken", 2024-09-16T03:42:51.890 INFO:tasks.workunit.client.0.smithi096.stdout: "luminous", 2024-09-16T03:42:51.891 INFO:tasks.workunit.client.0.smithi096.stdout: "mimic", 2024-09-16T03:42:51.891 INFO:tasks.workunit.client.0.smithi096.stdout: "osdmap-prune", 2024-09-16T03:42:51.891 INFO:tasks.workunit.client.0.smithi096.stdout: "nautilus", 2024-09-16T03:42:51.891 INFO:tasks.workunit.client.0.smithi096.stdout: "octopus", 2024-09-16T03:42:51.891 INFO:tasks.workunit.client.0.smithi096.stdout: "pacific", 2024-09-16T03:42:51.891 INFO:tasks.workunit.client.0.smithi096.stdout: "elector-pinging", 2024-09-16T03:42:51.891 INFO:tasks.workunit.client.0.smithi096.stdout: "quincy", 2024-09-16T03:42:51.891 INFO:tasks.workunit.client.0.smithi096.stdout: "reef", 2024-09-16T03:42:51.891 INFO:tasks.workunit.client.0.smithi096.stdout: "squid" 2024-09-16T03:42:51.891 INFO:tasks.workunit.client.0.smithi096.stdout: ] 2024-09-16T03:42:51.891 INFO:tasks.workunit.client.0.smithi096.stdout: }, 2024-09-16T03:42:51.891 INFO:tasks.workunit.client.0.smithi096.stdout: "outside_quorum": [], 2024-09-16T03:42:51.891 INFO:tasks.workunit.client.0.smithi096.stdout: "extra_probe_peers": [], 2024-09-16T03:42:51.891 INFO:tasks.workunit.client.0.smithi096.stdout: "sync_provider": [], 2024-09-16T03:42:51.892 INFO:tasks.workunit.client.0.smithi096.stdout: "monmap": { 2024-09-16T03:42:51.892 INFO:tasks.workunit.client.0.smithi096.stdout: "epoch": 1, 2024-09-16T03:42:51.892 INFO:tasks.workunit.client.0.smithi096.stdout: "fsid": "cffd3a77-eaaa-4e57-9639-cca2ba00ac85", 2024-09-16T03:42:51.892 INFO:tasks.workunit.client.0.smithi096.stdout: "modified": "2024-09-16T03:42:50.322147Z", 2024-09-16T03:42:51.892 INFO:tasks.workunit.client.0.smithi096.stdout: "created": "2024-09-16T03:42:50.322147Z", 2024-09-16T03:42:51.892 INFO:tasks.workunit.client.0.smithi096.stdout: "min_mon_release": 19, 2024-09-16T03:42:51.892 INFO:tasks.workunit.client.0.smithi096.stdout: "min_mon_release_name": "squid", 2024-09-16T03:42:51.892 INFO:tasks.workunit.client.0.smithi096.stdout: "election_strategy": 1, 2024-09-16T03:42:51.892 INFO:tasks.workunit.client.0.smithi096.stdout: "disallowed_leaders: ": "", 2024-09-16T03:42:51.893 INFO:tasks.workunit.client.0.smithi096.stdout: "stretch_mode": false, 2024-09-16T03:42:51.893 INFO:tasks.workunit.client.0.smithi096.stdout: "tiebreaker_mon": "", 2024-09-16T03:42:51.893 INFO:tasks.workunit.client.0.smithi096.stdout: "removed_ranks: ": "", 2024-09-16T03:42:51.893 INFO:tasks.workunit.client.0.smithi096.stdout: "features": { 2024-09-16T03:42:51.893 INFO:tasks.workunit.client.0.smithi096.stdout: "persistent": [ 2024-09-16T03:42:51.893 INFO:tasks.workunit.client.0.smithi096.stdout: "kraken", 2024-09-16T03:42:51.893 INFO:tasks.workunit.client.0.smithi096.stdout: "luminous", 2024-09-16T03:42:51.893 INFO:tasks.workunit.client.0.smithi096.stdout: "mimic", 2024-09-16T03:42:51.893 INFO:tasks.workunit.client.0.smithi096.stdout: "osdmap-prune", 2024-09-16T03:42:51.893 INFO:tasks.workunit.client.0.smithi096.stdout: "nautilus", 2024-09-16T03:42:51.893 INFO:tasks.workunit.client.0.smithi096.stdout: "octopus", 2024-09-16T03:42:51.894 INFO:tasks.workunit.client.0.smithi096.stdout: "pacific", 2024-09-16T03:42:51.894 INFO:tasks.workunit.client.0.smithi096.stdout: "elector-pinging", 2024-09-16T03:42:51.894 INFO:tasks.workunit.client.0.smithi096.stdout: "quincy", 2024-09-16T03:42:51.894 INFO:tasks.workunit.client.0.smithi096.stdout: "reef", 2024-09-16T03:42:51.894 INFO:tasks.workunit.client.0.smithi096.stdout: "squid" 2024-09-16T03:42:51.894 INFO:tasks.workunit.client.0.smithi096.stdout: ], 2024-09-16T03:42:51.894 INFO:tasks.workunit.client.0.smithi096.stdout: "optional": [] 2024-09-16T03:42:51.894 INFO:tasks.workunit.client.0.smithi096.stdout: }, 2024-09-16T03:42:51.895 INFO:tasks.workunit.client.0.smithi096.stdout: "mons": [ 2024-09-16T03:42:51.895 INFO:tasks.workunit.client.0.smithi096.stdout: { 2024-09-16T03:42:51.895 INFO:tasks.workunit.client.0.smithi096.stdout: "rank": 0, 2024-09-16T03:42:51.895 INFO:tasks.workunit.client.0.smithi096.stdout: "name": "a", 2024-09-16T03:42:51.895 INFO:tasks.workunit.client.0.smithi096.stdout: "public_addrs": { 2024-09-16T03:42:51.895 INFO:tasks.workunit.client.0.smithi096.stdout: "addrvec": [ 2024-09-16T03:42:51.895 INFO:tasks.workunit.client.0.smithi096.stdout: { 2024-09-16T03:42:51.895 INFO:tasks.workunit.client.0.smithi096.stdout: "type": "v2", 2024-09-16T03:42:51.895 INFO:tasks.workunit.client.0.smithi096.stdout: "addr": "127.0.0.1:7119", 2024-09-16T03:42:51.895 INFO:tasks.workunit.client.0.smithi096.stdout: "nonce": 0 2024-09-16T03:42:51.895 INFO:tasks.workunit.client.0.smithi096.stdout: } 2024-09-16T03:42:51.895 INFO:tasks.workunit.client.0.smithi096.stdout: ] 2024-09-16T03:42:51.895 INFO:tasks.workunit.client.0.smithi096.stdout: }, 2024-09-16T03:42:51.895 INFO:tasks.workunit.client.0.smithi096.stdout: "addr": "127.0.0.1:7119/0", 2024-09-16T03:42:51.896 INFO:tasks.workunit.client.0.smithi096.stdout: "public_addr": "127.0.0.1:7119/0", 2024-09-16T03:42:51.896 INFO:tasks.workunit.client.0.smithi096.stdout: "priority": 0, 2024-09-16T03:42:51.896 INFO:tasks.workunit.client.0.smithi096.stdout: "weight": 0, 2024-09-16T03:42:51.896 INFO:tasks.workunit.client.0.smithi096.stdout: "crush_location": "{}" 2024-09-16T03:42:51.896 INFO:tasks.workunit.client.0.smithi096.stdout: } 2024-09-16T03:42:51.896 INFO:tasks.workunit.client.0.smithi096.stdout: ] 2024-09-16T03:42:51.896 INFO:tasks.workunit.client.0.smithi096.stdout: }, 2024-09-16T03:42:51.896 INFO:tasks.workunit.client.0.smithi096.stdout: "feature_map": { 2024-09-16T03:42:51.896 INFO:tasks.workunit.client.0.smithi096.stdout: "mon": [ 2024-09-16T03:42:51.896 INFO:tasks.workunit.client.0.smithi096.stdout: { 2024-09-16T03:42:51.896 INFO:tasks.workunit.client.0.smithi096.stdout: "features": "0x3f03dffffffdffff", 2024-09-16T03:42:51.896 INFO:tasks.workunit.client.0.smithi096.stdout: "release": "squid", 2024-09-16T03:42:51.896 INFO:tasks.workunit.client.0.smithi096.stdout: "num": 1 2024-09-16T03:42:51.897 INFO:tasks.workunit.client.0.smithi096.stdout: } 2024-09-16T03:42:51.897 INFO:tasks.workunit.client.0.smithi096.stdout: ], 2024-09-16T03:42:51.897 INFO:tasks.workunit.client.0.smithi096.stdout: "client": [ 2024-09-16T03:42:51.897 INFO:tasks.workunit.client.0.smithi096.stdout: { 2024-09-16T03:42:51.897 INFO:tasks.workunit.client.0.smithi096.stdout: "features": "0x3f03dffffffdffff", 2024-09-16T03:42:51.897 INFO:tasks.workunit.client.0.smithi096.stdout: "release": "squid", 2024-09-16T03:42:51.897 INFO:tasks.workunit.client.0.smithi096.stdout: "num": 1 2024-09-16T03:42:51.897 INFO:tasks.workunit.client.0.smithi096.stdout: } 2024-09-16T03:42:51.897 INFO:tasks.workunit.client.0.smithi096.stdout: ] 2024-09-16T03:42:51.897 INFO:tasks.workunit.client.0.smithi096.stdout: }, 2024-09-16T03:42:51.898 INFO:tasks.workunit.client.0.smithi096.stdout: "stretch_mode": false 2024-09-16T03:42:51.898 INFO:tasks.workunit.client.0.smithi096.stdout: } 2024-09-16T03:42:51.898 INFO:tasks.workunit.client.0.smithi096.stdout:} 2024-09-16T03:42:51.898 INFO:tasks.workunit.client.0.smithi096.stdout: 2024-09-16T03:42:51.904 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-ping.sh:30: run: teardown td/mon-ping 2024-09-16T03:42:51.905 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/mon-ping 2024-09-16T03:42:51.905 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:42:51.905 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/mon-ping KILL 2024-09-16T03:42:51.905 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:42:51.905 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:42:51.906 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:42:51.906 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:42:51.906 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:42:52.014 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:42:52.014 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:42:52.015 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:42:52.016 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:42:52.018 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:42:52.018 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:42:52.018 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:42:52.020 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:42:52.020 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:42:52.021 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:42:52.021 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:42:52.022 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:42:52.024 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:42:52.024 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/mon-ping 2024-09-16T03:42:52.026 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:42:52.026 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:42:52.026 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.102063 2024-09-16T03:42:52.026 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.102063 2024-09-16T03:42:52.029 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:42:52.029 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:42:52.029 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2322: main: code=0 2024-09-16T03:42:52.029 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2326: main: teardown td/mon-ping 0 2024-09-16T03:42:52.029 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/mon-ping 2024-09-16T03:42:52.029 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2024-09-16T03:42:52.029 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/mon-ping KILL 2024-09-16T03:42:52.029 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:42:52.030 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:42:52.030 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:42:52.030 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:42:52.030 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:42:52.031 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:42:52.031 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:42:52.032 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:42:52.033 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:42:52.035 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:42:52.035 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:42:52.035 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:42:52.036 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:42:52.036 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:42:52.037 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:42:52.037 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:42:52.038 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:42:52.039 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2024-09-16T03:42:52.039 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/mon-ping 2024-09-16T03:42:52.040 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:42:52.040 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:42:52.040 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.102063 2024-09-16T03:42:52.041 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.102063 2024-09-16T03:42:52.042 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:42:52.042 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:42:52.042 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2327: main: return 0 2024-09-16T03:42:52.043 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-16T03:42:52.043 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-16T03:42:52.095 INFO:tasks.workunit:Running workunit mon/mon-scrub.sh... 2024-09-16T03:42:52.095 DEBUG:teuthology.orchestra.run.smithi096:workunit test mon/mon-scrub.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7498493279982dfe87f00616198a5967475f6169 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-scrub.sh 2024-09-16T03:42:52.151 INFO:tasks.workunit.client.0.smithi096.stderr:stty: 'standard input': Inappropriate ioctl for device 2024-09-16T03:42:52.156 INFO:tasks.workunit.client.0.smithi096.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2024-09-16T03:42:52.156 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2315: main: export PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-16T03:42:52.156 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2315: main: PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-16T03:42:52.156 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2316: main: export PYTHONWARNINGS=ignore 2024-09-16T03:42:52.157 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2316: main: PYTHONWARNINGS=ignore 2024-09-16T03:42:52.157 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2317: main: export CEPH_CONF=/dev/null 2024-09-16T03:42:52.157 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2317: main: CEPH_CONF=/dev/null 2024-09-16T03:42:52.157 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2318: main: unset CEPH_ARGS 2024-09-16T03:42:52.157 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2320: main: local code 2024-09-16T03:42:52.157 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2321: main: run td/mon-scrub 2024-09-16T03:42:52.157 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-scrub.sh:21: run: local dir=td/mon-scrub 2024-09-16T03:42:52.157 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-scrub.sh:22: run: shift 2024-09-16T03:42:52.157 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-scrub.sh:24: run: export CEPH_MON=127.0.0.1:7120 2024-09-16T03:42:52.157 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-scrub.sh:24: run: CEPH_MON=127.0.0.1:7120 2024-09-16T03:42:52.157 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-scrub.sh:25: run: export CEPH_ARGS 2024-09-16T03:42:52.157 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-scrub.sh:26: run: uuidgen 2024-09-16T03:42:52.158 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-scrub.sh:26: run: CEPH_ARGS+='--fsid=82042acf-55a5-45e8-9a81-7200bf8a8e15 --auth-supported=none ' 2024-09-16T03:42:52.158 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-scrub.sh:27: run: CEPH_ARGS+='--mon-host=127.0.0.1:7120 ' 2024-09-16T03:42:52.158 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-scrub.sh:29: run: set 2024-09-16T03:42:52.158 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-scrub.sh:29: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2024-09-16T03:42:52.161 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-scrub.sh:29: run: local funcs=TEST_mon_scrub 2024-09-16T03:42:52.161 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-scrub.sh:30: run: for func in $funcs 2024-09-16T03:42:52.161 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-scrub.sh:31: run: setup td/mon-scrub 2024-09-16T03:42:52.161 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/mon-scrub 2024-09-16T03:42:52.161 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/mon-scrub 2024-09-16T03:42:52.161 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/mon-scrub 2024-09-16T03:42:52.161 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:42:52.161 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/mon-scrub KILL 2024-09-16T03:42:52.161 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:42:52.162 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:42:52.162 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:42:52.162 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:42:52.162 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:42:52.163 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:42:52.163 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:42:52.164 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:42:52.165 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:42:52.165 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:42:52.165 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:42:52.166 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:42:52.167 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:42:52.167 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:42:52.167 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:42:52.167 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:42:52.168 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:42:52.169 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:42:52.169 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/mon-scrub 2024-09-16T03:42:52.171 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:42:52.171 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:42:52.171 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.102212 2024-09-16T03:42:52.171 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.102212 2024-09-16T03:42:52.172 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:42:52.172 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:42:52.172 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/mon-scrub 2024-09-16T03:42:52.173 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T03:42:52.174 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:42:52.174 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.102212 2024-09-16T03:42:52.174 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.102212 2024-09-16T03:42:52.175 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T03:42:52.176 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2024-09-16T03:42:52.176 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2024-09-16T03:42:52.176 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T03:42:52.176 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/mon-scrub 1' TERM HUP INT 2024-09-16T03:42:52.176 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-scrub.sh:32: run: TEST_mon_scrub td/mon-scrub 2024-09-16T03:42:52.176 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-scrub.sh:38: TEST_mon_scrub: local dir=td/mon-scrub 2024-09-16T03:42:52.176 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-scrub.sh:40: TEST_mon_scrub: run_mon td/mon-scrub a 2024-09-16T03:42:52.176 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/mon-scrub 2024-09-16T03:42:52.176 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T03:42:52.177 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T03:42:52.177 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T03:42:52.177 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/mon-scrub/a 2024-09-16T03:42:52.177 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/mon-scrub/a --run-dir=td/mon-scrub 2024-09-16T03:42:52.623 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T03:42:52.623 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:42:52.623 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:42:52.624 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:42:52.624 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:42:52.624 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.102212 2024-09-16T03:42:52.624 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.102212/$cluster-$name.asok' 2024-09-16T03:42:52.624 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/mon-scrub/a '--log-file=td/mon-scrub/$name.log' '--admin-socket=/tmp/ceph-asok.102212/$cluster-$name.asok' --mon-cluster-log-file=td/mon-scrub/log --run-dir=td/mon-scrub '--pid-file=td/mon-scrub/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-09-16T03:42:52.844 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T03:42:52.845 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T03:42:52.845 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:42:52.845 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:42:52.845 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T03:42:52.846 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T03:42:52.846 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:42:52.846 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:42:52.846 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:42:52.846 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:42:52.846 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:42:52.846 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.102212 2024-09-16T03:42:52.847 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.102212/ceph-mon.a.asok 2024-09-16T03:42:52.847 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:42:52.847 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.102212/ceph-mon.a.asok config get fsid 2024-09-16T03:42:52.963 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T03:42:52.964 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:42:52.964 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:42:52.964 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T03:42:52.964 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T03:42:52.965 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:42:52.965 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:42:52.965 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:42:52.965 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:42:52.965 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:42:52.965 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.102212 2024-09-16T03:42:52.965 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.102212/ceph-mon.a.asok 2024-09-16T03:42:52.966 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:42:52.966 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.102212/ceph-mon.a.asok config get mon_host 2024-09-16T03:42:53.076 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-scrub.sh:42: TEST_mon_scrub: ceph mon scrub 2024-09-16T03:42:53.541 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-scrub.sh:33: run: teardown td/mon-scrub 2024-09-16T03:42:53.541 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/mon-scrub 2024-09-16T03:42:53.541 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:42:53.541 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/mon-scrub KILL 2024-09-16T03:42:53.541 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:42:53.542 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:42:53.542 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:42:53.542 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:42:53.542 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:42:53.650 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:42:53.650 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:42:53.651 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:42:53.651 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:42:53.652 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:42:53.653 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:42:53.653 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:42:53.654 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:42:53.655 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:42:53.655 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:42:53.655 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:42:53.656 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:42:53.657 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:42:53.657 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/mon-scrub 2024-09-16T03:42:53.659 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:42:53.659 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:42:53.659 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.102212 2024-09-16T03:42:53.659 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.102212 2024-09-16T03:42:53.661 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:42:53.661 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:42:53.661 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2322: main: code=0 2024-09-16T03:42:53.661 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2326: main: teardown td/mon-scrub 0 2024-09-16T03:42:53.662 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/mon-scrub 2024-09-16T03:42:53.662 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2024-09-16T03:42:53.662 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/mon-scrub KILL 2024-09-16T03:42:53.662 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:42:53.662 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:42:53.662 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:42:53.662 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:42:53.662 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:42:53.663 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:42:53.663 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:42:53.664 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:42:53.665 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:42:53.666 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:42:53.666 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:42:53.666 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:42:53.667 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:42:53.667 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:42:53.667 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:42:53.667 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:42:53.668 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:42:53.669 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2024-09-16T03:42:53.669 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/mon-scrub 2024-09-16T03:42:53.671 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:42:53.671 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:42:53.671 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.102212 2024-09-16T03:42:53.671 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.102212 2024-09-16T03:42:53.672 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:42:53.672 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:42:53.672 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2327: main: return 0 2024-09-16T03:42:53.673 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-16T03:42:53.673 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-16T03:42:53.730 INFO:tasks.workunit:Running workunit mon/mon-seesaw.sh... 2024-09-16T03:42:53.730 DEBUG:teuthology.orchestra.run.smithi096:workunit test mon/mon-seesaw.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7498493279982dfe87f00616198a5967475f6169 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-seesaw.sh 2024-09-16T03:42:53.783 INFO:tasks.workunit.client.0.smithi096.stderr:stty: 'standard input': Inappropriate ioctl for device 2024-09-16T03:42:53.789 INFO:tasks.workunit.client.0.smithi096.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2024-09-16T03:42:53.789 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2315: main: export PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-16T03:42:53.790 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2315: main: PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-16T03:42:53.790 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2316: main: export PYTHONWARNINGS=ignore 2024-09-16T03:42:53.790 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2316: main: PYTHONWARNINGS=ignore 2024-09-16T03:42:53.790 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2317: main: export CEPH_CONF=/dev/null 2024-09-16T03:42:53.790 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2317: main: CEPH_CONF=/dev/null 2024-09-16T03:42:53.790 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2318: main: unset CEPH_ARGS 2024-09-16T03:42:53.790 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2320: main: local code 2024-09-16T03:42:53.790 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2321: main: run td/mon-seesaw 2024-09-16T03:42:53.790 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-seesaw.sh:6: run: local dir=td/mon-seesaw 2024-09-16T03:42:53.790 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-seesaw.sh:7: run: shift 2024-09-16T03:42:53.790 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-seesaw.sh:9: run: export CEPH_MON_A=127.0.0.1:7139 2024-09-16T03:42:53.790 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-seesaw.sh:9: run: CEPH_MON_A=127.0.0.1:7139 2024-09-16T03:42:53.791 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-seesaw.sh:10: run: export CEPH_MON_B=127.0.0.1:7141 2024-09-16T03:42:53.791 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-seesaw.sh:10: run: CEPH_MON_B=127.0.0.1:7141 2024-09-16T03:42:53.791 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-seesaw.sh:11: run: export CEPH_MON_C=127.0.0.1:7142 2024-09-16T03:42:53.791 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-seesaw.sh:11: run: CEPH_MON_C=127.0.0.1:7142 2024-09-16T03:42:53.791 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-seesaw.sh:12: run: export CEPH_ARGS 2024-09-16T03:42:53.791 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-seesaw.sh:13: run: uuidgen 2024-09-16T03:42:53.791 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-seesaw.sh:13: run: CEPH_ARGS+='--fsid=4bfeedcc-ee18-4c5d-bec3-b7e1842c7798 --auth-supported=none ' 2024-09-16T03:42:53.791 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-seesaw.sh:15: run: export 'BASE_CEPH_ARGS=--fsid=4bfeedcc-ee18-4c5d-bec3-b7e1842c7798 --auth-supported=none ' 2024-09-16T03:42:53.791 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-seesaw.sh:15: run: BASE_CEPH_ARGS='--fsid=4bfeedcc-ee18-4c5d-bec3-b7e1842c7798 --auth-supported=none ' 2024-09-16T03:42:53.791 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-seesaw.sh:16: run: CEPH_ARGS+='--mon-host=127.0.0.1:7139 ' 2024-09-16T03:42:53.793 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-seesaw.sh:18: run: set 2024-09-16T03:42:53.793 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-seesaw.sh:18: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2024-09-16T03:42:53.793 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-seesaw.sh:18: run: local funcs=TEST_mon_seesaw 2024-09-16T03:42:53.793 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-seesaw.sh:19: run: for func in $funcs 2024-09-16T03:42:53.793 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-seesaw.sh:20: run: setup td/mon-seesaw 2024-09-16T03:42:53.793 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/mon-seesaw 2024-09-16T03:42:53.793 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/mon-seesaw 2024-09-16T03:42:53.793 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/mon-seesaw 2024-09-16T03:42:53.793 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:42:53.794 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/mon-seesaw KILL 2024-09-16T03:42:53.794 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:42:53.794 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:42:53.794 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:42:53.794 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:42:53.794 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:42:53.794 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:42:53.795 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:42:53.796 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:42:53.796 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:42:53.797 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:42:53.797 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:42:53.797 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:42:53.798 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:42:53.798 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:42:53.799 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:42:53.799 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:42:53.799 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:42:53.800 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:42:53.801 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/mon-seesaw 2024-09-16T03:42:53.802 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:42:53.802 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:42:53.802 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.102374 2024-09-16T03:42:53.802 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.102374 2024-09-16T03:42:53.803 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:42:53.803 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:42:53.803 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/mon-seesaw 2024-09-16T03:42:53.806 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T03:42:53.806 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:42:53.806 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.102374 2024-09-16T03:42:53.806 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.102374 2024-09-16T03:42:53.806 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T03:42:53.808 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2024-09-16T03:42:53.808 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2024-09-16T03:42:53.808 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T03:42:53.808 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/mon-seesaw 1' TERM HUP INT 2024-09-16T03:42:53.808 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-seesaw.sh:21: run: TEST_mon_seesaw td/mon-seesaw 2024-09-16T03:42:53.808 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-seesaw.sh:27: TEST_mon_seesaw: local dir=td/mon-seesaw 2024-09-16T03:42:53.808 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-seesaw.sh:29: TEST_mon_seesaw: setup td/mon-seesaw 2024-09-16T03:42:53.809 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/mon-seesaw 2024-09-16T03:42:53.809 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/mon-seesaw 2024-09-16T03:42:53.809 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/mon-seesaw 2024-09-16T03:42:53.809 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:42:53.809 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/mon-seesaw KILL 2024-09-16T03:42:53.809 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:42:53.809 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:42:53.809 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:42:53.809 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:42:53.809 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:42:53.810 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:42:53.810 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:42:53.810 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:42:53.810 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:42:53.811 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:42:53.812 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:42:53.812 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:42:53.813 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:42:53.813 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:42:53.813 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:42:53.813 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:42:53.814 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:42:53.815 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:42:53.815 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/mon-seesaw 2024-09-16T03:42:53.816 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:42:53.816 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:42:53.816 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.102374 2024-09-16T03:42:53.816 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.102374 2024-09-16T03:42:53.817 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:42:53.817 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:42:53.817 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/mon-seesaw 2024-09-16T03:42:53.818 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T03:42:53.819 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:42:53.819 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.102374 2024-09-16T03:42:53.819 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.102374 2024-09-16T03:42:53.820 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T03:42:53.821 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2024-09-16T03:42:53.821 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T03:42:53.821 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/mon-seesaw 1' TERM HUP INT 2024-09-16T03:42:53.822 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-seesaw.sh:32: TEST_mon_seesaw: run_mon td/mon-seesaw aa --public-addr 127.0.0.1:7139 2024-09-16T03:42:53.822 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/mon-seesaw 2024-09-16T03:42:53.822 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T03:42:53.822 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=aa 2024-09-16T03:42:53.822 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T03:42:53.822 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/mon-seesaw/aa 2024-09-16T03:42:53.822 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id aa --mkfs --mon-data=td/mon-seesaw/aa --run-dir=td/mon-seesaw --public-addr 127.0.0.1:7139 2024-09-16T03:42:54.271 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T03:42:54.271 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:42:54.271 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:42:54.272 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:42:54.272 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:42:54.272 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.102374 2024-09-16T03:42:54.272 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.102374/$cluster-$name.asok' 2024-09-16T03:42:54.273 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id aa --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/mon-seesaw/aa '--log-file=td/mon-seesaw/$name.log' '--admin-socket=/tmp/ceph-asok.102374/$cluster-$name.asok' --mon-cluster-log-file=td/mon-seesaw/log --run-dir=td/mon-seesaw '--pid-file=td/mon-seesaw/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr 127.0.0.1:7139 2024-09-16T03:42:54.475 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T03:42:54.476 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon aa fsid 2024-09-16T03:42:54.476 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:42:54.476 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=aa 2024-09-16T03:42:54.476 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T03:42:54.477 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T03:42:54.477 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.aa 2024-09-16T03:42:54.477 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.aa 2024-09-16T03:42:54.477 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.aa ']' 2024-09-16T03:42:54.477 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:42:54.477 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:42:54.477 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.102374 2024-09-16T03:42:54.477 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.102374/ceph-mon.aa.asok 2024-09-16T03:42:54.478 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:42:54.478 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.102374/ceph-mon.aa.asok config get fsid 2024-09-16T03:42:54.597 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon aa mon_host 2024-09-16T03:42:54.597 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:42:54.598 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=aa 2024-09-16T03:42:54.598 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T03:42:54.598 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T03:42:54.599 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.aa 2024-09-16T03:42:54.599 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.aa 2024-09-16T03:42:54.599 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.aa ']' 2024-09-16T03:42:54.599 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:42:54.599 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:42:54.599 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.102374 2024-09-16T03:42:54.599 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.102374/ceph-mon.aa.asok 2024-09-16T03:42:54.599 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:42:54.599 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.102374/ceph-mon.aa.asok config get mon_host 2024-09-16T03:42:54.709 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-seesaw.sh:33: TEST_mon_seesaw: run_mgr td/mon-seesaw x 2024-09-16T03:42:54.709 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/mon-seesaw 2024-09-16T03:42:54.709 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2024-09-16T03:42:54.709 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2024-09-16T03:42:54.709 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2024-09-16T03:42:54.709 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/mon-seesaw/x 2024-09-16T03:42:54.709 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2024-09-16T03:42:55.604 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2024-09-16T03:42:55.604 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:42:55.604 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:42:55.605 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:42:55.605 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:42:55.605 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.102374 2024-09-16T03:42:55.605 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.102374/$cluster-$name.asok' 2024-09-16T03:42:55.605 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T03:42:55.607 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/mon-seesaw/x '--log-file=td/mon-seesaw/$name.log' '--admin-socket=/tmp/ceph-asok.102374/$cluster-$name.asok' --run-dir=td/mon-seesaw '--pid-file=td/mon-seesaw/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T03:42:55.640 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-seesaw.sh:34: TEST_mon_seesaw: run_osd td/mon-seesaw 0 2024-09-16T03:42:55.640 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/mon-seesaw 2024-09-16T03:42:55.640 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T03:42:55.641 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2024-09-16T03:42:55.641 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T03:42:55.641 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/mon-seesaw/0 2024-09-16T03:42:55.641 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=4bfeedcc-ee18-4c5d-bec3-b7e1842c7798 --auth-supported=none --mon-host=127.0.0.1:7139 ' 2024-09-16T03:42:55.641 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T03:42:55.641 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T03:42:55.641 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T03:42:55.641 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/mon-seesaw/0' 2024-09-16T03:42:55.641 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/mon-seesaw/0/journal' 2024-09-16T03:42:55.641 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T03:42:55.641 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T03:42:55.641 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/mon-seesaw' 2024-09-16T03:42:55.642 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T03:42:55.642 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:42:55.642 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:42:55.642 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:42:55.642 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:42:55.642 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.102374 2024-09-16T03:42:55.642 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.102374/$cluster-$name.asok' 2024-09-16T03:42:55.642 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.102374/$cluster-$name.asok' 2024-09-16T03:42:55.642 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T03:42:55.643 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T03:42:55.643 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T03:42:55.643 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/mon-seesaw/$name.log' 2024-09-16T03:42:55.643 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/mon-seesaw/$name.pid' 2024-09-16T03:42:55.643 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T03:42:55.643 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T03:42:55.643 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T03:42:55.643 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T03:42:55.643 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T03:42:55.643 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T03:42:55.643 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/mon-seesaw/0 2024-09-16T03:42:55.643 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T03:42:55.644 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=b6a368f2-2b53-4f1b-8fd7-ca4688bcd7e4 2024-09-16T03:42:55.644 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 b6a368f2-2b53-4f1b-8fd7-ca4688bcd7e4' 2024-09-16T03:42:55.644 INFO:tasks.workunit.client.0.smithi096.stdout:add osd0 b6a368f2-2b53-4f1b-8fd7-ca4688bcd7e4 2024-09-16T03:42:55.644 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T03:42:55.658 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQA/qedmOlRYJxAAnFXnTk8EGaX0dWpHvjTsIQ== 2024-09-16T03:42:55.658 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQA/qedmOlRYJxAAnFXnTk8EGaX0dWpHvjTsIQ=="}' 2024-09-16T03:42:55.658 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new b6a368f2-2b53-4f1b-8fd7-ca4688bcd7e4 -i td/mon-seesaw/0/new.json 2024-09-16T03:42:55.945 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T03:42:55.960 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/mon-seesaw/0/new.json 2024-09-16T03:42:55.960 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=4bfeedcc-ee18-4c5d-bec3-b7e1842c7798 --auth-supported=none --mon-host=127.0.0.1:7139 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/mon-seesaw/0 --osd-journal=td/mon-seesaw/0/journal --chdir= --run-dir=td/mon-seesaw '--admin-socket=/tmp/ceph-asok.102374/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/mon-seesaw/$name.log' '--pid-file=td/mon-seesaw/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQA/qedmOlRYJxAAnFXnTk8EGaX0dWpHvjTsIQ== --osd-uuid b6a368f2-2b53-4f1b-8fd7-ca4688bcd7e4 2024-09-16T03:42:55.987 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:42:55.986+0000 7f4d3d5667c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:42:55.989 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:42:55.990+0000 7f4d3d5667c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:42:55.990 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:42:55.990+0000 7f4d3d5667c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:42:55.991 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:42:55.990+0000 7f4d3d5667c0 -1 bdev(0x55c086a13c00 td/mon-seesaw/0/block) open stat got: (1) Operation not permitted 2024-09-16T03:42:55.991 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:42:55.990+0000 7f4d3d5667c0 -1 bluestore(td/mon-seesaw/0) _read_fsid unparsable uuid 2024-09-16T03:43:01.929 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/mon-seesaw/0/keyring 2024-09-16T03:43:01.929 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T03:43:01.931 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2024-09-16T03:43:01.931 INFO:tasks.workunit.client.0.smithi096.stdout:adding osd0 key to auth repository 2024-09-16T03:43:01.931 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/mon-seesaw/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T03:43:02.488 INFO:tasks.workunit.client.0.smithi096.stdout:start osd.0 2024-09-16T03:43:02.489 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2024-09-16T03:43:02.489 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=4bfeedcc-ee18-4c5d-bec3-b7e1842c7798 --auth-supported=none --mon-host=127.0.0.1:7139 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/mon-seesaw/0 --osd-journal=td/mon-seesaw/0/journal --chdir= --run-dir=td/mon-seesaw '--admin-socket=/tmp/ceph-asok.102374/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/mon-seesaw/$name.log' '--pid-file=td/mon-seesaw/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T03:43:02.489 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T03:43:02.489 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T03:43:02.489 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T03:43:02.513 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:43:02.514+0000 7f14620467c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:43:02.525 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:43:02.526+0000 7f14620467c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:43:02.526 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:43:02.526+0000 7f14620467c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:43:02.897 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2024-09-16T03:43:02.897 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:43:02.897 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2024-09-16T03:43:02.897 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:43:02.897 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:43:02.898 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:43:02.898 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:43:02.898 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T03:43:02.898 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:43:02.898 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:43:03.355 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:43:03.558 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:43:03.558+0000 7f14620467c0 -1 Falling back to public interface 2024-09-16T03:43:04.358 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:43:04.470 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:43:04.470 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T03:43:04.471 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T03:43:04.471 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:43:04.471 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:43:04.822 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:43:05.823 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:43:05.823 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:43:05.823 INFO:tasks.workunit.client.0.smithi096.stdout:2 2024-09-16T03:43:05.824 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T03:43:05.824 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:43:05.824 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:43:06.224 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:43:06.214+0000 7f14620467c0 -1 osd.0 0 log_to_monitors true 2024-09-16T03:43:06.239 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:43:07.241 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:43:07.241 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:43:07.241 INFO:tasks.workunit.client.0.smithi096.stdout:3 2024-09-16T03:43:07.242 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T03:43:07.242 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:43:07.242 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:43:07.680 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:43:08.682 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:43:08.682 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:43:08.682 INFO:tasks.workunit.client.0.smithi096.stdout:4 2024-09-16T03:43:08.683 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T03:43:08.683 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:43:08.683 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:43:09.150 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:43:10.152 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:43:10.152 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:43:10.152 INFO:tasks.workunit.client.0.smithi096.stdout:5 2024-09-16T03:43:10.153 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T03:43:10.153 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:43:10.153 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:43:10.642 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:43:11.643 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:43:11.644 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:43:11.644 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T03:43:11.644 INFO:tasks.workunit.client.0.smithi096.stdout:6 2024-09-16T03:43:11.644 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:43:11.644 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:43:12.147 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:43:13.148 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:43:13.148 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:43:13.149 INFO:tasks.workunit.client.0.smithi096.stdout:7 2024-09-16T03:43:13.149 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T03:43:13.149 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:43:13.149 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:43:13.618 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:43:14.619 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:43:14.619 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:43:14.620 INFO:tasks.workunit.client.0.smithi096.stdout:8 2024-09-16T03:43:14.620 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T03:43:14.620 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:43:14.620 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:43:15.175 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:43:16.176 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:43:16.176 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:43:16.177 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T03:43:16.177 INFO:tasks.workunit.client.0.smithi096.stdout:9 2024-09-16T03:43:16.177 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:43:16.177 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:43:16.621 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:43:17.624 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:43:17.624 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:43:17.624 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T03:43:17.624 INFO:tasks.workunit.client.0.smithi096.stdout:10 2024-09-16T03:43:17.625 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:43:17.625 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:43:18.481 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:43:19.482 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:43:19.482 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:43:19.483 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T03:43:19.483 INFO:tasks.workunit.client.0.smithi096.stdout:11 2024-09-16T03:43:19.483 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:43:19.483 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:43:20.271 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:43:21.272 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:43:21.272 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:43:21.273 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T03:43:21.273 INFO:tasks.workunit.client.0.smithi096.stdout:12 2024-09-16T03:43:21.273 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:43:21.273 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:43:22.040 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:43:23.042 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:43:23.042 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:43:23.042 INFO:tasks.workunit.client.0.smithi096.stdout:13 2024-09-16T03:43:23.043 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T03:43:23.043 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:43:23.044 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:43:23.568 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:43:24.570 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:43:24.571 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:43:24.571 INFO:tasks.workunit.client.0.smithi096.stdout:14 2024-09-16T03:43:24.571 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T03:43:24.571 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:43:24.572 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:43:25.645 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:43:26.647 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:43:26.647 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:43:26.647 INFO:tasks.workunit.client.0.smithi096.stdout:15 2024-09-16T03:43:26.648 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T03:43:26.648 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:43:26.648 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:43:27.283 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:43:28.285 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:43:28.285 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:43:28.286 INFO:tasks.workunit.client.0.smithi096.stdout:16 2024-09-16T03:43:28.286 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T03:43:28.286 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:43:28.286 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:43:28.785 INFO:tasks.workunit.client.0.smithi096.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/1975681623,v1:127.0.0.1:6803/1975681623] [v2:127.0.0.1:6804/1975681623,v1:127.0.0.1:6805/1975681623] exists,up b6a368f2-2b53-4f1b-8fd7-ca4688bcd7e4 2024-09-16T03:43:28.788 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:43:28.788 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:43:28.788 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:43:28.788 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-seesaw.sh:35: TEST_mon_seesaw: run_osd td/mon-seesaw 1 2024-09-16T03:43:28.789 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/mon-seesaw 2024-09-16T03:43:28.789 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T03:43:28.789 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2024-09-16T03:43:28.789 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T03:43:28.789 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/mon-seesaw/1 2024-09-16T03:43:28.789 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=4bfeedcc-ee18-4c5d-bec3-b7e1842c7798 --auth-supported=none --mon-host=127.0.0.1:7139 ' 2024-09-16T03:43:28.789 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T03:43:28.789 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T03:43:28.790 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T03:43:28.790 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/mon-seesaw/1' 2024-09-16T03:43:28.790 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/mon-seesaw/1/journal' 2024-09-16T03:43:28.790 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T03:43:28.790 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T03:43:28.790 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/mon-seesaw' 2024-09-16T03:43:28.790 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T03:43:28.790 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:43:28.790 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:43:28.791 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:43:28.791 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:43:28.791 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.102374 2024-09-16T03:43:28.791 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.102374/$cluster-$name.asok' 2024-09-16T03:43:28.791 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.102374/$cluster-$name.asok' 2024-09-16T03:43:28.791 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T03:43:28.791 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T03:43:28.791 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T03:43:28.791 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/mon-seesaw/$name.log' 2024-09-16T03:43:28.792 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/mon-seesaw/$name.pid' 2024-09-16T03:43:28.792 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T03:43:28.792 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T03:43:28.792 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T03:43:28.792 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T03:43:28.792 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T03:43:28.792 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T03:43:28.792 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/mon-seesaw/1 2024-09-16T03:43:28.793 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T03:43:28.793 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=a11713e1-bcf6-4561-91ea-b6f5465a5db0 2024-09-16T03:43:28.793 INFO:tasks.workunit.client.0.smithi096.stdout:add osd1 a11713e1-bcf6-4561-91ea-b6f5465a5db0 2024-09-16T03:43:28.794 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 a11713e1-bcf6-4561-91ea-b6f5465a5db0' 2024-09-16T03:43:28.794 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T03:43:28.811 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBgqedmjYd6MBAABXJtQ1YuiCPu8JYY9wdaCA== 2024-09-16T03:43:28.812 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBgqedmjYd6MBAABXJtQ1YuiCPu8JYY9wdaCA=="}' 2024-09-16T03:43:28.812 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new a11713e1-bcf6-4561-91ea-b6f5465a5db0 -i td/mon-seesaw/1/new.json 2024-09-16T03:43:29.293 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T03:43:29.309 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/mon-seesaw/1/new.json 2024-09-16T03:43:29.310 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=4bfeedcc-ee18-4c5d-bec3-b7e1842c7798 --auth-supported=none --mon-host=127.0.0.1:7139 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/mon-seesaw/1 --osd-journal=td/mon-seesaw/1/journal --chdir= --run-dir=td/mon-seesaw '--admin-socket=/tmp/ceph-asok.102374/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/mon-seesaw/$name.log' '--pid-file=td/mon-seesaw/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBgqedmjYd6MBAABXJtQ1YuiCPu8JYY9wdaCA== --osd-uuid a11713e1-bcf6-4561-91ea-b6f5465a5db0 2024-09-16T03:43:29.342 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:43:29.341+0000 7fe717f737c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:43:29.355 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:43:29.353+0000 7fe717f737c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:43:29.356 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:43:29.357+0000 7fe717f737c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:43:29.356 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:43:29.357+0000 7fe717f737c0 -1 bdev(0x5623566b3c00 td/mon-seesaw/1/block) open stat got: (1) Operation not permitted 2024-09-16T03:43:29.356 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:43:29.357+0000 7fe717f737c0 -1 bluestore(td/mon-seesaw/1) _read_fsid unparsable uuid 2024-09-16T03:43:35.556 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/mon-seesaw/1/keyring 2024-09-16T03:43:35.556 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T03:43:35.557 INFO:tasks.workunit.client.0.smithi096.stdout:adding osd1 key to auth repository 2024-09-16T03:43:35.557 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2024-09-16T03:43:35.557 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/mon-seesaw/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T03:43:36.121 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2024-09-16T03:43:36.121 INFO:tasks.workunit.client.0.smithi096.stdout:start osd.1 2024-09-16T03:43:36.122 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T03:43:36.122 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=4bfeedcc-ee18-4c5d-bec3-b7e1842c7798 --auth-supported=none --mon-host=127.0.0.1:7139 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/mon-seesaw/1 --osd-journal=td/mon-seesaw/1/journal --chdir= --run-dir=td/mon-seesaw '--admin-socket=/tmp/ceph-asok.102374/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/mon-seesaw/$name.log' '--pid-file=td/mon-seesaw/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T03:43:36.122 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T03:43:36.122 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T03:43:36.151 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:43:36.153+0000 7f85697187c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:43:36.167 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:43:36.169+0000 7f85697187c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:43:36.169 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:43:36.169+0000 7f85697187c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:43:36.555 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2024-09-16T03:43:36.555 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:43:36.555 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2024-09-16T03:43:36.556 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:43:36.556 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:43:36.556 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:43:36.556 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:43:36.556 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T03:43:36.556 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:43:36.556 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:43:36.997 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:43:37.906 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:43:37.905+0000 7f85697187c0 -1 Falling back to public interface 2024-09-16T03:43:37.999 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:43:37.999 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:43:37.999 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T03:43:38.000 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T03:43:38.000 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:43:38.000 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:43:38.481 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:43:39.483 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:43:39.483 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:43:39.483 INFO:tasks.workunit.client.0.smithi096.stdout:2 2024-09-16T03:43:39.484 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T03:43:39.484 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:43:39.484 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:43:39.941 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:43:40.935 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:43:40.933+0000 7f85697187c0 -1 osd.1 0 log_to_monitors true 2024-09-16T03:43:40.942 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:43:40.942 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:43:40.943 INFO:tasks.workunit.client.0.smithi096.stdout:3 2024-09-16T03:43:40.943 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T03:43:40.943 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:43:40.943 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:43:41.428 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:43:42.429 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:43:42.430 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:43:42.430 INFO:tasks.workunit.client.0.smithi096.stdout:4 2024-09-16T03:43:42.430 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T03:43:42.430 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:43:42.431 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:43:42.956 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:43:43.958 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:43:43.958 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:43:43.958 INFO:tasks.workunit.client.0.smithi096.stdout:5 2024-09-16T03:43:43.959 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T03:43:43.959 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:43:43.959 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:43:44.398 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:43:45.400 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:43:45.400 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:43:45.400 INFO:tasks.workunit.client.0.smithi096.stdout:6 2024-09-16T03:43:45.401 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T03:43:45.401 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:43:45.401 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:43:45.863 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:43:46.865 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:43:46.865 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:43:46.865 INFO:tasks.workunit.client.0.smithi096.stdout:7 2024-09-16T03:43:46.866 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T03:43:46.866 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:43:46.866 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:43:47.330 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:43:48.332 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:43:48.332 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:43:48.332 INFO:tasks.workunit.client.0.smithi096.stdout:8 2024-09-16T03:43:48.333 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T03:43:48.333 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:43:48.333 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:43:48.862 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:43:49.864 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:43:49.864 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:43:49.864 INFO:tasks.workunit.client.0.smithi096.stdout:9 2024-09-16T03:43:49.865 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T03:43:49.865 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:43:49.865 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:43:50.335 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:43:51.336 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:43:51.336 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:43:51.336 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T03:43:51.337 INFO:tasks.workunit.client.0.smithi096.stdout:10 2024-09-16T03:43:51.337 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:43:51.337 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:43:51.853 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:43:52.855 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:43:52.855 INFO:tasks.workunit.client.0.smithi096.stdout:11 2024-09-16T03:43:52.856 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:43:52.856 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T03:43:52.856 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:43:52.856 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:43:53.760 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:43:54.762 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:43:54.763 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:43:54.763 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T03:43:54.763 INFO:tasks.workunit.client.0.smithi096.stdout:12 2024-09-16T03:43:54.764 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:43:54.764 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:43:55.470 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:43:56.472 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:43:56.472 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:43:56.472 INFO:tasks.workunit.client.0.smithi096.stdout:13 2024-09-16T03:43:56.473 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T03:43:56.473 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:43:56.473 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:43:57.495 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:43:58.497 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:43:58.497 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:43:58.497 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T03:43:58.497 INFO:tasks.workunit.client.0.smithi096.stdout:14 2024-09-16T03:43:58.498 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:43:58.498 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:43:59.510 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:44:00.512 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:44:00.512 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:44:00.512 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T03:44:00.512 INFO:tasks.workunit.client.0.smithi096.stdout:15 2024-09-16T03:44:00.513 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:44:00.513 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:44:01.218 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:44:02.220 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:44:02.220 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:44:02.221 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T03:44:02.221 INFO:tasks.workunit.client.0.smithi096.stdout:16 2024-09-16T03:44:02.221 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:44:02.222 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:44:02.961 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:44:03.963 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:44:03.963 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:44:03.963 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T03:44:03.964 INFO:tasks.workunit.client.0.smithi096.stdout:17 2024-09-16T03:44:03.964 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:44:03.964 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:44:04.395 INFO:tasks.workunit.client.0.smithi096.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/2158410390,v1:127.0.0.1:6811/2158410390] [v2:127.0.0.1:6812/2158410390,v1:127.0.0.1:6813/2158410390] exists,up a11713e1-bcf6-4561-91ea-b6f5465a5db0 2024-09-16T03:44:04.398 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:44:04.398 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:44:04.398 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:44:04.398 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-seesaw.sh:36: TEST_mon_seesaw: run_osd td/mon-seesaw 2 2024-09-16T03:44:04.398 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/mon-seesaw 2024-09-16T03:44:04.398 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T03:44:04.398 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2024-09-16T03:44:04.398 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T03:44:04.398 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/mon-seesaw/2 2024-09-16T03:44:04.398 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=4bfeedcc-ee18-4c5d-bec3-b7e1842c7798 --auth-supported=none --mon-host=127.0.0.1:7139 ' 2024-09-16T03:44:04.398 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T03:44:04.399 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T03:44:04.399 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T03:44:04.399 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/mon-seesaw/2' 2024-09-16T03:44:04.399 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/mon-seesaw/2/journal' 2024-09-16T03:44:04.399 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T03:44:04.399 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T03:44:04.399 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/mon-seesaw' 2024-09-16T03:44:04.399 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T03:44:04.399 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:44:04.399 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:44:04.399 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:44:04.399 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:44:04.400 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.102374 2024-09-16T03:44:04.400 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.102374/$cluster-$name.asok' 2024-09-16T03:44:04.401 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.102374/$cluster-$name.asok' 2024-09-16T03:44:04.401 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T03:44:04.401 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T03:44:04.401 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T03:44:04.401 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/mon-seesaw/$name.log' 2024-09-16T03:44:04.401 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/mon-seesaw/$name.pid' 2024-09-16T03:44:04.401 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T03:44:04.401 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T03:44:04.402 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T03:44:04.402 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T03:44:04.402 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T03:44:04.402 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T03:44:04.402 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/mon-seesaw/2 2024-09-16T03:44:04.438 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T03:44:04.439 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=cd4027b4-c864-491d-8a43-16c880048c2a 2024-09-16T03:44:04.439 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 cd4027b4-c864-491d-8a43-16c880048c2a' 2024-09-16T03:44:04.439 INFO:tasks.workunit.client.0.smithi096.stdout:add osd2 cd4027b4-c864-491d-8a43-16c880048c2a 2024-09-16T03:44:04.439 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T03:44:04.459 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCEqedmuoyCGxAA74R8/Ekaq7ObPSqelXTYMw== 2024-09-16T03:44:04.459 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCEqedmuoyCGxAA74R8/Ekaq7ObPSqelXTYMw=="}' 2024-09-16T03:44:04.460 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new cd4027b4-c864-491d-8a43-16c880048c2a -i td/mon-seesaw/2/new.json 2024-09-16T03:44:04.978 INFO:tasks.workunit.client.0.smithi096.stdout:2 2024-09-16T03:44:04.994 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/mon-seesaw/2/new.json 2024-09-16T03:44:04.995 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=4bfeedcc-ee18-4c5d-bec3-b7e1842c7798 --auth-supported=none --mon-host=127.0.0.1:7139 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/mon-seesaw/2 --osd-journal=td/mon-seesaw/2/journal --chdir= --run-dir=td/mon-seesaw '--admin-socket=/tmp/ceph-asok.102374/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/mon-seesaw/$name.log' '--pid-file=td/mon-seesaw/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCEqedmuoyCGxAA74R8/Ekaq7ObPSqelXTYMw== --osd-uuid cd4027b4-c864-491d-8a43-16c880048c2a 2024-09-16T03:44:05.020 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:44:05.021+0000 7effc866d7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:44:05.022 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:44:05.021+0000 7effc866d7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:44:05.023 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:44:05.025+0000 7effc866d7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:44:05.024 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:44:05.025+0000 7effc866d7c0 -1 bdev(0x5596d4561c00 td/mon-seesaw/2/block) open stat got: (1) Operation not permitted 2024-09-16T03:44:05.024 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:44:05.025+0000 7effc866d7c0 -1 bluestore(td/mon-seesaw/2) _read_fsid unparsable uuid 2024-09-16T03:44:10.855 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/mon-seesaw/2/keyring 2024-09-16T03:44:10.855 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T03:44:10.856 INFO:tasks.workunit.client.0.smithi096.stdout:adding osd2 key to auth repository 2024-09-16T03:44:10.856 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2024-09-16T03:44:10.856 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/mon-seesaw/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T03:44:11.422 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2024-09-16T03:44:11.422 INFO:tasks.workunit.client.0.smithi096.stdout:start osd.2 2024-09-16T03:44:11.423 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=4bfeedcc-ee18-4c5d-bec3-b7e1842c7798 --auth-supported=none --mon-host=127.0.0.1:7139 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/mon-seesaw/2 --osd-journal=td/mon-seesaw/2/journal --chdir= --run-dir=td/mon-seesaw '--admin-socket=/tmp/ceph-asok.102374/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/mon-seesaw/$name.log' '--pid-file=td/mon-seesaw/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T03:44:11.423 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T03:44:11.423 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T03:44:11.423 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T03:44:11.451 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:44:11.453+0000 7f92090db7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:44:11.480 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:44:11.481+0000 7f92090db7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:44:11.482 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:44:11.481+0000 7f92090db7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:44:11.899 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2024-09-16T03:44:11.899 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:44:11.900 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2024-09-16T03:44:11.900 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:44:11.900 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T03:44:11.900 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:44:11.900 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:44:11.900 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:44:11.901 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:44:11.901 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:44:12.352 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:44:12.482 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:44:12.481+0000 7f92090db7c0 -1 Falling back to public interface 2024-09-16T03:44:13.354 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:44:13.354 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:44:13.354 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T03:44:13.355 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T03:44:13.355 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:44:13.355 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:44:13.767 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:44:14.769 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:44:14.769 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:44:14.769 INFO:tasks.workunit.client.0.smithi096.stdout:2 2024-09-16T03:44:14.770 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T03:44:14.770 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:44:14.770 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:44:15.229 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:44:15.278 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:44:15.276+0000 7f92090db7c0 -1 osd.2 0 log_to_monitors true 2024-09-16T03:44:16.230 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:44:16.230 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:44:16.230 INFO:tasks.workunit.client.0.smithi096.stdout:3 2024-09-16T03:44:16.231 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T03:44:16.231 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:44:16.231 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:44:16.659 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:44:17.661 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:44:17.662 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:44:17.662 INFO:tasks.workunit.client.0.smithi096.stdout:4 2024-09-16T03:44:17.663 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T03:44:17.663 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:44:17.663 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:44:18.145 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:44:19.147 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:44:19.148 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:44:19.148 INFO:tasks.workunit.client.0.smithi096.stdout:5 2024-09-16T03:44:19.149 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T03:44:19.149 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:44:19.149 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:44:19.575 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:44:20.577 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:44:20.577 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:44:20.578 INFO:tasks.workunit.client.0.smithi096.stdout:6 2024-09-16T03:44:20.578 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T03:44:20.578 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:44:20.578 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:44:21.086 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:44:22.087 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:44:22.088 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:44:22.088 INFO:tasks.workunit.client.0.smithi096.stdout:7 2024-09-16T03:44:22.088 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T03:44:22.089 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:44:22.089 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:44:22.543 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:44:23.545 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:44:23.545 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:44:23.545 INFO:tasks.workunit.client.0.smithi096.stdout:8 2024-09-16T03:44:23.546 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T03:44:23.546 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:44:23.546 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:44:24.068 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:44:25.069 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:44:25.069 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:44:25.069 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T03:44:25.070 INFO:tasks.workunit.client.0.smithi096.stdout:9 2024-09-16T03:44:25.070 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:44:25.070 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:44:25.579 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:44:26.581 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:44:26.581 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:44:26.582 INFO:tasks.workunit.client.0.smithi096.stdout:10 2024-09-16T03:44:26.582 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T03:44:26.582 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:44:26.582 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:44:27.101 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:44:28.104 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:44:28.105 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:44:28.105 INFO:tasks.workunit.client.0.smithi096.stdout:11 2024-09-16T03:44:28.105 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T03:44:28.105 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:44:28.106 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:44:28.789 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:44:29.790 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:44:29.790 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:44:29.790 INFO:tasks.workunit.client.0.smithi096.stdout:12 2024-09-16T03:44:29.791 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T03:44:29.791 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:44:29.791 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:44:30.604 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:44:31.605 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:44:31.605 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:44:31.606 INFO:tasks.workunit.client.0.smithi096.stdout:13 2024-09-16T03:44:31.606 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T03:44:31.606 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:44:31.606 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:44:32.390 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:44:33.392 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:44:33.392 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:44:33.392 INFO:tasks.workunit.client.0.smithi096.stdout:14 2024-09-16T03:44:33.392 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T03:44:33.393 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:44:33.393 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:44:34.368 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:44:35.369 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:44:35.370 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:44:35.370 INFO:tasks.workunit.client.0.smithi096.stdout:15 2024-09-16T03:44:35.370 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T03:44:35.371 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:44:35.371 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:44:36.098 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:44:37.100 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:44:37.100 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:44:37.100 INFO:tasks.workunit.client.0.smithi096.stdout:16 2024-09-16T03:44:37.101 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T03:44:37.101 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:44:37.101 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:44:37.849 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:44:38.850 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:44:38.851 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:44:38.851 INFO:tasks.workunit.client.0.smithi096.stdout:17 2024-09-16T03:44:38.851 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T03:44:38.852 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:44:38.852 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:44:39.318 INFO:tasks.workunit.client.0.smithi096.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/1140161659,v1:127.0.0.1:6819/1140161659] [v2:127.0.0.1:6820/1140161659,v1:127.0.0.1:6821/1140161659] exists,up cd4027b4-c864-491d-8a43-16c880048c2a 2024-09-16T03:44:39.319 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:44:39.320 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:44:39.320 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:44:39.320 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-seesaw.sh:38: TEST_mon_seesaw: wait_for_quorum 300 1 2024-09-16T03:44:39.320 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1046: wait_for_quorum: local timeout=300 2024-09-16T03:44:39.320 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1047: wait_for_quorum: local quorumsize=1 2024-09-16T03:44:39.320 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1049: wait_for_quorum: [[ -z 300 ]] 2024-09-16T03:44:39.320 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1053: wait_for_quorum: [[ -z 1 ]] 2024-09-16T03:44:39.320 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1058: wait_for_quorum: no_quorum=1 2024-09-16T03:44:39.320 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1059: wait_for_quorum: date +%s 2024-09-16T03:44:39.321 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1059: wait_for_quorum: wait_until=1726458579 2024-09-16T03:44:39.321 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2024-09-16T03:44:39.321 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1726458279 -lt 1726458579 ]] 2024-09-16T03:44:39.321 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 1' 2024-09-16T03:44:39.322 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 300 ceph quorum_status --format=json 2024-09-16T03:44:39.943 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2024-09-16T03:44:39.943 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":3,"quorum":[0],"quorum_names":["aa"],"quorum_leader_name":"aa","quorum_age":105,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4bfeedcc-ee18-4c5d-bec3-b7e1842c7798","modified":"2024-09-16T03:42:53.845323Z","created":"2024-09-16T03:42:53.845323Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"aa","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7139","nonce":0}]},"addr":"127.0.0.1:7139/0","public_addr":"127.0.0.1:7139/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:44:39.943 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":3,"quorum":[0],"quorum_names":["aa"],"quorum_leader_name":"aa","quorum_age":105,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4bfeedcc-ee18-4c5d-bec3-b7e1842c7798","modified":"2024-09-16T03:42:53.845323Z","created":"2024-09-16T03:42:53.845323Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders:' '":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks:' '":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"aa","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7139","nonce":0}]},"addr":"127.0.0.1:7139/0","public_addr":"127.0.0.1:7139/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:44:39.943 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 1' 2024-09-16T03:44:39.973 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=true 2024-09-16T03:44:39.973 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ true == \t\r\u\e ]] 2024-09-16T03:44:39.973 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: wait_for_quorum: no_quorum=0 2024-09-16T03:44:39.973 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1066: wait_for_quorum: break 2024-09-16T03:44:39.973 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: return 0 2024-09-16T03:44:39.973 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-seesaw.sh:41: TEST_mon_seesaw: run_mon td/mon-seesaw bb --public-addr 127.0.0.1:7141 2024-09-16T03:44:39.973 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/mon-seesaw 2024-09-16T03:44:39.973 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T03:44:39.973 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=bb 2024-09-16T03:44:39.974 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T03:44:39.974 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/mon-seesaw/bb 2024-09-16T03:44:39.974 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id bb --mkfs --mon-data=td/mon-seesaw/bb --run-dir=td/mon-seesaw --public-addr 127.0.0.1:7141 2024-09-16T03:44:40.496 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T03:44:40.496 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:44:40.497 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:44:40.497 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:44:40.497 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:44:40.497 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.102374 2024-09-16T03:44:40.497 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.102374/$cluster-$name.asok' 2024-09-16T03:44:40.497 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id bb --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/mon-seesaw/bb '--log-file=td/mon-seesaw/$name.log' '--admin-socket=/tmp/ceph-asok.102374/$cluster-$name.asok' --mon-cluster-log-file=td/mon-seesaw/log --run-dir=td/mon-seesaw '--pid-file=td/mon-seesaw/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr 127.0.0.1:7141 2024-09-16T03:44:40.681 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T03:44:40.682 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon bb fsid 2024-09-16T03:44:40.682 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:44:40.683 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=bb 2024-09-16T03:44:40.683 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T03:44:40.683 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T03:44:40.683 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.bb 2024-09-16T03:44:40.683 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.bb 2024-09-16T03:44:40.683 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.bb ']' 2024-09-16T03:44:40.684 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:44:40.684 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:44:40.684 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.102374 2024-09-16T03:44:40.684 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.102374/ceph-mon.bb.asok 2024-09-16T03:44:40.684 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:44:40.684 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.102374/ceph-mon.bb.asok config get fsid 2024-09-16T03:44:40.801 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon bb mon_host 2024-09-16T03:44:40.802 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:44:40.802 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=bb 2024-09-16T03:44:40.802 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T03:44:40.802 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T03:44:40.803 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.bb 2024-09-16T03:44:40.803 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.bb 2024-09-16T03:44:40.803 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.bb ']' 2024-09-16T03:44:40.803 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:44:40.803 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:44:40.803 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.102374 2024-09-16T03:44:40.803 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.102374/ceph-mon.bb.asok 2024-09-16T03:44:40.804 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:44:40.804 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.102374/ceph-mon.bb.asok config get mon_host 2024-09-16T03:44:40.914 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-seesaw.sh:42: TEST_mon_seesaw: CEPH_ARGS='--fsid=4bfeedcc-ee18-4c5d-bec3-b7e1842c7798 --auth-supported=none --mon-host=127.0.0.1:7139,127.0.0.1:7141' 2024-09-16T03:44:40.915 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-seesaw.sh:43: TEST_mon_seesaw: wait_for_quorum 300 2 2024-09-16T03:44:40.915 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1046: wait_for_quorum: local timeout=300 2024-09-16T03:44:40.915 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1047: wait_for_quorum: local quorumsize=2 2024-09-16T03:44:40.915 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1049: wait_for_quorum: [[ -z 300 ]] 2024-09-16T03:44:40.915 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1053: wait_for_quorum: [[ -z 2 ]] 2024-09-16T03:44:40.915 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1058: wait_for_quorum: no_quorum=1 2024-09-16T03:44:40.915 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1059: wait_for_quorum: date +%s 2024-09-16T03:44:40.915 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1059: wait_for_quorum: wait_until=1726458580 2024-09-16T03:44:40.916 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2024-09-16T03:44:40.918 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1726458280 -lt 1726458580 ]] 2024-09-16T03:44:40.918 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 2' 2024-09-16T03:44:40.919 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 300 ceph quorum_status --format=json 2024-09-16T03:44:50.526 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2024-09-16T03:44:50.527 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":8,"quorum":[0,1],"quorum_names":["aa","bb"],"quorum_leader_name":"aa","quorum_age":4,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":2,"fsid":"4bfeedcc-ee18-4c5d-bec3-b7e1842c7798","modified":"2024-09-16T03:44:40.969916Z","created":"2024-09-16T03:42:53.845323Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"aa","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7139","nonce":0}]},"addr":"127.0.0.1:7139/0","public_addr":"127.0.0.1:7139/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"bb","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7141","nonce":0}]},"addr":"127.0.0.1:7141/0","public_addr":"127.0.0.1:7141/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:44:50.527 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 2' 2024-09-16T03:44:50.528 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":8,"quorum":[0,1],"quorum_names":["aa","bb"],"quorum_leader_name":"aa","quorum_age":4,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":2,"fsid":"4bfeedcc-ee18-4c5d-bec3-b7e1842c7798","modified":"2024-09-16T03:44:40.969916Z","created":"2024-09-16T03:42:53.845323Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders:' '":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks:' '":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"aa","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7139","nonce":0}]},"addr":"127.0.0.1:7139/0","public_addr":"127.0.0.1:7139/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"bb","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7141","nonce":0}]},"addr":"127.0.0.1:7141/0","public_addr":"127.0.0.1:7141/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:44:50.555 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=true 2024-09-16T03:44:50.555 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ true == \t\r\u\e ]] 2024-09-16T03:44:50.556 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: wait_for_quorum: no_quorum=0 2024-09-16T03:44:50.556 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1066: wait_for_quorum: break 2024-09-16T03:44:50.556 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: return 0 2024-09-16T03:44:50.556 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-seesaw.sh:46: TEST_mon_seesaw: ceph mon rm aa 2024-09-16T03:44:51.372 INFO:tasks.workunit.client.0.smithi096.stderr:mon.aa does not exist or has already been removed 2024-09-16T03:44:51.387 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-seesaw.sh:47: TEST_mon_seesaw: CEPH_ARGS='--fsid=4bfeedcc-ee18-4c5d-bec3-b7e1842c7798 --auth-supported=none --mon-host=127.0.0.1:7141' 2024-09-16T03:44:51.388 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-seesaw.sh:48: TEST_mon_seesaw: sleep 5 2024-09-16T03:44:56.390 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-seesaw.sh:49: TEST_mon_seesaw: wait_for_quorum 300 1 2024-09-16T03:44:56.390 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1046: wait_for_quorum: local timeout=300 2024-09-16T03:44:56.390 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1047: wait_for_quorum: local quorumsize=1 2024-09-16T03:44:56.390 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1049: wait_for_quorum: [[ -z 300 ]] 2024-09-16T03:44:56.390 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1053: wait_for_quorum: [[ -z 1 ]] 2024-09-16T03:44:56.390 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1058: wait_for_quorum: no_quorum=1 2024-09-16T03:44:56.390 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1059: wait_for_quorum: date +%s 2024-09-16T03:44:56.392 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1059: wait_for_quorum: wait_until=1726458596 2024-09-16T03:44:56.393 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2024-09-16T03:44:56.394 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1726458296 -lt 1726458596 ]] 2024-09-16T03:44:56.394 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 1' 2024-09-16T03:44:56.395 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 300 ceph quorum_status --format=json 2024-09-16T03:44:57.008 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2024-09-16T03:44:57.008 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":9,"quorum":[0],"quorum_names":["bb"],"quorum_leader_name":"bb","quorum_age":5,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"4bfeedcc-ee18-4c5d-bec3-b7e1842c7798","modified":"2024-09-16T03:44:50.938273Z","created":"2024-09-16T03:42:53.845323Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"0","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"bb","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7141","nonce":0}]},"addr":"127.0.0.1:7141/0","public_addr":"127.0.0.1:7141/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:44:57.009 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 1' 2024-09-16T03:44:57.009 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":9,"quorum":[0],"quorum_names":["bb"],"quorum_leader_name":"bb","quorum_age":5,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":3,"fsid":"4bfeedcc-ee18-4c5d-bec3-b7e1842c7798","modified":"2024-09-16T03:44:50.938273Z","created":"2024-09-16T03:42:53.845323Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders:' '":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks:' '":"0","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"bb","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7141","nonce":0}]},"addr":"127.0.0.1:7141/0","public_addr":"127.0.0.1:7141/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:44:57.041 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=true 2024-09-16T03:44:57.042 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ true == \t\r\u\e ]] 2024-09-16T03:44:57.042 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: wait_for_quorum: no_quorum=0 2024-09-16T03:44:57.042 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1066: wait_for_quorum: break 2024-09-16T03:44:57.042 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: return 0 2024-09-16T03:44:57.042 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-seesaw.sh:53: TEST_mon_seesaw: ceph osd pool create foo 8 2024-09-16T03:44:57.553 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'foo' already exists 2024-09-16T03:44:57.569 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-seesaw.sh:54: TEST_mon_seesaw: rados -p foo bench 1 write 2024-09-16T03:44:57.758 INFO:tasks.workunit.client.0.smithi096.stdout:hints = 1 2024-09-16T03:44:57.759 INFO:tasks.workunit.client.0.smithi096.stdout:Maintaining 16 concurrent writes of 4194304 bytes to objects of size 4194304 for up to 1 seconds or 0 objects 2024-09-16T03:44:57.759 INFO:tasks.workunit.client.0.smithi096.stdout:Object prefix: benchmark_data_smithi096_108139 2024-09-16T03:44:57.791 INFO:tasks.workunit.client.0.smithi096.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T03:44:57.792 INFO:tasks.workunit.client.0.smithi096.stdout: 0 0 0 0 0 0 - 0 2024-09-16T03:44:58.791 INFO:tasks.workunit.client.0.smithi096.stdout: 1 16 16 0 0 0 - 0 2024-09-16T03:44:59.792 INFO:tasks.workunit.client.0.smithi096.stdout: 2 12 16 4 7.99893 8 1.83531 1.67303 2024-09-16T03:45:00.792 INFO:tasks.workunit.client.0.smithi096.stdout: 3 9 16 7 9.33216 12 2.99018 2.19043 2024-09-16T03:45:01.792 INFO:tasks.workunit.client.0.smithi096.stdout: 4 3 16 13 12.9982 24 3.90944 2.92301 2024-09-16T03:45:02.792 INFO:tasks.workunit.client.0.smithi096.stdout:Total time run: 4.25301 2024-09-16T03:45:02.792 INFO:tasks.workunit.client.0.smithi096.stdout:Total writes made: 16 2024-09-16T03:45:02.793 INFO:tasks.workunit.client.0.smithi096.stdout:Write size: 4194304 2024-09-16T03:45:02.793 INFO:tasks.workunit.client.0.smithi096.stdout:Object size: 4194304 2024-09-16T03:45:02.793 INFO:tasks.workunit.client.0.smithi096.stdout:Bandwidth (MB/sec): 15.0482 2024-09-16T03:45:02.793 INFO:tasks.workunit.client.0.smithi096.stdout:Stddev Bandwidth: 10 2024-09-16T03:45:02.793 INFO:tasks.workunit.client.0.smithi096.stdout:Max bandwidth (MB/sec): 24 2024-09-16T03:45:02.793 INFO:tasks.workunit.client.0.smithi096.stdout:Min bandwidth (MB/sec): 0 2024-09-16T03:45:02.793 INFO:tasks.workunit.client.0.smithi096.stdout:Average IOPS: 3 2024-09-16T03:45:02.793 INFO:tasks.workunit.client.0.smithi096.stdout:Stddev IOPS: 2.5 2024-09-16T03:45:02.793 INFO:tasks.workunit.client.0.smithi096.stdout:Max IOPS: 6 2024-09-16T03:45:02.793 INFO:tasks.workunit.client.0.smithi096.stdout:Min IOPS: 0 2024-09-16T03:45:02.793 INFO:tasks.workunit.client.0.smithi096.stdout:Average Latency(s): 3.15149 2024-09-16T03:45:02.793 INFO:tasks.workunit.client.0.smithi096.stdout:Stddev Latency(s): 0.981541 2024-09-16T03:45:02.794 INFO:tasks.workunit.client.0.smithi096.stdout:Max latency(s): 4.25288 2024-09-16T03:45:02.794 INFO:tasks.workunit.client.0.smithi096.stdout:Min latency(s): 1.61837 2024-09-16T03:45:02.890 INFO:tasks.workunit.client.0.smithi096.stdout:Cleaning up (deleting benchmark objects) 2024-09-16T03:45:03.084 INFO:tasks.workunit.client.0.smithi096.stdout:Removed 16 objects 2024-09-16T03:45:03.084 INFO:tasks.workunit.client.0.smithi096.stdout:Clean up completed and total clean up time :0.198334 2024-09-16T03:45:03.171 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-seesaw.sh:55: TEST_mon_seesaw: wait_for_clean 2024-09-16T03:45:03.171 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1633: wait_for_clean: local cmd= 2024-09-16T03:45:03.172 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1634: wait_for_clean: local num_active_clean=-1 2024-09-16T03:45:03.172 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1635: wait_for_clean: local cur_active_clean 2024-09-16T03:45:03.173 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: get_timeout_delays 90 .1 2024-09-16T03:45:03.174 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: shopt -q -o xtrace 2024-09-16T03:45:03.174 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: echo true 2024-09-16T03:45:03.174 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: local trace=true 2024-09-16T03:45:03.174 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: true 2024-09-16T03:45:03.174 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: shopt -u -o xtrace 2024-09-16T03:45:03.293 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-09-16T03:45:03.293 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: local -a delays 2024-09-16T03:45:03.293 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1637: wait_for_clean: local -i loop=0 2024-09-16T03:45:03.293 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1639: wait_for_clean: flush_pg_stats 2024-09-16T03:45:03.293 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: local timeout=300 2024-09-16T03:45:03.293 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ceph osd ls 2024-09-16T03:45:03.771 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ids='0 2024-09-16T03:45:03.771 INFO:tasks.workunit.client.0.smithi096.stderr:1 2024-09-16T03:45:03.772 INFO:tasks.workunit.client.0.smithi096.stderr:2' 2024-09-16T03:45:03.772 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2208: flush_pg_stats: seqs= 2024-09-16T03:45:03.772 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:45:03.772 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-09-16T03:45:03.945 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=21474836505 2024-09-16T03:45:03.945 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 21474836505 2024-09-16T03:45:03.946 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836505' 2024-09-16T03:45:03.946 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:45:03.946 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-09-16T03:45:04.091 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=42949672976 2024-09-16T03:45:04.091 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 42949672976 2024-09-16T03:45:04.091 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836505 1-42949672976' 2024-09-16T03:45:04.091 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:45:04.092 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-09-16T03:45:04.244 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=60129542157 2024-09-16T03:45:04.245 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 60129542157 2024-09-16T03:45:04.245 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836505 1-42949672976 2-60129542157' 2024-09-16T03:45:04.245 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:45:04.245 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 0-21474836505 2024-09-16T03:45:04.245 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:45:04.246 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=0 2024-09-16T03:45:04.247 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 0-21474836505 2024-09-16T03:45:04.247 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:45:04.248 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=21474836505 2024-09-16T03:45:04.248 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.0 seq 21474836505' 2024-09-16T03:45:04.249 INFO:tasks.workunit.client.0.smithi096.stdout:waiting osd.0 seq 21474836505 2024-09-16T03:45:04.249 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T03:45:04.658 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836505 -lt 21474836505 2024-09-16T03:45:04.658 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:45:04.659 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 1-42949672976 2024-09-16T03:45:04.659 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:45:04.660 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=1 2024-09-16T03:45:04.661 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 1-42949672976 2024-09-16T03:45:04.661 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:45:04.662 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=42949672976 2024-09-16T03:45:04.662 INFO:tasks.workunit.client.0.smithi096.stdout:waiting osd.1 seq 42949672976 2024-09-16T03:45:04.663 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.1 seq 42949672976' 2024-09-16T03:45:04.663 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 1 2024-09-16T03:45:05.149 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 42949672976 -lt 42949672976 2024-09-16T03:45:05.149 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:45:05.150 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 2-60129542157 2024-09-16T03:45:05.150 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:45:05.152 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=2 2024-09-16T03:45:05.153 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 2-60129542157 2024-09-16T03:45:05.153 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:45:05.154 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=60129542157 2024-09-16T03:45:05.154 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.2 seq 60129542157' 2024-09-16T03:45:05.155 INFO:tasks.workunit.client.0.smithi096.stdout:waiting osd.2 seq 60129542157 2024-09-16T03:45:05.155 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 2 2024-09-16T03:45:05.577 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 60129542157 -lt 60129542157 2024-09-16T03:45:05.579 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: get_num_pgs 2024-09-16T03:45:05.579 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:45:05.579 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:45:06.142 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: test 8 == 0 2024-09-16T03:45:06.142 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:45:06.143 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:45:06.143 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:45:06.143 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:45:06.143 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:45:06.143 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:45:06.143 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:45:06.548 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=8 2024-09-16T03:45:06.549 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:45:06.549 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:45:06.549 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:45:07.084 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 8 = 8 2024-09-16T03:45:07.084 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: break 2024-09-16T03:45:07.084 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: return 0 2024-09-16T03:45:07.084 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-seesaw.sh:59: TEST_mon_seesaw: rm -rf td/mon-seesaw/aa 2024-09-16T03:45:07.085 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-seesaw.sh:63: TEST_mon_seesaw: run_mon td/mon-seesaw aa --public-addr 127.0.0.1:7142 2024-09-16T03:45:07.085 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/mon-seesaw 2024-09-16T03:45:07.085 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T03:45:07.085 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=aa 2024-09-16T03:45:07.085 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T03:45:07.085 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/mon-seesaw/aa 2024-09-16T03:45:07.085 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id aa --mkfs --mon-data=td/mon-seesaw/aa --run-dir=td/mon-seesaw --public-addr 127.0.0.1:7142 2024-09-16T03:45:07.634 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T03:45:07.635 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:45:07.635 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:45:07.635 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:45:07.635 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:45:07.635 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.102374 2024-09-16T03:45:07.635 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.102374/$cluster-$name.asok' 2024-09-16T03:45:07.636 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id aa --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/mon-seesaw/aa '--log-file=td/mon-seesaw/$name.log' '--admin-socket=/tmp/ceph-asok.102374/$cluster-$name.asok' --mon-cluster-log-file=td/mon-seesaw/log --run-dir=td/mon-seesaw '--pid-file=td/mon-seesaw/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr 127.0.0.1:7142 2024-09-16T03:45:07.847 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T03:45:07.850 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon aa fsid 2024-09-16T03:45:07.850 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:45:07.850 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=aa 2024-09-16T03:45:07.850 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T03:45:07.850 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T03:45:07.850 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.aa 2024-09-16T03:45:07.850 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.aa 2024-09-16T03:45:07.850 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.aa ']' 2024-09-16T03:45:07.850 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:45:07.850 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:45:07.851 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.102374 2024-09-16T03:45:07.851 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.102374/ceph-mon.aa.asok 2024-09-16T03:45:07.851 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:45:07.851 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.102374/ceph-mon.aa.asok config get fsid 2024-09-16T03:45:07.958 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon aa mon_host 2024-09-16T03:45:07.958 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:45:07.958 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=aa 2024-09-16T03:45:07.958 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T03:45:07.959 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T03:45:07.959 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.aa 2024-09-16T03:45:07.959 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.aa 2024-09-16T03:45:07.959 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.aa ']' 2024-09-16T03:45:07.959 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:45:07.960 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:45:07.960 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.102374 2024-09-16T03:45:07.960 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.102374/ceph-mon.aa.asok 2024-09-16T03:45:07.960 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:45:07.960 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.102374/ceph-mon.aa.asok config get mon_host 2024-09-16T03:45:08.067 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-seesaw.sh:64: TEST_mon_seesaw: CEPH_ARGS='--fsid=4bfeedcc-ee18-4c5d-bec3-b7e1842c7798 --auth-supported=none --mon-host=127.0.0.1:7142,127.0.0.1:7141' 2024-09-16T03:45:08.067 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-seesaw.sh:65: TEST_mon_seesaw: wait_for_quorum 300 2 2024-09-16T03:45:08.067 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1046: wait_for_quorum: local timeout=300 2024-09-16T03:45:08.068 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1047: wait_for_quorum: local quorumsize=2 2024-09-16T03:45:08.068 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1049: wait_for_quorum: [[ -z 300 ]] 2024-09-16T03:45:08.068 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1053: wait_for_quorum: [[ -z 2 ]] 2024-09-16T03:45:08.068 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1058: wait_for_quorum: no_quorum=1 2024-09-16T03:45:08.068 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1059: wait_for_quorum: date +%s 2024-09-16T03:45:08.068 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1059: wait_for_quorum: wait_until=1726458608 2024-09-16T03:45:08.069 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: date +%s 2024-09-16T03:45:08.070 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1060: wait_for_quorum: [[ 1726458308 -lt 1726458608 ]] 2024-09-16T03:45:08.070 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: wait_for_quorum: jqfilter='.quorum | length == 2' 2024-09-16T03:45:08.071 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: timeout 300 ceph quorum_status --format=json 2024-09-16T03:45:14.754 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: wait_for_quorum: jqinput=' 2024-09-16T03:45:14.754 INFO:tasks.workunit.client.0.smithi096.stderr:{"election_epoch":14,"quorum":[0,1],"quorum_names":["bb","aa"],"quorum_leader_name":"bb","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":4,"fsid":"4bfeedcc-ee18-4c5d-bec3-b7e1842c7798","modified":"2024-09-16T03:45:08.019062Z","created":"2024-09-16T03:42:53.845323Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"bb","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7141","nonce":0}]},"addr":"127.0.0.1:7141/0","public_addr":"127.0.0.1:7141/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"aa","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7142","nonce":0}]},"addr":"127.0.0.1:7142/0","public_addr":"127.0.0.1:7142/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:45:14.754 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: jq '.quorum | length == 2' 2024-09-16T03:45:14.755 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: echo '{"election_epoch":14,"quorum":[0,1],"quorum_names":["bb","aa"],"quorum_leader_name":"bb","quorum_age":1,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":4,"fsid":"4bfeedcc-ee18-4c5d-bec3-b7e1842c7798","modified":"2024-09-16T03:45:08.019062Z","created":"2024-09-16T03:42:53.845323Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders:' '":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks:' '":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"bb","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7141","nonce":0}]},"addr":"127.0.0.1:7141/0","public_addr":"127.0.0.1:7141/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"aa","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7142","nonce":0}]},"addr":"127.0.0.1:7142/0","public_addr":"127.0.0.1:7142/0","priority":0,"weight":0,"crush_location":"{}"}]}}' 2024-09-16T03:45:14.789 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: wait_for_quorum: res=true 2024-09-16T03:45:14.789 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: wait_for_quorum: [[ true == \t\r\u\e ]] 2024-09-16T03:45:14.790 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: wait_for_quorum: no_quorum=0 2024-09-16T03:45:14.790 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1066: wait_for_quorum: break 2024-09-16T03:45:14.790 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1069: wait_for_quorum: return 0 2024-09-16T03:45:14.790 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-seesaw.sh:22: run: teardown td/mon-seesaw 2024-09-16T03:45:14.790 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/mon-seesaw 2024-09-16T03:45:14.790 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:45:14.790 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/mon-seesaw KILL 2024-09-16T03:45:14.790 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:45:14.790 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:45:14.790 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:45:14.790 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:45:14.790 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:45:15.101 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:45:15.101 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:45:15.103 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:45:15.104 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:45:15.105 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:45:15.105 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:45:15.105 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:45:15.106 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:45:15.106 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:45:15.107 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:45:15.107 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:45:15.108 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:45:15.109 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:45:15.109 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/mon-seesaw 2024-09-16T03:45:15.130 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:45:15.130 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:45:15.130 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.102374 2024-09-16T03:45:15.130 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.102374 2024-09-16T03:45:15.131 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:45:15.132 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:45:15.132 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2322: main: code=0 2024-09-16T03:45:15.132 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2326: main: teardown td/mon-seesaw 0 2024-09-16T03:45:15.132 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/mon-seesaw 2024-09-16T03:45:15.132 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2024-09-16T03:45:15.132 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/mon-seesaw KILL 2024-09-16T03:45:15.133 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:45:15.133 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:45:15.133 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:45:15.133 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:45:15.133 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:45:15.135 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:45:15.135 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:45:15.136 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:45:15.136 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:45:15.137 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:45:15.138 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:45:15.138 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:45:15.139 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:45:15.139 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:45:15.139 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:45:15.140 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:45:15.140 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:45:15.142 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2024-09-16T03:45:15.142 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/mon-seesaw 2024-09-16T03:45:15.143 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:45:15.143 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:45:15.143 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.102374 2024-09-16T03:45:15.144 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.102374 2024-09-16T03:45:15.145 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:45:15.145 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:45:15.145 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2327: main: return 0 2024-09-16T03:45:15.146 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-16T03:45:15.146 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-16T03:45:15.200 INFO:tasks.workunit:Running workunit mon/osd-crush.sh... 2024-09-16T03:45:15.201 DEBUG:teuthology.orchestra.run.smithi096:workunit test mon/osd-crush.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7498493279982dfe87f00616198a5967475f6169 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh 2024-09-16T03:45:15.258 INFO:tasks.workunit.client.0.smithi096.stderr:stty: 'standard input': Inappropriate ioctl for device 2024-09-16T03:45:15.263 INFO:tasks.workunit.client.0.smithi096.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2024-09-16T03:45:15.263 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2315: main: export PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-16T03:45:15.263 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2315: main: PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-16T03:45:15.263 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2316: main: export PYTHONWARNINGS=ignore 2024-09-16T03:45:15.264 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2316: main: PYTHONWARNINGS=ignore 2024-09-16T03:45:15.264 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2317: main: export CEPH_CONF=/dev/null 2024-09-16T03:45:15.264 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2317: main: CEPH_CONF=/dev/null 2024-09-16T03:45:15.264 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2318: main: unset CEPH_ARGS 2024-09-16T03:45:15.264 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2320: main: local code 2024-09-16T03:45:15.264 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2321: main: run td/osd-crush 2024-09-16T03:45:15.264 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:21: run: local dir=td/osd-crush 2024-09-16T03:45:15.264 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:22: run: shift 2024-09-16T03:45:15.264 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:24: run: export CEPH_MON=127.0.0.1:7104 2024-09-16T03:45:15.264 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:24: run: CEPH_MON=127.0.0.1:7104 2024-09-16T03:45:15.265 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:25: run: export CEPH_ARGS 2024-09-16T03:45:15.265 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:26: run: uuidgen 2024-09-16T03:45:15.265 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:26: run: CEPH_ARGS+='--fsid=62b9a41f-dbdc-4178-90d1-b82b7302f923 --auth-supported=none ' 2024-09-16T03:45:15.265 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:27: run: CEPH_ARGS+='--mon-host=127.0.0.1:7104 ' 2024-09-16T03:45:15.265 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:29: run: set 2024-09-16T03:45:15.266 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:29: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2024-09-16T03:45:15.267 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:29: run: local 'funcs=TEST_add_rule_failed 2024-09-16T03:45:15.267 INFO:tasks.workunit.client.0.smithi096.stderr:TEST_crush_ls_node 2024-09-16T03:45:15.268 INFO:tasks.workunit.client.0.smithi096.stderr:TEST_crush_reject_empty 2024-09-16T03:45:15.268 INFO:tasks.workunit.client.0.smithi096.stderr:TEST_crush_rename_bucket 2024-09-16T03:45:15.268 INFO:tasks.workunit.client.0.smithi096.stderr:TEST_crush_rule_create_erasure 2024-09-16T03:45:15.268 INFO:tasks.workunit.client.0.smithi096.stderr:TEST_crush_rule_create_simple 2024-09-16T03:45:15.268 INFO:tasks.workunit.client.0.smithi096.stderr:TEST_crush_rule_dump 2024-09-16T03:45:15.268 INFO:tasks.workunit.client.0.smithi096.stderr:TEST_crush_rule_rm' 2024-09-16T03:45:15.268 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:30: run: for func in $funcs 2024-09-16T03:45:15.268 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:31: run: setup td/osd-crush 2024-09-16T03:45:15.269 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-crush 2024-09-16T03:45:15.269 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-crush 2024-09-16T03:45:15.269 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-crush 2024-09-16T03:45:15.269 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:45:15.269 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-crush KILL 2024-09-16T03:45:15.269 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:45:15.269 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:45:15.269 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:45:15.269 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:45:15.269 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:45:15.270 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:45:15.270 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:45:15.270 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:45:15.271 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:45:15.272 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:45:15.272 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:45:15.272 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:45:15.273 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:45:15.273 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:45:15.274 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:45:15.274 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:45:15.274 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:45:15.276 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:45:15.276 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-crush 2024-09-16T03:45:15.277 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:45:15.277 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:45:15.277 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108643 2024-09-16T03:45:15.277 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.108643 2024-09-16T03:45:15.278 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:45:15.278 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:45:15.278 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-crush 2024-09-16T03:45:15.279 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T03:45:15.279 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:45:15.279 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108643 2024-09-16T03:45:15.280 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.108643 2024-09-16T03:45:15.281 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T03:45:15.283 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2024-09-16T03:45:15.283 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2024-09-16T03:45:15.283 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T03:45:15.283 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-crush 1' TERM HUP INT 2024-09-16T03:45:15.283 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:32: run: TEST_add_rule_failed td/osd-crush 2024-09-16T03:45:15.283 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:124: TEST_add_rule_failed: local dir=td/osd-crush 2024-09-16T03:45:15.283 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:126: TEST_add_rule_failed: run_mon td/osd-crush a 2024-09-16T03:45:15.283 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-crush 2024-09-16T03:45:15.283 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T03:45:15.283 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T03:45:15.284 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T03:45:15.284 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-crush/a 2024-09-16T03:45:15.284 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-crush/a --run-dir=td/osd-crush 2024-09-16T03:45:15.754 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T03:45:15.755 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:45:15.755 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:45:15.755 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:45:15.755 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:45:15.755 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108643 2024-09-16T03:45:15.755 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.108643/$cluster-$name.asok' 2024-09-16T03:45:15.756 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-crush/a '--log-file=td/osd-crush/$name.log' '--admin-socket=/tmp/ceph-asok.108643/$cluster-$name.asok' --mon-cluster-log-file=td/osd-crush/log --run-dir=td/osd-crush '--pid-file=td/osd-crush/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-09-16T03:45:15.950 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T03:45:15.951 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T03:45:15.951 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:45:15.951 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:45:15.951 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T03:45:15.952 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T03:45:15.952 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:45:15.952 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:45:15.952 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:45:15.952 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:45:15.952 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:45:15.952 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108643 2024-09-16T03:45:15.952 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.108643/ceph-mon.a.asok 2024-09-16T03:45:15.953 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:45:15.953 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.108643/ceph-mon.a.asok config get fsid 2024-09-16T03:45:16.069 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T03:45:16.069 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:45:16.069 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:45:16.070 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T03:45:16.070 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T03:45:16.071 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:45:16.071 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:45:16.071 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:45:16.071 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:45:16.071 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:45:16.071 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108643 2024-09-16T03:45:16.072 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.108643/ceph-mon.a.asok 2024-09-16T03:45:16.072 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:45:16.072 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.108643/ceph-mon.a.asok config get mon_host 2024-09-16T03:45:16.178 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:128: TEST_add_rule_failed: local root=host1 2024-09-16T03:45:16.178 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:130: TEST_add_rule_failed: ceph osd crush add-bucket host1 host 2024-09-16T03:45:17.077 INFO:tasks.workunit.client.0.smithi096.stderr:bucket 'host1' already exists 2024-09-16T03:45:17.094 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:131: TEST_add_rule_failed: ceph osd crush rule create-simple test_rule1 host1 osd firstn 2024-09-16T03:45:17.528 INFO:tasks.workunit.client.0.smithi096.stderr:rule test_rule1 already exists 2024-09-16T03:45:17.546 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:132: TEST_add_rule_failed: ceph osd crush rule create-simple test_rule2 host1 osd firstn 2024-09-16T03:45:17.887 INFO:tasks.workunit.client.0.smithi096.stderr:rule test_rule2 already exists 2024-09-16T03:45:17.904 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:133: TEST_add_rule_failed: ceph osd getcrushmap 2024-09-16T03:45:18.128 INFO:tasks.workunit.client.0.smithi096.stderr:4 2024-09-16T03:45:18.144 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:134: TEST_add_rule_failed: crushtool --decompile td/osd-crush/crushmap 2024-09-16T03:45:18.165 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: seq 3 255 2024-09-16T03:45:18.189 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.189 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.190 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.190 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.191 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.191 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.192 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.192 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.193 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.193 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.194 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.194 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.195 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.195 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.195 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.196 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.196 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.196 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.197 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.197 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.198 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.198 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.199 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.199 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.200 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.200 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.201 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.201 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.202 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.202 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.203 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.203 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.203 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.204 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.204 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.205 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.205 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.205 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.206 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.206 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.207 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.207 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.208 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.208 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.209 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.210 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.210 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.210 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.210 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.210 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.211 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.211 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.212 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.212 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.213 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.213 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.215 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.215 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.215 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.215 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.216 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.216 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.216 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.217 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.217 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.218 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.218 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.218 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.219 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.219 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.220 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.220 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.221 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.221 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.222 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.222 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.223 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.223 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.223 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.223 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.224 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.224 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.225 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.225 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.226 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.226 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.227 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.227 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.228 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.228 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.229 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.229 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.230 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.230 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.230 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.231 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.231 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.231 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.232 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.232 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.233 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.233 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.234 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.234 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.235 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.235 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.235 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.235 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.236 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.236 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.238 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.238 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.238 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.239 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.240 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.241 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.241 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.241 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.242 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.242 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.242 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.242 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.242 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.242 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.243 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.243 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.244 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.245 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.245 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.245 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.246 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.246 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.246 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.246 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.247 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.247 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.248 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.248 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.249 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.249 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.249 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.250 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.250 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.250 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.251 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.251 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.252 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.252 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.253 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.253 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.254 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.254 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.255 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.255 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.256 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.256 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.256 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.256 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.257 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.257 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.258 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.258 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.259 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.259 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.259 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.260 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.260 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.260 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.261 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.261 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.262 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.262 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.263 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.263 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.264 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.264 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.265 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.265 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.266 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.266 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.267 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.267 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.267 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.268 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.268 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.268 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.269 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.269 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.270 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.270 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.270 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.271 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.271 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.271 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.272 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.272 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.273 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.273 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.274 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.274 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.275 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.275 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.275 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.276 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.276 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.277 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.277 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.277 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.278 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.278 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.279 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.279 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.280 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.280 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.281 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.281 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.282 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.282 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.282 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.282 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.283 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.283 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.284 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.284 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.285 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.285 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.286 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.286 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.286 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.286 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.287 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.287 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.288 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.288 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.289 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.289 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.290 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.290 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.291 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.291 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.291 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.291 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.292 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.292 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.293 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.293 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.294 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.294 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.295 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.295 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.296 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.297 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.298 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.298 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.298 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.299 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.299 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.299 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.299 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.299 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.300 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.300 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.301 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.301 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.302 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.302 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.302 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.303 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.303 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.303 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.304 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.304 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.305 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.305 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.306 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.306 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.308 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.308 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.308 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.308 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.308 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.309 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.309 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.309 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.310 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.310 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.311 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.311 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.312 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.312 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.313 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.313 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.314 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.314 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.314 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.314 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.315 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.315 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.316 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.316 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.317 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.317 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.318 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.318 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.318 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.318 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.319 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.319 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.320 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.320 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.321 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.321 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.322 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.322 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.322 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.322 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.323 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.323 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.324 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.324 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.325 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.325 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.326 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.326 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.327 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.327 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.328 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.328 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.329 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.329 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.330 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.330 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.330 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.331 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.331 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.331 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.332 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.332 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.333 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.333 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.334 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.334 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.335 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.335 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.335 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.335 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.336 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.337 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.337 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.338 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.338 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.338 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.339 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.339 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.340 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.340 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.341 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.341 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.342 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.342 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.342 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.343 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.343 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.343 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.344 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.344 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.345 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.345 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.346 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.346 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.347 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.347 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.348 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.348 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.349 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.349 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.350 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.350 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.350 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.350 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.351 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.351 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.352 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.352 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.353 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.353 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.354 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.354 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.354 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.355 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.355 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.355 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.357 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.357 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.357 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.357 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.358 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.358 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.359 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.359 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.359 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.359 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.360 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.360 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.361 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.361 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.364 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.364 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.365 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.365 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.365 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.365 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.366 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.366 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.366 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.366 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.366 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.366 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.367 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.367 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.368 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.368 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.369 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.369 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.370 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.370 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.370 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.370 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.371 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.371 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.372 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.372 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.373 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.373 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.374 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.374 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.374 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.375 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.375 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.375 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.376 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.376 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.377 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.377 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.378 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.378 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.379 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.379 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.380 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.380 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.381 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.381 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.382 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.382 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.382 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.382 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.383 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.383 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.384 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.384 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.385 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.385 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.386 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.386 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.386 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.387 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.387 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.387 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.388 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.388 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.389 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.389 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.390 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.390 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.391 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.391 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.392 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.392 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.392 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.394 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.395 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.395 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.395 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.395 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.396 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.396 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.396 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.396 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.397 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.397 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.398 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.398 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.398 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.399 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.401 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.401 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.401 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.401 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.401 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.402 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.402 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.402 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.403 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.403 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.404 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:135: TEST_add_rule_failed: for i in $(seq 3 255) 2024-09-16T03:45:18.404 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:137: TEST_add_rule_failed: cat 2024-09-16T03:45:18.405 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:147: TEST_add_rule_failed: crushtool --compile td/osd-crush/crushmap.txt -o td/osd-crush/crushmap 2024-09-16T03:45:18.431 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:148: TEST_add_rule_failed: ceph osd setcrushmap -i td/osd-crush/crushmap 2024-09-16T03:45:18.873 INFO:tasks.workunit.client.0.smithi096.stderr:6 2024-09-16T03:45:18.898 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:149: TEST_add_rule_failed: ceph osd crush rule create-simple test_rule_nospace host1 osd firstn 2024-09-16T03:45:18.898 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:149: TEST_add_rule_failed: grep 'Error ENOSPC' 2024-09-16T03:45:19.092 INFO:tasks.workunit.client.0.smithi096.stdout:Error ENOSPC: failed to add rule 256 because (28) No space left on device 2024-09-16T03:45:19.093 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:33: run: teardown td/osd-crush 2024-09-16T03:45:19.093 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-crush 2024-09-16T03:45:19.093 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:45:19.093 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-crush KILL 2024-09-16T03:45:19.093 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:45:19.093 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:45:19.094 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:45:19.094 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:45:19.094 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:45:19.200 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:45:19.200 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:45:19.201 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:45:19.202 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:45:19.204 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:45:19.204 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:45:19.204 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:45:19.205 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:45:19.205 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:45:19.206 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:45:19.206 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:45:19.207 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:45:19.208 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:45:19.208 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-crush 2024-09-16T03:45:19.210 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:45:19.210 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:45:19.210 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108643 2024-09-16T03:45:19.211 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.108643 2024-09-16T03:45:19.213 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:45:19.213 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:45:19.213 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:30: run: for func in $funcs 2024-09-16T03:45:19.213 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:31: run: setup td/osd-crush 2024-09-16T03:45:19.213 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-crush 2024-09-16T03:45:19.213 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-crush 2024-09-16T03:45:19.213 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-crush 2024-09-16T03:45:19.213 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:45:19.213 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-crush KILL 2024-09-16T03:45:19.214 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:45:19.214 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:45:19.214 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:45:19.214 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:45:19.214 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:45:19.215 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:45:19.215 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:45:19.218 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:45:19.218 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:45:19.218 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:45:19.218 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:45:19.218 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:45:19.221 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:45:19.221 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:45:19.221 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:45:19.221 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:45:19.221 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:45:19.223 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:45:19.223 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-crush 2024-09-16T03:45:19.225 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:45:19.225 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:45:19.225 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108643 2024-09-16T03:45:19.225 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.108643 2024-09-16T03:45:19.226 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:45:19.226 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:45:19.226 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-crush 2024-09-16T03:45:19.226 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T03:45:19.227 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:45:19.227 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108643 2024-09-16T03:45:19.227 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.108643 2024-09-16T03:45:19.229 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T03:45:19.229 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2024-09-16T03:45:19.229 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T03:45:19.229 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-crush 1' TERM HUP INT 2024-09-16T03:45:19.229 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:32: run: TEST_crush_ls_node td/osd-crush 2024-09-16T03:45:19.230 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:169: TEST_crush_ls_node: local dir=td/osd-crush 2024-09-16T03:45:19.230 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:170: TEST_crush_ls_node: run_mon td/osd-crush a 2024-09-16T03:45:19.230 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-crush 2024-09-16T03:45:19.230 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T03:45:19.230 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T03:45:19.230 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T03:45:19.230 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-crush/a 2024-09-16T03:45:19.230 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-crush/a --run-dir=td/osd-crush 2024-09-16T03:45:19.717 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T03:45:19.717 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:45:19.717 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:45:19.717 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:45:19.717 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:45:19.718 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108643 2024-09-16T03:45:19.718 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.108643/$cluster-$name.asok' 2024-09-16T03:45:19.718 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-crush/a '--log-file=td/osd-crush/$name.log' '--admin-socket=/tmp/ceph-asok.108643/$cluster-$name.asok' --mon-cluster-log-file=td/osd-crush/log --run-dir=td/osd-crush '--pid-file=td/osd-crush/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-09-16T03:45:19.920 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T03:45:19.921 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T03:45:19.921 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:45:19.922 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:45:19.922 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T03:45:19.922 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T03:45:19.922 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:45:19.923 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:45:19.923 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:45:19.923 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:45:19.923 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:45:19.923 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108643 2024-09-16T03:45:19.923 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.108643/ceph-mon.a.asok 2024-09-16T03:45:19.923 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:45:19.923 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.108643/ceph-mon.a.asok config get fsid 2024-09-16T03:45:20.042 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T03:45:20.042 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:45:20.042 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:45:20.042 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T03:45:20.042 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T03:45:20.042 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:45:20.043 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:45:20.043 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:45:20.043 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:45:20.043 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:45:20.043 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108643 2024-09-16T03:45:20.043 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.108643/ceph-mon.a.asok 2024-09-16T03:45:20.043 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:45:20.043 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.108643/ceph-mon.a.asok config get mon_host 2024-09-16T03:45:20.144 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:171: TEST_crush_ls_node: ceph osd crush add-bucket default1 root 2024-09-16T03:45:21.022 INFO:tasks.workunit.client.0.smithi096.stderr:bucket 'default1' already exists 2024-09-16T03:45:21.040 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:172: TEST_crush_ls_node: ceph osd crush add-bucket host1 host 2024-09-16T03:45:21.479 INFO:tasks.workunit.client.0.smithi096.stderr:bucket 'host1' already exists 2024-09-16T03:45:21.495 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:173: TEST_crush_ls_node: ceph osd crush move host1 root=default1 2024-09-16T03:45:21.867 INFO:tasks.workunit.client.0.smithi096.stderr:no need to move item id -3 name 'host1' to location {root=default1} in crush map 2024-09-16T03:45:21.885 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:174: TEST_crush_ls_node: ceph osd crush ls default1 2024-09-16T03:45:21.886 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:174: TEST_crush_ls_node: grep host1 2024-09-16T03:45:22.159 INFO:tasks.workunit.client.0.smithi096.stdout:host1 2024-09-16T03:45:22.159 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:175: TEST_crush_ls_node: ceph osd crush ls default2 2024-09-16T03:45:22.159 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:175: TEST_crush_ls_node: grep 'Error ENOENT' 2024-09-16T03:45:22.346 INFO:tasks.workunit.client.0.smithi096.stdout:Error ENOENT: node 'default2' does not exist 2024-09-16T03:45:22.346 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:33: run: teardown td/osd-crush 2024-09-16T03:45:22.346 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-crush 2024-09-16T03:45:22.346 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:45:22.346 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-crush KILL 2024-09-16T03:45:22.347 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:45:22.347 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:45:22.347 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:45:22.347 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:45:22.347 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:45:22.453 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:45:22.454 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:45:22.455 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:45:22.455 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:45:22.456 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:45:22.457 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:45:22.457 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:45:22.458 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:45:22.458 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:45:22.459 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:45:22.459 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:45:22.460 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:45:22.461 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:45:22.461 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-crush 2024-09-16T03:45:22.463 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:45:22.463 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:45:22.463 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108643 2024-09-16T03:45:22.463 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.108643 2024-09-16T03:45:22.464 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:45:22.464 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:45:22.465 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:30: run: for func in $funcs 2024-09-16T03:45:22.465 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:31: run: setup td/osd-crush 2024-09-16T03:45:22.465 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-crush 2024-09-16T03:45:22.465 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-crush 2024-09-16T03:45:22.465 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-crush 2024-09-16T03:45:22.465 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:45:22.465 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-crush KILL 2024-09-16T03:45:22.465 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:45:22.465 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:45:22.466 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:45:22.466 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:45:22.466 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:45:22.467 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:45:22.467 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:45:22.468 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:45:22.469 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:45:22.470 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:45:22.471 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:45:22.471 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:45:22.471 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:45:22.471 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:45:22.472 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:45:22.472 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:45:22.472 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:45:22.473 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:45:22.473 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-crush 2024-09-16T03:45:22.475 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:45:22.475 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:45:22.475 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108643 2024-09-16T03:45:22.475 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.108643 2024-09-16T03:45:22.476 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:45:22.476 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:45:22.476 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-crush 2024-09-16T03:45:22.478 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T03:45:22.478 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:45:22.478 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108643 2024-09-16T03:45:22.478 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.108643 2024-09-16T03:45:22.481 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T03:45:22.482 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2024-09-16T03:45:22.482 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T03:45:22.482 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-crush 1' TERM HUP INT 2024-09-16T03:45:22.482 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:32: run: TEST_crush_reject_empty td/osd-crush 2024-09-16T03:45:22.482 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:179: TEST_crush_reject_empty: local dir=td/osd-crush 2024-09-16T03:45:22.482 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:180: TEST_crush_reject_empty: run_mon td/osd-crush a --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2024-09-16T03:45:22.482 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-crush 2024-09-16T03:45:22.482 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T03:45:22.482 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T03:45:22.482 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T03:45:22.482 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-crush/a 2024-09-16T03:45:22.482 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-crush/a --run-dir=td/osd-crush --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2024-09-16T03:45:22.954 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T03:45:22.954 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:45:22.954 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:45:22.954 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:45:22.954 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:45:22.954 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108643 2024-09-16T03:45:22.955 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.108643/$cluster-$name.asok' 2024-09-16T03:45:22.955 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-crush/a '--log-file=td/osd-crush/$name.log' '--admin-socket=/tmp/ceph-asok.108643/$cluster-$name.asok' --mon-cluster-log-file=td/osd-crush/log --run-dir=td/osd-crush '--pid-file=td/osd-crush/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2024-09-16T03:45:23.146 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T03:45:23.147 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T03:45:23.147 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:45:23.147 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:45:23.147 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T03:45:23.148 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T03:45:23.148 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:45:23.148 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:45:23.148 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:45:23.148 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:45:23.148 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:45:23.148 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108643 2024-09-16T03:45:23.148 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.108643/ceph-mon.a.asok 2024-09-16T03:45:23.149 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:45:23.149 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.108643/ceph-mon.a.asok config get fsid 2024-09-16T03:45:23.265 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T03:45:23.266 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:45:23.266 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:45:23.266 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T03:45:23.267 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T03:45:23.267 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:45:23.267 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:45:23.267 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:45:23.268 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:45:23.268 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:45:23.268 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108643 2024-09-16T03:45:23.268 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.108643/ceph-mon.a.asok 2024-09-16T03:45:23.268 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:45:23.268 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.108643/ceph-mon.a.asok config get mon_host 2024-09-16T03:45:23.379 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:182: TEST_crush_reject_empty: run_osd td/osd-crush 0 2024-09-16T03:45:23.379 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-crush 2024-09-16T03:45:23.379 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T03:45:23.379 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2024-09-16T03:45:23.379 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T03:45:23.379 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-crush/0 2024-09-16T03:45:23.380 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=62b9a41f-dbdc-4178-90d1-b82b7302f923 --auth-supported=none --mon-host=127.0.0.1:7104 ' 2024-09-16T03:45:23.380 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T03:45:23.380 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T03:45:23.380 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T03:45:23.380 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-crush/0' 2024-09-16T03:45:23.380 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-crush/0/journal' 2024-09-16T03:45:23.380 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T03:45:23.381 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T03:45:23.381 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-crush' 2024-09-16T03:45:23.381 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T03:45:23.381 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:45:23.381 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:45:23.381 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:45:23.381 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:45:23.381 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108643 2024-09-16T03:45:23.381 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.108643/$cluster-$name.asok' 2024-09-16T03:45:23.381 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.108643/$cluster-$name.asok' 2024-09-16T03:45:23.381 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T03:45:23.382 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T03:45:23.382 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T03:45:23.382 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-crush/$name.log' 2024-09-16T03:45:23.382 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-crush/$name.pid' 2024-09-16T03:45:23.382 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T03:45:23.382 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T03:45:23.382 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T03:45:23.382 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T03:45:23.382 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T03:45:23.382 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T03:45:23.382 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-crush/0 2024-09-16T03:45:23.383 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T03:45:23.383 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=f2ba842f-67cd-4d60-8324-4175458271a6 2024-09-16T03:45:23.383 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 f2ba842f-67cd-4d60-8324-4175458271a6' 2024-09-16T03:45:23.383 INFO:tasks.workunit.client.0.smithi096.stdout:add osd0 f2ba842f-67cd-4d60-8324-4175458271a6 2024-09-16T03:45:23.384 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T03:45:23.401 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDTqedmOP8GGBAAlVoU9SszsT8r0U3LnLg7Xg== 2024-09-16T03:45:23.401 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDTqedmOP8GGBAAlVoU9SszsT8r0U3LnLg7Xg=="}' 2024-09-16T03:45:23.402 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new f2ba842f-67cd-4d60-8324-4175458271a6 -i td/osd-crush/0/new.json 2024-09-16T03:45:24.302 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T03:45:24.318 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-crush/0/new.json 2024-09-16T03:45:24.319 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=62b9a41f-dbdc-4178-90d1-b82b7302f923 --auth-supported=none --mon-host=127.0.0.1:7104 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-crush/0 --osd-journal=td/osd-crush/0/journal --chdir= --run-dir=td/osd-crush '--admin-socket=/tmp/ceph-asok.108643/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-crush/$name.log' '--pid-file=td/osd-crush/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDTqedmOP8GGBAAlVoU9SszsT8r0U3LnLg7Xg== --osd-uuid f2ba842f-67cd-4d60-8324-4175458271a6 2024-09-16T03:45:24.345 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:45:24.342+0000 7f4936de77c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:45:24.372 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:45:24.366+0000 7f4936de77c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:45:24.373 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:45:24.366+0000 7f4936de77c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:45:24.373 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:45:24.370+0000 7f4936de77c0 -1 bdev(0x55925d6afc00 td/osd-crush/0/block) open stat got: (1) Operation not permitted 2024-09-16T03:45:24.373 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:45:24.370+0000 7f4936de77c0 -1 bluestore(td/osd-crush/0) _read_fsid unparsable uuid 2024-09-16T03:45:29.726 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-crush/0/keyring 2024-09-16T03:45:29.726 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T03:45:29.728 INFO:tasks.workunit.client.0.smithi096.stdout:adding osd0 key to auth repository 2024-09-16T03:45:29.728 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2024-09-16T03:45:29.728 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-crush/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T03:45:29.977 INFO:tasks.workunit.client.0.smithi096.stdout:start osd.0 2024-09-16T03:45:29.978 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2024-09-16T03:45:29.978 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T03:45:29.978 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T03:45:29.978 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=62b9a41f-dbdc-4178-90d1-b82b7302f923 --auth-supported=none --mon-host=127.0.0.1:7104 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-crush/0 --osd-journal=td/osd-crush/0/journal --chdir= --run-dir=td/osd-crush '--admin-socket=/tmp/ceph-asok.108643/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-crush/$name.log' '--pid-file=td/osd-crush/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T03:45:29.978 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T03:45:30.008 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:45:30.006+0000 7fd4c6eca7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:45:30.010 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:45:30.006+0000 7fd4c6eca7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:45:30.011 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:45:30.010+0000 7fd4c6eca7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:45:30.205 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2024-09-16T03:45:30.205 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:45:30.205 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2024-09-16T03:45:30.206 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:45:30.206 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:45:30.206 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:45:30.206 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T03:45:30.206 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:45:30.206 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:45:30.207 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:45:30.434 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:45:31.436 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:45:31.436 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:45:31.436 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T03:45:31.437 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T03:45:31.437 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:45:31.437 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:45:31.553 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:45:31.550+0000 7fd4c6eca7c0 -1 Falling back to public interface 2024-09-16T03:45:31.663 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:45:32.664 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:45:32.665 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:45:32.665 INFO:tasks.workunit.client.0.smithi096.stdout:2 2024-09-16T03:45:32.665 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T03:45:32.665 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:45:32.666 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:45:32.900 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:45:33.904 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:45:33.905 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:45:33.905 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T03:45:33.905 INFO:tasks.workunit.client.0.smithi096.stdout:3 2024-09-16T03:45:33.906 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:45:33.906 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:45:34.133 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:45:34.195 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:45:34.170+0000 7fd4c6eca7c0 -1 osd.0 0 log_to_monitors true 2024-09-16T03:45:35.134 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:45:35.134 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:45:35.134 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T03:45:35.134 INFO:tasks.workunit.client.0.smithi096.stdout:4 2024-09-16T03:45:35.135 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:45:35.135 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:45:35.366 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:45:36.368 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:45:36.369 INFO:tasks.workunit.client.0.smithi096.stdout:5 2024-09-16T03:45:36.369 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:45:36.370 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T03:45:36.370 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:45:36.370 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:45:36.607 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:45:37.609 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:45:37.609 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:45:37.610 INFO:tasks.workunit.client.0.smithi096.stdout:6 2024-09-16T03:45:37.610 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T03:45:37.610 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:45:37.610 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:45:37.844 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:45:38.846 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:45:38.846 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:45:38.847 INFO:tasks.workunit.client.0.smithi096.stdout:7 2024-09-16T03:45:38.847 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T03:45:38.847 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:45:38.847 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:45:39.087 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:45:40.088 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:45:40.089 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:45:40.089 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T03:45:40.089 INFO:tasks.workunit.client.0.smithi096.stdout:8 2024-09-16T03:45:40.089 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:45:40.089 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:45:40.327 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:45:41.328 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:45:41.328 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:45:41.329 INFO:tasks.workunit.client.0.smithi096.stdout:9 2024-09-16T03:45:41.329 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T03:45:41.329 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:45:41.329 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:45:41.565 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:45:42.567 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:45:42.567 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:45:42.567 INFO:tasks.workunit.client.0.smithi096.stdout:10 2024-09-16T03:45:42.568 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T03:45:42.568 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:45:42.568 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:45:42.804 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:45:43.806 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:45:43.806 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:45:43.806 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T03:45:43.806 INFO:tasks.workunit.client.0.smithi096.stdout:11 2024-09-16T03:45:43.807 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:45:43.807 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:45:44.043 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:45:45.045 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:45:45.045 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:45:45.046 INFO:tasks.workunit.client.0.smithi096.stdout:12 2024-09-16T03:45:45.046 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T03:45:45.046 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:45:45.046 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:45:45.280 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:45:46.282 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:45:46.282 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:45:46.282 INFO:tasks.workunit.client.0.smithi096.stdout:13 2024-09-16T03:45:46.283 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T03:45:46.283 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:45:46.283 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:45:46.514 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:45:47.516 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:45:47.516 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:45:47.516 INFO:tasks.workunit.client.0.smithi096.stdout:14 2024-09-16T03:45:47.517 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T03:45:47.517 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:45:47.517 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:45:47.752 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:45:48.754 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:45:48.754 INFO:tasks.workunit.client.0.smithi096.stdout:15 2024-09-16T03:45:48.754 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:45:48.755 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T03:45:48.755 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:45:48.755 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:45:48.991 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:45:49.993 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:45:49.993 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:45:49.993 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T03:45:49.993 INFO:tasks.workunit.client.0.smithi096.stdout:16 2024-09-16T03:45:49.993 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:45:49.994 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:45:50.231 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:45:51.232 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:45:51.233 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:45:51.233 INFO:tasks.workunit.client.0.smithi096.stdout:17 2024-09-16T03:45:51.233 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T03:45:51.233 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:45:51.234 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:45:51.466 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:45:52.468 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:45:52.468 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:45:52.468 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 18 2024-09-16T03:45:52.468 INFO:tasks.workunit.client.0.smithi096.stdout:18 2024-09-16T03:45:52.469 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:45:52.469 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:45:52.708 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:45:53.710 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:45:53.710 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:45:53.711 INFO:tasks.workunit.client.0.smithi096.stdout:19 2024-09-16T03:45:53.711 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 19 2024-09-16T03:45:53.711 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:45:53.711 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:45:53.943 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:45:54.944 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:45:54.944 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:45:54.945 INFO:tasks.workunit.client.0.smithi096.stdout:20 2024-09-16T03:45:54.945 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 20 2024-09-16T03:45:54.945 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:45:54.945 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:45:55.181 INFO:tasks.workunit.client.0.smithi096.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/4124917054,v1:127.0.0.1:6801/4124917054] [v2:127.0.0.1:6802/4124917054,v1:127.0.0.1:6803/4124917054] exists,up f2ba842f-67cd-4d60-8324-4175458271a6 2024-09-16T03:45:55.182 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:45:55.182 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:45:55.182 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:45:55.182 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:183: TEST_crush_reject_empty: create_rbd_pool 2024-09-16T03:45:55.182 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:526: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2024-09-16T03:45:55.399 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'rbd' does not exist 2024-09-16T03:45:55.414 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:527: create_rbd_pool: create_pool rbd 4 2024-09-16T03:45:55.414 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2024-09-16T03:45:55.789 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'rbd' already exists 2024-09-16T03:45:55.809 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2024-09-16T03:45:56.812 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:528: create_rbd_pool: rbd pool init rbd 2024-09-16T03:45:57.950 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:185: TEST_crush_reject_empty: local empty_map=td/osd-crush/empty_map 2024-09-16T03:45:57.950 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:186: TEST_crush_reject_empty: : 2024-09-16T03:45:57.950 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:187: TEST_crush_reject_empty: crushtool -c td/osd-crush/empty_map.txt -o td/osd-crush/empty_map.map 2024-09-16T03:45:57.973 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:188: TEST_crush_reject_empty: expect_failure td/osd-crush 'Error EINVAL' ceph osd setcrushmap -i td/osd-crush/empty_map.map 2024-09-16T03:45:57.973 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1970: expect_failure: local dir=td/osd-crush 2024-09-16T03:45:57.973 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1971: expect_failure: shift 2024-09-16T03:45:57.974 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1972: expect_failure: local 'expected=Error EINVAL' 2024-09-16T03:45:57.974 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1973: expect_failure: shift 2024-09-16T03:45:57.974 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1974: expect_failure: local success 2024-09-16T03:45:57.974 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1976: expect_failure: ceph osd setcrushmap -i td/osd-crush/empty_map.map 2024-09-16T03:45:58.158 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1979: expect_failure: success=false 2024-09-16T03:45:58.158 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1982: expect_failure: false 2024-09-16T03:45:58.158 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1982: expect_failure: grep --quiet 'Error EINVAL' td/osd-crush/out 2024-09-16T03:45:58.159 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1986: expect_failure: return 0 2024-09-16T03:45:58.159 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:33: run: teardown td/osd-crush 2024-09-16T03:45:58.159 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-crush 2024-09-16T03:45:58.159 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:45:58.159 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-crush KILL 2024-09-16T03:45:58.159 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:45:58.159 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:45:58.160 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:45:58.160 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:45:58.160 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:45:58.267 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:45:58.267 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:45:58.268 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:45:58.269 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:45:58.269 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:45:58.269 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:45:58.270 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:45:58.270 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:45:58.270 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:45:58.271 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:45:58.271 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:45:58.272 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:45:58.273 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:45:58.273 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-crush 2024-09-16T03:45:58.280 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:45:58.280 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:45:58.280 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108643 2024-09-16T03:45:58.280 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.108643 2024-09-16T03:45:58.282 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:45:58.282 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:45:58.282 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:30: run: for func in $funcs 2024-09-16T03:45:58.282 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:31: run: setup td/osd-crush 2024-09-16T03:45:58.282 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-crush 2024-09-16T03:45:58.282 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-crush 2024-09-16T03:45:58.283 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-crush 2024-09-16T03:45:58.283 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:45:58.283 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-crush KILL 2024-09-16T03:45:58.283 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:45:58.283 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:45:58.283 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:45:58.283 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:45:58.283 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:45:58.284 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:45:58.284 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:45:58.285 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:45:58.285 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:45:58.287 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:45:58.287 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:45:58.287 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:45:58.288 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:45:58.288 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:45:58.288 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:45:58.288 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:45:58.289 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:45:58.290 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:45:58.290 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-crush 2024-09-16T03:45:58.292 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:45:58.292 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:45:58.292 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108643 2024-09-16T03:45:58.292 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.108643 2024-09-16T03:45:58.293 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:45:58.293 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:45:58.293 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-crush 2024-09-16T03:45:58.295 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T03:45:58.295 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:45:58.295 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108643 2024-09-16T03:45:58.295 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.108643 2024-09-16T03:45:58.296 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T03:45:58.297 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2024-09-16T03:45:58.297 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T03:45:58.297 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-crush 1' TERM HUP INT 2024-09-16T03:45:58.297 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:32: run: TEST_crush_rename_bucket td/osd-crush 2024-09-16T03:45:58.298 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:154: TEST_crush_rename_bucket: local dir=td/osd-crush 2024-09-16T03:45:58.298 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:156: TEST_crush_rename_bucket: run_mon td/osd-crush a 2024-09-16T03:45:58.298 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-crush 2024-09-16T03:45:58.298 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T03:45:58.298 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T03:45:58.298 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T03:45:58.298 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-crush/a 2024-09-16T03:45:58.298 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-crush/a --run-dir=td/osd-crush 2024-09-16T03:45:58.741 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T03:45:58.742 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:45:58.742 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:45:58.742 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:45:58.742 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:45:58.742 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108643 2024-09-16T03:45:58.742 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.108643/$cluster-$name.asok' 2024-09-16T03:45:58.742 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-crush/a '--log-file=td/osd-crush/$name.log' '--admin-socket=/tmp/ceph-asok.108643/$cluster-$name.asok' --mon-cluster-log-file=td/osd-crush/log --run-dir=td/osd-crush '--pid-file=td/osd-crush/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-09-16T03:45:58.953 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T03:45:58.954 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T03:45:58.954 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:45:58.954 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:45:58.954 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T03:45:58.955 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T03:45:58.955 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:45:58.956 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:45:58.956 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:45:58.956 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:45:58.956 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:45:58.956 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108643 2024-09-16T03:45:58.956 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.108643/ceph-mon.a.asok 2024-09-16T03:45:58.956 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:45:58.956 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.108643/ceph-mon.a.asok config get fsid 2024-09-16T03:45:59.068 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T03:45:59.069 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:45:59.069 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:45:59.069 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T03:45:59.069 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T03:45:59.070 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:45:59.070 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:45:59.070 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:45:59.070 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:45:59.071 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:45:59.071 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108643 2024-09-16T03:45:59.071 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.108643/ceph-mon.a.asok 2024-09-16T03:45:59.071 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:45:59.071 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.108643/ceph-mon.a.asok config get mon_host 2024-09-16T03:45:59.180 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:158: TEST_crush_rename_bucket: ceph osd crush add-bucket host1 host 2024-09-16T03:46:00.071 INFO:tasks.workunit.client.0.smithi096.stderr:bucket 'host1' already exists 2024-09-16T03:46:00.087 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:159: TEST_crush_rename_bucket: ceph osd tree 2024-09-16T03:46:00.373 INFO:tasks.workunit.client.0.smithi096.stdout:ID CLASS WEIGHT TYPE NAME STATUS REWEIGHT PRI-AFF 2024-09-16T03:46:00.373 INFO:tasks.workunit.client.0.smithi096.stdout:-2 0 host host1 2024-09-16T03:46:00.373 INFO:tasks.workunit.client.0.smithi096.stdout:-1 0 root default 2024-09-16T03:46:00.389 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:160: TEST_crush_rename_bucket: ceph osd tree 2024-09-16T03:46:00.390 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:160: TEST_crush_rename_bucket: grep host2 2024-09-16T03:46:00.647 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:161: TEST_crush_rename_bucket: ceph osd crush rename-bucket host1 host2 2024-09-16T03:46:00.983 INFO:tasks.workunit.client.0.smithi096.stderr:srcname = 'host1' does not exist and dstname = 'host2' already exists 2024-09-16T03:46:01.001 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:162: TEST_crush_rename_bucket: ceph osd tree 2024-09-16T03:46:01.248 INFO:tasks.workunit.client.0.smithi096.stdout:ID CLASS WEIGHT TYPE NAME STATUS REWEIGHT PRI-AFF 2024-09-16T03:46:01.248 INFO:tasks.workunit.client.0.smithi096.stdout:-2 0 host host2 2024-09-16T03:46:01.248 INFO:tasks.workunit.client.0.smithi096.stdout:-1 0 root default 2024-09-16T03:46:01.264 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:163: TEST_crush_rename_bucket: ceph osd tree 2024-09-16T03:46:01.264 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:163: TEST_crush_rename_bucket: grep host2 2024-09-16T03:46:01.492 INFO:tasks.workunit.client.0.smithi096.stdout:-2 0 host host2 2024-09-16T03:46:01.492 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:164: TEST_crush_rename_bucket: ceph osd crush rename-bucket host1 host2 2024-09-16T03:46:01.717 INFO:tasks.workunit.client.0.smithi096.stderr:srcname = 'host1' does not exist and dstname = 'host2' already exists 2024-09-16T03:46:01.733 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:165: TEST_crush_rename_bucket: grep 'Error ENOENT' 2024-09-16T03:46:01.733 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:165: TEST_crush_rename_bucket: ceph osd crush rename-bucket nonexistent something 2024-09-16T03:46:01.919 INFO:tasks.workunit.client.0.smithi096.stdout:Error ENOENT: srcname = 'nonexistent' does not exist 2024-09-16T03:46:01.920 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:33: run: teardown td/osd-crush 2024-09-16T03:46:01.920 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-crush 2024-09-16T03:46:01.920 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:46:01.920 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-crush KILL 2024-09-16T03:46:01.921 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:46:01.921 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:46:01.921 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:46:01.921 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:46:01.921 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:46:02.029 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:46:02.029 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:46:02.031 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:46:02.031 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:46:02.033 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:46:02.033 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:46:02.034 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:46:02.035 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:46:02.035 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:46:02.035 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:46:02.037 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:46:02.037 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:46:02.038 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:46:02.038 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-crush 2024-09-16T03:46:02.040 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:46:02.040 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:46:02.040 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108643 2024-09-16T03:46:02.040 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.108643 2024-09-16T03:46:02.042 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:46:02.042 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:46:02.042 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:30: run: for func in $funcs 2024-09-16T03:46:02.042 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:31: run: setup td/osd-crush 2024-09-16T03:46:02.042 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-crush 2024-09-16T03:46:02.042 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-crush 2024-09-16T03:46:02.042 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-crush 2024-09-16T03:46:02.042 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:46:02.042 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-crush KILL 2024-09-16T03:46:02.042 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:46:02.042 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:46:02.043 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:46:02.043 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:46:02.043 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:46:02.044 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:46:02.045 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:46:02.046 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:46:02.046 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:46:02.047 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:46:02.047 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:46:02.048 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:46:02.048 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:46:02.048 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:46:02.049 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:46:02.049 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:46:02.050 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:46:02.051 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:46:02.051 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-crush 2024-09-16T03:46:02.053 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:46:02.053 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:46:02.053 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108643 2024-09-16T03:46:02.053 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.108643 2024-09-16T03:46:02.054 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:46:02.054 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:46:02.054 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-crush 2024-09-16T03:46:02.055 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T03:46:02.055 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:46:02.056 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108643 2024-09-16T03:46:02.056 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.108643 2024-09-16T03:46:02.057 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T03:46:02.058 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2024-09-16T03:46:02.058 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T03:46:02.058 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-crush 1' TERM HUP INT 2024-09-16T03:46:02.059 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:32: run: TEST_crush_rule_create_erasure td/osd-crush 2024-09-16T03:46:02.059 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:85: TEST_crush_rule_create_erasure: local dir=td/osd-crush 2024-09-16T03:46:02.059 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:87: TEST_crush_rule_create_erasure: run_mon td/osd-crush a 2024-09-16T03:46:02.059 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-crush 2024-09-16T03:46:02.059 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T03:46:02.059 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T03:46:02.059 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T03:46:02.059 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-crush/a 2024-09-16T03:46:02.059 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-crush/a --run-dir=td/osd-crush 2024-09-16T03:46:02.521 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T03:46:02.521 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:46:02.521 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:46:02.521 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:46:02.522 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:46:02.522 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108643 2024-09-16T03:46:02.522 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.108643/$cluster-$name.asok' 2024-09-16T03:46:02.522 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-crush/a '--log-file=td/osd-crush/$name.log' '--admin-socket=/tmp/ceph-asok.108643/$cluster-$name.asok' --mon-cluster-log-file=td/osd-crush/log --run-dir=td/osd-crush '--pid-file=td/osd-crush/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-09-16T03:46:02.724 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T03:46:02.726 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T03:46:02.726 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:46:02.726 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:46:02.726 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T03:46:02.727 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T03:46:02.727 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:46:02.727 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:46:02.727 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:46:02.728 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:46:02.728 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:46:02.728 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108643 2024-09-16T03:46:02.728 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.108643/ceph-mon.a.asok 2024-09-16T03:46:02.728 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:46:02.728 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.108643/ceph-mon.a.asok config get fsid 2024-09-16T03:46:02.844 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T03:46:02.845 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:46:02.845 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:46:02.845 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T03:46:02.846 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:46:02.846 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:46:02.846 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T03:46:02.846 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:46:02.846 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:46:02.846 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:46:02.846 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108643 2024-09-16T03:46:02.847 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.108643/ceph-mon.a.asok 2024-09-16T03:46:02.847 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:46:02.847 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.108643/ceph-mon.a.asok config get mon_host 2024-09-16T03:46:02.959 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:89: TEST_crush_rule_create_erasure: run_osd td/osd-crush 0 2024-09-16T03:46:02.959 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-crush 2024-09-16T03:46:02.959 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T03:46:02.959 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2024-09-16T03:46:02.959 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T03:46:02.960 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-crush/0 2024-09-16T03:46:02.960 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=62b9a41f-dbdc-4178-90d1-b82b7302f923 --auth-supported=none --mon-host=127.0.0.1:7104 ' 2024-09-16T03:46:02.960 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T03:46:02.960 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T03:46:02.960 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T03:46:02.960 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-crush/0' 2024-09-16T03:46:02.960 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-crush/0/journal' 2024-09-16T03:46:02.960 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T03:46:02.960 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T03:46:02.960 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-crush' 2024-09-16T03:46:02.960 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T03:46:02.961 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:46:02.961 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:46:02.961 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:46:02.961 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:46:02.961 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108643 2024-09-16T03:46:02.961 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.108643/$cluster-$name.asok' 2024-09-16T03:46:02.961 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.108643/$cluster-$name.asok' 2024-09-16T03:46:02.961 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T03:46:02.961 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T03:46:02.961 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T03:46:02.961 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-crush/$name.log' 2024-09-16T03:46:02.962 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-crush/$name.pid' 2024-09-16T03:46:02.962 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T03:46:02.962 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T03:46:02.962 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T03:46:02.962 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T03:46:02.962 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T03:46:02.962 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T03:46:02.962 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-crush/0 2024-09-16T03:46:02.963 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T03:46:02.963 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=d5600f93-7ef9-4d4f-8ed1-31ffb3e4d838 2024-09-16T03:46:02.963 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 d5600f93-7ef9-4d4f-8ed1-31ffb3e4d838' 2024-09-16T03:46:02.963 INFO:tasks.workunit.client.0.smithi096.stdout:add osd0 d5600f93-7ef9-4d4f-8ed1-31ffb3e4d838 2024-09-16T03:46:02.963 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T03:46:02.977 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQD6qedmXxRWOhAA7z00rusmnnsnJLjOrK8vkg== 2024-09-16T03:46:02.977 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQD6qedmXxRWOhAA7z00rusmnnsnJLjOrK8vkg=="}' 2024-09-16T03:46:02.977 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new d5600f93-7ef9-4d4f-8ed1-31ffb3e4d838 -i td/osd-crush/0/new.json 2024-09-16T03:46:03.877 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T03:46:03.893 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-crush/0/new.json 2024-09-16T03:46:03.894 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=62b9a41f-dbdc-4178-90d1-b82b7302f923 --auth-supported=none --mon-host=127.0.0.1:7104 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-crush/0 --osd-journal=td/osd-crush/0/journal --chdir= --run-dir=td/osd-crush '--admin-socket=/tmp/ceph-asok.108643/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-crush/$name.log' '--pid-file=td/osd-crush/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQD6qedmXxRWOhAA7z00rusmnnsnJLjOrK8vkg== --osd-uuid d5600f93-7ef9-4d4f-8ed1-31ffb3e4d838 2024-09-16T03:46:03.922 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:46:03.921+0000 7efc3ed1e7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:46:03.945 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:46:03.945+0000 7efc3ed1e7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:46:03.947 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:46:03.945+0000 7efc3ed1e7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:46:03.947 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:46:03.945+0000 7efc3ed1e7c0 -1 bdev(0x561aa7090800 td/osd-crush/0/block) open stat got: (1) Operation not permitted 2024-09-16T03:46:03.947 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:46:03.949+0000 7efc3ed1e7c0 -1 bluestore(td/osd-crush/0) _read_fsid unparsable uuid 2024-09-16T03:46:09.286 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-crush/0/keyring 2024-09-16T03:46:09.287 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T03:46:09.288 INFO:tasks.workunit.client.0.smithi096.stdout:adding osd0 key to auth repository 2024-09-16T03:46:09.288 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2024-09-16T03:46:09.288 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-crush/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T03:46:09.537 INFO:tasks.workunit.client.0.smithi096.stdout:start osd.0 2024-09-16T03:46:09.537 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2024-09-16T03:46:09.537 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=62b9a41f-dbdc-4178-90d1-b82b7302f923 --auth-supported=none --mon-host=127.0.0.1:7104 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-crush/0 --osd-journal=td/osd-crush/0/journal --chdir= --run-dir=td/osd-crush '--admin-socket=/tmp/ceph-asok.108643/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-crush/$name.log' '--pid-file=td/osd-crush/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T03:46:09.538 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T03:46:09.538 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T03:46:09.538 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T03:46:09.567 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:46:09.565+0000 7f2bde6c97c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:46:09.569 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:46:09.569+0000 7f2bde6c97c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:46:09.570 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:46:09.569+0000 7f2bde6c97c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:46:09.767 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2024-09-16T03:46:09.767 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:46:09.767 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2024-09-16T03:46:09.767 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:46:09.767 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:46:09.767 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:46:09.767 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T03:46:09.768 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:46:09.768 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:46:09.768 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:46:09.992 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:46:10.610 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:46:10.609+0000 7f2bde6c97c0 -1 Falling back to public interface 2024-09-16T03:46:10.993 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:46:10.993 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:46:10.993 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T03:46:10.994 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T03:46:10.994 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:46:10.994 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:46:11.225 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:46:12.226 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:46:12.228 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:46:12.228 INFO:tasks.workunit.client.0.smithi096.stdout:2 2024-09-16T03:46:12.228 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T03:46:12.228 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:46:12.229 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:46:12.450 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:46:13.451 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:46:13.451 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:46:13.452 INFO:tasks.workunit.client.0.smithi096.stdout:3 2024-09-16T03:46:13.452 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T03:46:13.452 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:46:13.452 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:46:13.525 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:46:13.525+0000 7f2bde6c97c0 -1 osd.0 0 log_to_monitors true 2024-09-16T03:46:13.777 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:46:14.779 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:46:14.779 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:46:14.779 INFO:tasks.workunit.client.0.smithi096.stdout:4 2024-09-16T03:46:14.780 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T03:46:14.780 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:46:14.780 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:46:15.018 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:46:16.020 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:46:16.020 INFO:tasks.workunit.client.0.smithi096.stdout:5 2024-09-16T03:46:16.021 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:46:16.021 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T03:46:16.021 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:46:16.021 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:46:16.250 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:46:17.252 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:46:17.252 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:46:17.253 INFO:tasks.workunit.client.0.smithi096.stdout:6 2024-09-16T03:46:17.253 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T03:46:17.253 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:46:17.253 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:46:17.484 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:46:18.485 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:46:18.486 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:46:18.486 INFO:tasks.workunit.client.0.smithi096.stdout:7 2024-09-16T03:46:18.486 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T03:46:18.487 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:46:18.487 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:46:18.722 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:46:19.723 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:46:19.723 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:46:19.724 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T03:46:19.724 INFO:tasks.workunit.client.0.smithi096.stdout:8 2024-09-16T03:46:19.724 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:46:19.724 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:46:19.961 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:46:20.962 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:46:20.963 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:46:20.963 INFO:tasks.workunit.client.0.smithi096.stdout:9 2024-09-16T03:46:20.963 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T03:46:20.964 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:46:20.964 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:46:21.200 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:46:22.201 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:46:22.201 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:46:22.202 INFO:tasks.workunit.client.0.smithi096.stdout:10 2024-09-16T03:46:22.202 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T03:46:22.202 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:46:22.202 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:46:22.439 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:46:23.441 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:46:23.441 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:46:23.441 INFO:tasks.workunit.client.0.smithi096.stdout:11 2024-09-16T03:46:23.442 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T03:46:23.442 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:46:23.442 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:46:23.675 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:46:24.676 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:46:24.677 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:46:24.677 INFO:tasks.workunit.client.0.smithi096.stdout:12 2024-09-16T03:46:24.677 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T03:46:24.677 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:46:24.678 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:46:24.911 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:46:25.913 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:46:25.913 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:46:25.913 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T03:46:25.914 INFO:tasks.workunit.client.0.smithi096.stdout:13 2024-09-16T03:46:25.914 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:46:25.914 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:46:26.148 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:46:27.150 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:46:27.150 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:46:27.150 INFO:tasks.workunit.client.0.smithi096.stdout:14 2024-09-16T03:46:27.151 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T03:46:27.151 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:46:27.151 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:46:27.383 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:46:28.385 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:46:28.385 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:46:28.385 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T03:46:28.386 INFO:tasks.workunit.client.0.smithi096.stdout:15 2024-09-16T03:46:28.386 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:46:28.386 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:46:28.621 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:46:29.623 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:46:29.623 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:46:29.623 INFO:tasks.workunit.client.0.smithi096.stdout:16 2024-09-16T03:46:29.624 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T03:46:29.624 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:46:29.624 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:46:29.860 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:46:30.862 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:46:30.863 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:46:30.863 INFO:tasks.workunit.client.0.smithi096.stdout:17 2024-09-16T03:46:30.863 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T03:46:30.863 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:46:30.863 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:46:31.097 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:46:32.100 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:46:32.100 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:46:32.100 INFO:tasks.workunit.client.0.smithi096.stdout:18 2024-09-16T03:46:32.101 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 18 2024-09-16T03:46:32.101 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:46:32.101 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:46:32.336 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:46:33.338 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:46:33.339 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:46:33.339 INFO:tasks.workunit.client.0.smithi096.stdout:19 2024-09-16T03:46:33.339 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 19 2024-09-16T03:46:33.339 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:46:33.340 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:46:33.571 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:46:34.572 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:46:34.573 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:46:34.573 INFO:tasks.workunit.client.0.smithi096.stdout:20 2024-09-16T03:46:34.573 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 20 2024-09-16T03:46:34.574 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:46:34.574 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:46:34.806 INFO:tasks.workunit.client.0.smithi096.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/742447670,v1:127.0.0.1:6801/742447670] [v2:127.0.0.1:6802/742447670,v1:127.0.0.1:6803/742447670] exists,up d5600f93-7ef9-4d4f-8ed1-31ffb3e4d838 2024-09-16T03:46:34.807 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:46:34.807 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:46:34.807 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:46:34.807 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:91: TEST_crush_rule_create_erasure: local rule=rule3 2024-09-16T03:46:34.807 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:95: TEST_crush_rule_create_erasure: ceph osd crush rule create-erasure rule3 2024-09-16T03:46:35.155 INFO:tasks.workunit.client.0.smithi096.stderr:rule rule3 already exists 2024-09-16T03:46:35.172 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:96: TEST_crush_rule_create_erasure: ceph osd crush rule create-erasure rule3 2024-09-16T03:46:35.172 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:97: TEST_crush_rule_create_erasure: grep 'rule3 already exists' 2024-09-16T03:46:35.434 INFO:tasks.workunit.client.0.smithi096.stdout:rule rule3 already exists 2024-09-16T03:46:35.435 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:98: TEST_crush_rule_create_erasure: ceph --format xml osd crush rule dump rule3 2024-09-16T03:46:35.435 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:100: TEST_crush_rule_create_erasure: grep 'chooseleaf_indep0host' 2024-09-16T03:46:35.435 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:99: TEST_crush_rule_create_erasure: egrep 'take[^<]+default' 2024-09-16T03:46:35.673 INFO:tasks.workunit.client.0.smithi096.stdout:1rule33set_chooseleaf_tries5set_choose_tries100take-1defaultchooseleaf_indep0hostemit 2024-09-16T03:46:35.674 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:101: TEST_crush_rule_create_erasure: ceph osd crush rule rm rule3 2024-09-16T03:46:36.040 INFO:tasks.workunit.client.0.smithi096.stderr:rule rule3 does not exist 2024-09-16T03:46:36.058 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:102: TEST_crush_rule_create_erasure: ceph osd crush rule ls 2024-09-16T03:46:36.058 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:102: TEST_crush_rule_create_erasure: grep rule3 2024-09-16T03:46:36.332 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:106: TEST_crush_rule_create_erasure: ceph osd crush rule create-erasure rule3 default 2024-09-16T03:46:36.772 INFO:tasks.workunit.client.0.smithi096.stderr:rule rule3 already exists 2024-09-16T03:46:36.792 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:107: TEST_crush_rule_create_erasure: ceph osd crush rule ls 2024-09-16T03:46:36.792 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:107: TEST_crush_rule_create_erasure: grep rule3 2024-09-16T03:46:37.053 INFO:tasks.workunit.client.0.smithi096.stdout:rule3 2024-09-16T03:46:37.053 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:108: TEST_crush_rule_create_erasure: ceph osd crush rule rm rule3 2024-09-16T03:46:37.463 INFO:tasks.workunit.client.0.smithi096.stderr:rule rule3 does not exist 2024-09-16T03:46:37.484 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:109: TEST_crush_rule_create_erasure: ceph osd crush rule ls 2024-09-16T03:46:37.484 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:109: TEST_crush_rule_create_erasure: grep rule3 2024-09-16T03:46:37.754 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:113: TEST_crush_rule_create_erasure: ceph osd erasure-code-profile rm default 2024-09-16T03:46:38.131 INFO:tasks.workunit.client.0.smithi096.stderr:erasure-code-profile default does not exist 2024-09-16T03:46:38.148 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:114: TEST_crush_rule_create_erasure: ceph osd erasure-code-profile ls 2024-09-16T03:46:38.148 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:114: TEST_crush_rule_create_erasure: grep default 2024-09-16T03:46:38.429 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:115: TEST_crush_rule_create_erasure: ceph osd crush rule create-erasure rule3 2024-09-16T03:46:39.013 INFO:tasks.workunit.client.0.smithi096.stderr:rule rule3 already exists 2024-09-16T03:46:39.033 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:116: TEST_crush_rule_create_erasure: get_asok_path mon.a 2024-09-16T03:46:39.033 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:46:39.033 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:46:39.034 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:46:39.034 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:46:39.034 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108643 2024-09-16T03:46:39.034 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.108643/ceph-mon.a.asok 2024-09-16T03:46:39.035 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:116: TEST_crush_rule_create_erasure: CEPH_ARGS= 2024-09-16T03:46:39.035 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:116: TEST_crush_rule_create_erasure: ceph --admin-daemon /tmp/ceph-asok.108643/ceph-mon.a.asok log flush 2024-09-16T03:46:39.140 INFO:tasks.workunit.client.0.smithi096.stdout:{} 2024-09-16T03:46:39.154 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:117: TEST_crush_rule_create_erasure: grep 'profile set default' td/osd-crush/mon.a.log 2024-09-16T03:46:39.159 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T03:46:38.612+0000 7fcc4a34b640 20 mon.a@0(leader).osd e11 erasure code profile set default={crush-device-class=,crush-failure-domain=host,crush-num-failure-domains=0,crush-osds-per-failure-domain=0,crush-root=default,jerasure-per-chunk-alignment=false,k=2,m=2,plugin=jerasure,technique=reed_sol_van,w=8} 2024-09-16T03:46:39.159 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:118: TEST_crush_rule_create_erasure: ceph osd erasure-code-profile ls 2024-09-16T03:46:39.160 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:118: TEST_crush_rule_create_erasure: grep default 2024-09-16T03:46:39.399 INFO:tasks.workunit.client.0.smithi096.stdout:default 2024-09-16T03:46:39.400 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:119: TEST_crush_rule_create_erasure: ceph osd crush rule rm rule3 2024-09-16T03:46:39.746 INFO:tasks.workunit.client.0.smithi096.stderr:rule rule3 does not exist 2024-09-16T03:46:39.765 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:120: TEST_crush_rule_create_erasure: ceph osd crush rule ls 2024-09-16T03:46:39.765 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:120: TEST_crush_rule_create_erasure: grep rule3 2024-09-16T03:46:40.017 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:33: run: teardown td/osd-crush 2024-09-16T03:46:40.017 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-crush 2024-09-16T03:46:40.017 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:46:40.017 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-crush KILL 2024-09-16T03:46:40.017 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:46:40.018 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:46:40.018 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:46:40.018 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:46:40.018 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:46:40.124 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:46:40.124 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:46:40.125 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:46:40.125 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:46:40.127 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:46:40.127 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:46:40.127 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:46:40.129 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:46:40.129 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:46:40.129 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:46:40.129 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:46:40.130 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:46:40.130 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:46:40.131 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-crush 2024-09-16T03:46:40.135 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:46:40.136 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:46:40.136 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108643 2024-09-16T03:46:40.136 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.108643 2024-09-16T03:46:40.139 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:46:40.139 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:46:40.140 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:30: run: for func in $funcs 2024-09-16T03:46:40.140 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:31: run: setup td/osd-crush 2024-09-16T03:46:40.140 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-crush 2024-09-16T03:46:40.141 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-crush 2024-09-16T03:46:40.141 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-crush 2024-09-16T03:46:40.141 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:46:40.141 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-crush KILL 2024-09-16T03:46:40.142 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:46:40.142 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:46:40.142 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:46:40.143 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:46:40.143 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:46:40.149 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:46:40.149 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:46:40.149 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:46:40.149 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:46:40.150 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:46:40.150 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:46:40.150 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:46:40.150 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:46:40.150 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:46:40.151 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:46:40.151 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:46:40.151 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:46:40.151 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:46:40.151 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-crush 2024-09-16T03:46:40.151 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:46:40.151 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:46:40.151 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108643 2024-09-16T03:46:40.152 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.108643 2024-09-16T03:46:40.152 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:46:40.152 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:46:40.152 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-crush 2024-09-16T03:46:40.152 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T03:46:40.152 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:46:40.152 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108643 2024-09-16T03:46:40.152 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.108643 2024-09-16T03:46:40.154 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T03:46:40.154 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2024-09-16T03:46:40.154 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T03:46:40.154 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-crush 1' TERM HUP INT 2024-09-16T03:46:40.154 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:32: run: TEST_crush_rule_create_simple td/osd-crush 2024-09-16T03:46:40.155 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:38: TEST_crush_rule_create_simple: local dir=td/osd-crush 2024-09-16T03:46:40.155 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:40: TEST_crush_rule_create_simple: run_mon td/osd-crush a 2024-09-16T03:46:40.155 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-crush 2024-09-16T03:46:40.155 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T03:46:40.155 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T03:46:40.155 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T03:46:40.155 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-crush/a 2024-09-16T03:46:40.155 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-crush/a --run-dir=td/osd-crush 2024-09-16T03:46:40.622 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T03:46:40.623 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:46:40.623 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:46:40.623 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:46:40.623 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:46:40.624 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108643 2024-09-16T03:46:40.624 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.108643/$cluster-$name.asok' 2024-09-16T03:46:40.624 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-crush/a '--log-file=td/osd-crush/$name.log' '--admin-socket=/tmp/ceph-asok.108643/$cluster-$name.asok' --mon-cluster-log-file=td/osd-crush/log --run-dir=td/osd-crush '--pid-file=td/osd-crush/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-09-16T03:46:40.836 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T03:46:40.837 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T03:46:40.837 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:46:40.837 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:46:40.837 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T03:46:40.838 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T03:46:40.839 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:46:40.839 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:46:40.839 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:46:40.839 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:46:40.839 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:46:40.839 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108643 2024-09-16T03:46:40.839 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.108643/ceph-mon.a.asok 2024-09-16T03:46:40.840 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:46:40.840 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.108643/ceph-mon.a.asok config get fsid 2024-09-16T03:46:40.956 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T03:46:40.956 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:46:40.956 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:46:40.956 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T03:46:40.957 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T03:46:40.957 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:46:40.957 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:46:40.958 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:46:40.958 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:46:40.958 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:46:40.958 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108643 2024-09-16T03:46:40.958 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.108643/ceph-mon.a.asok 2024-09-16T03:46:40.958 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:46:40.958 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.108643/ceph-mon.a.asok config get mon_host 2024-09-16T03:46:41.068 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:42: TEST_crush_rule_create_simple: ceph --format xml osd crush rule dump replicated_rule 2024-09-16T03:46:41.068 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:43: TEST_crush_rule_create_simple: egrep 'take[^<]+default' 2024-09-16T03:46:41.068 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:44: TEST_crush_rule_create_simple: grep 'choose_firstn0osd' 2024-09-16T03:46:41.919 INFO:tasks.workunit.client.0.smithi096.stdout:0replicated_rule1take-1defaultchoose_firstn0osdemit 2024-09-16T03:46:41.920 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:45: TEST_crush_rule_create_simple: local rule=rule0 2024-09-16T03:46:41.920 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:46: TEST_crush_rule_create_simple: local root=host1 2024-09-16T03:46:41.920 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:47: TEST_crush_rule_create_simple: ceph osd crush add-bucket host1 host 2024-09-16T03:46:42.204 INFO:tasks.workunit.client.0.smithi096.stderr:bucket 'host1' already exists 2024-09-16T03:46:42.220 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:48: TEST_crush_rule_create_simple: local failure_domain=osd 2024-09-16T03:46:42.221 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:49: TEST_crush_rule_create_simple: ceph osd crush rule create-simple rule0 host1 osd 2024-09-16T03:46:42.664 INFO:tasks.workunit.client.0.smithi096.stderr:rule rule0 already exists 2024-09-16T03:46:42.683 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:50: TEST_crush_rule_create_simple: ceph osd crush rule create-simple rule0 host1 osd 2024-09-16T03:46:42.683 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:51: TEST_crush_rule_create_simple: grep 'rule0 already exists' 2024-09-16T03:46:42.938 INFO:tasks.workunit.client.0.smithi096.stdout:rule rule0 already exists 2024-09-16T03:46:42.939 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:53: TEST_crush_rule_create_simple: egrep 'take[^<]+host1' 2024-09-16T03:46:42.939 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:54: TEST_crush_rule_create_simple: grep 'choose_firstn0osd' 2024-09-16T03:46:42.939 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:52: TEST_crush_rule_create_simple: ceph --format xml osd crush rule dump rule0 2024-09-16T03:46:43.180 INFO:tasks.workunit.client.0.smithi096.stdout:1rule01take-2host1choose_firstn0osdemit 2024-09-16T03:46:43.181 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:55: TEST_crush_rule_create_simple: ceph osd crush rule rm rule0 2024-09-16T03:46:43.516 INFO:tasks.workunit.client.0.smithi096.stderr:rule rule0 does not exist 2024-09-16T03:46:43.534 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:33: run: teardown td/osd-crush 2024-09-16T03:46:43.534 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-crush 2024-09-16T03:46:43.534 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:46:43.534 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-crush KILL 2024-09-16T03:46:43.534 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:46:43.534 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:46:43.534 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:46:43.534 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:46:43.535 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:46:43.642 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:46:43.642 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:46:43.643 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:46:43.643 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:46:43.644 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:46:43.645 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:46:43.645 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:46:43.647 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:46:43.647 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:46:43.647 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:46:43.648 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:46:43.648 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:46:43.649 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:46:43.650 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-crush 2024-09-16T03:46:43.652 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:46:43.652 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:46:43.652 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108643 2024-09-16T03:46:43.652 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.108643 2024-09-16T03:46:43.654 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:46:43.654 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:46:43.654 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:30: run: for func in $funcs 2024-09-16T03:46:43.654 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:31: run: setup td/osd-crush 2024-09-16T03:46:43.654 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-crush 2024-09-16T03:46:43.654 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-crush 2024-09-16T03:46:43.654 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-crush 2024-09-16T03:46:43.655 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:46:43.655 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-crush KILL 2024-09-16T03:46:43.655 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:46:43.655 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:46:43.655 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:46:43.655 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:46:43.655 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:46:43.656 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:46:43.657 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:46:43.657 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:46:43.658 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:46:43.659 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:46:43.659 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:46:43.659 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:46:43.660 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:46:43.660 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:46:43.661 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:46:43.661 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:46:43.662 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:46:43.663 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:46:43.663 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-crush 2024-09-16T03:46:43.665 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:46:43.665 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:46:43.665 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108643 2024-09-16T03:46:43.665 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.108643 2024-09-16T03:46:43.666 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:46:43.666 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:46:43.666 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-crush 2024-09-16T03:46:43.668 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T03:46:43.668 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:46:43.668 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108643 2024-09-16T03:46:43.668 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.108643 2024-09-16T03:46:43.669 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T03:46:43.671 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2024-09-16T03:46:43.671 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T03:46:43.671 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-crush 1' TERM HUP INT 2024-09-16T03:46:43.671 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:32: run: TEST_crush_rule_dump td/osd-crush 2024-09-16T03:46:43.671 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:59: TEST_crush_rule_dump: local dir=td/osd-crush 2024-09-16T03:46:43.671 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:61: TEST_crush_rule_dump: run_mon td/osd-crush a 2024-09-16T03:46:43.671 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-crush 2024-09-16T03:46:43.672 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T03:46:43.672 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T03:46:43.672 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T03:46:43.672 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-crush/a 2024-09-16T03:46:43.672 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-crush/a --run-dir=td/osd-crush 2024-09-16T03:46:44.071 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T03:46:44.071 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:46:44.071 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:46:44.071 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:46:44.071 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:46:44.071 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108643 2024-09-16T03:46:44.071 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.108643/$cluster-$name.asok' 2024-09-16T03:46:44.072 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-crush/a '--log-file=td/osd-crush/$name.log' '--admin-socket=/tmp/ceph-asok.108643/$cluster-$name.asok' --mon-cluster-log-file=td/osd-crush/log --run-dir=td/osd-crush '--pid-file=td/osd-crush/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-09-16T03:46:44.280 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T03:46:44.281 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T03:46:44.281 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:46:44.281 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:46:44.282 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T03:46:44.283 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:46:44.283 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:46:44.284 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:46:44.284 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T03:46:44.284 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:46:44.284 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:46:44.284 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108643 2024-09-16T03:46:44.285 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.108643/ceph-mon.a.asok 2024-09-16T03:46:44.285 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:46:44.285 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.108643/ceph-mon.a.asok config get fsid 2024-09-16T03:46:44.401 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T03:46:44.401 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:46:44.401 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:46:44.401 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T03:46:44.402 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T03:46:44.403 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:46:44.403 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:46:44.403 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:46:44.403 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:46:44.403 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:46:44.403 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108643 2024-09-16T03:46:44.403 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.108643/ceph-mon.a.asok 2024-09-16T03:46:44.403 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:46:44.403 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.108643/ceph-mon.a.asok config get mon_host 2024-09-16T03:46:44.516 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:63: TEST_crush_rule_dump: local rule=rule1 2024-09-16T03:46:44.516 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:64: TEST_crush_rule_dump: ceph osd crush rule create-erasure rule1 2024-09-16T03:46:45.423 INFO:tasks.workunit.client.0.smithi096.stderr:rule rule1 already exists 2024-09-16T03:46:45.441 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:66: TEST_crush_rule_dump: ceph --format json osd crush rule dump rule1 2024-09-16T03:46:45.441 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:66: TEST_crush_rule_dump: jq '.rule_name == "rule1"' 2024-09-16T03:46:45.698 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:66: TEST_crush_rule_dump: test true == true 2024-09-16T03:46:45.699 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:68: TEST_crush_rule_dump: jq 'map(select(.rule_name == "rule1")) | length == 1' 2024-09-16T03:46:45.699 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:68: TEST_crush_rule_dump: ceph --format json osd crush rule dump 2024-09-16T03:46:45.921 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:68: TEST_crush_rule_dump: test true == true 2024-09-16T03:46:45.922 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:69: TEST_crush_rule_dump: ceph osd crush rule dump non_existent_rule 2024-09-16T03:46:46.104 INFO:tasks.workunit.client.0.smithi096.stderr:Error ENOENT: unknown crush rule 'non_existent_rule' 2024-09-16T03:46:46.107 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:70: TEST_crush_rule_dump: ceph osd crush rule rm rule1 2024-09-16T03:46:46.437 INFO:tasks.workunit.client.0.smithi096.stderr:rule rule1 does not exist 2024-09-16T03:46:46.454 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:33: run: teardown td/osd-crush 2024-09-16T03:46:46.454 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-crush 2024-09-16T03:46:46.454 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:46:46.454 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-crush KILL 2024-09-16T03:46:46.455 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:46:46.455 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:46:46.455 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:46:46.455 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:46:46.456 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:46:46.564 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:46:46.565 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:46:46.566 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:46:46.567 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:46:46.568 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:46:46.568 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:46:46.569 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:46:46.570 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:46:46.570 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:46:46.570 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:46:46.571 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:46:46.572 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:46:46.573 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:46:46.573 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-crush 2024-09-16T03:46:46.575 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:46:46.575 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:46:46.575 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108643 2024-09-16T03:46:46.575 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.108643 2024-09-16T03:46:46.577 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:46:46.577 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:46:46.577 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:30: run: for func in $funcs 2024-09-16T03:46:46.577 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:31: run: setup td/osd-crush 2024-09-16T03:46:46.578 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-crush 2024-09-16T03:46:46.578 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-crush 2024-09-16T03:46:46.578 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-crush 2024-09-16T03:46:46.578 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:46:46.578 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-crush KILL 2024-09-16T03:46:46.578 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:46:46.578 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:46:46.578 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:46:46.578 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:46:46.578 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:46:46.580 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:46:46.580 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:46:46.581 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:46:46.581 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:46:46.583 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:46:46.583 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:46:46.583 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:46:46.584 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:46:46.584 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:46:46.585 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:46:46.585 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:46:46.585 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:46:46.587 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:46:46.587 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-crush 2024-09-16T03:46:46.588 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:46:46.589 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:46:46.589 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108643 2024-09-16T03:46:46.589 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.108643 2024-09-16T03:46:46.589 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:46:46.590 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:46:46.590 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-crush 2024-09-16T03:46:46.591 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T03:46:46.591 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:46:46.591 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108643 2024-09-16T03:46:46.591 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.108643 2024-09-16T03:46:46.594 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T03:46:46.594 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2024-09-16T03:46:46.594 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T03:46:46.594 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-crush 1' TERM HUP INT 2024-09-16T03:46:46.594 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:32: run: TEST_crush_rule_rm td/osd-crush 2024-09-16T03:46:46.594 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:74: TEST_crush_rule_rm: local rule=erasure2 2024-09-16T03:46:46.595 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:76: TEST_crush_rule_rm: run_mon td/osd-crush a 2024-09-16T03:46:46.595 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-crush 2024-09-16T03:46:46.595 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T03:46:46.595 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T03:46:46.595 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T03:46:46.595 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-crush/a 2024-09-16T03:46:46.595 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-crush/a --run-dir=td/osd-crush 2024-09-16T03:46:47.062 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T03:46:47.062 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:46:47.062 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:46:47.063 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:46:47.063 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:46:47.063 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108643 2024-09-16T03:46:47.063 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.108643/$cluster-$name.asok' 2024-09-16T03:46:47.063 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-crush/a '--log-file=td/osd-crush/$name.log' '--admin-socket=/tmp/ceph-asok.108643/$cluster-$name.asok' --mon-cluster-log-file=td/osd-crush/log --run-dir=td/osd-crush '--pid-file=td/osd-crush/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-09-16T03:46:47.282 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T03:46:47.283 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T03:46:47.283 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:46:47.283 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:46:47.283 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T03:46:47.284 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T03:46:47.284 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:46:47.284 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:46:47.284 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:46:47.285 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:46:47.285 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:46:47.285 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108643 2024-09-16T03:46:47.285 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.108643/ceph-mon.a.asok 2024-09-16T03:46:47.285 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:46:47.285 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.108643/ceph-mon.a.asok config get fsid 2024-09-16T03:46:47.402 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T03:46:47.402 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:46:47.402 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:46:47.402 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T03:46:47.403 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T03:46:47.403 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:46:47.403 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:46:47.403 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:46:47.404 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:46:47.404 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:46:47.404 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108643 2024-09-16T03:46:47.404 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.108643/ceph-mon.a.asok 2024-09-16T03:46:47.404 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:46:47.404 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.108643/ceph-mon.a.asok config get mon_host 2024-09-16T03:46:47.512 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:78: TEST_crush_rule_rm: ceph osd crush rule create-erasure erasure2 default 2024-09-16T03:46:48.393 INFO:tasks.workunit.client.0.smithi096.stderr:rule erasure2 already exists 2024-09-16T03:46:48.410 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:79: TEST_crush_rule_rm: grep erasure2 2024-09-16T03:46:48.410 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:79: TEST_crush_rule_rm: ceph osd crush rule ls 2024-09-16T03:46:48.648 INFO:tasks.workunit.client.0.smithi096.stdout:erasure2 2024-09-16T03:46:48.648 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:80: TEST_crush_rule_rm: ceph osd crush rule rm erasure2 2024-09-16T03:46:48.986 INFO:tasks.workunit.client.0.smithi096.stderr:rule erasure2 does not exist 2024-09-16T03:46:49.004 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:81: TEST_crush_rule_rm: ceph osd crush rule ls 2024-09-16T03:46:49.004 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:81: TEST_crush_rule_rm: grep erasure2 2024-09-16T03:46:49.261 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh:33: run: teardown td/osd-crush 2024-09-16T03:46:49.261 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-crush 2024-09-16T03:46:49.261 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:46:49.261 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-crush KILL 2024-09-16T03:46:49.262 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:46:49.262 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:46:49.262 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:46:49.262 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:46:49.262 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:46:49.369 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:46:49.369 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:46:49.370 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:46:49.371 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:46:49.372 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:46:49.372 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:46:49.372 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:46:49.374 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:46:49.374 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:46:49.375 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:46:49.375 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:46:49.376 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:46:49.377 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:46:49.378 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-crush 2024-09-16T03:46:49.380 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:46:49.380 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:46:49.380 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108643 2024-09-16T03:46:49.380 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.108643 2024-09-16T03:46:49.382 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:46:49.382 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:46:49.382 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2322: main: code=0 2024-09-16T03:46:49.382 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2326: main: teardown td/osd-crush 0 2024-09-16T03:46:49.382 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-crush 2024-09-16T03:46:49.382 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2024-09-16T03:46:49.382 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-crush KILL 2024-09-16T03:46:49.383 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:46:49.383 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:46:49.383 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:46:49.383 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:46:49.383 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:46:49.385 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:46:49.385 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:46:49.386 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:46:49.387 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:46:49.388 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:46:49.388 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:46:49.389 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:46:49.389 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:46:49.389 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:46:49.390 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:46:49.390 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:46:49.391 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:46:49.392 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2024-09-16T03:46:49.392 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-crush 2024-09-16T03:46:49.394 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:46:49.394 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:46:49.394 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.108643 2024-09-16T03:46:49.394 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.108643 2024-09-16T03:46:49.396 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:46:49.396 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:46:49.396 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2327: main: return 0 2024-09-16T03:46:49.397 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-16T03:46:49.398 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-16T03:46:49.451 INFO:tasks.workunit:Running workunit mon/osd-df.sh... 2024-09-16T03:46:49.451 DEBUG:teuthology.orchestra.run.smithi096:workunit test mon/osd-df.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7498493279982dfe87f00616198a5967475f6169 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh 2024-09-16T03:46:49.503 INFO:tasks.workunit.client.0.smithi096.stderr:stty: 'standard input': Inappropriate ioctl for device 2024-09-16T03:46:49.509 INFO:tasks.workunit.client.0.smithi096.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2024-09-16T03:46:49.509 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2315: main: export PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-16T03:46:49.509 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2315: main: PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-16T03:46:49.509 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2316: main: export PYTHONWARNINGS=ignore 2024-09-16T03:46:49.509 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2316: main: PYTHONWARNINGS=ignore 2024-09-16T03:46:49.509 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2317: main: export CEPH_CONF=/dev/null 2024-09-16T03:46:49.509 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2317: main: CEPH_CONF=/dev/null 2024-09-16T03:46:49.509 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2318: main: unset CEPH_ARGS 2024-09-16T03:46:49.510 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2320: main: local code 2024-09-16T03:46:49.510 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2321: main: run td/osd-df 2024-09-16T03:46:49.510 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:6: run: local dir=td/osd-df 2024-09-16T03:46:49.514 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:7: run: shift 2024-09-16T03:46:49.514 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:9: run: export CEPH_MON=127.0.0.1:7113 2024-09-16T03:46:49.514 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:9: run: CEPH_MON=127.0.0.1:7113 2024-09-16T03:46:49.514 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:10: run: export CEPH_ARGS 2024-09-16T03:46:49.514 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:11: run: uuidgen 2024-09-16T03:46:49.515 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:11: run: CEPH_ARGS+='--fsid=91752bc1-5e86-4795-8590-210b4f9a03be --auth-supported=none ' 2024-09-16T03:46:49.516 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:12: run: CEPH_ARGS+='--mon-host=127.0.0.1:7113 ' 2024-09-16T03:46:49.516 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:14: run: set 2024-09-16T03:46:49.516 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:14: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2024-09-16T03:46:49.516 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:14: run: local funcs=TEST_osd_df 2024-09-16T03:46:49.516 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:15: run: for func in $funcs 2024-09-16T03:46:49.516 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:16: run: setup td/osd-df 2024-09-16T03:46:49.516 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-df 2024-09-16T03:46:49.516 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-df 2024-09-16T03:46:49.516 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-df 2024-09-16T03:46:49.516 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:46:49.516 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-df KILL 2024-09-16T03:46:49.517 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:46:49.517 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:46:49.517 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:46:49.517 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:46:49.517 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:46:49.517 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:46:49.517 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:46:49.517 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:46:49.518 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:46:49.519 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:46:49.519 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:46:49.519 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:46:49.520 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:46:49.520 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:46:49.521 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:46:49.521 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:46:49.522 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:46:49.523 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:46:49.523 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-df 2024-09-16T03:46:49.524 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:46:49.524 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:46:49.525 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114720 2024-09-16T03:46:49.525 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.114720 2024-09-16T03:46:49.525 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:46:49.526 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:46:49.526 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-df 2024-09-16T03:46:49.527 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T03:46:49.527 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:46:49.527 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114720 2024-09-16T03:46:49.527 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.114720 2024-09-16T03:46:49.530 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T03:46:49.530 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2024-09-16T03:46:49.530 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2024-09-16T03:46:49.530 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T03:46:49.531 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-df 1' TERM HUP INT 2024-09-16T03:46:49.531 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:17: run: TEST_osd_df td/osd-df 2024-09-16T03:46:49.531 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:23: TEST_osd_df: local dir=td/osd-df 2024-09-16T03:46:49.531 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:24: TEST_osd_df: setup td/osd-df 2024-09-16T03:46:49.531 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-df 2024-09-16T03:46:49.531 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-df 2024-09-16T03:46:49.531 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-df 2024-09-16T03:46:49.531 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:46:49.531 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-df KILL 2024-09-16T03:46:49.531 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:46:49.531 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:46:49.531 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:46:49.531 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:46:49.532 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:46:49.532 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:46:49.532 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:46:49.533 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:46:49.534 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:46:49.535 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:46:49.535 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:46:49.535 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:46:49.536 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:46:49.536 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:46:49.537 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:46:49.537 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:46:49.537 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:46:49.539 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:46:49.539 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-df 2024-09-16T03:46:49.541 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:46:49.541 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:46:49.541 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114720 2024-09-16T03:46:49.541 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.114720 2024-09-16T03:46:49.542 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:46:49.542 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:46:49.542 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-df 2024-09-16T03:46:49.543 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T03:46:49.543 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:46:49.543 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114720 2024-09-16T03:46:49.543 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.114720 2024-09-16T03:46:49.545 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T03:46:49.545 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2024-09-16T03:46:49.546 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T03:46:49.546 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-df 1' TERM HUP INT 2024-09-16T03:46:49.546 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:26: TEST_osd_df: run_mon td/osd-df a 2024-09-16T03:46:49.546 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-df 2024-09-16T03:46:49.546 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T03:46:49.546 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T03:46:49.546 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T03:46:49.546 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-df/a 2024-09-16T03:46:49.546 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-df/a --run-dir=td/osd-df 2024-09-16T03:46:50.058 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T03:46:50.058 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:46:50.058 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:46:50.058 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:46:50.058 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:46:50.058 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114720 2024-09-16T03:46:50.058 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.114720/$cluster-$name.asok' 2024-09-16T03:46:50.059 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-df/a '--log-file=td/osd-df/$name.log' '--admin-socket=/tmp/ceph-asok.114720/$cluster-$name.asok' --mon-cluster-log-file=td/osd-df/log --run-dir=td/osd-df '--pid-file=td/osd-df/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-09-16T03:46:50.248 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T03:46:50.249 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T03:46:50.249 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:46:50.249 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:46:50.249 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T03:46:50.250 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T03:46:50.250 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:46:50.251 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:46:50.251 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:46:50.251 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:46:50.251 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:46:50.251 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114720 2024-09-16T03:46:50.251 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.114720/ceph-mon.a.asok 2024-09-16T03:46:50.251 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:46:50.251 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.114720/ceph-mon.a.asok config get fsid 2024-09-16T03:46:50.369 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T03:46:50.369 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:46:50.369 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:46:50.369 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T03:46:50.369 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T03:46:50.370 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:46:50.370 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:46:50.370 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:46:50.371 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:46:50.371 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:46:50.371 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114720 2024-09-16T03:46:50.371 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.114720/ceph-mon.a.asok 2024-09-16T03:46:50.371 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:46:50.371 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.114720/ceph-mon.a.asok config get mon_host 2024-09-16T03:46:50.473 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:27: TEST_osd_df: run_mgr td/osd-df x 2024-09-16T03:46:50.473 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-df 2024-09-16T03:46:50.473 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2024-09-16T03:46:50.473 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2024-09-16T03:46:50.473 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2024-09-16T03:46:50.473 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-df/x 2024-09-16T03:46:50.473 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2024-09-16T03:46:50.971 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2024-09-16T03:46:50.972 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:46:50.972 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:46:50.972 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:46:50.972 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:46:50.972 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114720 2024-09-16T03:46:50.973 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.114720/$cluster-$name.asok' 2024-09-16T03:46:50.973 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T03:46:50.974 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-df/x '--log-file=td/osd-df/$name.log' '--admin-socket=/tmp/ceph-asok.114720/$cluster-$name.asok' --run-dir=td/osd-df '--pid-file=td/osd-df/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T03:46:51.003 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:28: TEST_osd_df: run_osd td/osd-df 0 2024-09-16T03:46:51.004 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-df 2024-09-16T03:46:51.004 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T03:46:51.004 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2024-09-16T03:46:51.004 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T03:46:51.004 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-df/0 2024-09-16T03:46:51.004 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=91752bc1-5e86-4795-8590-210b4f9a03be --auth-supported=none --mon-host=127.0.0.1:7113 ' 2024-09-16T03:46:51.004 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T03:46:51.004 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T03:46:51.004 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T03:46:51.004 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-df/0' 2024-09-16T03:46:51.004 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-df/0/journal' 2024-09-16T03:46:51.005 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T03:46:51.005 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T03:46:51.005 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-df' 2024-09-16T03:46:51.005 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T03:46:51.005 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:46:51.005 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:46:51.005 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:46:51.005 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:46:51.005 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114720 2024-09-16T03:46:51.005 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.114720/$cluster-$name.asok' 2024-09-16T03:46:51.005 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.114720/$cluster-$name.asok' 2024-09-16T03:46:51.005 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T03:46:51.005 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T03:46:51.006 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T03:46:51.006 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-df/$name.log' 2024-09-16T03:46:51.006 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-df/$name.pid' 2024-09-16T03:46:51.006 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T03:46:51.006 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T03:46:51.006 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T03:46:51.006 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T03:46:51.006 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T03:46:51.006 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T03:46:51.006 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-df/0 2024-09-16T03:46:51.007 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T03:46:51.007 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=beca4999-f3be-40e0-b4de-f89312f85dad 2024-09-16T03:46:51.007 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 beca4999-f3be-40e0-b4de-f89312f85dad' 2024-09-16T03:46:51.007 INFO:tasks.workunit.client.0.smithi096.stdout:add osd0 beca4999-f3be-40e0-b4de-f89312f85dad 2024-09-16T03:46:51.007 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T03:46:51.022 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQArqudm1PpmARAAz6r4Oe+Q9tqRYg3WZ1L4/g== 2024-09-16T03:46:51.022 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQArqudm1PpmARAAz6r4Oe+Q9tqRYg3WZ1L4/g=="}' 2024-09-16T03:46:51.022 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new beca4999-f3be-40e0-b4de-f89312f85dad -i td/osd-df/0/new.json 2024-09-16T03:46:51.312 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T03:46:51.327 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-df/0/new.json 2024-09-16T03:46:51.328 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=91752bc1-5e86-4795-8590-210b4f9a03be --auth-supported=none --mon-host=127.0.0.1:7113 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-df/0 --osd-journal=td/osd-df/0/journal --chdir= --run-dir=td/osd-df '--admin-socket=/tmp/ceph-asok.114720/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-df/$name.log' '--pid-file=td/osd-df/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQArqudm1PpmARAAz6r4Oe+Q9tqRYg3WZ1L4/g== --osd-uuid beca4999-f3be-40e0-b4de-f89312f85dad 2024-09-16T03:46:51.353 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:46:51.352+0000 7fd33607f7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:46:51.382 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:46:51.380+0000 7fd33607f7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:46:51.383 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:46:51.380+0000 7fd33607f7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:46:51.383 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:46:51.380+0000 7fd33607f7c0 -1 bdev(0x55a5df6d5c00 td/osd-df/0/block) open stat got: (1) Operation not permitted 2024-09-16T03:46:51.383 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:46:51.380+0000 7fd33607f7c0 -1 bluestore(td/osd-df/0) _read_fsid unparsable uuid 2024-09-16T03:46:57.289 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-df/0/keyring 2024-09-16T03:46:57.289 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T03:46:57.290 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2024-09-16T03:46:57.290 INFO:tasks.workunit.client.0.smithi096.stdout:adding osd0 key to auth repository 2024-09-16T03:46:57.290 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-df/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T03:46:57.879 INFO:tasks.workunit.client.0.smithi096.stdout:start osd.0 2024-09-16T03:46:57.880 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2024-09-16T03:46:57.880 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=91752bc1-5e86-4795-8590-210b4f9a03be --auth-supported=none --mon-host=127.0.0.1:7113 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-df/0 --osd-journal=td/osd-df/0/journal --chdir= --run-dir=td/osd-df '--admin-socket=/tmp/ceph-asok.114720/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-df/$name.log' '--pid-file=td/osd-df/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T03:46:57.880 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T03:46:57.880 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T03:46:57.880 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T03:46:57.908 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:46:57.908+0000 7f08f5a797c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:46:57.911 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:46:57.908+0000 7f08f5a797c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:46:57.912 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:46:57.912+0000 7f08f5a797c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:46:58.364 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2024-09-16T03:46:58.364 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:46:58.364 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2024-09-16T03:46:58.364 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:46:58.364 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T03:46:58.365 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:46:58.365 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:46:58.365 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:46:58.365 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:46:58.365 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:46:58.840 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:46:58.930 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:46:58.928+0000 7f08f5a797c0 -1 Falling back to public interface 2024-09-16T03:46:59.842 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:46:59.842 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:46:59.842 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T03:46:59.842 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T03:46:59.843 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:46:59.843 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:47:00.299 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:47:01.301 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:47:01.301 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:47:01.301 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T03:47:01.301 INFO:tasks.workunit.client.0.smithi096.stdout:2 2024-09-16T03:47:01.302 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:47:01.302 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:47:01.558 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:47:01.556+0000 7f08f5a797c0 -1 osd.0 0 log_to_monitors true 2024-09-16T03:47:01.769 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:47:02.771 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:47:02.771 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:47:02.771 INFO:tasks.workunit.client.0.smithi096.stdout:3 2024-09-16T03:47:02.772 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T03:47:02.772 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:47:02.772 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:47:03.325 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:47:04.327 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:47:04.327 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:47:04.327 INFO:tasks.workunit.client.0.smithi096.stdout:4 2024-09-16T03:47:04.328 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T03:47:04.328 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:47:04.328 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:47:04.750 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:47:05.752 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:47:05.753 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:47:05.753 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T03:47:05.753 INFO:tasks.workunit.client.0.smithi096.stdout:5 2024-09-16T03:47:05.753 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:47:05.753 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:47:06.336 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:47:07.338 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:47:07.338 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:47:07.338 INFO:tasks.workunit.client.0.smithi096.stdout:6 2024-09-16T03:47:07.339 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T03:47:07.339 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:47:07.339 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:47:07.761 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:47:08.762 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:47:08.762 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:47:08.762 INFO:tasks.workunit.client.0.smithi096.stdout:7 2024-09-16T03:47:08.763 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T03:47:08.763 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:47:08.763 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:47:09.304 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:47:10.306 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:47:10.306 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:47:10.306 INFO:tasks.workunit.client.0.smithi096.stdout:8 2024-09-16T03:47:10.307 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T03:47:10.307 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:47:10.307 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:47:10.758 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:47:11.760 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:47:11.760 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:47:11.761 INFO:tasks.workunit.client.0.smithi096.stdout:9 2024-09-16T03:47:11.761 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T03:47:11.761 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:47:11.761 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:47:12.331 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:47:13.333 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:47:13.333 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:47:13.333 INFO:tasks.workunit.client.0.smithi096.stdout:10 2024-09-16T03:47:13.334 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T03:47:13.334 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:47:13.334 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:47:14.116 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:47:15.117 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:47:15.118 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:47:15.118 INFO:tasks.workunit.client.0.smithi096.stdout:11 2024-09-16T03:47:15.118 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T03:47:15.118 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:47:15.119 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:47:15.540 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:47:16.542 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:47:16.542 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:47:16.542 INFO:tasks.workunit.client.0.smithi096.stdout:12 2024-09-16T03:47:16.543 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T03:47:16.543 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:47:16.543 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:47:17.284 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:47:18.285 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:47:18.285 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:47:18.285 INFO:tasks.workunit.client.0.smithi096.stdout:13 2024-09-16T03:47:18.286 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T03:47:18.286 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:47:18.286 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:47:19.339 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:47:20.340 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:47:20.341 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:47:20.341 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T03:47:20.341 INFO:tasks.workunit.client.0.smithi096.stdout:14 2024-09-16T03:47:20.341 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:47:20.341 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:47:21.414 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:47:22.415 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:47:22.416 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:47:22.416 INFO:tasks.workunit.client.0.smithi096.stdout:15 2024-09-16T03:47:22.416 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T03:47:22.417 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:47:22.417 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:47:23.292 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:47:24.294 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:47:24.294 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:47:24.294 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T03:47:24.295 INFO:tasks.workunit.client.0.smithi096.stdout:16 2024-09-16T03:47:24.295 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:47:24.295 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:47:24.750 INFO:tasks.workunit.client.0.smithi096.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/1013700529,v1:127.0.0.1:6803/1013700529] [v2:127.0.0.1:6804/1013700529,v1:127.0.0.1:6805/1013700529] exists,up beca4999-f3be-40e0-b4de-f89312f85dad 2024-09-16T03:47:24.752 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:47:24.752 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:47:24.752 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:47:24.752 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:29: TEST_osd_df: run_osd td/osd-df 1 2024-09-16T03:47:24.752 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-df 2024-09-16T03:47:24.752 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T03:47:24.752 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2024-09-16T03:47:24.752 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T03:47:24.752 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-df/1 2024-09-16T03:47:24.752 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=91752bc1-5e86-4795-8590-210b4f9a03be --auth-supported=none --mon-host=127.0.0.1:7113 ' 2024-09-16T03:47:24.752 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T03:47:24.753 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T03:47:24.753 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T03:47:24.753 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-df/1' 2024-09-16T03:47:24.753 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-df/1/journal' 2024-09-16T03:47:24.753 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T03:47:24.753 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T03:47:24.753 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-df' 2024-09-16T03:47:24.753 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T03:47:24.753 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:47:24.753 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:47:24.753 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:47:24.753 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:47:24.753 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114720 2024-09-16T03:47:24.754 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.114720/$cluster-$name.asok' 2024-09-16T03:47:24.755 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.114720/$cluster-$name.asok' 2024-09-16T03:47:24.755 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T03:47:24.755 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T03:47:24.755 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T03:47:24.755 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-df/$name.log' 2024-09-16T03:47:24.755 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-df/$name.pid' 2024-09-16T03:47:24.755 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T03:47:24.755 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T03:47:24.755 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T03:47:24.755 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T03:47:24.756 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T03:47:24.756 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T03:47:24.756 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-df/1 2024-09-16T03:47:24.756 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T03:47:24.756 INFO:tasks.workunit.client.0.smithi096.stdout:add osd1 aba5848c-9bec-4ff4-8bd3-c19bdff6b3cf 2024-09-16T03:47:24.756 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=aba5848c-9bec-4ff4-8bd3-c19bdff6b3cf 2024-09-16T03:47:24.756 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 aba5848c-9bec-4ff4-8bd3-c19bdff6b3cf' 2024-09-16T03:47:24.757 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T03:47:24.774 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBMqudmQLY8LhAAtvCUQNDq0HqvbCnxxTr0Xg== 2024-09-16T03:47:24.774 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBMqudmQLY8LhAAtvCUQNDq0HqvbCnxxTr0Xg=="}' 2024-09-16T03:47:24.774 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new aba5848c-9bec-4ff4-8bd3-c19bdff6b3cf -i td/osd-df/1/new.json 2024-09-16T03:47:25.322 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T03:47:25.337 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-df/1/new.json 2024-09-16T03:47:25.339 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=91752bc1-5e86-4795-8590-210b4f9a03be --auth-supported=none --mon-host=127.0.0.1:7113 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-df/1 --osd-journal=td/osd-df/1/journal --chdir= --run-dir=td/osd-df '--admin-socket=/tmp/ceph-asok.114720/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-df/$name.log' '--pid-file=td/osd-df/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBMqudmQLY8LhAAtvCUQNDq0HqvbCnxxTr0Xg== --osd-uuid aba5848c-9bec-4ff4-8bd3-c19bdff6b3cf 2024-09-16T03:47:25.371 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:47:25.367+0000 7f83f00107c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:47:25.396 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:47:25.395+0000 7f83f00107c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:47:25.397 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:47:25.395+0000 7f83f00107c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:47:25.398 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:47:25.395+0000 7f83f00107c0 -1 bdev(0x55daee4d4800 td/osd-df/1/block) open stat got: (1) Operation not permitted 2024-09-16T03:47:25.398 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:47:25.395+0000 7f83f00107c0 -1 bluestore(td/osd-df/1) _read_fsid unparsable uuid 2024-09-16T03:47:31.488 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-df/1/keyring 2024-09-16T03:47:31.488 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T03:47:31.489 INFO:tasks.workunit.client.0.smithi096.stdout:adding osd1 key to auth repository 2024-09-16T03:47:31.489 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2024-09-16T03:47:31.489 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-df/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T03:47:32.060 INFO:tasks.workunit.client.0.smithi096.stdout:start osd.1 2024-09-16T03:47:32.061 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2024-09-16T03:47:32.061 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T03:47:32.061 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=91752bc1-5e86-4795-8590-210b4f9a03be --auth-supported=none --mon-host=127.0.0.1:7113 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-df/1 --osd-journal=td/osd-df/1/journal --chdir= --run-dir=td/osd-df '--admin-socket=/tmp/ceph-asok.114720/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-df/$name.log' '--pid-file=td/osd-df/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T03:47:32.061 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T03:47:32.061 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T03:47:32.090 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:47:32.087+0000 7ff3200e67c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:47:32.116 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:47:32.115+0000 7ff3200e67c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:47:32.117 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:47:32.115+0000 7ff3200e67c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:47:32.490 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2024-09-16T03:47:32.491 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:47:32.491 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2024-09-16T03:47:32.491 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:47:32.491 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:47:32.491 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:47:32.491 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T03:47:32.492 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:47:32.492 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:47:32.492 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:47:32.908 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:47:33.587 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:47:33.583+0000 7ff3200e67c0 -1 Falling back to public interface 2024-09-16T03:47:33.909 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:47:33.909 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:47:33.910 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T03:47:33.910 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T03:47:33.910 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:47:33.910 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:47:34.372 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:47:35.374 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:47:35.374 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:47:35.374 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T03:47:35.374 INFO:tasks.workunit.client.0.smithi096.stdout:2 2024-09-16T03:47:35.375 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:47:35.375 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:47:35.941 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:47:36.531 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:47:36.527+0000 7ff3200e67c0 -1 osd.1 0 log_to_monitors true 2024-09-16T03:47:36.943 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:47:36.943 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:47:36.943 INFO:tasks.workunit.client.0.smithi096.stdout:3 2024-09-16T03:47:36.944 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T03:47:36.944 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:47:36.944 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:47:37.506 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:47:38.508 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:47:38.508 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:47:38.508 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T03:47:38.508 INFO:tasks.workunit.client.0.smithi096.stdout:4 2024-09-16T03:47:38.509 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:47:38.509 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:47:38.947 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:47:39.948 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:47:39.949 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:47:39.949 INFO:tasks.workunit.client.0.smithi096.stdout:5 2024-09-16T03:47:39.949 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T03:47:39.949 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:47:39.950 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:47:40.430 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:47:41.432 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:47:41.432 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:47:41.432 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T03:47:41.432 INFO:tasks.workunit.client.0.smithi096.stdout:6 2024-09-16T03:47:41.433 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:47:41.433 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:47:41.881 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:47:42.883 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:47:42.883 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:47:42.883 INFO:tasks.workunit.client.0.smithi096.stdout:7 2024-09-16T03:47:42.884 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T03:47:42.884 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:47:42.884 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:47:43.427 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:47:44.428 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:47:44.428 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:47:44.429 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T03:47:44.429 INFO:tasks.workunit.client.0.smithi096.stdout:8 2024-09-16T03:47:44.429 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:47:44.429 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:47:44.870 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:47:45.871 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:47:45.871 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:47:45.872 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T03:47:45.872 INFO:tasks.workunit.client.0.smithi096.stdout:9 2024-09-16T03:47:45.873 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:47:45.873 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:47:46.338 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:47:47.340 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:47:47.340 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:47:47.340 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T03:47:47.340 INFO:tasks.workunit.client.0.smithi096.stdout:10 2024-09-16T03:47:47.341 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:47:47.341 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:47:47.761 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:47:48.763 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:47:48.763 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:47:48.763 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T03:47:48.763 INFO:tasks.workunit.client.0.smithi096.stdout:11 2024-09-16T03:47:48.763 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:47:48.764 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:47:49.188 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:47:50.190 INFO:tasks.workunit.client.0.smithi096.stdout:12 2024-09-16T03:47:50.191 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:47:50.192 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:47:50.192 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T03:47:50.192 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:47:50.192 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:47:51.178 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:47:52.179 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:47:52.180 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:47:52.180 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T03:47:52.180 INFO:tasks.workunit.client.0.smithi096.stdout:13 2024-09-16T03:47:52.180 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:47:52.181 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:47:52.963 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:47:53.964 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:47:53.965 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:47:53.965 INFO:tasks.workunit.client.0.smithi096.stdout:14 2024-09-16T03:47:53.965 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T03:47:53.965 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:47:53.965 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:47:54.485 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:47:55.486 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:47:55.487 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:47:55.487 INFO:tasks.workunit.client.0.smithi096.stdout:15 2024-09-16T03:47:55.487 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T03:47:55.488 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:47:55.488 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:47:56.487 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:47:57.489 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:47:57.489 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:47:57.489 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T03:47:57.490 INFO:tasks.workunit.client.0.smithi096.stdout:16 2024-09-16T03:47:57.490 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:47:57.490 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:47:58.432 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:47:59.433 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:47:59.433 INFO:tasks.workunit.client.0.smithi096.stdout:17 2024-09-16T03:47:59.434 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:47:59.434 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T03:47:59.434 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:47:59.434 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:47:59.886 INFO:tasks.workunit.client.0.smithi096.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/2915663318,v1:127.0.0.1:6811/2915663318] [v2:127.0.0.1:6812/2915663318,v1:127.0.0.1:6813/2915663318] exists,up aba5848c-9bec-4ff4-8bd3-c19bdff6b3cf 2024-09-16T03:47:59.887 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:47:59.888 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:47:59.888 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:47:59.888 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:30: TEST_osd_df: run_osd td/osd-df 2 2024-09-16T03:47:59.888 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-df 2024-09-16T03:47:59.888 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T03:47:59.888 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2024-09-16T03:47:59.888 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T03:47:59.888 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-df/2 2024-09-16T03:47:59.888 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=91752bc1-5e86-4795-8590-210b4f9a03be --auth-supported=none --mon-host=127.0.0.1:7113 ' 2024-09-16T03:47:59.888 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T03:47:59.888 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T03:47:59.888 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T03:47:59.889 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-df/2' 2024-09-16T03:47:59.889 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-df/2/journal' 2024-09-16T03:47:59.889 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T03:47:59.889 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T03:47:59.889 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-df' 2024-09-16T03:47:59.890 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T03:47:59.890 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:47:59.890 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:47:59.890 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:47:59.891 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:47:59.891 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114720 2024-09-16T03:47:59.891 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.114720/$cluster-$name.asok' 2024-09-16T03:47:59.891 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.114720/$cluster-$name.asok' 2024-09-16T03:47:59.891 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T03:47:59.891 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T03:47:59.891 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T03:47:59.891 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-df/$name.log' 2024-09-16T03:47:59.891 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-df/$name.pid' 2024-09-16T03:47:59.891 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T03:47:59.891 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T03:47:59.891 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T03:47:59.891 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T03:47:59.891 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T03:47:59.892 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T03:47:59.892 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-df/2 2024-09-16T03:47:59.892 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T03:47:59.892 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=27de28a1-0a3f-42f6-a687-4e8490963dfe 2024-09-16T03:47:59.892 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 27de28a1-0a3f-42f6-a687-4e8490963dfe' 2024-09-16T03:47:59.893 INFO:tasks.workunit.client.0.smithi096.stdout:add osd2 27de28a1-0a3f-42f6-a687-4e8490963dfe 2024-09-16T03:47:59.893 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T03:47:59.913 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBvqudm5Uh+NhAA9kmZ70Fn6vkm6xzE4uh87g== 2024-09-16T03:47:59.913 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBvqudm5Uh+NhAA9kmZ70Fn6vkm6xzE4uh87g=="}' 2024-09-16T03:47:59.913 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 27de28a1-0a3f-42f6-a687-4e8490963dfe -i td/osd-df/2/new.json 2024-09-16T03:48:00.540 INFO:tasks.workunit.client.0.smithi096.stdout:2 2024-09-16T03:48:00.557 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-df/2/new.json 2024-09-16T03:48:00.559 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=91752bc1-5e86-4795-8590-210b4f9a03be --auth-supported=none --mon-host=127.0.0.1:7113 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-df/2 --osd-journal=td/osd-df/2/journal --chdir= --run-dir=td/osd-df '--admin-socket=/tmp/ceph-asok.114720/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-df/$name.log' '--pid-file=td/osd-df/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBvqudm5Uh+NhAA9kmZ70Fn6vkm6xzE4uh87g== --osd-uuid 27de28a1-0a3f-42f6-a687-4e8490963dfe 2024-09-16T03:48:00.591 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:48:00.586+0000 7f0efc0247c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:48:00.595 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:48:00.590+0000 7f0efc0247c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:48:00.596 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:48:00.594+0000 7f0efc0247c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:48:00.597 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:48:00.594+0000 7f0efc0247c0 -1 bdev(0x5623dd07fc00 td/osd-df/2/block) open stat got: (1) Operation not permitted 2024-09-16T03:48:00.597 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:48:00.594+0000 7f0efc0247c0 -1 bluestore(td/osd-df/2) _read_fsid unparsable uuid 2024-09-16T03:48:06.501 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-df/2/keyring 2024-09-16T03:48:06.502 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T03:48:06.502 INFO:tasks.workunit.client.0.smithi096.stdout:adding osd2 key to auth repository 2024-09-16T03:48:06.503 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2024-09-16T03:48:06.503 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-df/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T03:48:07.077 INFO:tasks.workunit.client.0.smithi096.stdout:start osd.2 2024-09-16T03:48:07.078 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2024-09-16T03:48:07.078 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=91752bc1-5e86-4795-8590-210b4f9a03be --auth-supported=none --mon-host=127.0.0.1:7113 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-df/2 --osd-journal=td/osd-df/2/journal --chdir= --run-dir=td/osd-df '--admin-socket=/tmp/ceph-asok.114720/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-df/$name.log' '--pid-file=td/osd-df/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T03:48:07.079 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T03:48:07.079 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T03:48:07.079 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T03:48:07.106 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:48:07.102+0000 7fb6c3c487c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:48:07.119 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:48:07.114+0000 7fb6c3c487c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:48:07.121 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:48:07.118+0000 7fb6c3c487c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:48:07.549 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2024-09-16T03:48:07.549 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:48:07.549 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2024-09-16T03:48:07.549 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:48:07.549 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:48:07.549 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:48:07.550 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:48:07.550 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T03:48:07.550 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:48:07.550 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:48:07.987 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:48:08.187 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:48:08.182+0000 7fb6c3c487c0 -1 Falling back to public interface 2024-09-16T03:48:08.989 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:48:08.989 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:48:08.989 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T03:48:08.990 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T03:48:08.990 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:48:08.990 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:48:09.451 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:48:10.453 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:48:10.453 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:48:10.453 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T03:48:10.453 INFO:tasks.workunit.client.0.smithi096.stdout:2 2024-09-16T03:48:10.454 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:48:10.454 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:48:10.881 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:48:10.884 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:48:10.886+0000 7fb6c3c487c0 -1 osd.2 0 log_to_monitors true 2024-09-16T03:48:11.883 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:48:11.883 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:48:11.883 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T03:48:11.883 INFO:tasks.workunit.client.0.smithi096.stdout:3 2024-09-16T03:48:11.884 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:48:11.884 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:48:12.564 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:48:13.566 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:48:13.566 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:48:13.567 INFO:tasks.workunit.client.0.smithi096.stdout:4 2024-09-16T03:48:13.567 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T03:48:13.567 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:48:13.567 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:48:14.067 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:48:15.069 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:48:15.069 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:48:15.069 INFO:tasks.workunit.client.0.smithi096.stdout:5 2024-09-16T03:48:15.070 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T03:48:15.070 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:48:15.070 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:48:15.523 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:48:16.525 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:48:16.525 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:48:16.525 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T03:48:16.525 INFO:tasks.workunit.client.0.smithi096.stdout:6 2024-09-16T03:48:16.526 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:48:16.526 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:48:16.996 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:48:17.998 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:48:17.998 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:48:17.998 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T03:48:17.998 INFO:tasks.workunit.client.0.smithi096.stdout:7 2024-09-16T03:48:17.999 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:48:17.999 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:48:18.546 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:48:19.548 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:48:19.548 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:48:19.548 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T03:48:19.549 INFO:tasks.workunit.client.0.smithi096.stdout:8 2024-09-16T03:48:19.549 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:48:19.549 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:48:20.127 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:48:21.129 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:48:21.129 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:48:21.129 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T03:48:21.130 INFO:tasks.workunit.client.0.smithi096.stdout:9 2024-09-16T03:48:21.130 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:48:21.130 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:48:21.583 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:48:22.585 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:48:22.585 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:48:22.585 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T03:48:22.585 INFO:tasks.workunit.client.0.smithi096.stdout:10 2024-09-16T03:48:22.586 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:48:22.586 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:48:23.110 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:48:24.112 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:48:24.113 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:48:24.113 INFO:tasks.workunit.client.0.smithi096.stdout:11 2024-09-16T03:48:24.113 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T03:48:24.113 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:48:24.114 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:48:25.266 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:48:26.268 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:48:26.268 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:48:26.268 INFO:tasks.workunit.client.0.smithi096.stdout:12 2024-09-16T03:48:26.269 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T03:48:26.269 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:48:26.269 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:48:27.555 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:48:28.557 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:48:28.557 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:48:28.557 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T03:48:28.557 INFO:tasks.workunit.client.0.smithi096.stdout:13 2024-09-16T03:48:28.558 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:48:28.558 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:48:29.458 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:48:30.460 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:48:30.460 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:48:30.461 INFO:tasks.workunit.client.0.smithi096.stdout:14 2024-09-16T03:48:30.462 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T03:48:30.462 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:48:30.462 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:48:31.234 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:48:32.236 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:48:32.236 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:48:32.236 INFO:tasks.workunit.client.0.smithi096.stdout:15 2024-09-16T03:48:32.237 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T03:48:32.237 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:48:32.237 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:48:32.894 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:48:33.895 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:48:33.896 INFO:tasks.workunit.client.0.smithi096.stdout:16 2024-09-16T03:48:33.896 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:48:33.896 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T03:48:33.896 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:48:33.896 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:48:34.338 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:48:35.340 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:48:35.340 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:48:35.341 INFO:tasks.workunit.client.0.smithi096.stdout:17 2024-09-16T03:48:35.341 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T03:48:35.341 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:48:35.341 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:48:35.803 INFO:tasks.workunit.client.0.smithi096.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/585201625,v1:127.0.0.1:6819/585201625] [v2:127.0.0.1:6820/585201625,v1:127.0.0.1:6821/585201625] exists,up 27de28a1-0a3f-42f6-a687-4e8490963dfe 2024-09-16T03:48:35.806 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:48:35.806 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:48:35.806 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:48:35.806 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:31: TEST_osd_df: run_osd td/osd-df 3 2024-09-16T03:48:35.806 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-df 2024-09-16T03:48:35.806 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T03:48:35.806 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2024-09-16T03:48:35.807 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T03:48:35.807 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-df/3 2024-09-16T03:48:35.807 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=91752bc1-5e86-4795-8590-210b4f9a03be --auth-supported=none --mon-host=127.0.0.1:7113 ' 2024-09-16T03:48:35.808 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T03:48:35.808 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T03:48:35.808 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T03:48:35.808 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-df/3' 2024-09-16T03:48:35.808 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-df/3/journal' 2024-09-16T03:48:35.808 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T03:48:35.808 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T03:48:35.808 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-df' 2024-09-16T03:48:35.808 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T03:48:35.808 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:48:35.808 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:48:35.808 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:48:35.809 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:48:35.809 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114720 2024-09-16T03:48:35.809 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.114720/$cluster-$name.asok' 2024-09-16T03:48:35.809 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.114720/$cluster-$name.asok' 2024-09-16T03:48:35.809 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T03:48:35.809 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T03:48:35.809 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T03:48:35.809 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-df/$name.log' 2024-09-16T03:48:35.809 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-df/$name.pid' 2024-09-16T03:48:35.809 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T03:48:35.809 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T03:48:35.809 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T03:48:35.809 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T03:48:35.810 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T03:48:35.810 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T03:48:35.810 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-df/3 2024-09-16T03:48:35.811 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T03:48:35.811 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=b4c1d49d-0f7b-4755-b231-767607afc1ac 2024-09-16T03:48:35.811 INFO:tasks.workunit.client.0.smithi096.stdout:add osd3 b4c1d49d-0f7b-4755-b231-767607afc1ac 2024-09-16T03:48:35.812 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 b4c1d49d-0f7b-4755-b231-767607afc1ac' 2024-09-16T03:48:35.812 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T03:48:35.829 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCTqudmamCBMRAAs1SXegJO8NQr0JYKDeu8mA== 2024-09-16T03:48:35.830 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCTqudmamCBMRAAs1SXegJO8NQr0JYKDeu8mA=="}' 2024-09-16T03:48:35.830 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new b4c1d49d-0f7b-4755-b231-767607afc1ac -i td/osd-df/3/new.json 2024-09-16T03:48:36.333 INFO:tasks.workunit.client.0.smithi096.stdout:3 2024-09-16T03:48:36.350 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-df/3/new.json 2024-09-16T03:48:36.351 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=91752bc1-5e86-4795-8590-210b4f9a03be --auth-supported=none --mon-host=127.0.0.1:7113 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-df/3 --osd-journal=td/osd-df/3/journal --chdir= --run-dir=td/osd-df '--admin-socket=/tmp/ceph-asok.114720/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-df/$name.log' '--pid-file=td/osd-df/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCTqudmamCBMRAAs1SXegJO8NQr0JYKDeu8mA== --osd-uuid b4c1d49d-0f7b-4755-b231-767607afc1ac 2024-09-16T03:48:36.383 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:48:36.381+0000 7f043c4487c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:48:36.385 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:48:36.385+0000 7f043c4487c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:48:36.386 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:48:36.385+0000 7f043c4487c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:48:36.387 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:48:36.385+0000 7f043c4487c0 -1 bdev(0x555aefa8dc00 td/osd-df/3/block) open stat got: (1) Operation not permitted 2024-09-16T03:48:36.387 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:48:36.385+0000 7f043c4487c0 -1 bluestore(td/osd-df/3) _read_fsid unparsable uuid 2024-09-16T03:48:42.205 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-df/3/keyring 2024-09-16T03:48:42.205 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T03:48:42.207 INFO:tasks.workunit.client.0.smithi096.stdout:adding osd3 key to auth repository 2024-09-16T03:48:42.207 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2024-09-16T03:48:42.207 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-df/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T03:48:42.786 INFO:tasks.workunit.client.0.smithi096.stdout:start osd.3 2024-09-16T03:48:42.787 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2024-09-16T03:48:42.787 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T03:48:42.787 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=91752bc1-5e86-4795-8590-210b4f9a03be --auth-supported=none --mon-host=127.0.0.1:7113 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-df/3 --osd-journal=td/osd-df/3/journal --chdir= --run-dir=td/osd-df '--admin-socket=/tmp/ceph-asok.114720/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-df/$name.log' '--pid-file=td/osd-df/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T03:48:42.787 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T03:48:42.788 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T03:48:42.817 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:48:42.817+0000 7fb4ece327c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:48:42.834 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:48:42.833+0000 7fb4ece327c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:48:42.835 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:48:42.833+0000 7fb4ece327c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:48:43.247 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2024-09-16T03:48:43.247 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:48:43.247 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2024-09-16T03:48:43.247 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:48:43.247 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:48:43.247 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:48:43.247 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:48:43.247 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T03:48:43.248 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:48:43.248 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:48:43.748 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:48:44.055 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:48:44.053+0000 7fb4ece327c0 -1 Falling back to public interface 2024-09-16T03:48:44.749 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:48:44.749 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:48:44.750 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T03:48:44.750 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T03:48:44.750 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:48:44.750 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:48:45.167 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:48:46.168 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:48:46.168 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:48:46.168 INFO:tasks.workunit.client.0.smithi096.stdout:2 2024-09-16T03:48:46.169 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T03:48:46.169 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:48:46.169 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:48:46.600 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:48:46.903 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:48:46.901+0000 7fb4ece327c0 -1 osd.3 0 log_to_monitors true 2024-09-16T03:48:47.602 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:48:47.602 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:48:47.602 INFO:tasks.workunit.client.0.smithi096.stdout:3 2024-09-16T03:48:47.603 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T03:48:47.603 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:48:47.603 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:48:48.131 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:48:49.132 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:48:49.133 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:48:49.133 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T03:48:49.133 INFO:tasks.workunit.client.0.smithi096.stdout:4 2024-09-16T03:48:49.133 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:48:49.133 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:48:49.569 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:48:50.571 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:48:50.571 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:48:50.572 INFO:tasks.workunit.client.0.smithi096.stdout:5 2024-09-16T03:48:50.572 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T03:48:50.572 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:48:50.572 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:48:51.165 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:48:52.166 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:48:52.167 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:48:52.167 INFO:tasks.workunit.client.0.smithi096.stdout:6 2024-09-16T03:48:52.167 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T03:48:52.167 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:48:52.167 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:48:52.854 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:48:53.855 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:48:53.856 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:48:53.856 INFO:tasks.workunit.client.0.smithi096.stdout:7 2024-09-16T03:48:53.856 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T03:48:53.857 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:48:53.857 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:48:54.365 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:48:55.367 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:48:55.367 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:48:55.367 INFO:tasks.workunit.client.0.smithi096.stdout:8 2024-09-16T03:48:55.368 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T03:48:55.368 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:48:55.368 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:48:55.883 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:48:56.885 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:48:56.885 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:48:56.885 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T03:48:56.885 INFO:tasks.workunit.client.0.smithi096.stdout:9 2024-09-16T03:48:56.886 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:48:56.886 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:48:57.323 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:48:58.325 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:48:58.325 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:48:58.325 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T03:48:58.326 INFO:tasks.workunit.client.0.smithi096.stdout:10 2024-09-16T03:48:58.326 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:48:58.326 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:48:58.857 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:48:59.859 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:48:59.859 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:48:59.859 INFO:tasks.workunit.client.0.smithi096.stdout:11 2024-09-16T03:48:59.860 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T03:48:59.860 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:48:59.860 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:49:00.718 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:49:01.720 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:49:01.720 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:49:01.721 INFO:tasks.workunit.client.0.smithi096.stdout:12 2024-09-16T03:49:01.721 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T03:49:01.721 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:49:01.721 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:49:03.013 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:49:04.015 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:49:04.015 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:49:04.015 INFO:tasks.workunit.client.0.smithi096.stdout:13 2024-09-16T03:49:04.016 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T03:49:04.016 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:49:04.016 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:49:04.789 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:49:05.791 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:49:05.791 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:49:05.791 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T03:49:05.792 INFO:tasks.workunit.client.0.smithi096.stdout:14 2024-09-16T03:49:05.792 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:49:05.792 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:49:06.230 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:49:07.232 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:49:07.232 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:49:07.232 INFO:tasks.workunit.client.0.smithi096.stdout:15 2024-09-16T03:49:07.233 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T03:49:07.233 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:49:07.233 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:49:07.827 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:49:08.829 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:49:08.829 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:49:08.829 INFO:tasks.workunit.client.0.smithi096.stdout:16 2024-09-16T03:49:08.830 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T03:49:08.830 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:49:08.830 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:49:09.930 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:49:10.931 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:49:10.932 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:49:10.932 INFO:tasks.workunit.client.0.smithi096.stdout:17 2024-09-16T03:49:10.932 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T03:49:10.932 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:49:10.933 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:49:11.459 INFO:tasks.workunit.client.0.smithi096.stdout:osd.3 up in weight 1 up_from 20 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/1412754187,v1:127.0.0.1:6827/1412754187] [v2:127.0.0.1:6828/1412754187,v1:127.0.0.1:6829/1412754187] exists,up b4c1d49d-0f7b-4755-b231-767607afc1ac 2024-09-16T03:49:11.461 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:49:11.461 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:49:11.461 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:49:11.461 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:32: TEST_osd_df: run_osd td/osd-df 4 2024-09-16T03:49:11.461 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-df 2024-09-16T03:49:11.461 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T03:49:11.462 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=4 2024-09-16T03:49:11.462 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T03:49:11.462 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-df/4 2024-09-16T03:49:11.462 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=91752bc1-5e86-4795-8590-210b4f9a03be --auth-supported=none --mon-host=127.0.0.1:7113 ' 2024-09-16T03:49:11.462 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T03:49:11.462 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T03:49:11.462 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T03:49:11.462 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-df/4' 2024-09-16T03:49:11.462 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-df/4/journal' 2024-09-16T03:49:11.462 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T03:49:11.463 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T03:49:11.463 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-df' 2024-09-16T03:49:11.463 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T03:49:11.463 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:49:11.463 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:49:11.463 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:49:11.463 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:49:11.463 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114720 2024-09-16T03:49:11.463 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.114720/$cluster-$name.asok' 2024-09-16T03:49:11.465 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.114720/$cluster-$name.asok' 2024-09-16T03:49:11.465 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T03:49:11.465 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T03:49:11.465 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T03:49:11.465 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-df/$name.log' 2024-09-16T03:49:11.465 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-df/$name.pid' 2024-09-16T03:49:11.465 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T03:49:11.465 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T03:49:11.465 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T03:49:11.466 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T03:49:11.466 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T03:49:11.466 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T03:49:11.466 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-df/4 2024-09-16T03:49:11.466 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T03:49:11.466 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=73d59ca7-ed21-4b74-b097-4104a5f740b4 2024-09-16T03:49:11.466 INFO:tasks.workunit.client.0.smithi096.stdout:add osd4 73d59ca7-ed21-4b74-b097-4104a5f740b4 2024-09-16T03:49:11.467 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd4 73d59ca7-ed21-4b74-b097-4104a5f740b4' 2024-09-16T03:49:11.467 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T03:49:11.487 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQC3qudmO40RHRAAaIAsEe/dAduW2aKo6WEIPw== 2024-09-16T03:49:11.487 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQC3qudmO40RHRAAaIAsEe/dAduW2aKo6WEIPw=="}' 2024-09-16T03:49:11.487 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 73d59ca7-ed21-4b74-b097-4104a5f740b4 -i td/osd-df/4/new.json 2024-09-16T03:49:11.973 INFO:tasks.workunit.client.0.smithi096.stdout:4 2024-09-16T03:49:11.989 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-df/4/new.json 2024-09-16T03:49:11.991 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 4 --fsid=91752bc1-5e86-4795-8590-210b4f9a03be --auth-supported=none --mon-host=127.0.0.1:7113 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-df/4 --osd-journal=td/osd-df/4/journal --chdir= --run-dir=td/osd-df '--admin-socket=/tmp/ceph-asok.114720/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-df/$name.log' '--pid-file=td/osd-df/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQC3qudmO40RHRAAaIAsEe/dAduW2aKo6WEIPw== --osd-uuid 73d59ca7-ed21-4b74-b097-4104a5f740b4 2024-09-16T03:49:12.022 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:49:12.020+0000 7f0fe51497c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:49:12.024 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:49:12.024+0000 7f0fe51497c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:49:12.025 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:49:12.024+0000 7f0fe51497c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:49:12.026 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:49:12.024+0000 7f0fe51497c0 -1 bdev(0x55c4143ebc00 td/osd-df/4/block) open stat got: (1) Operation not permitted 2024-09-16T03:49:12.026 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:49:12.024+0000 7f0fe51497c0 -1 bluestore(td/osd-df/4) _read_fsid unparsable uuid 2024-09-16T03:49:17.926 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-df/4/keyring 2024-09-16T03:49:17.927 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T03:49:17.928 INFO:tasks.workunit.client.0.smithi096.stdout:adding osd4 key to auth repository 2024-09-16T03:49:17.929 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd4 key to auth repository 2024-09-16T03:49:17.929 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-df/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T03:49:18.499 INFO:tasks.workunit.client.0.smithi096.stdout:start osd.4 2024-09-16T03:49:18.500 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.4 2024-09-16T03:49:18.500 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 4 --fsid=91752bc1-5e86-4795-8590-210b4f9a03be --auth-supported=none --mon-host=127.0.0.1:7113 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-df/4 --osd-journal=td/osd-df/4/journal --chdir= --run-dir=td/osd-df '--admin-socket=/tmp/ceph-asok.114720/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-df/$name.log' '--pid-file=td/osd-df/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T03:49:18.500 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T03:49:18.500 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T03:49:18.500 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T03:49:18.528 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:49:18.524+0000 7fa5300a67c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:49:18.547 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:49:18.544+0000 7fa5300a67c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:49:18.549 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:49:18.548+0000 7fa5300a67c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:49:18.916 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 4 2024-09-16T03:49:18.917 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:49:18.917 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=4 2024-09-16T03:49:18.917 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:49:18.917 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:49:18.917 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:49:18.917 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T03:49:18.918 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:49:18.918 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:49:18.918 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:49:19.378 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:49:19.551 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:49:19.548+0000 7fa5300a67c0 -1 Falling back to public interface 2024-09-16T03:49:20.379 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:49:20.379 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:49:20.379 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T03:49:20.380 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T03:49:20.380 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:49:20.380 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:49:20.829 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:49:21.831 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:49:21.831 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:49:21.832 INFO:tasks.workunit.client.0.smithi096.stdout:2 2024-09-16T03:49:21.832 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T03:49:21.832 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:49:21.832 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:49:22.293 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:49:22.452 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:49:22.452+0000 7fa5300a67c0 -1 osd.4 0 log_to_monitors true 2024-09-16T03:49:23.294 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:49:23.295 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:49:23.295 INFO:tasks.workunit.client.0.smithi096.stdout:3 2024-09-16T03:49:23.295 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T03:49:23.295 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:49:23.296 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:49:23.843 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:49:24.844 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:49:24.844 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:49:24.844 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T03:49:24.845 INFO:tasks.workunit.client.0.smithi096.stdout:4 2024-09-16T03:49:24.845 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:49:24.845 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:49:25.331 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:49:26.332 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:49:26.333 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:49:26.333 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T03:49:26.333 INFO:tasks.workunit.client.0.smithi096.stdout:5 2024-09-16T03:49:26.333 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:49:26.334 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:49:26.793 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:49:27.795 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:49:27.795 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:49:27.795 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T03:49:27.795 INFO:tasks.workunit.client.0.smithi096.stdout:6 2024-09-16T03:49:27.796 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:49:27.796 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:49:28.243 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:49:29.245 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:49:29.245 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:49:29.245 INFO:tasks.workunit.client.0.smithi096.stdout:7 2024-09-16T03:49:29.246 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T03:49:29.246 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:49:29.246 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:49:29.696 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:49:30.698 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:49:30.698 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:49:30.698 INFO:tasks.workunit.client.0.smithi096.stdout:8 2024-09-16T03:49:30.699 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T03:49:30.699 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:49:30.699 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:49:31.329 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:49:32.331 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:49:32.331 INFO:tasks.workunit.client.0.smithi096.stdout:9 2024-09-16T03:49:32.331 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:49:32.331 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T03:49:32.332 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:49:32.332 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:49:32.781 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:49:33.783 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:49:33.784 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:49:33.784 INFO:tasks.workunit.client.0.smithi096.stdout:10 2024-09-16T03:49:33.784 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T03:49:33.784 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:49:33.784 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:49:34.304 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:49:35.306 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:49:35.306 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:49:35.306 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T03:49:35.306 INFO:tasks.workunit.client.0.smithi096.stdout:11 2024-09-16T03:49:35.306 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:49:35.307 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:49:36.084 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:49:37.085 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:49:37.086 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:49:37.086 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T03:49:37.086 INFO:tasks.workunit.client.0.smithi096.stdout:12 2024-09-16T03:49:37.087 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:49:37.087 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:49:37.849 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:49:38.851 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:49:38.851 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:49:38.851 INFO:tasks.workunit.client.0.smithi096.stdout:13 2024-09-16T03:49:38.852 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T03:49:38.852 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:49:38.852 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:49:39.641 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:49:40.643 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:49:40.643 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:49:40.643 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T03:49:40.643 INFO:tasks.workunit.client.0.smithi096.stdout:14 2024-09-16T03:49:40.643 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:49:40.644 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:49:41.619 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:49:42.621 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:49:42.621 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:49:42.621 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T03:49:42.622 INFO:tasks.workunit.client.0.smithi096.stdout:15 2024-09-16T03:49:42.622 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:49:42.622 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:49:43.326 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:49:44.328 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:49:44.328 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:49:44.328 INFO:tasks.workunit.client.0.smithi096.stdout:16 2024-09-16T03:49:44.329 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T03:49:44.329 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:49:44.329 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:49:45.218 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:49:46.220 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:49:46.220 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:49:46.221 INFO:tasks.workunit.client.0.smithi096.stdout:17 2024-09-16T03:49:46.222 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T03:49:46.222 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:49:46.222 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:49:46.659 INFO:tasks.workunit.client.0.smithi096.stdout:osd.4 up in weight 1 up_from 25 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/2048167833,v1:127.0.0.1:6835/2048167833] [v2:127.0.0.1:6836/2048167833,v1:127.0.0.1:6837/2048167833] exists,up 73d59ca7-ed21-4b74-b097-4104a5f740b4 2024-09-16T03:49:46.661 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:49:46.661 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:49:46.661 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:49:46.661 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:33: TEST_osd_df: run_osd td/osd-df 5 2024-09-16T03:49:46.661 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-df 2024-09-16T03:49:46.661 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T03:49:46.662 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=5 2024-09-16T03:49:46.662 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T03:49:46.662 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-df/5 2024-09-16T03:49:46.662 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=91752bc1-5e86-4795-8590-210b4f9a03be --auth-supported=none --mon-host=127.0.0.1:7113 ' 2024-09-16T03:49:46.662 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T03:49:46.662 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T03:49:46.662 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T03:49:46.662 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-df/5' 2024-09-16T03:49:46.662 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-df/5/journal' 2024-09-16T03:49:46.662 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T03:49:46.662 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T03:49:46.662 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-df' 2024-09-16T03:49:46.663 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T03:49:46.663 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:49:46.663 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:49:46.663 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:49:46.663 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:49:46.663 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114720 2024-09-16T03:49:46.663 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.114720/$cluster-$name.asok' 2024-09-16T03:49:46.664 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.114720/$cluster-$name.asok' 2024-09-16T03:49:46.664 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T03:49:46.664 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T03:49:46.665 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T03:49:46.665 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-df/$name.log' 2024-09-16T03:49:46.665 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-df/$name.pid' 2024-09-16T03:49:46.665 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T03:49:46.665 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T03:49:46.665 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T03:49:46.665 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T03:49:46.665 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T03:49:46.665 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T03:49:46.665 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-df/5 2024-09-16T03:49:46.665 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T03:49:46.665 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=b5d433d4-3a96-488f-9eb7-1b2b78ce3510 2024-09-16T03:49:46.666 INFO:tasks.workunit.client.0.smithi096.stdout:add osd5 b5d433d4-3a96-488f-9eb7-1b2b78ce3510 2024-09-16T03:49:46.666 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd5 b5d433d4-3a96-488f-9eb7-1b2b78ce3510' 2024-09-16T03:49:46.666 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T03:49:46.685 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDaqudmHsTcKBAATwAAYuDOoZ5FpS3/++308w== 2024-09-16T03:49:46.685 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDaqudmHsTcKBAATwAAYuDOoZ5FpS3/++308w=="}' 2024-09-16T03:49:46.685 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new b5d433d4-3a96-488f-9eb7-1b2b78ce3510 -i td/osd-df/5/new.json 2024-09-16T03:49:47.178 INFO:tasks.workunit.client.0.smithi096.stdout:5 2024-09-16T03:49:47.194 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-df/5/new.json 2024-09-16T03:49:47.195 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 5 --fsid=91752bc1-5e86-4795-8590-210b4f9a03be --auth-supported=none --mon-host=127.0.0.1:7113 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-df/5 --osd-journal=td/osd-df/5/journal --chdir= --run-dir=td/osd-df '--admin-socket=/tmp/ceph-asok.114720/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-df/$name.log' '--pid-file=td/osd-df/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDaqudmHsTcKBAATwAAYuDOoZ5FpS3/++308w== --osd-uuid b5d433d4-3a96-488f-9eb7-1b2b78ce3510 2024-09-16T03:49:47.227 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:49:47.223+0000 7fc94d9677c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:49:47.229 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:49:47.227+0000 7fc94d9677c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:49:47.231 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:49:47.227+0000 7fc94d9677c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:49:47.231 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:49:47.227+0000 7fc94d9677c0 -1 bdev(0x5568c51b5c00 td/osd-df/5/block) open stat got: (1) Operation not permitted 2024-09-16T03:49:47.232 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:49:47.227+0000 7fc94d9677c0 -1 bluestore(td/osd-df/5) _read_fsid unparsable uuid 2024-09-16T03:49:53.594 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-df/5/keyring 2024-09-16T03:49:53.594 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T03:49:53.595 INFO:tasks.workunit.client.0.smithi096.stdout:adding osd5 key to auth repository 2024-09-16T03:49:53.596 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd5 key to auth repository 2024-09-16T03:49:53.596 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-df/5/keyring auth add osd.5 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T03:49:54.172 INFO:tasks.workunit.client.0.smithi096.stdout:start osd.5 2024-09-16T03:49:54.173 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.5 2024-09-16T03:49:54.173 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T03:49:54.173 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T03:49:54.173 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T03:49:54.173 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 5 --fsid=91752bc1-5e86-4795-8590-210b4f9a03be --auth-supported=none --mon-host=127.0.0.1:7113 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-df/5 --osd-journal=td/osd-df/5/journal --chdir= --run-dir=td/osd-df '--admin-socket=/tmp/ceph-asok.114720/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-df/$name.log' '--pid-file=td/osd-df/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T03:49:54.202 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:49:54.199+0000 7f185fa007c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:49:54.226 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:49:54.223+0000 7f185fa007c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:49:54.227 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:49:54.223+0000 7f185fa007c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:49:54.585 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 5 2024-09-16T03:49:54.585 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:49:54.585 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=5 2024-09-16T03:49:54.585 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:49:54.585 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:49:54.586 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:49:54.586 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T03:49:54.586 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:49:54.586 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:49:54.586 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:49:55.044 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:49:55.511 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:49:55.507+0000 7f185fa007c0 -1 Falling back to public interface 2024-09-16T03:49:56.046 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:49:56.046 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:49:56.046 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T03:49:56.047 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T03:49:56.047 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:49:56.047 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:49:56.538 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:49:57.540 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:49:57.540 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:49:57.540 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T03:49:57.540 INFO:tasks.workunit.client.0.smithi096.stdout:2 2024-09-16T03:49:57.541 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:49:57.541 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:49:58.032 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:49:58.443 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:49:58.439+0000 7f185fa007c0 -1 osd.5 0 log_to_monitors true 2024-09-16T03:49:59.034 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:49:59.034 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:49:59.034 INFO:tasks.workunit.client.0.smithi096.stdout:3 2024-09-16T03:49:59.035 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T03:49:59.035 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:49:59.035 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:49:59.632 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:50:00.633 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:50:00.634 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:50:00.634 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T03:50:00.634 INFO:tasks.workunit.client.0.smithi096.stdout:4 2024-09-16T03:50:00.634 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:50:00.634 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:50:01.069 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:50:02.070 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:50:02.070 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:50:02.071 INFO:tasks.workunit.client.0.smithi096.stdout:5 2024-09-16T03:50:02.071 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T03:50:02.071 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:50:02.071 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:50:02.685 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:50:03.687 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:50:03.687 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:50:03.687 INFO:tasks.workunit.client.0.smithi096.stdout:6 2024-09-16T03:50:03.688 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T03:50:03.688 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:50:03.688 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:50:04.283 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:50:05.284 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:50:05.285 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:50:05.285 INFO:tasks.workunit.client.0.smithi096.stdout:7 2024-09-16T03:50:05.285 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T03:50:05.285 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:50:05.285 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:50:05.713 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:50:06.714 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:50:06.714 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:50:06.715 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T03:50:06.715 INFO:tasks.workunit.client.0.smithi096.stdout:8 2024-09-16T03:50:06.715 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:50:06.715 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:50:07.259 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:50:08.261 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:50:08.261 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:50:08.261 INFO:tasks.workunit.client.0.smithi096.stdout:9 2024-09-16T03:50:08.262 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T03:50:08.262 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:50:08.262 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:50:08.717 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:50:09.719 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:50:09.719 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:50:09.719 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T03:50:09.720 INFO:tasks.workunit.client.0.smithi096.stdout:10 2024-09-16T03:50:09.720 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:50:09.720 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:50:10.377 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:50:11.378 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:50:11.379 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:50:11.379 INFO:tasks.workunit.client.0.smithi096.stdout:11 2024-09-16T03:50:11.379 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T03:50:11.379 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:50:11.379 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:50:12.010 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:50:13.012 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:50:13.012 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:50:13.012 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T03:50:13.013 INFO:tasks.workunit.client.0.smithi096.stdout:12 2024-09-16T03:50:13.013 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:50:13.013 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:50:13.759 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:50:14.761 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:50:14.761 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:50:14.761 INFO:tasks.workunit.client.0.smithi096.stdout:13 2024-09-16T03:50:14.762 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T03:50:14.762 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:50:14.762 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:50:15.555 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:50:16.557 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:50:16.557 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:50:16.557 INFO:tasks.workunit.client.0.smithi096.stdout:14 2024-09-16T03:50:16.558 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T03:50:16.558 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:50:16.558 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:50:17.684 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:50:18.686 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:50:18.686 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:50:18.686 INFO:tasks.workunit.client.0.smithi096.stdout:15 2024-09-16T03:50:18.687 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T03:50:18.687 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:50:18.687 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:50:19.756 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:50:20.758 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:50:20.758 INFO:tasks.workunit.client.0.smithi096.stdout:16 2024-09-16T03:50:20.759 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:50:20.759 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T03:50:20.759 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:50:20.759 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:50:21.285 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:50:22.286 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:50:22.286 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:50:22.286 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T03:50:22.286 INFO:tasks.workunit.client.0.smithi096.stdout:17 2024-09-16T03:50:22.287 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:50:22.287 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:50:22.856 INFO:tasks.workunit.client.0.smithi096.stdout:osd.5 up in weight 1 up_from 30 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6842/2573196057,v1:127.0.0.1:6843/2573196057] [v2:127.0.0.1:6844/2573196057,v1:127.0.0.1:6845/2573196057] exists,up b5d433d4-3a96-488f-9eb7-1b2b78ce3510 2024-09-16T03:50:22.857 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:50:22.857 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:50:22.857 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:50:22.857 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:36: TEST_osd_df: grep osd.0 2024-09-16T03:50:22.857 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:36: TEST_osd_df: ceph osd df --f json-pretty 2024-09-16T03:50:23.270 INFO:tasks.workunit.client.0.smithi096.stdout: "name": "osd.0", 2024-09-16T03:50:23.271 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:37: TEST_osd_df: ceph osd df --f json-pretty 2024-09-16T03:50:23.271 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:37: TEST_osd_df: grep osd.1 2024-09-16T03:50:23.698 INFO:tasks.workunit.client.0.smithi096.stdout: "name": "osd.1", 2024-09-16T03:50:23.699 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:38: TEST_osd_df: ceph osd df --f json-pretty 2024-09-16T03:50:23.699 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:38: TEST_osd_df: grep osd.2 2024-09-16T03:50:24.103 INFO:tasks.workunit.client.0.smithi096.stdout: "name": "osd.2", 2024-09-16T03:50:24.104 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:39: TEST_osd_df: ceph osd df --f json-pretty 2024-09-16T03:50:24.104 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:39: TEST_osd_df: grep osd.3 2024-09-16T03:50:24.529 INFO:tasks.workunit.client.0.smithi096.stdout: "name": "osd.3", 2024-09-16T03:50:24.530 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:40: TEST_osd_df: ceph osd df --f json-pretty 2024-09-16T03:50:24.530 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:40: TEST_osd_df: grep osd.4 2024-09-16T03:50:24.956 INFO:tasks.workunit.client.0.smithi096.stdout: "name": "osd.4", 2024-09-16T03:50:24.957 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:41: TEST_osd_df: grep osd.5 2024-09-16T03:50:24.957 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:41: TEST_osd_df: ceph osd df --f json-pretty 2024-09-16T03:50:25.381 INFO:tasks.workunit.client.0.smithi096.stdout: "name": "osd.5", 2024-09-16T03:50:25.382 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:44: TEST_osd_df: ceph osd crush get-device-class 0 2024-09-16T03:50:25.848 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:44: TEST_osd_df: osd_class=hdd 2024-09-16T03:50:25.849 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:45: TEST_osd_df: ceph osd df class hdd --f json-pretty 2024-09-16T03:50:25.849 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:45: TEST_osd_df: grep osd.0 2024-09-16T03:50:26.264 INFO:tasks.workunit.client.0.smithi096.stdout: "name": "osd.0", 2024-09-16T03:50:26.265 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:47: TEST_osd_df: grep osd.0 2024-09-16T03:50:26.265 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:47: TEST_osd_df: ceph osd df hdd --f json-pretty 2024-09-16T03:50:26.672 INFO:tasks.workunit.client.0.smithi096.stdout: "name": "osd.0", 2024-09-16T03:50:26.672 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:48: TEST_osd_df: ceph osd crush rm-device-class 0 2024-09-16T03:50:27.370 INFO:tasks.workunit.client.0.smithi096.stderr:osd.0 belongs to no class, done removing class of osd(s): 2024-09-16T03:50:27.393 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:49: TEST_osd_df: ceph osd crush set-device-class aaa 0 2024-09-16T03:50:28.082 INFO:tasks.workunit.client.0.smithi096.stderr:osd.0 already set to class aaa. set-device-class item id 0 name 'osd.0' device_class 'aaa': no change. set osd(s) to class 'aaa' 2024-09-16T03:50:28.104 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:50: TEST_osd_df: ceph osd df aaa --f json-pretty 2024-09-16T03:50:28.104 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:50: TEST_osd_df: grep osd.0 2024-09-16T03:50:28.598 INFO:tasks.workunit.client.0.smithi096.stdout: "name": "osd.0", 2024-09-16T03:50:28.598 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:51: TEST_osd_df: ceph osd df aaa --f json-pretty 2024-09-16T03:50:28.598 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:51: TEST_osd_df: grep osd.1 2024-09-16T03:50:28.998 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:53: TEST_osd_df: ceph osd crush rm-device-class 0 2024-09-16T03:50:29.704 INFO:tasks.workunit.client.0.smithi096.stderr:osd.0 belongs to no class, done removing class of osd(s): 2024-09-16T03:50:29.727 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:54: TEST_osd_df: ceph osd crush set-device-class hdd 0 2024-09-16T03:50:30.466 INFO:tasks.workunit.client.0.smithi096.stderr:osd.0 already set to class hdd. set-device-class item id 0 name 'osd.0' device_class 'hdd': no change. set osd(s) to class 'hdd' 2024-09-16T03:50:30.486 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:57: TEST_osd_df: ceph osd df osd.0 --f json-pretty 2024-09-16T03:50:30.487 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:57: TEST_osd_df: grep osd.0 2024-09-16T03:50:30.915 INFO:tasks.workunit.client.0.smithi096.stdout: "name": "osd.0", 2024-09-16T03:50:30.916 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:58: TEST_osd_df: ceph osd df osd.0 --f json-pretty 2024-09-16T03:50:30.917 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:58: TEST_osd_df: grep osd.1 2024-09-16T03:50:31.341 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:59: TEST_osd_df: ceph osd crush move osd.0 root=default host=foo 2024-09-16T03:50:31.844 INFO:tasks.workunit.client.0.smithi096.stderr:no need to move item id 0 name 'osd.0' to location {host=foo,root=default} in crush map 2024-09-16T03:50:31.860 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:60: TEST_osd_df: ceph osd crush move osd.1 root=default host=foo 2024-09-16T03:50:32.515 INFO:tasks.workunit.client.0.smithi096.stderr:no need to move item id 1 name 'osd.1' to location {host=foo,root=default} in crush map 2024-09-16T03:50:32.532 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:61: TEST_osd_df: ceph osd crush move osd.2 root=default host=foo 2024-09-16T03:50:33.164 INFO:tasks.workunit.client.0.smithi096.stderr:no need to move item id 2 name 'osd.2' to location {host=foo,root=default} in crush map 2024-09-16T03:50:33.181 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:62: TEST_osd_df: ceph osd crush move osd.3 root=default host=bar 2024-09-16T03:50:33.695 INFO:tasks.workunit.client.0.smithi096.stderr:no need to move item id 3 name 'osd.3' to location {host=bar,root=default} in crush map 2024-09-16T03:50:33.711 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:63: TEST_osd_df: ceph osd crush move osd.4 root=default host=bar 2024-09-16T03:50:34.417 INFO:tasks.workunit.client.0.smithi096.stderr:no need to move item id 4 name 'osd.4' to location {host=bar,root=default} in crush map 2024-09-16T03:50:34.434 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:64: TEST_osd_df: ceph osd crush move osd.5 root=default host=bar 2024-09-16T03:50:34.981 INFO:tasks.workunit.client.0.smithi096.stderr:no need to move item id 5 name 'osd.5' to location {host=bar,root=default} in crush map 2024-09-16T03:50:34.998 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:65: TEST_osd_df: ceph osd df tree foo --f json-pretty 2024-09-16T03:50:34.998 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:65: TEST_osd_df: grep foo 2024-09-16T03:50:35.399 INFO:tasks.workunit.client.0.smithi096.stdout: "name": "foo", 2024-09-16T03:50:35.400 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:66: TEST_osd_df: ceph osd df tree foo --f json-pretty 2024-09-16T03:50:35.400 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:66: TEST_osd_df: grep bar 2024-09-16T03:50:35.814 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:67: TEST_osd_df: ceph osd df foo --f json-pretty 2024-09-16T03:50:35.814 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:67: TEST_osd_df: grep osd.0 2024-09-16T03:50:36.212 INFO:tasks.workunit.client.0.smithi096.stdout: "name": "osd.0", 2024-09-16T03:50:36.213 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:68: TEST_osd_df: ceph osd df foo --f json-pretty 2024-09-16T03:50:36.213 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:68: TEST_osd_df: grep osd.1 2024-09-16T03:50:36.607 INFO:tasks.workunit.client.0.smithi096.stdout: "name": "osd.1", 2024-09-16T03:50:36.608 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:69: TEST_osd_df: ceph osd df foo --f json-pretty 2024-09-16T03:50:36.608 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:69: TEST_osd_df: grep osd.2 2024-09-16T03:50:37.008 INFO:tasks.workunit.client.0.smithi096.stdout: "name": "osd.2", 2024-09-16T03:50:37.008 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:70: TEST_osd_df: ceph osd df foo --f json-pretty 2024-09-16T03:50:37.008 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:70: TEST_osd_df: grep osd.3 2024-09-16T03:50:37.423 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:71: TEST_osd_df: ceph osd df foo --f json-pretty 2024-09-16T03:50:37.423 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:71: TEST_osd_df: grep osd.4 2024-09-16T03:50:37.845 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:72: TEST_osd_df: grep osd.5 2024-09-16T03:50:37.845 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:72: TEST_osd_df: ceph osd df foo --f json-pretty 2024-09-16T03:50:38.263 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:73: TEST_osd_df: ceph osd df tree bar --f json-pretty 2024-09-16T03:50:38.263 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:73: TEST_osd_df: grep bar 2024-09-16T03:50:38.664 INFO:tasks.workunit.client.0.smithi096.stdout: "name": "bar", 2024-09-16T03:50:38.665 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:74: TEST_osd_df: ceph osd df tree bar --f json-pretty 2024-09-16T03:50:38.665 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:74: TEST_osd_df: grep foo 2024-09-16T03:50:39.065 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:75: TEST_osd_df: ceph osd df bar --f json-pretty 2024-09-16T03:50:39.065 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:75: TEST_osd_df: grep osd.0 2024-09-16T03:50:39.507 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:76: TEST_osd_df: ceph osd df bar --f json-pretty 2024-09-16T03:50:39.507 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:76: TEST_osd_df: grep osd.1 2024-09-16T03:50:39.919 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:77: TEST_osd_df: ceph osd df bar --f json-pretty 2024-09-16T03:50:39.919 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:77: TEST_osd_df: grep osd.2 2024-09-16T03:50:40.314 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:78: TEST_osd_df: ceph osd df bar --f json-pretty 2024-09-16T03:50:40.314 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:78: TEST_osd_df: grep osd.3 2024-09-16T03:50:40.702 INFO:tasks.workunit.client.0.smithi096.stdout: "name": "osd.3", 2024-09-16T03:50:40.703 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:79: TEST_osd_df: ceph osd df bar --f json-pretty 2024-09-16T03:50:40.703 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:79: TEST_osd_df: grep osd.4 2024-09-16T03:50:41.110 INFO:tasks.workunit.client.0.smithi096.stdout: "name": "osd.4", 2024-09-16T03:50:41.111 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:80: TEST_osd_df: ceph osd df bar --f json-pretty 2024-09-16T03:50:41.111 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:80: TEST_osd_df: grep osd.5 2024-09-16T03:50:41.512 INFO:tasks.workunit.client.0.smithi096.stdout: "name": "osd.5", 2024-09-16T03:50:41.512 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:83: TEST_osd_df: ceph osd crush rm-device-class all 2024-09-16T03:50:42.221 INFO:tasks.workunit.client.0.smithi096.stderr:osd.0 belongs to no class, osd.1 belongs to no class, osd.2 belongs to no class, osd.3 belongs to no class, osd.4 belongs to no class, osd.5 belongs to no class, done removing class of osd(s): 2024-09-16T03:50:42.243 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:84: TEST_osd_df: ceph osd crush set-device-class nvme 0 1 3 4 2024-09-16T03:50:43.109 INFO:tasks.workunit.client.0.smithi096.stderr:osd.0 already set to class nvme. set-device-class item id 0 name 'osd.0' device_class 'nvme': no change. osd.1 already set to class nvme. set-device-class item id 1 name 'osd.1' device_class 'nvme': no change. osd.3 already set to class nvme. set-device-class item id 3 name 'osd.3' device_class 'nvme': no change. osd.4 already set to class nvme. set-device-class item id 4 name 'osd.4' device_class 'nvme': no change. set osd(s) to class 'nvme' 2024-09-16T03:50:43.131 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:85: TEST_osd_df: ceph osd crush rule create-replicated nvme-rule default host nvme 2024-09-16T03:50:43.787 INFO:tasks.workunit.client.0.smithi096.stderr:rule nvme-rule already exists 2024-09-16T03:50:43.804 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:86: TEST_osd_df: ceph osd pool create nvme-pool 12 12 nvme-rule 2024-09-16T03:50:44.363 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'nvme-pool' already exists 2024-09-16T03:50:44.379 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:87: TEST_osd_df: ceph osd df nvme-pool --f json-pretty 2024-09-16T03:50:44.379 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:87: TEST_osd_df: grep osd.0 2024-09-16T03:50:44.810 INFO:tasks.workunit.client.0.smithi096.stdout: "name": "osd.0", 2024-09-16T03:50:44.811 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:88: TEST_osd_df: ceph osd df nvme-pool --f json-pretty 2024-09-16T03:50:44.811 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:88: TEST_osd_df: grep osd.1 2024-09-16T03:50:45.230 INFO:tasks.workunit.client.0.smithi096.stdout: "name": "osd.1", 2024-09-16T03:50:45.230 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:89: TEST_osd_df: ceph osd df nvme-pool --f json-pretty 2024-09-16T03:50:45.230 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:89: TEST_osd_df: grep osd.2 2024-09-16T03:50:45.653 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:90: TEST_osd_df: grep osd.3 2024-09-16T03:50:45.653 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:90: TEST_osd_df: ceph osd df nvme-pool --f json-pretty 2024-09-16T03:50:46.095 INFO:tasks.workunit.client.0.smithi096.stdout: "name": "osd.3", 2024-09-16T03:50:46.096 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:91: TEST_osd_df: ceph osd df nvme-pool --f json-pretty 2024-09-16T03:50:46.096 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:91: TEST_osd_df: grep osd.4 2024-09-16T03:50:46.614 INFO:tasks.workunit.client.0.smithi096.stdout: "name": "osd.4", 2024-09-16T03:50:46.615 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:92: TEST_osd_df: grep osd.5 2024-09-16T03:50:46.615 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:92: TEST_osd_df: ceph osd df nvme-pool --f json-pretty 2024-09-16T03:50:47.059 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:94: TEST_osd_df: teardown td/osd-df 2024-09-16T03:50:47.059 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-df 2024-09-16T03:50:47.059 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:50:47.059 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-df KILL 2024-09-16T03:50:47.060 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:50:47.060 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:50:47.060 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:50:47.060 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:50:47.060 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:50:47.373 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:50:47.373 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:50:47.374 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:50:47.374 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:50:47.376 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:50:47.376 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:50:47.376 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:50:47.377 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:50:47.377 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:50:47.378 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:50:47.378 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:50:47.379 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:50:47.380 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:50:47.380 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-df 2024-09-16T03:50:47.413 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:50:47.413 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:50:47.413 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114720 2024-09-16T03:50:47.413 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.114720 2024-09-16T03:50:47.415 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:50:47.415 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:50:47.415 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh:18: run: teardown td/osd-df 2024-09-16T03:50:47.415 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-df 2024-09-16T03:50:47.415 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:50:47.415 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-df KILL 2024-09-16T03:50:47.415 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:50:47.415 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:50:47.415 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:50:47.415 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:50:47.416 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:50:47.417 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:50:47.418 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:50:47.419 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:50:47.419 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:50:47.420 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:50:47.420 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:50:47.420 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:50:47.421 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:50:47.421 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:50:47.421 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:50:47.422 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:50:47.422 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:50:47.424 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:50:47.424 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-df 2024-09-16T03:50:47.425 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:50:47.425 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:50:47.425 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114720 2024-09-16T03:50:47.425 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.114720 2024-09-16T03:50:47.427 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:50:47.427 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:50:47.427 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2322: main: code=0 2024-09-16T03:50:47.427 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2326: main: teardown td/osd-df 0 2024-09-16T03:50:47.427 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-df 2024-09-16T03:50:47.428 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2024-09-16T03:50:47.428 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-df KILL 2024-09-16T03:50:47.428 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:50:47.428 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:50:47.428 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:50:47.428 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:50:47.428 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:50:47.429 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:50:47.430 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:50:47.430 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:50:47.431 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:50:47.432 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:50:47.432 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:50:47.432 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:50:47.433 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:50:47.434 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:50:47.434 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:50:47.434 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:50:47.435 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:50:47.436 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2024-09-16T03:50:47.436 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-df 2024-09-16T03:50:47.438 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:50:47.438 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:50:47.438 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114720 2024-09-16T03:50:47.438 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.114720 2024-09-16T03:50:47.439 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:50:47.439 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:50:47.439 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2327: main: return 0 2024-09-16T03:50:47.440 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-16T03:50:47.440 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-16T03:50:47.493 INFO:tasks.workunit:Running workunit mon/osd-erasure-code-profile.sh... 2024-09-16T03:50:47.494 DEBUG:teuthology.orchestra.run.smithi096:workunit test mon/osd-erasure-code-profile.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7498493279982dfe87f00616198a5967475f6169 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh 2024-09-16T03:50:47.549 INFO:tasks.workunit.client.0.smithi096.stderr:stty: 'standard input': Inappropriate ioctl for device 2024-09-16T03:50:47.555 INFO:tasks.workunit.client.0.smithi096.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2024-09-16T03:50:47.555 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2315: main: export PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-16T03:50:47.555 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2315: main: PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-16T03:50:47.555 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2316: main: export PYTHONWARNINGS=ignore 2024-09-16T03:50:47.555 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2316: main: PYTHONWARNINGS=ignore 2024-09-16T03:50:47.555 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2317: main: export CEPH_CONF=/dev/null 2024-09-16T03:50:47.555 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2317: main: CEPH_CONF=/dev/null 2024-09-16T03:50:47.555 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2318: main: unset CEPH_ARGS 2024-09-16T03:50:47.555 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2320: main: local code 2024-09-16T03:50:47.555 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2321: main: run td/osd-erasure-code-profile 2024-09-16T03:50:47.555 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:21: run: local dir=td/osd-erasure-code-profile 2024-09-16T03:50:47.555 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:22: run: shift 2024-09-16T03:50:47.555 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:24: run: export CEPH_MON=127.0.0.1:7220 2024-09-16T03:50:47.556 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:24: run: CEPH_MON=127.0.0.1:7220 2024-09-16T03:50:47.556 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:25: run: export CEPH_ARGS 2024-09-16T03:50:47.556 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:26: run: uuidgen 2024-09-16T03:50:47.556 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:26: run: CEPH_ARGS+='--fsid=e818c953-a450-4975-a691-8cc81c368ff4 --auth-supported=none ' 2024-09-16T03:50:47.556 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:27: run: CEPH_ARGS+='--mon-host=127.0.0.1:7220 ' 2024-09-16T03:50:47.556 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:29: run: set 2024-09-16T03:50:47.557 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:29: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2024-09-16T03:50:47.559 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:29: run: local 'funcs=TEST_format_invalid 2024-09-16T03:50:47.559 INFO:tasks.workunit.client.0.smithi096.stderr:TEST_format_json 2024-09-16T03:50:47.559 INFO:tasks.workunit.client.0.smithi096.stderr:TEST_format_plain 2024-09-16T03:50:47.559 INFO:tasks.workunit.client.0.smithi096.stderr:TEST_get 2024-09-16T03:50:47.559 INFO:tasks.workunit.client.0.smithi096.stderr:TEST_invalid_crush_failure_domain 2024-09-16T03:50:47.559 INFO:tasks.workunit.client.0.smithi096.stderr:TEST_ls 2024-09-16T03:50:47.559 INFO:tasks.workunit.client.0.smithi096.stderr:TEST_profile_k_sanity 2024-09-16T03:50:47.559 INFO:tasks.workunit.client.0.smithi096.stderr:TEST_rm 2024-09-16T03:50:47.559 INFO:tasks.workunit.client.0.smithi096.stderr:TEST_set 2024-09-16T03:50:47.559 INFO:tasks.workunit.client.0.smithi096.stderr:TEST_set_idempotent' 2024-09-16T03:50:47.559 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:30: run: for func in $funcs 2024-09-16T03:50:47.559 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:31: run: setup td/osd-erasure-code-profile 2024-09-16T03:50:47.559 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-erasure-code-profile 2024-09-16T03:50:47.560 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-erasure-code-profile 2024-09-16T03:50:47.560 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-erasure-code-profile 2024-09-16T03:50:47.560 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:50:47.560 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-erasure-code-profile KILL 2024-09-16T03:50:47.560 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:50:47.560 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:50:47.560 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:50:47.560 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:50:47.560 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:50:47.560 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:50:47.561 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:50:47.562 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:50:47.562 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:50:47.564 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:50:47.564 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:50:47.564 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:50:47.564 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:50:47.565 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:50:47.565 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:50:47.565 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:50:47.565 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:50:47.568 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:50:47.568 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-erasure-code-profile 2024-09-16T03:50:47.568 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:50:47.569 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:50:47.569 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.126710 2024-09-16T03:50:47.569 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.126710 2024-09-16T03:50:47.569 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:50:47.569 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:50:47.569 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-erasure-code-profile 2024-09-16T03:50:47.571 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T03:50:47.571 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:50:47.572 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.126710 2024-09-16T03:50:47.572 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.126710 2024-09-16T03:50:47.574 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T03:50:47.574 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2024-09-16T03:50:47.574 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2024-09-16T03:50:47.574 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T03:50:47.574 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-erasure-code-profile 1' TERM HUP INT 2024-09-16T03:50:47.574 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:32: run: TEST_format_invalid td/osd-erasure-code-profile 2024-09-16T03:50:47.574 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:162: TEST_format_invalid: local dir=td/osd-erasure-code-profile 2024-09-16T03:50:47.575 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:164: TEST_format_invalid: local profile=profile 2024-09-16T03:50:47.575 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:167: TEST_format_invalid: run_mon td/osd-erasure-code-profile a --osd_pool_default_erasure-code-profile 1 2024-09-16T03:50:47.575 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-erasure-code-profile 2024-09-16T03:50:47.575 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T03:50:47.575 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T03:50:47.575 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T03:50:47.575 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-erasure-code-profile/a 2024-09-16T03:50:47.575 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-erasure-code-profile/a --run-dir=td/osd-erasure-code-profile --osd_pool_default_erasure-code-profile 1 2024-09-16T03:50:48.053 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T03:50:48.053 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:50:48.053 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:50:48.054 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:50:48.054 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:50:48.054 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.126710 2024-09-16T03:50:48.054 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.126710/$cluster-$name.asok' 2024-09-16T03:50:48.054 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-erasure-code-profile/a '--log-file=td/osd-erasure-code-profile/$name.log' '--admin-socket=/tmp/ceph-asok.126710/$cluster-$name.asok' --mon-cluster-log-file=td/osd-erasure-code-profile/log --run-dir=td/osd-erasure-code-profile '--pid-file=td/osd-erasure-code-profile/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_erasure-code-profile 1 2024-09-16T03:50:48.264 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T03:50:48.265 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T03:50:48.265 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:50:48.265 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:50:48.265 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T03:50:48.267 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T03:50:48.267 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:50:48.267 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:50:48.267 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:50:48.267 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:50:48.267 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:50:48.267 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.126710 2024-09-16T03:50:48.267 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.126710/ceph-mon.a.asok 2024-09-16T03:50:48.267 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:50:48.267 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.126710/ceph-mon.a.asok config get fsid 2024-09-16T03:50:48.385 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T03:50:48.386 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:50:48.386 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:50:48.386 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T03:50:48.386 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T03:50:48.386 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:50:48.386 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:50:48.386 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:50:48.386 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:50:48.386 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:50:48.386 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.126710 2024-09-16T03:50:48.386 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.126710/ceph-mon.a.asok 2024-09-16T03:50:48.386 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:50:48.386 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.126710/ceph-mon.a.asok config get mon_host 2024-09-16T03:50:48.494 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:169: TEST_format_invalid: ceph osd erasure-code-profile set profile 2024-09-16T03:50:49.295 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:170: TEST_format_invalid: cat td/osd-erasure-code-profile/out 2024-09-16T03:50:49.296 INFO:tasks.workunit.client.0.smithi096.stdout:Error EINVAL: 1 must be a JSON object but is of type 4 instead 2024-09-16T03:50:49.297 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:171: TEST_format_invalid: grep 'must be a JSON object' td/osd-erasure-code-profile/out 2024-09-16T03:50:49.298 INFO:tasks.workunit.client.0.smithi096.stdout:Error EINVAL: 1 must be a JSON object but is of type 4 instead 2024-09-16T03:50:49.298 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:33: run: teardown td/osd-erasure-code-profile 2024-09-16T03:50:49.298 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-erasure-code-profile 2024-09-16T03:50:49.299 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:50:49.299 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-erasure-code-profile KILL 2024-09-16T03:50:49.299 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:50:49.299 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:50:49.299 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:50:49.299 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:50:49.299 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:50:49.410 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:50:49.411 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:50:49.411 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:50:49.411 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:50:49.411 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:50:49.411 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:50:49.411 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:50:49.411 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:50:49.411 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:50:49.411 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:50:49.411 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:50:49.412 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:50:49.412 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:50:49.412 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-erasure-code-profile 2024-09-16T03:50:49.414 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:50:49.414 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:50:49.414 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.126710 2024-09-16T03:50:49.414 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.126710 2024-09-16T03:50:49.416 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:50:49.416 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:50:49.417 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:30: run: for func in $funcs 2024-09-16T03:50:49.417 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:31: run: setup td/osd-erasure-code-profile 2024-09-16T03:50:49.417 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-erasure-code-profile 2024-09-16T03:50:49.417 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-erasure-code-profile 2024-09-16T03:50:49.417 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-erasure-code-profile 2024-09-16T03:50:49.417 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:50:49.417 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-erasure-code-profile KILL 2024-09-16T03:50:49.417 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:50:49.417 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:50:49.417 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:50:49.417 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:50:49.417 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:50:49.419 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:50:49.419 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:50:49.420 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:50:49.420 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:50:49.421 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:50:49.421 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:50:49.422 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:50:49.423 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:50:49.423 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:50:49.424 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:50:49.424 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:50:49.424 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:50:49.425 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:50:49.425 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-erasure-code-profile 2024-09-16T03:50:49.427 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:50:49.427 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:50:49.427 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.126710 2024-09-16T03:50:49.427 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.126710 2024-09-16T03:50:49.428 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:50:49.428 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:50:49.428 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-erasure-code-profile 2024-09-16T03:50:49.429 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T03:50:49.430 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:50:49.430 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.126710 2024-09-16T03:50:49.430 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.126710 2024-09-16T03:50:49.433 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T03:50:49.433 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2024-09-16T03:50:49.433 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T03:50:49.433 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-erasure-code-profile 1' TERM HUP INT 2024-09-16T03:50:49.433 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:32: run: TEST_format_json td/osd-erasure-code-profile 2024-09-16T03:50:49.433 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:175: TEST_format_json: local dir=td/osd-erasure-code-profile 2024-09-16T03:50:49.433 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:178: TEST_format_json: expected='"plugin":"isa"' 2024-09-16T03:50:49.433 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:179: TEST_format_json: run_mon td/osd-erasure-code-profile a --osd_pool_default_erasure-code-profile '{"plugin":"isa"}' 2024-09-16T03:50:49.433 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-erasure-code-profile 2024-09-16T03:50:49.433 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T03:50:49.434 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T03:50:49.434 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T03:50:49.434 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-erasure-code-profile/a 2024-09-16T03:50:49.434 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-erasure-code-profile/a --run-dir=td/osd-erasure-code-profile --osd_pool_default_erasure-code-profile '{"plugin":"isa"}' 2024-09-16T03:50:49.894 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T03:50:49.894 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:50:49.894 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:50:49.894 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:50:49.894 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:50:49.895 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.126710 2024-09-16T03:50:49.895 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.126710/$cluster-$name.asok' 2024-09-16T03:50:49.895 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-erasure-code-profile/a '--log-file=td/osd-erasure-code-profile/$name.log' '--admin-socket=/tmp/ceph-asok.126710/$cluster-$name.asok' --mon-cluster-log-file=td/osd-erasure-code-profile/log --run-dir=td/osd-erasure-code-profile '--pid-file=td/osd-erasure-code-profile/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_erasure-code-profile '{"plugin":"isa"}' 2024-09-16T03:50:50.095 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T03:50:50.096 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T03:50:50.096 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:50:50.096 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:50:50.096 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T03:50:50.097 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:50:50.097 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:50:50.097 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:50:50.097 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T03:50:50.098 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:50:50.098 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:50:50.098 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.126710 2024-09-16T03:50:50.098 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.126710/ceph-mon.a.asok 2024-09-16T03:50:50.098 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:50:50.098 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.126710/ceph-mon.a.asok config get fsid 2024-09-16T03:50:50.209 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T03:50:50.210 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:50:50.210 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:50:50.210 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T03:50:50.211 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T03:50:50.211 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:50:50.211 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:50:50.211 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:50:50.211 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:50:50.211 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:50:50.211 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.126710 2024-09-16T03:50:50.211 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.126710/ceph-mon.a.asok 2024-09-16T03:50:50.212 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:50:50.212 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.126710/ceph-mon.a.asok config get mon_host 2024-09-16T03:50:50.329 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:181: TEST_format_json: ceph --format json osd erasure-code-profile get default 2024-09-16T03:50:50.329 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:182: TEST_format_json: grep '"plugin":"isa"' 2024-09-16T03:50:51.193 INFO:tasks.workunit.client.0.smithi096.stdout:{"plugin":"isa"} 2024-09-16T03:50:51.194 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:33: run: teardown td/osd-erasure-code-profile 2024-09-16T03:50:51.194 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-erasure-code-profile 2024-09-16T03:50:51.194 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:50:51.195 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-erasure-code-profile KILL 2024-09-16T03:50:51.195 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:50:51.195 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:50:51.195 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:50:51.195 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:50:51.195 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:50:51.302 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:50:51.302 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:50:51.303 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:50:51.303 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:50:51.305 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:50:51.305 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:50:51.306 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:50:51.307 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:50:51.307 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:50:51.308 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:50:51.308 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:50:51.308 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:50:51.310 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:50:51.310 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-erasure-code-profile 2024-09-16T03:50:51.312 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:50:51.312 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:50:51.312 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.126710 2024-09-16T03:50:51.312 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.126710 2024-09-16T03:50:51.314 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:50:51.314 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:50:51.314 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:30: run: for func in $funcs 2024-09-16T03:50:51.314 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:31: run: setup td/osd-erasure-code-profile 2024-09-16T03:50:51.314 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-erasure-code-profile 2024-09-16T03:50:51.314 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-erasure-code-profile 2024-09-16T03:50:51.314 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-erasure-code-profile 2024-09-16T03:50:51.314 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:50:51.315 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-erasure-code-profile KILL 2024-09-16T03:50:51.315 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:50:51.315 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:50:51.315 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:50:51.315 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:50:51.315 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:50:51.317 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:50:51.317 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:50:51.317 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:50:51.318 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:50:51.319 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:50:51.319 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:50:51.319 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:50:51.320 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:50:51.320 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:50:51.321 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:50:51.321 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:50:51.322 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:50:51.323 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:50:51.323 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-erasure-code-profile 2024-09-16T03:50:51.324 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:50:51.324 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:50:51.325 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.126710 2024-09-16T03:50:51.325 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.126710 2024-09-16T03:50:51.325 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:50:51.326 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:50:51.326 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-erasure-code-profile 2024-09-16T03:50:51.327 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T03:50:51.327 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:50:51.328 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.126710 2024-09-16T03:50:51.328 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.126710 2024-09-16T03:50:51.330 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T03:50:51.330 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2024-09-16T03:50:51.330 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T03:50:51.330 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-erasure-code-profile 1' TERM HUP INT 2024-09-16T03:50:51.330 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:32: run: TEST_format_plain td/osd-erasure-code-profile 2024-09-16T03:50:51.330 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:186: TEST_format_plain: local dir=td/osd-erasure-code-profile 2024-09-16T03:50:51.330 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:189: TEST_format_plain: expected='"plugin":"isa"' 2024-09-16T03:50:51.331 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:190: TEST_format_plain: run_mon td/osd-erasure-code-profile a --osd_pool_default_erasure-code-profile plugin=isa 2024-09-16T03:50:51.331 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-erasure-code-profile 2024-09-16T03:50:51.331 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T03:50:51.331 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T03:50:51.331 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T03:50:51.331 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-erasure-code-profile/a 2024-09-16T03:50:51.331 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-erasure-code-profile/a --run-dir=td/osd-erasure-code-profile --osd_pool_default_erasure-code-profile plugin=isa 2024-09-16T03:50:51.791 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T03:50:51.791 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:50:51.791 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:50:51.792 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:50:51.792 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:50:51.792 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.126710 2024-09-16T03:50:51.792 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.126710/$cluster-$name.asok' 2024-09-16T03:50:51.792 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-erasure-code-profile/a '--log-file=td/osd-erasure-code-profile/$name.log' '--admin-socket=/tmp/ceph-asok.126710/$cluster-$name.asok' --mon-cluster-log-file=td/osd-erasure-code-profile/log --run-dir=td/osd-erasure-code-profile '--pid-file=td/osd-erasure-code-profile/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_erasure-code-profile plugin=isa 2024-09-16T03:50:51.986 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T03:50:51.987 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T03:50:51.987 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:50:51.987 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:50:51.987 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T03:50:51.988 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T03:50:51.988 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:50:51.989 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:50:51.989 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:50:51.989 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:50:51.989 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:50:51.989 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.126710 2024-09-16T03:50:51.989 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.126710/ceph-mon.a.asok 2024-09-16T03:50:51.989 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:50:51.989 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.126710/ceph-mon.a.asok config get fsid 2024-09-16T03:50:52.108 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T03:50:52.108 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:50:52.108 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:50:52.109 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T03:50:52.110 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T03:50:52.111 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:50:52.111 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:50:52.111 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:50:52.111 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:50:52.111 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:50:52.111 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.126710 2024-09-16T03:50:52.111 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.126710/ceph-mon.a.asok 2024-09-16T03:50:52.111 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:50:52.111 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.126710/ceph-mon.a.asok config get mon_host 2024-09-16T03:50:52.219 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:192: TEST_format_plain: ceph --format json osd erasure-code-profile get default 2024-09-16T03:50:52.220 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:193: TEST_format_plain: grep '"plugin":"isa"' 2024-09-16T03:50:53.081 INFO:tasks.workunit.client.0.smithi096.stdout:{"plugin":"isa"} 2024-09-16T03:50:53.082 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:33: run: teardown td/osd-erasure-code-profile 2024-09-16T03:50:53.082 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-erasure-code-profile 2024-09-16T03:50:53.082 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:50:53.082 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-erasure-code-profile KILL 2024-09-16T03:50:53.082 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:50:53.082 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:50:53.082 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:50:53.082 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:50:53.083 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:50:53.188 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:50:53.189 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:50:53.189 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:50:53.190 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:50:53.191 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:50:53.191 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:50:53.192 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:50:53.193 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:50:53.193 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:50:53.194 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:50:53.194 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:50:53.195 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:50:53.196 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:50:53.196 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-erasure-code-profile 2024-09-16T03:50:53.198 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:50:53.198 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:50:53.198 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.126710 2024-09-16T03:50:53.198 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.126710 2024-09-16T03:50:53.200 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:50:53.200 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:50:53.201 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:30: run: for func in $funcs 2024-09-16T03:50:53.201 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:31: run: setup td/osd-erasure-code-profile 2024-09-16T03:50:53.201 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-erasure-code-profile 2024-09-16T03:50:53.201 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-erasure-code-profile 2024-09-16T03:50:53.201 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-erasure-code-profile 2024-09-16T03:50:53.201 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:50:53.201 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-erasure-code-profile KILL 2024-09-16T03:50:53.201 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:50:53.201 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:50:53.203 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:50:53.203 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:50:53.203 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:50:53.204 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:50:53.204 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:50:53.204 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:50:53.204 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:50:53.204 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:50:53.205 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:50:53.205 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:50:53.205 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:50:53.206 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:50:53.206 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:50:53.206 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:50:53.207 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:50:53.208 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:50:53.208 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-erasure-code-profile 2024-09-16T03:50:53.209 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:50:53.209 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:50:53.210 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.126710 2024-09-16T03:50:53.210 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.126710 2024-09-16T03:50:53.210 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:50:53.210 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:50:53.210 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-erasure-code-profile 2024-09-16T03:50:53.212 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T03:50:53.212 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:50:53.212 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.126710 2024-09-16T03:50:53.212 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.126710 2024-09-16T03:50:53.214 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T03:50:53.215 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2024-09-16T03:50:53.215 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T03:50:53.215 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-erasure-code-profile 1' TERM HUP INT 2024-09-16T03:50:53.215 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:32: run: TEST_get td/osd-erasure-code-profile 2024-09-16T03:50:53.215 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:112: TEST_get: local dir=td/osd-erasure-code-profile 2024-09-16T03:50:53.215 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:113: TEST_get: local id= 2024-09-16T03:50:53.215 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:115: TEST_get: run_mon td/osd-erasure-code-profile a 2024-09-16T03:50:53.215 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-erasure-code-profile 2024-09-16T03:50:53.215 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T03:50:53.215 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T03:50:53.215 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T03:50:53.215 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-erasure-code-profile/a 2024-09-16T03:50:53.216 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-erasure-code-profile/a --run-dir=td/osd-erasure-code-profile 2024-09-16T03:50:53.697 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T03:50:53.698 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:50:53.698 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:50:53.698 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:50:53.698 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:50:53.698 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.126710 2024-09-16T03:50:53.699 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.126710/$cluster-$name.asok' 2024-09-16T03:50:53.699 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-erasure-code-profile/a '--log-file=td/osd-erasure-code-profile/$name.log' '--admin-socket=/tmp/ceph-asok.126710/$cluster-$name.asok' --mon-cluster-log-file=td/osd-erasure-code-profile/log --run-dir=td/osd-erasure-code-profile '--pid-file=td/osd-erasure-code-profile/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-09-16T03:50:53.900 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T03:50:53.901 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T03:50:53.901 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:50:53.901 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:50:53.902 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T03:50:53.902 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T03:50:53.903 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:50:53.903 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:50:53.903 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:50:53.903 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:50:53.903 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:50:53.903 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.126710 2024-09-16T03:50:53.903 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.126710/ceph-mon.a.asok 2024-09-16T03:50:53.903 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:50:53.904 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.126710/ceph-mon.a.asok config get fsid 2024-09-16T03:50:54.019 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T03:50:54.019 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:50:54.019 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:50:54.020 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T03:50:54.021 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:50:54.021 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:50:54.021 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:50:54.021 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T03:50:54.021 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:50:54.021 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:50:54.021 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.126710 2024-09-16T03:50:54.021 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.126710/ceph-mon.a.asok 2024-09-16T03:50:54.022 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:50:54.022 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.126710/ceph-mon.a.asok config get mon_host 2024-09-16T03:50:54.132 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:117: TEST_get: local default_profile=default 2024-09-16T03:50:54.133 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:118: TEST_get: ceph osd erasure-code-profile get default 2024-09-16T03:50:54.133 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:119: TEST_get: grep plugin=jerasure 2024-09-16T03:50:54.995 INFO:tasks.workunit.client.0.smithi096.stdout:plugin=jerasure 2024-09-16T03:50:54.995 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:120: TEST_get: ceph --format xml osd erasure-code-profile get default 2024-09-16T03:50:54.996 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:121: TEST_get: grep 'jerasure' 2024-09-16T03:50:55.242 INFO:tasks.workunit.client.0.smithi096.stdout:22jerasurereed_sol_van 2024-09-16T03:50:55.243 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:122: TEST_get: ceph osd erasure-code-profile get WRONG 2024-09-16T03:50:55.434 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:123: TEST_get: grep -q 'unknown erasure code profile '\''WRONG'\''' td/osd-erasure-code-profile/out 2024-09-16T03:50:55.436 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:33: run: teardown td/osd-erasure-code-profile 2024-09-16T03:50:55.436 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-erasure-code-profile 2024-09-16T03:50:55.436 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:50:55.436 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-erasure-code-profile KILL 2024-09-16T03:50:55.437 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:50:55.437 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:50:55.437 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:50:55.437 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:50:55.437 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:50:55.544 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:50:55.544 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:50:55.544 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:50:55.545 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:50:55.546 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:50:55.546 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:50:55.547 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:50:55.548 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:50:55.548 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:50:55.549 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:50:55.549 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:50:55.549 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:50:55.550 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:50:55.550 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-erasure-code-profile 2024-09-16T03:50:55.552 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:50:55.553 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:50:55.553 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.126710 2024-09-16T03:50:55.553 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.126710 2024-09-16T03:50:55.554 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:50:55.555 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:50:55.555 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:30: run: for func in $funcs 2024-09-16T03:50:55.555 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:31: run: setup td/osd-erasure-code-profile 2024-09-16T03:50:55.555 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-erasure-code-profile 2024-09-16T03:50:55.555 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-erasure-code-profile 2024-09-16T03:50:55.555 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-erasure-code-profile 2024-09-16T03:50:55.555 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:50:55.555 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-erasure-code-profile KILL 2024-09-16T03:50:55.555 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:50:55.555 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:50:55.555 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:50:55.556 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:50:55.556 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:50:55.560 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:50:55.560 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:50:55.561 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:50:55.561 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:50:55.562 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:50:55.562 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:50:55.562 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:50:55.562 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:50:55.562 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:50:55.562 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:50:55.562 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:50:55.562 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:50:55.563 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:50:55.563 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-erasure-code-profile 2024-09-16T03:50:55.564 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:50:55.564 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:50:55.564 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.126710 2024-09-16T03:50:55.565 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.126710 2024-09-16T03:50:55.565 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:50:55.565 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:50:55.565 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-erasure-code-profile 2024-09-16T03:50:55.567 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T03:50:55.567 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:50:55.567 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.126710 2024-09-16T03:50:55.567 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.126710 2024-09-16T03:50:55.568 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T03:50:55.570 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2024-09-16T03:50:55.570 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T03:50:55.570 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-erasure-code-profile 1' TERM HUP INT 2024-09-16T03:50:55.570 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:32: run: TEST_invalid_crush_failure_domain td/osd-erasure-code-profile 2024-09-16T03:50:55.570 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:227: TEST_invalid_crush_failure_domain: local dir=td/osd-erasure-code-profile 2024-09-16T03:50:55.570 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:229: TEST_invalid_crush_failure_domain: run_mon td/osd-erasure-code-profile a 2024-09-16T03:50:55.570 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-erasure-code-profile 2024-09-16T03:50:55.570 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T03:50:55.570 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T03:50:55.570 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T03:50:55.571 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-erasure-code-profile/a 2024-09-16T03:50:55.571 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-erasure-code-profile/a --run-dir=td/osd-erasure-code-profile 2024-09-16T03:50:56.038 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T03:50:56.039 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:50:56.039 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:50:56.039 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:50:56.039 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:50:56.040 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.126710 2024-09-16T03:50:56.040 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.126710/$cluster-$name.asok' 2024-09-16T03:50:56.040 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-erasure-code-profile/a '--log-file=td/osd-erasure-code-profile/$name.log' '--admin-socket=/tmp/ceph-asok.126710/$cluster-$name.asok' --mon-cluster-log-file=td/osd-erasure-code-profile/log --run-dir=td/osd-erasure-code-profile '--pid-file=td/osd-erasure-code-profile/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-09-16T03:50:56.242 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T03:50:56.243 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T03:50:56.243 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:50:56.243 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:50:56.243 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T03:50:56.244 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T03:50:56.244 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:50:56.244 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:50:56.244 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:50:56.245 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:50:56.245 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:50:56.245 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.126710 2024-09-16T03:50:56.245 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.126710/ceph-mon.a.asok 2024-09-16T03:50:56.245 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:50:56.245 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.126710/ceph-mon.a.asok config get fsid 2024-09-16T03:50:56.361 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T03:50:56.361 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:50:56.361 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:50:56.361 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T03:50:56.362 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T03:50:56.362 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:50:56.362 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:50:56.362 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:50:56.362 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:50:56.362 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:50:56.363 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.126710 2024-09-16T03:50:56.363 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.126710/ceph-mon.a.asok 2024-09-16T03:50:56.363 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:50:56.363 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.126710/ceph-mon.a.asok config get mon_host 2024-09-16T03:50:56.480 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:231: TEST_invalid_crush_failure_domain: local profile=ec_profile 2024-09-16T03:50:56.480 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:232: TEST_invalid_crush_failure_domain: local crush_failure_domain=invalid_failure_domain 2024-09-16T03:50:56.480 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:234: TEST_invalid_crush_failure_domain: ceph osd erasure-code-profile set ec_profile k=4 m=2 crush-failure-domain=invalid_failure_domain 2024-09-16T03:50:57.281 INFO:tasks.workunit.client.0.smithi096.stdout:Error EINVAL: erasure-code-profile {crush-failure-domain=invalid_failure_domain,k=4,m=2,plugin=jerasure,technique=reed_sol_van} contains an invalid failure-domain "invalid_failure_domain" 2024-09-16T03:50:57.284 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:33: run: teardown td/osd-erasure-code-profile 2024-09-16T03:50:57.285 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-erasure-code-profile 2024-09-16T03:50:57.285 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:50:57.285 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-erasure-code-profile KILL 2024-09-16T03:50:57.285 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:50:57.285 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:50:57.286 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:50:57.286 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:50:57.286 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:50:57.393 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:50:57.393 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:50:57.394 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:50:57.394 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:50:57.395 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:50:57.395 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:50:57.395 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:50:57.396 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:50:57.396 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:50:57.397 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:50:57.397 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:50:57.398 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:50:57.399 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:50:57.399 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-erasure-code-profile 2024-09-16T03:50:57.401 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:50:57.404 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:50:57.404 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.126710 2024-09-16T03:50:57.404 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.126710 2024-09-16T03:50:57.406 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:50:57.406 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:50:57.406 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:30: run: for func in $funcs 2024-09-16T03:50:57.406 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:31: run: setup td/osd-erasure-code-profile 2024-09-16T03:50:57.406 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-erasure-code-profile 2024-09-16T03:50:57.406 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-erasure-code-profile 2024-09-16T03:50:57.406 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-erasure-code-profile 2024-09-16T03:50:57.407 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:50:57.407 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-erasure-code-profile KILL 2024-09-16T03:50:57.407 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:50:57.407 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:50:57.407 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:50:57.407 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:50:57.407 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:50:57.407 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:50:57.407 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:50:57.408 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:50:57.408 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:50:57.408 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:50:57.408 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:50:57.408 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:50:57.409 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:50:57.409 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:50:57.410 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:50:57.410 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:50:57.411 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:50:57.412 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:50:57.412 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-erasure-code-profile 2024-09-16T03:50:57.413 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:50:57.413 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:50:57.413 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.126710 2024-09-16T03:50:57.414 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.126710 2024-09-16T03:50:57.414 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:50:57.415 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:50:57.415 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-erasure-code-profile 2024-09-16T03:50:57.416 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T03:50:57.416 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:50:57.416 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.126710 2024-09-16T03:50:57.416 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.126710 2024-09-16T03:50:57.418 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T03:50:57.419 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2024-09-16T03:50:57.419 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T03:50:57.419 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-erasure-code-profile 1' TERM HUP INT 2024-09-16T03:50:57.419 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:32: run: TEST_ls td/osd-erasure-code-profile 2024-09-16T03:50:57.419 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:72: TEST_ls: local dir=td/osd-erasure-code-profile 2024-09-16T03:50:57.420 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:73: TEST_ls: local id= 2024-09-16T03:50:57.420 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:75: TEST_ls: run_mon td/osd-erasure-code-profile a 2024-09-16T03:50:57.420 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-erasure-code-profile 2024-09-16T03:50:57.420 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T03:50:57.420 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T03:50:57.420 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T03:50:57.420 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-erasure-code-profile/a 2024-09-16T03:50:57.420 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-erasure-code-profile/a --run-dir=td/osd-erasure-code-profile 2024-09-16T03:50:57.887 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T03:50:57.887 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:50:57.887 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:50:57.887 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:50:57.888 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:50:57.888 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.126710 2024-09-16T03:50:57.888 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.126710/$cluster-$name.asok' 2024-09-16T03:50:57.888 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-erasure-code-profile/a '--log-file=td/osd-erasure-code-profile/$name.log' '--admin-socket=/tmp/ceph-asok.126710/$cluster-$name.asok' --mon-cluster-log-file=td/osd-erasure-code-profile/log --run-dir=td/osd-erasure-code-profile '--pid-file=td/osd-erasure-code-profile/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-09-16T03:50:58.091 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T03:50:58.091 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T03:50:58.091 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:50:58.092 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:50:58.092 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T03:50:58.093 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T03:50:58.093 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:50:58.093 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:50:58.093 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:50:58.093 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:50:58.093 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:50:58.093 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.126710 2024-09-16T03:50:58.093 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.126710/ceph-mon.a.asok 2024-09-16T03:50:58.094 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:50:58.094 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.126710/ceph-mon.a.asok config get fsid 2024-09-16T03:50:58.209 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T03:50:58.210 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:50:58.210 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:50:58.210 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T03:50:58.211 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T03:50:58.211 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:50:58.211 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:50:58.211 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:50:58.211 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:50:58.211 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:50:58.211 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.126710 2024-09-16T03:50:58.212 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.126710/ceph-mon.a.asok 2024-09-16T03:50:58.212 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:50:58.212 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.126710/ceph-mon.a.asok config get mon_host 2024-09-16T03:50:58.323 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:77: TEST_ls: local profile=myprofile 2024-09-16T03:50:58.324 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:78: TEST_ls: ceph osd erasure-code-profile ls 2024-09-16T03:50:58.324 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:78: TEST_ls: grep myprofile 2024-09-16T03:50:59.181 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:79: TEST_ls: ceph osd erasure-code-profile set myprofile 2024-09-16T03:50:59.487 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:80: TEST_ls: ceph osd erasure-code-profile ls 2024-09-16T03:50:59.487 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:80: TEST_ls: grep myprofile 2024-09-16T03:50:59.756 INFO:tasks.workunit.client.0.smithi096.stdout:myprofile 2024-09-16T03:50:59.757 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:81: TEST_ls: ceph --format xml osd erasure-code-profile ls 2024-09-16T03:50:59.757 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:82: TEST_ls: grep 'myprofile' 2024-09-16T03:51:00.001 INFO:tasks.workunit.client.0.smithi096.stdout:defaultmyprofile 2024-09-16T03:51:00.001 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:84: TEST_ls: ceph osd erasure-code-profile rm myprofile 2024-09-16T03:51:00.338 INFO:tasks.workunit.client.0.smithi096.stderr:erasure-code-profile myprofile does not exist 2024-09-16T03:51:00.354 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:33: run: teardown td/osd-erasure-code-profile 2024-09-16T03:51:00.354 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-erasure-code-profile 2024-09-16T03:51:00.354 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:51:00.354 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-erasure-code-profile KILL 2024-09-16T03:51:00.355 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:51:00.355 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:51:00.355 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:51:00.355 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:51:00.355 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:51:00.461 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:51:00.462 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:51:00.463 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:51:00.464 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:51:00.465 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:51:00.466 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:51:00.466 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:51:00.466 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:51:00.467 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:51:00.467 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:51:00.467 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:51:00.468 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:51:00.469 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:51:00.470 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-erasure-code-profile 2024-09-16T03:51:00.473 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:51:00.473 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:51:00.473 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.126710 2024-09-16T03:51:00.473 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.126710 2024-09-16T03:51:00.474 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:51:00.474 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:51:00.475 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:30: run: for func in $funcs 2024-09-16T03:51:00.475 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:31: run: setup td/osd-erasure-code-profile 2024-09-16T03:51:00.475 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-erasure-code-profile 2024-09-16T03:51:00.475 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-erasure-code-profile 2024-09-16T03:51:00.475 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-erasure-code-profile 2024-09-16T03:51:00.475 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:51:00.475 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-erasure-code-profile KILL 2024-09-16T03:51:00.476 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:51:00.476 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:51:00.476 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:51:00.476 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:51:00.476 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:51:00.481 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:51:00.481 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:51:00.481 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:51:00.481 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:51:00.481 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:51:00.481 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:51:00.481 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:51:00.482 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:51:00.482 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:51:00.482 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:51:00.482 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:51:00.483 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:51:00.484 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:51:00.484 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-erasure-code-profile 2024-09-16T03:51:00.486 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:51:00.486 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:51:00.486 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.126710 2024-09-16T03:51:00.486 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.126710 2024-09-16T03:51:00.487 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:51:00.487 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:51:00.487 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-erasure-code-profile 2024-09-16T03:51:00.489 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T03:51:00.489 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:51:00.489 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.126710 2024-09-16T03:51:00.489 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.126710 2024-09-16T03:51:00.490 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T03:51:00.491 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2024-09-16T03:51:00.492 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T03:51:00.492 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-erasure-code-profile 1' TERM HUP INT 2024-09-16T03:51:00.492 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:32: run: TEST_profile_k_sanity td/osd-erasure-code-profile 2024-09-16T03:51:00.492 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:197: TEST_profile_k_sanity: local dir=td/osd-erasure-code-profile 2024-09-16T03:51:00.492 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:198: TEST_profile_k_sanity: local profile=profile-sanity 2024-09-16T03:51:00.492 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:200: TEST_profile_k_sanity: run_mon td/osd-erasure-code-profile a 2024-09-16T03:51:00.492 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-erasure-code-profile 2024-09-16T03:51:00.492 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T03:51:00.492 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T03:51:00.492 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T03:51:00.492 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-erasure-code-profile/a 2024-09-16T03:51:00.492 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-erasure-code-profile/a --run-dir=td/osd-erasure-code-profile 2024-09-16T03:51:00.965 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T03:51:00.965 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:51:00.965 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:51:00.966 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:51:00.966 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:51:00.966 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.126710 2024-09-16T03:51:00.966 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.126710/$cluster-$name.asok' 2024-09-16T03:51:00.967 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-erasure-code-profile/a '--log-file=td/osd-erasure-code-profile/$name.log' '--admin-socket=/tmp/ceph-asok.126710/$cluster-$name.asok' --mon-cluster-log-file=td/osd-erasure-code-profile/log --run-dir=td/osd-erasure-code-profile '--pid-file=td/osd-erasure-code-profile/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-09-16T03:51:01.169 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T03:51:01.170 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T03:51:01.170 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:51:01.170 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:51:01.170 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T03:51:01.171 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T03:51:01.171 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:51:01.171 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:51:01.171 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:51:01.172 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:51:01.172 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:51:01.172 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.126710 2024-09-16T03:51:01.172 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.126710/ceph-mon.a.asok 2024-09-16T03:51:01.172 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:51:01.172 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.126710/ceph-mon.a.asok config get fsid 2024-09-16T03:51:01.286 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T03:51:01.286 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:51:01.286 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:51:01.286 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T03:51:01.286 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T03:51:01.287 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:51:01.287 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:51:01.287 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:51:01.287 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:51:01.287 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:51:01.287 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.126710 2024-09-16T03:51:01.287 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.126710/ceph-mon.a.asok 2024-09-16T03:51:01.288 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:51:01.288 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.126710/ceph-mon.a.asok config get mon_host 2024-09-16T03:51:01.394 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:202: TEST_profile_k_sanity: expect_failure td/osd-erasure-code-profile 'k must be a multiple of (k + m) / l' ceph osd erasure-code-profile set profile-sanity plugin=lrc l=1 k=1 m=1 2024-09-16T03:51:01.395 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1970: expect_failure: local dir=td/osd-erasure-code-profile 2024-09-16T03:51:01.395 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1971: expect_failure: shift 2024-09-16T03:51:01.395 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1972: expect_failure: local 'expected=k must be a multiple of (k + m) / l' 2024-09-16T03:51:01.395 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1973: expect_failure: shift 2024-09-16T03:51:01.395 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1974: expect_failure: local success 2024-09-16T03:51:01.395 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1976: expect_failure: ceph osd erasure-code-profile set profile-sanity plugin=lrc l=1 k=1 m=1 2024-09-16T03:51:02.197 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1979: expect_failure: success=false 2024-09-16T03:51:02.198 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1982: expect_failure: false 2024-09-16T03:51:02.198 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1982: expect_failure: grep --quiet 'k must be a multiple of (k + m) / l' td/osd-erasure-code-profile/out 2024-09-16T03:51:02.200 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1986: expect_failure: return 0 2024-09-16T03:51:02.200 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:209: TEST_profile_k_sanity: erasure_code_plugin_exists isa 2024-09-16T03:51:02.200 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2059: erasure_code_plugin_exists: local plugin=isa 2024-09-16T03:51:02.200 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2060: erasure_code_plugin_exists: local status 2024-09-16T03:51:02.200 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2061: erasure_code_plugin_exists: local grepstr 2024-09-16T03:51:02.201 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2062: erasure_code_plugin_exists: local s 2024-09-16T03:51:02.201 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: erasure_code_plugin_exists: case `uname` in 2024-09-16T03:51:02.201 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: erasure_code_plugin_exists: uname 2024-09-16T03:51:02.201 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: erasure_code_plugin_exists: grepstr='isa.*No such file' 2024-09-16T03:51:02.201 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: erasure_code_plugin_exists: ceph osd erasure-code-profile set TESTPROFILE plugin=isa 2024-09-16T03:51:02.529 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: erasure_code_plugin_exists: s= 2024-09-16T03:51:02.529 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: erasure_code_plugin_exists: local status=0 2024-09-16T03:51:02.529 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: erasure_code_plugin_exists: '[' 0 -eq 0 ']' 2024-09-16T03:51:02.529 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: erasure_code_plugin_exists: ceph osd erasure-code-profile rm TESTPROFILE 2024-09-16T03:51:02.975 INFO:tasks.workunit.client.0.smithi096.stderr:erasure-code-profile TESTPROFILE does not exist 2024-09-16T03:51:02.990 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: erasure_code_plugin_exists: return 0 2024-09-16T03:51:02.990 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:210: TEST_profile_k_sanity: expect_failure td/osd-erasure-code-profile 'k=1 must be >= 2' ceph osd erasure-code-profile set profile-sanity plugin=isa k=1 m=1 2024-09-16T03:51:02.990 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1970: expect_failure: local dir=td/osd-erasure-code-profile 2024-09-16T03:51:02.990 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1971: expect_failure: shift 2024-09-16T03:51:02.990 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1972: expect_failure: local 'expected=k=1 must be >= 2' 2024-09-16T03:51:02.990 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1973: expect_failure: shift 2024-09-16T03:51:02.990 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1974: expect_failure: local success 2024-09-16T03:51:02.991 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1976: expect_failure: ceph osd erasure-code-profile set profile-sanity plugin=isa k=1 m=1 2024-09-16T03:51:03.271 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1979: expect_failure: success=false 2024-09-16T03:51:03.271 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1982: expect_failure: false 2024-09-16T03:51:03.271 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1982: expect_failure: grep --quiet 'k=1 must be >= 2' td/osd-erasure-code-profile/out 2024-09-16T03:51:03.272 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1986: expect_failure: return 0 2024-09-16T03:51:03.272 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:219: TEST_profile_k_sanity: expect_failure td/osd-erasure-code-profile 'k=1 must be >= 2' ceph osd erasure-code-profile set profile-sanity plugin=jerasure k=1 m=1 2024-09-16T03:51:03.273 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1970: expect_failure: local dir=td/osd-erasure-code-profile 2024-09-16T03:51:03.273 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1971: expect_failure: shift 2024-09-16T03:51:03.273 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1972: expect_failure: local 'expected=k=1 must be >= 2' 2024-09-16T03:51:03.273 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1973: expect_failure: shift 2024-09-16T03:51:03.273 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1974: expect_failure: local success 2024-09-16T03:51:03.273 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1976: expect_failure: ceph osd erasure-code-profile set profile-sanity plugin=jerasure k=1 m=1 2024-09-16T03:51:03.516 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1979: expect_failure: success=false 2024-09-16T03:51:03.516 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1982: expect_failure: false 2024-09-16T03:51:03.516 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1982: expect_failure: grep --quiet 'k=1 must be >= 2' td/osd-erasure-code-profile/out 2024-09-16T03:51:03.517 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1986: expect_failure: return 0 2024-09-16T03:51:03.517 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:33: run: teardown td/osd-erasure-code-profile 2024-09-16T03:51:03.517 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-erasure-code-profile 2024-09-16T03:51:03.517 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:51:03.517 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-erasure-code-profile KILL 2024-09-16T03:51:03.518 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:51:03.518 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:51:03.518 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:51:03.518 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:51:03.518 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:51:03.626 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:51:03.626 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:51:03.627 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:51:03.627 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:51:03.629 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:51:03.629 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:51:03.629 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:51:03.631 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:51:03.631 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:51:03.632 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:51:03.632 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:51:03.632 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:51:03.634 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:51:03.634 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-erasure-code-profile 2024-09-16T03:51:03.636 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:51:03.636 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:51:03.636 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.126710 2024-09-16T03:51:03.636 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.126710 2024-09-16T03:51:03.638 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:51:03.638 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:51:03.638 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:30: run: for func in $funcs 2024-09-16T03:51:03.638 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:31: run: setup td/osd-erasure-code-profile 2024-09-16T03:51:03.638 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-erasure-code-profile 2024-09-16T03:51:03.638 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-erasure-code-profile 2024-09-16T03:51:03.638 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-erasure-code-profile 2024-09-16T03:51:03.638 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:51:03.638 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-erasure-code-profile KILL 2024-09-16T03:51:03.638 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:51:03.638 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:51:03.639 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:51:03.639 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:51:03.639 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:51:03.640 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:51:03.640 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:51:03.641 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:51:03.641 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:51:03.642 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:51:03.643 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:51:03.643 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:51:03.644 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:51:03.644 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:51:03.644 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:51:03.644 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:51:03.645 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:51:03.646 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:51:03.646 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-erasure-code-profile 2024-09-16T03:51:03.648 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:51:03.648 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:51:03.648 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.126710 2024-09-16T03:51:03.648 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.126710 2024-09-16T03:51:03.649 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:51:03.649 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:51:03.649 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-erasure-code-profile 2024-09-16T03:51:03.650 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T03:51:03.650 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:51:03.650 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.126710 2024-09-16T03:51:03.650 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.126710 2024-09-16T03:51:03.652 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T03:51:03.653 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2024-09-16T03:51:03.653 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T03:51:03.653 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-erasure-code-profile 1' TERM HUP INT 2024-09-16T03:51:03.653 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:32: run: TEST_rm td/osd-erasure-code-profile 2024-09-16T03:51:03.653 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:88: TEST_rm: local dir=td/osd-erasure-code-profile 2024-09-16T03:51:03.653 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:89: TEST_rm: local id= 2024-09-16T03:51:03.653 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:91: TEST_rm: run_mon td/osd-erasure-code-profile a 2024-09-16T03:51:03.654 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-erasure-code-profile 2024-09-16T03:51:03.654 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T03:51:03.654 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T03:51:03.654 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T03:51:03.654 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-erasure-code-profile/a 2024-09-16T03:51:03.654 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-erasure-code-profile/a --run-dir=td/osd-erasure-code-profile 2024-09-16T03:51:04.134 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T03:51:04.134 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:51:04.134 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:51:04.135 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:51:04.135 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:51:04.135 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.126710 2024-09-16T03:51:04.136 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.126710/$cluster-$name.asok' 2024-09-16T03:51:04.136 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-erasure-code-profile/a '--log-file=td/osd-erasure-code-profile/$name.log' '--admin-socket=/tmp/ceph-asok.126710/$cluster-$name.asok' --mon-cluster-log-file=td/osd-erasure-code-profile/log --run-dir=td/osd-erasure-code-profile '--pid-file=td/osd-erasure-code-profile/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-09-16T03:51:04.337 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T03:51:04.338 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T03:51:04.338 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:51:04.338 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:51:04.338 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T03:51:04.339 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T03:51:04.339 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:51:04.339 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:51:04.339 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:51:04.340 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:51:04.340 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:51:04.340 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.126710 2024-09-16T03:51:04.340 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.126710/ceph-mon.a.asok 2024-09-16T03:51:04.340 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:51:04.340 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.126710/ceph-mon.a.asok config get fsid 2024-09-16T03:51:04.456 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T03:51:04.456 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:51:04.456 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:51:04.456 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T03:51:04.457 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:51:04.457 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T03:51:04.457 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:51:04.457 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:51:04.458 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:51:04.458 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:51:04.458 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.126710 2024-09-16T03:51:04.458 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.126710/ceph-mon.a.asok 2024-09-16T03:51:04.458 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:51:04.458 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.126710/ceph-mon.a.asok config get mon_host 2024-09-16T03:51:04.568 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:93: TEST_rm: local profile=myprofile 2024-09-16T03:51:04.568 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:94: TEST_rm: ceph osd erasure-code-profile set myprofile 2024-09-16T03:51:05.481 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:95: TEST_rm: ceph osd erasure-code-profile ls 2024-09-16T03:51:05.481 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:95: TEST_rm: grep myprofile 2024-09-16T03:51:05.758 INFO:tasks.workunit.client.0.smithi096.stdout:myprofile 2024-09-16T03:51:05.758 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:96: TEST_rm: ceph osd erasure-code-profile rm myprofile 2024-09-16T03:51:06.080 INFO:tasks.workunit.client.0.smithi096.stderr:erasure-code-profile myprofile does not exist 2024-09-16T03:51:06.097 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:97: TEST_rm: ceph osd erasure-code-profile ls 2024-09-16T03:51:06.097 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:97: TEST_rm: grep myprofile 2024-09-16T03:51:06.337 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:98: TEST_rm: ceph osd erasure-code-profile rm WRONG 2024-09-16T03:51:06.337 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:99: TEST_rm: grep 'WRONG does not exist' 2024-09-16T03:51:06.560 INFO:tasks.workunit.client.0.smithi096.stdout:erasure-code-profile WRONG does not exist 2024-09-16T03:51:06.561 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:101: TEST_rm: ceph osd erasure-code-profile set myprofile 2024-09-16T03:51:06.909 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:102: TEST_rm: create_pool poolname 12 12 erasure myprofile 2024-09-16T03:51:06.909 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create poolname 12 12 erasure myprofile 2024-09-16T03:51:07.630 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'poolname' already exists 2024-09-16T03:51:07.649 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2024-09-16T03:51:08.650 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:103: TEST_rm: ceph osd erasure-code-profile rm myprofile 2024-09-16T03:51:08.842 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:104: TEST_rm: grep 'poolname.*using.*myprofile' td/osd-erasure-code-profile/out 2024-09-16T03:51:08.843 INFO:tasks.workunit.client.0.smithi096.stdout:Error EBUSY: poolname pool(s) are using the erasure code profile 'myprofile' 2024-09-16T03:51:08.843 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:105: TEST_rm: ceph osd pool delete poolname poolname --yes-i-really-really-mean-it 2024-09-16T03:51:09.206 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'poolname' does not exist 2024-09-16T03:51:09.223 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:106: TEST_rm: ceph osd erasure-code-profile rm myprofile 2024-09-16T03:51:09.646 INFO:tasks.workunit.client.0.smithi096.stderr:erasure-code-profile myprofile does not exist 2024-09-16T03:51:09.662 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:108: TEST_rm: ceph osd erasure-code-profile rm myprofile 2024-09-16T03:51:09.919 INFO:tasks.workunit.client.0.smithi096.stderr:erasure-code-profile myprofile does not exist 2024-09-16T03:51:09.934 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:33: run: teardown td/osd-erasure-code-profile 2024-09-16T03:51:09.934 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-erasure-code-profile 2024-09-16T03:51:09.934 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:51:09.934 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-erasure-code-profile KILL 2024-09-16T03:51:09.935 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:51:09.935 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:51:09.935 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:51:09.935 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:51:09.935 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:51:10.042 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:51:10.042 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:51:10.043 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:51:10.043 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:51:10.045 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:51:10.045 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:51:10.046 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:51:10.047 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:51:10.047 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:51:10.047 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:51:10.048 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:51:10.048 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:51:10.050 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:51:10.050 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-erasure-code-profile 2024-09-16T03:51:10.053 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:51:10.053 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:51:10.053 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.126710 2024-09-16T03:51:10.053 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.126710 2024-09-16T03:51:10.055 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:51:10.055 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:51:10.055 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:30: run: for func in $funcs 2024-09-16T03:51:10.055 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:31: run: setup td/osd-erasure-code-profile 2024-09-16T03:51:10.055 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-erasure-code-profile 2024-09-16T03:51:10.055 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-erasure-code-profile 2024-09-16T03:51:10.055 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-erasure-code-profile 2024-09-16T03:51:10.055 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:51:10.055 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-erasure-code-profile KILL 2024-09-16T03:51:10.055 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:51:10.056 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:51:10.056 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:51:10.056 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:51:10.056 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:51:10.057 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:51:10.057 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:51:10.058 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:51:10.058 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:51:10.060 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:51:10.060 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:51:10.060 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:51:10.061 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:51:10.061 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:51:10.061 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:51:10.062 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:51:10.062 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:51:10.064 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:51:10.064 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-erasure-code-profile 2024-09-16T03:51:10.065 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:51:10.065 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:51:10.065 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.126710 2024-09-16T03:51:10.065 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.126710 2024-09-16T03:51:10.066 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:51:10.066 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:51:10.066 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-erasure-code-profile 2024-09-16T03:51:10.068 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T03:51:10.068 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:51:10.068 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.126710 2024-09-16T03:51:10.068 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.126710 2024-09-16T03:51:10.069 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T03:51:10.070 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2024-09-16T03:51:10.070 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T03:51:10.070 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-erasure-code-profile 1' TERM HUP INT 2024-09-16T03:51:10.071 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:32: run: TEST_set td/osd-erasure-code-profile 2024-09-16T03:51:10.071 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:38: TEST_set: local dir=td/osd-erasure-code-profile 2024-09-16T03:51:10.071 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:39: TEST_set: local id= 2024-09-16T03:51:10.071 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:41: TEST_set: run_mon td/osd-erasure-code-profile a 2024-09-16T03:51:10.071 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-erasure-code-profile 2024-09-16T03:51:10.071 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T03:51:10.071 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T03:51:10.071 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T03:51:10.071 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-erasure-code-profile/a 2024-09-16T03:51:10.071 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-erasure-code-profile/a --run-dir=td/osd-erasure-code-profile 2024-09-16T03:51:10.528 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T03:51:10.528 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:51:10.528 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:51:10.528 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:51:10.529 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:51:10.529 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.126710 2024-09-16T03:51:10.529 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.126710/$cluster-$name.asok' 2024-09-16T03:51:10.529 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-erasure-code-profile/a '--log-file=td/osd-erasure-code-profile/$name.log' '--admin-socket=/tmp/ceph-asok.126710/$cluster-$name.asok' --mon-cluster-log-file=td/osd-erasure-code-profile/log --run-dir=td/osd-erasure-code-profile '--pid-file=td/osd-erasure-code-profile/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-09-16T03:51:10.728 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T03:51:10.728 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T03:51:10.728 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:51:10.728 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:51:10.729 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T03:51:10.730 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T03:51:10.730 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:51:10.730 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:51:10.730 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:51:10.730 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:51:10.730 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:51:10.730 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.126710 2024-09-16T03:51:10.730 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.126710/ceph-mon.a.asok 2024-09-16T03:51:10.730 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:51:10.730 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.126710/ceph-mon.a.asok config get fsid 2024-09-16T03:51:10.846 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T03:51:10.846 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:51:10.846 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:51:10.846 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T03:51:10.847 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T03:51:10.847 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:51:10.847 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:51:10.847 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:51:10.847 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:51:10.848 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:51:10.848 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.126710 2024-09-16T03:51:10.848 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.126710/ceph-mon.a.asok 2024-09-16T03:51:10.848 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:51:10.848 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.126710/ceph-mon.a.asok config get mon_host 2024-09-16T03:51:10.957 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:43: TEST_set: local profile=myprofile 2024-09-16T03:51:10.957 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:47: TEST_set: ceph osd erasure-code-profile set myprofile 2024-09-16T03:51:11.875 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:48: TEST_set: ceph osd erasure-code-profile get myprofile 2024-09-16T03:51:11.875 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:49: TEST_set: grep plugin=jerasure 2024-09-16T03:51:12.142 INFO:tasks.workunit.client.0.smithi096.stdout:plugin=jerasure 2024-09-16T03:51:12.142 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:50: TEST_set: ceph osd erasure-code-profile rm myprofile 2024-09-16T03:51:12.475 INFO:tasks.workunit.client.0.smithi096.stderr:erasure-code-profile myprofile does not exist 2024-09-16T03:51:12.491 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:54: TEST_set: ceph osd erasure-code-profile set myprofile key=value plugin=isa 2024-09-16T03:51:12.967 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:56: TEST_set: ceph osd erasure-code-profile get myprofile 2024-09-16T03:51:12.967 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:57: TEST_set: grep -e key=value -e plugin=isa 2024-09-16T03:51:13.234 INFO:tasks.workunit.client.0.smithi096.stdout:key=value 2024-09-16T03:51:13.234 INFO:tasks.workunit.client.0.smithi096.stdout:plugin=isa 2024-09-16T03:51:13.234 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:62: TEST_set: ceph osd erasure-code-profile set myprofile 2024-09-16T03:51:13.426 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:63: TEST_set: grep 'will not override' td/osd-erasure-code-profile/out 2024-09-16T03:51:13.427 INFO:tasks.workunit.client.0.smithi096.stdout:Error EPERM: will not override erasure code profile myprofile because the existing profile {crush-device-class=,crush-failure-domain=host,crush-num-failure-domains=0,crush-osds-per-failure-domain=0,crush-root=default,k=7,key=value,m=3,plugin=isa,technique=reed_sol_van} is different from the proposed profile {crush-device-class=,crush-failure-domain=host,crush-num-failure-domains=0,crush-osds-per-failure-domain=0,crush-root=default,jerasure-per-chunk-alignment=false,k=2,m=2,plugin=jerasure,technique=reed_sol_van,w=8} 2024-09-16T03:51:13.428 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:64: TEST_set: ceph osd erasure-code-profile set myprofile key=other --force --yes-i-really-mean-it 2024-09-16T03:51:13.803 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:66: TEST_set: grep key=other 2024-09-16T03:51:13.804 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:65: TEST_set: ceph osd erasure-code-profile get myprofile 2024-09-16T03:51:14.073 INFO:tasks.workunit.client.0.smithi096.stdout:key=other 2024-09-16T03:51:14.073 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:68: TEST_set: ceph osd erasure-code-profile rm myprofile 2024-09-16T03:51:14.414 INFO:tasks.workunit.client.0.smithi096.stderr:erasure-code-profile myprofile does not exist 2024-09-16T03:51:14.431 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:33: run: teardown td/osd-erasure-code-profile 2024-09-16T03:51:14.431 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-erasure-code-profile 2024-09-16T03:51:14.431 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:51:14.431 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-erasure-code-profile KILL 2024-09-16T03:51:14.431 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:51:14.431 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:51:14.432 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:51:14.432 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:51:14.432 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:51:14.538 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:51:14.539 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:51:14.540 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:51:14.540 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:51:14.541 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:51:14.541 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:51:14.542 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:51:14.543 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:51:14.543 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:51:14.543 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:51:14.544 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:51:14.545 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:51:14.546 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:51:14.546 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-erasure-code-profile 2024-09-16T03:51:14.550 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:51:14.550 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:51:14.550 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.126710 2024-09-16T03:51:14.550 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.126710 2024-09-16T03:51:14.552 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:51:14.552 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:51:14.552 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:30: run: for func in $funcs 2024-09-16T03:51:14.552 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:31: run: setup td/osd-erasure-code-profile 2024-09-16T03:51:14.552 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-erasure-code-profile 2024-09-16T03:51:14.552 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-erasure-code-profile 2024-09-16T03:51:14.552 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-erasure-code-profile 2024-09-16T03:51:14.552 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:51:14.552 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-erasure-code-profile KILL 2024-09-16T03:51:14.553 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:51:14.553 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:51:14.553 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:51:14.553 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:51:14.553 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:51:14.554 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:51:14.554 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:51:14.555 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:51:14.556 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:51:14.557 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:51:14.557 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:51:14.557 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:51:14.558 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:51:14.558 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:51:14.558 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:51:14.559 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:51:14.560 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:51:14.561 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:51:14.561 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-erasure-code-profile 2024-09-16T03:51:14.562 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:51:14.563 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:51:14.563 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.126710 2024-09-16T03:51:14.563 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.126710 2024-09-16T03:51:14.564 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:51:14.564 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:51:14.564 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-erasure-code-profile 2024-09-16T03:51:14.565 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T03:51:14.566 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:51:14.566 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.126710 2024-09-16T03:51:14.566 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.126710 2024-09-16T03:51:14.568 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T03:51:14.568 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2024-09-16T03:51:14.568 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T03:51:14.568 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-erasure-code-profile 1' TERM HUP INT 2024-09-16T03:51:14.568 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:32: run: TEST_set_idempotent td/osd-erasure-code-profile 2024-09-16T03:51:14.568 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:127: TEST_set_idempotent: local dir=td/osd-erasure-code-profile 2024-09-16T03:51:14.569 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:128: TEST_set_idempotent: local id= 2024-09-16T03:51:14.569 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:130: TEST_set_idempotent: run_mon td/osd-erasure-code-profile a 2024-09-16T03:51:14.569 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-erasure-code-profile 2024-09-16T03:51:14.569 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T03:51:14.569 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T03:51:14.569 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T03:51:14.569 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-erasure-code-profile/a 2024-09-16T03:51:14.569 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-erasure-code-profile/a --run-dir=td/osd-erasure-code-profile 2024-09-16T03:51:15.041 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T03:51:15.041 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:51:15.041 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:51:15.042 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:51:15.042 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:51:15.042 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.126710 2024-09-16T03:51:15.042 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.126710/$cluster-$name.asok' 2024-09-16T03:51:15.042 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-erasure-code-profile/a '--log-file=td/osd-erasure-code-profile/$name.log' '--admin-socket=/tmp/ceph-asok.126710/$cluster-$name.asok' --mon-cluster-log-file=td/osd-erasure-code-profile/log --run-dir=td/osd-erasure-code-profile '--pid-file=td/osd-erasure-code-profile/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-09-16T03:51:15.236 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T03:51:15.237 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T03:51:15.237 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:51:15.237 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:51:15.237 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T03:51:15.237 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T03:51:15.238 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:51:15.238 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:51:15.238 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:51:15.238 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:51:15.238 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:51:15.238 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.126710 2024-09-16T03:51:15.239 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.126710/ceph-mon.a.asok 2024-09-16T03:51:15.239 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:51:15.239 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.126710/ceph-mon.a.asok config get fsid 2024-09-16T03:51:15.355 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T03:51:15.355 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:51:15.355 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:51:15.355 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T03:51:15.356 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T03:51:15.356 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:51:15.356 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:51:15.357 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:51:15.357 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:51:15.357 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:51:15.357 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.126710 2024-09-16T03:51:15.357 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.126710/ceph-mon.a.asok 2024-09-16T03:51:15.357 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:51:15.357 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.126710/ceph-mon.a.asok config get mon_host 2024-09-16T03:51:15.466 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:136: TEST_set_idempotent: ceph osd erasure-code-profile set default k=2 m=2 2024-09-16T03:51:16.328 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:137: TEST_set_idempotent: local profile 2024-09-16T03:51:16.328 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:143: TEST_set_idempotent: profile=profileidempotent1 2024-09-16T03:51:16.328 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:144: TEST_set_idempotent: ceph osd erasure-code-profile ls 2024-09-16T03:51:16.328 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:144: TEST_set_idempotent: grep profileidempotent1 2024-09-16T03:51:16.565 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:145: TEST_set_idempotent: ceph osd erasure-code-profile set profileidempotent1 k=2 crush-failure-domain=osd 2024-09-16T03:51:16.855 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:146: TEST_set_idempotent: ceph osd erasure-code-profile ls 2024-09-16T03:51:16.856 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:146: TEST_set_idempotent: grep profileidempotent1 2024-09-16T03:51:17.113 INFO:tasks.workunit.client.0.smithi096.stdout:profileidempotent1 2024-09-16T03:51:17.114 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:147: TEST_set_idempotent: ceph osd erasure-code-profile set profileidempotent1 k=2 crush-failure-domain=osd 2024-09-16T03:51:17.354 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:148: TEST_set_idempotent: ceph osd erasure-code-profile rm profileidempotent1 2024-09-16T03:51:17.683 INFO:tasks.workunit.client.0.smithi096.stderr:erasure-code-profile profileidempotent1 does not exist 2024-09-16T03:51:17.699 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:153: TEST_set_idempotent: profile=profileidempotent2 2024-09-16T03:51:17.699 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:154: TEST_set_idempotent: ceph osd erasure-code-profile ls 2024-09-16T03:51:17.699 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:154: TEST_set_idempotent: grep profileidempotent2 2024-09-16T03:51:17.971 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:155: TEST_set_idempotent: ceph osd erasure-code-profile set profileidempotent2 plugin=lrc k=4 m=2 l=3 crush-failure-domain=osd 2024-09-16T03:51:18.377 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:156: TEST_set_idempotent: ceph osd erasure-code-profile ls 2024-09-16T03:51:18.378 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:156: TEST_set_idempotent: grep profileidempotent2 2024-09-16T03:51:18.669 INFO:tasks.workunit.client.0.smithi096.stdout:profileidempotent2 2024-09-16T03:51:18.669 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:157: TEST_set_idempotent: ceph osd erasure-code-profile set profileidempotent2 plugin=lrc k=4 m=2 l=3 crush-failure-domain=osd 2024-09-16T03:51:18.948 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:158: TEST_set_idempotent: ceph osd erasure-code-profile rm profileidempotent2 2024-09-16T03:51:19.296 INFO:tasks.workunit.client.0.smithi096.stderr:erasure-code-profile profileidempotent2 does not exist 2024-09-16T03:51:19.312 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh:33: run: teardown td/osd-erasure-code-profile 2024-09-16T03:51:19.313 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-erasure-code-profile 2024-09-16T03:51:19.313 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:51:19.313 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-erasure-code-profile KILL 2024-09-16T03:51:19.313 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:51:19.313 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:51:19.314 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:51:19.314 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:51:19.314 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:51:19.422 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:51:19.422 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:51:19.424 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:51:19.424 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:51:19.425 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:51:19.425 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:51:19.426 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:51:19.427 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:51:19.427 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:51:19.427 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:51:19.427 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:51:19.428 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:51:19.429 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:51:19.430 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-erasure-code-profile 2024-09-16T03:51:19.432 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:51:19.432 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:51:19.432 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.126710 2024-09-16T03:51:19.432 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.126710 2024-09-16T03:51:19.433 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:51:19.433 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:51:19.434 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2322: main: code=0 2024-09-16T03:51:19.434 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2326: main: teardown td/osd-erasure-code-profile 0 2024-09-16T03:51:19.434 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-erasure-code-profile 2024-09-16T03:51:19.434 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2024-09-16T03:51:19.434 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-erasure-code-profile KILL 2024-09-16T03:51:19.434 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:51:19.434 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:51:19.434 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:51:19.435 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:51:19.435 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:51:19.436 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:51:19.437 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:51:19.437 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:51:19.438 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:51:19.439 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:51:19.439 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:51:19.439 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:51:19.440 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:51:19.440 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:51:19.441 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:51:19.441 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:51:19.442 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:51:19.443 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2024-09-16T03:51:19.443 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-erasure-code-profile 2024-09-16T03:51:19.444 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:51:19.444 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:51:19.444 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.126710 2024-09-16T03:51:19.445 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.126710 2024-09-16T03:51:19.445 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:51:19.446 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:51:19.446 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2327: main: return 0 2024-09-16T03:51:19.447 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-16T03:51:19.447 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-16T03:51:19.501 INFO:tasks.workunit:Running workunit mon/osd-pool-create.sh... 2024-09-16T03:51:19.501 DEBUG:teuthology.orchestra.run.smithi096:workunit test mon/osd-pool-create.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7498493279982dfe87f00616198a5967475f6169 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh 2024-09-16T03:51:19.561 INFO:tasks.workunit.client.0.smithi096.stderr:stty: 'standard input': Inappropriate ioctl for device 2024-09-16T03:51:19.568 INFO:tasks.workunit.client.0.smithi096.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2024-09-16T03:51:19.568 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2315: main: export PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-16T03:51:19.568 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2315: main: PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-16T03:51:19.568 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2316: main: export PYTHONWARNINGS=ignore 2024-09-16T03:51:19.568 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2316: main: PYTHONWARNINGS=ignore 2024-09-16T03:51:19.568 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2317: main: export CEPH_CONF=/dev/null 2024-09-16T03:51:19.568 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2317: main: CEPH_CONF=/dev/null 2024-09-16T03:51:19.568 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2318: main: unset CEPH_ARGS 2024-09-16T03:51:19.568 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2320: main: local code 2024-09-16T03:51:19.569 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2321: main: run td/osd-pool-create 2024-09-16T03:51:19.569 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:21: run: local dir=td/osd-pool-create 2024-09-16T03:51:19.569 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:22: run: shift 2024-09-16T03:51:19.569 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:24: run: export CEPH_MON=127.0.0.1:7105 2024-09-16T03:51:19.569 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:24: run: CEPH_MON=127.0.0.1:7105 2024-09-16T03:51:19.569 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:25: run: uuidgen 2024-09-16T03:51:19.569 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:25: run: CEPH_ARGS+='--fsid=38a92d84-8703-45d8-b5ef-7d976430f112 --auth-supported=none ' 2024-09-16T03:51:19.570 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:26: run: CEPH_ARGS+='--mon-host=127.0.0.1:7105 ' 2024-09-16T03:51:19.570 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:27: run: export CEPH_ARGS 2024-09-16T03:51:19.570 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:29: run: set 2024-09-16T03:51:19.570 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:29: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2024-09-16T03:51:19.573 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:29: run: local 'funcs=TEST_erasure_code_pool 2024-09-16T03:51:19.573 INFO:tasks.workunit.client.0.smithi096.stderr:TEST_erasure_code_pool_lrc 2024-09-16T03:51:19.573 INFO:tasks.workunit.client.0.smithi096.stderr:TEST_erasure_code_profile_default 2024-09-16T03:51:19.573 INFO:tasks.workunit.client.0.smithi096.stderr:TEST_erasure_crush_rule 2024-09-16T03:51:19.573 INFO:tasks.workunit.client.0.smithi096.stderr:TEST_erasure_crush_stripe_unit 2024-09-16T03:51:19.573 INFO:tasks.workunit.client.0.smithi096.stderr:TEST_erasure_crush_stripe_unit_padded 2024-09-16T03:51:19.573 INFO:tasks.workunit.client.0.smithi096.stderr:TEST_erasure_invalid_profile 2024-09-16T03:51:19.573 INFO:tasks.workunit.client.0.smithi096.stderr:TEST_no_pool_delete 2024-09-16T03:51:19.573 INFO:tasks.workunit.client.0.smithi096.stderr:TEST_pool_both_prio 2024-09-16T03:51:19.573 INFO:tasks.workunit.client.0.smithi096.stderr:TEST_pool_both_prio_no_neg 2024-09-16T03:51:19.573 INFO:tasks.workunit.client.0.smithi096.stderr:TEST_pool_both_prio_no_pos 2024-09-16T03:51:19.573 INFO:tasks.workunit.client.0.smithi096.stderr:TEST_pool_neg_only_prio 2024-09-16T03:51:19.574 INFO:tasks.workunit.client.0.smithi096.stderr:TEST_pool_pos_only_prio 2024-09-16T03:51:19.574 INFO:tasks.workunit.client.0.smithi096.stderr:TEST_replicated_pool 2024-09-16T03:51:19.574 INFO:tasks.workunit.client.0.smithi096.stderr:TEST_replicated_pool_with_rule 2024-09-16T03:51:19.574 INFO:tasks.workunit.client.0.smithi096.stderr:TEST_utf8_cli' 2024-09-16T03:51:19.574 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:30: run: for func in $funcs 2024-09-16T03:51:19.574 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:31: run: setup td/osd-pool-create 2024-09-16T03:51:19.574 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-pool-create 2024-09-16T03:51:19.574 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-pool-create 2024-09-16T03:51:19.574 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-pool-create 2024-09-16T03:51:19.574 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:51:19.574 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-pool-create KILL 2024-09-16T03:51:19.574 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:51:19.574 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:51:19.574 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:51:19.575 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:51:19.575 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:51:19.575 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:51:19.575 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:51:19.576 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:51:19.576 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:51:19.577 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:51:19.577 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:51:19.577 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:51:19.578 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:51:19.579 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:51:19.579 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:51:19.579 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:51:19.580 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:51:19.581 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:51:19.581 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-pool-create 2024-09-16T03:51:19.583 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:51:19.583 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:51:19.583 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:51:19.583 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.128966 2024-09-16T03:51:19.584 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:51:19.584 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:51:19.584 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-pool-create 2024-09-16T03:51:19.585 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T03:51:19.585 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:51:19.585 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:51:19.586 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.128966 2024-09-16T03:51:19.588 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T03:51:19.588 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2024-09-16T03:51:19.588 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2024-09-16T03:51:19.588 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T03:51:19.588 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-pool-create 1' TERM HUP INT 2024-09-16T03:51:19.588 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:32: run: TEST_erasure_code_pool td/osd-pool-create 2024-09-16T03:51:19.588 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:119: TEST_erasure_code_pool: local dir=td/osd-pool-create 2024-09-16T03:51:19.588 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:120: TEST_erasure_code_pool: run_mon td/osd-pool-create a 2024-09-16T03:51:19.588 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-pool-create 2024-09-16T03:51:19.589 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T03:51:19.589 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T03:51:19.589 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T03:51:19.589 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-pool-create/a 2024-09-16T03:51:19.589 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-pool-create/a --run-dir=td/osd-pool-create 2024-09-16T03:51:20.080 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T03:51:20.081 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:51:20.081 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:51:20.081 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:51:20.081 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:51:20.081 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:51:20.082 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T03:51:20.082 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-pool-create/a '--log-file=td/osd-pool-create/$name.log' '--admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' --mon-cluster-log-file=td/osd-pool-create/log --run-dir=td/osd-pool-create '--pid-file=td/osd-pool-create/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-09-16T03:51:20.282 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T03:51:20.284 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T03:51:20.284 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:51:20.284 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:51:20.284 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T03:51:20.284 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T03:51:20.284 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:51:20.284 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:51:20.284 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:51:20.285 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:51:20.285 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:51:20.285 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:51:20.285 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.128966/ceph-mon.a.asok 2024-09-16T03:51:20.286 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:51:20.286 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.128966/ceph-mon.a.asok config get fsid 2024-09-16T03:51:20.403 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T03:51:20.404 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:51:20.404 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:51:20.404 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T03:51:20.406 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:51:20.406 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:51:20.406 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:51:20.406 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T03:51:20.406 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:51:20.406 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:51:20.407 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:51:20.407 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.128966/ceph-mon.a.asok 2024-09-16T03:51:20.407 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:51:20.407 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.128966/ceph-mon.a.asok config get mon_host 2024-09-16T03:51:20.515 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:121: TEST_erasure_code_pool: ceph --format json osd dump 2024-09-16T03:51:21.352 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:122: TEST_erasure_code_pool: local 'expected="erasure_code_profile":"default"' 2024-09-16T03:51:21.352 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:123: TEST_erasure_code_pool: grep '"erasure_code_profile":"default"' td/osd-pool-create/osd.json 2024-09-16T03:51:21.353 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:124: TEST_erasure_code_pool: ceph osd pool create erasurecodes 12 12 erasure 2024-09-16T03:51:21.796 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'erasurecodes' already exists 2024-09-16T03:51:21.816 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:125: TEST_erasure_code_pool: ceph --format json osd dump 2024-09-16T03:51:21.817 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:125: TEST_erasure_code_pool: tee td/osd-pool-create/osd.json 2024-09-16T03:51:22.045 INFO:tasks.workunit.client.0.smithi096.stdout: 2024-09-16T03:51:22.045 INFO:tasks.workunit.client.0.smithi096.stdout:{"epoch":3,"fsid":"38a92d84-8703-45d8-b5ef-7d976430f112","created":"2024-09-16T03:51:20.584813+0000","modified":"2024-09-16T03:51:21.706132+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.99000000953674316,"backfillfull_ratio":0.99000000953674316,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":0,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"erasurecodes","create_time":"2024-09-16T03:51:21.610712+0000","flags":32769,"flags_names":"hashpspool,creating","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":12,"pg_placement_num":12,"pg_placement_num_target":12,"pg_num_target":12,"pg_num_pending":12,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"3","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"default","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{}}],"osds":[],"osd_xinfo":[],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T03:51:22.060 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:126: TEST_erasure_code_pool: grep '"erasure_code_profile":"default"' td/osd-pool-create/osd.json 2024-09-16T03:51:22.062 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:128: TEST_erasure_code_pool: ceph osd pool create erasurecodes 12 12 erasure 2024-09-16T03:51:22.062 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:129: TEST_erasure_code_pool: grep 'already exists' 2024-09-16T03:51:22.300 INFO:tasks.workunit.client.0.smithi096.stdout:pool 'erasurecodes' already exists 2024-09-16T03:51:22.301 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:130: TEST_erasure_code_pool: ceph osd pool create erasurecodes 12 12 2024-09-16T03:51:22.301 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:131: TEST_erasure_code_pool: grep 'cannot change to type replicated' 2024-09-16T03:51:22.486 INFO:tasks.workunit.client.0.smithi096.stdout:Error EINVAL: pool 'erasurecodes' cannot change to type replicated 2024-09-16T03:51:22.487 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:33: run: teardown td/osd-pool-create 2024-09-16T03:51:22.488 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-pool-create 2024-09-16T03:51:22.488 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:51:22.488 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-pool-create KILL 2024-09-16T03:51:22.488 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:51:22.488 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:51:22.488 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:51:22.488 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:51:22.488 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:51:22.594 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:51:22.595 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:51:22.596 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:51:22.597 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:51:22.598 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:51:22.598 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:51:22.598 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:51:22.599 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:51:22.600 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:51:22.600 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:51:22.600 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:51:22.601 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:51:22.602 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:51:22.602 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-pool-create 2024-09-16T03:51:22.604 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:51:22.604 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:51:22.604 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:51:22.604 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.128966 2024-09-16T03:51:22.607 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:51:22.607 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:51:22.607 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:30: run: for func in $funcs 2024-09-16T03:51:22.607 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:31: run: setup td/osd-pool-create 2024-09-16T03:51:22.607 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-pool-create 2024-09-16T03:51:22.607 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-pool-create 2024-09-16T03:51:22.607 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-pool-create 2024-09-16T03:51:22.607 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:51:22.607 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-pool-create KILL 2024-09-16T03:51:22.607 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:51:22.608 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:51:22.608 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:51:22.608 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:51:22.608 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:51:22.609 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:51:22.610 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:51:22.610 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:51:22.611 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:51:22.612 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:51:22.612 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:51:22.612 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:51:22.613 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:51:22.613 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:51:22.614 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:51:22.614 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:51:22.615 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:51:22.616 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:51:22.616 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-pool-create 2024-09-16T03:51:22.617 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:51:22.617 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:51:22.617 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:51:22.618 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.128966 2024-09-16T03:51:22.618 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:51:22.619 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:51:22.619 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-pool-create 2024-09-16T03:51:22.620 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T03:51:22.620 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:51:22.620 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:51:22.620 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.128966 2024-09-16T03:51:22.623 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T03:51:22.623 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2024-09-16T03:51:22.623 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T03:51:22.623 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-pool-create 1' TERM HUP INT 2024-09-16T03:51:22.623 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:32: run: TEST_erasure_code_pool_lrc td/osd-pool-create 2024-09-16T03:51:22.623 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:154: TEST_erasure_code_pool_lrc: local dir=td/osd-pool-create 2024-09-16T03:51:22.623 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:155: TEST_erasure_code_pool_lrc: run_mon td/osd-pool-create a 2024-09-16T03:51:22.623 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-pool-create 2024-09-16T03:51:22.623 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T03:51:22.623 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T03:51:22.624 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T03:51:22.624 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-pool-create/a 2024-09-16T03:51:22.624 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-pool-create/a --run-dir=td/osd-pool-create 2024-09-16T03:51:23.091 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T03:51:23.091 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:51:23.091 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:51:23.092 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:51:23.092 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:51:23.092 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:51:23.092 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T03:51:23.092 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-pool-create/a '--log-file=td/osd-pool-create/$name.log' '--admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' --mon-cluster-log-file=td/osd-pool-create/log --run-dir=td/osd-pool-create '--pid-file=td/osd-pool-create/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-09-16T03:51:23.292 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T03:51:23.293 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T03:51:23.293 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:51:23.293 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:51:23.293 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T03:51:23.294 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T03:51:23.294 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:51:23.294 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:51:23.295 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:51:23.295 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:51:23.295 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:51:23.295 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:51:23.295 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.128966/ceph-mon.a.asok 2024-09-16T03:51:23.295 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:51:23.295 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.128966/ceph-mon.a.asok config get fsid 2024-09-16T03:51:23.412 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T03:51:23.412 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:51:23.412 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:51:23.412 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T03:51:23.413 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:51:23.413 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:51:23.413 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:51:23.413 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T03:51:23.413 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:51:23.413 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:51:23.413 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:51:23.414 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.128966/ceph-mon.a.asok 2024-09-16T03:51:23.414 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:51:23.414 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.128966/ceph-mon.a.asok config get mon_host 2024-09-16T03:51:23.526 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:157: TEST_erasure_code_pool_lrc: ceph osd erasure-code-profile set LRCprofile plugin=lrc mapping=DD_ 'layers=[ [ "DDc", "" ] ]' 2024-09-16T03:51:24.464 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:162: TEST_erasure_code_pool_lrc: ceph --format json osd dump 2024-09-16T03:51:24.729 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:163: TEST_erasure_code_pool_lrc: local 'expected="erasure_code_profile":"LRCprofile"' 2024-09-16T03:51:24.729 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:164: TEST_erasure_code_pool_lrc: local poolname=erasurecodes 2024-09-16T03:51:24.729 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:165: TEST_erasure_code_pool_lrc: grep '"erasure_code_profile":"LRCprofile"' td/osd-pool-create/osd.json 2024-09-16T03:51:24.730 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:166: TEST_erasure_code_pool_lrc: ceph osd pool create erasurecodes 12 12 erasure LRCprofile 2024-09-16T03:51:25.258 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'erasurecodes' already exists 2024-09-16T03:51:25.277 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:167: TEST_erasure_code_pool_lrc: ceph --format json osd dump 2024-09-16T03:51:25.277 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:167: TEST_erasure_code_pool_lrc: tee td/osd-pool-create/osd.json 2024-09-16T03:51:25.515 INFO:tasks.workunit.client.0.smithi096.stdout: 2024-09-16T03:51:25.515 INFO:tasks.workunit.client.0.smithi096.stdout:{"epoch":4,"fsid":"38a92d84-8703-45d8-b5ef-7d976430f112","created":"2024-09-16T03:51:23.603500+0000","modified":"2024-09-16T03:51:25.159599+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.99000000953674316,"backfillfull_ratio":0.99000000953674316,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":0,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"erasurecodes","create_time":"2024-09-16T03:51:25.055951+0000","flags":32769,"flags_names":"hashpspool,creating","type":3,"size":3,"min_size":2,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":12,"pg_placement_num":12,"pg_placement_num_target":12,"pg_num_target":12,"pg_num_pending":12,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"4","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"LRCprofile","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{}}],"osds":[],"osd_xinfo":[],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"LRCprofile":{"crush-device-class":"","crush-failure-domain":"host","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","k":"-1","l":"-1","layers":"[ [ \"DDc\", \"\" ] ]","m":"-1","mapping":"DD_","plugin":"lrc"},"default":{"k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T03:51:25.530 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:168: TEST_erasure_code_pool_lrc: grep '"erasure_code_profile":"LRCprofile"' td/osd-pool-create/osd.json 2024-09-16T03:51:25.534 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:169: TEST_erasure_code_pool_lrc: ceph osd crush rule ls 2024-09-16T03:51:25.534 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:169: TEST_erasure_code_pool_lrc: grep erasurecodes 2024-09-16T03:51:25.767 INFO:tasks.workunit.client.0.smithi096.stdout:erasurecodes 2024-09-16T03:51:25.768 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:33: run: teardown td/osd-pool-create 2024-09-16T03:51:25.769 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-pool-create 2024-09-16T03:51:25.769 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:51:25.769 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-pool-create KILL 2024-09-16T03:51:25.769 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:51:25.769 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:51:25.769 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:51:25.770 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:51:25.770 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:51:25.875 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:51:25.876 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:51:25.877 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:51:25.877 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:51:25.878 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:51:25.879 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:51:25.879 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:51:25.880 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:51:25.880 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:51:25.880 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:51:25.880 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:51:25.881 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:51:25.882 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:51:25.883 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-pool-create 2024-09-16T03:51:25.884 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:51:25.885 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:51:25.885 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:51:25.885 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.128966 2024-09-16T03:51:25.886 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:51:25.887 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:51:25.887 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:30: run: for func in $funcs 2024-09-16T03:51:25.887 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:31: run: setup td/osd-pool-create 2024-09-16T03:51:25.887 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-pool-create 2024-09-16T03:51:25.887 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-pool-create 2024-09-16T03:51:25.887 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-pool-create 2024-09-16T03:51:25.887 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:51:25.887 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-pool-create KILL 2024-09-16T03:51:25.887 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:51:25.887 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:51:25.887 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:51:25.888 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:51:25.888 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:51:25.889 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:51:25.889 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:51:25.890 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:51:25.890 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:51:25.891 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:51:25.892 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:51:25.892 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:51:25.893 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:51:25.893 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:51:25.893 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:51:25.893 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:51:25.894 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:51:25.895 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:51:25.895 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-pool-create 2024-09-16T03:51:25.897 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:51:25.897 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:51:25.897 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:51:25.897 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.128966 2024-09-16T03:51:25.898 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:51:25.898 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:51:25.898 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-pool-create 2024-09-16T03:51:25.899 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T03:51:25.899 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:51:25.900 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:51:25.900 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.128966 2024-09-16T03:51:25.901 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T03:51:25.902 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2024-09-16T03:51:25.902 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T03:51:25.902 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-pool-create 1' TERM HUP INT 2024-09-16T03:51:25.902 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:32: run: TEST_erasure_code_profile_default td/osd-pool-create 2024-09-16T03:51:25.902 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:78: TEST_erasure_code_profile_default: local dir=td/osd-pool-create 2024-09-16T03:51:25.902 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:79: TEST_erasure_code_profile_default: run_mon td/osd-pool-create a 2024-09-16T03:51:25.903 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-pool-create 2024-09-16T03:51:25.903 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T03:51:25.903 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T03:51:25.903 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T03:51:25.903 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-pool-create/a 2024-09-16T03:51:25.903 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-pool-create/a --run-dir=td/osd-pool-create 2024-09-16T03:51:26.369 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T03:51:26.369 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:51:26.369 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:51:26.369 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:51:26.369 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:51:26.369 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:51:26.370 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T03:51:26.370 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-pool-create/a '--log-file=td/osd-pool-create/$name.log' '--admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' --mon-cluster-log-file=td/osd-pool-create/log --run-dir=td/osd-pool-create '--pid-file=td/osd-pool-create/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-09-16T03:51:26.572 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T03:51:26.573 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T03:51:26.573 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:51:26.573 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:51:26.573 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T03:51:26.574 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T03:51:26.574 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:51:26.575 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:51:26.575 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:51:26.575 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:51:26.575 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:51:26.575 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:51:26.575 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.128966/ceph-mon.a.asok 2024-09-16T03:51:26.575 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:51:26.575 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.128966/ceph-mon.a.asok config get fsid 2024-09-16T03:51:26.693 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T03:51:26.693 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:51:26.693 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:51:26.693 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T03:51:26.694 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T03:51:26.694 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:51:26.694 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:51:26.694 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:51:26.694 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:51:26.695 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:51:26.695 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:51:26.695 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.128966/ceph-mon.a.asok 2024-09-16T03:51:26.695 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:51:26.695 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.128966/ceph-mon.a.asok config get mon_host 2024-09-16T03:51:26.808 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:80: TEST_erasure_code_profile_default: ceph osd erasure-code-profile rm default 2024-09-16T03:51:27.716 INFO:tasks.workunit.client.0.smithi096.stderr:erasure-code-profile default does not exist 2024-09-16T03:51:27.734 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:81: TEST_erasure_code_profile_default: ceph osd erasure-code-profile ls 2024-09-16T03:51:27.734 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:81: TEST_erasure_code_profile_default: grep default 2024-09-16T03:51:28.004 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:82: TEST_erasure_code_profile_default: ceph osd pool create 12 12 erasure default 2024-09-16T03:51:28.678 INFO:tasks.workunit.client.0.smithi096.stderr:pool '12' already exists 2024-09-16T03:51:28.697 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:83: TEST_erasure_code_profile_default: ceph osd erasure-code-profile ls 2024-09-16T03:51:28.697 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:83: TEST_erasure_code_profile_default: grep default 2024-09-16T03:51:28.955 INFO:tasks.workunit.client.0.smithi096.stdout:default 2024-09-16T03:51:28.956 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:33: run: teardown td/osd-pool-create 2024-09-16T03:51:28.956 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-pool-create 2024-09-16T03:51:28.956 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:51:28.956 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-pool-create KILL 2024-09-16T03:51:28.957 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:51:28.957 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:51:28.957 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:51:28.957 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:51:28.957 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:51:29.063 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:51:29.063 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:51:29.064 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:51:29.065 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:51:29.066 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:51:29.066 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:51:29.067 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:51:29.068 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:51:29.068 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:51:29.068 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:51:29.068 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:51:29.069 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:51:29.070 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:51:29.070 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-pool-create 2024-09-16T03:51:29.074 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:51:29.074 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:51:29.074 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:51:29.074 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.128966 2024-09-16T03:51:29.075 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:51:29.075 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:51:29.076 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:30: run: for func in $funcs 2024-09-16T03:51:29.076 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:31: run: setup td/osd-pool-create 2024-09-16T03:51:29.076 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-pool-create 2024-09-16T03:51:29.076 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-pool-create 2024-09-16T03:51:29.076 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-pool-create 2024-09-16T03:51:29.076 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:51:29.076 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-pool-create KILL 2024-09-16T03:51:29.076 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:51:29.076 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:51:29.077 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:51:29.077 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:51:29.077 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:51:29.078 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:51:29.078 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:51:29.079 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:51:29.080 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:51:29.081 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:51:29.081 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:51:29.081 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:51:29.082 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:51:29.082 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:51:29.083 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:51:29.083 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:51:29.084 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:51:29.085 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:51:29.085 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-pool-create 2024-09-16T03:51:29.086 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:51:29.086 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:51:29.086 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:51:29.086 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.128966 2024-09-16T03:51:29.087 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:51:29.088 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:51:29.088 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-pool-create 2024-09-16T03:51:29.089 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T03:51:29.089 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:51:29.089 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:51:29.089 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.128966 2024-09-16T03:51:29.091 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T03:51:29.092 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2024-09-16T03:51:29.092 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T03:51:29.092 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-pool-create 1' TERM HUP INT 2024-09-16T03:51:29.092 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:32: run: TEST_erasure_crush_rule td/osd-pool-create 2024-09-16T03:51:29.092 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:48: TEST_erasure_crush_rule: local dir=td/osd-pool-create 2024-09-16T03:51:29.092 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:49: TEST_erasure_crush_rule: run_mon td/osd-pool-create a 2024-09-16T03:51:29.092 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-pool-create 2024-09-16T03:51:29.092 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T03:51:29.093 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T03:51:29.093 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T03:51:29.093 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-pool-create/a 2024-09-16T03:51:29.093 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-pool-create/a --run-dir=td/osd-pool-create 2024-09-16T03:51:29.572 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T03:51:29.572 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:51:29.572 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:51:29.572 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:51:29.572 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:51:29.573 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:51:29.573 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T03:51:29.573 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-pool-create/a '--log-file=td/osd-pool-create/$name.log' '--admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' --mon-cluster-log-file=td/osd-pool-create/log --run-dir=td/osd-pool-create '--pid-file=td/osd-pool-create/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-09-16T03:51:29.775 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T03:51:29.776 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T03:51:29.776 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:51:29.776 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:51:29.776 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T03:51:29.777 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T03:51:29.777 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:51:29.777 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:51:29.777 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:51:29.777 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:51:29.777 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:51:29.777 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:51:29.777 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.128966/ceph-mon.a.asok 2024-09-16T03:51:29.778 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:51:29.778 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.128966/ceph-mon.a.asok config get fsid 2024-09-16T03:51:29.896 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T03:51:29.896 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:51:29.896 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:51:29.896 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T03:51:29.897 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T03:51:29.897 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:51:29.897 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:51:29.897 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:51:29.897 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:51:29.897 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:51:29.898 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:51:29.898 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.128966/ceph-mon.a.asok 2024-09-16T03:51:29.898 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:51:29.898 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.128966/ceph-mon.a.asok config get mon_host 2024-09-16T03:51:30.011 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:53: TEST_erasure_crush_rule: local crush_rule=myrule 2024-09-16T03:51:30.011 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:54: TEST_erasure_crush_rule: ceph osd crush rule ls 2024-09-16T03:51:30.012 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:54: TEST_erasure_crush_rule: grep myrule 2024-09-16T03:51:30.864 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:55: TEST_erasure_crush_rule: ceph osd crush rule create-erasure myrule 2024-09-16T03:51:31.144 INFO:tasks.workunit.client.0.smithi096.stderr:rule myrule already exists 2024-09-16T03:51:31.160 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:56: TEST_erasure_crush_rule: ceph osd crush rule ls 2024-09-16T03:51:31.161 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:56: TEST_erasure_crush_rule: grep myrule 2024-09-16T03:51:31.420 INFO:tasks.workunit.client.0.smithi096.stdout:myrule 2024-09-16T03:51:31.421 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:57: TEST_erasure_crush_rule: local poolname 2024-09-16T03:51:31.421 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:58: TEST_erasure_crush_rule: poolname=pool_erasure1 2024-09-16T03:51:31.421 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:59: TEST_erasure_crush_rule: grep '"crush_rule":1' 2024-09-16T03:51:31.421 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:59: TEST_erasure_crush_rule: ceph --format json osd dump 2024-09-16T03:51:31.656 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:60: TEST_erasure_crush_rule: ceph osd pool create pool_erasure1 12 12 erasure default myrule 2024-09-16T03:51:31.997 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'pool_erasure1' already exists 2024-09-16T03:51:32.015 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:61: TEST_erasure_crush_rule: ceph --format json osd dump 2024-09-16T03:51:32.015 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:61: TEST_erasure_crush_rule: grep '"crush_rule":1' 2024-09-16T03:51:32.285 INFO:tasks.workunit.client.0.smithi096.stdout:{"epoch":3,"fsid":"38a92d84-8703-45d8-b5ef-7d976430f112","created":"2024-09-16T03:51:30.067508+0000","modified":"2024-09-16T03:51:31.897650+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.99000000953674316,"backfillfull_ratio":0.99000000953674316,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":0,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"pool_erasure1","create_time":"2024-09-16T03:51:31.847441+0000","flags":32769,"flags_names":"hashpspool,creating","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":12,"pg_placement_num":12,"pg_placement_num_target":12,"pg_num_target":12,"pg_num_pending":12,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"3","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"default","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{}}],"osds":[],"osd_xinfo":[],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T03:51:32.285 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:65: TEST_erasure_crush_rule: poolname=pool_erasure2 2024-09-16T03:51:32.286 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:66: TEST_erasure_crush_rule: ceph osd erasure-code-profile set myprofile 2024-09-16T03:51:32.641 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:67: TEST_erasure_crush_rule: ceph osd pool create pool_erasure2 12 12 erasure myprofile 2024-09-16T03:51:33.351 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'pool_erasure2' already exists 2024-09-16T03:51:33.371 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:68: TEST_erasure_crush_rule: ceph osd crush rule ls 2024-09-16T03:51:33.371 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:68: TEST_erasure_crush_rule: grep pool_erasure2 2024-09-16T03:51:33.615 INFO:tasks.workunit.client.0.smithi096.stdout:pool_erasure2 2024-09-16T03:51:33.616 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:73: TEST_erasure_crush_rule: poolname=pool_erasure3 2024-09-16T03:51:33.616 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:74: TEST_erasure_crush_rule: ceph osd pool create pool_erasure3 12 12 erasure myprofile INVALIDRULE 2024-09-16T03:51:33.801 INFO:tasks.workunit.client.0.smithi096.stderr:Error ENOENT: specified rule INVALIDRULE doesn't exist 2024-09-16T03:51:33.804 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:33: run: teardown td/osd-pool-create 2024-09-16T03:51:33.804 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-pool-create 2024-09-16T03:51:33.804 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:51:33.804 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-pool-create KILL 2024-09-16T03:51:33.805 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:51:33.805 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:51:33.805 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:51:33.805 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:51:33.805 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:51:33.912 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:51:33.912 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:51:33.913 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:51:33.914 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:51:33.916 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:51:33.916 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:51:33.916 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:51:33.918 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:51:33.918 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:51:33.918 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:51:33.919 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:51:33.919 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:51:33.920 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:51:33.921 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-pool-create 2024-09-16T03:51:33.923 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:51:33.923 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:51:33.923 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:51:33.923 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.128966 2024-09-16T03:51:33.924 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:51:33.924 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:51:33.924 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:30: run: for func in $funcs 2024-09-16T03:51:33.924 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:31: run: setup td/osd-pool-create 2024-09-16T03:51:33.925 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-pool-create 2024-09-16T03:51:33.925 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-pool-create 2024-09-16T03:51:33.925 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-pool-create 2024-09-16T03:51:33.925 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:51:33.925 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-pool-create KILL 2024-09-16T03:51:33.925 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:51:33.926 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:51:33.926 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:51:33.926 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:51:33.926 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:51:33.928 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:51:33.928 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:51:33.929 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:51:33.930 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:51:33.931 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:51:33.931 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:51:33.931 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:51:33.932 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:51:33.932 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:51:33.932 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:51:33.933 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:51:33.933 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:51:33.935 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:51:33.935 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-pool-create 2024-09-16T03:51:33.936 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:51:33.936 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:51:33.937 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:51:33.937 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.128966 2024-09-16T03:51:33.937 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:51:33.938 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:51:33.938 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-pool-create 2024-09-16T03:51:33.939 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T03:51:33.939 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:51:33.940 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:51:33.940 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.128966 2024-09-16T03:51:33.941 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T03:51:33.942 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2024-09-16T03:51:33.943 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T03:51:33.943 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-pool-create 1' TERM HUP INT 2024-09-16T03:51:33.943 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:32: run: TEST_erasure_crush_stripe_unit td/osd-pool-create 2024-09-16T03:51:33.943 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:87: TEST_erasure_crush_stripe_unit: local dir=td/osd-pool-create 2024-09-16T03:51:33.943 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:89: TEST_erasure_crush_stripe_unit: run_mon td/osd-pool-create a --public-addr 127.0.0.1:7105 2024-09-16T03:51:33.943 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-pool-create 2024-09-16T03:51:33.943 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T03:51:33.943 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T03:51:33.943 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T03:51:33.943 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-pool-create/a 2024-09-16T03:51:33.943 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-pool-create/a --run-dir=td/osd-pool-create --public-addr 127.0.0.1:7105 2024-09-16T03:51:34.395 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T03:51:34.395 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:51:34.395 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:51:34.396 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:51:34.396 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:51:34.396 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:51:34.396 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T03:51:34.396 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-pool-create/a '--log-file=td/osd-pool-create/$name.log' '--admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' --mon-cluster-log-file=td/osd-pool-create/log --run-dir=td/osd-pool-create '--pid-file=td/osd-pool-create/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr 127.0.0.1:7105 2024-09-16T03:51:34.607 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T03:51:34.608 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T03:51:34.609 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:51:34.609 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:51:34.609 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T03:51:34.609 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T03:51:34.609 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:51:34.610 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:51:34.610 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:51:34.610 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:51:34.610 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:51:34.610 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:51:34.611 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.128966/ceph-mon.a.asok 2024-09-16T03:51:34.611 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:51:34.611 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.128966/ceph-mon.a.asok config get fsid 2024-09-16T03:51:34.728 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T03:51:34.728 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:51:34.728 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:51:34.728 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T03:51:34.729 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:51:34.729 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:51:34.729 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:51:34.729 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T03:51:34.730 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:51:34.730 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:51:34.730 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:51:34.730 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.128966/ceph-mon.a.asok 2024-09-16T03:51:34.730 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:51:34.730 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.128966/ceph-mon.a.asok config get mon_host 2024-09-16T03:51:34.839 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:90: TEST_erasure_crush_stripe_unit: ceph-conf --show-config-value osd_pool_erasure_code_stripe_unit 2024-09-16T03:51:34.858 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:90: TEST_erasure_crush_stripe_unit: stripe_unit=4096 2024-09-16T03:51:34.859 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:91: TEST_erasure_crush_stripe_unit: ceph osd erasure-code-profile get myprofile 2024-09-16T03:51:34.859 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:91: TEST_erasure_crush_stripe_unit: grep k= 2024-09-16T03:51:35.658 INFO:tasks.workunit.client.0.smithi096.stderr:Error ENOENT: unknown erasure code profile 'myprofile' 2024-09-16T03:51:35.661 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:91: TEST_erasure_crush_stripe_unit: eval local 2024-09-16T03:51:35.661 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:91: TEST_erasure_crush_stripe_unit: local 2024-09-16T03:51:35.662 INFO:tasks.workunit.client.0.smithi096.stdout:declare -- dir="td/osd-pool-create" 2024-09-16T03:51:35.662 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:92: TEST_erasure_crush_stripe_unit: stripe_width = 0 2024-09-16T03:51:35.662 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh: line 92: stripe_width: command not found 2024-09-16T03:51:35.662 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:93: TEST_erasure_crush_stripe_unit: ceph osd pool create pool_erasure 12 12 erasure 2024-09-16T03:51:36.119 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'pool_erasure' already exists 2024-09-16T03:51:36.138 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:94: TEST_erasure_crush_stripe_unit: ceph --format json osd dump 2024-09-16T03:51:36.138 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:94: TEST_erasure_crush_stripe_unit: tee td/osd-pool-create/osd.json 2024-09-16T03:51:36.376 INFO:tasks.workunit.client.0.smithi096.stdout: 2024-09-16T03:51:36.376 INFO:tasks.workunit.client.0.smithi096.stdout:{"epoch":3,"fsid":"38a92d84-8703-45d8-b5ef-7d976430f112","created":"2024-09-16T03:51:34.924251+0000","modified":"2024-09-16T03:51:36.020294+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.99000000953674316,"backfillfull_ratio":0.99000000953674316,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":0,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"pool_erasure","create_time":"2024-09-16T03:51:35.933194+0000","flags":32769,"flags_names":"hashpspool,creating","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":12,"pg_placement_num":12,"pg_placement_num_target":12,"pg_num_target":12,"pg_num_pending":12,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"3","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"default","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{}}],"osds":[],"osd_xinfo":[],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T03:51:36.392 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:95: TEST_erasure_crush_stripe_unit: grep '"stripe_width":' td/osd-pool-create/osd.json 2024-09-16T03:51:36.393 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:33: run: teardown td/osd-pool-create 2024-09-16T03:51:36.393 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-pool-create 2024-09-16T03:51:36.393 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:51:36.393 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-pool-create KILL 2024-09-16T03:51:36.394 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:51:36.394 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:51:36.394 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:51:36.394 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:51:36.394 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:51:36.500 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:51:36.500 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:51:36.502 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:51:36.502 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:51:36.504 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:51:36.504 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:51:36.505 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:51:36.506 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:51:36.506 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:51:36.506 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:51:36.507 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:51:36.507 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:51:36.508 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:51:36.509 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-pool-create 2024-09-16T03:51:36.511 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:51:36.511 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:51:36.511 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:51:36.511 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.128966 2024-09-16T03:51:36.513 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:51:36.513 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:51:36.513 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:30: run: for func in $funcs 2024-09-16T03:51:36.513 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:31: run: setup td/osd-pool-create 2024-09-16T03:51:36.513 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-pool-create 2024-09-16T03:51:36.513 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-pool-create 2024-09-16T03:51:36.513 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-pool-create 2024-09-16T03:51:36.513 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:51:36.513 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-pool-create KILL 2024-09-16T03:51:36.513 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:51:36.514 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:51:36.514 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:51:36.514 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:51:36.514 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:51:36.515 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:51:36.515 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:51:36.516 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:51:36.516 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:51:36.517 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:51:36.517 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:51:36.518 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:51:36.519 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:51:36.519 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:51:36.519 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:51:36.520 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:51:36.520 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:51:36.522 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:51:36.522 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-pool-create 2024-09-16T03:51:36.523 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:51:36.523 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:51:36.523 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:51:36.524 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.128966 2024-09-16T03:51:36.524 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:51:36.524 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:51:36.524 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-pool-create 2024-09-16T03:51:36.526 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T03:51:36.526 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:51:36.526 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:51:36.527 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.128966 2024-09-16T03:51:36.528 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T03:51:36.530 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2024-09-16T03:51:36.530 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T03:51:36.530 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-pool-create 1' TERM HUP INT 2024-09-16T03:51:36.530 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:32: run: TEST_erasure_crush_stripe_unit_padded td/osd-pool-create 2024-09-16T03:51:36.530 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:99: TEST_erasure_crush_stripe_unit_padded: local dir=td/osd-pool-create 2024-09-16T03:51:36.530 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:102: TEST_erasure_crush_stripe_unit_padded: profile+=' plugin=jerasure' 2024-09-16T03:51:36.530 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:103: TEST_erasure_crush_stripe_unit_padded: profile+=' technique=reed_sol_van' 2024-09-16T03:51:36.530 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:104: TEST_erasure_crush_stripe_unit_padded: k=4 2024-09-16T03:51:36.530 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:105: TEST_erasure_crush_stripe_unit_padded: profile+=' k=4' 2024-09-16T03:51:36.530 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:106: TEST_erasure_crush_stripe_unit_padded: profile+=' m=2' 2024-09-16T03:51:36.530 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:107: TEST_erasure_crush_stripe_unit_padded: actual_stripe_unit=2048 2024-09-16T03:51:36.531 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:108: TEST_erasure_crush_stripe_unit_padded: desired_stripe_unit=2047 2024-09-16T03:51:36.531 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:109: TEST_erasure_crush_stripe_unit_padded: actual_stripe_width=8192 2024-09-16T03:51:36.531 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:110: TEST_erasure_crush_stripe_unit_padded: run_mon td/osd-pool-create a --osd_pool_erasure_code_stripe_unit 2047 --osd_pool_default_erasure_code_profile ' plugin=jerasure technique=reed_sol_van k=4 m=2' 2024-09-16T03:51:36.531 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-pool-create 2024-09-16T03:51:36.531 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T03:51:36.531 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T03:51:36.531 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T03:51:36.531 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-pool-create/a 2024-09-16T03:51:36.531 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-pool-create/a --run-dir=td/osd-pool-create --osd_pool_erasure_code_stripe_unit 2047 --osd_pool_default_erasure_code_profile ' plugin=jerasure technique=reed_sol_van k=4 m=2' 2024-09-16T03:51:37.012 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T03:51:37.012 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:51:37.013 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:51:37.013 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:51:37.013 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:51:37.013 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:51:37.013 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T03:51:37.014 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-pool-create/a '--log-file=td/osd-pool-create/$name.log' '--admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' --mon-cluster-log-file=td/osd-pool-create/log --run-dir=td/osd-pool-create '--pid-file=td/osd-pool-create/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_erasure_code_stripe_unit 2047 --osd_pool_default_erasure_code_profile ' plugin=jerasure technique=reed_sol_van k=4 m=2' 2024-09-16T03:51:37.221 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T03:51:37.223 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T03:51:37.223 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:51:37.223 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:51:37.223 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T03:51:37.224 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:51:37.224 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:51:37.224 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:51:37.224 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T03:51:37.224 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:51:37.224 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:51:37.224 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:51:37.225 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.128966/ceph-mon.a.asok 2024-09-16T03:51:37.225 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:51:37.225 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.128966/ceph-mon.a.asok config get fsid 2024-09-16T03:51:37.344 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T03:51:37.344 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:51:37.344 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:51:37.344 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T03:51:37.345 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:51:37.345 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T03:51:37.345 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:51:37.345 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:51:37.345 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:51:37.346 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:51:37.346 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:51:37.346 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.128966/ceph-mon.a.asok 2024-09-16T03:51:37.346 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:51:37.346 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.128966/ceph-mon.a.asok config get mon_host 2024-09-16T03:51:37.455 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:113: TEST_erasure_crush_stripe_unit_padded: ceph osd pool create pool_erasure 12 12 erasure 2024-09-16T03:51:38.519 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'pool_erasure' already exists 2024-09-16T03:51:38.540 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:114: TEST_erasure_crush_stripe_unit_padded: ceph osd dump 2024-09-16T03:51:38.540 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:114: TEST_erasure_crush_stripe_unit_padded: tee td/osd-pool-create/osd.json 2024-09-16T03:51:38.774 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 3 2024-09-16T03:51:38.774 INFO:tasks.workunit.client.0.smithi096.stdout:fsid 38a92d84-8703-45d8-b5ef-7d976430f112 2024-09-16T03:51:38.774 INFO:tasks.workunit.client.0.smithi096.stdout:created 2024-09-16T03:51:37.508367+0000 2024-09-16T03:51:38.774 INFO:tasks.workunit.client.0.smithi096.stdout:modified 2024-09-16T03:51:38.420938+0000 2024-09-16T03:51:38.774 INFO:tasks.workunit.client.0.smithi096.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-16T03:51:38.774 INFO:tasks.workunit.client.0.smithi096.stdout:crush_version 2 2024-09-16T03:51:38.775 INFO:tasks.workunit.client.0.smithi096.stdout:full_ratio 0.99 2024-09-16T03:51:38.775 INFO:tasks.workunit.client.0.smithi096.stdout:backfillfull_ratio 0.99 2024-09-16T03:51:38.775 INFO:tasks.workunit.client.0.smithi096.stdout:nearfull_ratio 0.85 2024-09-16T03:51:38.775 INFO:tasks.workunit.client.0.smithi096.stdout:require_min_compat_client luminous 2024-09-16T03:51:38.775 INFO:tasks.workunit.client.0.smithi096.stdout:min_compat_client jewel 2024-09-16T03:51:38.775 INFO:tasks.workunit.client.0.smithi096.stdout:require_osd_release squid 2024-09-16T03:51:38.775 INFO:tasks.workunit.client.0.smithi096.stdout:stretch_mode_enabled false 2024-09-16T03:51:38.775 INFO:tasks.workunit.client.0.smithi096.stdout:pool 1 'pool_erasure' erasure profile default size 6 min_size 5 crush_rule 1 object_hash rjenkins pg_num 12 pgp_num 12 autoscale_mode off last_change 3 flags hashpspool,creating stripe_width 8192 2024-09-16T03:51:38.775 INFO:tasks.workunit.client.0.smithi096.stdout:max_osd 0 2024-09-16T03:51:38.789 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:115: TEST_erasure_crush_stripe_unit_padded: grep 'stripe_width 8192' td/osd-pool-create/osd.json 2024-09-16T03:51:38.791 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:33: run: teardown td/osd-pool-create 2024-09-16T03:51:38.791 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-pool-create 2024-09-16T03:51:38.791 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:51:38.791 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-pool-create KILL 2024-09-16T03:51:38.792 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:51:38.792 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:51:38.792 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:51:38.792 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:51:38.792 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:51:38.898 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:51:38.899 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:51:38.899 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:51:38.900 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:51:38.902 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:51:38.902 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:51:38.902 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:51:38.903 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:51:38.903 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:51:38.903 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:51:38.904 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:51:38.905 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:51:38.906 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:51:38.906 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-pool-create 2024-09-16T03:51:38.908 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:51:38.908 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:51:38.908 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:51:38.908 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.128966 2024-09-16T03:51:38.910 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:51:38.910 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:51:38.910 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:30: run: for func in $funcs 2024-09-16T03:51:38.911 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:31: run: setup td/osd-pool-create 2024-09-16T03:51:38.911 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-pool-create 2024-09-16T03:51:38.911 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-pool-create 2024-09-16T03:51:38.911 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-pool-create 2024-09-16T03:51:38.911 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:51:38.911 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-pool-create KILL 2024-09-16T03:51:38.911 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:51:38.911 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:51:38.911 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:51:38.911 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:51:38.912 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:51:38.912 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:51:38.912 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:51:38.913 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:51:38.914 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:51:38.915 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:51:38.915 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:51:38.915 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:51:38.917 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:51:38.917 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:51:38.917 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:51:38.917 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:51:38.918 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:51:38.919 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:51:38.919 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-pool-create 2024-09-16T03:51:38.920 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:51:38.920 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:51:38.921 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:51:38.921 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.128966 2024-09-16T03:51:38.921 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:51:38.922 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:51:38.922 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-pool-create 2024-09-16T03:51:38.923 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T03:51:38.923 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:51:38.924 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:51:38.924 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.128966 2024-09-16T03:51:38.926 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T03:51:38.926 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2024-09-16T03:51:38.926 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T03:51:38.926 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-pool-create 1' TERM HUP INT 2024-09-16T03:51:38.926 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:32: run: TEST_erasure_invalid_profile td/osd-pool-create 2024-09-16T03:51:38.926 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:39: TEST_erasure_invalid_profile: local dir=td/osd-pool-create 2024-09-16T03:51:38.926 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:40: TEST_erasure_invalid_profile: run_mon td/osd-pool-create a 2024-09-16T03:51:38.926 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-pool-create 2024-09-16T03:51:38.926 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T03:51:38.927 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T03:51:38.927 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T03:51:38.927 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-pool-create/a 2024-09-16T03:51:38.927 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-pool-create/a --run-dir=td/osd-pool-create 2024-09-16T03:51:39.405 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T03:51:39.405 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:51:39.405 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:51:39.406 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:51:39.406 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:51:39.406 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:51:39.406 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T03:51:39.406 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-pool-create/a '--log-file=td/osd-pool-create/$name.log' '--admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' --mon-cluster-log-file=td/osd-pool-create/log --run-dir=td/osd-pool-create '--pid-file=td/osd-pool-create/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-09-16T03:51:39.608 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T03:51:39.610 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T03:51:39.610 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:51:39.610 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:51:39.610 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T03:51:39.611 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T03:51:39.611 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:51:39.611 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:51:39.611 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:51:39.612 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:51:39.612 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:51:39.612 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:51:39.613 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.128966/ceph-mon.a.asok 2024-09-16T03:51:39.613 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:51:39.613 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.128966/ceph-mon.a.asok config get fsid 2024-09-16T03:51:39.729 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T03:51:39.729 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:51:39.729 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:51:39.729 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T03:51:39.729 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T03:51:39.729 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:51:39.729 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:51:39.729 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:51:39.729 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:51:39.730 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:51:39.730 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:51:39.730 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.128966/ceph-mon.a.asok 2024-09-16T03:51:39.730 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:51:39.730 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.128966/ceph-mon.a.asok config get mon_host 2024-09-16T03:51:39.839 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:41: TEST_erasure_invalid_profile: local poolname=pool_erasure 2024-09-16T03:51:39.839 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:42: TEST_erasure_invalid_profile: local notaprofile=not-a-valid-erasure-code-profile 2024-09-16T03:51:39.840 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:43: TEST_erasure_invalid_profile: ceph osd pool create pool_erasure 12 12 erasure not-a-valid-erasure-code-profile 2024-09-16T03:51:40.641 INFO:tasks.workunit.client.0.smithi096.stderr:Error EINVAL: cannot determine the erasure code plugin because there is no 'plugin' entry in the erasure_code_profile {} 2024-09-16T03:51:40.645 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:44: TEST_erasure_invalid_profile: ceph osd erasure-code-profile ls 2024-09-16T03:51:40.645 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:44: TEST_erasure_invalid_profile: grep not-a-valid-erasure-code-profile 2024-09-16T03:51:40.924 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:33: run: teardown td/osd-pool-create 2024-09-16T03:51:40.925 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-pool-create 2024-09-16T03:51:40.925 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:51:40.925 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-pool-create KILL 2024-09-16T03:51:40.926 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:51:40.926 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:51:40.926 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:51:40.926 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:51:40.926 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:51:41.031 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:51:41.032 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:51:41.032 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:51:41.033 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:51:41.034 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:51:41.034 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:51:41.034 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:51:41.036 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:51:41.036 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:51:41.037 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:51:41.037 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:51:41.038 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:51:41.039 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:51:41.039 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-pool-create 2024-09-16T03:51:41.041 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:51:41.041 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:51:41.041 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:51:41.042 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.128966 2024-09-16T03:51:41.044 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:51:41.044 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:51:41.044 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:30: run: for func in $funcs 2024-09-16T03:51:41.044 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:31: run: setup td/osd-pool-create 2024-09-16T03:51:41.044 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-pool-create 2024-09-16T03:51:41.044 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-pool-create 2024-09-16T03:51:41.044 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-pool-create 2024-09-16T03:51:41.044 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:51:41.044 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-pool-create KILL 2024-09-16T03:51:41.045 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:51:41.045 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:51:41.045 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:51:41.045 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:51:41.045 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:51:41.045 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:51:41.046 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:51:41.047 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:51:41.047 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:51:41.048 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:51:41.049 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:51:41.049 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:51:41.049 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:51:41.050 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:51:41.050 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:51:41.050 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:51:41.051 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:51:41.052 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:51:41.052 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-pool-create 2024-09-16T03:51:41.053 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:51:41.053 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:51:41.054 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:51:41.054 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.128966 2024-09-16T03:51:41.054 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:51:41.055 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:51:41.055 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-pool-create 2024-09-16T03:51:41.056 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T03:51:41.056 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:51:41.056 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:51:41.056 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.128966 2024-09-16T03:51:41.059 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T03:51:41.059 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2024-09-16T03:51:41.059 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T03:51:41.059 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-pool-create 1' TERM HUP INT 2024-09-16T03:51:41.059 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:32: run: TEST_no_pool_delete td/osd-pool-create 2024-09-16T03:51:41.059 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:187: TEST_no_pool_delete: local dir=td/osd-pool-create 2024-09-16T03:51:41.059 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:188: TEST_no_pool_delete: run_mon td/osd-pool-create a 2024-09-16T03:51:41.059 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-pool-create 2024-09-16T03:51:41.059 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T03:51:41.059 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T03:51:41.060 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T03:51:41.060 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-pool-create/a 2024-09-16T03:51:41.060 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-pool-create/a --run-dir=td/osd-pool-create 2024-09-16T03:51:41.503 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T03:51:41.503 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:51:41.503 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:51:41.503 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:51:41.504 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:51:41.504 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:51:41.504 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T03:51:41.504 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-pool-create/a '--log-file=td/osd-pool-create/$name.log' '--admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' --mon-cluster-log-file=td/osd-pool-create/log --run-dir=td/osd-pool-create '--pid-file=td/osd-pool-create/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-09-16T03:51:41.716 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T03:51:41.717 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T03:51:41.718 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:51:41.718 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:51:41.718 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T03:51:41.718 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T03:51:41.719 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:51:41.719 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:51:41.719 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:51:41.719 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:51:41.719 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:51:41.719 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:51:41.719 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.128966/ceph-mon.a.asok 2024-09-16T03:51:41.719 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:51:41.720 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.128966/ceph-mon.a.asok config get fsid 2024-09-16T03:51:41.837 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T03:51:41.838 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:51:41.838 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:51:41.838 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T03:51:41.838 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T03:51:41.839 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:51:41.839 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:51:41.839 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:51:41.839 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:51:41.839 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:51:41.840 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:51:41.840 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.128966/ceph-mon.a.asok 2024-09-16T03:51:41.840 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:51:41.840 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.128966/ceph-mon.a.asok config get mon_host 2024-09-16T03:51:41.949 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:189: TEST_no_pool_delete: ceph osd pool create foo 1 2024-09-16T03:51:42.859 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'foo' already exists 2024-09-16T03:51:42.878 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:190: TEST_no_pool_delete: ceph tell mon.a injectargs -- --no-mon-allow-pool-delete 2024-09-16T03:51:43.027 INFO:tasks.workunit.client.0.smithi096.stdout:{} 2024-09-16T03:51:43.044 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:191: TEST_no_pool_delete: ceph osd pool delete foo foo --yes-i-really-really-mean-it 2024-09-16T03:51:43.221 INFO:tasks.workunit.client.0.smithi096.stderr:Error EPERM: pool deletion is disabled; you must first set the mon_allow_pool_delete config option to true before you can destroy a pool 2024-09-16T03:51:43.226 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:192: TEST_no_pool_delete: ceph tell mon.a injectargs -- --mon-allow-pool-delete 2024-09-16T03:51:43.378 INFO:tasks.workunit.client.0.smithi096.stdout:{} 2024-09-16T03:51:43.394 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:193: TEST_no_pool_delete: ceph osd pool delete foo foo --yes-i-really-really-mean-it 2024-09-16T03:51:43.719 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'foo' does not exist 2024-09-16T03:51:43.736 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:33: run: teardown td/osd-pool-create 2024-09-16T03:51:43.737 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-pool-create 2024-09-16T03:51:43.737 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:51:43.737 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-pool-create KILL 2024-09-16T03:51:43.737 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:51:43.738 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:51:43.738 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:51:43.738 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:51:43.738 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:51:43.845 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:51:43.846 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:51:43.846 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:51:43.847 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:51:43.848 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:51:43.848 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:51:43.848 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:51:43.849 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:51:43.849 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:51:43.850 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:51:43.850 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:51:43.851 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:51:43.852 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:51:43.853 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-pool-create 2024-09-16T03:51:43.855 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:51:43.855 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:51:43.855 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:51:43.855 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.128966 2024-09-16T03:51:43.857 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:51:43.857 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:51:43.857 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:30: run: for func in $funcs 2024-09-16T03:51:43.857 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:31: run: setup td/osd-pool-create 2024-09-16T03:51:43.857 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-pool-create 2024-09-16T03:51:43.857 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-pool-create 2024-09-16T03:51:43.857 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-pool-create 2024-09-16T03:51:43.857 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:51:43.857 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-pool-create KILL 2024-09-16T03:51:43.857 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:51:43.858 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:51:43.858 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:51:43.858 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:51:43.858 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:51:43.859 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:51:43.859 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:51:43.860 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:51:43.866 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:51:43.866 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:51:43.866 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:51:43.866 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:51:43.866 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:51:43.866 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:51:43.866 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:51:43.866 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:51:43.866 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:51:43.867 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:51:43.867 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-pool-create 2024-09-16T03:51:43.867 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:51:43.867 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:51:43.868 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:51:43.868 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.128966 2024-09-16T03:51:43.868 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:51:43.869 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:51:43.869 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-pool-create 2024-09-16T03:51:43.870 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T03:51:43.870 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:51:43.870 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:51:43.871 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.128966 2024-09-16T03:51:43.874 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T03:51:43.874 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2024-09-16T03:51:43.874 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T03:51:43.874 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-pool-create 1' TERM HUP INT 2024-09-16T03:51:43.874 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:32: run: TEST_pool_both_prio td/osd-pool-create 2024-09-16T03:51:43.874 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:288: TEST_pool_both_prio: local dir=td/osd-pool-create 2024-09-16T03:51:43.874 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:289: TEST_pool_both_prio: check_pool_priority td/osd-pool-create 20 '5 - 50' '-10 -9 -8 -7 -6 -5 -4 -3 -2 -1 0 1 2 3 4 5 6 7 8 9 10' 2024-09-16T03:51:43.875 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:215: check_pool_priority: local dir=td/osd-pool-create 2024-09-16T03:51:43.875 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:216: check_pool_priority: shift 2024-09-16T03:51:43.875 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:217: check_pool_priority: local pools=20 2024-09-16T03:51:43.875 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:218: check_pool_priority: shift 2024-09-16T03:51:43.875 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:219: check_pool_priority: local 'spread=5 - 50' 2024-09-16T03:51:43.875 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:220: check_pool_priority: shift 2024-09-16T03:51:43.875 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:221: check_pool_priority: local 'results=-10 -9 -8 -7 -6 -5 -4 -3 -2 -1 0 1 2 3 4 5 6 7 8 9 10' 2024-09-16T03:51:43.875 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:223: check_pool_priority: setup td/osd-pool-create 2024-09-16T03:51:43.875 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-pool-create 2024-09-16T03:51:43.875 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-pool-create 2024-09-16T03:51:43.876 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-pool-create 2024-09-16T03:51:43.876 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:51:43.876 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-pool-create KILL 2024-09-16T03:51:43.876 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:51:43.876 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:51:43.876 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:51:43.876 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:51:43.876 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:51:43.877 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:51:43.877 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:51:43.877 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:51:43.877 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:51:43.878 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:51:43.878 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:51:43.879 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:51:43.880 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:51:43.880 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:51:43.880 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:51:43.880 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:51:43.881 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:51:43.883 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:51:43.883 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-pool-create 2024-09-16T03:51:43.884 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:51:43.884 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:51:43.884 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:51:43.884 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.128966 2024-09-16T03:51:43.886 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:51:43.886 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:51:43.886 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-pool-create 2024-09-16T03:51:43.887 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T03:51:43.887 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:51:43.887 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:51:43.887 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.128966 2024-09-16T03:51:43.889 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T03:51:43.890 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2024-09-16T03:51:43.890 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T03:51:43.890 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-pool-create 1' TERM HUP INT 2024-09-16T03:51:43.890 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:225: check_pool_priority: EXTRA_OPTS=--debug_allow_any_pool_priority=true 2024-09-16T03:51:43.890 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:226: check_pool_priority: export EXTRA_OPTS 2024-09-16T03:51:43.890 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:227: check_pool_priority: run_mon td/osd-pool-create a 2024-09-16T03:51:43.891 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-pool-create 2024-09-16T03:51:43.891 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T03:51:43.891 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T03:51:43.891 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T03:51:43.891 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-pool-create/a 2024-09-16T03:51:43.891 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-pool-create/a --run-dir=td/osd-pool-create 2024-09-16T03:51:44.361 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T03:51:44.362 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:51:44.362 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:51:44.362 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:51:44.362 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:51:44.362 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:51:44.363 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T03:51:44.363 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug_allow_any_pool_priority=true --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-pool-create/a '--log-file=td/osd-pool-create/$name.log' '--admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' --mon-cluster-log-file=td/osd-pool-create/log --run-dir=td/osd-pool-create '--pid-file=td/osd-pool-create/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-09-16T03:51:44.591 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T03:51:44.592 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T03:51:44.592 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:51:44.592 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:51:44.592 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T03:51:44.593 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T03:51:44.593 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:51:44.593 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:51:44.593 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:51:44.593 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:51:44.594 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:51:44.594 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:51:44.594 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.128966/ceph-mon.a.asok 2024-09-16T03:51:44.594 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:51:44.594 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.128966/ceph-mon.a.asok config get fsid 2024-09-16T03:51:44.709 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T03:51:44.709 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:51:44.709 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:51:44.709 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T03:51:44.710 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T03:51:44.710 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:51:44.711 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:51:44.711 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:51:44.711 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:51:44.711 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:51:44.711 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:51:44.711 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.128966/ceph-mon.a.asok 2024-09-16T03:51:44.711 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:51:44.711 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.128966/ceph-mon.a.asok config get mon_host 2024-09-16T03:51:44.816 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:228: check_pool_priority: run_mgr td/osd-pool-create x 2024-09-16T03:51:44.816 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-pool-create 2024-09-16T03:51:44.816 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2024-09-16T03:51:44.816 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2024-09-16T03:51:44.816 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2024-09-16T03:51:44.816 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-pool-create/x 2024-09-16T03:51:44.816 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2024-09-16T03:51:45.719 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2024-09-16T03:51:45.719 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:51:45.719 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:51:45.720 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:51:45.720 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:51:45.720 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:51:45.720 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T03:51:45.720 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T03:51:45.722 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --debug_allow_any_pool_priority=true --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-pool-create/x '--log-file=td/osd-pool-create/$name.log' '--admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' --run-dir=td/osd-pool-create '--pid-file=td/osd-pool-create/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T03:51:45.757 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:229: check_pool_priority: run_osd td/osd-pool-create 0 2024-09-16T03:51:45.758 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-pool-create 2024-09-16T03:51:45.758 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T03:51:45.758 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2024-09-16T03:51:45.758 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T03:51:45.758 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-pool-create/0 2024-09-16T03:51:45.758 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=38a92d84-8703-45d8-b5ef-7d976430f112 --auth-supported=none --mon-host=127.0.0.1:7105 ' 2024-09-16T03:51:45.758 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T03:51:45.758 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T03:51:45.758 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T03:51:45.758 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-pool-create/0' 2024-09-16T03:51:45.759 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-pool-create/0/journal' 2024-09-16T03:51:45.759 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T03:51:45.759 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+=--debug_allow_any_pool_priority=true 2024-09-16T03:51:45.759 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-pool-create' 2024-09-16T03:51:45.759 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T03:51:45.759 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:51:45.759 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:51:45.759 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:51:45.759 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:51:45.759 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:51:45.759 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T03:51:45.759 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T03:51:45.759 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T03:51:45.760 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T03:51:45.760 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T03:51:45.760 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-pool-create/$name.log' 2024-09-16T03:51:45.760 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-pool-create/$name.pid' 2024-09-16T03:51:45.760 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T03:51:45.760 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T03:51:45.760 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T03:51:45.760 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T03:51:45.760 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T03:51:45.760 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T03:51:45.760 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-pool-create/0 2024-09-16T03:51:45.761 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T03:51:45.761 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=24f0b211-47dd-4323-baae-163742e2781a 2024-09-16T03:51:45.761 INFO:tasks.workunit.client.0.smithi096.stdout:add osd0 24f0b211-47dd-4323-baae-163742e2781a 2024-09-16T03:51:45.762 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 24f0b211-47dd-4323-baae-163742e2781a' 2024-09-16T03:51:45.762 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T03:51:45.776 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBRq+dmz+9ALhAAcXCTYCNjOMeR1PpIFeP10g== 2024-09-16T03:51:45.776 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBRq+dmz+9ALhAAcXCTYCNjOMeR1PpIFeP10g=="}' 2024-09-16T03:51:45.776 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 24f0b211-47dd-4323-baae-163742e2781a -i td/osd-pool-create/0/new.json 2024-09-16T03:51:46.060 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T03:51:46.074 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-pool-create/0/new.json 2024-09-16T03:51:46.076 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=38a92d84-8703-45d8-b5ef-7d976430f112 --auth-supported=none --mon-host=127.0.0.1:7105 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-pool-create/0 --osd-journal=td/osd-pool-create/0/journal --chdir=--debug_allow_any_pool_priority=true --run-dir=td/osd-pool-create '--admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-pool-create/$name.log' '--pid-file=td/osd-pool-create/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBRq+dmz+9ALhAAcXCTYCNjOMeR1PpIFeP10g== --osd-uuid 24f0b211-47dd-4323-baae-163742e2781a 2024-09-16T03:51:46.113 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:51:46.108+0000 7fbab2a497c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:51:46.129 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:51:46.124+0000 7fbab2a497c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:51:46.130 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:51:46.128+0000 7fbab2a497c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:51:46.130 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:51:46.128+0000 7fbab2a497c0 -1 global_init_chdir: failed to chdir to directory: '--debug_allow_any_pool_priority=true': (2) No such file or directory 2024-09-16T03:51:46.130 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:51:46.128+0000 7fbab2a497c0 -1 bdev(0x5650458ffc00 td/osd-pool-create/0/block) open stat got: (1) Operation not permitted 2024-09-16T03:51:46.130 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:51:46.128+0000 7fbab2a497c0 -1 bluestore(td/osd-pool-create/0) _read_fsid unparsable uuid 2024-09-16T03:51:52.172 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-pool-create/0/keyring 2024-09-16T03:51:52.172 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T03:51:52.173 INFO:tasks.workunit.client.0.smithi096.stdout:adding osd0 key to auth repository 2024-09-16T03:51:52.174 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2024-09-16T03:51:52.174 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-pool-create/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T03:51:52.769 INFO:tasks.workunit.client.0.smithi096.stdout:start osd.0 2024-09-16T03:51:52.770 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2024-09-16T03:51:52.770 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T03:51:52.770 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=38a92d84-8703-45d8-b5ef-7d976430f112 --auth-supported=none --mon-host=127.0.0.1:7105 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-pool-create/0 --osd-journal=td/osd-pool-create/0/journal --chdir=--debug_allow_any_pool_priority=true --run-dir=td/osd-pool-create '--admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-pool-create/$name.log' '--pid-file=td/osd-pool-create/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T03:51:52.770 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T03:51:52.770 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T03:51:52.799 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:51:52.796+0000 7f09bad617c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:51:52.801 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:51:52.800+0000 7f09bad617c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:51:52.803 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:51:52.800+0000 7f09bad617c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:51:52.803 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:51:52.800+0000 7f09bad617c0 -1 global_init_chdir: failed to chdir to directory: '--debug_allow_any_pool_priority=true': (2) No such file or directory 2024-09-16T03:51:53.185 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2024-09-16T03:51:53.185 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:51:53.185 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2024-09-16T03:51:53.185 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:51:53.185 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:51:53.185 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:51:53.185 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:51:53.186 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T03:51:53.186 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:51:53.186 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:51:53.644 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:51:54.312 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:51:54.308+0000 7f09bad617c0 -1 Falling back to public interface 2024-09-16T03:51:54.314 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:51:54.312+0000 7f09bad617c0 -1 global_init_chdir: failed to chdir to directory: '--debug_allow_any_pool_priority=true': (2) No such file or directory 2024-09-16T03:51:54.646 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:51:54.647 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:51:54.647 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T03:51:54.647 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T03:51:54.647 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:51:54.647 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:51:55.055 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:51:56.056 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:51:56.057 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:51:56.057 INFO:tasks.workunit.client.0.smithi096.stdout:2 2024-09-16T03:51:56.057 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T03:51:56.058 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:51:56.058 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:51:56.478 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:51:57.036 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:51:57.031+0000 7f09bad617c0 -1 osd.0 0 log_to_monitors true 2024-09-16T03:51:57.480 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:51:57.480 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:51:57.480 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T03:51:57.480 INFO:tasks.workunit.client.0.smithi096.stdout:3 2024-09-16T03:51:57.480 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:51:57.481 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:51:58.080 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:51:59.082 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:51:59.082 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:51:59.082 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T03:51:59.082 INFO:tasks.workunit.client.0.smithi096.stdout:4 2024-09-16T03:51:59.082 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:51:59.083 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:51:59.525 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:52:00.526 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:52:00.526 INFO:tasks.workunit.client.0.smithi096.stdout:5 2024-09-16T03:52:00.527 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:52:00.527 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T03:52:00.527 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:52:00.527 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:52:01.163 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:52:02.165 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:52:02.165 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:52:02.165 INFO:tasks.workunit.client.0.smithi096.stdout:6 2024-09-16T03:52:02.166 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T03:52:02.166 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:52:02.166 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:52:02.607 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:52:03.609 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:52:03.609 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:52:03.609 INFO:tasks.workunit.client.0.smithi096.stdout:7 2024-09-16T03:52:03.610 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T03:52:03.610 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:52:03.610 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:52:04.115 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:52:05.117 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:52:05.117 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:52:05.117 INFO:tasks.workunit.client.0.smithi096.stdout:8 2024-09-16T03:52:05.117 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T03:52:05.118 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:52:05.118 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:52:05.541 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:52:06.543 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:52:06.543 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:52:06.543 INFO:tasks.workunit.client.0.smithi096.stdout:9 2024-09-16T03:52:06.544 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T03:52:06.544 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:52:06.544 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:52:06.964 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:52:07.965 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:52:07.966 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:52:07.966 INFO:tasks.workunit.client.0.smithi096.stdout:10 2024-09-16T03:52:07.966 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T03:52:07.967 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:52:07.967 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:52:08.382 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:52:09.384 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:52:09.385 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:52:09.385 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T03:52:09.385 INFO:tasks.workunit.client.0.smithi096.stdout:11 2024-09-16T03:52:09.386 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:52:09.386 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:52:10.097 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:52:11.099 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:52:11.099 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:52:11.099 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T03:52:11.099 INFO:tasks.workunit.client.0.smithi096.stdout:12 2024-09-16T03:52:11.100 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:52:11.100 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:52:11.890 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:52:12.892 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:52:12.892 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:52:12.893 INFO:tasks.workunit.client.0.smithi096.stdout:13 2024-09-16T03:52:12.893 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T03:52:12.893 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:52:12.893 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:52:13.931 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:52:14.933 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:52:14.933 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:52:14.934 INFO:tasks.workunit.client.0.smithi096.stdout:14 2024-09-16T03:52:14.934 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T03:52:14.934 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:52:14.934 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:52:16.087 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:52:17.089 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:52:17.089 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:52:17.089 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T03:52:17.089 INFO:tasks.workunit.client.0.smithi096.stdout:15 2024-09-16T03:52:17.090 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:52:17.090 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:52:17.604 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:52:18.606 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:52:18.606 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:52:18.606 INFO:tasks.workunit.client.0.smithi096.stdout:16 2024-09-16T03:52:18.607 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T03:52:18.607 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:52:18.607 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:52:19.349 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:52:20.351 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:52:20.351 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:52:20.352 INFO:tasks.workunit.client.0.smithi096.stdout:17 2024-09-16T03:52:20.352 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T03:52:20.352 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:52:20.352 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:52:20.765 INFO:tasks.workunit.client.0.smithi096.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/1694474429,v1:127.0.0.1:6803/1694474429] [v2:127.0.0.1:6804/1694474429,v1:127.0.0.1:6805/1694474429] exists,up 24f0b211-47dd-4323-baae-163742e2781a 2024-09-16T03:52:20.769 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:52:20.769 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:52:20.769 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:52:20.770 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:230: check_pool_priority: run_osd td/osd-pool-create 1 2024-09-16T03:52:20.770 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-pool-create 2024-09-16T03:52:20.770 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T03:52:20.770 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2024-09-16T03:52:20.770 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T03:52:20.770 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-pool-create/1 2024-09-16T03:52:20.770 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=38a92d84-8703-45d8-b5ef-7d976430f112 --auth-supported=none --mon-host=127.0.0.1:7105 ' 2024-09-16T03:52:20.770 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T03:52:20.770 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T03:52:20.770 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T03:52:20.770 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-pool-create/1' 2024-09-16T03:52:20.770 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-pool-create/1/journal' 2024-09-16T03:52:20.771 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T03:52:20.771 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+=--debug_allow_any_pool_priority=true 2024-09-16T03:52:20.771 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-pool-create' 2024-09-16T03:52:20.771 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T03:52:20.771 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:52:20.771 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:52:20.771 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:52:20.772 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:52:20.772 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:52:20.772 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T03:52:20.772 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T03:52:20.772 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T03:52:20.772 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T03:52:20.772 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T03:52:20.772 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-pool-create/$name.log' 2024-09-16T03:52:20.772 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-pool-create/$name.pid' 2024-09-16T03:52:20.772 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T03:52:20.772 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T03:52:20.772 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T03:52:20.772 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T03:52:20.773 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T03:52:20.773 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T03:52:20.773 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-pool-create/1 2024-09-16T03:52:20.774 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T03:52:20.774 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=959188bb-efce-4225-bd41-49eee704cbb0 2024-09-16T03:52:20.774 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 959188bb-efce-4225-bd41-49eee704cbb0' 2024-09-16T03:52:20.774 INFO:tasks.workunit.client.0.smithi096.stdout:add osd1 959188bb-efce-4225-bd41-49eee704cbb0 2024-09-16T03:52:20.774 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T03:52:20.792 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQB0q+dmoksqLxAAMgKgx5PUe69YrQwFH8xC9w== 2024-09-16T03:52:20.792 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQB0q+dmoksqLxAAMgKgx5PUe69YrQwFH8xC9w=="}' 2024-09-16T03:52:20.792 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 959188bb-efce-4225-bd41-49eee704cbb0 -i td/osd-pool-create/1/new.json 2024-09-16T03:52:21.300 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T03:52:21.316 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-pool-create/1/new.json 2024-09-16T03:52:21.317 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=38a92d84-8703-45d8-b5ef-7d976430f112 --auth-supported=none --mon-host=127.0.0.1:7105 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-pool-create/1 --osd-journal=td/osd-pool-create/1/journal --chdir=--debug_allow_any_pool_priority=true --run-dir=td/osd-pool-create '--admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-pool-create/$name.log' '--pid-file=td/osd-pool-create/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQB0q+dmoksqLxAAMgKgx5PUe69YrQwFH8xC9w== --osd-uuid 959188bb-efce-4225-bd41-49eee704cbb0 2024-09-16T03:52:21.352 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:52:21.347+0000 7f173bf747c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:52:21.382 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:52:21.379+0000 7f173bf747c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:52:21.384 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:52:21.379+0000 7f173bf747c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:52:21.384 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:52:21.379+0000 7f173bf747c0 -1 global_init_chdir: failed to chdir to directory: '--debug_allow_any_pool_priority=true': (2) No such file or directory 2024-09-16T03:52:21.384 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:52:21.379+0000 7f173bf747c0 -1 bdev(0x55c95b48e800 td/osd-pool-create/1/block) open stat got: (1) Operation not permitted 2024-09-16T03:52:21.384 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:52:21.379+0000 7f173bf747c0 -1 bluestore(td/osd-pool-create/1) _read_fsid unparsable uuid 2024-09-16T03:52:26.974 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-pool-create/1/keyring 2024-09-16T03:52:26.975 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T03:52:26.976 INFO:tasks.workunit.client.0.smithi096.stdout:adding osd1 key to auth repository 2024-09-16T03:52:26.976 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2024-09-16T03:52:26.977 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-pool-create/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T03:52:27.541 INFO:tasks.workunit.client.0.smithi096.stdout:start osd.1 2024-09-16T03:52:27.542 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2024-09-16T03:52:27.542 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=38a92d84-8703-45d8-b5ef-7d976430f112 --auth-supported=none --mon-host=127.0.0.1:7105 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-pool-create/1 --osd-journal=td/osd-pool-create/1/journal --chdir=--debug_allow_any_pool_priority=true --run-dir=td/osd-pool-create '--admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-pool-create/$name.log' '--pid-file=td/osd-pool-create/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T03:52:27.542 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T03:52:27.542 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T03:52:27.542 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T03:52:27.571 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:52:27.567+0000 7f4c5418f7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:52:27.577 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:52:27.575+0000 7f4c5418f7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:52:27.579 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:52:27.575+0000 7f4c5418f7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:52:27.579 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:52:27.575+0000 7f4c5418f7c0 -1 global_init_chdir: failed to chdir to directory: '--debug_allow_any_pool_priority=true': (2) No such file or directory 2024-09-16T03:52:28.008 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2024-09-16T03:52:28.008 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:52:28.008 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2024-09-16T03:52:28.008 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:52:28.008 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:52:28.009 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T03:52:28.009 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:52:28.009 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:52:28.009 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:52:28.009 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:52:28.482 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:52:28.780 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:52:28.775+0000 7f4c5418f7c0 -1 Falling back to public interface 2024-09-16T03:52:28.784 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:52:28.779+0000 7f4c5418f7c0 -1 global_init_chdir: failed to chdir to directory: '--debug_allow_any_pool_priority=true': (2) No such file or directory 2024-09-16T03:52:29.484 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:52:29.485 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:52:29.485 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T03:52:29.485 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T03:52:29.485 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:52:29.485 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:52:29.968 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:52:30.969 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:52:30.970 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:52:30.970 INFO:tasks.workunit.client.0.smithi096.stdout:2 2024-09-16T03:52:30.970 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T03:52:30.971 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:52:30.971 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:52:31.398 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:52:31.895 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:52:31.891+0000 7f4c5418f7c0 -1 osd.1 0 log_to_monitors true 2024-09-16T03:52:32.400 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:52:32.400 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:52:32.401 INFO:tasks.workunit.client.0.smithi096.stdout:3 2024-09-16T03:52:32.401 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T03:52:32.401 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:52:32.401 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:52:33.018 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:52:34.021 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:52:34.021 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:52:34.021 INFO:tasks.workunit.client.0.smithi096.stdout:4 2024-09-16T03:52:34.022 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T03:52:34.022 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:52:34.022 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:52:34.470 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:52:35.472 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:52:35.472 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:52:35.472 INFO:tasks.workunit.client.0.smithi096.stdout:5 2024-09-16T03:52:35.473 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T03:52:35.473 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:52:35.473 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:52:36.076 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:52:37.077 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:52:37.078 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:52:37.078 INFO:tasks.workunit.client.0.smithi096.stdout:6 2024-09-16T03:52:37.078 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T03:52:37.079 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:52:37.079 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:52:37.709 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:52:38.711 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:52:38.711 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:52:38.712 INFO:tasks.workunit.client.0.smithi096.stdout:7 2024-09-16T03:52:38.713 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T03:52:38.713 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:52:38.713 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:52:39.231 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:52:40.233 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:52:40.233 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:52:40.233 INFO:tasks.workunit.client.0.smithi096.stdout:8 2024-09-16T03:52:40.233 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T03:52:40.234 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:52:40.234 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:52:40.880 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:52:41.882 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:52:41.882 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:52:41.882 INFO:tasks.workunit.client.0.smithi096.stdout:9 2024-09-16T03:52:41.883 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T03:52:41.883 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:52:41.883 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:52:42.351 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:52:43.353 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:52:43.353 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:52:43.354 INFO:tasks.workunit.client.0.smithi096.stdout:10 2024-09-16T03:52:43.354 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T03:52:43.354 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:52:43.354 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:52:43.825 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:52:44.827 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:52:44.827 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:52:44.827 INFO:tasks.workunit.client.0.smithi096.stdout:11 2024-09-16T03:52:44.828 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T03:52:44.828 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:52:44.828 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:52:45.690 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:52:46.692 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:52:46.692 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:52:46.693 INFO:tasks.workunit.client.0.smithi096.stdout:12 2024-09-16T03:52:46.693 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T03:52:46.693 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:52:46.693 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:52:47.705 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:52:48.707 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:52:48.707 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:52:48.707 INFO:tasks.workunit.client.0.smithi096.stdout:13 2024-09-16T03:52:48.708 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T03:52:48.708 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:52:48.708 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:52:49.753 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:52:50.755 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:52:50.755 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:52:50.755 INFO:tasks.workunit.client.0.smithi096.stdout:14 2024-09-16T03:52:50.756 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T03:52:50.756 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:52:50.756 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:52:51.696 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:52:52.698 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:52:52.698 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:52:52.698 INFO:tasks.workunit.client.0.smithi096.stdout:15 2024-09-16T03:52:52.699 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T03:52:52.699 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:52:52.699 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:52:53.598 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:52:54.600 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:52:54.600 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:52:54.600 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T03:52:54.600 INFO:tasks.workunit.client.0.smithi096.stdout:16 2024-09-16T03:52:54.601 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:52:54.601 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:52:55.187 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:52:56.189 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:52:56.189 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:52:56.189 INFO:tasks.workunit.client.0.smithi096.stdout:17 2024-09-16T03:52:56.190 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T03:52:56.190 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:52:56.190 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:52:56.643 INFO:tasks.workunit.client.0.smithi096.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/1403100131,v1:127.0.0.1:6811/1403100131] [v2:127.0.0.1:6812/1403100131,v1:127.0.0.1:6813/1403100131] exists,up 959188bb-efce-4225-bd41-49eee704cbb0 2024-09-16T03:52:56.646 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:52:56.646 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:52:56.646 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:52:56.646 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:231: check_pool_priority: run_osd td/osd-pool-create 2 2024-09-16T03:52:56.647 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-pool-create 2024-09-16T03:52:56.647 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T03:52:56.647 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2024-09-16T03:52:56.647 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T03:52:56.647 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-pool-create/2 2024-09-16T03:52:56.647 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=38a92d84-8703-45d8-b5ef-7d976430f112 --auth-supported=none --mon-host=127.0.0.1:7105 ' 2024-09-16T03:52:56.647 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T03:52:56.647 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T03:52:56.647 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T03:52:56.647 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-pool-create/2' 2024-09-16T03:52:56.647 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-pool-create/2/journal' 2024-09-16T03:52:56.647 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T03:52:56.647 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+=--debug_allow_any_pool_priority=true 2024-09-16T03:52:56.648 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-pool-create' 2024-09-16T03:52:56.648 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T03:52:56.648 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:52:56.648 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:52:56.648 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:52:56.648 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:52:56.648 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:52:56.648 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T03:52:56.648 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T03:52:56.648 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T03:52:56.648 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T03:52:56.649 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T03:52:56.649 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-pool-create/$name.log' 2024-09-16T03:52:56.649 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-pool-create/$name.pid' 2024-09-16T03:52:56.649 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T03:52:56.649 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T03:52:56.649 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T03:52:56.649 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T03:52:56.649 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T03:52:56.649 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T03:52:56.649 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-pool-create/2 2024-09-16T03:52:56.650 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T03:52:56.650 INFO:tasks.workunit.client.0.smithi096.stdout:add osd2 5cf36ce3-37a9-436d-b46b-f2807f5a69cc 2024-09-16T03:52:56.650 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=5cf36ce3-37a9-436d-b46b-f2807f5a69cc 2024-09-16T03:52:56.650 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 5cf36ce3-37a9-436d-b46b-f2807f5a69cc' 2024-09-16T03:52:56.650 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T03:52:56.663 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCYq+dmW/KEJxAAbiKNVdBQmtzNxvT2F7Qh9A== 2024-09-16T03:52:56.663 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCYq+dmW/KEJxAAbiKNVdBQmtzNxvT2F7Qh9A=="}' 2024-09-16T03:52:56.663 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 5cf36ce3-37a9-436d-b46b-f2807f5a69cc -i td/osd-pool-create/2/new.json 2024-09-16T03:52:57.160 INFO:tasks.workunit.client.0.smithi096.stdout:2 2024-09-16T03:52:57.176 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-pool-create/2/new.json 2024-09-16T03:52:57.178 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=38a92d84-8703-45d8-b5ef-7d976430f112 --auth-supported=none --mon-host=127.0.0.1:7105 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-pool-create/2 --osd-journal=td/osd-pool-create/2/journal --chdir=--debug_allow_any_pool_priority=true --run-dir=td/osd-pool-create '--admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-pool-create/$name.log' '--pid-file=td/osd-pool-create/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCYq+dmW/KEJxAAbiKNVdBQmtzNxvT2F7Qh9A== --osd-uuid 5cf36ce3-37a9-436d-b46b-f2807f5a69cc 2024-09-16T03:52:57.209 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:52:57.206+0000 7fe44b5507c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:52:57.212 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:52:57.210+0000 7fe44b5507c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:52:57.213 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:52:57.210+0000 7fe44b5507c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:52:57.213 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:52:57.210+0000 7fe44b5507c0 -1 global_init_chdir: failed to chdir to directory: '--debug_allow_any_pool_priority=true': (2) No such file or directory 2024-09-16T03:52:57.213 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:52:57.214+0000 7fe44b5507c0 -1 bdev(0x55f05a81bc00 td/osd-pool-create/2/block) open stat got: (1) Operation not permitted 2024-09-16T03:52:57.214 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:52:57.214+0000 7fe44b5507c0 -1 bluestore(td/osd-pool-create/2) _read_fsid unparsable uuid 2024-09-16T03:53:03.442 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-pool-create/2/keyring 2024-09-16T03:53:03.443 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T03:53:03.444 INFO:tasks.workunit.client.0.smithi096.stdout:adding osd2 key to auth repository 2024-09-16T03:53:03.444 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2024-09-16T03:53:03.444 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-pool-create/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T03:53:04.001 INFO:tasks.workunit.client.0.smithi096.stdout:start osd.2 2024-09-16T03:53:04.002 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2024-09-16T03:53:04.002 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=38a92d84-8703-45d8-b5ef-7d976430f112 --auth-supported=none --mon-host=127.0.0.1:7105 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-pool-create/2 --osd-journal=td/osd-pool-create/2/journal --chdir=--debug_allow_any_pool_priority=true --run-dir=td/osd-pool-create '--admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-pool-create/$name.log' '--pid-file=td/osd-pool-create/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T03:53:04.002 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T03:53:04.002 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T03:53:04.002 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T03:53:04.030 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:53:04.030+0000 7fb6233557c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:53:04.049 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:53:04.046+0000 7fb6233557c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:53:04.050 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:53:04.050+0000 7fb6233557c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:53:04.050 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:53:04.050+0000 7fb6233557c0 -1 global_init_chdir: failed to chdir to directory: '--debug_allow_any_pool_priority=true': (2) No such file or directory 2024-09-16T03:53:04.485 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2024-09-16T03:53:04.485 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:53:04.485 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2024-09-16T03:53:04.485 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:53:04.485 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T03:53:04.486 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:53:04.486 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:53:04.486 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:53:04.486 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:53:04.486 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:53:04.978 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:53:05.577 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:53:05.574+0000 7fb6233557c0 -1 Falling back to public interface 2024-09-16T03:53:05.582 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:53:05.582+0000 7fb6233557c0 -1 global_init_chdir: failed to chdir to directory: '--debug_allow_any_pool_priority=true': (2) No such file or directory 2024-09-16T03:53:05.980 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:53:05.980 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:53:05.981 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T03:53:05.982 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T03:53:05.982 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:53:05.982 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:53:06.439 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:53:07.441 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:53:07.441 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:53:07.442 INFO:tasks.workunit.client.0.smithi096.stdout:2 2024-09-16T03:53:07.442 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T03:53:07.443 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:53:07.443 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:53:07.853 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:53:08.339 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:53:08.338+0000 7fb6233557c0 -1 osd.2 0 log_to_monitors true 2024-09-16T03:53:08.855 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:53:08.855 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:53:08.855 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T03:53:08.855 INFO:tasks.workunit.client.0.smithi096.stdout:3 2024-09-16T03:53:08.856 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:53:08.856 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:53:09.420 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:53:10.422 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:53:10.423 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:53:10.423 INFO:tasks.workunit.client.0.smithi096.stdout:4 2024-09-16T03:53:10.423 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T03:53:10.423 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:53:10.423 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:53:10.859 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:53:11.861 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:53:11.861 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:53:11.861 INFO:tasks.workunit.client.0.smithi096.stdout:5 2024-09-16T03:53:11.861 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T03:53:11.862 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:53:11.862 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:53:12.299 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:53:13.301 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:53:13.301 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:53:13.302 INFO:tasks.workunit.client.0.smithi096.stdout:6 2024-09-16T03:53:13.302 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T03:53:13.303 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:53:13.303 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:53:13.718 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:53:14.719 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:53:14.719 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:53:14.719 INFO:tasks.workunit.client.0.smithi096.stdout:7 2024-09-16T03:53:14.720 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T03:53:14.720 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:53:14.720 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:53:15.241 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:53:16.243 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:53:16.243 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:53:16.243 INFO:tasks.workunit.client.0.smithi096.stdout:8 2024-09-16T03:53:16.243 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T03:53:16.244 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:53:16.244 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:53:16.717 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:53:17.718 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:53:17.719 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:53:17.719 INFO:tasks.workunit.client.0.smithi096.stdout:9 2024-09-16T03:53:17.720 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T03:53:17.720 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:53:17.720 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:53:18.280 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:53:19.282 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:53:19.282 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:53:19.282 INFO:tasks.workunit.client.0.smithi096.stdout:10 2024-09-16T03:53:19.283 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T03:53:19.283 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:53:19.283 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:53:19.725 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:53:20.727 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:53:20.727 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:53:20.728 INFO:tasks.workunit.client.0.smithi096.stdout:11 2024-09-16T03:53:20.728 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T03:53:20.728 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:53:20.728 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:53:21.554 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:53:22.556 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:53:22.556 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:53:22.556 INFO:tasks.workunit.client.0.smithi096.stdout:12 2024-09-16T03:53:22.557 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T03:53:22.557 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:53:22.557 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:53:23.363 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:53:24.365 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:53:24.365 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:53:24.365 INFO:tasks.workunit.client.0.smithi096.stdout:13 2024-09-16T03:53:24.366 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T03:53:24.366 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:53:24.366 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:53:25.661 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:53:26.663 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:53:26.664 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:53:26.664 INFO:tasks.workunit.client.0.smithi096.stdout:14 2024-09-16T03:53:26.664 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T03:53:26.665 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:53:26.665 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:53:27.620 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:53:28.622 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:53:28.622 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:53:28.622 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T03:53:28.623 INFO:tasks.workunit.client.0.smithi096.stdout:15 2024-09-16T03:53:28.623 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:53:28.623 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:53:29.381 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:53:30.382 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:53:30.383 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:53:30.383 INFO:tasks.workunit.client.0.smithi096.stdout:16 2024-09-16T03:53:30.384 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T03:53:30.384 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:53:30.384 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:53:30.852 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:53:31.854 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:53:31.854 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:53:31.854 INFO:tasks.workunit.client.0.smithi096.stdout:17 2024-09-16T03:53:31.855 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T03:53:31.855 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:53:31.855 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:53:32.329 INFO:tasks.workunit.client.0.smithi096.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/3581651807,v1:127.0.0.1:6819/3581651807] [v2:127.0.0.1:6820/3581651807,v1:127.0.0.1:6821/3581651807] exists,up 5cf36ce3-37a9-436d-b46b-f2807f5a69cc 2024-09-16T03:53:32.329 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:53:32.329 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:53:32.330 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:53:32.330 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: seq 0 20 2024-09-16T03:53:32.330 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:53:32.330 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 0 + 1 2024-09-16T03:53:32.331 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=1 2024-09-16T03:53:32.331 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test1 1 1 2024-09-16T03:53:32.973 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test1' already exists 2024-09-16T03:53:32.990 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:53:32.990 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 1 + 1 2024-09-16T03:53:32.991 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=2 2024-09-16T03:53:32.991 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test2 1 1 2024-09-16T03:53:33.811 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test2' already exists 2024-09-16T03:53:33.828 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:53:33.829 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 2 + 1 2024-09-16T03:53:33.830 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=3 2024-09-16T03:53:33.830 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test3 1 1 2024-09-16T03:53:34.830 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test3' already exists 2024-09-16T03:53:34.848 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:53:34.848 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 3 + 1 2024-09-16T03:53:34.849 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=4 2024-09-16T03:53:34.849 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test4 1 1 2024-09-16T03:53:35.443 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test4' already exists 2024-09-16T03:53:35.458 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:53:35.459 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 4 + 1 2024-09-16T03:53:35.460 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=5 2024-09-16T03:53:35.460 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test5 1 1 2024-09-16T03:53:36.238 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test5' already exists 2024-09-16T03:53:36.255 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:53:36.256 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 5 + 1 2024-09-16T03:53:36.258 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=6 2024-09-16T03:53:36.258 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test6 1 1 2024-09-16T03:53:37.156 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test6' already exists 2024-09-16T03:53:37.174 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:53:37.174 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 6 + 1 2024-09-16T03:53:37.176 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=7 2024-09-16T03:53:37.176 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test7 1 1 2024-09-16T03:53:37.828 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test7' already exists 2024-09-16T03:53:37.846 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:53:37.846 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 7 + 1 2024-09-16T03:53:37.848 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=8 2024-09-16T03:53:37.848 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test8 1 1 2024-09-16T03:53:39.261 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test8' already exists 2024-09-16T03:53:39.283 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:53:39.284 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 8 + 1 2024-09-16T03:53:39.285 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=9 2024-09-16T03:53:39.285 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test9 1 1 2024-09-16T03:53:39.958 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test9' already exists 2024-09-16T03:53:39.974 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:53:39.974 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 9 + 1 2024-09-16T03:53:39.976 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=10 2024-09-16T03:53:39.976 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test10 1 1 2024-09-16T03:53:40.753 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test10' already exists 2024-09-16T03:53:40.769 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:53:40.770 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 10 + 1 2024-09-16T03:53:40.771 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=11 2024-09-16T03:53:40.771 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test11 1 1 2024-09-16T03:53:41.741 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test11' already exists 2024-09-16T03:53:41.758 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:53:41.758 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 11 + 1 2024-09-16T03:53:41.760 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=12 2024-09-16T03:53:41.760 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test12 1 1 2024-09-16T03:53:42.685 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test12' already exists 2024-09-16T03:53:42.708 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:53:42.708 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 12 + 1 2024-09-16T03:53:42.710 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=13 2024-09-16T03:53:42.710 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test13 1 1 2024-09-16T03:53:43.505 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test13' already exists 2024-09-16T03:53:43.521 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:53:43.521 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 13 + 1 2024-09-16T03:53:43.523 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=14 2024-09-16T03:53:43.523 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test14 1 1 2024-09-16T03:53:44.302 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test14' already exists 2024-09-16T03:53:44.321 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:53:44.322 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 14 + 1 2024-09-16T03:53:44.323 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=15 2024-09-16T03:53:44.323 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test15 1 1 2024-09-16T03:53:45.192 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test15' already exists 2024-09-16T03:53:45.211 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:53:45.212 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 15 + 1 2024-09-16T03:53:45.213 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=16 2024-09-16T03:53:45.213 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test16 1 1 2024-09-16T03:53:45.875 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test16' already exists 2024-09-16T03:53:45.892 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:53:45.893 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 16 + 1 2024-09-16T03:53:45.894 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=17 2024-09-16T03:53:45.894 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test17 1 1 2024-09-16T03:53:46.423 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test17' already exists 2024-09-16T03:53:46.441 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:53:46.442 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 17 + 1 2024-09-16T03:53:46.443 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=18 2024-09-16T03:53:46.443 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test18 1 1 2024-09-16T03:53:47.250 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test18' already exists 2024-09-16T03:53:47.267 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:53:47.267 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 18 + 1 2024-09-16T03:53:47.268 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=19 2024-09-16T03:53:47.269 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test19 1 1 2024-09-16T03:53:47.931 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test19' already exists 2024-09-16T03:53:47.950 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:53:47.950 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 19 + 1 2024-09-16T03:53:47.951 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=20 2024-09-16T03:53:47.952 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test20 1 1 2024-09-16T03:53:48.873 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test20' already exists 2024-09-16T03:53:48.893 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:53:48.893 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 20 + 1 2024-09-16T03:53:48.894 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=21 2024-09-16T03:53:48.894 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test21 1 1 2024-09-16T03:53:49.982 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test21' already exists 2024-09-16T03:53:50.000 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:240: check_pool_priority: wait_for_clean 2024-09-16T03:53:50.001 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1633: wait_for_clean: local cmd= 2024-09-16T03:53:50.001 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1634: wait_for_clean: local num_active_clean=-1 2024-09-16T03:53:50.001 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1635: wait_for_clean: local cur_active_clean 2024-09-16T03:53:50.002 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: get_timeout_delays 90 .1 2024-09-16T03:53:50.002 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: shopt -q -o xtrace 2024-09-16T03:53:50.002 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: echo true 2024-09-16T03:53:50.002 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: local trace=true 2024-09-16T03:53:50.002 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: true 2024-09-16T03:53:50.002 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: shopt -u -o xtrace 2024-09-16T03:53:50.097 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-09-16T03:53:50.097 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: local -a delays 2024-09-16T03:53:50.098 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1637: wait_for_clean: local -i loop=0 2024-09-16T03:53:50.098 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1639: wait_for_clean: flush_pg_stats 2024-09-16T03:53:50.098 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: local timeout=300 2024-09-16T03:53:50.098 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ceph osd ls 2024-09-16T03:53:50.575 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ids='0 2024-09-16T03:53:50.575 INFO:tasks.workunit.client.0.smithi096.stderr:1 2024-09-16T03:53:50.576 INFO:tasks.workunit.client.0.smithi096.stderr:2' 2024-09-16T03:53:50.576 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2208: flush_pg_stats: seqs= 2024-09-16T03:53:50.576 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:53:50.576 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-09-16T03:53:50.734 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=21474836503 2024-09-16T03:53:50.734 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 21474836503 2024-09-16T03:53:50.734 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836503' 2024-09-16T03:53:50.734 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:53:50.734 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-09-16T03:53:50.938 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=42949672976 2024-09-16T03:53:50.938 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 42949672976 2024-09-16T03:53:50.938 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836503 1-42949672976' 2024-09-16T03:53:50.938 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:53:50.938 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-09-16T03:53:51.091 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=64424509450 2024-09-16T03:53:51.091 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 64424509450 2024-09-16T03:53:51.091 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836503 1-42949672976 2-64424509450' 2024-09-16T03:53:51.092 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:53:51.092 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 0-21474836503 2024-09-16T03:53:51.092 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:53:51.093 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=0 2024-09-16T03:53:51.093 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 0-21474836503 2024-09-16T03:53:51.093 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:53:51.094 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=21474836503 2024-09-16T03:53:51.094 INFO:tasks.workunit.client.0.smithi096.stdout:waiting osd.0 seq 21474836503 2024-09-16T03:53:51.095 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.0 seq 21474836503' 2024-09-16T03:53:51.095 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T03:53:51.640 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836500 -lt 21474836503 2024-09-16T03:53:51.640 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: flush_pg_stats: sleep 1 2024-09-16T03:53:52.642 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2224: flush_pg_stats: '[' 300 -eq 0 ']' 2024-09-16T03:53:52.642 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T03:53:53.092 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836503 -lt 21474836503 2024-09-16T03:53:53.093 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:53:53.093 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 1-42949672976 2024-09-16T03:53:53.093 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:53:53.094 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=1 2024-09-16T03:53:53.095 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 1-42949672976 2024-09-16T03:53:53.095 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:53:53.096 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=42949672976 2024-09-16T03:53:53.096 INFO:tasks.workunit.client.0.smithi096.stdout:waiting osd.1 seq 42949672976 2024-09-16T03:53:53.096 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.1 seq 42949672976' 2024-09-16T03:53:53.097 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 1 2024-09-16T03:53:53.543 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 42949672977 -lt 42949672976 2024-09-16T03:53:53.544 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:53:53.544 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 2-64424509450 2024-09-16T03:53:53.545 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:53:53.546 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=2 2024-09-16T03:53:53.546 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 2-64424509450 2024-09-16T03:53:53.546 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:53:53.547 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=64424509450 2024-09-16T03:53:53.548 INFO:tasks.workunit.client.0.smithi096.stdout:waiting osd.2 seq 64424509450 2024-09-16T03:53:53.548 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.2 seq 64424509450' 2024-09-16T03:53:53.548 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 2 2024-09-16T03:53:54.028 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 64424509451 -lt 64424509450 2024-09-16T03:53:54.029 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: get_num_pgs 2024-09-16T03:53:54.029 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:53:54.029 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:53:54.656 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: test 21 == 0 2024-09-16T03:53:54.656 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:53:54.657 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:53:54.657 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:53:54.657 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:53:54.657 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:53:54.657 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:53:54.657 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:53:55.077 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=21 2024-09-16T03:53:55.077 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:53:55.078 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:53:55.078 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:53:55.616 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 21 = 21 2024-09-16T03:53:55.616 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: break 2024-09-16T03:53:55.616 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: return 0 2024-09-16T03:53:55.617 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: seq 0 20 2024-09-16T03:53:55.618 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:53:55.618 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 0 + 1 2024-09-16T03:53:55.619 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=1 2024-09-16T03:53:55.619 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 0 '*' 5 - 50 2024-09-16T03:53:55.620 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test1 recovery_priority -50 2024-09-16T03:53:56.349 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 1 recovery_priority to -50 2024-09-16T03:53:56.370 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:53:56.370 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 1 + 1 2024-09-16T03:53:56.371 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=2 2024-09-16T03:53:56.371 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 1 '*' 5 - 50 2024-09-16T03:53:56.374 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test2 recovery_priority -45 2024-09-16T03:53:57.154 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 2 recovery_priority to -45 2024-09-16T03:53:57.290 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:53:57.291 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 2 + 1 2024-09-16T03:53:57.291 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=3 2024-09-16T03:53:57.291 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 2 '*' 5 - 50 2024-09-16T03:53:57.291 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test3 recovery_priority -40 2024-09-16T03:53:58.034 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 3 recovery_priority to -40 2024-09-16T03:53:58.056 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:53:58.057 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 3 + 1 2024-09-16T03:53:58.057 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=4 2024-09-16T03:53:58.058 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 3 '*' 5 - 50 2024-09-16T03:53:58.059 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test4 recovery_priority -35 2024-09-16T03:53:58.805 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 4 recovery_priority to -35 2024-09-16T03:53:58.828 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:53:58.828 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 4 + 1 2024-09-16T03:53:58.830 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=5 2024-09-16T03:53:58.831 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 4 '*' 5 - 50 2024-09-16T03:53:58.832 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test5 recovery_priority -30 2024-09-16T03:53:59.669 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 5 recovery_priority to -30 2024-09-16T03:53:59.689 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:53:59.690 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 5 + 1 2024-09-16T03:53:59.691 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=6 2024-09-16T03:53:59.691 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 5 '*' 5 - 50 2024-09-16T03:53:59.692 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test6 recovery_priority -25 2024-09-16T03:54:00.490 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 6 recovery_priority to -25 2024-09-16T03:54:00.512 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:54:00.512 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 6 + 1 2024-09-16T03:54:00.514 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=7 2024-09-16T03:54:00.515 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 6 '*' 5 - 50 2024-09-16T03:54:00.516 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test7 recovery_priority -20 2024-09-16T03:54:01.228 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 7 recovery_priority to -20 2024-09-16T03:54:01.248 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:54:01.248 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 7 + 1 2024-09-16T03:54:01.250 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=8 2024-09-16T03:54:01.250 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 7 '*' 5 - 50 2024-09-16T03:54:01.251 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test8 recovery_priority -15 2024-09-16T03:54:02.006 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 8 recovery_priority to -15 2024-09-16T03:54:02.024 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:54:02.024 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 8 + 1 2024-09-16T03:54:02.026 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=9 2024-09-16T03:54:02.026 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 8 '*' 5 - 50 2024-09-16T03:54:02.028 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test9 recovery_priority -10 2024-09-16T03:54:02.853 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 9 recovery_priority to -10 2024-09-16T03:54:02.874 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:54:02.874 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 9 + 1 2024-09-16T03:54:02.875 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=10 2024-09-16T03:54:02.875 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 9 '*' 5 - 50 2024-09-16T03:54:02.876 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test10 recovery_priority -5 2024-09-16T03:54:03.716 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 10 recovery_priority to -5 2024-09-16T03:54:03.738 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:54:03.739 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 10 + 1 2024-09-16T03:54:03.740 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=11 2024-09-16T03:54:03.740 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 10 '*' 5 - 50 2024-09-16T03:54:03.742 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test11 recovery_priority 0 2024-09-16T03:54:04.562 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 11 recovery_priority to 0 2024-09-16T03:54:04.585 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:54:04.586 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 11 + 1 2024-09-16T03:54:04.587 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=12 2024-09-16T03:54:04.587 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 11 '*' 5 - 50 2024-09-16T03:54:04.588 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test12 recovery_priority 5 2024-09-16T03:54:05.459 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 12 recovery_priority to 5 2024-09-16T03:54:05.480 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:54:05.481 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 12 + 1 2024-09-16T03:54:05.482 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=13 2024-09-16T03:54:05.482 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 12 '*' 5 - 50 2024-09-16T03:54:05.484 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test13 recovery_priority 10 2024-09-16T03:54:06.296 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 13 recovery_priority to 10 2024-09-16T03:54:06.315 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:54:06.315 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 13 + 1 2024-09-16T03:54:06.317 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=14 2024-09-16T03:54:06.317 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 13 '*' 5 - 50 2024-09-16T03:54:06.319 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test14 recovery_priority 15 2024-09-16T03:54:06.987 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 14 recovery_priority to 15 2024-09-16T03:54:07.003 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:54:07.004 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 14 + 1 2024-09-16T03:54:07.005 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=15 2024-09-16T03:54:07.005 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 14 '*' 5 - 50 2024-09-16T03:54:07.006 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test15 recovery_priority 20 2024-09-16T03:54:07.925 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 15 recovery_priority to 20 2024-09-16T03:54:07.946 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:54:07.947 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 15 + 1 2024-09-16T03:54:07.948 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=16 2024-09-16T03:54:07.948 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 15 '*' 5 - 50 2024-09-16T03:54:07.949 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test16 recovery_priority 25 2024-09-16T03:54:08.743 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 16 recovery_priority to 25 2024-09-16T03:54:08.766 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:54:08.767 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 16 + 1 2024-09-16T03:54:08.769 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=17 2024-09-16T03:54:08.769 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 16 '*' 5 - 50 2024-09-16T03:54:08.770 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test17 recovery_priority 30 2024-09-16T03:54:09.397 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 17 recovery_priority to 30 2024-09-16T03:54:09.415 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:54:09.415 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 17 + 1 2024-09-16T03:54:09.417 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=18 2024-09-16T03:54:09.417 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 17 '*' 5 - 50 2024-09-16T03:54:09.418 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test18 recovery_priority 35 2024-09-16T03:54:10.218 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 18 recovery_priority to 35 2024-09-16T03:54:10.244 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:54:10.245 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 18 + 1 2024-09-16T03:54:10.246 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=19 2024-09-16T03:54:10.247 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 18 '*' 5 - 50 2024-09-16T03:54:10.248 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test19 recovery_priority 40 2024-09-16T03:54:11.064 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 19 recovery_priority to 40 2024-09-16T03:54:11.085 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:54:11.085 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 19 + 1 2024-09-16T03:54:11.086 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=20 2024-09-16T03:54:11.087 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 19 '*' 5 - 50 2024-09-16T03:54:11.088 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test20 recovery_priority 45 2024-09-16T03:54:11.844 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 20 recovery_priority to 45 2024-09-16T03:54:11.867 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:54:11.867 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 20 + 1 2024-09-16T03:54:11.869 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=21 2024-09-16T03:54:11.869 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 20 '*' 5 - 50 2024-09-16T03:54:11.870 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test21 recovery_priority 50 2024-09-16T03:54:12.691 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 21 recovery_priority to 50 2024-09-16T03:54:12.712 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:249: check_pool_priority: bin/ceph osd dump 2024-09-16T03:54:12.713 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh: line 249: bin/ceph: No such file or directory 2024-09-16T03:54:12.714 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:252: check_pool_priority: kill_daemons 2024-09-16T03:54:12.714 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:54:12.714 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:54:12.715 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:54:12.715 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:54:12.715 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:54:14.029 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:54:14.029 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:253: check_pool_priority: run_mon td/osd-pool-create a 2024-09-16T03:54:14.029 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-pool-create 2024-09-16T03:54:14.029 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T03:54:14.029 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T03:54:14.029 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T03:54:14.029 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-pool-create/a 2024-09-16T03:54:14.029 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-pool-create/a --run-dir=td/osd-pool-create 2024-09-16T03:54:14.054 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:54:14.052+0000 7f9359513e00 -1 'td/osd-pool-create/a' already exists and is not empty: monitor may already exist 2024-09-16T03:54:14.056 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T03:54:14.057 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:54:14.057 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:54:14.057 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:54:14.057 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:54:14.057 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:54:14.058 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T03:54:14.058 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug_allow_any_pool_priority=true --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-pool-create/a '--log-file=td/osd-pool-create/$name.log' '--admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' --mon-cluster-log-file=td/osd-pool-create/log --run-dir=td/osd-pool-create '--pid-file=td/osd-pool-create/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-09-16T03:54:14.312 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T03:54:14.313 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T03:54:14.313 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:54:14.314 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:54:14.314 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T03:54:14.315 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T03:54:14.315 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:54:14.315 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:54:14.315 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:54:14.315 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:54:14.315 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:54:14.315 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:54:14.315 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.128966/ceph-mon.a.asok 2024-09-16T03:54:14.316 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:54:14.316 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.128966/ceph-mon.a.asok config get fsid 2024-09-16T03:54:14.433 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T03:54:14.433 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:54:14.433 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:54:14.433 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T03:54:14.434 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:54:14.434 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:54:14.435 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:54:14.435 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T03:54:14.435 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:54:14.435 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:54:14.435 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:54:14.435 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.128966/ceph-mon.a.asok 2024-09-16T03:54:14.435 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:54:14.435 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.128966/ceph-mon.a.asok config get mon_host 2024-09-16T03:54:14.548 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:254: check_pool_priority: run_mgr td/osd-pool-create x 2024-09-16T03:54:14.548 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-pool-create 2024-09-16T03:54:14.548 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2024-09-16T03:54:14.548 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2024-09-16T03:54:14.548 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2024-09-16T03:54:14.548 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-pool-create/x 2024-09-16T03:54:14.548 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2024-09-16T03:54:14.975 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2024-09-16T03:54:14.976 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:54:14.976 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:54:14.976 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:54:14.976 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:54:14.976 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:54:14.976 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T03:54:14.977 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T03:54:14.977 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --debug_allow_any_pool_priority=true --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-pool-create/x '--log-file=td/osd-pool-create/$name.log' '--admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' --run-dir=td/osd-pool-create '--pid-file=td/osd-pool-create/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T03:54:15.011 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:255: check_pool_priority: activate_osd td/osd-pool-create 0 2024-09-16T03:54:15.011 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-pool-create 2024-09-16T03:54:15.011 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2024-09-16T03:54:15.011 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2024-09-16T03:54:15.011 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2024-09-16T03:54:15.011 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-pool-create/0 2024-09-16T03:54:15.011 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=38a92d84-8703-45d8-b5ef-7d976430f112 --auth-supported=none --mon-host=127.0.0.1:7105 ' 2024-09-16T03:54:15.011 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T03:54:15.011 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T03:54:15.011 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T03:54:15.011 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-pool-create/0' 2024-09-16T03:54:15.012 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-pool-create/0/journal' 2024-09-16T03:54:15.012 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2024-09-16T03:54:15.012 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+=--debug_allow_any_pool_priority=true 2024-09-16T03:54:15.012 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-pool-create' 2024-09-16T03:54:15.012 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2024-09-16T03:54:15.012 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:54:15.012 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:54:15.012 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:54:15.012 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:54:15.012 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:54:15.012 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T03:54:15.012 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T03:54:15.012 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2024-09-16T03:54:15.013 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-pool-create/$name.log' 2024-09-16T03:54:15.013 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-pool-create/$name.pid' 2024-09-16T03:54:15.013 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T03:54:15.013 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T03:54:15.013 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T03:54:15.013 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T03:54:15.013 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2024-09-16T03:54:15.013 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2024-09-16T03:54:15.013 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-pool-create/0 2024-09-16T03:54:15.013 INFO:tasks.workunit.client.0.smithi096.stdout:start osd.0 2024-09-16T03:54:15.014 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2024-09-16T03:54:15.015 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=38a92d84-8703-45d8-b5ef-7d976430f112 --auth-supported=none --mon-host=127.0.0.1:7105 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-pool-create/0 --osd-journal=td/osd-pool-create/0/journal --chdir=--debug_allow_any_pool_priority=true --run-dir=td/osd-pool-create '--admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-pool-create/$name.log' '--pid-file=td/osd-pool-create/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T03:54:15.015 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-pool-create/0/whoami 2024-09-16T03:54:15.015 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2024-09-16T03:54:15.015 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2024-09-16T03:54:15.015 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2024-09-16T03:54:15.015 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2024-09-16T03:54:15.035 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:54:15.032+0000 7fd6d37fd7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:54:15.037 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:54:15.032+0000 7fd6d37fd7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:54:15.039 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:54:15.036+0000 7fd6d37fd7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:54:15.039 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:54:15.036+0000 7fd6d37fd7c0 -1 global_init_chdir: failed to chdir to directory: '--debug_allow_any_pool_priority=true': (2) No such file or directory 2024-09-16T03:54:15.451 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2024-09-16T03:54:15.451 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:54:15.451 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T03:54:15.452 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2024-09-16T03:54:15.452 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:54:15.452 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:54:15.452 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:54:15.452 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:54:15.452 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:54:15.452 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:54:15.936 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:54:16.415 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:54:16.412+0000 7fd6d37fd7c0 -1 Falling back to public interface 2024-09-16T03:54:16.416 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:54:16.412+0000 7fd6d37fd7c0 -1 global_init_chdir: failed to chdir to directory: '--debug_allow_any_pool_priority=true': (2) No such file or directory 2024-09-16T03:54:16.937 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:54:16.937 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:54:16.938 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T03:54:16.938 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T03:54:16.938 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:54:16.938 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:54:17.353 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:54:18.354 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:54:18.355 INFO:tasks.workunit.client.0.smithi096.stdout:2 2024-09-16T03:54:18.355 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:54:18.355 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T03:54:18.355 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:54:18.356 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:54:18.763 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:54:19.765 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:54:19.765 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:54:19.765 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T03:54:19.766 INFO:tasks.workunit.client.0.smithi096.stdout:3 2024-09-16T03:54:19.766 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:54:19.766 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:54:19.894 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:54:19.888+0000 7fd6d37fd7c0 -1 osd.0 103 log_to_monitors true 2024-09-16T03:54:20.307 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:54:21.309 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:54:21.309 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:54:21.309 INFO:tasks.workunit.client.0.smithi096.stdout:4 2024-09-16T03:54:21.310 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T03:54:21.310 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:54:21.310 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:54:21.751 INFO:tasks.workunit.client.0.smithi096.stdout:osd.0 up in weight 1 up_from 107 up_thru 107 down_at 104 last_clean_interval [5,103) [v2:127.0.0.1:6800/1700300187,v1:127.0.0.1:6801/1700300187] [v2:127.0.0.1:6802/1700300187,v1:127.0.0.1:6803/1700300187] exists,up 24f0b211-47dd-4323-baae-163742e2781a 2024-09-16T03:54:21.753 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:54:21.753 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:54:21.753 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:54:21.753 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:256: check_pool_priority: activate_osd td/osd-pool-create 1 2024-09-16T03:54:21.754 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-pool-create 2024-09-16T03:54:21.754 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2024-09-16T03:54:21.754 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2024-09-16T03:54:21.754 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2024-09-16T03:54:21.754 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-pool-create/1 2024-09-16T03:54:21.754 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=38a92d84-8703-45d8-b5ef-7d976430f112 --auth-supported=none --mon-host=127.0.0.1:7105 ' 2024-09-16T03:54:21.754 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T03:54:21.754 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T03:54:21.754 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T03:54:21.754 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-pool-create/1' 2024-09-16T03:54:21.754 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-pool-create/1/journal' 2024-09-16T03:54:21.754 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2024-09-16T03:54:21.755 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+=--debug_allow_any_pool_priority=true 2024-09-16T03:54:21.755 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-pool-create' 2024-09-16T03:54:21.755 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2024-09-16T03:54:21.755 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:54:21.755 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:54:21.755 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:54:21.755 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:54:21.755 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:54:21.755 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T03:54:21.758 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T03:54:21.759 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2024-09-16T03:54:21.759 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-pool-create/$name.log' 2024-09-16T03:54:21.759 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-pool-create/$name.pid' 2024-09-16T03:54:21.759 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T03:54:21.759 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T03:54:21.759 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T03:54:21.759 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T03:54:21.759 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2024-09-16T03:54:21.759 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2024-09-16T03:54:21.759 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-pool-create/1 2024-09-16T03:54:21.759 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2024-09-16T03:54:21.760 INFO:tasks.workunit.client.0.smithi096.stdout:start osd.1 2024-09-16T03:54:21.760 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=38a92d84-8703-45d8-b5ef-7d976430f112 --auth-supported=none --mon-host=127.0.0.1:7105 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-pool-create/1 --osd-journal=td/osd-pool-create/1/journal --chdir=--debug_allow_any_pool_priority=true --run-dir=td/osd-pool-create '--admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-pool-create/$name.log' '--pid-file=td/osd-pool-create/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T03:54:21.761 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-pool-create/1/whoami 2024-09-16T03:54:21.761 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2024-09-16T03:54:21.761 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2024-09-16T03:54:21.761 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2024-09-16T03:54:21.761 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2024-09-16T03:54:21.779 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:54:21.776+0000 7febba3837c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:54:21.781 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:54:21.776+0000 7febba3837c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:54:21.782 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:54:21.780+0000 7febba3837c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:54:21.782 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:54:21.780+0000 7febba3837c0 -1 global_init_chdir: failed to chdir to directory: '--debug_allow_any_pool_priority=true': (2) No such file or directory 2024-09-16T03:54:22.204 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2024-09-16T03:54:22.204 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:54:22.204 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2024-09-16T03:54:22.205 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:54:22.205 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:54:22.205 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:54:22.205 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:54:22.205 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T03:54:22.205 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:54:22.206 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:54:22.644 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:54:22.848 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:54:22.844+0000 7febba3837c0 -1 Falling back to public interface 2024-09-16T03:54:22.852 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:54:22.848+0000 7febba3837c0 -1 global_init_chdir: failed to chdir to directory: '--debug_allow_any_pool_priority=true': (2) No such file or directory 2024-09-16T03:54:23.646 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:54:23.646 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:54:23.646 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T03:54:23.647 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T03:54:23.647 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:54:23.647 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:54:24.062 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:54:25.064 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:54:25.064 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:54:25.064 INFO:tasks.workunit.client.0.smithi096.stdout:2 2024-09-16T03:54:25.065 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T03:54:25.065 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:54:25.065 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:54:25.493 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:54:26.310 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:54:26.308+0000 7febba3837c0 -1 osd.1 101 log_to_monitors true 2024-09-16T03:54:26.495 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:54:26.495 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:54:26.495 INFO:tasks.workunit.client.0.smithi096.stdout:3 2024-09-16T03:54:26.496 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T03:54:26.496 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:54:26.496 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:54:27.019 INFO:tasks.workunit.client.0.smithi096.stdout:osd.1 up in weight 1 up_from 110 up_thru 42 down_at 104 last_clean_interval [10,101) [v2:127.0.0.1:6810/1809800875,v1:127.0.0.1:6811/1809800875] [v2:127.0.0.1:6812/1809800875,v1:127.0.0.1:6813/1809800875] exists,up 959188bb-efce-4225-bd41-49eee704cbb0 2024-09-16T03:54:27.024 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:54:27.024 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:54:27.024 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:54:27.025 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:257: check_pool_priority: activate_osd td/osd-pool-create 2 2024-09-16T03:54:27.025 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-pool-create 2024-09-16T03:54:27.025 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2024-09-16T03:54:27.025 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2024-09-16T03:54:27.025 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2024-09-16T03:54:27.025 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-pool-create/2 2024-09-16T03:54:27.026 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=38a92d84-8703-45d8-b5ef-7d976430f112 --auth-supported=none --mon-host=127.0.0.1:7105 ' 2024-09-16T03:54:27.026 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T03:54:27.026 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T03:54:27.026 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T03:54:27.026 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-pool-create/2' 2024-09-16T03:54:27.027 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-pool-create/2/journal' 2024-09-16T03:54:27.027 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2024-09-16T03:54:27.027 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+=--debug_allow_any_pool_priority=true 2024-09-16T03:54:27.027 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-pool-create' 2024-09-16T03:54:27.027 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2024-09-16T03:54:27.027 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:54:27.028 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:54:27.028 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:54:27.028 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:54:27.028 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:54:27.028 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T03:54:27.029 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T03:54:27.029 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2024-09-16T03:54:27.029 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-pool-create/$name.log' 2024-09-16T03:54:27.029 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-pool-create/$name.pid' 2024-09-16T03:54:27.029 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T03:54:27.029 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T03:54:27.029 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T03:54:27.029 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T03:54:27.030 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2024-09-16T03:54:27.030 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2024-09-16T03:54:27.030 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-pool-create/2 2024-09-16T03:54:27.030 INFO:tasks.workunit.client.0.smithi096.stdout:start osd.2 2024-09-16T03:54:27.032 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2024-09-16T03:54:27.032 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=38a92d84-8703-45d8-b5ef-7d976430f112 --auth-supported=none --mon-host=127.0.0.1:7105 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-pool-create/2 --osd-journal=td/osd-pool-create/2/journal --chdir=--debug_allow_any_pool_priority=true --run-dir=td/osd-pool-create '--admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-pool-create/$name.log' '--pid-file=td/osd-pool-create/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T03:54:27.032 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-pool-create/2/whoami 2024-09-16T03:54:27.033 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2024-09-16T03:54:27.033 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2024-09-16T03:54:27.033 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2024-09-16T03:54:27.033 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2024-09-16T03:54:27.052 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:54:27.048+0000 7f0d25c267c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:54:27.054 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:54:27.052+0000 7f0d25c267c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:54:27.055 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:54:27.052+0000 7f0d25c267c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:54:27.056 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:54:27.052+0000 7f0d25c267c0 -1 global_init_chdir: failed to chdir to directory: '--debug_allow_any_pool_priority=true': (2) No such file or directory 2024-09-16T03:54:27.584 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2024-09-16T03:54:27.584 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:54:27.584 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2024-09-16T03:54:27.584 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:54:27.584 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T03:54:27.585 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:54:27.585 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:54:27.585 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:54:27.585 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:54:27.585 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:54:28.049 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:54:28.345 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:54:28.340+0000 7f0d25c267c0 -1 Falling back to public interface 2024-09-16T03:54:28.350 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:54:28.348+0000 7f0d25c267c0 -1 global_init_chdir: failed to chdir to directory: '--debug_allow_any_pool_priority=true': (2) No such file or directory 2024-09-16T03:54:29.051 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:54:29.051 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:54:29.051 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T03:54:29.052 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T03:54:29.052 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:54:29.052 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:54:29.518 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:54:30.520 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:54:30.520 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:54:30.520 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T03:54:30.520 INFO:tasks.workunit.client.0.smithi096.stdout:2 2024-09-16T03:54:30.521 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:54:30.521 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:54:30.962 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:54:31.728 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:54:31.724+0000 7f0d25c267c0 -1 osd.2 101 log_to_monitors true 2024-09-16T03:54:31.965 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:54:31.965 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:54:31.965 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T03:54:31.966 INFO:tasks.workunit.client.0.smithi096.stdout:3 2024-09-16T03:54:31.966 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:54:31.966 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:54:32.456 INFO:tasks.workunit.client.0.smithi096.stdout:osd.2 up in weight 1 up_from 114 up_thru 58 down_at 104 last_clean_interval [15,101) [v2:127.0.0.1:6818/2198346019,v1:127.0.0.1:6819/2198346019] [v2:127.0.0.1:6820/2198346019,v1:127.0.0.1:6821/2198346019] exists,up 5cf36ce3-37a9-436d-b46b-f2807f5a69cc 2024-09-16T03:54:32.457 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:54:32.457 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:54:32.457 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:54:32.457 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:258: check_pool_priority: sleep 5 2024-09-16T03:54:37.458 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:260: check_pool_priority: grep convert td/osd-pool-create/mon.a.log 2024-09-16T03:54:37.486 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T03:51:44.996+0000 7f3ad0de4640 20 mon.a@0(leader).osd e1 convert_pool_priorities nothing to fix 2024-09-16T03:54:37.486 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T03:54:14.392+0000 7fda22cd8e00 10 mon.a@0(leader).osd e104 convert_pool_priorities pool 1 recovery_priority adjusted -50 to -10 2024-09-16T03:54:37.486 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T03:54:14.392+0000 7fda22cd8e00 10 mon.a@0(leader).osd e104 convert_pool_priorities pool 2 recovery_priority adjusted -45 to -9 2024-09-16T03:54:37.486 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T03:54:14.392+0000 7fda22cd8e00 10 mon.a@0(leader).osd e104 convert_pool_priorities pool 3 recovery_priority adjusted -40 to -8 2024-09-16T03:54:37.487 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T03:54:14.392+0000 7fda22cd8e00 10 mon.a@0(leader).osd e104 convert_pool_priorities pool 4 recovery_priority adjusted -35 to -7 2024-09-16T03:54:37.487 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T03:54:14.392+0000 7fda22cd8e00 10 mon.a@0(leader).osd e104 convert_pool_priorities pool 5 recovery_priority adjusted -30 to -6 2024-09-16T03:54:37.487 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T03:54:14.392+0000 7fda22cd8e00 10 mon.a@0(leader).osd e104 convert_pool_priorities pool 6 recovery_priority adjusted -25 to -5 2024-09-16T03:54:37.487 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T03:54:14.392+0000 7fda22cd8e00 10 mon.a@0(leader).osd e104 convert_pool_priorities pool 7 recovery_priority adjusted -20 to -4 2024-09-16T03:54:37.487 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T03:54:14.392+0000 7fda22cd8e00 10 mon.a@0(leader).osd e104 convert_pool_priorities pool 8 recovery_priority adjusted -15 to -3 2024-09-16T03:54:37.487 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T03:54:14.392+0000 7fda22cd8e00 10 mon.a@0(leader).osd e104 convert_pool_priorities pool 9 recovery_priority adjusted -10 to -2 2024-09-16T03:54:37.487 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T03:54:14.392+0000 7fda22cd8e00 10 mon.a@0(leader).osd e104 convert_pool_priorities pool 10 recovery_priority adjusted -5 to -1 2024-09-16T03:54:37.487 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T03:54:14.392+0000 7fda22cd8e00 10 mon.a@0(leader).osd e104 convert_pool_priorities pool 12 recovery_priority adjusted 5 to 1 2024-09-16T03:54:37.487 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T03:54:14.392+0000 7fda22cd8e00 10 mon.a@0(leader).osd e104 convert_pool_priorities pool 13 recovery_priority adjusted 10 to 2 2024-09-16T03:54:37.487 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T03:54:14.392+0000 7fda22cd8e00 10 mon.a@0(leader).osd e104 convert_pool_priorities pool 14 recovery_priority adjusted 15 to 3 2024-09-16T03:54:37.487 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T03:54:14.392+0000 7fda22cd8e00 10 mon.a@0(leader).osd e104 convert_pool_priorities pool 15 recovery_priority adjusted 20 to 4 2024-09-16T03:54:37.487 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T03:54:14.392+0000 7fda22cd8e00 10 mon.a@0(leader).osd e104 convert_pool_priorities pool 16 recovery_priority adjusted 25 to 5 2024-09-16T03:54:37.487 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T03:54:14.392+0000 7fda22cd8e00 10 mon.a@0(leader).osd e104 convert_pool_priorities pool 17 recovery_priority adjusted 30 to 6 2024-09-16T03:54:37.488 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T03:54:14.392+0000 7fda22cd8e00 10 mon.a@0(leader).osd e104 convert_pool_priorities pool 18 recovery_priority adjusted 35 to 7 2024-09-16T03:54:37.488 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T03:54:14.392+0000 7fda22cd8e00 10 mon.a@0(leader).osd e104 convert_pool_priorities pool 19 recovery_priority adjusted 40 to 8 2024-09-16T03:54:37.488 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T03:54:14.392+0000 7fda22cd8e00 10 mon.a@0(leader).osd e104 convert_pool_priorities pool 20 recovery_priority adjusted 45 to 9 2024-09-16T03:54:37.488 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T03:54:14.392+0000 7fda22cd8e00 10 mon.a@0(leader).osd e104 convert_pool_priorities pool 21 recovery_priority adjusted 50 to 10 2024-09-16T03:54:37.488 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:261: check_pool_priority: ceph osd dump 2024-09-16T03:54:37.894 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 116 2024-09-16T03:54:37.894 INFO:tasks.workunit.client.0.smithi096.stdout:fsid 38a92d84-8703-45d8-b5ef-7d976430f112 2024-09-16T03:54:37.894 INFO:tasks.workunit.client.0.smithi096.stdout:created 2024-09-16T03:51:44.874271+0000 2024-09-16T03:54:37.894 INFO:tasks.workunit.client.0.smithi096.stdout:modified 2024-09-16T03:54:32.799626+0000 2024-09-16T03:54:37.894 INFO:tasks.workunit.client.0.smithi096.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-16T03:54:37.894 INFO:tasks.workunit.client.0.smithi096.stdout:crush_version 10 2024-09-16T03:54:37.894 INFO:tasks.workunit.client.0.smithi096.stdout:full_ratio 0.99 2024-09-16T03:54:37.894 INFO:tasks.workunit.client.0.smithi096.stdout:backfillfull_ratio 0.99 2024-09-16T03:54:37.894 INFO:tasks.workunit.client.0.smithi096.stdout:nearfull_ratio 0.85 2024-09-16T03:54:37.894 INFO:tasks.workunit.client.0.smithi096.stdout:require_min_compat_client luminous 2024-09-16T03:54:37.894 INFO:tasks.workunit.client.0.smithi096.stdout:min_compat_client jewel 2024-09-16T03:54:37.895 INFO:tasks.workunit.client.0.smithi096.stdout:require_osd_release squid 2024-09-16T03:54:37.895 INFO:tasks.workunit.client.0.smithi096.stdout:stretch_mode_enabled false 2024-09-16T03:54:37.895 INFO:tasks.workunit.client.0.smithi096.stdout:pool 1 'test1' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 105 flags hashpspool stripe_width 0 recovery_priority -10 read_balance_score 3.00 2024-09-16T03:54:37.895 INFO:tasks.workunit.client.0.smithi096.stdout:pool 2 'test2' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 105 flags hashpspool stripe_width 0 recovery_priority -9 read_balance_score 3.00 2024-09-16T03:54:37.895 INFO:tasks.workunit.client.0.smithi096.stdout:pool 3 'test3' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 105 flags hashpspool stripe_width 0 recovery_priority -8 read_balance_score 3.00 2024-09-16T03:54:37.895 INFO:tasks.workunit.client.0.smithi096.stdout:pool 4 'test4' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 105 flags hashpspool stripe_width 0 recovery_priority -7 read_balance_score 3.00 2024-09-16T03:54:37.895 INFO:tasks.workunit.client.0.smithi096.stdout:pool 5 'test5' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 105 flags hashpspool stripe_width 0 recovery_priority -6 read_balance_score 3.00 2024-09-16T03:54:37.895 INFO:tasks.workunit.client.0.smithi096.stdout:pool 6 'test6' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 105 flags hashpspool stripe_width 0 recovery_priority -5 read_balance_score 3.00 2024-09-16T03:54:37.895 INFO:tasks.workunit.client.0.smithi096.stdout:pool 7 'test7' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 105 flags hashpspool stripe_width 0 recovery_priority -4 read_balance_score 3.00 2024-09-16T03:54:37.895 INFO:tasks.workunit.client.0.smithi096.stdout:pool 8 'test8' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 105 flags hashpspool stripe_width 0 recovery_priority -3 read_balance_score 3.00 2024-09-16T03:54:37.895 INFO:tasks.workunit.client.0.smithi096.stdout:pool 9 'test9' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 105 flags hashpspool stripe_width 0 recovery_priority -2 read_balance_score 3.00 2024-09-16T03:54:37.895 INFO:tasks.workunit.client.0.smithi096.stdout:pool 10 'test10' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 105 flags hashpspool stripe_width 0 recovery_priority -1 read_balance_score 3.00 2024-09-16T03:54:37.895 INFO:tasks.workunit.client.0.smithi096.stdout:pool 11 'test11' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 83 flags hashpspool stripe_width 0 read_balance_score 3.00 2024-09-16T03:54:37.896 INFO:tasks.workunit.client.0.smithi096.stdout:pool 12 'test12' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 105 flags hashpspool stripe_width 0 recovery_priority 1 read_balance_score 3.00 2024-09-16T03:54:37.896 INFO:tasks.workunit.client.0.smithi096.stdout:pool 13 'test13' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 105 flags hashpspool stripe_width 0 recovery_priority 2 read_balance_score 3.00 2024-09-16T03:54:37.896 INFO:tasks.workunit.client.0.smithi096.stdout:pool 14 'test14' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 105 flags hashpspool stripe_width 0 recovery_priority 3 read_balance_score 3.00 2024-09-16T03:54:37.896 INFO:tasks.workunit.client.0.smithi096.stdout:pool 15 'test15' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 105 flags hashpspool stripe_width 0 recovery_priority 4 read_balance_score 3.00 2024-09-16T03:54:37.896 INFO:tasks.workunit.client.0.smithi096.stdout:pool 16 'test16' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 105 flags hashpspool stripe_width 0 recovery_priority 5 read_balance_score 3.00 2024-09-16T03:54:37.896 INFO:tasks.workunit.client.0.smithi096.stdout:pool 17 'test17' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 105 flags hashpspool stripe_width 0 recovery_priority 6 read_balance_score 3.00 2024-09-16T03:54:37.896 INFO:tasks.workunit.client.0.smithi096.stdout:pool 18 'test18' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 105 flags hashpspool stripe_width 0 recovery_priority 7 read_balance_score 3.00 2024-09-16T03:54:37.896 INFO:tasks.workunit.client.0.smithi096.stdout:pool 19 'test19' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 105 flags hashpspool stripe_width 0 recovery_priority 8 read_balance_score 3.00 2024-09-16T03:54:37.896 INFO:tasks.workunit.client.0.smithi096.stdout:pool 20 'test20' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 105 flags hashpspool stripe_width 0 recovery_priority 9 read_balance_score 3.00 2024-09-16T03:54:37.896 INFO:tasks.workunit.client.0.smithi096.stdout:pool 21 'test21' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 105 flags hashpspool stripe_width 0 recovery_priority 10 read_balance_score 3.00 2024-09-16T03:54:37.896 INFO:tasks.workunit.client.0.smithi096.stdout:max_osd 3 2024-09-16T03:54:37.896 INFO:tasks.workunit.client.0.smithi096.stdout:osd.0 up in weight 1 up_from 107 up_thru 114 down_at 104 last_clean_interval [5,103) [v2:127.0.0.1:6800/1700300187,v1:127.0.0.1:6801/1700300187] [v2:127.0.0.1:6802/1700300187,v1:127.0.0.1:6803/1700300187] exists,up 24f0b211-47dd-4323-baae-163742e2781a 2024-09-16T03:54:37.897 INFO:tasks.workunit.client.0.smithi096.stdout:osd.1 up in weight 1 up_from 110 up_thru 114 down_at 104 last_clean_interval [10,101) [v2:127.0.0.1:6810/1809800875,v1:127.0.0.1:6811/1809800875] [v2:127.0.0.1:6812/1809800875,v1:127.0.0.1:6813/1809800875] exists,up 959188bb-efce-4225-bd41-49eee704cbb0 2024-09-16T03:54:37.897 INFO:tasks.workunit.client.0.smithi096.stdout:osd.2 up in weight 1 up_from 114 up_thru 114 down_at 104 last_clean_interval [15,101) [v2:127.0.0.1:6818/2198346019,v1:127.0.0.1:6819/2198346019] [v2:127.0.0.1:6820/2198346019,v1:127.0.0.1:6821/2198346019] exists,up 5cf36ce3-37a9-436d-b46b-f2807f5a69cc 2024-09-16T03:54:37.897 INFO:tasks.workunit.client.0.smithi096.stdout:blocklist 127.0.0.1:6801/543064227 expires 2024-09-17T03:54:19.600200+0000 2024-09-16T03:54:37.897 INFO:tasks.workunit.client.0.smithi096.stdout:blocklist 127.0.0.1:6800/543064227 expires 2024-09-17T03:54:19.600200+0000 2024-09-16T03:54:37.897 INFO:tasks.workunit.client.0.smithi096.stdout:blocklist 127.0.0.1:0/4284970476 expires 2024-09-17T03:54:19.600200+0000 2024-09-16T03:54:37.897 INFO:tasks.workunit.client.0.smithi096.stdout:blocklist 127.0.0.1:0/2390528345 expires 2024-09-17T03:54:19.600200+0000 2024-09-16T03:54:37.897 INFO:tasks.workunit.client.0.smithi096.stdout:blocklist 127.0.0.1:0/4095005216 expires 2024-09-17T03:54:19.600200+0000 2024-09-16T03:54:37.910 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:263: check_pool_priority: pos=1 2024-09-16T03:54:37.910 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: ceph osd dump 2024-09-16T03:54:37.911 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: grep '^pool' 2024-09-16T03:54:37.911 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: sed 's/.*recovery_priority //' 2024-09-16T03:54:37.911 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: awk '{ print $1 }' 2024-09-16T03:54:38.355 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T03:54:38.356 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $1 }' 2024-09-16T03:54:38.356 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo -10 -9 -8 -7 -6 -5 -4 -3 -2 -1 0 1 2 3 4 5 6 7 8 9 10 2024-09-16T03:54:38.358 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=-10 2024-09-16T03:54:38.358 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test -10 = 0 2024-09-16T03:54:38.358 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test -10 = -10 2024-09-16T03:54:38.358 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 1 + 1 2024-09-16T03:54:38.359 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=2 2024-09-16T03:54:38.359 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T03:54:38.359 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo -10 -9 -8 -7 -6 -5 -4 -3 -2 -1 0 1 2 3 4 5 6 7 8 9 10 2024-09-16T03:54:38.359 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $2 }' 2024-09-16T03:54:38.362 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=-9 2024-09-16T03:54:38.362 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test -9 = 0 2024-09-16T03:54:38.362 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test -9 = -9 2024-09-16T03:54:38.363 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 2 + 1 2024-09-16T03:54:38.363 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=3 2024-09-16T03:54:38.363 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T03:54:38.364 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo -10 -9 -8 -7 -6 -5 -4 -3 -2 -1 0 1 2 3 4 5 6 7 8 9 10 2024-09-16T03:54:38.364 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $3 }' 2024-09-16T03:54:38.366 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=-8 2024-09-16T03:54:38.366 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test -8 = 0 2024-09-16T03:54:38.366 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test -8 = -8 2024-09-16T03:54:38.366 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 3 + 1 2024-09-16T03:54:38.367 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=4 2024-09-16T03:54:38.367 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T03:54:38.367 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo -10 -9 -8 -7 -6 -5 -4 -3 -2 -1 0 1 2 3 4 5 6 7 8 9 10 2024-09-16T03:54:38.367 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $4 }' 2024-09-16T03:54:38.370 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=-7 2024-09-16T03:54:38.370 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test -7 = 0 2024-09-16T03:54:38.370 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test -7 = -7 2024-09-16T03:54:38.370 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 4 + 1 2024-09-16T03:54:38.371 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=5 2024-09-16T03:54:38.371 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T03:54:38.372 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo -10 -9 -8 -7 -6 -5 -4 -3 -2 -1 0 1 2 3 4 5 6 7 8 9 10 2024-09-16T03:54:38.372 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $5 }' 2024-09-16T03:54:38.373 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=-6 2024-09-16T03:54:38.373 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test -6 = 0 2024-09-16T03:54:38.373 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test -6 = -6 2024-09-16T03:54:38.374 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 5 + 1 2024-09-16T03:54:38.374 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=6 2024-09-16T03:54:38.374 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T03:54:38.376 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo -10 -9 -8 -7 -6 -5 -4 -3 -2 -1 0 1 2 3 4 5 6 7 8 9 10 2024-09-16T03:54:38.376 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $6 }' 2024-09-16T03:54:38.377 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=-5 2024-09-16T03:54:38.377 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test -5 = 0 2024-09-16T03:54:38.377 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test -5 = -5 2024-09-16T03:54:38.377 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 6 + 1 2024-09-16T03:54:38.379 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=7 2024-09-16T03:54:38.379 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T03:54:38.380 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo -10 -9 -8 -7 -6 -5 -4 -3 -2 -1 0 1 2 3 4 5 6 7 8 9 10 2024-09-16T03:54:38.380 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $7 }' 2024-09-16T03:54:38.381 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=-4 2024-09-16T03:54:38.381 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test -4 = 0 2024-09-16T03:54:38.381 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test -4 = -4 2024-09-16T03:54:38.382 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 7 + 1 2024-09-16T03:54:38.382 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=8 2024-09-16T03:54:38.382 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T03:54:38.383 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo -10 -9 -8 -7 -6 -5 -4 -3 -2 -1 0 1 2 3 4 5 6 7 8 9 10 2024-09-16T03:54:38.383 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $8 }' 2024-09-16T03:54:38.385 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=-3 2024-09-16T03:54:38.386 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test -3 = 0 2024-09-16T03:54:38.386 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test -3 = -3 2024-09-16T03:54:38.386 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 8 + 1 2024-09-16T03:54:38.387 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=9 2024-09-16T03:54:38.387 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T03:54:38.388 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo -10 -9 -8 -7 -6 -5 -4 -3 -2 -1 0 1 2 3 4 5 6 7 8 9 10 2024-09-16T03:54:38.389 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $9 }' 2024-09-16T03:54:38.390 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=-2 2024-09-16T03:54:38.390 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test -2 = 0 2024-09-16T03:54:38.390 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test -2 = -2 2024-09-16T03:54:38.390 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 9 + 1 2024-09-16T03:54:38.390 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=10 2024-09-16T03:54:38.390 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T03:54:38.391 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo -10 -9 -8 -7 -6 -5 -4 -3 -2 -1 0 1 2 3 4 5 6 7 8 9 10 2024-09-16T03:54:38.391 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $10 }' 2024-09-16T03:54:38.394 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=-1 2024-09-16T03:54:38.394 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test -1 = 0 2024-09-16T03:54:38.394 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test -1 = -1 2024-09-16T03:54:38.394 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 10 + 1 2024-09-16T03:54:38.394 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=11 2024-09-16T03:54:38.394 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T03:54:38.395 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo -10 -9 -8 -7 -6 -5 -4 -3 -2 -1 0 1 2 3 4 5 6 7 8 9 10 2024-09-16T03:54:38.395 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $11 }' 2024-09-16T03:54:38.396 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=0 2024-09-16T03:54:38.397 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test 0 = 0 2024-09-16T03:54:38.397 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:270: check_pool_priority: result=pool 2024-09-16T03:54:38.397 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test pool = pool 2024-09-16T03:54:38.397 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 11 + 1 2024-09-16T03:54:38.397 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=12 2024-09-16T03:54:38.398 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T03:54:38.398 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo -10 -9 -8 -7 -6 -5 -4 -3 -2 -1 0 1 2 3 4 5 6 7 8 9 10 2024-09-16T03:54:38.398 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $12 }' 2024-09-16T03:54:38.400 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=1 2024-09-16T03:54:38.400 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test 1 = 0 2024-09-16T03:54:38.400 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test 1 = 1 2024-09-16T03:54:38.400 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 12 + 1 2024-09-16T03:54:38.401 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=13 2024-09-16T03:54:38.401 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T03:54:38.401 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo -10 -9 -8 -7 -6 -5 -4 -3 -2 -1 0 1 2 3 4 5 6 7 8 9 10 2024-09-16T03:54:38.402 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $13 }' 2024-09-16T03:54:38.404 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=2 2024-09-16T03:54:38.404 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test 2 = 0 2024-09-16T03:54:38.404 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test 2 = 2 2024-09-16T03:54:38.404 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 13 + 1 2024-09-16T03:54:38.405 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=14 2024-09-16T03:54:38.405 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T03:54:38.405 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo -10 -9 -8 -7 -6 -5 -4 -3 -2 -1 0 1 2 3 4 5 6 7 8 9 10 2024-09-16T03:54:38.405 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $14 }' 2024-09-16T03:54:38.407 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=3 2024-09-16T03:54:38.407 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test 3 = 0 2024-09-16T03:54:38.407 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test 3 = 3 2024-09-16T03:54:38.407 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 14 + 1 2024-09-16T03:54:38.408 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=15 2024-09-16T03:54:38.408 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T03:54:38.408 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo -10 -9 -8 -7 -6 -5 -4 -3 -2 -1 0 1 2 3 4 5 6 7 8 9 10 2024-09-16T03:54:38.409 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $15 }' 2024-09-16T03:54:38.410 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=4 2024-09-16T03:54:38.410 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test 4 = 0 2024-09-16T03:54:38.410 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test 4 = 4 2024-09-16T03:54:38.411 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 15 + 1 2024-09-16T03:54:38.411 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=16 2024-09-16T03:54:38.412 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T03:54:38.412 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo -10 -9 -8 -7 -6 -5 -4 -3 -2 -1 0 1 2 3 4 5 6 7 8 9 10 2024-09-16T03:54:38.412 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $16 }' 2024-09-16T03:54:38.415 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=5 2024-09-16T03:54:38.415 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test 5 = 0 2024-09-16T03:54:38.416 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test 5 = 5 2024-09-16T03:54:38.416 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 16 + 1 2024-09-16T03:54:38.416 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=17 2024-09-16T03:54:38.416 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T03:54:38.416 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo -10 -9 -8 -7 -6 -5 -4 -3 -2 -1 0 1 2 3 4 5 6 7 8 9 10 2024-09-16T03:54:38.416 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $17 }' 2024-09-16T03:54:38.417 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=6 2024-09-16T03:54:38.417 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test 6 = 0 2024-09-16T03:54:38.417 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test 6 = 6 2024-09-16T03:54:38.418 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 17 + 1 2024-09-16T03:54:38.421 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=18 2024-09-16T03:54:38.421 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T03:54:38.421 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo -10 -9 -8 -7 -6 -5 -4 -3 -2 -1 0 1 2 3 4 5 6 7 8 9 10 2024-09-16T03:54:38.421 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $18 }' 2024-09-16T03:54:38.422 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=7 2024-09-16T03:54:38.422 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test 7 = 0 2024-09-16T03:54:38.422 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test 7 = 7 2024-09-16T03:54:38.422 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 18 + 1 2024-09-16T03:54:38.422 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=19 2024-09-16T03:54:38.423 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T03:54:38.423 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo -10 -9 -8 -7 -6 -5 -4 -3 -2 -1 0 1 2 3 4 5 6 7 8 9 10 2024-09-16T03:54:38.423 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $19 }' 2024-09-16T03:54:38.424 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=8 2024-09-16T03:54:38.425 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test 8 = 0 2024-09-16T03:54:38.425 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test 8 = 8 2024-09-16T03:54:38.425 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 19 + 1 2024-09-16T03:54:38.426 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=20 2024-09-16T03:54:38.426 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T03:54:38.426 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo -10 -9 -8 -7 -6 -5 -4 -3 -2 -1 0 1 2 3 4 5 6 7 8 9 10 2024-09-16T03:54:38.426 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $20 }' 2024-09-16T03:54:38.428 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=9 2024-09-16T03:54:38.428 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test 9 = 0 2024-09-16T03:54:38.430 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test 9 = 9 2024-09-16T03:54:38.430 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 20 + 1 2024-09-16T03:54:38.430 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=21 2024-09-16T03:54:38.431 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T03:54:38.431 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo -10 -9 -8 -7 -6 -5 -4 -3 -2 -1 0 1 2 3 4 5 6 7 8 9 10 2024-09-16T03:54:38.431 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $21 }' 2024-09-16T03:54:38.431 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=10 2024-09-16T03:54:38.431 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test 10 = 0 2024-09-16T03:54:38.432 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test 10 = 10 2024-09-16T03:54:38.432 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 21 + 1 2024-09-16T03:54:38.433 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=22 2024-09-16T03:54:38.434 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:33: run: teardown td/osd-pool-create 2024-09-16T03:54:38.434 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-pool-create 2024-09-16T03:54:38.434 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:54:38.434 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-pool-create KILL 2024-09-16T03:54:38.434 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:54:38.434 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:54:38.434 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:54:38.434 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:54:38.434 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:54:38.542 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:54:38.542 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:54:38.542 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:54:38.543 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:54:38.544 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:54:38.544 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:54:38.544 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:54:38.544 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:54:38.545 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:54:38.545 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:54:38.545 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:54:38.546 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:54:38.547 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:54:38.547 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-pool-create 2024-09-16T03:54:38.571 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:54:38.571 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:54:38.571 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:54:38.571 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.128966 2024-09-16T03:54:38.571 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:54:38.571 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:54:38.572 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:30: run: for func in $funcs 2024-09-16T03:54:38.572 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:31: run: setup td/osd-pool-create 2024-09-16T03:54:38.572 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-pool-create 2024-09-16T03:54:38.572 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-pool-create 2024-09-16T03:54:38.572 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-pool-create 2024-09-16T03:54:38.572 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:54:38.572 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-pool-create KILL 2024-09-16T03:54:38.572 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:54:38.572 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:54:38.572 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:54:38.572 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:54:38.572 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:54:38.573 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:54:38.573 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:54:38.574 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:54:38.574 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:54:38.577 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:54:38.577 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:54:38.577 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:54:38.577 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:54:38.577 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:54:38.577 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:54:38.577 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:54:38.578 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:54:38.579 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:54:38.579 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-pool-create 2024-09-16T03:54:38.580 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:54:38.580 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:54:38.580 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:54:38.580 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.128966 2024-09-16T03:54:38.580 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:54:38.581 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:54:38.581 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-pool-create 2024-09-16T03:54:38.582 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T03:54:38.582 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:54:38.582 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:54:38.582 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.128966 2024-09-16T03:54:38.585 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T03:54:38.585 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2024-09-16T03:54:38.585 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T03:54:38.585 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-pool-create 1' TERM HUP INT 2024-09-16T03:54:38.585 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:32: run: TEST_pool_both_prio_no_neg td/osd-pool-create 2024-09-16T03:54:38.586 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:293: TEST_pool_both_prio_no_neg: local dir=td/osd-pool-create 2024-09-16T03:54:38.586 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:294: TEST_pool_both_prio_no_neg: check_pool_priority td/osd-pool-create 20 '2 - 4' '-4 -2 0 0 1 1 2 2 3 3 4 5 5 6 6 7 7 8 8 9 10' 2024-09-16T03:54:38.586 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:215: check_pool_priority: local dir=td/osd-pool-create 2024-09-16T03:54:38.586 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:216: check_pool_priority: shift 2024-09-16T03:54:38.586 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:217: check_pool_priority: local pools=20 2024-09-16T03:54:38.586 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:218: check_pool_priority: shift 2024-09-16T03:54:38.586 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:219: check_pool_priority: local 'spread=2 - 4' 2024-09-16T03:54:38.586 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:220: check_pool_priority: shift 2024-09-16T03:54:38.586 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:221: check_pool_priority: local 'results=-4 -2 0 0 1 1 2 2 3 3 4 5 5 6 6 7 7 8 8 9 10' 2024-09-16T03:54:38.586 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:223: check_pool_priority: setup td/osd-pool-create 2024-09-16T03:54:38.586 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-pool-create 2024-09-16T03:54:38.586 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-pool-create 2024-09-16T03:54:38.586 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-pool-create 2024-09-16T03:54:38.586 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:54:38.586 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-pool-create KILL 2024-09-16T03:54:38.587 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:54:38.587 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:54:38.587 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:54:38.587 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:54:38.587 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:54:38.589 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:54:38.590 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:54:38.590 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:54:38.590 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:54:38.590 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:54:38.590 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:54:38.590 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:54:38.590 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:54:38.590 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:54:38.590 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:54:38.590 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:54:38.590 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:54:38.591 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:54:38.591 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-pool-create 2024-09-16T03:54:38.592 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:54:38.592 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:54:38.592 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:54:38.592 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.128966 2024-09-16T03:54:38.592 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:54:38.592 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:54:38.592 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-pool-create 2024-09-16T03:54:38.593 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T03:54:38.593 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:54:38.593 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:54:38.593 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.128966 2024-09-16T03:54:38.595 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T03:54:38.595 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2024-09-16T03:54:38.596 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T03:54:38.596 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-pool-create 1' TERM HUP INT 2024-09-16T03:54:38.596 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:225: check_pool_priority: EXTRA_OPTS=--debug_allow_any_pool_priority=true 2024-09-16T03:54:38.596 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:226: check_pool_priority: export EXTRA_OPTS 2024-09-16T03:54:38.596 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:227: check_pool_priority: run_mon td/osd-pool-create a 2024-09-16T03:54:38.596 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-pool-create 2024-09-16T03:54:38.596 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T03:54:38.596 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T03:54:38.597 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T03:54:38.597 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-pool-create/a 2024-09-16T03:54:38.598 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-pool-create/a --run-dir=td/osd-pool-create 2024-09-16T03:54:39.062 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T03:54:39.062 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:54:39.062 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:54:39.063 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:54:39.063 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:54:39.063 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:54:39.063 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T03:54:39.064 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug_allow_any_pool_priority=true --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-pool-create/a '--log-file=td/osd-pool-create/$name.log' '--admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' --mon-cluster-log-file=td/osd-pool-create/log --run-dir=td/osd-pool-create '--pid-file=td/osd-pool-create/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-09-16T03:54:39.282 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T03:54:39.283 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T03:54:39.283 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:54:39.284 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:54:39.284 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T03:54:39.285 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T03:54:39.285 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:54:39.285 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:54:39.285 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:54:39.285 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:54:39.285 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:54:39.285 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:54:39.285 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.128966/ceph-mon.a.asok 2024-09-16T03:54:39.286 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:54:39.286 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.128966/ceph-mon.a.asok config get fsid 2024-09-16T03:54:39.403 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T03:54:39.403 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:54:39.403 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:54:39.403 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T03:54:39.404 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T03:54:39.405 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:54:39.405 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:54:39.405 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:54:39.405 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:54:39.405 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:54:39.405 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:54:39.405 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.128966/ceph-mon.a.asok 2024-09-16T03:54:39.405 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:54:39.405 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.128966/ceph-mon.a.asok config get mon_host 2024-09-16T03:54:39.506 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:228: check_pool_priority: run_mgr td/osd-pool-create x 2024-09-16T03:54:39.506 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-pool-create 2024-09-16T03:54:39.506 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2024-09-16T03:54:39.506 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2024-09-16T03:54:39.506 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2024-09-16T03:54:39.506 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-pool-create/x 2024-09-16T03:54:39.507 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2024-09-16T03:54:40.423 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2024-09-16T03:54:40.424 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:54:40.424 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:54:40.424 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:54:40.424 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:54:40.425 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:54:40.425 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T03:54:40.425 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T03:54:40.426 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --debug_allow_any_pool_priority=true --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-pool-create/x '--log-file=td/osd-pool-create/$name.log' '--admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' --run-dir=td/osd-pool-create '--pid-file=td/osd-pool-create/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T03:54:40.458 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:229: check_pool_priority: run_osd td/osd-pool-create 0 2024-09-16T03:54:40.459 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-pool-create 2024-09-16T03:54:40.459 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T03:54:40.459 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2024-09-16T03:54:40.459 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T03:54:40.459 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-pool-create/0 2024-09-16T03:54:40.459 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=38a92d84-8703-45d8-b5ef-7d976430f112 --auth-supported=none --mon-host=127.0.0.1:7105 ' 2024-09-16T03:54:40.459 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T03:54:40.459 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T03:54:40.459 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T03:54:40.459 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-pool-create/0' 2024-09-16T03:54:40.460 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-pool-create/0/journal' 2024-09-16T03:54:40.460 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T03:54:40.460 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+=--debug_allow_any_pool_priority=true 2024-09-16T03:54:40.460 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-pool-create' 2024-09-16T03:54:40.460 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T03:54:40.460 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:54:40.460 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:54:40.460 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:54:40.460 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:54:40.460 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:54:40.460 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T03:54:40.461 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T03:54:40.461 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T03:54:40.461 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T03:54:40.461 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T03:54:40.461 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-pool-create/$name.log' 2024-09-16T03:54:40.461 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-pool-create/$name.pid' 2024-09-16T03:54:40.461 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T03:54:40.461 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T03:54:40.461 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T03:54:40.461 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T03:54:40.461 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T03:54:40.461 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T03:54:40.462 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-pool-create/0 2024-09-16T03:54:40.462 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T03:54:40.462 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=84ca08be-2c32-4320-8e89-c9a110a57f4c 2024-09-16T03:54:40.462 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 84ca08be-2c32-4320-8e89-c9a110a57f4c' 2024-09-16T03:54:40.463 INFO:tasks.workunit.client.0.smithi096.stdout:add osd0 84ca08be-2c32-4320-8e89-c9a110a57f4c 2024-09-16T03:54:40.463 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T03:54:40.475 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAArOdmROpRHBAAiFpPfz62eETYzTaNj7//MA== 2024-09-16T03:54:40.476 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAArOdmROpRHBAAiFpPfz62eETYzTaNj7//MA=="}' 2024-09-16T03:54:40.476 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 84ca08be-2c32-4320-8e89-c9a110a57f4c -i td/osd-pool-create/0/new.json 2024-09-16T03:54:40.794 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T03:54:40.810 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-pool-create/0/new.json 2024-09-16T03:54:40.811 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=38a92d84-8703-45d8-b5ef-7d976430f112 --auth-supported=none --mon-host=127.0.0.1:7105 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-pool-create/0 --osd-journal=td/osd-pool-create/0/journal --chdir=--debug_allow_any_pool_priority=true --run-dir=td/osd-pool-create '--admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-pool-create/$name.log' '--pid-file=td/osd-pool-create/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAArOdmROpRHBAAiFpPfz62eETYzTaNj7//MA== --osd-uuid 84ca08be-2c32-4320-8e89-c9a110a57f4c 2024-09-16T03:54:40.843 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:54:40.839+0000 7ff79a7de7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:54:40.845 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:54:40.839+0000 7ff79a7de7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:54:40.846 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:54:40.843+0000 7ff79a7de7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:54:40.847 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:54:40.843+0000 7ff79a7de7c0 -1 global_init_chdir: failed to chdir to directory: '--debug_allow_any_pool_priority=true': (2) No such file or directory 2024-09-16T03:54:40.847 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:54:40.843+0000 7ff79a7de7c0 -1 bdev(0x5572a13b1c00 td/osd-pool-create/0/block) open stat got: (1) Operation not permitted 2024-09-16T03:54:40.847 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:54:40.843+0000 7ff79a7de7c0 -1 bluestore(td/osd-pool-create/0) _read_fsid unparsable uuid 2024-09-16T03:54:47.134 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-pool-create/0/keyring 2024-09-16T03:54:47.135 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T03:54:47.136 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2024-09-16T03:54:47.136 INFO:tasks.workunit.client.0.smithi096.stdout:adding osd0 key to auth repository 2024-09-16T03:54:47.136 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-pool-create/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T03:54:47.711 INFO:tasks.workunit.client.0.smithi096.stdout:start osd.0 2024-09-16T03:54:47.711 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2024-09-16T03:54:47.711 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T03:54:47.711 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=38a92d84-8703-45d8-b5ef-7d976430f112 --auth-supported=none --mon-host=127.0.0.1:7105 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-pool-create/0 --osd-journal=td/osd-pool-create/0/journal --chdir=--debug_allow_any_pool_priority=true --run-dir=td/osd-pool-create '--admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-pool-create/$name.log' '--pid-file=td/osd-pool-create/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T03:54:47.712 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T03:54:47.712 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T03:54:47.743 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:54:47.739+0000 7f8098aa97c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:54:47.778 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:54:47.775+0000 7f8098aa97c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:54:47.779 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:54:47.775+0000 7f8098aa97c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:54:47.779 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:54:47.775+0000 7f8098aa97c0 -1 global_init_chdir: failed to chdir to directory: '--debug_allow_any_pool_priority=true': (2) No such file or directory 2024-09-16T03:54:48.113 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2024-09-16T03:54:48.113 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:54:48.113 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2024-09-16T03:54:48.113 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:54:48.113 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:54:48.113 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:54:48.114 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T03:54:48.114 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:54:48.114 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:54:48.114 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:54:48.564 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:54:49.068 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:54:49.063+0000 7f8098aa97c0 -1 Falling back to public interface 2024-09-16T03:54:49.070 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:54:49.067+0000 7f8098aa97c0 -1 global_init_chdir: failed to chdir to directory: '--debug_allow_any_pool_priority=true': (2) No such file or directory 2024-09-16T03:54:49.563 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:54:49.563 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:54:49.563 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T03:54:49.564 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T03:54:49.564 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:54:49.564 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:54:49.976 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:54:50.977 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:54:50.977 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:54:50.977 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T03:54:50.977 INFO:tasks.workunit.client.0.smithi096.stdout:2 2024-09-16T03:54:50.978 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:54:50.978 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:54:51.400 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:54:51.954 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:54:51.951+0000 7f8098aa97c0 -1 osd.0 0 log_to_monitors true 2024-09-16T03:54:52.402 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:54:52.402 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:54:52.402 INFO:tasks.workunit.client.0.smithi096.stdout:3 2024-09-16T03:54:52.403 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T03:54:52.403 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:54:52.403 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:54:52.821 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:54:53.823 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:54:53.823 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:54:53.823 INFO:tasks.workunit.client.0.smithi096.stdout:4 2024-09-16T03:54:53.824 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T03:54:53.824 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:54:53.824 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:54:54.268 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:54:55.270 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:54:55.270 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:54:55.270 INFO:tasks.workunit.client.0.smithi096.stdout:5 2024-09-16T03:54:55.271 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T03:54:55.271 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:54:55.271 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:54:55.832 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:54:56.834 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:54:56.834 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:54:56.834 INFO:tasks.workunit.client.0.smithi096.stdout:6 2024-09-16T03:54:56.835 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T03:54:56.835 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:54:56.835 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:54:57.293 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:54:58.295 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:54:58.295 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:54:58.295 INFO:tasks.workunit.client.0.smithi096.stdout:7 2024-09-16T03:54:58.296 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T03:54:58.296 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:54:58.296 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:54:58.723 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:54:59.724 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:54:59.724 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:54:59.725 INFO:tasks.workunit.client.0.smithi096.stdout:8 2024-09-16T03:54:59.725 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T03:54:59.725 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:54:59.725 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:55:00.177 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:55:01.178 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:55:01.179 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:55:01.179 INFO:tasks.workunit.client.0.smithi096.stdout:9 2024-09-16T03:55:01.179 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T03:55:01.180 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:55:01.180 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:55:01.629 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:55:02.632 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:55:02.632 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:55:02.632 INFO:tasks.workunit.client.0.smithi096.stdout:10 2024-09-16T03:55:02.633 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T03:55:02.633 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:55:02.633 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:55:03.118 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:55:04.121 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:55:04.121 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:55:04.121 INFO:tasks.workunit.client.0.smithi096.stdout:11 2024-09-16T03:55:04.121 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T03:55:04.122 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:55:04.122 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:55:04.558 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:55:05.559 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:55:05.560 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:55:05.560 INFO:tasks.workunit.client.0.smithi096.stdout:12 2024-09-16T03:55:05.560 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T03:55:05.560 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:55:05.560 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:55:06.307 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:55:07.309 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:55:07.309 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:55:07.309 INFO:tasks.workunit.client.0.smithi096.stdout:13 2024-09-16T03:55:07.310 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T03:55:07.310 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:55:07.310 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:55:08.053 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:55:09.053 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:55:09.053 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:55:09.053 INFO:tasks.workunit.client.0.smithi096.stdout:14 2024-09-16T03:55:09.054 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T03:55:09.054 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:55:09.054 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:55:09.557 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:55:10.559 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:55:10.559 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:55:10.559 INFO:tasks.workunit.client.0.smithi096.stdout:15 2024-09-16T03:55:10.560 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T03:55:10.560 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:55:10.560 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:55:11.357 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:55:12.359 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:55:12.359 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:55:12.359 INFO:tasks.workunit.client.0.smithi096.stdout:16 2024-09-16T03:55:12.360 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T03:55:12.360 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:55:12.360 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:55:13.194 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:55:14.195 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:55:14.195 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:55:14.196 INFO:tasks.workunit.client.0.smithi096.stdout:17 2024-09-16T03:55:14.196 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T03:55:14.196 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:55:14.196 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:55:14.917 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:55:15.919 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:55:15.919 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:55:15.919 INFO:tasks.workunit.client.0.smithi096.stdout:18 2024-09-16T03:55:15.920 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 18 2024-09-16T03:55:15.920 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:55:15.920 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:55:16.764 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:55:17.765 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:55:17.765 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:55:17.765 INFO:tasks.workunit.client.0.smithi096.stdout:19 2024-09-16T03:55:17.766 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 19 2024-09-16T03:55:17.766 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:55:17.766 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:55:18.225 INFO:tasks.workunit.client.0.smithi096.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/3678242054,v1:127.0.0.1:6803/3678242054] [v2:127.0.0.1:6804/3678242054,v1:127.0.0.1:6805/3678242054] exists,up 84ca08be-2c32-4320-8e89-c9a110a57f4c 2024-09-16T03:55:18.228 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:55:18.228 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:55:18.228 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:55:18.228 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:230: check_pool_priority: run_osd td/osd-pool-create 1 2024-09-16T03:55:18.228 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-pool-create 2024-09-16T03:55:18.228 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T03:55:18.228 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2024-09-16T03:55:18.229 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T03:55:18.229 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-pool-create/1 2024-09-16T03:55:18.229 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=38a92d84-8703-45d8-b5ef-7d976430f112 --auth-supported=none --mon-host=127.0.0.1:7105 ' 2024-09-16T03:55:18.229 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T03:55:18.229 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T03:55:18.229 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T03:55:18.229 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-pool-create/1' 2024-09-16T03:55:18.229 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-pool-create/1/journal' 2024-09-16T03:55:18.229 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T03:55:18.229 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+=--debug_allow_any_pool_priority=true 2024-09-16T03:55:18.230 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-pool-create' 2024-09-16T03:55:18.230 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T03:55:18.230 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:55:18.230 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:55:18.230 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:55:18.230 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:55:18.230 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:55:18.230 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T03:55:18.230 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T03:55:18.230 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T03:55:18.231 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T03:55:18.231 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T03:55:18.231 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-pool-create/$name.log' 2024-09-16T03:55:18.231 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-pool-create/$name.pid' 2024-09-16T03:55:18.231 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T03:55:18.231 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T03:55:18.231 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T03:55:18.231 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T03:55:18.232 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T03:55:18.232 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T03:55:18.232 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-pool-create/1 2024-09-16T03:55:18.232 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T03:55:18.232 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=d71e1585-29de-45de-a1ec-d0ec60eee17c 2024-09-16T03:55:18.233 INFO:tasks.workunit.client.0.smithi096.stdout:add osd1 d71e1585-29de-45de-a1ec-d0ec60eee17c 2024-09-16T03:55:18.233 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 d71e1585-29de-45de-a1ec-d0ec60eee17c' 2024-09-16T03:55:18.233 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T03:55:18.250 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAmrOdmuUDfDhAA/fQU7JyahoahIQ9eZo0NSQ== 2024-09-16T03:55:18.250 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAmrOdmuUDfDhAA/fQU7JyahoahIQ9eZo0NSQ=="}' 2024-09-16T03:55:18.251 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new d71e1585-29de-45de-a1ec-d0ec60eee17c -i td/osd-pool-create/1/new.json 2024-09-16T03:55:18.753 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T03:55:18.769 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-pool-create/1/new.json 2024-09-16T03:55:18.769 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=38a92d84-8703-45d8-b5ef-7d976430f112 --auth-supported=none --mon-host=127.0.0.1:7105 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-pool-create/1 --osd-journal=td/osd-pool-create/1/journal --chdir=--debug_allow_any_pool_priority=true --run-dir=td/osd-pool-create '--admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-pool-create/$name.log' '--pid-file=td/osd-pool-create/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAmrOdmuUDfDhAA/fQU7JyahoahIQ9eZo0NSQ== --osd-uuid d71e1585-29de-45de-a1ec-d0ec60eee17c 2024-09-16T03:55:18.801 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:55:18.794+0000 7f03e085b7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:55:18.803 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:55:18.798+0000 7f03e085b7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:55:18.805 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:55:18.798+0000 7f03e085b7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:55:18.805 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:55:18.798+0000 7f03e085b7c0 -1 global_init_chdir: failed to chdir to directory: '--debug_allow_any_pool_priority=true': (2) No such file or directory 2024-09-16T03:55:18.805 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:55:18.798+0000 7f03e085b7c0 -1 bdev(0x55f78f4c1c00 td/osd-pool-create/1/block) open stat got: (1) Operation not permitted 2024-09-16T03:55:18.805 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:55:18.798+0000 7f03e085b7c0 -1 bluestore(td/osd-pool-create/1) _read_fsid unparsable uuid 2024-09-16T03:55:25.294 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-pool-create/1/keyring 2024-09-16T03:55:25.295 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T03:55:25.296 INFO:tasks.workunit.client.0.smithi096.stdout:adding osd1 key to auth repository 2024-09-16T03:55:25.296 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2024-09-16T03:55:25.297 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-pool-create/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T03:55:25.879 INFO:tasks.workunit.client.0.smithi096.stdout:start osd.1 2024-09-16T03:55:25.880 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2024-09-16T03:55:25.880 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=38a92d84-8703-45d8-b5ef-7d976430f112 --auth-supported=none --mon-host=127.0.0.1:7105 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-pool-create/1 --osd-journal=td/osd-pool-create/1/journal --chdir=--debug_allow_any_pool_priority=true --run-dir=td/osd-pool-create '--admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-pool-create/$name.log' '--pid-file=td/osd-pool-create/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T03:55:25.880 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T03:55:25.880 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T03:55:25.880 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T03:55:25.906 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:55:25.902+0000 7f36fecf97c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:55:25.941 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:55:25.934+0000 7f36fecf97c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:55:25.943 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:55:25.938+0000 7f36fecf97c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:55:25.943 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:55:25.938+0000 7f36fecf97c0 -1 global_init_chdir: failed to chdir to directory: '--debug_allow_any_pool_priority=true': (2) No such file or directory 2024-09-16T03:55:26.353 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2024-09-16T03:55:26.353 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:55:26.353 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2024-09-16T03:55:26.353 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:55:26.353 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:55:26.353 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:55:26.354 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:55:26.354 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T03:55:26.354 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:55:26.354 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:55:26.800 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:55:26.964 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:55:26.958+0000 7f36fecf97c0 -1 Falling back to public interface 2024-09-16T03:55:26.967 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:55:26.962+0000 7f36fecf97c0 -1 global_init_chdir: failed to chdir to directory: '--debug_allow_any_pool_priority=true': (2) No such file or directory 2024-09-16T03:55:27.802 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:55:27.802 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:55:27.802 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T03:55:27.803 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T03:55:27.803 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:55:27.803 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:55:28.212 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:55:29.213 INFO:tasks.workunit.client.0.smithi096.stdout:2 2024-09-16T03:55:29.214 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:55:29.214 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:55:29.214 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T03:55:29.214 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:55:29.214 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:55:29.717 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:55:30.047 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:55:30.042+0000 7f36fecf97c0 -1 osd.1 0 log_to_monitors true 2024-09-16T03:55:30.719 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:55:30.719 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:55:30.719 INFO:tasks.workunit.client.0.smithi096.stdout:3 2024-09-16T03:55:30.720 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T03:55:30.720 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:55:30.720 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:55:31.222 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:55:32.223 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:55:32.223 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:55:32.223 INFO:tasks.workunit.client.0.smithi096.stdout:4 2024-09-16T03:55:32.224 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T03:55:32.224 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:55:32.224 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:55:32.715 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:55:33.717 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:55:33.717 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:55:33.717 INFO:tasks.workunit.client.0.smithi096.stdout:5 2024-09-16T03:55:33.718 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T03:55:33.718 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:55:33.718 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:55:34.261 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:55:35.263 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:55:35.263 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:55:35.264 INFO:tasks.workunit.client.0.smithi096.stdout:6 2024-09-16T03:55:35.264 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T03:55:35.264 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:55:35.264 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:55:35.801 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:55:36.802 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:55:36.802 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:55:36.802 INFO:tasks.workunit.client.0.smithi096.stdout:7 2024-09-16T03:55:36.803 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T03:55:36.803 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:55:36.803 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:55:37.421 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:55:38.423 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:55:38.423 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:55:38.424 INFO:tasks.workunit.client.0.smithi096.stdout:8 2024-09-16T03:55:38.424 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T03:55:38.424 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:55:38.424 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:55:39.000 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:55:40.001 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:55:40.001 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:55:40.001 INFO:tasks.workunit.client.0.smithi096.stdout:9 2024-09-16T03:55:40.002 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T03:55:40.002 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:55:40.002 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:55:40.426 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:55:41.427 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:55:41.427 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:55:41.428 INFO:tasks.workunit.client.0.smithi096.stdout:10 2024-09-16T03:55:41.428 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T03:55:41.428 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:55:41.428 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:55:41.989 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:55:42.991 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:55:42.991 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:55:42.991 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T03:55:42.992 INFO:tasks.workunit.client.0.smithi096.stdout:11 2024-09-16T03:55:42.992 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:55:42.992 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:55:43.434 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:55:44.435 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:55:44.435 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:55:44.436 INFO:tasks.workunit.client.0.smithi096.stdout:12 2024-09-16T03:55:44.437 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T03:55:44.437 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:55:44.437 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:55:44.865 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:55:45.867 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:55:45.867 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:55:45.867 INFO:tasks.workunit.client.0.smithi096.stdout:13 2024-09-16T03:55:45.868 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T03:55:45.868 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:55:45.868 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:55:46.485 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:55:47.487 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:55:47.487 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:55:47.487 INFO:tasks.workunit.client.0.smithi096.stdout:14 2024-09-16T03:55:47.488 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T03:55:47.488 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:55:47.488 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:55:48.368 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:55:49.369 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:55:49.370 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:55:49.370 INFO:tasks.workunit.client.0.smithi096.stdout:15 2024-09-16T03:55:49.370 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T03:55:49.370 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:55:49.371 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:55:50.761 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:55:51.763 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:55:51.763 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:55:51.763 INFO:tasks.workunit.client.0.smithi096.stdout:16 2024-09-16T03:55:51.764 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T03:55:51.764 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:55:51.764 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:55:52.580 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:55:53.582 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:55:53.582 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:55:53.582 INFO:tasks.workunit.client.0.smithi096.stdout:17 2024-09-16T03:55:53.583 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T03:55:53.583 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:55:53.583 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:55:54.808 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:55:55.812 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:55:55.813 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:55:55.813 INFO:tasks.workunit.client.0.smithi096.stdout:18 2024-09-16T03:55:55.813 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 18 2024-09-16T03:55:55.813 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:55:55.814 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:55:56.312 INFO:tasks.workunit.client.0.smithi096.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/458625578,v1:127.0.0.1:6811/458625578] [v2:127.0.0.1:6812/458625578,v1:127.0.0.1:6813/458625578] exists,up d71e1585-29de-45de-a1ec-d0ec60eee17c 2024-09-16T03:55:56.316 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:55:56.316 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:55:56.316 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:55:56.316 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:231: check_pool_priority: run_osd td/osd-pool-create 2 2024-09-16T03:55:56.316 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-pool-create 2024-09-16T03:55:56.316 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T03:55:56.316 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2024-09-16T03:55:56.316 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T03:55:56.316 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-pool-create/2 2024-09-16T03:55:56.317 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=38a92d84-8703-45d8-b5ef-7d976430f112 --auth-supported=none --mon-host=127.0.0.1:7105 ' 2024-09-16T03:55:56.317 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T03:55:56.317 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T03:55:56.317 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T03:55:56.317 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-pool-create/2' 2024-09-16T03:55:56.317 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-pool-create/2/journal' 2024-09-16T03:55:56.317 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T03:55:56.317 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+=--debug_allow_any_pool_priority=true 2024-09-16T03:55:56.317 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-pool-create' 2024-09-16T03:55:56.317 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T03:55:56.317 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:55:56.317 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:55:56.318 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:55:56.318 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:55:56.318 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:55:56.318 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T03:55:56.318 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T03:55:56.318 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T03:55:56.318 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T03:55:56.318 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T03:55:56.318 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-pool-create/$name.log' 2024-09-16T03:55:56.319 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-pool-create/$name.pid' 2024-09-16T03:55:56.319 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T03:55:56.319 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T03:55:56.319 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T03:55:56.320 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T03:55:56.320 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T03:55:56.320 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T03:55:56.320 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-pool-create/2 2024-09-16T03:55:56.320 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T03:55:56.321 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=017c2729-b36d-4fde-b243-c8f7fb2dbbf9 2024-09-16T03:55:56.321 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 017c2729-b36d-4fde-b243-c8f7fb2dbbf9' 2024-09-16T03:55:56.321 INFO:tasks.workunit.client.0.smithi096.stdout:add osd2 017c2729-b36d-4fde-b243-c8f7fb2dbbf9 2024-09-16T03:55:56.321 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T03:55:56.338 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBMrOdmWjgiFBAAkv2yzX1+ywx8hqNWGHv01w== 2024-09-16T03:55:56.339 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBMrOdmWjgiFBAAkv2yzX1+ywx8hqNWGHv01w=="}' 2024-09-16T03:55:56.339 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 017c2729-b36d-4fde-b243-c8f7fb2dbbf9 -i td/osd-pool-create/2/new.json 2024-09-16T03:55:56.815 INFO:tasks.workunit.client.0.smithi096.stdout:2 2024-09-16T03:55:56.831 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-pool-create/2/new.json 2024-09-16T03:55:56.832 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=38a92d84-8703-45d8-b5ef-7d976430f112 --auth-supported=none --mon-host=127.0.0.1:7105 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-pool-create/2 --osd-journal=td/osd-pool-create/2/journal --chdir=--debug_allow_any_pool_priority=true --run-dir=td/osd-pool-create '--admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-pool-create/$name.log' '--pid-file=td/osd-pool-create/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBMrOdmWjgiFBAAkv2yzX1+ywx8hqNWGHv01w== --osd-uuid 017c2729-b36d-4fde-b243-c8f7fb2dbbf9 2024-09-16T03:55:56.865 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:55:56.862+0000 7faf3a35a7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:55:56.878 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:55:56.878+0000 7faf3a35a7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:55:56.880 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:55:56.878+0000 7faf3a35a7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:55:56.880 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:55:56.878+0000 7faf3a35a7c0 -1 global_init_chdir: failed to chdir to directory: '--debug_allow_any_pool_priority=true': (2) No such file or directory 2024-09-16T03:55:56.880 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:55:56.878+0000 7faf3a35a7c0 -1 bdev(0x5645cd78fc00 td/osd-pool-create/2/block) open stat got: (1) Operation not permitted 2024-09-16T03:55:56.880 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:55:56.878+0000 7faf3a35a7c0 -1 bluestore(td/osd-pool-create/2) _read_fsid unparsable uuid 2024-09-16T03:56:03.225 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-pool-create/2/keyring 2024-09-16T03:56:03.226 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T03:56:03.226 INFO:tasks.workunit.client.0.smithi096.stdout:adding osd2 key to auth repository 2024-09-16T03:56:03.227 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2024-09-16T03:56:03.227 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-pool-create/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T03:56:03.803 INFO:tasks.workunit.client.0.smithi096.stdout:start osd.2 2024-09-16T03:56:03.804 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2024-09-16T03:56:03.804 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=38a92d84-8703-45d8-b5ef-7d976430f112 --auth-supported=none --mon-host=127.0.0.1:7105 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-pool-create/2 --osd-journal=td/osd-pool-create/2/journal --chdir=--debug_allow_any_pool_priority=true --run-dir=td/osd-pool-create '--admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-pool-create/$name.log' '--pid-file=td/osd-pool-create/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T03:56:03.804 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T03:56:03.804 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T03:56:03.804 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T03:56:03.833 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:56:03.829+0000 7f5dea8a37c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:56:03.859 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:56:03.857+0000 7f5dea8a37c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:56:03.861 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:56:03.857+0000 7f5dea8a37c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:56:03.861 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:56:03.857+0000 7f5dea8a37c0 -1 global_init_chdir: failed to chdir to directory: '--debug_allow_any_pool_priority=true': (2) No such file or directory 2024-09-16T03:56:04.288 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2024-09-16T03:56:04.289 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:56:04.289 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2024-09-16T03:56:04.289 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:56:04.289 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:56:04.289 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:56:04.289 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T03:56:04.290 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:56:04.290 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:56:04.290 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:56:04.745 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:56:05.137 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:56:05.133+0000 7f5dea8a37c0 -1 Falling back to public interface 2024-09-16T03:56:05.142 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:56:05.141+0000 7f5dea8a37c0 -1 global_init_chdir: failed to chdir to directory: '--debug_allow_any_pool_priority=true': (2) No such file or directory 2024-09-16T03:56:05.746 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:56:05.747 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:56:05.747 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T03:56:05.747 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T03:56:05.747 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:56:05.748 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:56:06.182 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:56:07.183 INFO:tasks.workunit.client.0.smithi096.stdout:2 2024-09-16T03:56:07.184 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:56:07.184 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:56:07.184 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T03:56:07.184 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:56:07.184 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:56:07.606 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:56:07.949 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:56:07.945+0000 7f5dea8a37c0 -1 osd.2 0 log_to_monitors true 2024-09-16T03:56:08.607 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:56:08.608 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:56:08.608 INFO:tasks.workunit.client.0.smithi096.stdout:3 2024-09-16T03:56:08.608 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T03:56:08.608 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:56:08.609 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:56:09.253 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:56:10.254 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:56:10.255 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:56:10.255 INFO:tasks.workunit.client.0.smithi096.stdout:4 2024-09-16T03:56:10.255 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T03:56:10.255 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:56:10.256 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:56:10.811 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:56:11.812 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:56:11.813 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:56:11.814 INFO:tasks.workunit.client.0.smithi096.stdout:5 2024-09-16T03:56:11.814 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T03:56:11.815 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:56:11.815 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:56:12.252 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:56:13.254 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:56:13.254 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:56:13.254 INFO:tasks.workunit.client.0.smithi096.stdout:6 2024-09-16T03:56:13.255 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T03:56:13.255 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:56:13.255 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:56:13.813 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:56:14.815 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:56:14.815 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:56:14.815 INFO:tasks.workunit.client.0.smithi096.stdout:7 2024-09-16T03:56:14.816 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T03:56:14.816 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:56:14.816 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:56:15.233 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:56:16.234 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:56:16.234 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:56:16.235 INFO:tasks.workunit.client.0.smithi096.stdout:8 2024-09-16T03:56:16.235 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T03:56:16.235 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:56:16.235 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:56:16.836 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:56:17.837 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:56:17.838 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:56:17.838 INFO:tasks.workunit.client.0.smithi096.stdout:9 2024-09-16T03:56:17.838 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T03:56:17.838 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:56:17.838 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:56:18.302 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:56:19.304 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:56:19.304 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:56:19.304 INFO:tasks.workunit.client.0.smithi096.stdout:10 2024-09-16T03:56:19.305 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T03:56:19.305 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:56:19.305 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:56:19.820 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:56:20.821 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:56:20.822 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:56:20.822 INFO:tasks.workunit.client.0.smithi096.stdout:11 2024-09-16T03:56:20.823 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T03:56:20.823 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:56:20.823 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:56:21.253 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:56:22.255 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:56:22.255 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:56:22.255 INFO:tasks.workunit.client.0.smithi096.stdout:12 2024-09-16T03:56:22.256 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T03:56:22.256 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:56:22.256 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:56:22.869 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:56:23.870 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:56:23.871 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:56:23.871 INFO:tasks.workunit.client.0.smithi096.stdout:13 2024-09-16T03:56:23.871 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T03:56:23.871 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:56:23.871 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:56:24.909 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:56:25.911 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:56:25.911 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:56:25.911 INFO:tasks.workunit.client.0.smithi096.stdout:14 2024-09-16T03:56:25.912 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T03:56:25.912 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:56:25.912 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:56:26.683 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:56:27.685 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:56:27.685 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:56:27.685 INFO:tasks.workunit.client.0.smithi096.stdout:15 2024-09-16T03:56:27.686 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T03:56:27.686 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:56:27.686 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:56:28.536 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:56:29.537 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:56:29.538 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:56:29.538 INFO:tasks.workunit.client.0.smithi096.stdout:16 2024-09-16T03:56:29.538 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T03:56:29.538 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:56:29.538 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:56:29.963 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:56:30.965 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:56:30.965 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:56:30.965 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T03:56:30.966 INFO:tasks.workunit.client.0.smithi096.stdout:17 2024-09-16T03:56:30.966 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:56:30.966 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:56:32.122 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:56:33.123 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:56:33.123 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:56:33.124 INFO:tasks.workunit.client.0.smithi096.stdout:18 2024-09-16T03:56:33.124 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 18 2024-09-16T03:56:33.124 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:56:33.125 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:56:33.666 INFO:tasks.workunit.client.0.smithi096.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/1111961408,v1:127.0.0.1:6819/1111961408] [v2:127.0.0.1:6820/1111961408,v1:127.0.0.1:6821/1111961408] exists,up 017c2729-b36d-4fde-b243-c8f7fb2dbbf9 2024-09-16T03:56:33.666 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:56:33.667 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:56:33.667 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:56:33.667 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: seq 0 20 2024-09-16T03:56:33.668 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:56:33.669 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 0 + 1 2024-09-16T03:56:33.670 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=1 2024-09-16T03:56:33.670 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test1 1 1 2024-09-16T03:56:34.214 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test1' already exists 2024-09-16T03:56:34.230 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:56:34.231 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 1 + 1 2024-09-16T03:56:34.232 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=2 2024-09-16T03:56:34.233 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test2 1 1 2024-09-16T03:56:34.770 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test2' already exists 2024-09-16T03:56:34.785 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:56:34.786 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 2 + 1 2024-09-16T03:56:34.787 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=3 2024-09-16T03:56:34.787 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test3 1 1 2024-09-16T03:56:35.915 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test3' already exists 2024-09-16T03:56:35.938 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:56:35.938 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 3 + 1 2024-09-16T03:56:35.939 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=4 2024-09-16T03:56:35.940 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test4 1 1 2024-09-16T03:56:37.330 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test4' already exists 2024-09-16T03:56:37.351 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:56:37.352 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 4 + 1 2024-09-16T03:56:37.353 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=5 2024-09-16T03:56:37.354 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test5 1 1 2024-09-16T03:56:38.888 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test5' already exists 2024-09-16T03:56:38.908 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:56:38.908 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 5 + 1 2024-09-16T03:56:38.909 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=6 2024-09-16T03:56:38.909 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test6 1 1 2024-09-16T03:56:39.710 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test6' already exists 2024-09-16T03:56:39.728 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:56:39.728 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 6 + 1 2024-09-16T03:56:39.730 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=7 2024-09-16T03:56:39.730 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test7 1 1 2024-09-16T03:56:40.657 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test7' already exists 2024-09-16T03:56:40.674 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:56:40.675 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 7 + 1 2024-09-16T03:56:40.677 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=8 2024-09-16T03:56:40.677 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test8 1 1 2024-09-16T03:56:41.647 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test8' already exists 2024-09-16T03:56:41.664 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:56:41.665 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 8 + 1 2024-09-16T03:56:41.666 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=9 2024-09-16T03:56:41.666 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test9 1 1 2024-09-16T03:56:42.492 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test9' already exists 2024-09-16T03:56:42.508 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:56:42.509 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 9 + 1 2024-09-16T03:56:42.510 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=10 2024-09-16T03:56:42.510 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test10 1 1 2024-09-16T03:56:43.633 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test10' already exists 2024-09-16T03:56:43.650 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:56:43.651 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 10 + 1 2024-09-16T03:56:43.652 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=11 2024-09-16T03:56:43.652 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test11 1 1 2024-09-16T03:56:44.228 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test11' already exists 2024-09-16T03:56:44.244 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:56:44.245 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 11 + 1 2024-09-16T03:56:44.246 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=12 2024-09-16T03:56:44.246 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test12 1 1 2024-09-16T03:56:45.359 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test12' already exists 2024-09-16T03:56:45.376 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:56:45.377 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 12 + 1 2024-09-16T03:56:45.377 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=13 2024-09-16T03:56:45.378 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test13 1 1 2024-09-16T03:56:47.022 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test13' already exists 2024-09-16T03:56:47.048 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:56:47.048 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 13 + 1 2024-09-16T03:56:47.049 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=14 2024-09-16T03:56:47.050 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test14 1 1 2024-09-16T03:56:47.847 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test14' already exists 2024-09-16T03:56:47.866 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:56:47.866 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 14 + 1 2024-09-16T03:56:47.867 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=15 2024-09-16T03:56:47.867 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test15 1 1 2024-09-16T03:56:48.608 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test15' already exists 2024-09-16T03:56:48.626 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:56:48.626 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 15 + 1 2024-09-16T03:56:48.628 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=16 2024-09-16T03:56:48.628 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test16 1 1 2024-09-16T03:56:49.506 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test16' already exists 2024-09-16T03:56:49.523 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:56:49.524 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 16 + 1 2024-09-16T03:56:49.526 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=17 2024-09-16T03:56:49.526 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test17 1 1 2024-09-16T03:56:50.537 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test17' already exists 2024-09-16T03:56:50.554 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:56:50.554 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 17 + 1 2024-09-16T03:56:50.555 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=18 2024-09-16T03:56:50.555 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test18 1 1 2024-09-16T03:56:51.706 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test18' already exists 2024-09-16T03:56:51.723 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:56:51.724 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 18 + 1 2024-09-16T03:56:51.725 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=19 2024-09-16T03:56:51.726 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test19 1 1 2024-09-16T03:56:52.789 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test19' already exists 2024-09-16T03:56:52.805 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:56:52.806 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 19 + 1 2024-09-16T03:56:52.807 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=20 2024-09-16T03:56:52.807 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test20 1 1 2024-09-16T03:56:54.033 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test20' already exists 2024-09-16T03:56:54.057 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:56:54.057 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 20 + 1 2024-09-16T03:56:54.059 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=21 2024-09-16T03:56:54.059 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test21 1 1 2024-09-16T03:56:54.851 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test21' already exists 2024-09-16T03:56:54.868 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:240: check_pool_priority: wait_for_clean 2024-09-16T03:56:54.868 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1633: wait_for_clean: local cmd= 2024-09-16T03:56:54.868 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1634: wait_for_clean: local num_active_clean=-1 2024-09-16T03:56:54.868 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1635: wait_for_clean: local cur_active_clean 2024-09-16T03:56:54.869 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: get_timeout_delays 90 .1 2024-09-16T03:56:54.870 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: shopt -q -o xtrace 2024-09-16T03:56:54.870 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: echo true 2024-09-16T03:56:54.870 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: local trace=true 2024-09-16T03:56:54.870 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: true 2024-09-16T03:56:54.870 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: shopt -u -o xtrace 2024-09-16T03:56:54.973 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-09-16T03:56:54.973 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: local -a delays 2024-09-16T03:56:54.973 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1637: wait_for_clean: local -i loop=0 2024-09-16T03:56:54.973 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1639: wait_for_clean: flush_pg_stats 2024-09-16T03:56:54.974 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: local timeout=300 2024-09-16T03:56:54.974 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ceph osd ls 2024-09-16T03:56:55.540 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ids='0 2024-09-16T03:56:55.540 INFO:tasks.workunit.client.0.smithi096.stderr:1 2024-09-16T03:56:55.540 INFO:tasks.workunit.client.0.smithi096.stderr:2' 2024-09-16T03:56:55.540 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2208: flush_pg_stats: seqs= 2024-09-16T03:56:55.540 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:56:55.540 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-09-16T03:56:55.699 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=21474836508 2024-09-16T03:56:55.699 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 21474836508 2024-09-16T03:56:55.699 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836508' 2024-09-16T03:56:55.700 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:56:55.700 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-09-16T03:56:55.995 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=42949672982 2024-09-16T03:56:55.995 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 42949672982 2024-09-16T03:56:55.995 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836508 1-42949672982' 2024-09-16T03:56:55.995 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:56:55.995 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-09-16T03:56:56.165 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=64424509449 2024-09-16T03:56:56.166 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 64424509449 2024-09-16T03:56:56.166 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836508 1-42949672982 2-64424509449' 2024-09-16T03:56:56.166 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:56:56.166 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 0-21474836508 2024-09-16T03:56:56.166 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:56:56.167 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=0 2024-09-16T03:56:56.167 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 0-21474836508 2024-09-16T03:56:56.167 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:56:56.168 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=21474836508 2024-09-16T03:56:56.168 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.0 seq 21474836508' 2024-09-16T03:56:56.168 INFO:tasks.workunit.client.0.smithi096.stdout:waiting osd.0 seq 21474836508 2024-09-16T03:56:56.169 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T03:56:56.630 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836506 -lt 21474836508 2024-09-16T03:56:56.630 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: flush_pg_stats: sleep 1 2024-09-16T03:56:57.632 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2224: flush_pg_stats: '[' 300 -eq 0 ']' 2024-09-16T03:56:57.632 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T03:56:58.056 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836508 -lt 21474836508 2024-09-16T03:56:58.056 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:56:58.057 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 1-42949672982 2024-09-16T03:56:58.057 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:56:58.058 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=1 2024-09-16T03:56:58.059 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 1-42949672982 2024-09-16T03:56:58.059 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:56:58.060 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=42949672982 2024-09-16T03:56:58.060 INFO:tasks.workunit.client.0.smithi096.stdout:waiting osd.1 seq 42949672982 2024-09-16T03:56:58.061 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.1 seq 42949672982' 2024-09-16T03:56:58.061 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 1 2024-09-16T03:56:58.484 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 42949672982 -lt 42949672982 2024-09-16T03:56:58.484 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:56:58.485 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 2-64424509449 2024-09-16T03:56:58.485 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:56:58.487 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=2 2024-09-16T03:56:58.487 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 2-64424509449 2024-09-16T03:56:58.487 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:56:58.488 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=64424509449 2024-09-16T03:56:58.488 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.2 seq 64424509449' 2024-09-16T03:56:58.489 INFO:tasks.workunit.client.0.smithi096.stdout:waiting osd.2 seq 64424509449 2024-09-16T03:56:58.489 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 2 2024-09-16T03:56:58.913 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 64424509449 -lt 64424509449 2024-09-16T03:56:58.913 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: get_num_pgs 2024-09-16T03:56:58.914 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:56:58.914 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:56:59.485 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: test 21 == 0 2024-09-16T03:56:59.485 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:56:59.486 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:56:59.486 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:56:59.486 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:56:59.486 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:56:59.486 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:56:59.486 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:56:59.886 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=21 2024-09-16T03:56:59.887 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:56:59.887 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:56:59.887 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:57:00.421 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 21 = 21 2024-09-16T03:57:00.422 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: break 2024-09-16T03:57:00.422 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: return 0 2024-09-16T03:57:00.422 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: seq 0 20 2024-09-16T03:57:00.422 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:57:00.422 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 0 + 1 2024-09-16T03:57:00.424 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=1 2024-09-16T03:57:00.424 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 0 '*' 2 - 4 2024-09-16T03:57:00.425 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test1 recovery_priority -4 2024-09-16T03:57:01.163 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 1 recovery_priority to -4 2024-09-16T03:57:01.181 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:57:01.182 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 1 + 1 2024-09-16T03:57:01.183 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=2 2024-09-16T03:57:01.183 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 1 '*' 2 - 4 2024-09-16T03:57:01.185 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test2 recovery_priority -2 2024-09-16T03:57:01.983 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 2 recovery_priority to -2 2024-09-16T03:57:02.008 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:57:02.009 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 2 + 1 2024-09-16T03:57:02.009 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=3 2024-09-16T03:57:02.010 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 2 '*' 2 - 4 2024-09-16T03:57:02.011 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test3 recovery_priority 0 2024-09-16T03:57:03.024 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 3 recovery_priority to 0 2024-09-16T03:57:03.042 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:57:03.043 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 3 + 1 2024-09-16T03:57:03.044 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=4 2024-09-16T03:57:03.046 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 3 '*' 2 - 4 2024-09-16T03:57:03.047 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test4 recovery_priority 2 2024-09-16T03:57:04.042 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 4 recovery_priority to 2 2024-09-16T03:57:04.063 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:57:04.064 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 4 + 1 2024-09-16T03:57:04.065 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=5 2024-09-16T03:57:04.066 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 4 '*' 2 - 4 2024-09-16T03:57:04.066 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test5 recovery_priority 4 2024-09-16T03:57:04.864 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 5 recovery_priority to 4 2024-09-16T03:57:04.885 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:57:04.885 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 5 + 1 2024-09-16T03:57:04.887 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=6 2024-09-16T03:57:04.887 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 5 '*' 2 - 4 2024-09-16T03:57:04.888 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test6 recovery_priority 6 2024-09-16T03:57:05.826 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 6 recovery_priority to 6 2024-09-16T03:57:05.847 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:57:05.848 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 6 + 1 2024-09-16T03:57:05.849 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=7 2024-09-16T03:57:05.850 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 6 '*' 2 - 4 2024-09-16T03:57:05.851 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test7 recovery_priority 8 2024-09-16T03:57:06.889 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 7 recovery_priority to 8 2024-09-16T03:57:06.912 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:57:06.912 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 7 + 1 2024-09-16T03:57:06.913 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=8 2024-09-16T03:57:06.914 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 7 '*' 2 - 4 2024-09-16T03:57:06.915 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test8 recovery_priority 10 2024-09-16T03:57:07.802 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 8 recovery_priority to 10 2024-09-16T03:57:07.824 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:57:07.824 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 8 + 1 2024-09-16T03:57:07.825 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=9 2024-09-16T03:57:07.826 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 8 '*' 2 - 4 2024-09-16T03:57:07.827 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test9 recovery_priority 12 2024-09-16T03:57:08.480 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 9 recovery_priority to 12 2024-09-16T03:57:08.498 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:57:08.499 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 9 + 1 2024-09-16T03:57:08.500 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=10 2024-09-16T03:57:08.501 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 9 '*' 2 - 4 2024-09-16T03:57:08.502 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test10 recovery_priority 14 2024-09-16T03:57:09.403 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 10 recovery_priority to 14 2024-09-16T03:57:09.430 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:57:09.431 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 10 + 1 2024-09-16T03:57:09.433 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=11 2024-09-16T03:57:09.433 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 10 '*' 2 - 4 2024-09-16T03:57:09.434 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test11 recovery_priority 16 2024-09-16T03:57:10.267 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 11 recovery_priority to 16 2024-09-16T03:57:10.287 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:57:10.287 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 11 + 1 2024-09-16T03:57:10.288 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=12 2024-09-16T03:57:10.289 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 11 '*' 2 - 4 2024-09-16T03:57:10.290 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test12 recovery_priority 18 2024-09-16T03:57:11.028 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 12 recovery_priority to 18 2024-09-16T03:57:11.049 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:57:11.049 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 12 + 1 2024-09-16T03:57:11.050 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=13 2024-09-16T03:57:11.050 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 12 '*' 2 - 4 2024-09-16T03:57:11.051 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test13 recovery_priority 20 2024-09-16T03:57:11.849 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 13 recovery_priority to 20 2024-09-16T03:57:11.868 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:57:11.869 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 13 + 1 2024-09-16T03:57:11.870 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=14 2024-09-16T03:57:11.871 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 13 '*' 2 - 4 2024-09-16T03:57:11.872 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test14 recovery_priority 22 2024-09-16T03:57:12.711 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 14 recovery_priority to 22 2024-09-16T03:57:12.733 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:57:12.733 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 14 + 1 2024-09-16T03:57:12.734 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=15 2024-09-16T03:57:12.735 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 14 '*' 2 - 4 2024-09-16T03:57:12.737 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test15 recovery_priority 24 2024-09-16T03:57:13.536 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 15 recovery_priority to 24 2024-09-16T03:57:13.558 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:57:13.558 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 15 + 1 2024-09-16T03:57:13.560 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=16 2024-09-16T03:57:13.560 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 15 '*' 2 - 4 2024-09-16T03:57:13.561 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test16 recovery_priority 26 2024-09-16T03:57:14.520 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 16 recovery_priority to 26 2024-09-16T03:57:14.543 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:57:14.543 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 16 + 1 2024-09-16T03:57:14.544 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=17 2024-09-16T03:57:14.545 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 16 '*' 2 - 4 2024-09-16T03:57:14.546 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test17 recovery_priority 28 2024-09-16T03:57:15.223 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 17 recovery_priority to 28 2024-09-16T03:57:15.243 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:57:15.243 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 17 + 1 2024-09-16T03:57:15.244 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=18 2024-09-16T03:57:15.245 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 17 '*' 2 - 4 2024-09-16T03:57:15.246 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test18 recovery_priority 30 2024-09-16T03:57:16.113 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 18 recovery_priority to 30 2024-09-16T03:57:16.136 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:57:16.136 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 18 + 1 2024-09-16T03:57:16.138 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=19 2024-09-16T03:57:16.138 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 18 '*' 2 - 4 2024-09-16T03:57:16.140 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test19 recovery_priority 32 2024-09-16T03:57:16.873 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 19 recovery_priority to 32 2024-09-16T03:57:16.890 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:57:16.890 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 19 + 1 2024-09-16T03:57:16.891 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=20 2024-09-16T03:57:16.892 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 19 '*' 2 - 4 2024-09-16T03:57:16.894 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test20 recovery_priority 34 2024-09-16T03:57:17.761 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 20 recovery_priority to 34 2024-09-16T03:57:17.785 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:57:17.785 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 20 + 1 2024-09-16T03:57:17.786 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=21 2024-09-16T03:57:17.786 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 20 '*' 2 - 4 2024-09-16T03:57:17.788 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test21 recovery_priority 36 2024-09-16T03:57:18.891 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 21 recovery_priority to 36 2024-09-16T03:57:18.916 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:249: check_pool_priority: bin/ceph osd dump 2024-09-16T03:57:18.917 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh: line 249: bin/ceph: No such file or directory 2024-09-16T03:57:18.917 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:252: check_pool_priority: kill_daemons 2024-09-16T03:57:18.918 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:57:18.918 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:57:18.918 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:57:18.918 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:57:18.919 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:57:24.238 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:57:24.239 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:253: check_pool_priority: run_mon td/osd-pool-create a 2024-09-16T03:57:24.239 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-pool-create 2024-09-16T03:57:24.239 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T03:57:24.239 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T03:57:24.239 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T03:57:24.239 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-pool-create/a 2024-09-16T03:57:24.239 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-pool-create/a --run-dir=td/osd-pool-create 2024-09-16T03:57:24.265 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:57:24.260+0000 7f0be8955e00 -1 'td/osd-pool-create/a' already exists and is not empty: monitor may already exist 2024-09-16T03:57:24.267 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T03:57:24.267 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:57:24.267 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:57:24.268 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:57:24.268 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:57:24.268 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:57:24.268 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T03:57:24.269 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug_allow_any_pool_priority=true --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-pool-create/a '--log-file=td/osd-pool-create/$name.log' '--admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' --mon-cluster-log-file=td/osd-pool-create/log --run-dir=td/osd-pool-create '--pid-file=td/osd-pool-create/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-09-16T03:57:24.546 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T03:57:24.547 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T03:57:24.547 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:57:24.547 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:57:24.547 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T03:57:24.548 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T03:57:24.548 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:57:24.548 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:57:24.548 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:57:24.549 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:57:24.549 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:57:24.549 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:57:24.549 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.128966/ceph-mon.a.asok 2024-09-16T03:57:24.549 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:57:24.549 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.128966/ceph-mon.a.asok config get fsid 2024-09-16T03:57:24.665 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T03:57:24.665 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:57:24.665 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:57:24.666 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T03:57:24.667 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:57:24.667 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:57:24.667 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:57:24.667 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T03:57:24.667 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:57:24.667 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:57:24.667 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:57:24.667 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.128966/ceph-mon.a.asok 2024-09-16T03:57:24.667 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:57:24.667 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.128966/ceph-mon.a.asok config get mon_host 2024-09-16T03:57:24.774 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:254: check_pool_priority: run_mgr td/osd-pool-create x 2024-09-16T03:57:24.774 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-pool-create 2024-09-16T03:57:24.774 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2024-09-16T03:57:24.775 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2024-09-16T03:57:24.775 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2024-09-16T03:57:24.775 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-pool-create/x 2024-09-16T03:57:24.775 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2024-09-16T03:57:25.178 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2024-09-16T03:57:25.179 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:57:25.179 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:57:25.179 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:57:25.180 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:57:25.180 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:57:25.180 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T03:57:25.180 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T03:57:25.181 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --debug_allow_any_pool_priority=true --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-pool-create/x '--log-file=td/osd-pool-create/$name.log' '--admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' --run-dir=td/osd-pool-create '--pid-file=td/osd-pool-create/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T03:57:25.208 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:255: check_pool_priority: activate_osd td/osd-pool-create 0 2024-09-16T03:57:25.208 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-pool-create 2024-09-16T03:57:25.209 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2024-09-16T03:57:25.209 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2024-09-16T03:57:25.209 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2024-09-16T03:57:25.209 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-pool-create/0 2024-09-16T03:57:25.209 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=38a92d84-8703-45d8-b5ef-7d976430f112 --auth-supported=none --mon-host=127.0.0.1:7105 ' 2024-09-16T03:57:25.209 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T03:57:25.209 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T03:57:25.209 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T03:57:25.209 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-pool-create/0' 2024-09-16T03:57:25.209 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-pool-create/0/journal' 2024-09-16T03:57:25.209 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2024-09-16T03:57:25.209 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+=--debug_allow_any_pool_priority=true 2024-09-16T03:57:25.209 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-pool-create' 2024-09-16T03:57:25.210 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2024-09-16T03:57:25.210 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:57:25.210 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:57:25.210 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:57:25.210 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:57:25.210 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:57:25.210 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T03:57:25.210 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T03:57:25.210 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2024-09-16T03:57:25.210 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-pool-create/$name.log' 2024-09-16T03:57:25.210 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-pool-create/$name.pid' 2024-09-16T03:57:25.210 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T03:57:25.210 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T03:57:25.211 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T03:57:25.211 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T03:57:25.211 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2024-09-16T03:57:25.211 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2024-09-16T03:57:25.211 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-pool-create/0 2024-09-16T03:57:25.211 INFO:tasks.workunit.client.0.smithi096.stdout:start osd.0 2024-09-16T03:57:25.212 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2024-09-16T03:57:25.212 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=38a92d84-8703-45d8-b5ef-7d976430f112 --auth-supported=none --mon-host=127.0.0.1:7105 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-pool-create/0 --osd-journal=td/osd-pool-create/0/journal --chdir=--debug_allow_any_pool_priority=true --run-dir=td/osd-pool-create '--admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-pool-create/$name.log' '--pid-file=td/osd-pool-create/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T03:57:25.212 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-pool-create/0/whoami 2024-09-16T03:57:25.212 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2024-09-16T03:57:25.212 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2024-09-16T03:57:25.212 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2024-09-16T03:57:25.213 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2024-09-16T03:57:25.242 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:57:25.240+0000 7f135c66f7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:57:25.245 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:57:25.240+0000 7f135c66f7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:57:25.246 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:57:25.244+0000 7f135c66f7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:57:25.247 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:57:25.244+0000 7f135c66f7c0 -1 global_init_chdir: failed to chdir to directory: '--debug_allow_any_pool_priority=true': (2) No such file or directory 2024-09-16T03:57:25.646 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2024-09-16T03:57:25.646 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:57:25.646 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2024-09-16T03:57:25.646 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:57:25.646 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:57:25.646 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:57:25.646 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:57:25.647 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T03:57:25.647 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:57:25.647 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:57:26.077 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:57:26.632 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:57:26.628+0000 7f135c66f7c0 -1 Falling back to public interface 2024-09-16T03:57:26.636 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:57:26.628+0000 7f135c66f7c0 -1 global_init_chdir: failed to chdir to directory: '--debug_allow_any_pool_priority=true': (2) No such file or directory 2024-09-16T03:57:27.078 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:57:27.078 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:57:27.078 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T03:57:27.079 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T03:57:27.079 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:57:27.079 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:57:27.506 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:57:28.508 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:57:28.508 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:57:28.508 INFO:tasks.workunit.client.0.smithi096.stdout:2 2024-09-16T03:57:28.509 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T03:57:28.509 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:57:28.509 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:57:28.968 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:57:29.970 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:57:29.970 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:57:29.970 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T03:57:29.970 INFO:tasks.workunit.client.0.smithi096.stdout:3 2024-09-16T03:57:29.971 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:57:29.971 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:57:30.217 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:57:30.212+0000 7f135c66f7c0 -1 osd.0 105 log_to_monitors true 2024-09-16T03:57:30.437 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:57:31.439 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:57:31.439 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:57:31.440 INFO:tasks.workunit.client.0.smithi096.stdout:4 2024-09-16T03:57:31.440 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T03:57:31.440 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:57:31.440 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:57:31.923 INFO:tasks.workunit.client.0.smithi096.stdout:osd.0 up in weight 1 up_from 109 up_thru 109 down_at 106 last_clean_interval [5,105) [v2:127.0.0.1:6800/3817869436,v1:127.0.0.1:6801/3817869436] [v2:127.0.0.1:6802/3817869436,v1:127.0.0.1:6803/3817869436] exists,up 84ca08be-2c32-4320-8e89-c9a110a57f4c 2024-09-16T03:57:31.926 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:57:31.926 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:57:31.927 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:57:31.927 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:256: check_pool_priority: activate_osd td/osd-pool-create 1 2024-09-16T03:57:31.927 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-pool-create 2024-09-16T03:57:31.927 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2024-09-16T03:57:31.927 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2024-09-16T03:57:31.927 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2024-09-16T03:57:31.927 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-pool-create/1 2024-09-16T03:57:31.927 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=38a92d84-8703-45d8-b5ef-7d976430f112 --auth-supported=none --mon-host=127.0.0.1:7105 ' 2024-09-16T03:57:31.927 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T03:57:31.927 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T03:57:31.927 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T03:57:31.927 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-pool-create/1' 2024-09-16T03:57:31.927 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-pool-create/1/journal' 2024-09-16T03:57:31.928 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2024-09-16T03:57:31.928 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+=--debug_allow_any_pool_priority=true 2024-09-16T03:57:31.928 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-pool-create' 2024-09-16T03:57:31.928 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2024-09-16T03:57:31.928 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:57:31.928 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:57:31.928 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:57:31.928 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:57:31.928 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:57:31.928 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T03:57:31.928 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T03:57:31.928 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2024-09-16T03:57:31.928 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-pool-create/$name.log' 2024-09-16T03:57:31.929 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-pool-create/$name.pid' 2024-09-16T03:57:31.929 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T03:57:31.929 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T03:57:31.929 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T03:57:31.929 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T03:57:31.929 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2024-09-16T03:57:31.929 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2024-09-16T03:57:31.929 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-pool-create/1 2024-09-16T03:57:31.929 INFO:tasks.workunit.client.0.smithi096.stdout:start osd.1 2024-09-16T03:57:31.930 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2024-09-16T03:57:31.930 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=38a92d84-8703-45d8-b5ef-7d976430f112 --auth-supported=none --mon-host=127.0.0.1:7105 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-pool-create/1 --osd-journal=td/osd-pool-create/1/journal --chdir=--debug_allow_any_pool_priority=true --run-dir=td/osd-pool-create '--admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-pool-create/$name.log' '--pid-file=td/osd-pool-create/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T03:57:31.930 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-pool-create/1/whoami 2024-09-16T03:57:31.931 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2024-09-16T03:57:31.931 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2024-09-16T03:57:31.931 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2024-09-16T03:57:31.931 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2024-09-16T03:57:31.961 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:57:31.956+0000 7fbf9a86f7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:57:31.977 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:57:31.972+0000 7fbf9a86f7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:57:31.978 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:57:31.976+0000 7fbf9a86f7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:57:31.978 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:57:31.976+0000 7fbf9a86f7c0 -1 global_init_chdir: failed to chdir to directory: '--debug_allow_any_pool_priority=true': (2) No such file or directory 2024-09-16T03:57:32.486 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2024-09-16T03:57:32.486 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:57:32.486 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2024-09-16T03:57:32.486 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:57:32.487 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:57:32.487 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:57:32.487 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T03:57:32.487 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:57:32.488 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:57:32.488 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:57:32.935 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:57:33.256 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:57:33.252+0000 7fbf9a86f7c0 -1 Falling back to public interface 2024-09-16T03:57:33.260 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:57:33.256+0000 7fbf9a86f7c0 -1 global_init_chdir: failed to chdir to directory: '--debug_allow_any_pool_priority=true': (2) No such file or directory 2024-09-16T03:57:33.936 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:57:33.937 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:57:33.937 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T03:57:33.937 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T03:57:33.937 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:57:33.938 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:57:34.363 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:57:35.365 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:57:35.366 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:57:35.366 INFO:tasks.workunit.client.0.smithi096.stdout:2 2024-09-16T03:57:35.366 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T03:57:35.367 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:57:35.367 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:57:35.808 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:57:36.810 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:57:36.810 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:57:36.810 INFO:tasks.workunit.client.0.smithi096.stdout:3 2024-09-16T03:57:36.811 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T03:57:36.811 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:57:36.811 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:57:36.914 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:57:36.912+0000 7fbf9a86f7c0 -1 osd.1 105 log_to_monitors true 2024-09-16T03:57:37.324 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:57:38.325 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:57:38.325 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:57:38.326 INFO:tasks.workunit.client.0.smithi096.stdout:4 2024-09-16T03:57:38.326 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T03:57:38.326 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:57:38.326 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:57:39.006 INFO:tasks.workunit.client.0.smithi096.stdout:osd.1 up in weight 1 up_from 112 up_thru 112 down_at 106 last_clean_interval [10,105) [v2:127.0.0.1:6810/146575731,v1:127.0.0.1:6811/146575731] [v2:127.0.0.1:6812/146575731,v1:127.0.0.1:6813/146575731] exists,up d71e1585-29de-45de-a1ec-d0ec60eee17c 2024-09-16T03:57:39.009 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:57:39.009 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:57:39.009 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:57:39.009 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:257: check_pool_priority: activate_osd td/osd-pool-create 2 2024-09-16T03:57:39.009 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-pool-create 2024-09-16T03:57:39.009 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2024-09-16T03:57:39.009 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2024-09-16T03:57:39.010 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2024-09-16T03:57:39.010 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-pool-create/2 2024-09-16T03:57:39.010 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=38a92d84-8703-45d8-b5ef-7d976430f112 --auth-supported=none --mon-host=127.0.0.1:7105 ' 2024-09-16T03:57:39.010 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T03:57:39.010 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T03:57:39.010 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T03:57:39.010 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-pool-create/2' 2024-09-16T03:57:39.010 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-pool-create/2/journal' 2024-09-16T03:57:39.010 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2024-09-16T03:57:39.010 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+=--debug_allow_any_pool_priority=true 2024-09-16T03:57:39.010 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-pool-create' 2024-09-16T03:57:39.010 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2024-09-16T03:57:39.010 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:57:39.011 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:57:39.011 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:57:39.011 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:57:39.011 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:57:39.011 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T03:57:39.011 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T03:57:39.011 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2024-09-16T03:57:39.011 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-pool-create/$name.log' 2024-09-16T03:57:39.011 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-pool-create/$name.pid' 2024-09-16T03:57:39.011 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T03:57:39.011 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T03:57:39.011 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T03:57:39.011 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T03:57:39.012 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2024-09-16T03:57:39.012 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2024-09-16T03:57:39.012 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-pool-create/2 2024-09-16T03:57:39.012 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2024-09-16T03:57:39.012 INFO:tasks.workunit.client.0.smithi096.stdout:start osd.2 2024-09-16T03:57:39.013 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=38a92d84-8703-45d8-b5ef-7d976430f112 --auth-supported=none --mon-host=127.0.0.1:7105 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-pool-create/2 --osd-journal=td/osd-pool-create/2/journal --chdir=--debug_allow_any_pool_priority=true --run-dir=td/osd-pool-create '--admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-pool-create/$name.log' '--pid-file=td/osd-pool-create/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T03:57:39.013 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-pool-create/2/whoami 2024-09-16T03:57:39.013 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2024-09-16T03:57:39.013 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2024-09-16T03:57:39.013 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2024-09-16T03:57:39.013 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2024-09-16T03:57:39.038 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:57:39.035+0000 7f7c4218b7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:57:39.093 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:57:39.087+0000 7f7c4218b7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:57:39.095 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:57:39.091+0000 7f7c4218b7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:57:39.095 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:57:39.091+0000 7f7c4218b7c0 -1 global_init_chdir: failed to chdir to directory: '--debug_allow_any_pool_priority=true': (2) No such file or directory 2024-09-16T03:57:39.432 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2024-09-16T03:57:39.432 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:57:39.432 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2024-09-16T03:57:39.432 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:57:39.432 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:57:39.432 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:57:39.432 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:57:39.433 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T03:57:39.433 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:57:39.433 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:57:39.933 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:57:40.328 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:57:40.323+0000 7f7c4218b7c0 -1 Falling back to public interface 2024-09-16T03:57:40.333 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:57:40.331+0000 7f7c4218b7c0 -1 global_init_chdir: failed to chdir to directory: '--debug_allow_any_pool_priority=true': (2) No such file or directory 2024-09-16T03:57:40.935 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:57:40.935 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:57:40.935 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T03:57:40.936 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T03:57:40.936 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:57:40.936 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:57:41.415 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:57:42.417 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:57:42.417 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:57:42.417 INFO:tasks.workunit.client.0.smithi096.stdout:2 2024-09-16T03:57:42.420 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T03:57:42.420 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:57:42.420 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:57:42.840 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:57:43.684 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:57:43.679+0000 7f7c4218b7c0 -1 osd.2 105 log_to_monitors true 2024-09-16T03:57:43.841 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:57:43.841 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:57:43.842 INFO:tasks.workunit.client.0.smithi096.stdout:3 2024-09-16T03:57:43.842 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T03:57:43.842 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:57:43.842 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:57:44.336 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:57:45.338 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:57:45.338 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:57:45.339 INFO:tasks.workunit.client.0.smithi096.stdout:4 2024-09-16T03:57:45.339 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T03:57:45.339 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:57:45.339 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:57:45.885 INFO:tasks.workunit.client.0.smithi096.stdout:osd.2 up in weight 1 up_from 116 up_thru 116 down_at 106 last_clean_interval [15,105) [v2:127.0.0.1:6818/3722891366,v1:127.0.0.1:6819/3722891366] [v2:127.0.0.1:6820/3722891366,v1:127.0.0.1:6821/3722891366] exists,up 017c2729-b36d-4fde-b243-c8f7fb2dbbf9 2024-09-16T03:57:45.886 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:57:45.886 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:57:45.886 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:57:45.886 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:258: check_pool_priority: sleep 5 2024-09-16T03:57:50.887 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:260: check_pool_priority: grep convert td/osd-pool-create/mon.a.log 2024-09-16T03:57:50.914 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T03:54:39.831+0000 7f2e432a2640 20 mon.a@0(leader).osd e1 convert_pool_priorities nothing to fix 2024-09-16T03:57:50.915 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T03:57:24.676+0000 7f5417d12e00 10 mon.a@0(leader).osd e106 convert_pool_priorities pool 4 recovery_priority adjusted 2 to 0 2024-09-16T03:57:50.915 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T03:57:24.676+0000 7f5417d12e00 10 mon.a@0(leader).osd e106 convert_pool_priorities pool 5 recovery_priority adjusted 4 to 1 2024-09-16T03:57:50.915 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T03:57:24.676+0000 7f5417d12e00 10 mon.a@0(leader).osd e106 convert_pool_priorities pool 6 recovery_priority adjusted 6 to 1 2024-09-16T03:57:50.915 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T03:57:24.676+0000 7f5417d12e00 10 mon.a@0(leader).osd e106 convert_pool_priorities pool 7 recovery_priority adjusted 8 to 2 2024-09-16T03:57:50.915 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T03:57:24.676+0000 7f5417d12e00 10 mon.a@0(leader).osd e106 convert_pool_priorities pool 8 recovery_priority adjusted 10 to 2 2024-09-16T03:57:50.915 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T03:57:24.676+0000 7f5417d12e00 10 mon.a@0(leader).osd e106 convert_pool_priorities pool 9 recovery_priority adjusted 12 to 3 2024-09-16T03:57:50.915 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T03:57:24.676+0000 7f5417d12e00 10 mon.a@0(leader).osd e106 convert_pool_priorities pool 10 recovery_priority adjusted 14 to 3 2024-09-16T03:57:50.915 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T03:57:24.676+0000 7f5417d12e00 10 mon.a@0(leader).osd e106 convert_pool_priorities pool 11 recovery_priority adjusted 16 to 4 2024-09-16T03:57:50.915 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T03:57:24.676+0000 7f5417d12e00 10 mon.a@0(leader).osd e106 convert_pool_priorities pool 12 recovery_priority adjusted 18 to 5 2024-09-16T03:57:50.915 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T03:57:24.676+0000 7f5417d12e00 10 mon.a@0(leader).osd e106 convert_pool_priorities pool 13 recovery_priority adjusted 20 to 5 2024-09-16T03:57:50.915 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T03:57:24.676+0000 7f5417d12e00 10 mon.a@0(leader).osd e106 convert_pool_priorities pool 14 recovery_priority adjusted 22 to 6 2024-09-16T03:57:50.916 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T03:57:24.676+0000 7f5417d12e00 10 mon.a@0(leader).osd e106 convert_pool_priorities pool 15 recovery_priority adjusted 24 to 6 2024-09-16T03:57:50.916 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T03:57:24.676+0000 7f5417d12e00 10 mon.a@0(leader).osd e106 convert_pool_priorities pool 16 recovery_priority adjusted 26 to 7 2024-09-16T03:57:50.916 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T03:57:24.676+0000 7f5417d12e00 10 mon.a@0(leader).osd e106 convert_pool_priorities pool 17 recovery_priority adjusted 28 to 7 2024-09-16T03:57:50.916 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T03:57:24.676+0000 7f5417d12e00 10 mon.a@0(leader).osd e106 convert_pool_priorities pool 18 recovery_priority adjusted 30 to 8 2024-09-16T03:57:50.916 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T03:57:24.676+0000 7f5417d12e00 10 mon.a@0(leader).osd e106 convert_pool_priorities pool 19 recovery_priority adjusted 32 to 8 2024-09-16T03:57:50.916 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T03:57:24.676+0000 7f5417d12e00 10 mon.a@0(leader).osd e106 convert_pool_priorities pool 20 recovery_priority adjusted 34 to 9 2024-09-16T03:57:50.916 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T03:57:24.676+0000 7f5417d12e00 10 mon.a@0(leader).osd e106 convert_pool_priorities pool 21 recovery_priority adjusted 36 to 10 2024-09-16T03:57:50.916 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:261: check_pool_priority: ceph osd dump 2024-09-16T03:57:51.319 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 118 2024-09-16T03:57:51.319 INFO:tasks.workunit.client.0.smithi096.stdout:fsid 38a92d84-8703-45d8-b5ef-7d976430f112 2024-09-16T03:57:51.319 INFO:tasks.workunit.client.0.smithi096.stdout:created 2024-09-16T03:54:39.624318+0000 2024-09-16T03:57:51.319 INFO:tasks.workunit.client.0.smithi096.stdout:modified 2024-09-16T03:57:44.966583+0000 2024-09-16T03:57:51.319 INFO:tasks.workunit.client.0.smithi096.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-16T03:57:51.319 INFO:tasks.workunit.client.0.smithi096.stdout:crush_version 10 2024-09-16T03:57:51.319 INFO:tasks.workunit.client.0.smithi096.stdout:full_ratio 0.99 2024-09-16T03:57:51.319 INFO:tasks.workunit.client.0.smithi096.stdout:backfillfull_ratio 0.99 2024-09-16T03:57:51.320 INFO:tasks.workunit.client.0.smithi096.stdout:nearfull_ratio 0.85 2024-09-16T03:57:51.320 INFO:tasks.workunit.client.0.smithi096.stdout:require_min_compat_client luminous 2024-09-16T03:57:51.320 INFO:tasks.workunit.client.0.smithi096.stdout:min_compat_client jewel 2024-09-16T03:57:51.320 INFO:tasks.workunit.client.0.smithi096.stdout:require_osd_release squid 2024-09-16T03:57:51.320 INFO:tasks.workunit.client.0.smithi096.stdout:stretch_mode_enabled false 2024-09-16T03:57:51.320 INFO:tasks.workunit.client.0.smithi096.stdout:pool 1 'test1' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 65 flags hashpspool stripe_width 0 recovery_priority -4 read_balance_score 3.00 2024-09-16T03:57:51.320 INFO:tasks.workunit.client.0.smithi096.stdout:pool 2 'test2' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 67 flags hashpspool stripe_width 0 recovery_priority -2 read_balance_score 3.00 2024-09-16T03:57:51.320 INFO:tasks.workunit.client.0.smithi096.stdout:pool 3 'test3' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 69 flags hashpspool stripe_width 0 read_balance_score 3.00 2024-09-16T03:57:51.320 INFO:tasks.workunit.client.0.smithi096.stdout:pool 4 'test4' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 107 flags hashpspool stripe_width 0 read_balance_score 3.00 2024-09-16T03:57:51.320 INFO:tasks.workunit.client.0.smithi096.stdout:pool 5 'test5' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 107 flags hashpspool stripe_width 0 recovery_priority 1 read_balance_score 3.00 2024-09-16T03:57:51.320 INFO:tasks.workunit.client.0.smithi096.stdout:pool 6 'test6' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 107 flags hashpspool stripe_width 0 recovery_priority 1 read_balance_score 3.00 2024-09-16T03:57:51.320 INFO:tasks.workunit.client.0.smithi096.stdout:pool 7 'test7' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 107 flags hashpspool stripe_width 0 recovery_priority 2 read_balance_score 3.00 2024-09-16T03:57:51.321 INFO:tasks.workunit.client.0.smithi096.stdout:pool 8 'test8' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 107 flags hashpspool stripe_width 0 recovery_priority 2 read_balance_score 3.00 2024-09-16T03:57:51.321 INFO:tasks.workunit.client.0.smithi096.stdout:pool 9 'test9' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 107 flags hashpspool stripe_width 0 recovery_priority 3 read_balance_score 3.00 2024-09-16T03:57:51.321 INFO:tasks.workunit.client.0.smithi096.stdout:pool 10 'test10' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 107 flags hashpspool stripe_width 0 recovery_priority 3 read_balance_score 3.00 2024-09-16T03:57:51.321 INFO:tasks.workunit.client.0.smithi096.stdout:pool 11 'test11' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 107 flags hashpspool stripe_width 0 recovery_priority 4 read_balance_score 3.00 2024-09-16T03:57:51.321 INFO:tasks.workunit.client.0.smithi096.stdout:pool 12 'test12' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 107 flags hashpspool stripe_width 0 recovery_priority 5 read_balance_score 3.00 2024-09-16T03:57:51.321 INFO:tasks.workunit.client.0.smithi096.stdout:pool 13 'test13' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 107 flags hashpspool stripe_width 0 recovery_priority 5 read_balance_score 3.00 2024-09-16T03:57:51.321 INFO:tasks.workunit.client.0.smithi096.stdout:pool 14 'test14' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 107 flags hashpspool stripe_width 0 recovery_priority 6 read_balance_score 3.00 2024-09-16T03:57:51.321 INFO:tasks.workunit.client.0.smithi096.stdout:pool 15 'test15' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 107 flags hashpspool stripe_width 0 recovery_priority 6 read_balance_score 3.00 2024-09-16T03:57:51.321 INFO:tasks.workunit.client.0.smithi096.stdout:pool 16 'test16' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 107 flags hashpspool stripe_width 0 recovery_priority 7 read_balance_score 3.00 2024-09-16T03:57:51.321 INFO:tasks.workunit.client.0.smithi096.stdout:pool 17 'test17' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 107 flags hashpspool stripe_width 0 recovery_priority 7 read_balance_score 3.00 2024-09-16T03:57:51.322 INFO:tasks.workunit.client.0.smithi096.stdout:pool 18 'test18' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 107 flags hashpspool stripe_width 0 recovery_priority 8 read_balance_score 3.00 2024-09-16T03:57:51.322 INFO:tasks.workunit.client.0.smithi096.stdout:pool 19 'test19' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 107 flags hashpspool stripe_width 0 recovery_priority 8 read_balance_score 3.00 2024-09-16T03:57:51.322 INFO:tasks.workunit.client.0.smithi096.stdout:pool 20 'test20' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 107 flags hashpspool stripe_width 0 recovery_priority 9 read_balance_score 3.00 2024-09-16T03:57:51.322 INFO:tasks.workunit.client.0.smithi096.stdout:pool 21 'test21' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 107 flags hashpspool stripe_width 0 recovery_priority 10 read_balance_score 3.00 2024-09-16T03:57:51.322 INFO:tasks.workunit.client.0.smithi096.stdout:max_osd 3 2024-09-16T03:57:51.322 INFO:tasks.workunit.client.0.smithi096.stdout:osd.0 up in weight 1 up_from 109 up_thru 116 down_at 106 last_clean_interval [5,105) [v2:127.0.0.1:6800/3817869436,v1:127.0.0.1:6801/3817869436] [v2:127.0.0.1:6802/3817869436,v1:127.0.0.1:6803/3817869436] exists,up 84ca08be-2c32-4320-8e89-c9a110a57f4c 2024-09-16T03:57:51.322 INFO:tasks.workunit.client.0.smithi096.stdout:osd.1 up in weight 1 up_from 112 up_thru 116 down_at 106 last_clean_interval [10,105) [v2:127.0.0.1:6810/146575731,v1:127.0.0.1:6811/146575731] [v2:127.0.0.1:6812/146575731,v1:127.0.0.1:6813/146575731] exists,up d71e1585-29de-45de-a1ec-d0ec60eee17c 2024-09-16T03:57:51.322 INFO:tasks.workunit.client.0.smithi096.stdout:osd.2 up in weight 1 up_from 116 up_thru 116 down_at 106 last_clean_interval [15,105) [v2:127.0.0.1:6818/3722891366,v1:127.0.0.1:6819/3722891366] [v2:127.0.0.1:6820/3722891366,v1:127.0.0.1:6821/3722891366] exists,up 017c2729-b36d-4fde-b243-c8f7fb2dbbf9 2024-09-16T03:57:51.322 INFO:tasks.workunit.client.0.smithi096.stdout:blocklist 127.0.0.1:0/2915676010 expires 2024-09-17T03:57:29.836516+0000 2024-09-16T03:57:51.322 INFO:tasks.workunit.client.0.smithi096.stdout:blocklist 127.0.0.1:6800/962139700 expires 2024-09-17T03:57:29.836516+0000 2024-09-16T03:57:51.322 INFO:tasks.workunit.client.0.smithi096.stdout:blocklist 127.0.0.1:6801/962139700 expires 2024-09-17T03:57:29.836516+0000 2024-09-16T03:57:51.322 INFO:tasks.workunit.client.0.smithi096.stdout:blocklist 127.0.0.1:0/2287431986 expires 2024-09-17T03:57:29.836516+0000 2024-09-16T03:57:51.322 INFO:tasks.workunit.client.0.smithi096.stdout:blocklist 127.0.0.1:0/3023731232 expires 2024-09-17T03:57:29.836516+0000 2024-09-16T03:57:51.334 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:263: check_pool_priority: pos=1 2024-09-16T03:57:51.336 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: ceph osd dump 2024-09-16T03:57:51.336 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: grep '^pool' 2024-09-16T03:57:51.336 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: sed 's/.*recovery_priority //' 2024-09-16T03:57:51.336 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: awk '{ print $1 }' 2024-09-16T03:57:51.780 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T03:57:51.781 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo -4 -2 0 0 1 1 2 2 3 3 4 5 5 6 6 7 7 8 8 9 10 2024-09-16T03:57:51.781 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $1 }' 2024-09-16T03:57:51.783 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=-4 2024-09-16T03:57:51.783 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test -4 = 0 2024-09-16T03:57:51.783 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test -4 = -4 2024-09-16T03:57:51.784 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 1 + 1 2024-09-16T03:57:51.784 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=2 2024-09-16T03:57:51.785 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T03:57:51.785 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo -4 -2 0 0 1 1 2 2 3 3 4 5 5 6 6 7 7 8 8 9 10 2024-09-16T03:57:51.785 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $2 }' 2024-09-16T03:57:51.788 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=-2 2024-09-16T03:57:51.788 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test -2 = 0 2024-09-16T03:57:51.788 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test -2 = -2 2024-09-16T03:57:51.788 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 2 + 1 2024-09-16T03:57:51.789 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=3 2024-09-16T03:57:51.789 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T03:57:51.790 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo -4 -2 0 0 1 1 2 2 3 3 4 5 5 6 6 7 7 8 8 9 10 2024-09-16T03:57:51.790 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $3 }' 2024-09-16T03:57:51.791 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=0 2024-09-16T03:57:51.791 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test 0 = 0 2024-09-16T03:57:51.791 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:270: check_pool_priority: result=pool 2024-09-16T03:57:51.791 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test pool = pool 2024-09-16T03:57:51.792 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 3 + 1 2024-09-16T03:57:51.792 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=4 2024-09-16T03:57:51.792 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T03:57:51.793 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo -4 -2 0 0 1 1 2 2 3 3 4 5 5 6 6 7 7 8 8 9 10 2024-09-16T03:57:51.793 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $4 }' 2024-09-16T03:57:51.795 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=0 2024-09-16T03:57:51.795 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test 0 = 0 2024-09-16T03:57:51.795 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:270: check_pool_priority: result=pool 2024-09-16T03:57:51.795 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test pool = pool 2024-09-16T03:57:51.796 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 4 + 1 2024-09-16T03:57:51.796 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=5 2024-09-16T03:57:51.796 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T03:57:51.797 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo -4 -2 0 0 1 1 2 2 3 3 4 5 5 6 6 7 7 8 8 9 10 2024-09-16T03:57:51.797 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $5 }' 2024-09-16T03:57:51.799 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=1 2024-09-16T03:57:51.799 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test 1 = 0 2024-09-16T03:57:51.799 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test 1 = 1 2024-09-16T03:57:51.800 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 5 + 1 2024-09-16T03:57:51.800 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=6 2024-09-16T03:57:51.800 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T03:57:51.801 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo -4 -2 0 0 1 1 2 2 3 3 4 5 5 6 6 7 7 8 8 9 10 2024-09-16T03:57:51.801 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $6 }' 2024-09-16T03:57:51.803 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=1 2024-09-16T03:57:51.803 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test 1 = 0 2024-09-16T03:57:51.803 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test 1 = 1 2024-09-16T03:57:51.804 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 6 + 1 2024-09-16T03:57:51.804 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=7 2024-09-16T03:57:51.804 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T03:57:51.805 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo -4 -2 0 0 1 1 2 2 3 3 4 5 5 6 6 7 7 8 8 9 10 2024-09-16T03:57:51.805 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $7 }' 2024-09-16T03:57:51.807 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=2 2024-09-16T03:57:51.807 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test 2 = 0 2024-09-16T03:57:51.807 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test 2 = 2 2024-09-16T03:57:51.808 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 7 + 1 2024-09-16T03:57:51.808 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=8 2024-09-16T03:57:51.808 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T03:57:51.809 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo -4 -2 0 0 1 1 2 2 3 3 4 5 5 6 6 7 7 8 8 9 10 2024-09-16T03:57:51.809 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $8 }' 2024-09-16T03:57:51.811 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=2 2024-09-16T03:57:51.812 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test 2 = 0 2024-09-16T03:57:51.812 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test 2 = 2 2024-09-16T03:57:51.812 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 8 + 1 2024-09-16T03:57:51.812 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=9 2024-09-16T03:57:51.812 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T03:57:51.813 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo -4 -2 0 0 1 1 2 2 3 3 4 5 5 6 6 7 7 8 8 9 10 2024-09-16T03:57:51.813 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $9 }' 2024-09-16T03:57:51.815 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=3 2024-09-16T03:57:51.815 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test 3 = 0 2024-09-16T03:57:51.816 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test 3 = 3 2024-09-16T03:57:51.816 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 9 + 1 2024-09-16T03:57:51.816 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=10 2024-09-16T03:57:51.816 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T03:57:51.817 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo -4 -2 0 0 1 1 2 2 3 3 4 5 5 6 6 7 7 8 8 9 10 2024-09-16T03:57:51.817 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $10 }' 2024-09-16T03:57:51.820 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=3 2024-09-16T03:57:51.820 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test 3 = 0 2024-09-16T03:57:51.820 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test 3 = 3 2024-09-16T03:57:51.820 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 10 + 1 2024-09-16T03:57:51.821 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=11 2024-09-16T03:57:51.821 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T03:57:51.821 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo -4 -2 0 0 1 1 2 2 3 3 4 5 5 6 6 7 7 8 8 9 10 2024-09-16T03:57:51.821 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $11 }' 2024-09-16T03:57:51.823 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=4 2024-09-16T03:57:51.823 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test 4 = 0 2024-09-16T03:57:51.823 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test 4 = 4 2024-09-16T03:57:51.823 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 11 + 1 2024-09-16T03:57:51.824 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=12 2024-09-16T03:57:51.824 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T03:57:51.824 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo -4 -2 0 0 1 1 2 2 3 3 4 5 5 6 6 7 7 8 8 9 10 2024-09-16T03:57:51.825 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $12 }' 2024-09-16T03:57:51.827 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=5 2024-09-16T03:57:51.827 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test 5 = 0 2024-09-16T03:57:51.827 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test 5 = 5 2024-09-16T03:57:51.827 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 12 + 1 2024-09-16T03:57:51.828 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=13 2024-09-16T03:57:51.828 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T03:57:51.829 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo -4 -2 0 0 1 1 2 2 3 3 4 5 5 6 6 7 7 8 8 9 10 2024-09-16T03:57:51.829 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $13 }' 2024-09-16T03:57:51.831 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=5 2024-09-16T03:57:51.831 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test 5 = 0 2024-09-16T03:57:51.831 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test 5 = 5 2024-09-16T03:57:51.831 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 13 + 1 2024-09-16T03:57:51.832 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=14 2024-09-16T03:57:51.832 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T03:57:51.833 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo -4 -2 0 0 1 1 2 2 3 3 4 5 5 6 6 7 7 8 8 9 10 2024-09-16T03:57:51.833 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $14 }' 2024-09-16T03:57:51.834 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=6 2024-09-16T03:57:51.834 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test 6 = 0 2024-09-16T03:57:51.834 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test 6 = 6 2024-09-16T03:57:51.835 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 14 + 1 2024-09-16T03:57:51.835 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=15 2024-09-16T03:57:51.835 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T03:57:51.836 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo -4 -2 0 0 1 1 2 2 3 3 4 5 5 6 6 7 7 8 8 9 10 2024-09-16T03:57:51.836 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $15 }' 2024-09-16T03:57:51.838 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=6 2024-09-16T03:57:51.838 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test 6 = 0 2024-09-16T03:57:51.838 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test 6 = 6 2024-09-16T03:57:51.839 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 15 + 1 2024-09-16T03:57:51.839 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=16 2024-09-16T03:57:51.839 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T03:57:51.840 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo -4 -2 0 0 1 1 2 2 3 3 4 5 5 6 6 7 7 8 8 9 10 2024-09-16T03:57:51.840 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $16 }' 2024-09-16T03:57:51.842 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=7 2024-09-16T03:57:51.842 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test 7 = 0 2024-09-16T03:57:51.842 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test 7 = 7 2024-09-16T03:57:51.843 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 16 + 1 2024-09-16T03:57:51.843 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=17 2024-09-16T03:57:51.843 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T03:57:51.844 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo -4 -2 0 0 1 1 2 2 3 3 4 5 5 6 6 7 7 8 8 9 10 2024-09-16T03:57:51.844 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $17 }' 2024-09-16T03:57:51.846 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=7 2024-09-16T03:57:51.846 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test 7 = 0 2024-09-16T03:57:51.846 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test 7 = 7 2024-09-16T03:57:51.847 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 17 + 1 2024-09-16T03:57:51.847 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=18 2024-09-16T03:57:51.847 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T03:57:51.848 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo -4 -2 0 0 1 1 2 2 3 3 4 5 5 6 6 7 7 8 8 9 10 2024-09-16T03:57:51.848 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $18 }' 2024-09-16T03:57:51.850 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=8 2024-09-16T03:57:51.850 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test 8 = 0 2024-09-16T03:57:51.850 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test 8 = 8 2024-09-16T03:57:51.851 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 18 + 1 2024-09-16T03:57:51.851 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=19 2024-09-16T03:57:51.851 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T03:57:51.852 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo -4 -2 0 0 1 1 2 2 3 3 4 5 5 6 6 7 7 8 8 9 10 2024-09-16T03:57:51.852 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $19 }' 2024-09-16T03:57:51.854 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=8 2024-09-16T03:57:51.854 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test 8 = 0 2024-09-16T03:57:51.854 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test 8 = 8 2024-09-16T03:57:51.854 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 19 + 1 2024-09-16T03:57:51.855 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=20 2024-09-16T03:57:51.855 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T03:57:51.856 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo -4 -2 0 0 1 1 2 2 3 3 4 5 5 6 6 7 7 8 8 9 10 2024-09-16T03:57:51.856 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $20 }' 2024-09-16T03:57:51.858 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=9 2024-09-16T03:57:51.858 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test 9 = 0 2024-09-16T03:57:51.858 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test 9 = 9 2024-09-16T03:57:51.858 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 20 + 1 2024-09-16T03:57:51.858 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=21 2024-09-16T03:57:51.859 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T03:57:51.859 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo -4 -2 0 0 1 1 2 2 3 3 4 5 5 6 6 7 7 8 8 9 10 2024-09-16T03:57:51.859 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $21 }' 2024-09-16T03:57:51.861 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=10 2024-09-16T03:57:51.861 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test 10 = 0 2024-09-16T03:57:51.861 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test 10 = 10 2024-09-16T03:57:51.862 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 21 + 1 2024-09-16T03:57:51.862 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=22 2024-09-16T03:57:51.863 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:33: run: teardown td/osd-pool-create 2024-09-16T03:57:51.863 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-pool-create 2024-09-16T03:57:51.863 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:57:51.863 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-pool-create KILL 2024-09-16T03:57:51.864 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:57:51.864 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:57:51.864 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:57:51.864 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:57:51.864 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:57:52.173 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:57:52.173 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:57:52.175 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:57:52.175 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:57:52.176 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:57:52.176 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:57:52.177 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:57:52.178 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:57:52.178 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:57:52.179 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:57:52.179 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:57:52.181 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:57:52.182 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:57:52.182 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-pool-create 2024-09-16T03:57:52.212 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:57:52.213 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:57:52.213 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:57:52.214 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.128966 2024-09-16T03:57:52.217 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:57:52.217 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:57:52.217 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:30: run: for func in $funcs 2024-09-16T03:57:52.217 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:31: run: setup td/osd-pool-create 2024-09-16T03:57:52.217 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-pool-create 2024-09-16T03:57:52.217 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-pool-create 2024-09-16T03:57:52.217 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-pool-create 2024-09-16T03:57:52.218 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:57:52.218 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-pool-create KILL 2024-09-16T03:57:52.218 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:57:52.218 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:57:52.218 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:57:52.218 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:57:52.218 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:57:52.218 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:57:52.219 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:57:52.220 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:57:52.220 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:57:52.220 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:57:52.220 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:57:52.220 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:57:52.221 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:57:52.221 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:57:52.221 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:57:52.222 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:57:52.223 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:57:52.223 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:57:52.223 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-pool-create 2024-09-16T03:57:52.225 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:57:52.225 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:57:52.225 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:57:52.225 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.128966 2024-09-16T03:57:52.226 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:57:52.226 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:57:52.226 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-pool-create 2024-09-16T03:57:52.227 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T03:57:52.227 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:57:52.228 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:57:52.228 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.128966 2024-09-16T03:57:52.232 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T03:57:52.232 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2024-09-16T03:57:52.232 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T03:57:52.232 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-pool-create 1' TERM HUP INT 2024-09-16T03:57:52.232 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:32: run: TEST_pool_both_prio_no_pos td/osd-pool-create 2024-09-16T03:57:52.233 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:298: TEST_pool_both_prio_no_pos: local dir=td/osd-pool-create 2024-09-16T03:57:52.233 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:299: TEST_pool_both_prio_no_pos: check_pool_priority td/osd-pool-create 20 '2 - 36' '-10 -9 -8 -8 -7 -7 -6 -6 -5 -5 -4 -3 -3 -2 -2 -1 -1 0 0 2 4' 2024-09-16T03:57:52.233 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:215: check_pool_priority: local dir=td/osd-pool-create 2024-09-16T03:57:52.233 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:216: check_pool_priority: shift 2024-09-16T03:57:52.233 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:217: check_pool_priority: local pools=20 2024-09-16T03:57:52.233 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:218: check_pool_priority: shift 2024-09-16T03:57:52.233 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:219: check_pool_priority: local 'spread=2 - 36' 2024-09-16T03:57:52.233 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:220: check_pool_priority: shift 2024-09-16T03:57:52.234 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:221: check_pool_priority: local 'results=-10 -9 -8 -8 -7 -7 -6 -6 -5 -5 -4 -3 -3 -2 -2 -1 -1 0 0 2 4' 2024-09-16T03:57:52.234 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:223: check_pool_priority: setup td/osd-pool-create 2024-09-16T03:57:52.234 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-pool-create 2024-09-16T03:57:52.234 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-pool-create 2024-09-16T03:57:52.236 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-pool-create 2024-09-16T03:57:52.236 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:57:52.236 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-pool-create KILL 2024-09-16T03:57:52.236 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:57:52.236 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:57:52.236 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:57:52.236 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:57:52.236 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:57:52.238 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:57:52.238 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:57:52.238 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:57:52.238 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:57:52.238 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:57:52.238 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:57:52.238 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:57:52.238 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:57:52.239 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:57:52.239 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:57:52.239 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:57:52.239 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:57:52.239 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:57:52.239 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-pool-create 2024-09-16T03:57:52.241 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:57:52.241 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:57:52.241 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:57:52.241 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.128966 2024-09-16T03:57:52.242 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:57:52.242 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:57:52.242 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-pool-create 2024-09-16T03:57:52.244 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T03:57:52.244 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:57:52.244 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:57:52.244 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.128966 2024-09-16T03:57:52.245 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T03:57:52.246 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2024-09-16T03:57:52.246 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T03:57:52.247 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-pool-create 1' TERM HUP INT 2024-09-16T03:57:52.247 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:225: check_pool_priority: EXTRA_OPTS=--debug_allow_any_pool_priority=true 2024-09-16T03:57:52.247 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:226: check_pool_priority: export EXTRA_OPTS 2024-09-16T03:57:52.247 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:227: check_pool_priority: run_mon td/osd-pool-create a 2024-09-16T03:57:52.247 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-pool-create 2024-09-16T03:57:52.247 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T03:57:52.247 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T03:57:52.247 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T03:57:52.247 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-pool-create/a 2024-09-16T03:57:52.247 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-pool-create/a --run-dir=td/osd-pool-create 2024-09-16T03:57:52.719 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T03:57:52.719 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:57:52.719 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:57:52.720 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:57:52.720 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:57:52.720 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:57:52.720 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T03:57:52.721 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug_allow_any_pool_priority=true --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-pool-create/a '--log-file=td/osd-pool-create/$name.log' '--admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' --mon-cluster-log-file=td/osd-pool-create/log --run-dir=td/osd-pool-create '--pid-file=td/osd-pool-create/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-09-16T03:57:52.920 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T03:57:52.921 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T03:57:52.921 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:57:52.921 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:57:52.921 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T03:57:52.922 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T03:57:52.922 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:57:52.922 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:57:52.923 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:57:52.923 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:57:52.923 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:57:52.923 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:57:52.923 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.128966/ceph-mon.a.asok 2024-09-16T03:57:52.923 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:57:52.923 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.128966/ceph-mon.a.asok config get fsid 2024-09-16T03:57:53.036 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T03:57:53.036 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:57:53.036 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:57:53.036 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T03:57:53.037 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:57:53.037 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:57:53.038 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:57:53.038 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T03:57:53.038 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:57:53.038 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:57:53.038 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:57:53.038 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.128966/ceph-mon.a.asok 2024-09-16T03:57:53.038 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:57:53.038 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.128966/ceph-mon.a.asok config get mon_host 2024-09-16T03:57:53.138 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:228: check_pool_priority: run_mgr td/osd-pool-create x 2024-09-16T03:57:53.138 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-pool-create 2024-09-16T03:57:53.138 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2024-09-16T03:57:53.138 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2024-09-16T03:57:53.138 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2024-09-16T03:57:53.138 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-pool-create/x 2024-09-16T03:57:53.139 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2024-09-16T03:57:54.043 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2024-09-16T03:57:54.044 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:57:54.044 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:57:54.044 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:57:54.044 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:57:54.044 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:57:54.044 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T03:57:54.045 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T03:57:54.045 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --debug_allow_any_pool_priority=true --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-pool-create/x '--log-file=td/osd-pool-create/$name.log' '--admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' --run-dir=td/osd-pool-create '--pid-file=td/osd-pool-create/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T03:57:54.077 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:229: check_pool_priority: run_osd td/osd-pool-create 0 2024-09-16T03:57:54.077 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-pool-create 2024-09-16T03:57:54.077 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T03:57:54.077 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2024-09-16T03:57:54.077 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T03:57:54.077 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-pool-create/0 2024-09-16T03:57:54.077 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=38a92d84-8703-45d8-b5ef-7d976430f112 --auth-supported=none --mon-host=127.0.0.1:7105 ' 2024-09-16T03:57:54.077 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T03:57:54.077 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T03:57:54.077 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T03:57:54.078 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-pool-create/0' 2024-09-16T03:57:54.078 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-pool-create/0/journal' 2024-09-16T03:57:54.078 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T03:57:54.078 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+=--debug_allow_any_pool_priority=true 2024-09-16T03:57:54.078 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-pool-create' 2024-09-16T03:57:54.078 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T03:57:54.078 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:57:54.078 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:57:54.078 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:57:54.078 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:57:54.078 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:57:54.078 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T03:57:54.079 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T03:57:54.079 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T03:57:54.079 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T03:57:54.079 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T03:57:54.079 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-pool-create/$name.log' 2024-09-16T03:57:54.079 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-pool-create/$name.pid' 2024-09-16T03:57:54.079 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T03:57:54.079 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T03:57:54.079 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T03:57:54.079 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T03:57:54.079 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T03:57:54.079 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T03:57:54.080 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-pool-create/0 2024-09-16T03:57:54.080 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T03:57:54.080 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=2a46a48b-7dad-45d0-b564-7d8e7b42c6cb 2024-09-16T03:57:54.081 INFO:tasks.workunit.client.0.smithi096.stdout:add osd0 2a46a48b-7dad-45d0-b564-7d8e7b42c6cb 2024-09-16T03:57:54.081 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 2a46a48b-7dad-45d0-b564-7d8e7b42c6cb' 2024-09-16T03:57:54.081 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T03:57:54.094 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDCrOdmpjCYBRAAg4Zw/tc/fSb2U+nau3+L8g== 2024-09-16T03:57:54.094 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDCrOdmpjCYBRAAg4Zw/tc/fSb2U+nau3+L8g=="}' 2024-09-16T03:57:54.094 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 2a46a48b-7dad-45d0-b564-7d8e7b42c6cb -i td/osd-pool-create/0/new.json 2024-09-16T03:57:54.367 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T03:57:54.381 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-pool-create/0/new.json 2024-09-16T03:57:54.382 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=38a92d84-8703-45d8-b5ef-7d976430f112 --auth-supported=none --mon-host=127.0.0.1:7105 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-pool-create/0 --osd-journal=td/osd-pool-create/0/journal --chdir=--debug_allow_any_pool_priority=true --run-dir=td/osd-pool-create '--admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-pool-create/$name.log' '--pid-file=td/osd-pool-create/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDCrOdmpjCYBRAAg4Zw/tc/fSb2U+nau3+L8g== --osd-uuid 2a46a48b-7dad-45d0-b564-7d8e7b42c6cb 2024-09-16T03:57:54.407 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:57:54.403+0000 7f202a8217c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:57:54.436 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:57:54.431+0000 7f202a8217c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:57:54.437 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:57:54.431+0000 7f202a8217c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:57:54.437 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:57:54.435+0000 7f202a8217c0 -1 global_init_chdir: failed to chdir to directory: '--debug_allow_any_pool_priority=true': (2) No such file or directory 2024-09-16T03:57:54.438 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:57:54.435+0000 7f202a8217c0 -1 bdev(0x557bfb9ae800 td/osd-pool-create/0/block) open stat got: (1) Operation not permitted 2024-09-16T03:57:54.438 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:57:54.435+0000 7f202a8217c0 -1 bluestore(td/osd-pool-create/0) _read_fsid unparsable uuid 2024-09-16T03:58:00.747 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-pool-create/0/keyring 2024-09-16T03:58:00.747 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T03:58:00.749 INFO:tasks.workunit.client.0.smithi096.stdout:adding osd0 key to auth repository 2024-09-16T03:58:00.749 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2024-09-16T03:58:00.749 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-pool-create/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T03:58:01.387 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2024-09-16T03:58:01.387 INFO:tasks.workunit.client.0.smithi096.stdout:start osd.0 2024-09-16T03:58:01.388 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=38a92d84-8703-45d8-b5ef-7d976430f112 --auth-supported=none --mon-host=127.0.0.1:7105 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-pool-create/0 --osd-journal=td/osd-pool-create/0/journal --chdir=--debug_allow_any_pool_priority=true --run-dir=td/osd-pool-create '--admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-pool-create/$name.log' '--pid-file=td/osd-pool-create/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T03:58:01.388 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T03:58:01.388 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T03:58:01.388 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T03:58:01.416 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:58:01.411+0000 7f1d8984c7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:58:01.418 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:58:01.415+0000 7f1d8984c7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:58:01.420 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:58:01.415+0000 7f1d8984c7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:58:01.420 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:58:01.415+0000 7f1d8984c7c0 -1 global_init_chdir: failed to chdir to directory: '--debug_allow_any_pool_priority=true': (2) No such file or directory 2024-09-16T03:58:01.813 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2024-09-16T03:58:01.813 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:58:01.813 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2024-09-16T03:58:01.813 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:58:01.813 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:58:01.813 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:58:01.814 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:58:01.814 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T03:58:01.814 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:58:01.814 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:58:02.270 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:58:02.908 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:58:02.903+0000 7f1d8984c7c0 -1 Falling back to public interface 2024-09-16T03:58:02.910 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:58:02.907+0000 7f1d8984c7c0 -1 global_init_chdir: failed to chdir to directory: '--debug_allow_any_pool_priority=true': (2) No such file or directory 2024-09-16T03:58:03.272 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:58:03.272 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:58:03.272 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T03:58:03.272 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T03:58:03.273 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:58:03.273 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:58:03.692 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:58:04.693 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:58:04.694 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:58:04.694 INFO:tasks.workunit.client.0.smithi096.stdout:2 2024-09-16T03:58:04.695 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T03:58:04.695 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:58:04.695 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:58:05.190 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:58:05.746 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:58:05.743+0000 7f1d8984c7c0 -1 osd.0 0 log_to_monitors true 2024-09-16T03:58:06.192 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:58:06.192 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:58:06.192 INFO:tasks.workunit.client.0.smithi096.stdout:3 2024-09-16T03:58:06.193 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T03:58:06.193 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:58:06.193 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:58:06.788 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:58:07.790 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:58:07.790 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:58:07.790 INFO:tasks.workunit.client.0.smithi096.stdout:4 2024-09-16T03:58:07.791 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T03:58:07.791 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:58:07.791 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:58:08.223 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:58:09.224 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:58:09.225 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:58:09.225 INFO:tasks.workunit.client.0.smithi096.stdout:5 2024-09-16T03:58:09.225 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T03:58:09.225 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:58:09.226 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:58:09.695 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:58:10.696 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:58:10.696 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:58:10.697 INFO:tasks.workunit.client.0.smithi096.stdout:6 2024-09-16T03:58:10.697 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T03:58:10.697 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:58:10.697 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:58:11.152 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:58:12.154 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:58:12.154 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:58:12.154 INFO:tasks.workunit.client.0.smithi096.stdout:7 2024-09-16T03:58:12.155 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T03:58:12.155 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:58:12.155 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:58:12.596 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:58:13.599 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:58:13.599 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:58:13.600 INFO:tasks.workunit.client.0.smithi096.stdout:8 2024-09-16T03:58:13.600 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T03:58:13.601 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:58:13.601 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:58:14.020 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:58:15.022 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:58:15.022 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:58:15.022 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T03:58:15.022 INFO:tasks.workunit.client.0.smithi096.stdout:9 2024-09-16T03:58:15.023 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:58:15.023 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:58:15.577 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:58:16.579 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:58:16.579 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:58:16.579 INFO:tasks.workunit.client.0.smithi096.stdout:10 2024-09-16T03:58:16.579 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T03:58:16.580 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:58:16.580 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:58:17.015 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:58:18.017 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:58:18.017 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:58:18.017 INFO:tasks.workunit.client.0.smithi096.stdout:11 2024-09-16T03:58:18.018 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T03:58:18.018 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:58:18.018 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:58:18.506 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:58:19.509 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:58:19.509 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:58:19.509 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T03:58:19.510 INFO:tasks.workunit.client.0.smithi096.stdout:12 2024-09-16T03:58:19.510 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:58:19.511 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:58:20.246 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:58:21.247 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:58:21.247 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:58:21.247 INFO:tasks.workunit.client.0.smithi096.stdout:13 2024-09-16T03:58:21.248 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T03:58:21.248 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:58:21.248 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:58:22.144 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:58:23.146 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:58:23.146 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:58:23.146 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T03:58:23.146 INFO:tasks.workunit.client.0.smithi096.stdout:14 2024-09-16T03:58:23.147 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:58:23.147 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:58:23.967 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:58:24.969 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:58:24.970 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:58:24.970 INFO:tasks.workunit.client.0.smithi096.stdout:15 2024-09-16T03:58:24.971 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T03:58:24.971 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:58:24.971 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:58:26.293 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:58:27.295 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:58:27.295 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:58:27.296 INFO:tasks.workunit.client.0.smithi096.stdout:16 2024-09-16T03:58:27.296 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T03:58:27.296 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:58:27.296 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:58:28.440 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:58:29.442 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:58:29.442 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:58:29.443 INFO:tasks.workunit.client.0.smithi096.stdout:17 2024-09-16T03:58:29.443 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T03:58:29.443 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:58:29.443 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:58:29.865 INFO:tasks.workunit.client.0.smithi096.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/2079339455,v1:127.0.0.1:6803/2079339455] [v2:127.0.0.1:6804/2079339455,v1:127.0.0.1:6805/2079339455] exists,up 2a46a48b-7dad-45d0-b564-7d8e7b42c6cb 2024-09-16T03:58:29.868 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:58:29.868 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:58:29.868 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:58:29.868 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:230: check_pool_priority: run_osd td/osd-pool-create 1 2024-09-16T03:58:29.868 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-pool-create 2024-09-16T03:58:29.869 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T03:58:29.869 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2024-09-16T03:58:29.869 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T03:58:29.869 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-pool-create/1 2024-09-16T03:58:29.869 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=38a92d84-8703-45d8-b5ef-7d976430f112 --auth-supported=none --mon-host=127.0.0.1:7105 ' 2024-09-16T03:58:29.869 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T03:58:29.869 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T03:58:29.869 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T03:58:29.869 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-pool-create/1' 2024-09-16T03:58:29.870 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-pool-create/1/journal' 2024-09-16T03:58:29.870 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T03:58:29.870 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+=--debug_allow_any_pool_priority=true 2024-09-16T03:58:29.870 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-pool-create' 2024-09-16T03:58:29.870 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T03:58:29.870 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:58:29.870 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:58:29.870 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:58:29.870 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:58:29.870 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:58:29.870 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T03:58:29.870 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T03:58:29.871 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T03:58:29.871 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T03:58:29.871 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T03:58:29.871 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-pool-create/$name.log' 2024-09-16T03:58:29.871 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-pool-create/$name.pid' 2024-09-16T03:58:29.871 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T03:58:29.871 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T03:58:29.871 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T03:58:29.871 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T03:58:29.871 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T03:58:29.871 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T03:58:29.871 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-pool-create/1 2024-09-16T03:58:29.872 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T03:58:29.872 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=5ee4abe9-b499-40fb-a57e-12a3d2502387 2024-09-16T03:58:29.872 INFO:tasks.workunit.client.0.smithi096.stdout:add osd1 5ee4abe9-b499-40fb-a57e-12a3d2502387 2024-09-16T03:58:29.873 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 5ee4abe9-b499-40fb-a57e-12a3d2502387' 2024-09-16T03:58:29.873 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T03:58:29.891 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDlrOdmKn8XNRAAK/vNDjMRXcGycZdAC4uGVg== 2024-09-16T03:58:29.891 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDlrOdmKn8XNRAAK/vNDjMRXcGycZdAC4uGVg=="}' 2024-09-16T03:58:29.892 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 5ee4abe9-b499-40fb-a57e-12a3d2502387 -i td/osd-pool-create/1/new.json 2024-09-16T03:58:30.442 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T03:58:30.458 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-pool-create/1/new.json 2024-09-16T03:58:30.459 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=38a92d84-8703-45d8-b5ef-7d976430f112 --auth-supported=none --mon-host=127.0.0.1:7105 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-pool-create/1 --osd-journal=td/osd-pool-create/1/journal --chdir=--debug_allow_any_pool_priority=true --run-dir=td/osd-pool-create '--admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-pool-create/$name.log' '--pid-file=td/osd-pool-create/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDlrOdmKn8XNRAAK/vNDjMRXcGycZdAC4uGVg== --osd-uuid 5ee4abe9-b499-40fb-a57e-12a3d2502387 2024-09-16T03:58:30.491 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:58:30.486+0000 7f6c24d3a7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:58:30.504 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:58:30.498+0000 7f6c24d3a7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:58:30.505 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:58:30.502+0000 7f6c24d3a7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:58:30.506 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:58:30.502+0000 7f6c24d3a7c0 -1 global_init_chdir: failed to chdir to directory: '--debug_allow_any_pool_priority=true': (2) No such file or directory 2024-09-16T03:58:30.506 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:58:30.502+0000 7f6c24d3a7c0 -1 bdev(0x564b0b615c00 td/osd-pool-create/1/block) open stat got: (1) Operation not permitted 2024-09-16T03:58:30.506 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:58:30.502+0000 7f6c24d3a7c0 -1 bluestore(td/osd-pool-create/1) _read_fsid unparsable uuid 2024-09-16T03:58:36.627 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-pool-create/1/keyring 2024-09-16T03:58:36.627 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T03:58:36.629 INFO:tasks.workunit.client.0.smithi096.stdout:adding osd1 key to auth repository 2024-09-16T03:58:36.629 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2024-09-16T03:58:36.629 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-pool-create/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T03:58:37.192 INFO:tasks.workunit.client.0.smithi096.stdout:start osd.1 2024-09-16T03:58:37.192 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2024-09-16T03:58:37.192 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T03:58:37.193 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T03:58:37.193 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=38a92d84-8703-45d8-b5ef-7d976430f112 --auth-supported=none --mon-host=127.0.0.1:7105 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-pool-create/1 --osd-journal=td/osd-pool-create/1/journal --chdir=--debug_allow_any_pool_priority=true --run-dir=td/osd-pool-create '--admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-pool-create/$name.log' '--pid-file=td/osd-pool-create/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T03:58:37.193 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T03:58:37.222 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:58:37.218+0000 7fe83414d7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:58:37.240 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:58:37.234+0000 7fe83414d7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:58:37.241 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:58:37.234+0000 7fe83414d7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:58:37.241 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:58:37.238+0000 7fe83414d7c0 -1 global_init_chdir: failed to chdir to directory: '--debug_allow_any_pool_priority=true': (2) No such file or directory 2024-09-16T03:58:37.669 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2024-09-16T03:58:37.669 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:58:37.669 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2024-09-16T03:58:37.669 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:58:37.669 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:58:37.669 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:58:37.670 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T03:58:37.670 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:58:37.670 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:58:37.670 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:58:38.126 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:58:38.496 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:58:38.490+0000 7fe83414d7c0 -1 Falling back to public interface 2024-09-16T03:58:38.500 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:58:38.494+0000 7fe83414d7c0 -1 global_init_chdir: failed to chdir to directory: '--debug_allow_any_pool_priority=true': (2) No such file or directory 2024-09-16T03:58:39.128 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:58:39.128 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:58:39.129 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T03:58:39.129 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T03:58:39.130 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:58:39.130 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:58:39.547 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:58:40.549 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:58:40.549 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:58:40.549 INFO:tasks.workunit.client.0.smithi096.stdout:2 2024-09-16T03:58:40.550 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T03:58:40.550 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:58:40.550 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:58:40.986 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:58:41.370 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:58:41.366+0000 7fe83414d7c0 -1 osd.1 0 log_to_monitors true 2024-09-16T03:58:41.987 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:58:41.987 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:58:41.988 INFO:tasks.workunit.client.0.smithi096.stdout:3 2024-09-16T03:58:41.988 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T03:58:41.988 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:58:41.988 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:58:42.599 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:58:43.601 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:58:43.601 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:58:43.601 INFO:tasks.workunit.client.0.smithi096.stdout:4 2024-09-16T03:58:43.602 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T03:58:43.602 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:58:43.602 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:58:44.051 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:58:45.052 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:58:45.053 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:58:45.053 INFO:tasks.workunit.client.0.smithi096.stdout:5 2024-09-16T03:58:45.053 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T03:58:45.053 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:58:45.053 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:58:45.709 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:58:46.711 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:58:46.711 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:58:46.711 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T03:58:46.712 INFO:tasks.workunit.client.0.smithi096.stdout:6 2024-09-16T03:58:46.712 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:58:46.712 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:58:47.267 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:58:48.269 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:58:48.269 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:58:48.270 INFO:tasks.workunit.client.0.smithi096.stdout:7 2024-09-16T03:58:48.270 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T03:58:48.271 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:58:48.271 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:58:48.701 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:58:49.703 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:58:49.703 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:58:49.703 INFO:tasks.workunit.client.0.smithi096.stdout:8 2024-09-16T03:58:49.704 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T03:58:49.704 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:58:49.704 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:58:50.254 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:58:51.256 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:58:51.256 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:58:51.256 INFO:tasks.workunit.client.0.smithi096.stdout:9 2024-09-16T03:58:51.257 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T03:58:51.257 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:58:51.257 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:58:51.722 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:58:52.724 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:58:52.725 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:58:52.725 INFO:tasks.workunit.client.0.smithi096.stdout:10 2024-09-16T03:58:52.725 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T03:58:52.726 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:58:52.726 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:58:53.280 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:58:54.282 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:58:54.282 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:58:54.282 INFO:tasks.workunit.client.0.smithi096.stdout:11 2024-09-16T03:58:54.283 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T03:58:54.283 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:58:54.283 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:58:54.922 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:58:55.924 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:58:55.924 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:58:55.924 INFO:tasks.workunit.client.0.smithi096.stdout:12 2024-09-16T03:58:55.925 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T03:58:55.925 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:58:55.925 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:58:57.002 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:58:58.004 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:58:58.004 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:58:58.005 INFO:tasks.workunit.client.0.smithi096.stdout:13 2024-09-16T03:58:58.005 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T03:58:58.005 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:58:58.005 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:58:58.806 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:58:59.807 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:58:59.807 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:58:59.808 INFO:tasks.workunit.client.0.smithi096.stdout:14 2024-09-16T03:58:59.808 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T03:58:59.808 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:58:59.808 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:59:00.813 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:59:01.815 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:59:01.815 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:59:01.815 INFO:tasks.workunit.client.0.smithi096.stdout:15 2024-09-16T03:59:01.815 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T03:59:01.816 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:59:01.816 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:59:02.873 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:59:03.875 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:59:03.876 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:59:03.876 INFO:tasks.workunit.client.0.smithi096.stdout:16 2024-09-16T03:59:03.876 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T03:59:03.877 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:59:03.877 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:59:04.915 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:59:05.917 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:59:05.917 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:59:05.917 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T03:59:05.917 INFO:tasks.workunit.client.0.smithi096.stdout:17 2024-09-16T03:59:05.918 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:59:05.918 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:59:06.387 INFO:tasks.workunit.client.0.smithi096.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/1157244823,v1:127.0.0.1:6811/1157244823] [v2:127.0.0.1:6812/1157244823,v1:127.0.0.1:6813/1157244823] exists,up 5ee4abe9-b499-40fb-a57e-12a3d2502387 2024-09-16T03:59:06.390 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:59:06.390 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:59:06.390 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:59:06.391 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:231: check_pool_priority: run_osd td/osd-pool-create 2 2024-09-16T03:59:06.391 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-pool-create 2024-09-16T03:59:06.391 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T03:59:06.391 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2024-09-16T03:59:06.391 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T03:59:06.391 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-pool-create/2 2024-09-16T03:59:06.391 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=38a92d84-8703-45d8-b5ef-7d976430f112 --auth-supported=none --mon-host=127.0.0.1:7105 ' 2024-09-16T03:59:06.391 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T03:59:06.391 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T03:59:06.391 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T03:59:06.391 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-pool-create/2' 2024-09-16T03:59:06.391 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-pool-create/2/journal' 2024-09-16T03:59:06.392 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T03:59:06.392 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+=--debug_allow_any_pool_priority=true 2024-09-16T03:59:06.392 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-pool-create' 2024-09-16T03:59:06.392 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T03:59:06.392 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:59:06.392 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:59:06.392 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:59:06.392 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:59:06.392 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T03:59:06.392 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T03:59:06.392 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T03:59:06.392 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T03:59:06.393 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T03:59:06.393 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T03:59:06.393 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-pool-create/$name.log' 2024-09-16T03:59:06.393 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-pool-create/$name.pid' 2024-09-16T03:59:06.393 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T03:59:06.393 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T03:59:06.393 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T03:59:06.393 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T03:59:06.393 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T03:59:06.393 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T03:59:06.393 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-pool-create/2 2024-09-16T03:59:06.394 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T03:59:06.394 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=160ceeb1-2b72-46b6-a631-9022d87b853a 2024-09-16T03:59:06.394 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 160ceeb1-2b72-46b6-a631-9022d87b853a' 2024-09-16T03:59:06.394 INFO:tasks.workunit.client.0.smithi096.stdout:add osd2 160ceeb1-2b72-46b6-a631-9022d87b853a 2024-09-16T03:59:06.395 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T03:59:06.414 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAKredm2E+pGBAAcpqZ+mTnet6OvLtujEeWcw== 2024-09-16T03:59:06.414 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAKredm2E+pGBAAcpqZ+mTnet6OvLtujEeWcw=="}' 2024-09-16T03:59:06.414 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 160ceeb1-2b72-46b6-a631-9022d87b853a -i td/osd-pool-create/2/new.json 2024-09-16T03:59:07.000 INFO:tasks.workunit.client.0.smithi096.stdout:2 2024-09-16T03:59:07.016 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-pool-create/2/new.json 2024-09-16T03:59:07.018 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=38a92d84-8703-45d8-b5ef-7d976430f112 --auth-supported=none --mon-host=127.0.0.1:7105 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-pool-create/2 --osd-journal=td/osd-pool-create/2/journal --chdir=--debug_allow_any_pool_priority=true --run-dir=td/osd-pool-create '--admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-pool-create/$name.log' '--pid-file=td/osd-pool-create/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAKredm2E+pGBAAcpqZ+mTnet6OvLtujEeWcw== --osd-uuid 160ceeb1-2b72-46b6-a631-9022d87b853a 2024-09-16T03:59:07.044 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:59:07.042+0000 7f71be4fa7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:59:07.063 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:59:07.062+0000 7f71be4fa7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:59:07.065 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:59:07.062+0000 7f71be4fa7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:59:07.065 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:59:07.062+0000 7f71be4fa7c0 -1 global_init_chdir: failed to chdir to directory: '--debug_allow_any_pool_priority=true': (2) No such file or directory 2024-09-16T03:59:07.065 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:59:07.066+0000 7f71be4fa7c0 -1 bdev(0x55c3969f5c00 td/osd-pool-create/2/block) open stat got: (1) Operation not permitted 2024-09-16T03:59:07.065 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:59:07.066+0000 7f71be4fa7c0 -1 bluestore(td/osd-pool-create/2) _read_fsid unparsable uuid 2024-09-16T03:59:13.286 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-pool-create/2/keyring 2024-09-16T03:59:13.286 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T03:59:13.288 INFO:tasks.workunit.client.0.smithi096.stdout:adding osd2 key to auth repository 2024-09-16T03:59:13.288 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2024-09-16T03:59:13.289 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-pool-create/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T03:59:13.856 INFO:tasks.workunit.client.0.smithi096.stdout:start osd.2 2024-09-16T03:59:13.857 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2024-09-16T03:59:13.857 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T03:59:13.857 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=38a92d84-8703-45d8-b5ef-7d976430f112 --auth-supported=none --mon-host=127.0.0.1:7105 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-pool-create/2 --osd-journal=td/osd-pool-create/2/journal --chdir=--debug_allow_any_pool_priority=true --run-dir=td/osd-pool-create '--admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-pool-create/$name.log' '--pid-file=td/osd-pool-create/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T03:59:13.857 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T03:59:13.858 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T03:59:13.889 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:59:13.886+0000 7f906d3de7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:59:13.900 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:59:13.898+0000 7f906d3de7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:59:13.901 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:59:13.902+0000 7f906d3de7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:59:13.901 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:59:13.902+0000 7f906d3de7c0 -1 global_init_chdir: failed to chdir to directory: '--debug_allow_any_pool_priority=true': (2) No such file or directory 2024-09-16T03:59:14.328 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2024-09-16T03:59:14.328 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:59:14.328 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2024-09-16T03:59:14.328 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T03:59:14.329 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:59:14.329 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:59:14.329 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:59:14.329 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:59:14.329 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:59:14.329 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:59:14.757 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:59:14.944 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:59:14.942+0000 7f906d3de7c0 -1 Falling back to public interface 2024-09-16T03:59:14.949 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:59:14.946+0000 7f906d3de7c0 -1 global_init_chdir: failed to chdir to directory: '--debug_allow_any_pool_priority=true': (2) No such file or directory 2024-09-16T03:59:15.759 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:59:15.759 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:59:15.759 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T03:59:15.760 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T03:59:15.760 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:59:15.760 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:59:16.241 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:59:17.242 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:59:17.243 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:59:17.243 INFO:tasks.workunit.client.0.smithi096.stdout:2 2024-09-16T03:59:17.243 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T03:59:17.244 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:59:17.244 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:59:17.682 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:59:17.801 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T03:59:17.797+0000 7f906d3de7c0 -1 osd.2 0 log_to_monitors true 2024-09-16T03:59:18.683 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:59:18.683 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:59:18.683 INFO:tasks.workunit.client.0.smithi096.stdout:3 2024-09-16T03:59:18.684 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T03:59:18.684 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:59:18.684 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:59:19.184 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:59:20.186 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:59:20.186 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:59:20.186 INFO:tasks.workunit.client.0.smithi096.stdout:4 2024-09-16T03:59:20.187 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T03:59:20.187 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:59:20.187 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:59:20.739 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:59:21.741 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:59:21.741 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:59:21.741 INFO:tasks.workunit.client.0.smithi096.stdout:5 2024-09-16T03:59:21.742 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T03:59:21.742 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:59:21.742 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:59:22.170 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:59:23.171 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:59:23.171 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:59:23.171 INFO:tasks.workunit.client.0.smithi096.stdout:6 2024-09-16T03:59:23.172 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T03:59:23.172 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:59:23.172 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:59:23.839 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:59:24.840 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:59:24.841 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:59:24.841 INFO:tasks.workunit.client.0.smithi096.stdout:7 2024-09-16T03:59:24.841 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T03:59:24.842 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:59:24.842 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:59:25.475 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:59:26.477 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:59:26.477 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:59:26.478 INFO:tasks.workunit.client.0.smithi096.stdout:8 2024-09-16T03:59:26.478 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T03:59:26.478 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:59:26.478 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:59:26.982 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:59:27.983 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:59:27.984 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:59:27.984 INFO:tasks.workunit.client.0.smithi096.stdout:9 2024-09-16T03:59:27.984 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T03:59:27.984 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:59:27.985 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:59:28.435 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:59:29.437 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:59:29.437 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:59:29.437 INFO:tasks.workunit.client.0.smithi096.stdout:10 2024-09-16T03:59:29.438 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T03:59:29.438 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:59:29.438 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:59:30.001 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:59:31.003 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:59:31.003 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:59:31.003 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T03:59:31.004 INFO:tasks.workunit.client.0.smithi096.stdout:11 2024-09-16T03:59:31.004 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:59:31.004 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:59:31.952 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:59:32.954 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:59:32.954 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:59:32.954 INFO:tasks.workunit.client.0.smithi096.stdout:12 2024-09-16T03:59:32.954 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T03:59:32.955 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:59:32.955 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:59:33.806 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:59:34.808 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:59:34.808 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:59:34.809 INFO:tasks.workunit.client.0.smithi096.stdout:13 2024-09-16T03:59:34.809 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T03:59:34.809 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:59:34.809 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:59:36.066 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:59:37.069 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:59:37.069 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:59:37.069 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T03:59:37.069 INFO:tasks.workunit.client.0.smithi096.stdout:14 2024-09-16T03:59:37.069 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:59:37.070 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:59:37.808 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:59:38.809 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:59:38.810 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:59:38.810 INFO:tasks.workunit.client.0.smithi096.stdout:15 2024-09-16T03:59:38.810 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T03:59:38.810 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:59:38.811 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:59:39.966 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:59:40.967 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:59:40.967 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:59:40.968 INFO:tasks.workunit.client.0.smithi096.stdout:16 2024-09-16T03:59:40.968 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T03:59:40.968 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:59:40.968 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:59:41.449 INFO:tasks.workunit.client.0.smithi096.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/1717805395,v1:127.0.0.1:6819/1717805395] [v2:127.0.0.1:6820/1717805395,v1:127.0.0.1:6821/1717805395] exists,up 160ceeb1-2b72-46b6-a631-9022d87b853a 2024-09-16T03:59:41.449 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:59:41.449 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:59:41.449 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:59:41.450 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: seq 0 20 2024-09-16T03:59:41.450 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:59:41.451 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 0 + 1 2024-09-16T03:59:41.451 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=1 2024-09-16T03:59:41.451 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test1 1 1 2024-09-16T03:59:42.029 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test1' already exists 2024-09-16T03:59:42.045 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:59:42.045 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 1 + 1 2024-09-16T03:59:42.046 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=2 2024-09-16T03:59:42.046 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test2 1 1 2024-09-16T03:59:42.572 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test2' already exists 2024-09-16T03:59:42.589 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:59:42.589 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 2 + 1 2024-09-16T03:59:42.590 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=3 2024-09-16T03:59:42.590 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test3 1 1 2024-09-16T03:59:43.596 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test3' already exists 2024-09-16T03:59:43.617 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:59:43.617 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 3 + 1 2024-09-16T03:59:43.619 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=4 2024-09-16T03:59:43.619 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test4 1 1 2024-09-16T03:59:44.635 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test4' already exists 2024-09-16T03:59:44.652 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:59:44.653 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 4 + 1 2024-09-16T03:59:44.654 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=5 2024-09-16T03:59:44.654 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test5 1 1 2024-09-16T03:59:45.644 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test5' already exists 2024-09-16T03:59:45.661 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:59:45.661 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 5 + 1 2024-09-16T03:59:45.662 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=6 2024-09-16T03:59:45.662 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test6 1 1 2024-09-16T03:59:46.675 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test6' already exists 2024-09-16T03:59:46.691 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:59:46.692 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 6 + 1 2024-09-16T03:59:46.693 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=7 2024-09-16T03:59:46.693 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test7 1 1 2024-09-16T03:59:47.775 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test7' already exists 2024-09-16T03:59:47.800 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:59:47.800 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 7 + 1 2024-09-16T03:59:47.802 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=8 2024-09-16T03:59:47.802 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test8 1 1 2024-09-16T03:59:48.656 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test8' already exists 2024-09-16T03:59:48.673 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:59:48.673 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 8 + 1 2024-09-16T03:59:48.674 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=9 2024-09-16T03:59:48.674 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test9 1 1 2024-09-16T03:59:49.640 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test9' already exists 2024-09-16T03:59:49.657 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:59:49.657 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 9 + 1 2024-09-16T03:59:49.659 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=10 2024-09-16T03:59:49.659 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test10 1 1 2024-09-16T03:59:50.822 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test10' already exists 2024-09-16T03:59:50.839 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:59:50.840 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 10 + 1 2024-09-16T03:59:50.842 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=11 2024-09-16T03:59:50.842 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test11 1 1 2024-09-16T03:59:51.654 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test11' already exists 2024-09-16T03:59:51.672 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:59:51.672 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 11 + 1 2024-09-16T03:59:51.673 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=12 2024-09-16T03:59:51.673 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test12 1 1 2024-09-16T03:59:52.679 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test12' already exists 2024-09-16T03:59:52.696 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:59:52.697 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 12 + 1 2024-09-16T03:59:52.698 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=13 2024-09-16T03:59:52.698 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test13 1 1 2024-09-16T03:59:53.604 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test13' already exists 2024-09-16T03:59:53.621 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:59:53.622 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 13 + 1 2024-09-16T03:59:53.622 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=14 2024-09-16T03:59:53.622 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test14 1 1 2024-09-16T03:59:54.619 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test14' already exists 2024-09-16T03:59:54.637 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:59:54.637 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 14 + 1 2024-09-16T03:59:54.638 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=15 2024-09-16T03:59:54.638 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test15 1 1 2024-09-16T03:59:55.714 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test15' already exists 2024-09-16T03:59:55.737 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:59:55.737 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 15 + 1 2024-09-16T03:59:55.738 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=16 2024-09-16T03:59:55.738 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test16 1 1 2024-09-16T03:59:56.874 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test16' already exists 2024-09-16T03:59:56.890 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:59:56.891 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 16 + 1 2024-09-16T03:59:56.893 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=17 2024-09-16T03:59:56.893 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test17 1 1 2024-09-16T03:59:57.873 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test17' already exists 2024-09-16T03:59:57.891 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:59:57.891 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 17 + 1 2024-09-16T03:59:57.893 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=18 2024-09-16T03:59:57.893 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test18 1 1 2024-09-16T03:59:58.863 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test18' already exists 2024-09-16T03:59:58.880 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:59:58.880 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 18 + 1 2024-09-16T03:59:58.882 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=19 2024-09-16T03:59:58.882 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test19 1 1 2024-09-16T03:59:59.904 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test19' already exists 2024-09-16T03:59:59.920 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T03:59:59.921 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 19 + 1 2024-09-16T03:59:59.922 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=20 2024-09-16T03:59:59.922 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test20 1 1 2024-09-16T04:00:00.724 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test20' already exists 2024-09-16T04:00:00.742 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:00:00.743 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 20 + 1 2024-09-16T04:00:00.744 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=21 2024-09-16T04:00:00.744 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test21 1 1 2024-09-16T04:00:01.868 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test21' already exists 2024-09-16T04:00:01.888 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:240: check_pool_priority: wait_for_clean 2024-09-16T04:00:01.889 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1633: wait_for_clean: local cmd= 2024-09-16T04:00:01.889 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1634: wait_for_clean: local num_active_clean=-1 2024-09-16T04:00:01.889 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1635: wait_for_clean: local cur_active_clean 2024-09-16T04:00:01.889 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: get_timeout_delays 90 .1 2024-09-16T04:00:01.890 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: shopt -q -o xtrace 2024-09-16T04:00:01.890 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: echo true 2024-09-16T04:00:01.890 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: local trace=true 2024-09-16T04:00:01.890 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: true 2024-09-16T04:00:01.891 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: shopt -u -o xtrace 2024-09-16T04:00:02.002 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-09-16T04:00:02.002 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: local -a delays 2024-09-16T04:00:02.002 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1637: wait_for_clean: local -i loop=0 2024-09-16T04:00:02.002 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1639: wait_for_clean: flush_pg_stats 2024-09-16T04:00:02.002 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: local timeout=300 2024-09-16T04:00:02.003 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ceph osd ls 2024-09-16T04:00:02.665 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ids='0 2024-09-16T04:00:02.665 INFO:tasks.workunit.client.0.smithi096.stderr:1 2024-09-16T04:00:02.665 INFO:tasks.workunit.client.0.smithi096.stderr:2' 2024-09-16T04:00:02.665 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2208: flush_pg_stats: seqs= 2024-09-16T04:00:02.665 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:00:02.665 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-09-16T04:00:02.844 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=21474836510 2024-09-16T04:00:02.844 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 21474836510 2024-09-16T04:00:02.844 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836510' 2024-09-16T04:00:02.844 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:00:02.844 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-09-16T04:00:02.992 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=42949672981 2024-09-16T04:00:02.992 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 42949672981 2024-09-16T04:00:02.992 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836510 1-42949672981' 2024-09-16T04:00:02.992 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:00:02.992 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-09-16T04:00:03.158 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=64424509450 2024-09-16T04:00:03.158 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 64424509450 2024-09-16T04:00:03.158 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836510 1-42949672981 2-64424509450' 2024-09-16T04:00:03.159 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:00:03.159 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 0-21474836510 2024-09-16T04:00:03.159 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:00:03.160 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=0 2024-09-16T04:00:03.160 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 0-21474836510 2024-09-16T04:00:03.160 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:00:03.160 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=21474836510 2024-09-16T04:00:03.161 INFO:tasks.workunit.client.0.smithi096.stdout:waiting osd.0 seq 21474836510 2024-09-16T04:00:03.161 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.0 seq 21474836510' 2024-09-16T04:00:03.161 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T04:00:03.738 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836508 -lt 21474836510 2024-09-16T04:00:03.738 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: flush_pg_stats: sleep 1 2024-09-16T04:00:04.739 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2224: flush_pg_stats: '[' 300 -eq 0 ']' 2024-09-16T04:00:04.740 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T04:00:05.197 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836510 -lt 21474836510 2024-09-16T04:00:05.197 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:00:05.198 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 1-42949672981 2024-09-16T04:00:05.198 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:00:05.199 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=1 2024-09-16T04:00:05.200 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:00:05.200 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 1-42949672981 2024-09-16T04:00:05.201 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=42949672981 2024-09-16T04:00:05.201 INFO:tasks.workunit.client.0.smithi096.stdout:waiting osd.1 seq 42949672981 2024-09-16T04:00:05.201 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.1 seq 42949672981' 2024-09-16T04:00:05.202 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 1 2024-09-16T04:00:05.636 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 42949672981 -lt 42949672981 2024-09-16T04:00:05.636 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:00:05.637 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 2-64424509450 2024-09-16T04:00:05.637 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:00:05.639 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=2 2024-09-16T04:00:05.639 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 2-64424509450 2024-09-16T04:00:05.640 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:00:05.641 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=64424509450 2024-09-16T04:00:05.641 INFO:tasks.workunit.client.0.smithi096.stdout:waiting osd.2 seq 64424509450 2024-09-16T04:00:05.642 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.2 seq 64424509450' 2024-09-16T04:00:05.642 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 2 2024-09-16T04:00:06.069 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 64424509450 -lt 64424509450 2024-09-16T04:00:06.069 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: get_num_pgs 2024-09-16T04:00:06.070 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T04:00:06.070 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T04:00:06.629 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: test 21 == 0 2024-09-16T04:00:06.629 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T04:00:06.630 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T04:00:06.630 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T04:00:06.630 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T04:00:06.630 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T04:00:06.630 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T04:00:06.630 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T04:00:07.055 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=21 2024-09-16T04:00:07.055 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T04:00:07.056 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T04:00:07.056 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T04:00:07.650 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 21 = 21 2024-09-16T04:00:07.650 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: break 2024-09-16T04:00:07.650 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: return 0 2024-09-16T04:00:07.650 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: seq 0 20 2024-09-16T04:00:07.651 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:00:07.651 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 0 + 1 2024-09-16T04:00:07.652 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=1 2024-09-16T04:00:07.652 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 0 '*' 2 - 36 2024-09-16T04:00:07.653 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test1 recovery_priority -36 2024-09-16T04:00:08.320 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 1 recovery_priority to -36 2024-09-16T04:00:08.340 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:00:08.341 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 1 + 1 2024-09-16T04:00:08.342 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=2 2024-09-16T04:00:08.342 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 1 '*' 2 - 36 2024-09-16T04:00:08.343 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test2 recovery_priority -34 2024-09-16T04:00:09.082 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 2 recovery_priority to -34 2024-09-16T04:00:09.103 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:00:09.103 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 2 + 1 2024-09-16T04:00:09.104 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=3 2024-09-16T04:00:09.105 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 2 '*' 2 - 36 2024-09-16T04:00:09.106 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test3 recovery_priority -32 2024-09-16T04:00:09.902 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 3 recovery_priority to -32 2024-09-16T04:00:09.925 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:00:09.925 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 3 + 1 2024-09-16T04:00:09.927 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=4 2024-09-16T04:00:09.927 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 3 '*' 2 - 36 2024-09-16T04:00:09.929 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test4 recovery_priority -30 2024-09-16T04:00:10.849 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 4 recovery_priority to -30 2024-09-16T04:00:10.869 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:00:10.869 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 4 + 1 2024-09-16T04:00:10.870 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=5 2024-09-16T04:00:10.871 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 4 '*' 2 - 36 2024-09-16T04:00:10.871 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test5 recovery_priority -28 2024-09-16T04:00:11.782 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 5 recovery_priority to -28 2024-09-16T04:00:11.805 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:00:11.805 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 5 + 1 2024-09-16T04:00:11.806 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=6 2024-09-16T04:00:11.807 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 5 '*' 2 - 36 2024-09-16T04:00:11.808 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test6 recovery_priority -26 2024-09-16T04:00:12.844 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 6 recovery_priority to -26 2024-09-16T04:00:12.865 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:00:12.865 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 6 + 1 2024-09-16T04:00:12.866 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=7 2024-09-16T04:00:12.867 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 6 '*' 2 - 36 2024-09-16T04:00:12.868 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test7 recovery_priority -24 2024-09-16T04:00:13.657 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 7 recovery_priority to -24 2024-09-16T04:00:13.678 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:00:13.678 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 7 + 1 2024-09-16T04:00:13.679 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=8 2024-09-16T04:00:13.680 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 7 '*' 2 - 36 2024-09-16T04:00:13.681 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test8 recovery_priority -22 2024-09-16T04:00:14.586 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 8 recovery_priority to -22 2024-09-16T04:00:14.608 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:00:14.609 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 8 + 1 2024-09-16T04:00:14.610 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=9 2024-09-16T04:00:14.610 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 8 '*' 2 - 36 2024-09-16T04:00:14.611 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test9 recovery_priority -20 2024-09-16T04:00:15.552 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 9 recovery_priority to -20 2024-09-16T04:00:15.571 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:00:15.572 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 9 + 1 2024-09-16T04:00:15.573 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=10 2024-09-16T04:00:15.574 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 9 '*' 2 - 36 2024-09-16T04:00:15.575 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test10 recovery_priority -18 2024-09-16T04:00:16.546 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 10 recovery_priority to -18 2024-09-16T04:00:16.570 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:00:16.570 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 10 + 1 2024-09-16T04:00:16.571 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=11 2024-09-16T04:00:16.572 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 10 '*' 2 - 36 2024-09-16T04:00:16.573 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test11 recovery_priority -16 2024-09-16T04:00:17.701 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 11 recovery_priority to -16 2024-09-16T04:00:17.720 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:00:17.721 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 11 + 1 2024-09-16T04:00:17.722 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=12 2024-09-16T04:00:17.722 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 11 '*' 2 - 36 2024-09-16T04:00:17.724 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test12 recovery_priority -14 2024-09-16T04:00:18.462 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 12 recovery_priority to -14 2024-09-16T04:00:18.484 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:00:18.485 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 12 + 1 2024-09-16T04:00:18.486 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=13 2024-09-16T04:00:18.486 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 12 '*' 2 - 36 2024-09-16T04:00:18.487 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test13 recovery_priority -12 2024-09-16T04:00:19.367 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 13 recovery_priority to -12 2024-09-16T04:00:19.386 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:00:19.387 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 13 + 1 2024-09-16T04:00:19.387 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=14 2024-09-16T04:00:19.388 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 13 '*' 2 - 36 2024-09-16T04:00:19.390 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test14 recovery_priority -10 2024-09-16T04:00:20.211 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 14 recovery_priority to -10 2024-09-16T04:00:20.233 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:00:20.233 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 14 + 1 2024-09-16T04:00:20.234 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=15 2024-09-16T04:00:20.234 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 14 '*' 2 - 36 2024-09-16T04:00:20.235 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test15 recovery_priority -8 2024-09-16T04:00:21.083 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 15 recovery_priority to -8 2024-09-16T04:00:21.104 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:00:21.104 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 15 + 1 2024-09-16T04:00:21.106 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=16 2024-09-16T04:00:21.106 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 15 '*' 2 - 36 2024-09-16T04:00:21.107 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test16 recovery_priority -6 2024-09-16T04:00:22.062 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 16 recovery_priority to -6 2024-09-16T04:00:22.083 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:00:22.083 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 16 + 1 2024-09-16T04:00:22.085 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=17 2024-09-16T04:00:22.086 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 16 '*' 2 - 36 2024-09-16T04:00:22.087 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test17 recovery_priority -4 2024-09-16T04:00:22.740 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 17 recovery_priority to -4 2024-09-16T04:00:22.757 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:00:22.757 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 17 + 1 2024-09-16T04:00:22.758 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=18 2024-09-16T04:00:22.759 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 17 '*' 2 - 36 2024-09-16T04:00:22.761 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test18 recovery_priority -2 2024-09-16T04:00:23.611 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 18 recovery_priority to -2 2024-09-16T04:00:23.631 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:00:23.631 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 18 + 1 2024-09-16T04:00:23.632 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=19 2024-09-16T04:00:23.633 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 18 '*' 2 - 36 2024-09-16T04:00:23.634 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test19 recovery_priority 0 2024-09-16T04:00:24.464 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 19 recovery_priority to 0 2024-09-16T04:00:24.487 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:00:24.488 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 19 + 1 2024-09-16T04:00:24.489 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=20 2024-09-16T04:00:24.489 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 19 '*' 2 - 36 2024-09-16T04:00:24.491 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test20 recovery_priority 2 2024-09-16T04:00:25.386 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 20 recovery_priority to 2 2024-09-16T04:00:25.407 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:00:25.407 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 20 + 1 2024-09-16T04:00:25.408 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=21 2024-09-16T04:00:25.409 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 20 '*' 2 - 36 2024-09-16T04:00:25.409 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test21 recovery_priority 4 2024-09-16T04:00:26.274 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 21 recovery_priority to 4 2024-09-16T04:00:26.298 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:249: check_pool_priority: bin/ceph osd dump 2024-09-16T04:00:26.298 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh: line 249: bin/ceph: No such file or directory 2024-09-16T04:00:26.298 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:252: check_pool_priority: kill_daemons 2024-09-16T04:00:26.299 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T04:00:26.299 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T04:00:26.300 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T04:00:26.300 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T04:00:26.300 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T04:00:27.615 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T04:00:27.615 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:253: check_pool_priority: run_mon td/osd-pool-create a 2024-09-16T04:00:27.616 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-pool-create 2024-09-16T04:00:27.616 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T04:00:27.616 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T04:00:27.616 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T04:00:27.616 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-pool-create/a 2024-09-16T04:00:27.616 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-pool-create/a --run-dir=td/osd-pool-create 2024-09-16T04:00:27.640 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:00:27.636+0000 7f16e599ee00 -1 'td/osd-pool-create/a' already exists and is not empty: monitor may already exist 2024-09-16T04:00:27.646 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T04:00:27.646 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:00:27.646 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:00:27.647 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:00:27.647 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:00:27.647 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T04:00:27.647 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T04:00:27.647 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug_allow_any_pool_priority=true --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-pool-create/a '--log-file=td/osd-pool-create/$name.log' '--admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' --mon-cluster-log-file=td/osd-pool-create/log --run-dir=td/osd-pool-create '--pid-file=td/osd-pool-create/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-09-16T04:00:27.883 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T04:00:27.885 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T04:00:27.885 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T04:00:27.885 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T04:00:27.885 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T04:00:27.886 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T04:00:27.886 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T04:00:27.886 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T04:00:27.886 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T04:00:27.887 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T04:00:27.887 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:00:27.887 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T04:00:27.887 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.128966/ceph-mon.a.asok 2024-09-16T04:00:27.887 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T04:00:27.887 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.128966/ceph-mon.a.asok config get fsid 2024-09-16T04:00:28.001 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T04:00:28.002 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T04:00:28.002 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T04:00:28.002 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T04:00:28.002 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T04:00:28.002 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T04:00:28.002 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T04:00:28.002 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T04:00:28.003 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T04:00:28.003 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:00:28.003 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T04:00:28.004 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.128966/ceph-mon.a.asok 2024-09-16T04:00:28.004 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T04:00:28.004 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.128966/ceph-mon.a.asok config get mon_host 2024-09-16T04:00:28.107 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:254: check_pool_priority: run_mgr td/osd-pool-create x 2024-09-16T04:00:28.107 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-pool-create 2024-09-16T04:00:28.107 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2024-09-16T04:00:28.107 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2024-09-16T04:00:28.108 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2024-09-16T04:00:28.108 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-pool-create/x 2024-09-16T04:00:28.108 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2024-09-16T04:00:28.544 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2024-09-16T04:00:28.544 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:00:28.544 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:00:28.545 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:00:28.545 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:00:28.545 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T04:00:28.545 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T04:00:28.545 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T04:00:28.546 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --debug_allow_any_pool_priority=true --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-pool-create/x '--log-file=td/osd-pool-create/$name.log' '--admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' --run-dir=td/osd-pool-create '--pid-file=td/osd-pool-create/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T04:00:28.581 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:255: check_pool_priority: activate_osd td/osd-pool-create 0 2024-09-16T04:00:28.582 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-pool-create 2024-09-16T04:00:28.582 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2024-09-16T04:00:28.582 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2024-09-16T04:00:28.582 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2024-09-16T04:00:28.582 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-pool-create/0 2024-09-16T04:00:28.582 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=38a92d84-8703-45d8-b5ef-7d976430f112 --auth-supported=none --mon-host=127.0.0.1:7105 ' 2024-09-16T04:00:28.582 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T04:00:28.582 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T04:00:28.582 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T04:00:28.582 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-pool-create/0' 2024-09-16T04:00:28.582 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-pool-create/0/journal' 2024-09-16T04:00:28.582 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2024-09-16T04:00:28.583 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+=--debug_allow_any_pool_priority=true 2024-09-16T04:00:28.583 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-pool-create' 2024-09-16T04:00:28.583 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2024-09-16T04:00:28.583 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:00:28.583 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:00:28.583 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:00:28.583 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:00:28.583 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T04:00:28.583 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T04:00:28.583 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T04:00:28.583 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2024-09-16T04:00:28.583 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-pool-create/$name.log' 2024-09-16T04:00:28.583 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-pool-create/$name.pid' 2024-09-16T04:00:28.583 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T04:00:28.584 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T04:00:28.584 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T04:00:28.584 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T04:00:28.584 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2024-09-16T04:00:28.584 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2024-09-16T04:00:28.584 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-pool-create/0 2024-09-16T04:00:28.584 INFO:tasks.workunit.client.0.smithi096.stdout:start osd.0 2024-09-16T04:00:28.585 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2024-09-16T04:00:28.585 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=38a92d84-8703-45d8-b5ef-7d976430f112 --auth-supported=none --mon-host=127.0.0.1:7105 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-pool-create/0 --osd-journal=td/osd-pool-create/0/journal --chdir=--debug_allow_any_pool_priority=true --run-dir=td/osd-pool-create '--admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-pool-create/$name.log' '--pid-file=td/osd-pool-create/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T04:00:28.585 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-pool-create/0/whoami 2024-09-16T04:00:28.586 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2024-09-16T04:00:28.586 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2024-09-16T04:00:28.586 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2024-09-16T04:00:28.586 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2024-09-16T04:00:28.607 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:00:28.604+0000 7fe71340e7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:00:28.609 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:00:28.608+0000 7fe71340e7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:00:28.611 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:00:28.608+0000 7fe71340e7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:00:28.611 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:00:28.608+0000 7fe71340e7c0 -1 global_init_chdir: failed to chdir to directory: '--debug_allow_any_pool_priority=true': (2) No such file or directory 2024-09-16T04:00:29.026 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2024-09-16T04:00:29.026 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T04:00:29.026 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2024-09-16T04:00:29.026 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T04:00:29.026 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T04:00:29.027 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:00:29.027 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T04:00:29.027 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T04:00:29.027 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:00:29.027 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:00:29.569 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:00:30.240 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:00:30.236+0000 7fe71340e7c0 -1 Falling back to public interface 2024-09-16T04:00:30.241 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:00:30.240+0000 7fe71340e7c0 -1 global_init_chdir: failed to chdir to directory: '--debug_allow_any_pool_priority=true': (2) No such file or directory 2024-09-16T04:00:30.570 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:00:30.570 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:00:30.571 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T04:00:30.571 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T04:00:30.571 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:00:30.571 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:00:30.978 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:00:31.980 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:00:31.980 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:00:31.980 INFO:tasks.workunit.client.0.smithi096.stdout:2 2024-09-16T04:00:31.981 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T04:00:31.981 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:00:31.981 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:00:32.407 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:00:33.408 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:00:33.409 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:00:33.409 INFO:tasks.workunit.client.0.smithi096.stdout:3 2024-09-16T04:00:33.409 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T04:00:33.409 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:00:33.410 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:00:34.130 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:00:34.615 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:00:34.612+0000 7fe71340e7c0 -1 osd.0 105 log_to_monitors true 2024-09-16T04:00:35.131 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:00:35.132 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:00:35.132 INFO:tasks.workunit.client.0.smithi096.stdout:4 2024-09-16T04:00:35.132 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T04:00:35.132 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:00:35.133 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:00:35.645 INFO:tasks.workunit.client.0.smithi096.stdout:osd.0 up in weight 1 up_from 109 up_thru 53 down_at 106 last_clean_interval [5,105) [v2:127.0.0.1:6800/1308462607,v1:127.0.0.1:6801/1308462607] [v2:127.0.0.1:6802/1308462607,v1:127.0.0.1:6803/1308462607] exists,up 2a46a48b-7dad-45d0-b564-7d8e7b42c6cb 2024-09-16T04:00:35.647 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T04:00:35.647 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T04:00:35.647 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T04:00:35.647 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:256: check_pool_priority: activate_osd td/osd-pool-create 1 2024-09-16T04:00:35.648 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-pool-create 2024-09-16T04:00:35.648 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2024-09-16T04:00:35.648 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2024-09-16T04:00:35.648 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2024-09-16T04:00:35.648 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-pool-create/1 2024-09-16T04:00:35.648 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=38a92d84-8703-45d8-b5ef-7d976430f112 --auth-supported=none --mon-host=127.0.0.1:7105 ' 2024-09-16T04:00:35.648 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T04:00:35.648 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T04:00:35.648 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T04:00:35.648 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-pool-create/1' 2024-09-16T04:00:35.648 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-pool-create/1/journal' 2024-09-16T04:00:35.648 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2024-09-16T04:00:35.649 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+=--debug_allow_any_pool_priority=true 2024-09-16T04:00:35.649 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-pool-create' 2024-09-16T04:00:35.649 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2024-09-16T04:00:35.649 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:00:35.649 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:00:35.650 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:00:35.650 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:00:35.650 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T04:00:35.651 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T04:00:35.651 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T04:00:35.651 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2024-09-16T04:00:35.651 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-pool-create/$name.log' 2024-09-16T04:00:35.651 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-pool-create/$name.pid' 2024-09-16T04:00:35.651 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T04:00:35.651 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T04:00:35.651 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T04:00:35.651 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T04:00:35.651 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2024-09-16T04:00:35.651 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2024-09-16T04:00:35.651 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-pool-create/1 2024-09-16T04:00:35.652 INFO:tasks.workunit.client.0.smithi096.stdout:start osd.1 2024-09-16T04:00:35.653 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2024-09-16T04:00:35.653 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=38a92d84-8703-45d8-b5ef-7d976430f112 --auth-supported=none --mon-host=127.0.0.1:7105 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-pool-create/1 --osd-journal=td/osd-pool-create/1/journal --chdir=--debug_allow_any_pool_priority=true --run-dir=td/osd-pool-create '--admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-pool-create/$name.log' '--pid-file=td/osd-pool-create/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T04:00:35.653 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-pool-create/1/whoami 2024-09-16T04:00:35.653 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2024-09-16T04:00:35.653 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2024-09-16T04:00:35.653 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2024-09-16T04:00:35.653 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2024-09-16T04:00:35.679 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:00:35.676+0000 7f66ff7dc7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:00:35.728 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:00:35.724+0000 7f66ff7dc7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:00:35.730 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:00:35.728+0000 7f66ff7dc7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:00:35.730 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:00:35.728+0000 7f66ff7dc7c0 -1 global_init_chdir: failed to chdir to directory: '--debug_allow_any_pool_priority=true': (2) No such file or directory 2024-09-16T04:00:36.077 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2024-09-16T04:00:36.077 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T04:00:36.077 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2024-09-16T04:00:36.078 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T04:00:36.078 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T04:00:36.078 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T04:00:36.078 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:00:36.078 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T04:00:36.079 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:00:36.079 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:00:36.551 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:00:37.020 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:00:37.016+0000 7f66ff7dc7c0 -1 Falling back to public interface 2024-09-16T04:00:37.024 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:00:37.020+0000 7f66ff7dc7c0 -1 global_init_chdir: failed to chdir to directory: '--debug_allow_any_pool_priority=true': (2) No such file or directory 2024-09-16T04:00:37.552 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:00:37.553 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:00:37.553 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T04:00:37.553 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T04:00:37.553 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:00:37.554 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:00:38.036 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:00:39.037 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:00:39.037 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:00:39.038 INFO:tasks.workunit.client.0.smithi096.stdout:2 2024-09-16T04:00:39.038 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T04:00:39.038 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:00:39.038 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:00:39.466 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:00:40.456 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:00:40.451+0000 7f66ff7dc7c0 -1 osd.1 104 log_to_monitors true 2024-09-16T04:00:40.467 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:00:40.467 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:00:40.467 INFO:tasks.workunit.client.0.smithi096.stdout:3 2024-09-16T04:00:40.468 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T04:00:40.468 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:00:40.468 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:00:40.991 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:00:41.993 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:00:41.993 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:00:41.993 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T04:00:41.993 INFO:tasks.workunit.client.0.smithi096.stdout:4 2024-09-16T04:00:41.994 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:00:41.994 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:00:42.637 INFO:tasks.workunit.client.0.smithi096.stdout:osd.1 up in weight 1 up_from 112 up_thru 112 down_at 106 last_clean_interval [10,104) [v2:127.0.0.1:6810/1193604255,v1:127.0.0.1:6811/1193604255] [v2:127.0.0.1:6812/1193604255,v1:127.0.0.1:6813/1193604255] exists,up 5ee4abe9-b499-40fb-a57e-12a3d2502387 2024-09-16T04:00:42.640 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T04:00:42.640 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T04:00:42.640 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T04:00:42.640 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:257: check_pool_priority: activate_osd td/osd-pool-create 2 2024-09-16T04:00:42.640 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-pool-create 2024-09-16T04:00:42.640 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2024-09-16T04:00:42.640 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2024-09-16T04:00:42.641 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2024-09-16T04:00:42.641 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-pool-create/2 2024-09-16T04:00:42.641 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=38a92d84-8703-45d8-b5ef-7d976430f112 --auth-supported=none --mon-host=127.0.0.1:7105 ' 2024-09-16T04:00:42.641 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T04:00:42.641 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T04:00:42.641 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T04:00:42.641 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-pool-create/2' 2024-09-16T04:00:42.641 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-pool-create/2/journal' 2024-09-16T04:00:42.641 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2024-09-16T04:00:42.641 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+=--debug_allow_any_pool_priority=true 2024-09-16T04:00:42.641 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-pool-create' 2024-09-16T04:00:42.641 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2024-09-16T04:00:42.641 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:00:42.642 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:00:42.642 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:00:42.642 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:00:42.642 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T04:00:42.642 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T04:00:42.642 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T04:00:42.642 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2024-09-16T04:00:42.642 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-pool-create/$name.log' 2024-09-16T04:00:42.642 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-pool-create/$name.pid' 2024-09-16T04:00:42.642 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T04:00:42.642 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T04:00:42.642 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T04:00:42.642 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T04:00:42.643 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2024-09-16T04:00:42.643 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2024-09-16T04:00:42.643 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-pool-create/2 2024-09-16T04:00:42.643 INFO:tasks.workunit.client.0.smithi096.stdout:start osd.2 2024-09-16T04:00:42.644 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2024-09-16T04:00:42.644 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=38a92d84-8703-45d8-b5ef-7d976430f112 --auth-supported=none --mon-host=127.0.0.1:7105 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-pool-create/2 --osd-journal=td/osd-pool-create/2/journal --chdir=--debug_allow_any_pool_priority=true --run-dir=td/osd-pool-create '--admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-pool-create/$name.log' '--pid-file=td/osd-pool-create/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T04:00:42.644 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-pool-create/2/whoami 2024-09-16T04:00:42.644 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2024-09-16T04:00:42.645 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2024-09-16T04:00:42.645 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2024-09-16T04:00:42.645 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2024-09-16T04:00:42.671 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:00:42.667+0000 7f6eb1a607c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:00:42.698 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:00:42.695+0000 7f6eb1a607c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:00:42.700 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:00:42.695+0000 7f6eb1a607c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:00:42.700 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:00:42.695+0000 7f6eb1a607c0 -1 global_init_chdir: failed to chdir to directory: '--debug_allow_any_pool_priority=true': (2) No such file or directory 2024-09-16T04:00:43.113 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2024-09-16T04:00:43.113 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T04:00:43.114 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2024-09-16T04:00:43.114 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T04:00:43.114 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T04:00:43.114 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:00:43.114 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T04:00:43.114 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T04:00:43.114 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:00:43.115 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:00:43.638 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:00:43.908 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:00:43.903+0000 7f6eb1a607c0 -1 Falling back to public interface 2024-09-16T04:00:43.913 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:00:43.911+0000 7f6eb1a607c0 -1 global_init_chdir: failed to chdir to directory: '--debug_allow_any_pool_priority=true': (2) No such file or directory 2024-09-16T04:00:44.639 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:00:44.639 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:00:44.640 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T04:00:44.640 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T04:00:44.640 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:00:44.640 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:00:45.081 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:00:46.083 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:00:46.083 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:00:46.083 INFO:tasks.workunit.client.0.smithi096.stdout:2 2024-09-16T04:00:46.084 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T04:00:46.084 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:00:46.084 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:00:46.615 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:00:47.617 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:00:47.617 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:00:47.617 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T04:00:47.617 INFO:tasks.workunit.client.0.smithi096.stdout:3 2024-09-16T04:00:47.618 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:00:47.618 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:00:47.775 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:00:47.771+0000 7f6eb1a607c0 -1 osd.2 104 log_to_monitors true 2024-09-16T04:00:48.141 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:00:49.140 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:00:49.141 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:00:49.141 INFO:tasks.workunit.client.0.smithi096.stdout:4 2024-09-16T04:00:49.141 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T04:00:49.141 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:00:49.142 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:00:49.737 INFO:tasks.workunit.client.0.smithi096.stdout:osd.2 up in weight 1 up_from 116 up_thru 116 down_at 106 last_clean_interval [15,104) [v2:127.0.0.1:6818/3181609768,v1:127.0.0.1:6819/3181609768] [v2:127.0.0.1:6820/3181609768,v1:127.0.0.1:6821/3181609768] exists,up 160ceeb1-2b72-46b6-a631-9022d87b853a 2024-09-16T04:00:49.738 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T04:00:49.738 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T04:00:49.738 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T04:00:49.738 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:258: check_pool_priority: sleep 5 2024-09-16T04:00:54.739 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:260: check_pool_priority: grep convert td/osd-pool-create/mon.a.log 2024-09-16T04:00:54.766 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T03:57:53.447+0000 7f5b0faa0640 20 mon.a@0(leader).osd e1 convert_pool_priorities nothing to fix 2024-09-16T04:00:54.766 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T04:00:27.952+0000 7f0887045e00 10 mon.a@0(leader).osd e106 convert_pool_priorities pool 1 recovery_priority adjusted -36 to -10 2024-09-16T04:00:54.766 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T04:00:27.952+0000 7f0887045e00 10 mon.a@0(leader).osd e106 convert_pool_priorities pool 2 recovery_priority adjusted -34 to -9 2024-09-16T04:00:54.766 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T04:00:27.952+0000 7f0887045e00 10 mon.a@0(leader).osd e106 convert_pool_priorities pool 3 recovery_priority adjusted -32 to -8 2024-09-16T04:00:54.767 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T04:00:27.952+0000 7f0887045e00 10 mon.a@0(leader).osd e106 convert_pool_priorities pool 4 recovery_priority adjusted -30 to -8 2024-09-16T04:00:54.767 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T04:00:27.952+0000 7f0887045e00 10 mon.a@0(leader).osd e106 convert_pool_priorities pool 5 recovery_priority adjusted -28 to -7 2024-09-16T04:00:54.767 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T04:00:27.952+0000 7f0887045e00 10 mon.a@0(leader).osd e106 convert_pool_priorities pool 6 recovery_priority adjusted -26 to -7 2024-09-16T04:00:54.767 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T04:00:27.952+0000 7f0887045e00 10 mon.a@0(leader).osd e106 convert_pool_priorities pool 7 recovery_priority adjusted -24 to -6 2024-09-16T04:00:54.767 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T04:00:27.952+0000 7f0887045e00 10 mon.a@0(leader).osd e106 convert_pool_priorities pool 8 recovery_priority adjusted -22 to -6 2024-09-16T04:00:54.767 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T04:00:27.952+0000 7f0887045e00 10 mon.a@0(leader).osd e106 convert_pool_priorities pool 9 recovery_priority adjusted -20 to -5 2024-09-16T04:00:54.767 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T04:00:27.952+0000 7f0887045e00 10 mon.a@0(leader).osd e106 convert_pool_priorities pool 10 recovery_priority adjusted -18 to -5 2024-09-16T04:00:54.767 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T04:00:27.952+0000 7f0887045e00 10 mon.a@0(leader).osd e106 convert_pool_priorities pool 11 recovery_priority adjusted -16 to -4 2024-09-16T04:00:54.767 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T04:00:27.952+0000 7f0887045e00 10 mon.a@0(leader).osd e106 convert_pool_priorities pool 12 recovery_priority adjusted -14 to -3 2024-09-16T04:00:54.767 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T04:00:27.952+0000 7f0887045e00 10 mon.a@0(leader).osd e106 convert_pool_priorities pool 13 recovery_priority adjusted -12 to -3 2024-09-16T04:00:54.767 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T04:00:27.952+0000 7f0887045e00 10 mon.a@0(leader).osd e106 convert_pool_priorities pool 14 recovery_priority adjusted -10 to -2 2024-09-16T04:00:54.767 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T04:00:27.952+0000 7f0887045e00 10 mon.a@0(leader).osd e106 convert_pool_priorities pool 15 recovery_priority adjusted -8 to -2 2024-09-16T04:00:54.768 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T04:00:27.952+0000 7f0887045e00 10 mon.a@0(leader).osd e106 convert_pool_priorities pool 16 recovery_priority adjusted -6 to -1 2024-09-16T04:00:54.768 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T04:00:27.952+0000 7f0887045e00 10 mon.a@0(leader).osd e106 convert_pool_priorities pool 17 recovery_priority adjusted -4 to -1 2024-09-16T04:00:54.768 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T04:00:27.952+0000 7f0887045e00 10 mon.a@0(leader).osd e106 convert_pool_priorities pool 18 recovery_priority adjusted -2 to 0 2024-09-16T04:00:54.768 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:261: check_pool_priority: ceph osd dump 2024-09-16T04:00:55.225 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 118 2024-09-16T04:00:55.225 INFO:tasks.workunit.client.0.smithi096.stdout:fsid 38a92d84-8703-45d8-b5ef-7d976430f112 2024-09-16T04:00:55.225 INFO:tasks.workunit.client.0.smithi096.stdout:created 2024-09-16T03:57:53.223179+0000 2024-09-16T04:00:55.225 INFO:tasks.workunit.client.0.smithi096.stdout:modified 2024-09-16T04:00:48.972244+0000 2024-09-16T04:00:55.225 INFO:tasks.workunit.client.0.smithi096.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-16T04:00:55.225 INFO:tasks.workunit.client.0.smithi096.stdout:crush_version 10 2024-09-16T04:00:55.225 INFO:tasks.workunit.client.0.smithi096.stdout:full_ratio 0.99 2024-09-16T04:00:55.225 INFO:tasks.workunit.client.0.smithi096.stdout:backfillfull_ratio 0.99 2024-09-16T04:00:55.225 INFO:tasks.workunit.client.0.smithi096.stdout:nearfull_ratio 0.85 2024-09-16T04:00:55.226 INFO:tasks.workunit.client.0.smithi096.stdout:require_min_compat_client luminous 2024-09-16T04:00:55.226 INFO:tasks.workunit.client.0.smithi096.stdout:min_compat_client jewel 2024-09-16T04:00:55.226 INFO:tasks.workunit.client.0.smithi096.stdout:require_osd_release squid 2024-09-16T04:00:55.226 INFO:tasks.workunit.client.0.smithi096.stdout:stretch_mode_enabled false 2024-09-16T04:00:55.226 INFO:tasks.workunit.client.0.smithi096.stdout:pool 1 'test1' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 107 flags hashpspool stripe_width 0 recovery_priority -10 read_balance_score 3.00 2024-09-16T04:00:55.226 INFO:tasks.workunit.client.0.smithi096.stdout:pool 2 'test2' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 107 flags hashpspool stripe_width 0 recovery_priority -9 read_balance_score 3.00 2024-09-16T04:00:55.226 INFO:tasks.workunit.client.0.smithi096.stdout:pool 3 'test3' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 107 flags hashpspool stripe_width 0 recovery_priority -8 read_balance_score 3.00 2024-09-16T04:00:55.226 INFO:tasks.workunit.client.0.smithi096.stdout:pool 4 'test4' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 107 flags hashpspool stripe_width 0 recovery_priority -8 read_balance_score 3.00 2024-09-16T04:00:55.226 INFO:tasks.workunit.client.0.smithi096.stdout:pool 5 'test5' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 107 flags hashpspool stripe_width 0 recovery_priority -7 read_balance_score 3.00 2024-09-16T04:00:55.226 INFO:tasks.workunit.client.0.smithi096.stdout:pool 6 'test6' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 107 flags hashpspool stripe_width 0 recovery_priority -7 read_balance_score 3.00 2024-09-16T04:00:55.226 INFO:tasks.workunit.client.0.smithi096.stdout:pool 7 'test7' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 107 flags hashpspool stripe_width 0 recovery_priority -6 read_balance_score 3.00 2024-09-16T04:00:55.227 INFO:tasks.workunit.client.0.smithi096.stdout:pool 8 'test8' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 107 flags hashpspool stripe_width 0 recovery_priority -6 read_balance_score 3.00 2024-09-16T04:00:55.227 INFO:tasks.workunit.client.0.smithi096.stdout:pool 9 'test9' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 107 flags hashpspool stripe_width 0 recovery_priority -5 read_balance_score 3.00 2024-09-16T04:00:55.227 INFO:tasks.workunit.client.0.smithi096.stdout:pool 10 'test10' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 107 flags hashpspool stripe_width 0 recovery_priority -5 read_balance_score 3.00 2024-09-16T04:00:55.227 INFO:tasks.workunit.client.0.smithi096.stdout:pool 11 'test11' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 107 flags hashpspool stripe_width 0 recovery_priority -4 read_balance_score 3.00 2024-09-16T04:00:55.227 INFO:tasks.workunit.client.0.smithi096.stdout:pool 12 'test12' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 107 flags hashpspool stripe_width 0 recovery_priority -3 read_balance_score 3.00 2024-09-16T04:00:55.227 INFO:tasks.workunit.client.0.smithi096.stdout:pool 13 'test13' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 107 flags hashpspool stripe_width 0 recovery_priority -3 read_balance_score 3.00 2024-09-16T04:00:55.227 INFO:tasks.workunit.client.0.smithi096.stdout:pool 14 'test14' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 107 flags hashpspool stripe_width 0 recovery_priority -2 read_balance_score 3.00 2024-09-16T04:00:55.227 INFO:tasks.workunit.client.0.smithi096.stdout:pool 15 'test15' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 107 flags hashpspool stripe_width 0 recovery_priority -2 read_balance_score 3.00 2024-09-16T04:00:55.227 INFO:tasks.workunit.client.0.smithi096.stdout:pool 16 'test16' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 107 flags hashpspool stripe_width 0 recovery_priority -1 read_balance_score 3.00 2024-09-16T04:00:55.227 INFO:tasks.workunit.client.0.smithi096.stdout:pool 17 'test17' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 107 flags hashpspool stripe_width 0 recovery_priority -1 read_balance_score 3.00 2024-09-16T04:00:55.227 INFO:tasks.workunit.client.0.smithi096.stdout:pool 18 'test18' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 107 flags hashpspool stripe_width 0 read_balance_score 3.00 2024-09-16T04:00:55.227 INFO:tasks.workunit.client.0.smithi096.stdout:pool 19 'test19' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 101 flags hashpspool stripe_width 0 read_balance_score 3.00 2024-09-16T04:00:55.227 INFO:tasks.workunit.client.0.smithi096.stdout:pool 20 'test20' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 103 flags hashpspool stripe_width 0 recovery_priority 2 read_balance_score 3.00 2024-09-16T04:00:55.228 INFO:tasks.workunit.client.0.smithi096.stdout:pool 21 'test21' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 105 flags hashpspool stripe_width 0 recovery_priority 4 read_balance_score 3.00 2024-09-16T04:00:55.228 INFO:tasks.workunit.client.0.smithi096.stdout:max_osd 3 2024-09-16T04:00:55.228 INFO:tasks.workunit.client.0.smithi096.stdout:osd.0 up in weight 1 up_from 109 up_thru 116 down_at 106 last_clean_interval [5,105) [v2:127.0.0.1:6800/1308462607,v1:127.0.0.1:6801/1308462607] [v2:127.0.0.1:6802/1308462607,v1:127.0.0.1:6803/1308462607] exists,up 2a46a48b-7dad-45d0-b564-7d8e7b42c6cb 2024-09-16T04:00:55.228 INFO:tasks.workunit.client.0.smithi096.stdout:osd.1 up in weight 1 up_from 112 up_thru 116 down_at 106 last_clean_interval [10,104) [v2:127.0.0.1:6810/1193604255,v1:127.0.0.1:6811/1193604255] [v2:127.0.0.1:6812/1193604255,v1:127.0.0.1:6813/1193604255] exists,up 5ee4abe9-b499-40fb-a57e-12a3d2502387 2024-09-16T04:00:55.228 INFO:tasks.workunit.client.0.smithi096.stdout:osd.2 up in weight 1 up_from 116 up_thru 116 down_at 106 last_clean_interval [15,104) [v2:127.0.0.1:6818/3181609768,v1:127.0.0.1:6819/3181609768] [v2:127.0.0.1:6820/3181609768,v1:127.0.0.1:6821/3181609768] exists,up 160ceeb1-2b72-46b6-a631-9022d87b853a 2024-09-16T04:00:55.228 INFO:tasks.workunit.client.0.smithi096.stdout:blocklist 127.0.0.1:0/2059409099 expires 2024-09-17T04:00:33.195712+0000 2024-09-16T04:00:55.228 INFO:tasks.workunit.client.0.smithi096.stdout:blocklist 127.0.0.1:0/3387940508 expires 2024-09-17T04:00:33.195712+0000 2024-09-16T04:00:55.228 INFO:tasks.workunit.client.0.smithi096.stdout:blocklist 127.0.0.1:0/2097722393 expires 2024-09-17T04:00:33.195712+0000 2024-09-16T04:00:55.228 INFO:tasks.workunit.client.0.smithi096.stdout:blocklist 127.0.0.1:6801/3426408728 expires 2024-09-17T04:00:33.195712+0000 2024-09-16T04:00:55.228 INFO:tasks.workunit.client.0.smithi096.stdout:blocklist 127.0.0.1:6800/3426408728 expires 2024-09-17T04:00:33.195712+0000 2024-09-16T04:00:55.241 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:263: check_pool_priority: pos=1 2024-09-16T04:00:55.241 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: ceph osd dump 2024-09-16T04:00:55.241 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: grep '^pool' 2024-09-16T04:00:55.242 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: sed 's/.*recovery_priority //' 2024-09-16T04:00:55.242 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: awk '{ print $1 }' 2024-09-16T04:00:55.708 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T04:00:55.709 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $1 }' 2024-09-16T04:00:55.709 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo -10 -9 -8 -8 -7 -7 -6 -6 -5 -5 -4 -3 -3 -2 -2 -1 -1 0 0 2 4 2024-09-16T04:00:55.710 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=-10 2024-09-16T04:00:55.711 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test -10 = 0 2024-09-16T04:00:55.711 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test -10 = -10 2024-09-16T04:00:55.711 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 1 + 1 2024-09-16T04:00:55.713 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=2 2024-09-16T04:00:55.713 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T04:00:55.718 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo -10 -9 -8 -8 -7 -7 -6 -6 -5 -5 -4 -3 -3 -2 -2 -1 -1 0 0 2 4 2024-09-16T04:00:55.718 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $2 }' 2024-09-16T04:00:55.718 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=-9 2024-09-16T04:00:55.718 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test -9 = 0 2024-09-16T04:00:55.718 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test -9 = -9 2024-09-16T04:00:55.718 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 2 + 1 2024-09-16T04:00:55.718 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=3 2024-09-16T04:00:55.718 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T04:00:55.719 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo -10 -9 -8 -8 -7 -7 -6 -6 -5 -5 -4 -3 -3 -2 -2 -1 -1 0 0 2 4 2024-09-16T04:00:55.719 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $3 }' 2024-09-16T04:00:55.719 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=-8 2024-09-16T04:00:55.719 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test -8 = 0 2024-09-16T04:00:55.719 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test -8 = -8 2024-09-16T04:00:55.720 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 3 + 1 2024-09-16T04:00:55.720 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=4 2024-09-16T04:00:55.720 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T04:00:55.720 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo -10 -9 -8 -8 -7 -7 -6 -6 -5 -5 -4 -3 -3 -2 -2 -1 -1 0 0 2 4 2024-09-16T04:00:55.720 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $4 }' 2024-09-16T04:00:55.722 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=-8 2024-09-16T04:00:55.722 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test -8 = 0 2024-09-16T04:00:55.722 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test -8 = -8 2024-09-16T04:00:55.722 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 4 + 1 2024-09-16T04:00:55.723 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=5 2024-09-16T04:00:55.723 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T04:00:55.724 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo -10 -9 -8 -8 -7 -7 -6 -6 -5 -5 -4 -3 -3 -2 -2 -1 -1 0 0 2 4 2024-09-16T04:00:55.724 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $5 }' 2024-09-16T04:00:55.726 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=-7 2024-09-16T04:00:55.726 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test -7 = 0 2024-09-16T04:00:55.726 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test -7 = -7 2024-09-16T04:00:55.726 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 5 + 1 2024-09-16T04:00:55.726 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=6 2024-09-16T04:00:55.726 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T04:00:55.727 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo -10 -9 -8 -8 -7 -7 -6 -6 -5 -5 -4 -3 -3 -2 -2 -1 -1 0 0 2 4 2024-09-16T04:00:55.727 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $6 }' 2024-09-16T04:00:55.729 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=-7 2024-09-16T04:00:55.729 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test -7 = 0 2024-09-16T04:00:55.729 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test -7 = -7 2024-09-16T04:00:55.729 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 6 + 1 2024-09-16T04:00:55.730 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=7 2024-09-16T04:00:55.730 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T04:00:55.731 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo -10 -9 -8 -8 -7 -7 -6 -6 -5 -5 -4 -3 -3 -2 -2 -1 -1 0 0 2 4 2024-09-16T04:00:55.731 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $7 }' 2024-09-16T04:00:55.732 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=-6 2024-09-16T04:00:55.732 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test -6 = 0 2024-09-16T04:00:55.732 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test -6 = -6 2024-09-16T04:00:55.733 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 7 + 1 2024-09-16T04:00:55.734 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=8 2024-09-16T04:00:55.734 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T04:00:55.734 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo -10 -9 -8 -8 -7 -7 -6 -6 -5 -5 -4 -3 -3 -2 -2 -1 -1 0 0 2 4 2024-09-16T04:00:55.734 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $8 }' 2024-09-16T04:00:55.736 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=-6 2024-09-16T04:00:55.736 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test -6 = 0 2024-09-16T04:00:55.736 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test -6 = -6 2024-09-16T04:00:55.737 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 8 + 1 2024-09-16T04:00:55.737 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=9 2024-09-16T04:00:55.737 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T04:00:55.737 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo -10 -9 -8 -8 -7 -7 -6 -6 -5 -5 -4 -3 -3 -2 -2 -1 -1 0 0 2 4 2024-09-16T04:00:55.738 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $9 }' 2024-09-16T04:00:55.740 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=-5 2024-09-16T04:00:55.740 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test -5 = 0 2024-09-16T04:00:55.740 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test -5 = -5 2024-09-16T04:00:55.740 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 9 + 1 2024-09-16T04:00:55.740 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=10 2024-09-16T04:00:55.741 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T04:00:55.741 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo -10 -9 -8 -8 -7 -7 -6 -6 -5 -5 -4 -3 -3 -2 -2 -1 -1 0 0 2 4 2024-09-16T04:00:55.741 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $10 }' 2024-09-16T04:00:55.743 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=-5 2024-09-16T04:00:55.743 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test -5 = 0 2024-09-16T04:00:55.743 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test -5 = -5 2024-09-16T04:00:55.743 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 10 + 1 2024-09-16T04:00:55.744 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=11 2024-09-16T04:00:55.744 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T04:00:55.745 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo -10 -9 -8 -8 -7 -7 -6 -6 -5 -5 -4 -3 -3 -2 -2 -1 -1 0 0 2 4 2024-09-16T04:00:55.745 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $11 }' 2024-09-16T04:00:55.746 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=-4 2024-09-16T04:00:55.747 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test -4 = 0 2024-09-16T04:00:55.747 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test -4 = -4 2024-09-16T04:00:55.747 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 11 + 1 2024-09-16T04:00:55.748 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=12 2024-09-16T04:00:55.748 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T04:00:55.748 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo -10 -9 -8 -8 -7 -7 -6 -6 -5 -5 -4 -3 -3 -2 -2 -1 -1 0 0 2 4 2024-09-16T04:00:55.749 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $12 }' 2024-09-16T04:00:55.751 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=-3 2024-09-16T04:00:55.751 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test -3 = 0 2024-09-16T04:00:55.751 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test -3 = -3 2024-09-16T04:00:55.751 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 12 + 1 2024-09-16T04:00:55.752 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=13 2024-09-16T04:00:55.752 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T04:00:55.752 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo -10 -9 -8 -8 -7 -7 -6 -6 -5 -5 -4 -3 -3 -2 -2 -1 -1 0 0 2 4 2024-09-16T04:00:55.752 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $13 }' 2024-09-16T04:00:55.754 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=-3 2024-09-16T04:00:55.754 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test -3 = 0 2024-09-16T04:00:55.755 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test -3 = -3 2024-09-16T04:00:55.755 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 13 + 1 2024-09-16T04:00:55.755 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=14 2024-09-16T04:00:55.756 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T04:00:55.756 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo -10 -9 -8 -8 -7 -7 -6 -6 -5 -5 -4 -3 -3 -2 -2 -1 -1 0 0 2 4 2024-09-16T04:00:55.756 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $14 }' 2024-09-16T04:00:55.758 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=-2 2024-09-16T04:00:55.759 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test -2 = 0 2024-09-16T04:00:55.759 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test -2 = -2 2024-09-16T04:00:55.759 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 14 + 1 2024-09-16T04:00:55.759 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=15 2024-09-16T04:00:55.759 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T04:00:55.760 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo -10 -9 -8 -8 -7 -7 -6 -6 -5 -5 -4 -3 -3 -2 -2 -1 -1 0 0 2 4 2024-09-16T04:00:55.760 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $15 }' 2024-09-16T04:00:55.762 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=-2 2024-09-16T04:00:55.762 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test -2 = 0 2024-09-16T04:00:55.762 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test -2 = -2 2024-09-16T04:00:55.763 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 15 + 1 2024-09-16T04:00:55.763 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=16 2024-09-16T04:00:55.763 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T04:00:55.763 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo -10 -9 -8 -8 -7 -7 -6 -6 -5 -5 -4 -3 -3 -2 -2 -1 -1 0 0 2 4 2024-09-16T04:00:55.764 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $16 }' 2024-09-16T04:00:55.765 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=-1 2024-09-16T04:00:55.765 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test -1 = 0 2024-09-16T04:00:55.765 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test -1 = -1 2024-09-16T04:00:55.766 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 16 + 1 2024-09-16T04:00:55.766 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=17 2024-09-16T04:00:55.766 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T04:00:55.767 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo -10 -9 -8 -8 -7 -7 -6 -6 -5 -5 -4 -3 -3 -2 -2 -1 -1 0 0 2 4 2024-09-16T04:00:55.767 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $17 }' 2024-09-16T04:00:55.769 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=-1 2024-09-16T04:00:55.769 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test -1 = 0 2024-09-16T04:00:55.769 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test -1 = -1 2024-09-16T04:00:55.769 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 17 + 1 2024-09-16T04:00:55.770 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=18 2024-09-16T04:00:55.770 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T04:00:55.771 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo -10 -9 -8 -8 -7 -7 -6 -6 -5 -5 -4 -3 -3 -2 -2 -1 -1 0 0 2 4 2024-09-16T04:00:55.771 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $18 }' 2024-09-16T04:00:55.773 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=0 2024-09-16T04:00:55.773 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test 0 = 0 2024-09-16T04:00:55.773 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:270: check_pool_priority: result=pool 2024-09-16T04:00:55.773 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test pool = pool 2024-09-16T04:00:55.773 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 18 + 1 2024-09-16T04:00:55.774 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=19 2024-09-16T04:00:55.774 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T04:00:55.774 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo -10 -9 -8 -8 -7 -7 -6 -6 -5 -5 -4 -3 -3 -2 -2 -1 -1 0 0 2 4 2024-09-16T04:00:55.774 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $19 }' 2024-09-16T04:00:55.776 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=0 2024-09-16T04:00:55.776 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test 0 = 0 2024-09-16T04:00:55.776 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:270: check_pool_priority: result=pool 2024-09-16T04:00:55.776 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test pool = pool 2024-09-16T04:00:55.776 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 19 + 1 2024-09-16T04:00:55.777 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=20 2024-09-16T04:00:55.777 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T04:00:55.778 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo -10 -9 -8 -8 -7 -7 -6 -6 -5 -5 -4 -3 -3 -2 -2 -1 -1 0 0 2 4 2024-09-16T04:00:55.778 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $20 }' 2024-09-16T04:00:55.781 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=2 2024-09-16T04:00:55.781 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test 2 = 0 2024-09-16T04:00:55.781 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test 2 = 2 2024-09-16T04:00:55.781 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 20 + 1 2024-09-16T04:00:55.782 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=21 2024-09-16T04:00:55.782 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T04:00:55.782 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo -10 -9 -8 -8 -7 -7 -6 -6 -5 -5 -4 -3 -3 -2 -2 -1 -1 0 0 2 4 2024-09-16T04:00:55.782 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $21 }' 2024-09-16T04:00:55.784 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=4 2024-09-16T04:00:55.784 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test 4 = 0 2024-09-16T04:00:55.784 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test 4 = 4 2024-09-16T04:00:55.784 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 21 + 1 2024-09-16T04:00:55.785 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=22 2024-09-16T04:00:55.785 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:33: run: teardown td/osd-pool-create 2024-09-16T04:00:55.785 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-pool-create 2024-09-16T04:00:55.785 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T04:00:55.786 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-pool-create KILL 2024-09-16T04:00:55.786 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T04:00:55.786 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T04:00:55.786 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T04:00:55.786 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T04:00:55.786 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T04:00:56.095 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T04:00:56.096 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T04:00:56.096 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T04:00:56.097 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T04:00:56.098 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T04:00:56.098 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T04:00:56.099 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T04:00:56.100 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T04:00:56.100 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T04:00:56.100 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T04:00:56.100 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T04:00:56.101 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T04:00:56.103 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T04:00:56.103 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-pool-create 2024-09-16T04:00:56.131 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T04:00:56.131 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:00:56.131 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T04:00:56.132 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.128966 2024-09-16T04:00:56.134 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T04:00:56.134 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T04:00:56.134 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:30: run: for func in $funcs 2024-09-16T04:00:56.135 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:31: run: setup td/osd-pool-create 2024-09-16T04:00:56.135 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-pool-create 2024-09-16T04:00:56.135 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-pool-create 2024-09-16T04:00:56.135 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-pool-create 2024-09-16T04:00:56.135 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T04:00:56.135 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-pool-create KILL 2024-09-16T04:00:56.135 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T04:00:56.135 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T04:00:56.135 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T04:00:56.136 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T04:00:56.136 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T04:00:56.138 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T04:00:56.138 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T04:00:56.139 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T04:00:56.139 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T04:00:56.140 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T04:00:56.140 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T04:00:56.141 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T04:00:56.142 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T04:00:56.142 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T04:00:56.142 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T04:00:56.142 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T04:00:56.143 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T04:00:56.144 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T04:00:56.144 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-pool-create 2024-09-16T04:00:56.146 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T04:00:56.146 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:00:56.146 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T04:00:56.146 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.128966 2024-09-16T04:00:56.147 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T04:00:56.147 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T04:00:56.147 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-pool-create 2024-09-16T04:00:56.148 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T04:00:56.148 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:00:56.149 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T04:00:56.149 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.128966 2024-09-16T04:00:56.150 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T04:00:56.152 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2024-09-16T04:00:56.152 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T04:00:56.152 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-pool-create 1' TERM HUP INT 2024-09-16T04:00:56.153 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:32: run: TEST_pool_neg_only_prio td/osd-pool-create 2024-09-16T04:00:56.153 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:283: TEST_pool_neg_only_prio: local dir=td/osd-pool-create 2024-09-16T04:00:56.153 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:284: TEST_pool_neg_only_prio: check_pool_priority td/osd-pool-create 20 -5 '0 0 -1 -1 -2 -2 -3 -3 -4 -4 -5 -5 -6 -6 -7 -7 -8 -8 -9 -9 -10' 2024-09-16T04:00:56.153 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:215: check_pool_priority: local dir=td/osd-pool-create 2024-09-16T04:00:56.153 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:216: check_pool_priority: shift 2024-09-16T04:00:56.153 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:217: check_pool_priority: local pools=20 2024-09-16T04:00:56.153 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:218: check_pool_priority: shift 2024-09-16T04:00:56.153 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:219: check_pool_priority: local spread=-5 2024-09-16T04:00:56.153 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:220: check_pool_priority: shift 2024-09-16T04:00:56.153 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:221: check_pool_priority: local 'results=0 0 -1 -1 -2 -2 -3 -3 -4 -4 -5 -5 -6 -6 -7 -7 -8 -8 -9 -9 -10' 2024-09-16T04:00:56.153 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:223: check_pool_priority: setup td/osd-pool-create 2024-09-16T04:00:56.153 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-pool-create 2024-09-16T04:00:56.153 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-pool-create 2024-09-16T04:00:56.154 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-pool-create 2024-09-16T04:00:56.154 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T04:00:56.154 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-pool-create KILL 2024-09-16T04:00:56.154 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T04:00:56.154 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T04:00:56.154 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T04:00:56.154 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T04:00:56.154 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T04:00:56.154 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T04:00:56.155 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T04:00:56.155 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T04:00:56.156 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T04:00:56.157 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T04:00:56.157 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T04:00:56.157 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T04:00:56.158 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T04:00:56.158 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T04:00:56.158 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T04:00:56.158 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T04:00:56.159 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T04:00:56.161 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T04:00:56.161 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-pool-create 2024-09-16T04:00:56.162 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T04:00:56.162 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:00:56.162 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T04:00:56.162 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.128966 2024-09-16T04:00:56.163 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T04:00:56.163 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T04:00:56.163 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-pool-create 2024-09-16T04:00:56.165 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T04:00:56.165 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:00:56.165 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T04:00:56.165 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.128966 2024-09-16T04:00:56.166 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T04:00:56.168 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2024-09-16T04:00:56.168 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T04:00:56.168 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-pool-create 1' TERM HUP INT 2024-09-16T04:00:56.168 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:225: check_pool_priority: EXTRA_OPTS=--debug_allow_any_pool_priority=true 2024-09-16T04:00:56.168 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:226: check_pool_priority: export EXTRA_OPTS 2024-09-16T04:00:56.168 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:227: check_pool_priority: run_mon td/osd-pool-create a 2024-09-16T04:00:56.168 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-pool-create 2024-09-16T04:00:56.168 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T04:00:56.168 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T04:00:56.168 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T04:00:56.168 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-pool-create/a 2024-09-16T04:00:56.168 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-pool-create/a --run-dir=td/osd-pool-create 2024-09-16T04:00:56.625 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T04:00:56.625 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:00:56.625 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:00:56.625 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:00:56.625 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:00:56.626 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T04:00:56.626 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T04:00:56.626 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug_allow_any_pool_priority=true --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-pool-create/a '--log-file=td/osd-pool-create/$name.log' '--admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' --mon-cluster-log-file=td/osd-pool-create/log --run-dir=td/osd-pool-create '--pid-file=td/osd-pool-create/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-09-16T04:00:56.834 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T04:00:56.835 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T04:00:56.835 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T04:00:56.835 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T04:00:56.835 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T04:00:56.836 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T04:00:56.836 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T04:00:56.836 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T04:00:56.836 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T04:00:56.837 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T04:00:56.837 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:00:56.837 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T04:00:56.837 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.128966/ceph-mon.a.asok 2024-09-16T04:00:56.837 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T04:00:56.837 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.128966/ceph-mon.a.asok config get fsid 2024-09-16T04:00:56.951 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T04:00:56.951 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T04:00:56.951 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T04:00:56.951 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T04:00:56.951 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T04:00:56.952 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T04:00:56.952 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T04:00:56.952 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T04:00:56.952 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T04:00:56.952 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:00:56.952 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T04:00:56.952 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.128966/ceph-mon.a.asok 2024-09-16T04:00:56.953 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T04:00:56.953 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.128966/ceph-mon.a.asok config get mon_host 2024-09-16T04:00:57.052 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:228: check_pool_priority: run_mgr td/osd-pool-create x 2024-09-16T04:00:57.053 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-pool-create 2024-09-16T04:00:57.053 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2024-09-16T04:00:57.053 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2024-09-16T04:00:57.053 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2024-09-16T04:00:57.053 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-pool-create/x 2024-09-16T04:00:57.053 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2024-09-16T04:00:57.977 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2024-09-16T04:00:57.977 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:00:57.977 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:00:57.977 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:00:57.978 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:00:57.978 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T04:00:57.978 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T04:00:57.978 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T04:00:57.980 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --debug_allow_any_pool_priority=true --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-pool-create/x '--log-file=td/osd-pool-create/$name.log' '--admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' --run-dir=td/osd-pool-create '--pid-file=td/osd-pool-create/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T04:00:58.015 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:229: check_pool_priority: run_osd td/osd-pool-create 0 2024-09-16T04:00:58.015 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-pool-create 2024-09-16T04:00:58.015 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T04:00:58.015 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2024-09-16T04:00:58.015 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T04:00:58.015 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-pool-create/0 2024-09-16T04:00:58.016 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=38a92d84-8703-45d8-b5ef-7d976430f112 --auth-supported=none --mon-host=127.0.0.1:7105 ' 2024-09-16T04:00:58.016 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T04:00:58.016 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T04:00:58.016 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T04:00:58.016 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-pool-create/0' 2024-09-16T04:00:58.016 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-pool-create/0/journal' 2024-09-16T04:00:58.016 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T04:00:58.016 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+=--debug_allow_any_pool_priority=true 2024-09-16T04:00:58.016 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-pool-create' 2024-09-16T04:00:58.016 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T04:00:58.016 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:00:58.016 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:00:58.016 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:00:58.017 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:00:58.017 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T04:00:58.017 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T04:00:58.017 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T04:00:58.017 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T04:00:58.017 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T04:00:58.017 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T04:00:58.017 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-pool-create/$name.log' 2024-09-16T04:00:58.017 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-pool-create/$name.pid' 2024-09-16T04:00:58.017 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T04:00:58.017 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T04:00:58.017 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T04:00:58.017 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T04:00:58.018 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T04:00:58.018 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T04:00:58.018 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-pool-create/0 2024-09-16T04:00:58.018 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T04:00:58.018 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=1d5c9e9e-4f75-4416-bab3-3c4e68381550 2024-09-16T04:00:58.018 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 1d5c9e9e-4f75-4416-bab3-3c4e68381550' 2024-09-16T04:00:58.019 INFO:tasks.workunit.client.0.smithi096.stdout:add osd0 1d5c9e9e-4f75-4416-bab3-3c4e68381550 2024-09-16T04:00:58.019 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T04:00:58.033 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQB6redmGCL6ARAAlJk8acJS+mmSlSasIfGmrw== 2024-09-16T04:00:58.033 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQB6redmGCL6ARAAlJk8acJS+mmSlSasIfGmrw=="}' 2024-09-16T04:00:58.033 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 1d5c9e9e-4f75-4416-bab3-3c4e68381550 -i td/osd-pool-create/0/new.json 2024-09-16T04:00:58.446 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T04:00:58.466 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-pool-create/0/new.json 2024-09-16T04:00:58.467 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=38a92d84-8703-45d8-b5ef-7d976430f112 --auth-supported=none --mon-host=127.0.0.1:7105 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-pool-create/0 --osd-journal=td/osd-pool-create/0/journal --chdir=--debug_allow_any_pool_priority=true --run-dir=td/osd-pool-create '--admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-pool-create/$name.log' '--pid-file=td/osd-pool-create/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQB6redmGCL6ARAAlJk8acJS+mmSlSasIfGmrw== --osd-uuid 1d5c9e9e-4f75-4416-bab3-3c4e68381550 2024-09-16T04:00:58.500 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:00:58.495+0000 7f47a76bb7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:00:58.502 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:00:58.499+0000 7f47a76bb7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:00:58.504 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:00:58.499+0000 7f47a76bb7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:00:58.504 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:00:58.499+0000 7f47a76bb7c0 -1 global_init_chdir: failed to chdir to directory: '--debug_allow_any_pool_priority=true': (2) No such file or directory 2024-09-16T04:00:58.504 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:00:58.499+0000 7f47a76bb7c0 -1 bdev(0x56524b67fc00 td/osd-pool-create/0/block) open stat got: (1) Operation not permitted 2024-09-16T04:00:58.504 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:00:58.499+0000 7f47a76bb7c0 -1 bluestore(td/osd-pool-create/0) _read_fsid unparsable uuid 2024-09-16T04:01:04.530 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-pool-create/0/keyring 2024-09-16T04:01:04.530 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T04:01:04.532 INFO:tasks.workunit.client.0.smithi096.stdout:adding osd0 key to auth repository 2024-09-16T04:01:04.532 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2024-09-16T04:01:04.532 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-pool-create/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T04:01:05.096 INFO:tasks.workunit.client.0.smithi096.stdout:start osd.0 2024-09-16T04:01:05.096 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2024-09-16T04:01:05.096 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=38a92d84-8703-45d8-b5ef-7d976430f112 --auth-supported=none --mon-host=127.0.0.1:7105 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-pool-create/0 --osd-journal=td/osd-pool-create/0/journal --chdir=--debug_allow_any_pool_priority=true --run-dir=td/osd-pool-create '--admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-pool-create/$name.log' '--pid-file=td/osd-pool-create/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T04:01:05.096 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T04:01:05.097 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T04:01:05.097 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T04:01:05.125 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:01:05.119+0000 7fa38e3917c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:01:05.128 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:01:05.123+0000 7fa38e3917c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:01:05.129 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:01:05.123+0000 7fa38e3917c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:01:05.129 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:01:05.123+0000 7fa38e3917c0 -1 global_init_chdir: failed to chdir to directory: '--debug_allow_any_pool_priority=true': (2) No such file or directory 2024-09-16T04:01:05.516 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2024-09-16T04:01:05.516 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T04:01:05.516 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2024-09-16T04:01:05.516 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T04:01:05.516 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T04:01:05.516 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:01:05.516 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T04:01:05.517 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T04:01:05.517 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:01:05.517 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:01:05.997 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:01:06.616 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:01:06.611+0000 7fa38e3917c0 -1 Falling back to public interface 2024-09-16T04:01:06.618 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:01:06.615+0000 7fa38e3917c0 -1 global_init_chdir: failed to chdir to directory: '--debug_allow_any_pool_priority=true': (2) No such file or directory 2024-09-16T04:01:06.998 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:01:06.999 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:01:06.999 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T04:01:06.999 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T04:01:07.000 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:01:07.000 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:01:07.456 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:01:08.457 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:01:08.458 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:01:08.458 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T04:01:08.458 INFO:tasks.workunit.client.0.smithi096.stdout:2 2024-09-16T04:01:08.458 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:01:08.458 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:01:08.896 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:01:09.489 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:01:09.483+0000 7fa38e3917c0 -1 osd.0 0 log_to_monitors true 2024-09-16T04:01:09.898 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:01:09.898 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:01:09.898 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T04:01:09.898 INFO:tasks.workunit.client.0.smithi096.stdout:3 2024-09-16T04:01:09.899 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:01:09.899 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:01:10.367 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:01:11.368 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:01:11.369 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:01:11.369 INFO:tasks.workunit.client.0.smithi096.stdout:4 2024-09-16T04:01:11.369 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T04:01:11.369 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:01:11.369 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:01:11.822 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:01:12.824 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:01:12.824 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:01:12.824 INFO:tasks.workunit.client.0.smithi096.stdout:5 2024-09-16T04:01:12.825 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T04:01:12.825 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:01:12.825 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:01:13.344 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:01:14.345 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:01:14.346 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:01:14.346 INFO:tasks.workunit.client.0.smithi096.stdout:6 2024-09-16T04:01:14.347 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T04:01:14.347 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:01:14.347 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:01:14.768 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:01:15.770 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:01:15.770 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:01:15.770 INFO:tasks.workunit.client.0.smithi096.stdout:7 2024-09-16T04:01:15.770 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T04:01:15.771 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:01:15.771 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:01:16.399 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:01:17.400 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:01:17.401 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:01:17.401 INFO:tasks.workunit.client.0.smithi096.stdout:8 2024-09-16T04:01:17.401 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T04:01:17.401 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:01:17.402 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:01:17.817 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:01:18.818 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:01:18.819 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:01:18.819 INFO:tasks.workunit.client.0.smithi096.stdout:9 2024-09-16T04:01:18.820 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T04:01:18.820 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:01:18.821 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:01:19.387 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:01:20.389 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:01:20.389 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:01:20.389 INFO:tasks.workunit.client.0.smithi096.stdout:10 2024-09-16T04:01:20.390 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T04:01:20.390 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:01:20.390 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:01:20.821 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:01:21.823 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:01:21.823 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:01:21.823 INFO:tasks.workunit.client.0.smithi096.stdout:11 2024-09-16T04:01:21.824 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T04:01:21.824 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:01:21.824 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:01:22.385 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:01:23.387 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:01:23.388 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:01:23.388 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T04:01:23.388 INFO:tasks.workunit.client.0.smithi096.stdout:12 2024-09-16T04:01:23.389 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:01:23.389 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:01:24.168 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:01:25.169 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:01:25.170 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:01:25.170 INFO:tasks.workunit.client.0.smithi096.stdout:13 2024-09-16T04:01:25.170 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T04:01:25.170 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:01:25.170 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:01:26.050 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:01:27.051 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:01:27.052 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:01:27.052 INFO:tasks.workunit.client.0.smithi096.stdout:14 2024-09-16T04:01:27.052 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T04:01:27.053 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:01:27.053 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:01:27.637 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:01:28.639 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:01:28.639 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:01:28.639 INFO:tasks.workunit.client.0.smithi096.stdout:15 2024-09-16T04:01:28.640 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T04:01:28.640 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:01:28.640 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:01:29.148 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:01:30.150 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:01:30.150 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:01:30.150 INFO:tasks.workunit.client.0.smithi096.stdout:16 2024-09-16T04:01:30.151 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T04:01:30.151 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:01:30.151 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:01:30.998 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:01:32.000 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:01:32.000 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:01:32.000 INFO:tasks.workunit.client.0.smithi096.stdout:17 2024-09-16T04:01:32.001 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T04:01:32.001 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:01:32.001 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:01:32.860 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:01:33.862 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:01:33.862 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:01:33.862 INFO:tasks.workunit.client.0.smithi096.stdout:18 2024-09-16T04:01:33.863 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 18 2024-09-16T04:01:33.863 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:01:33.863 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:01:34.379 INFO:tasks.workunit.client.0.smithi096.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/4096179662,v1:127.0.0.1:6803/4096179662] [v2:127.0.0.1:6804/4096179662,v1:127.0.0.1:6805/4096179662] exists,up 1d5c9e9e-4f75-4416-bab3-3c4e68381550 2024-09-16T04:01:34.381 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T04:01:34.381 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T04:01:34.381 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T04:01:34.381 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:230: check_pool_priority: run_osd td/osd-pool-create 1 2024-09-16T04:01:34.381 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-pool-create 2024-09-16T04:01:34.381 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T04:01:34.381 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2024-09-16T04:01:34.381 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T04:01:34.381 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-pool-create/1 2024-09-16T04:01:34.381 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=38a92d84-8703-45d8-b5ef-7d976430f112 --auth-supported=none --mon-host=127.0.0.1:7105 ' 2024-09-16T04:01:34.382 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T04:01:34.382 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T04:01:34.382 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T04:01:34.382 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-pool-create/1' 2024-09-16T04:01:34.382 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-pool-create/1/journal' 2024-09-16T04:01:34.382 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T04:01:34.382 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+=--debug_allow_any_pool_priority=true 2024-09-16T04:01:34.382 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-pool-create' 2024-09-16T04:01:34.382 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T04:01:34.382 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:01:34.382 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:01:34.384 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:01:34.385 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:01:34.385 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T04:01:34.385 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T04:01:34.385 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T04:01:34.385 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T04:01:34.385 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T04:01:34.385 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T04:01:34.385 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-pool-create/$name.log' 2024-09-16T04:01:34.385 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-pool-create/$name.pid' 2024-09-16T04:01:34.385 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T04:01:34.385 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T04:01:34.386 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T04:01:34.386 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T04:01:34.386 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T04:01:34.386 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T04:01:34.386 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-pool-create/1 2024-09-16T04:01:34.386 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T04:01:34.386 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=b3ac9d17-3fca-4586-89f4-7e78d1c8ea34 2024-09-16T04:01:34.387 INFO:tasks.workunit.client.0.smithi096.stdout:add osd1 b3ac9d17-3fca-4586-89f4-7e78d1c8ea34 2024-09-16T04:01:34.387 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 b3ac9d17-3fca-4586-89f4-7e78d1c8ea34' 2024-09-16T04:01:34.387 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T04:01:34.407 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCeredm4cY+GBAAdhTMEsayHnNt3tlcvdPGPg== 2024-09-16T04:01:34.407 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCeredm4cY+GBAAdhTMEsayHnNt3tlcvdPGPg=="}' 2024-09-16T04:01:34.408 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new b3ac9d17-3fca-4586-89f4-7e78d1c8ea34 -i td/osd-pool-create/1/new.json 2024-09-16T04:01:34.893 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T04:01:34.908 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-pool-create/1/new.json 2024-09-16T04:01:34.910 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=38a92d84-8703-45d8-b5ef-7d976430f112 --auth-supported=none --mon-host=127.0.0.1:7105 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-pool-create/1 --osd-journal=td/osd-pool-create/1/journal --chdir=--debug_allow_any_pool_priority=true --run-dir=td/osd-pool-create '--admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-pool-create/$name.log' '--pid-file=td/osd-pool-create/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCeredm4cY+GBAAdhTMEsayHnNt3tlcvdPGPg== --osd-uuid b3ac9d17-3fca-4586-89f4-7e78d1c8ea34 2024-09-16T04:01:34.943 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:01:34.938+0000 7f3342b8e7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:01:34.988 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:01:34.982+0000 7f3342b8e7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:01:34.990 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:01:34.986+0000 7f3342b8e7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:01:34.990 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:01:34.986+0000 7f3342b8e7c0 -1 global_init_chdir: failed to chdir to directory: '--debug_allow_any_pool_priority=true': (2) No such file or directory 2024-09-16T04:01:34.990 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:01:34.986+0000 7f3342b8e7c0 -1 bdev(0x55a24eae7c00 td/osd-pool-create/1/block) open stat got: (1) Operation not permitted 2024-09-16T04:01:34.990 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:01:34.986+0000 7f3342b8e7c0 -1 bluestore(td/osd-pool-create/1) _read_fsid unparsable uuid 2024-09-16T04:01:41.218 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-pool-create/1/keyring 2024-09-16T04:01:41.219 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T04:01:41.220 INFO:tasks.workunit.client.0.smithi096.stdout:adding osd1 key to auth repository 2024-09-16T04:01:41.220 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2024-09-16T04:01:41.220 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-pool-create/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T04:01:41.800 INFO:tasks.workunit.client.0.smithi096.stdout:start osd.1 2024-09-16T04:01:41.801 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2024-09-16T04:01:41.801 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=38a92d84-8703-45d8-b5ef-7d976430f112 --auth-supported=none --mon-host=127.0.0.1:7105 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-pool-create/1 --osd-journal=td/osd-pool-create/1/journal --chdir=--debug_allow_any_pool_priority=true --run-dir=td/osd-pool-create '--admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-pool-create/$name.log' '--pid-file=td/osd-pool-create/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T04:01:41.801 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T04:01:41.801 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T04:01:41.801 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T04:01:41.829 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:01:41.826+0000 7f7ac8f677c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:01:41.832 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:01:41.830+0000 7f7ac8f677c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:01:41.833 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:01:41.830+0000 7f7ac8f677c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:01:41.833 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:01:41.834+0000 7f7ac8f677c0 -1 global_init_chdir: failed to chdir to directory: '--debug_allow_any_pool_priority=true': (2) No such file or directory 2024-09-16T04:01:42.245 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2024-09-16T04:01:42.246 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T04:01:42.246 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2024-09-16T04:01:42.246 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T04:01:42.246 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T04:01:42.246 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:01:42.246 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T04:01:42.246 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T04:01:42.247 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:01:42.247 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:01:42.709 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:01:43.092 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:01:43.090+0000 7f7ac8f677c0 -1 Falling back to public interface 2024-09-16T04:01:43.096 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:01:43.094+0000 7f7ac8f677c0 -1 global_init_chdir: failed to chdir to directory: '--debug_allow_any_pool_priority=true': (2) No such file or directory 2024-09-16T04:01:43.710 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:01:43.711 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:01:43.711 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T04:01:43.711 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T04:01:43.712 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:01:43.712 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:01:44.200 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:01:45.201 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:01:45.202 INFO:tasks.workunit.client.0.smithi096.stdout:2 2024-09-16T04:01:45.202 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:01:45.203 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T04:01:45.203 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:01:45.203 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:01:45.615 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:01:45.987 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:01:45.986+0000 7f7ac8f677c0 -1 osd.1 0 log_to_monitors true 2024-09-16T04:01:46.617 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:01:46.617 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:01:46.617 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T04:01:46.617 INFO:tasks.workunit.client.0.smithi096.stdout:3 2024-09-16T04:01:46.617 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:01:46.618 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:01:47.237 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:01:48.239 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:01:48.239 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:01:48.239 INFO:tasks.workunit.client.0.smithi096.stdout:4 2024-09-16T04:01:48.240 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T04:01:48.240 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:01:48.240 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:01:48.680 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:01:49.682 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:01:49.682 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:01:49.682 INFO:tasks.workunit.client.0.smithi096.stdout:5 2024-09-16T04:01:49.683 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T04:01:49.683 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:01:49.683 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:01:50.222 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:01:51.224 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:01:51.224 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:01:51.225 INFO:tasks.workunit.client.0.smithi096.stdout:6 2024-09-16T04:01:51.225 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T04:01:51.225 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:01:51.225 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:01:51.695 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:01:52.697 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:01:52.697 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:01:52.697 INFO:tasks.workunit.client.0.smithi096.stdout:7 2024-09-16T04:01:52.698 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T04:01:52.698 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:01:52.698 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:01:53.389 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:01:54.391 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:01:54.391 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:01:54.392 INFO:tasks.workunit.client.0.smithi096.stdout:8 2024-09-16T04:01:54.392 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T04:01:54.392 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:01:54.393 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:01:54.856 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:01:55.857 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:01:55.857 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:01:55.858 INFO:tasks.workunit.client.0.smithi096.stdout:9 2024-09-16T04:01:55.858 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T04:01:55.858 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:01:55.858 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:01:56.373 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:01:57.375 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:01:57.375 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:01:57.375 INFO:tasks.workunit.client.0.smithi096.stdout:10 2024-09-16T04:01:57.375 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T04:01:57.376 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:01:57.376 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:01:57.895 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:01:58.897 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:01:58.897 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:01:58.898 INFO:tasks.workunit.client.0.smithi096.stdout:11 2024-09-16T04:01:58.898 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T04:01:58.898 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:01:58.898 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:01:59.499 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:02:00.501 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:02:00.501 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:02:00.501 INFO:tasks.workunit.client.0.smithi096.stdout:12 2024-09-16T04:02:00.502 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T04:02:00.502 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:02:00.502 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:02:01.537 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:02:02.539 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:02:02.539 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:02:02.539 INFO:tasks.workunit.client.0.smithi096.stdout:13 2024-09-16T04:02:02.539 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T04:02:02.540 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:02:02.540 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:02:03.309 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:02:04.311 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:02:04.311 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:02:04.312 INFO:tasks.workunit.client.0.smithi096.stdout:14 2024-09-16T04:02:04.312 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T04:02:04.312 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:02:04.312 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:02:05.136 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:02:06.138 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:02:06.138 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:02:06.138 INFO:tasks.workunit.client.0.smithi096.stdout:15 2024-09-16T04:02:06.139 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T04:02:06.139 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:02:06.139 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:02:06.791 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:02:07.793 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:02:07.793 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:02:07.793 INFO:tasks.workunit.client.0.smithi096.stdout:16 2024-09-16T04:02:07.794 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T04:02:07.794 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:02:07.794 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:02:08.642 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:02:09.644 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:02:09.645 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:02:09.645 INFO:tasks.workunit.client.0.smithi096.stdout:17 2024-09-16T04:02:09.645 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T04:02:09.645 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:02:09.645 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:02:10.446 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:02:11.448 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:02:11.449 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:02:11.449 INFO:tasks.workunit.client.0.smithi096.stdout:18 2024-09-16T04:02:11.449 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 18 2024-09-16T04:02:11.449 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:02:11.450 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:02:11.905 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:02:12.907 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:02:12.907 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:02:12.907 INFO:tasks.workunit.client.0.smithi096.stdout:19 2024-09-16T04:02:12.908 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 19 2024-09-16T04:02:12.908 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:02:12.908 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:02:13.343 INFO:tasks.workunit.client.0.smithi096.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/1027685661,v1:127.0.0.1:6811/1027685661] [v2:127.0.0.1:6812/1027685661,v1:127.0.0.1:6813/1027685661] exists,up b3ac9d17-3fca-4586-89f4-7e78d1c8ea34 2024-09-16T04:02:13.345 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T04:02:13.346 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T04:02:13.346 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T04:02:13.346 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:231: check_pool_priority: run_osd td/osd-pool-create 2 2024-09-16T04:02:13.346 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-pool-create 2024-09-16T04:02:13.346 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T04:02:13.346 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2024-09-16T04:02:13.346 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T04:02:13.346 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-pool-create/2 2024-09-16T04:02:13.346 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=38a92d84-8703-45d8-b5ef-7d976430f112 --auth-supported=none --mon-host=127.0.0.1:7105 ' 2024-09-16T04:02:13.346 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T04:02:13.346 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T04:02:13.346 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T04:02:13.347 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-pool-create/2' 2024-09-16T04:02:13.347 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-pool-create/2/journal' 2024-09-16T04:02:13.347 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T04:02:13.347 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+=--debug_allow_any_pool_priority=true 2024-09-16T04:02:13.347 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-pool-create' 2024-09-16T04:02:13.347 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T04:02:13.347 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:02:13.347 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:02:13.347 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:02:13.347 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:02:13.347 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T04:02:13.347 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T04:02:13.349 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T04:02:13.349 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T04:02:13.349 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T04:02:13.349 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T04:02:13.349 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-pool-create/$name.log' 2024-09-16T04:02:13.349 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-pool-create/$name.pid' 2024-09-16T04:02:13.349 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T04:02:13.350 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T04:02:13.350 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T04:02:13.350 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T04:02:13.350 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T04:02:13.350 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T04:02:13.350 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-pool-create/2 2024-09-16T04:02:13.350 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T04:02:13.350 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=d1cc70d2-1122-4c03-9022-4090c3b00940 2024-09-16T04:02:13.350 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 d1cc70d2-1122-4c03-9022-4090c3b00940' 2024-09-16T04:02:13.350 INFO:tasks.workunit.client.0.smithi096.stdout:add osd2 d1cc70d2-1122-4c03-9022-4090c3b00940 2024-09-16T04:02:13.351 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T04:02:13.371 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDFredmle0RFhAAMwpbV5WVjI4e43nvcBavyA== 2024-09-16T04:02:13.371 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDFredmle0RFhAAMwpbV5WVjI4e43nvcBavyA=="}' 2024-09-16T04:02:13.371 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new d1cc70d2-1122-4c03-9022-4090c3b00940 -i td/osd-pool-create/2/new.json 2024-09-16T04:02:13.846 INFO:tasks.workunit.client.0.smithi096.stdout:2 2024-09-16T04:02:13.862 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-pool-create/2/new.json 2024-09-16T04:02:13.863 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=38a92d84-8703-45d8-b5ef-7d976430f112 --auth-supported=none --mon-host=127.0.0.1:7105 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-pool-create/2 --osd-journal=td/osd-pool-create/2/journal --chdir=--debug_allow_any_pool_priority=true --run-dir=td/osd-pool-create '--admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-pool-create/$name.log' '--pid-file=td/osd-pool-create/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDFredmle0RFhAAMwpbV5WVjI4e43nvcBavyA== --osd-uuid d1cc70d2-1122-4c03-9022-4090c3b00940 2024-09-16T04:02:13.894 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:02:13.893+0000 7f18788e07c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:02:13.921 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:02:13.917+0000 7f18788e07c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:02:13.922 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:02:13.921+0000 7f18788e07c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:02:13.922 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:02:13.921+0000 7f18788e07c0 -1 global_init_chdir: failed to chdir to directory: '--debug_allow_any_pool_priority=true': (2) No such file or directory 2024-09-16T04:02:13.922 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:02:13.921+0000 7f18788e07c0 -1 bdev(0x564596967c00 td/osd-pool-create/2/block) open stat got: (1) Operation not permitted 2024-09-16T04:02:13.922 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:02:13.921+0000 7f18788e07c0 -1 bluestore(td/osd-pool-create/2) _read_fsid unparsable uuid 2024-09-16T04:02:20.786 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-pool-create/2/keyring 2024-09-16T04:02:20.786 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T04:02:20.787 INFO:tasks.workunit.client.0.smithi096.stdout:adding osd2 key to auth repository 2024-09-16T04:02:20.788 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2024-09-16T04:02:20.788 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-pool-create/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T04:02:21.358 INFO:tasks.workunit.client.0.smithi096.stdout:start osd.2 2024-09-16T04:02:21.359 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2024-09-16T04:02:21.359 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T04:02:21.359 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T04:02:21.359 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=38a92d84-8703-45d8-b5ef-7d976430f112 --auth-supported=none --mon-host=127.0.0.1:7105 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-pool-create/2 --osd-journal=td/osd-pool-create/2/journal --chdir=--debug_allow_any_pool_priority=true --run-dir=td/osd-pool-create '--admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-pool-create/$name.log' '--pid-file=td/osd-pool-create/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T04:02:21.359 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T04:02:21.389 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:02:21.385+0000 7fb9b96617c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:02:21.424 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:02:21.421+0000 7fb9b96617c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:02:21.425 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:02:21.425+0000 7fb9b96617c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:02:21.425 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:02:21.425+0000 7fb9b96617c0 -1 global_init_chdir: failed to chdir to directory: '--debug_allow_any_pool_priority=true': (2) No such file or directory 2024-09-16T04:02:21.879 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2024-09-16T04:02:21.879 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T04:02:21.879 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2024-09-16T04:02:21.879 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T04:02:21.880 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T04:02:21.880 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T04:02:21.880 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:02:21.880 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T04:02:21.880 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:02:21.881 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:02:22.336 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:02:22.632 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:02:22.629+0000 7fb9b96617c0 -1 Falling back to public interface 2024-09-16T04:02:22.638 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:02:22.637+0000 7fb9b96617c0 -1 global_init_chdir: failed to chdir to directory: '--debug_allow_any_pool_priority=true': (2) No such file or directory 2024-09-16T04:02:23.338 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:02:23.338 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:02:23.338 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T04:02:23.339 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T04:02:23.339 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:02:23.339 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:02:23.768 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:02:24.770 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:02:24.770 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:02:24.770 INFO:tasks.workunit.client.0.smithi096.stdout:2 2024-09-16T04:02:24.771 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T04:02:24.771 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:02:24.771 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:02:25.184 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:02:25.574 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:02:25.573+0000 7fb9b96617c0 -1 osd.2 0 log_to_monitors true 2024-09-16T04:02:26.186 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:02:26.186 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:02:26.186 INFO:tasks.workunit.client.0.smithi096.stdout:3 2024-09-16T04:02:26.187 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T04:02:26.187 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:02:26.187 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:02:26.681 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:02:27.682 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:02:27.682 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:02:27.683 INFO:tasks.workunit.client.0.smithi096.stdout:4 2024-09-16T04:02:27.683 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T04:02:27.684 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:02:27.684 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:02:28.141 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:02:29.142 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:02:29.142 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:02:29.143 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T04:02:29.143 INFO:tasks.workunit.client.0.smithi096.stdout:5 2024-09-16T04:02:29.143 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:02:29.143 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:02:29.787 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:02:30.790 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:02:30.790 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:02:30.790 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T04:02:30.790 INFO:tasks.workunit.client.0.smithi096.stdout:6 2024-09-16T04:02:30.791 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:02:30.791 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:02:31.373 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:02:32.375 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:02:32.375 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:02:32.375 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T04:02:32.375 INFO:tasks.workunit.client.0.smithi096.stdout:7 2024-09-16T04:02:32.376 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:02:32.376 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:02:32.808 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:02:33.809 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:02:33.810 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:02:33.810 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T04:02:33.810 INFO:tasks.workunit.client.0.smithi096.stdout:8 2024-09-16T04:02:33.810 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:02:33.810 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:02:34.262 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:02:35.264 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:02:35.264 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:02:35.264 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T04:02:35.265 INFO:tasks.workunit.client.0.smithi096.stdout:9 2024-09-16T04:02:35.265 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:02:35.265 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:02:35.852 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:02:36.854 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:02:36.854 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:02:36.855 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T04:02:36.855 INFO:tasks.workunit.client.0.smithi096.stdout:10 2024-09-16T04:02:36.855 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:02:36.855 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:02:37.302 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:02:38.304 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:02:38.304 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:02:38.304 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T04:02:38.305 INFO:tasks.workunit.client.0.smithi096.stdout:11 2024-09-16T04:02:38.305 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:02:38.305 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:02:38.821 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:02:39.824 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:02:39.824 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:02:39.824 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T04:02:39.824 INFO:tasks.workunit.client.0.smithi096.stdout:12 2024-09-16T04:02:39.824 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:02:39.825 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:02:40.439 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:02:41.441 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:02:41.441 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:02:41.441 INFO:tasks.workunit.client.0.smithi096.stdout:13 2024-09-16T04:02:41.442 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T04:02:41.442 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:02:41.442 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:02:42.568 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:02:43.570 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:02:43.570 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:02:43.570 INFO:tasks.workunit.client.0.smithi096.stdout:14 2024-09-16T04:02:43.571 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T04:02:43.571 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:02:43.571 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:02:44.312 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:02:45.313 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:02:45.313 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:02:45.314 INFO:tasks.workunit.client.0.smithi096.stdout:15 2024-09-16T04:02:45.314 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T04:02:45.314 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:02:45.314 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:02:45.734 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:02:46.736 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:02:46.736 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:02:46.737 INFO:tasks.workunit.client.0.smithi096.stdout:16 2024-09-16T04:02:46.737 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T04:02:46.737 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:02:46.737 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:02:47.349 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:02:48.351 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:02:48.351 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:02:48.351 INFO:tasks.workunit.client.0.smithi096.stdout:17 2024-09-16T04:02:48.352 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T04:02:48.352 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:02:48.352 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:02:49.168 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:02:50.169 INFO:tasks.workunit.client.0.smithi096.stdout:18 2024-09-16T04:02:50.170 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:02:50.170 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:02:50.170 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 18 2024-09-16T04:02:50.170 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:02:50.170 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:02:50.795 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:02:51.796 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:02:51.796 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:02:51.796 INFO:tasks.workunit.client.0.smithi096.stdout:19 2024-09-16T04:02:51.797 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 19 2024-09-16T04:02:51.797 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:02:51.797 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:02:52.227 INFO:tasks.workunit.client.0.smithi096.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/2643661082,v1:127.0.0.1:6819/2643661082] [v2:127.0.0.1:6820/2643661082,v1:127.0.0.1:6821/2643661082] exists,up d1cc70d2-1122-4c03-9022-4090c3b00940 2024-09-16T04:02:52.228 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T04:02:52.228 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T04:02:52.228 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T04:02:52.228 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: seq 0 20 2024-09-16T04:02:52.229 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:02:52.230 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 0 + 1 2024-09-16T04:02:52.231 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=1 2024-09-16T04:02:52.231 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test1 1 1 2024-09-16T04:02:52.905 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test1' already exists 2024-09-16T04:02:52.922 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:02:52.923 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 1 + 1 2024-09-16T04:02:52.924 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=2 2024-09-16T04:02:52.924 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test2 1 1 2024-09-16T04:02:53.787 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test2' already exists 2024-09-16T04:02:53.805 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:02:53.805 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 2 + 1 2024-09-16T04:02:53.807 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=3 2024-09-16T04:02:53.807 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test3 1 1 2024-09-16T04:02:54.490 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test3' already exists 2024-09-16T04:02:54.506 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:02:54.506 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 3 + 1 2024-09-16T04:02:54.507 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=4 2024-09-16T04:02:54.508 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test4 1 1 2024-09-16T04:02:55.439 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test4' already exists 2024-09-16T04:02:55.457 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:02:55.457 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 4 + 1 2024-09-16T04:02:55.459 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=5 2024-09-16T04:02:55.459 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test5 1 1 2024-09-16T04:02:56.439 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test5' already exists 2024-09-16T04:02:56.456 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:02:56.457 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 5 + 1 2024-09-16T04:02:56.458 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=6 2024-09-16T04:02:56.458 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test6 1 1 2024-09-16T04:02:57.174 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test6' already exists 2024-09-16T04:02:57.191 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:02:57.191 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 6 + 1 2024-09-16T04:02:57.193 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=7 2024-09-16T04:02:57.193 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test7 1 1 2024-09-16T04:02:57.721 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test7' already exists 2024-09-16T04:02:57.738 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:02:57.738 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 7 + 1 2024-09-16T04:02:57.740 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=8 2024-09-16T04:02:57.741 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test8 1 1 2024-09-16T04:02:58.987 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test8' already exists 2024-09-16T04:02:59.005 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:02:59.005 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 8 + 1 2024-09-16T04:02:59.006 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=9 2024-09-16T04:02:59.006 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test9 1 1 2024-09-16T04:03:00.080 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test9' already exists 2024-09-16T04:03:00.097 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:03:00.098 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 9 + 1 2024-09-16T04:03:00.100 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=10 2024-09-16T04:03:00.100 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test10 1 1 2024-09-16T04:03:01.474 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test10' already exists 2024-09-16T04:03:01.490 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:03:01.491 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 10 + 1 2024-09-16T04:03:01.492 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=11 2024-09-16T04:03:01.492 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test11 1 1 2024-09-16T04:03:02.575 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test11' already exists 2024-09-16T04:03:02.593 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:03:02.593 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 11 + 1 2024-09-16T04:03:02.594 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=12 2024-09-16T04:03:02.594 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test12 1 1 2024-09-16T04:03:03.316 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test12' already exists 2024-09-16T04:03:03.333 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:03:03.333 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 12 + 1 2024-09-16T04:03:03.334 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=13 2024-09-16T04:03:03.334 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test13 1 1 2024-09-16T04:03:04.218 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test13' already exists 2024-09-16T04:03:04.236 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:03:04.236 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 13 + 1 2024-09-16T04:03:04.238 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=14 2024-09-16T04:03:04.238 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test14 1 1 2024-09-16T04:03:05.530 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test14' already exists 2024-09-16T04:03:05.547 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:03:05.547 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 14 + 1 2024-09-16T04:03:05.549 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=15 2024-09-16T04:03:05.549 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test15 1 1 2024-09-16T04:03:06.563 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test15' already exists 2024-09-16T04:03:06.580 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:03:06.580 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 15 + 1 2024-09-16T04:03:06.582 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=16 2024-09-16T04:03:06.582 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test16 1 1 2024-09-16T04:03:07.396 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test16' already exists 2024-09-16T04:03:07.413 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:03:07.413 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 16 + 1 2024-09-16T04:03:07.415 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=17 2024-09-16T04:03:07.415 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test17 1 1 2024-09-16T04:03:08.450 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test17' already exists 2024-09-16T04:03:08.473 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:03:08.474 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 17 + 1 2024-09-16T04:03:08.475 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=18 2024-09-16T04:03:08.475 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test18 1 1 2024-09-16T04:03:09.645 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test18' already exists 2024-09-16T04:03:09.661 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:03:09.662 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 18 + 1 2024-09-16T04:03:09.663 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=19 2024-09-16T04:03:09.663 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test19 1 1 2024-09-16T04:03:10.416 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test19' already exists 2024-09-16T04:03:10.433 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:03:10.434 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 19 + 1 2024-09-16T04:03:10.435 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=20 2024-09-16T04:03:10.435 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test20 1 1 2024-09-16T04:03:11.547 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test20' already exists 2024-09-16T04:03:11.563 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:03:11.564 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 20 + 1 2024-09-16T04:03:11.565 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=21 2024-09-16T04:03:11.566 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test21 1 1 2024-09-16T04:03:12.970 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test21' already exists 2024-09-16T04:03:12.988 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:240: check_pool_priority: wait_for_clean 2024-09-16T04:03:12.988 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1633: wait_for_clean: local cmd= 2024-09-16T04:03:12.988 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1634: wait_for_clean: local num_active_clean=-1 2024-09-16T04:03:12.988 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1635: wait_for_clean: local cur_active_clean 2024-09-16T04:03:12.989 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: get_timeout_delays 90 .1 2024-09-16T04:03:12.990 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: shopt -q -o xtrace 2024-09-16T04:03:12.990 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: echo true 2024-09-16T04:03:12.990 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: local trace=true 2024-09-16T04:03:12.990 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: true 2024-09-16T04:03:12.990 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: shopt -u -o xtrace 2024-09-16T04:03:13.098 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-09-16T04:03:13.098 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: local -a delays 2024-09-16T04:03:13.098 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1637: wait_for_clean: local -i loop=0 2024-09-16T04:03:13.098 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1639: wait_for_clean: flush_pg_stats 2024-09-16T04:03:13.098 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: local timeout=300 2024-09-16T04:03:13.099 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ceph osd ls 2024-09-16T04:03:13.667 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ids='0 2024-09-16T04:03:13.667 INFO:tasks.workunit.client.0.smithi096.stderr:1 2024-09-16T04:03:13.667 INFO:tasks.workunit.client.0.smithi096.stderr:2' 2024-09-16T04:03:13.667 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2208: flush_pg_stats: seqs= 2024-09-16T04:03:13.667 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:03:13.667 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-09-16T04:03:13.835 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=21474836506 2024-09-16T04:03:13.835 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 21474836506 2024-09-16T04:03:13.835 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836506' 2024-09-16T04:03:13.835 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:03:13.835 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-09-16T04:03:14.031 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=38654705687 2024-09-16T04:03:14.031 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 38654705687 2024-09-16T04:03:14.031 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836506 1-38654705687' 2024-09-16T04:03:14.031 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:03:14.031 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-09-16T04:03:14.294 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=60129542157 2024-09-16T04:03:14.294 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 60129542157 2024-09-16T04:03:14.294 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836506 1-38654705687 2-60129542157' 2024-09-16T04:03:14.295 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:03:14.295 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 0-21474836506 2024-09-16T04:03:14.295 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:03:14.295 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=0 2024-09-16T04:03:14.296 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 0-21474836506 2024-09-16T04:03:14.296 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:03:14.297 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=21474836506 2024-09-16T04:03:14.298 INFO:tasks.workunit.client.0.smithi096.stdout:waiting osd.0 seq 21474836506 2024-09-16T04:03:14.298 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.0 seq 21474836506' 2024-09-16T04:03:14.298 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T04:03:14.716 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836504 -lt 21474836506 2024-09-16T04:03:14.716 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: flush_pg_stats: sleep 1 2024-09-16T04:03:15.717 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2224: flush_pg_stats: '[' 300 -eq 0 ']' 2024-09-16T04:03:15.718 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T04:03:16.137 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836506 -lt 21474836506 2024-09-16T04:03:16.137 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:03:16.138 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 1-38654705687 2024-09-16T04:03:16.138 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:03:16.139 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=1 2024-09-16T04:03:16.140 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 1-38654705687 2024-09-16T04:03:16.140 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:03:16.141 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=38654705687 2024-09-16T04:03:16.141 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.1 seq 38654705687' 2024-09-16T04:03:16.141 INFO:tasks.workunit.client.0.smithi096.stdout:waiting osd.1 seq 38654705687 2024-09-16T04:03:16.142 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 1 2024-09-16T04:03:16.595 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 38654705687 -lt 38654705687 2024-09-16T04:03:16.595 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:03:16.596 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 2-60129542157 2024-09-16T04:03:16.596 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:03:16.597 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=2 2024-09-16T04:03:16.598 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 2-60129542157 2024-09-16T04:03:16.598 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:03:16.599 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=60129542157 2024-09-16T04:03:16.600 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.2 seq 60129542157' 2024-09-16T04:03:16.600 INFO:tasks.workunit.client.0.smithi096.stdout:waiting osd.2 seq 60129542157 2024-09-16T04:03:16.600 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 2 2024-09-16T04:03:17.033 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 60129542157 -lt 60129542157 2024-09-16T04:03:17.033 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: get_num_pgs 2024-09-16T04:03:17.034 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T04:03:17.034 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T04:03:17.638 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: test 21 == 0 2024-09-16T04:03:17.638 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T04:03:17.639 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T04:03:17.639 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T04:03:17.639 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T04:03:17.639 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T04:03:17.639 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T04:03:17.639 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T04:03:18.060 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=21 2024-09-16T04:03:18.061 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T04:03:18.061 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T04:03:18.061 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T04:03:18.663 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 21 = 21 2024-09-16T04:03:18.663 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: break 2024-09-16T04:03:18.664 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: return 0 2024-09-16T04:03:18.664 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: seq 0 20 2024-09-16T04:03:18.664 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:03:18.664 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 0 + 1 2024-09-16T04:03:18.665 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=1 2024-09-16T04:03:18.666 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 0 '*' -5 2024-09-16T04:03:18.666 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test1 recovery_priority 0 2024-09-16T04:03:19.415 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 1 recovery_priority to 0 2024-09-16T04:03:19.436 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:03:19.437 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 1 + 1 2024-09-16T04:03:19.438 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=2 2024-09-16T04:03:19.439 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 1 '*' -5 2024-09-16T04:03:19.440 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test2 recovery_priority -5 2024-09-16T04:03:20.311 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 2 recovery_priority to -5 2024-09-16T04:03:20.330 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:03:20.332 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 2 + 1 2024-09-16T04:03:20.333 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=3 2024-09-16T04:03:20.334 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 2 '*' -5 2024-09-16T04:03:20.335 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test3 recovery_priority -10 2024-09-16T04:03:21.290 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 3 recovery_priority to -10 2024-09-16T04:03:21.310 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:03:21.311 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 3 + 1 2024-09-16T04:03:21.312 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=4 2024-09-16T04:03:21.313 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 3 '*' -5 2024-09-16T04:03:21.314 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test4 recovery_priority -15 2024-09-16T04:03:22.253 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 4 recovery_priority to -15 2024-09-16T04:03:22.270 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:03:22.271 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 4 + 1 2024-09-16T04:03:22.273 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=5 2024-09-16T04:03:22.273 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 4 '*' -5 2024-09-16T04:03:22.274 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test5 recovery_priority -20 2024-09-16T04:03:23.023 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 5 recovery_priority to -20 2024-09-16T04:03:23.049 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:03:23.049 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 5 + 1 2024-09-16T04:03:23.050 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=6 2024-09-16T04:03:23.051 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 5 '*' -5 2024-09-16T04:03:23.052 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test6 recovery_priority -25 2024-09-16T04:03:23.718 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 6 recovery_priority to -25 2024-09-16T04:03:23.737 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:03:23.737 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 6 + 1 2024-09-16T04:03:23.738 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=7 2024-09-16T04:03:23.739 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 6 '*' -5 2024-09-16T04:03:23.740 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test7 recovery_priority -30 2024-09-16T04:03:24.790 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 7 recovery_priority to -30 2024-09-16T04:03:24.816 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:03:24.817 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 7 + 1 2024-09-16T04:03:24.818 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=8 2024-09-16T04:03:24.819 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 7 '*' -5 2024-09-16T04:03:24.820 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test8 recovery_priority -35 2024-09-16T04:03:25.710 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 8 recovery_priority to -35 2024-09-16T04:03:25.729 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:03:25.729 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 8 + 1 2024-09-16T04:03:25.730 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=9 2024-09-16T04:03:25.731 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 8 '*' -5 2024-09-16T04:03:25.731 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test9 recovery_priority -40 2024-09-16T04:03:26.639 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 9 recovery_priority to -40 2024-09-16T04:03:26.662 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:03:26.663 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 9 + 1 2024-09-16T04:03:26.664 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=10 2024-09-16T04:03:26.665 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 9 '*' -5 2024-09-16T04:03:26.666 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test10 recovery_priority -45 2024-09-16T04:03:27.368 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 10 recovery_priority to -45 2024-09-16T04:03:27.387 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:03:27.388 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 10 + 1 2024-09-16T04:03:27.389 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=11 2024-09-16T04:03:27.390 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 10 '*' -5 2024-09-16T04:03:27.391 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test11 recovery_priority -50 2024-09-16T04:03:28.414 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 11 recovery_priority to -50 2024-09-16T04:03:28.438 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:03:28.438 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 11 + 1 2024-09-16T04:03:28.439 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=12 2024-09-16T04:03:28.440 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 11 '*' -5 2024-09-16T04:03:28.441 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test12 recovery_priority -55 2024-09-16T04:03:29.184 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 12 recovery_priority to -55 2024-09-16T04:03:29.203 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:03:29.204 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 12 + 1 2024-09-16T04:03:29.205 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=13 2024-09-16T04:03:29.205 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 12 '*' -5 2024-09-16T04:03:29.206 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test13 recovery_priority -60 2024-09-16T04:03:30.055 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 13 recovery_priority to -60 2024-09-16T04:03:30.076 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:03:30.076 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 13 + 1 2024-09-16T04:03:30.077 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=14 2024-09-16T04:03:30.078 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 13 '*' -5 2024-09-16T04:03:30.080 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test14 recovery_priority -65 2024-09-16T04:03:31.017 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 14 recovery_priority to -65 2024-09-16T04:03:31.040 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:03:31.040 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 14 + 1 2024-09-16T04:03:31.041 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=15 2024-09-16T04:03:31.041 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 14 '*' -5 2024-09-16T04:03:31.042 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test15 recovery_priority -70 2024-09-16T04:03:32.088 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 15 recovery_priority to -70 2024-09-16T04:03:32.109 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:03:32.109 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 15 + 1 2024-09-16T04:03:32.110 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=16 2024-09-16T04:03:32.111 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 15 '*' -5 2024-09-16T04:03:32.113 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test16 recovery_priority -75 2024-09-16T04:03:32.967 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 16 recovery_priority to -75 2024-09-16T04:03:32.986 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:03:32.986 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 16 + 1 2024-09-16T04:03:32.987 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=17 2024-09-16T04:03:32.988 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 16 '*' -5 2024-09-16T04:03:32.990 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test17 recovery_priority -80 2024-09-16T04:03:33.812 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 17 recovery_priority to -80 2024-09-16T04:03:33.837 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:03:33.837 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 17 + 1 2024-09-16T04:03:33.838 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=18 2024-09-16T04:03:33.838 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 17 '*' -5 2024-09-16T04:03:33.839 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test18 recovery_priority -85 2024-09-16T04:03:34.858 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 18 recovery_priority to -85 2024-09-16T04:03:34.880 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:03:34.880 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 18 + 1 2024-09-16T04:03:34.881 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=19 2024-09-16T04:03:34.882 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 18 '*' -5 2024-09-16T04:03:34.883 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test19 recovery_priority -90 2024-09-16T04:03:35.771 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 19 recovery_priority to -90 2024-09-16T04:03:35.793 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:03:35.793 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 19 + 1 2024-09-16T04:03:35.794 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=20 2024-09-16T04:03:35.795 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 19 '*' -5 2024-09-16T04:03:35.796 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test20 recovery_priority -95 2024-09-16T04:03:36.734 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 20 recovery_priority to -95 2024-09-16T04:03:36.754 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:03:36.754 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 20 + 1 2024-09-16T04:03:36.756 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=21 2024-09-16T04:03:36.757 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 20 '*' -5 2024-09-16T04:03:36.758 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test21 recovery_priority -100 2024-09-16T04:03:37.755 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 21 recovery_priority to -100 2024-09-16T04:03:37.778 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:249: check_pool_priority: bin/ceph osd dump 2024-09-16T04:03:37.779 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh: line 249: bin/ceph: No such file or directory 2024-09-16T04:03:37.779 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:252: check_pool_priority: kill_daemons 2024-09-16T04:03:37.780 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T04:03:37.780 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T04:03:37.781 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T04:03:37.781 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T04:03:37.781 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T04:03:39.094 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T04:03:39.095 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:253: check_pool_priority: run_mon td/osd-pool-create a 2024-09-16T04:03:39.095 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-pool-create 2024-09-16T04:03:39.095 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T04:03:39.095 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T04:03:39.095 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T04:03:39.095 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-pool-create/a 2024-09-16T04:03:39.095 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-pool-create/a --run-dir=td/osd-pool-create 2024-09-16T04:03:39.119 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:03:39.115+0000 7fb32a013e00 -1 'td/osd-pool-create/a' already exists and is not empty: monitor may already exist 2024-09-16T04:03:39.122 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T04:03:39.122 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:03:39.122 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:03:39.123 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:03:39.123 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:03:39.123 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T04:03:39.123 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T04:03:39.123 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug_allow_any_pool_priority=true --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-pool-create/a '--log-file=td/osd-pool-create/$name.log' '--admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' --mon-cluster-log-file=td/osd-pool-create/log --run-dir=td/osd-pool-create '--pid-file=td/osd-pool-create/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-09-16T04:03:39.402 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T04:03:39.403 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T04:03:39.403 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T04:03:39.403 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T04:03:39.404 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T04:03:39.404 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T04:03:39.405 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T04:03:39.405 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T04:03:39.405 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T04:03:39.405 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T04:03:39.405 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:03:39.405 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T04:03:39.405 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.128966/ceph-mon.a.asok 2024-09-16T04:03:39.405 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T04:03:39.406 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.128966/ceph-mon.a.asok config get fsid 2024-09-16T04:03:39.518 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T04:03:39.518 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T04:03:39.518 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T04:03:39.518 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T04:03:39.519 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T04:03:39.519 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T04:03:39.519 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T04:03:39.519 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T04:03:39.520 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T04:03:39.520 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:03:39.520 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T04:03:39.520 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.128966/ceph-mon.a.asok 2024-09-16T04:03:39.520 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T04:03:39.520 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.128966/ceph-mon.a.asok config get mon_host 2024-09-16T04:03:39.622 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:254: check_pool_priority: run_mgr td/osd-pool-create x 2024-09-16T04:03:39.622 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-pool-create 2024-09-16T04:03:39.622 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2024-09-16T04:03:39.622 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2024-09-16T04:03:39.622 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2024-09-16T04:03:39.623 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-pool-create/x 2024-09-16T04:03:39.623 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2024-09-16T04:03:40.055 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2024-09-16T04:03:40.055 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:03:40.055 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:03:40.056 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:03:40.056 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:03:40.056 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T04:03:40.056 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T04:03:40.057 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T04:03:40.058 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --debug_allow_any_pool_priority=true --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-pool-create/x '--log-file=td/osd-pool-create/$name.log' '--admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' --run-dir=td/osd-pool-create '--pid-file=td/osd-pool-create/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T04:03:40.091 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:255: check_pool_priority: activate_osd td/osd-pool-create 0 2024-09-16T04:03:40.092 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-pool-create 2024-09-16T04:03:40.092 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2024-09-16T04:03:40.092 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2024-09-16T04:03:40.092 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2024-09-16T04:03:40.092 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-pool-create/0 2024-09-16T04:03:40.092 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=38a92d84-8703-45d8-b5ef-7d976430f112 --auth-supported=none --mon-host=127.0.0.1:7105 ' 2024-09-16T04:03:40.092 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T04:03:40.092 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T04:03:40.092 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T04:03:40.092 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-pool-create/0' 2024-09-16T04:03:40.092 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-pool-create/0/journal' 2024-09-16T04:03:40.093 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2024-09-16T04:03:40.093 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+=--debug_allow_any_pool_priority=true 2024-09-16T04:03:40.093 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-pool-create' 2024-09-16T04:03:40.093 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2024-09-16T04:03:40.093 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:03:40.093 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:03:40.093 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:03:40.093 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:03:40.093 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T04:03:40.093 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T04:03:40.093 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T04:03:40.093 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2024-09-16T04:03:40.093 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-pool-create/$name.log' 2024-09-16T04:03:40.094 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-pool-create/$name.pid' 2024-09-16T04:03:40.094 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T04:03:40.094 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T04:03:40.094 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T04:03:40.094 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T04:03:40.094 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2024-09-16T04:03:40.094 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2024-09-16T04:03:40.094 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-pool-create/0 2024-09-16T04:03:40.095 INFO:tasks.workunit.client.0.smithi096.stdout:start osd.0 2024-09-16T04:03:40.095 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2024-09-16T04:03:40.096 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=38a92d84-8703-45d8-b5ef-7d976430f112 --auth-supported=none --mon-host=127.0.0.1:7105 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-pool-create/0 --osd-journal=td/osd-pool-create/0/journal --chdir=--debug_allow_any_pool_priority=true --run-dir=td/osd-pool-create '--admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-pool-create/$name.log' '--pid-file=td/osd-pool-create/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T04:03:40.096 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-pool-create/0/whoami 2024-09-16T04:03:40.096 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2024-09-16T04:03:40.096 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2024-09-16T04:03:40.096 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2024-09-16T04:03:40.096 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2024-09-16T04:03:40.116 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:03:40.111+0000 7f23e9b9f7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:03:40.119 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:03:40.115+0000 7f23e9b9f7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:03:40.121 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:03:40.115+0000 7f23e9b9f7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:03:40.121 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:03:40.115+0000 7f23e9b9f7c0 -1 global_init_chdir: failed to chdir to directory: '--debug_allow_any_pool_priority=true': (2) No such file or directory 2024-09-16T04:03:40.557 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2024-09-16T04:03:40.557 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T04:03:40.557 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2024-09-16T04:03:40.557 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T04:03:40.558 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T04:03:40.558 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:03:40.558 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T04:03:40.558 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T04:03:40.558 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:03:40.559 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:03:41.011 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:03:41.428 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:03:41.423+0000 7f23e9b9f7c0 -1 Falling back to public interface 2024-09-16T04:03:41.429 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:03:41.427+0000 7f23e9b9f7c0 -1 global_init_chdir: failed to chdir to directory: '--debug_allow_any_pool_priority=true': (2) No such file or directory 2024-09-16T04:03:42.013 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:03:42.013 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:03:42.013 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T04:03:42.013 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T04:03:42.014 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:03:42.014 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:03:42.423 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:03:43.424 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:03:43.424 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:03:43.424 INFO:tasks.workunit.client.0.smithi096.stdout:2 2024-09-16T04:03:43.425 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T04:03:43.425 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:03:43.425 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:03:43.834 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:03:44.836 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:03:44.836 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:03:44.836 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T04:03:44.836 INFO:tasks.workunit.client.0.smithi096.stdout:3 2024-09-16T04:03:44.837 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:03:44.837 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:03:45.344 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:03:45.339+0000 7f23e9b9f7c0 -1 osd.0 105 log_to_monitors true 2024-09-16T04:03:45.419 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:03:46.421 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:03:46.421 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:03:46.421 INFO:tasks.workunit.client.0.smithi096.stdout:4 2024-09-16T04:03:46.422 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T04:03:46.422 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:03:46.422 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:03:46.876 INFO:tasks.workunit.client.0.smithi096.stdout:osd.0 up in weight 1 up_from 110 up_thru 110 down_at 107 last_clean_interval [5,105) [v2:127.0.0.1:6800/3961590641,v1:127.0.0.1:6801/3961590641] [v2:127.0.0.1:6802/3961590641,v1:127.0.0.1:6803/3961590641] exists,up 1d5c9e9e-4f75-4416-bab3-3c4e68381550 2024-09-16T04:03:46.879 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T04:03:46.879 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T04:03:46.879 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T04:03:46.879 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:256: check_pool_priority: activate_osd td/osd-pool-create 1 2024-09-16T04:03:46.879 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-pool-create 2024-09-16T04:03:46.879 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2024-09-16T04:03:46.879 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2024-09-16T04:03:46.880 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2024-09-16T04:03:46.880 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-pool-create/1 2024-09-16T04:03:46.880 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=38a92d84-8703-45d8-b5ef-7d976430f112 --auth-supported=none --mon-host=127.0.0.1:7105 ' 2024-09-16T04:03:46.880 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T04:03:46.880 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T04:03:46.880 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T04:03:46.880 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-pool-create/1' 2024-09-16T04:03:46.880 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-pool-create/1/journal' 2024-09-16T04:03:46.880 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2024-09-16T04:03:46.880 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+=--debug_allow_any_pool_priority=true 2024-09-16T04:03:46.880 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-pool-create' 2024-09-16T04:03:46.880 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2024-09-16T04:03:46.881 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:03:46.881 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:03:46.881 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:03:46.881 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:03:46.881 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T04:03:46.881 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T04:03:46.881 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T04:03:46.881 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2024-09-16T04:03:46.881 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-pool-create/$name.log' 2024-09-16T04:03:46.881 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-pool-create/$name.pid' 2024-09-16T04:03:46.882 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T04:03:46.882 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T04:03:46.882 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T04:03:46.882 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T04:03:46.882 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2024-09-16T04:03:46.882 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2024-09-16T04:03:46.882 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-pool-create/1 2024-09-16T04:03:46.882 INFO:tasks.workunit.client.0.smithi096.stdout:start osd.1 2024-09-16T04:03:46.883 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2024-09-16T04:03:46.883 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=38a92d84-8703-45d8-b5ef-7d976430f112 --auth-supported=none --mon-host=127.0.0.1:7105 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-pool-create/1 --osd-journal=td/osd-pool-create/1/journal --chdir=--debug_allow_any_pool_priority=true --run-dir=td/osd-pool-create '--admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-pool-create/$name.log' '--pid-file=td/osd-pool-create/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T04:03:46.883 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-pool-create/1/whoami 2024-09-16T04:03:46.884 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2024-09-16T04:03:46.884 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2024-09-16T04:03:46.884 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2024-09-16T04:03:46.884 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2024-09-16T04:03:46.913 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:03:46.907+0000 7f81b485f7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:03:46.936 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:03:46.931+0000 7f81b485f7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:03:46.937 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:03:46.931+0000 7f81b485f7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:03:46.937 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:03:46.935+0000 7f81b485f7c0 -1 global_init_chdir: failed to chdir to directory: '--debug_allow_any_pool_priority=true': (2) No such file or directory 2024-09-16T04:03:47.311 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2024-09-16T04:03:47.311 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T04:03:47.311 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2024-09-16T04:03:47.311 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T04:03:47.312 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T04:03:47.312 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:03:47.312 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T04:03:47.312 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T04:03:47.313 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:03:47.313 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:03:47.743 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:03:48.220 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:03:48.215+0000 7f81b485f7c0 -1 Falling back to public interface 2024-09-16T04:03:48.224 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:03:48.219+0000 7f81b485f7c0 -1 global_init_chdir: failed to chdir to directory: '--debug_allow_any_pool_priority=true': (2) No such file or directory 2024-09-16T04:03:48.744 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:03:48.745 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:03:48.745 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T04:03:48.745 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T04:03:48.745 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:03:48.746 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:03:49.168 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:03:50.170 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:03:50.170 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:03:50.170 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T04:03:50.171 INFO:tasks.workunit.client.0.smithi096.stdout:2 2024-09-16T04:03:50.171 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:03:50.171 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:03:50.642 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:03:51.643 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:03:51.644 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:03:51.644 INFO:tasks.workunit.client.0.smithi096.stdout:3 2024-09-16T04:03:51.644 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T04:03:51.645 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:03:51.645 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:03:52.022 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:03:52.019+0000 7f81b485f7c0 -1 osd.1 106 log_to_monitors true 2024-09-16T04:03:52.071 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:03:53.073 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:03:53.073 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:03:53.073 INFO:tasks.workunit.client.0.smithi096.stdout:4 2024-09-16T04:03:53.074 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T04:03:53.074 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:03:53.074 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:03:53.572 INFO:tasks.workunit.client.0.smithi096.stdout:osd.1 up in weight 1 up_from 113 up_thru 113 down_at 107 last_clean_interval [9,106) [v2:127.0.0.1:6810/985418852,v1:127.0.0.1:6811/985418852] [v2:127.0.0.1:6812/985418852,v1:127.0.0.1:6813/985418852] exists,up b3ac9d17-3fca-4586-89f4-7e78d1c8ea34 2024-09-16T04:03:53.574 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T04:03:53.574 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T04:03:53.574 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T04:03:53.574 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:257: check_pool_priority: activate_osd td/osd-pool-create 2 2024-09-16T04:03:53.575 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-pool-create 2024-09-16T04:03:53.575 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2024-09-16T04:03:53.575 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2024-09-16T04:03:53.575 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2024-09-16T04:03:53.575 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-pool-create/2 2024-09-16T04:03:53.575 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=38a92d84-8703-45d8-b5ef-7d976430f112 --auth-supported=none --mon-host=127.0.0.1:7105 ' 2024-09-16T04:03:53.575 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T04:03:53.575 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T04:03:53.575 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T04:03:53.575 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-pool-create/2' 2024-09-16T04:03:53.575 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-pool-create/2/journal' 2024-09-16T04:03:53.575 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2024-09-16T04:03:53.575 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+=--debug_allow_any_pool_priority=true 2024-09-16T04:03:53.576 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-pool-create' 2024-09-16T04:03:53.576 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2024-09-16T04:03:53.576 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:03:53.576 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:03:53.576 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:03:53.576 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:03:53.576 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T04:03:53.576 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T04:03:53.577 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T04:03:53.577 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2024-09-16T04:03:53.577 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-pool-create/$name.log' 2024-09-16T04:03:53.577 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-pool-create/$name.pid' 2024-09-16T04:03:53.577 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T04:03:53.577 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T04:03:53.578 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T04:03:53.578 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T04:03:53.578 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2024-09-16T04:03:53.578 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2024-09-16T04:03:53.578 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-pool-create/2 2024-09-16T04:03:53.579 INFO:tasks.workunit.client.0.smithi096.stdout:start osd.2 2024-09-16T04:03:53.579 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2024-09-16T04:03:53.579 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=38a92d84-8703-45d8-b5ef-7d976430f112 --auth-supported=none --mon-host=127.0.0.1:7105 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-pool-create/2 --osd-journal=td/osd-pool-create/2/journal --chdir=--debug_allow_any_pool_priority=true --run-dir=td/osd-pool-create '--admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-pool-create/$name.log' '--pid-file=td/osd-pool-create/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T04:03:53.580 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-pool-create/2/whoami 2024-09-16T04:03:53.580 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2024-09-16T04:03:53.580 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2024-09-16T04:03:53.580 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2024-09-16T04:03:53.580 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2024-09-16T04:03:53.609 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:03:53.603+0000 7f7996dde7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:03:53.616 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:03:53.611+0000 7f7996dde7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:03:53.618 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:03:53.615+0000 7f7996dde7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:03:53.618 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:03:53.615+0000 7f7996dde7c0 -1 global_init_chdir: failed to chdir to directory: '--debug_allow_any_pool_priority=true': (2) No such file or directory 2024-09-16T04:03:54.191 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2024-09-16T04:03:54.191 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T04:03:54.191 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2024-09-16T04:03:54.191 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T04:03:54.192 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T04:03:54.192 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T04:03:54.192 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:03:54.192 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T04:03:54.192 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:03:54.192 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:03:54.726 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:03:54.852 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:03:54.847+0000 7f7996dde7c0 -1 Falling back to public interface 2024-09-16T04:03:54.857 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:03:54.851+0000 7f7996dde7c0 -1 global_init_chdir: failed to chdir to directory: '--debug_allow_any_pool_priority=true': (2) No such file or directory 2024-09-16T04:03:55.728 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:03:55.728 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:03:55.728 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T04:03:55.728 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T04:03:55.729 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:03:55.729 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:03:56.203 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:03:57.205 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:03:57.205 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:03:57.205 INFO:tasks.workunit.client.0.smithi096.stdout:2 2024-09-16T04:03:57.206 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T04:03:57.206 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:03:57.206 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:03:57.737 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:03:58.332 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:03:58.327+0000 7f7996dde7c0 -1 osd.2 104 log_to_monitors true 2024-09-16T04:03:58.739 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:03:58.739 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:03:58.739 INFO:tasks.workunit.client.0.smithi096.stdout:3 2024-09-16T04:03:58.740 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T04:03:58.740 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:03:58.740 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:03:59.392 INFO:tasks.workunit.client.0.smithi096.stdout:osd.2 up in weight 1 up_from 117 up_thru 61 down_at 107 last_clean_interval [14,104) [v2:127.0.0.1:6818/2641469401,v1:127.0.0.1:6819/2641469401] [v2:127.0.0.1:6820/2641469401,v1:127.0.0.1:6821/2641469401] exists,up d1cc70d2-1122-4c03-9022-4090c3b00940 2024-09-16T04:03:59.393 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T04:03:59.393 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T04:03:59.393 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T04:03:59.393 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:258: check_pool_priority: sleep 5 2024-09-16T04:04:04.394 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:260: check_pool_priority: grep convert td/osd-pool-create/mon.a.log 2024-09-16T04:04:04.422 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T04:00:57.283+0000 7f37a2c99640 20 mon.a@0(leader).osd e1 convert_pool_priorities nothing to fix 2024-09-16T04:04:04.422 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T04:03:39.499+0000 7ff41ba24e00 10 mon.a@0(leader).osd e107 convert_pool_priorities pool 2 recovery_priority adjusted -5 to 0 2024-09-16T04:04:04.423 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T04:03:39.499+0000 7ff41ba24e00 10 mon.a@0(leader).osd e107 convert_pool_priorities pool 3 recovery_priority adjusted -10 to -1 2024-09-16T04:04:04.423 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T04:03:39.499+0000 7ff41ba24e00 10 mon.a@0(leader).osd e107 convert_pool_priorities pool 4 recovery_priority adjusted -15 to -1 2024-09-16T04:04:04.423 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T04:03:39.499+0000 7ff41ba24e00 10 mon.a@0(leader).osd e107 convert_pool_priorities pool 5 recovery_priority adjusted -20 to -2 2024-09-16T04:04:04.423 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T04:03:39.499+0000 7ff41ba24e00 10 mon.a@0(leader).osd e107 convert_pool_priorities pool 6 recovery_priority adjusted -25 to -2 2024-09-16T04:04:04.423 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T04:03:39.499+0000 7ff41ba24e00 10 mon.a@0(leader).osd e107 convert_pool_priorities pool 7 recovery_priority adjusted -30 to -3 2024-09-16T04:04:04.423 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T04:03:39.499+0000 7ff41ba24e00 10 mon.a@0(leader).osd e107 convert_pool_priorities pool 8 recovery_priority adjusted -35 to -3 2024-09-16T04:04:04.423 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T04:03:39.499+0000 7ff41ba24e00 10 mon.a@0(leader).osd e107 convert_pool_priorities pool 9 recovery_priority adjusted -40 to -4 2024-09-16T04:04:04.423 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T04:03:39.499+0000 7ff41ba24e00 10 mon.a@0(leader).osd e107 convert_pool_priorities pool 10 recovery_priority adjusted -45 to -4 2024-09-16T04:04:04.423 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T04:03:39.499+0000 7ff41ba24e00 10 mon.a@0(leader).osd e107 convert_pool_priorities pool 11 recovery_priority adjusted -50 to -5 2024-09-16T04:04:04.423 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T04:03:39.499+0000 7ff41ba24e00 10 mon.a@0(leader).osd e107 convert_pool_priorities pool 12 recovery_priority adjusted -55 to -5 2024-09-16T04:04:04.423 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T04:03:39.499+0000 7ff41ba24e00 10 mon.a@0(leader).osd e107 convert_pool_priorities pool 13 recovery_priority adjusted -60 to -6 2024-09-16T04:04:04.423 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T04:03:39.499+0000 7ff41ba24e00 10 mon.a@0(leader).osd e107 convert_pool_priorities pool 14 recovery_priority adjusted -65 to -6 2024-09-16T04:04:04.423 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T04:03:39.499+0000 7ff41ba24e00 10 mon.a@0(leader).osd e107 convert_pool_priorities pool 15 recovery_priority adjusted -70 to -7 2024-09-16T04:04:04.424 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T04:03:39.499+0000 7ff41ba24e00 10 mon.a@0(leader).osd e107 convert_pool_priorities pool 16 recovery_priority adjusted -75 to -7 2024-09-16T04:04:04.424 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T04:03:39.499+0000 7ff41ba24e00 10 mon.a@0(leader).osd e107 convert_pool_priorities pool 17 recovery_priority adjusted -80 to -8 2024-09-16T04:04:04.424 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T04:03:39.499+0000 7ff41ba24e00 10 mon.a@0(leader).osd e107 convert_pool_priorities pool 18 recovery_priority adjusted -85 to -8 2024-09-16T04:04:04.424 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T04:03:39.499+0000 7ff41ba24e00 10 mon.a@0(leader).osd e107 convert_pool_priorities pool 19 recovery_priority adjusted -90 to -9 2024-09-16T04:04:04.424 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T04:03:39.499+0000 7ff41ba24e00 10 mon.a@0(leader).osd e107 convert_pool_priorities pool 20 recovery_priority adjusted -95 to -9 2024-09-16T04:04:04.424 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T04:03:39.499+0000 7ff41ba24e00 10 mon.a@0(leader).osd e107 convert_pool_priorities pool 21 recovery_priority adjusted -100 to -10 2024-09-16T04:04:04.424 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:261: check_pool_priority: ceph osd dump 2024-09-16T04:04:04.825 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 119 2024-09-16T04:04:04.825 INFO:tasks.workunit.client.0.smithi096.stdout:fsid 38a92d84-8703-45d8-b5ef-7d976430f112 2024-09-16T04:04:04.825 INFO:tasks.workunit.client.0.smithi096.stdout:created 2024-09-16T04:00:57.120593+0000 2024-09-16T04:04:04.825 INFO:tasks.workunit.client.0.smithi096.stdout:modified 2024-09-16T04:03:59.793438+0000 2024-09-16T04:04:04.825 INFO:tasks.workunit.client.0.smithi096.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-16T04:04:04.825 INFO:tasks.workunit.client.0.smithi096.stdout:crush_version 10 2024-09-16T04:04:04.825 INFO:tasks.workunit.client.0.smithi096.stdout:full_ratio 0.99 2024-09-16T04:04:04.825 INFO:tasks.workunit.client.0.smithi096.stdout:backfillfull_ratio 0.99 2024-09-16T04:04:04.825 INFO:tasks.workunit.client.0.smithi096.stdout:nearfull_ratio 0.85 2024-09-16T04:04:04.825 INFO:tasks.workunit.client.0.smithi096.stdout:require_min_compat_client luminous 2024-09-16T04:04:04.826 INFO:tasks.workunit.client.0.smithi096.stdout:min_compat_client jewel 2024-09-16T04:04:04.826 INFO:tasks.workunit.client.0.smithi096.stdout:require_osd_release squid 2024-09-16T04:04:04.826 INFO:tasks.workunit.client.0.smithi096.stdout:stretch_mode_enabled false 2024-09-16T04:04:04.826 INFO:tasks.workunit.client.0.smithi096.stdout:pool 1 'test1' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 66 flags hashpspool stripe_width 0 read_balance_score 3.00 2024-09-16T04:04:04.826 INFO:tasks.workunit.client.0.smithi096.stdout:pool 2 'test2' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 108 flags hashpspool stripe_width 0 read_balance_score 3.00 2024-09-16T04:04:04.826 INFO:tasks.workunit.client.0.smithi096.stdout:pool 3 'test3' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 108 flags hashpspool stripe_width 0 recovery_priority -1 read_balance_score 3.00 2024-09-16T04:04:04.826 INFO:tasks.workunit.client.0.smithi096.stdout:pool 4 'test4' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 108 flags hashpspool stripe_width 0 recovery_priority -1 read_balance_score 3.00 2024-09-16T04:04:04.826 INFO:tasks.workunit.client.0.smithi096.stdout:pool 5 'test5' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 108 flags hashpspool stripe_width 0 recovery_priority -2 read_balance_score 3.00 2024-09-16T04:04:04.826 INFO:tasks.workunit.client.0.smithi096.stdout:pool 6 'test6' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 108 flags hashpspool stripe_width 0 recovery_priority -2 read_balance_score 3.00 2024-09-16T04:04:04.826 INFO:tasks.workunit.client.0.smithi096.stdout:pool 7 'test7' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 108 flags hashpspool stripe_width 0 recovery_priority -3 read_balance_score 3.00 2024-09-16T04:04:04.826 INFO:tasks.workunit.client.0.smithi096.stdout:pool 8 'test8' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 108 flags hashpspool stripe_width 0 recovery_priority -3 read_balance_score 3.00 2024-09-16T04:04:04.827 INFO:tasks.workunit.client.0.smithi096.stdout:pool 9 'test9' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 108 flags hashpspool stripe_width 0 recovery_priority -4 read_balance_score 3.00 2024-09-16T04:04:04.827 INFO:tasks.workunit.client.0.smithi096.stdout:pool 10 'test10' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 108 flags hashpspool stripe_width 0 recovery_priority -4 read_balance_score 3.00 2024-09-16T04:04:04.827 INFO:tasks.workunit.client.0.smithi096.stdout:pool 11 'test11' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 108 flags hashpspool stripe_width 0 recovery_priority -5 read_balance_score 3.00 2024-09-16T04:04:04.827 INFO:tasks.workunit.client.0.smithi096.stdout:pool 12 'test12' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 108 flags hashpspool stripe_width 0 recovery_priority -5 read_balance_score 3.00 2024-09-16T04:04:04.827 INFO:tasks.workunit.client.0.smithi096.stdout:pool 13 'test13' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 108 flags hashpspool stripe_width 0 recovery_priority -6 read_balance_score 3.00 2024-09-16T04:04:04.827 INFO:tasks.workunit.client.0.smithi096.stdout:pool 14 'test14' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 108 flags hashpspool stripe_width 0 recovery_priority -6 read_balance_score 3.00 2024-09-16T04:04:04.827 INFO:tasks.workunit.client.0.smithi096.stdout:pool 15 'test15' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 108 flags hashpspool stripe_width 0 recovery_priority -7 read_balance_score 3.00 2024-09-16T04:04:04.827 INFO:tasks.workunit.client.0.smithi096.stdout:pool 16 'test16' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 108 flags hashpspool stripe_width 0 recovery_priority -7 read_balance_score 3.00 2024-09-16T04:04:04.827 INFO:tasks.workunit.client.0.smithi096.stdout:pool 17 'test17' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 108 flags hashpspool stripe_width 0 recovery_priority -8 read_balance_score 3.00 2024-09-16T04:04:04.827 INFO:tasks.workunit.client.0.smithi096.stdout:pool 18 'test18' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 108 flags hashpspool stripe_width 0 recovery_priority -8 read_balance_score 3.00 2024-09-16T04:04:04.827 INFO:tasks.workunit.client.0.smithi096.stdout:pool 19 'test19' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 108 flags hashpspool stripe_width 0 recovery_priority -9 read_balance_score 3.00 2024-09-16T04:04:04.827 INFO:tasks.workunit.client.0.smithi096.stdout:pool 20 'test20' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 108 flags hashpspool stripe_width 0 recovery_priority -9 read_balance_score 3.00 2024-09-16T04:04:04.828 INFO:tasks.workunit.client.0.smithi096.stdout:pool 21 'test21' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 108 flags hashpspool stripe_width 0 recovery_priority -10 read_balance_score 3.00 2024-09-16T04:04:04.828 INFO:tasks.workunit.client.0.smithi096.stdout:max_osd 3 2024-09-16T04:04:04.828 INFO:tasks.workunit.client.0.smithi096.stdout:osd.0 up in weight 1 up_from 110 up_thru 117 down_at 107 last_clean_interval [5,105) [v2:127.0.0.1:6800/3961590641,v1:127.0.0.1:6801/3961590641] [v2:127.0.0.1:6802/3961590641,v1:127.0.0.1:6803/3961590641] exists,up 1d5c9e9e-4f75-4416-bab3-3c4e68381550 2024-09-16T04:04:04.828 INFO:tasks.workunit.client.0.smithi096.stdout:osd.1 up in weight 1 up_from 113 up_thru 117 down_at 107 last_clean_interval [9,106) [v2:127.0.0.1:6810/985418852,v1:127.0.0.1:6811/985418852] [v2:127.0.0.1:6812/985418852,v1:127.0.0.1:6813/985418852] exists,up b3ac9d17-3fca-4586-89f4-7e78d1c8ea34 2024-09-16T04:04:04.828 INFO:tasks.workunit.client.0.smithi096.stdout:osd.2 up in weight 1 up_from 117 up_thru 117 down_at 107 last_clean_interval [14,104) [v2:127.0.0.1:6818/2641469401,v1:127.0.0.1:6819/2641469401] [v2:127.0.0.1:6820/2641469401,v1:127.0.0.1:6821/2641469401] exists,up d1cc70d2-1122-4c03-9022-4090c3b00940 2024-09-16T04:04:04.828 INFO:tasks.workunit.client.0.smithi096.stdout:blocklist 127.0.0.1:0/1576877499 expires 2024-09-17T04:03:44.688614+0000 2024-09-16T04:04:04.828 INFO:tasks.workunit.client.0.smithi096.stdout:blocklist 127.0.0.1:0/3612487835 expires 2024-09-17T04:03:44.688614+0000 2024-09-16T04:04:04.828 INFO:tasks.workunit.client.0.smithi096.stdout:blocklist 127.0.0.1:0/245995887 expires 2024-09-17T04:03:44.688614+0000 2024-09-16T04:04:04.828 INFO:tasks.workunit.client.0.smithi096.stdout:blocklist 127.0.0.1:6801/4118803556 expires 2024-09-17T04:03:44.688614+0000 2024-09-16T04:04:04.828 INFO:tasks.workunit.client.0.smithi096.stdout:blocklist 127.0.0.1:6800/4118803556 expires 2024-09-17T04:03:44.688614+0000 2024-09-16T04:04:04.840 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:263: check_pool_priority: pos=1 2024-09-16T04:04:04.841 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: grep '^pool' 2024-09-16T04:04:04.841 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: sed 's/.*recovery_priority //' 2024-09-16T04:04:04.841 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: ceph osd dump 2024-09-16T04:04:04.841 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: awk '{ print $1 }' 2024-09-16T04:04:05.339 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T04:04:05.339 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo 0 0 -1 -1 -2 -2 -3 -3 -4 -4 -5 -5 -6 -6 -7 -7 -8 -8 -9 -9 -10 2024-09-16T04:04:05.340 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $1 }' 2024-09-16T04:04:05.343 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=0 2024-09-16T04:04:05.343 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test 0 = 0 2024-09-16T04:04:05.343 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:270: check_pool_priority: result=pool 2024-09-16T04:04:05.343 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test pool = pool 2024-09-16T04:04:05.343 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 1 + 1 2024-09-16T04:04:05.345 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=2 2024-09-16T04:04:05.345 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T04:04:05.345 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo 0 0 -1 -1 -2 -2 -3 -3 -4 -4 -5 -5 -6 -6 -7 -7 -8 -8 -9 -9 -10 2024-09-16T04:04:05.345 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $2 }' 2024-09-16T04:04:05.347 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=0 2024-09-16T04:04:05.348 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test 0 = 0 2024-09-16T04:04:05.348 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:270: check_pool_priority: result=pool 2024-09-16T04:04:05.348 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test pool = pool 2024-09-16T04:04:05.348 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 2 + 1 2024-09-16T04:04:05.348 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=3 2024-09-16T04:04:05.349 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T04:04:05.349 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo 0 0 -1 -1 -2 -2 -3 -3 -4 -4 -5 -5 -6 -6 -7 -7 -8 -8 -9 -9 -10 2024-09-16T04:04:05.349 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $3 }' 2024-09-16T04:04:05.351 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=-1 2024-09-16T04:04:05.351 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test -1 = 0 2024-09-16T04:04:05.351 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test -1 = -1 2024-09-16T04:04:05.351 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 3 + 1 2024-09-16T04:04:05.352 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=4 2024-09-16T04:04:05.352 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T04:04:05.353 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo 0 0 -1 -1 -2 -2 -3 -3 -4 -4 -5 -5 -6 -6 -7 -7 -8 -8 -9 -9 -10 2024-09-16T04:04:05.353 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $4 }' 2024-09-16T04:04:05.355 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=-1 2024-09-16T04:04:05.355 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test -1 = 0 2024-09-16T04:04:05.355 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test -1 = -1 2024-09-16T04:04:05.355 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 4 + 1 2024-09-16T04:04:05.356 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=5 2024-09-16T04:04:05.356 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T04:04:05.356 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo 0 0 -1 -1 -2 -2 -3 -3 -4 -4 -5 -5 -6 -6 -7 -7 -8 -8 -9 -9 -10 2024-09-16T04:04:05.357 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $5 }' 2024-09-16T04:04:05.358 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=-2 2024-09-16T04:04:05.358 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test -2 = 0 2024-09-16T04:04:05.358 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test -2 = -2 2024-09-16T04:04:05.359 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 5 + 1 2024-09-16T04:04:05.359 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=6 2024-09-16T04:04:05.359 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T04:04:05.360 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo 0 0 -1 -1 -2 -2 -3 -3 -4 -4 -5 -5 -6 -6 -7 -7 -8 -8 -9 -9 -10 2024-09-16T04:04:05.360 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $6 }' 2024-09-16T04:04:05.362 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=-2 2024-09-16T04:04:05.362 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test -2 = 0 2024-09-16T04:04:05.363 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test -2 = -2 2024-09-16T04:04:05.363 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 6 + 1 2024-09-16T04:04:05.363 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=7 2024-09-16T04:04:05.363 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T04:04:05.364 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo 0 0 -1 -1 -2 -2 -3 -3 -4 -4 -5 -5 -6 -6 -7 -7 -8 -8 -9 -9 -10 2024-09-16T04:04:05.364 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $7 }' 2024-09-16T04:04:05.366 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=-3 2024-09-16T04:04:05.366 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test -3 = 0 2024-09-16T04:04:05.366 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test -3 = -3 2024-09-16T04:04:05.367 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 7 + 1 2024-09-16T04:04:05.367 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=8 2024-09-16T04:04:05.367 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T04:04:05.368 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo 0 0 -1 -1 -2 -2 -3 -3 -4 -4 -5 -5 -6 -6 -7 -7 -8 -8 -9 -9 -10 2024-09-16T04:04:05.368 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $8 }' 2024-09-16T04:04:05.370 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=-3 2024-09-16T04:04:05.370 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test -3 = 0 2024-09-16T04:04:05.370 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test -3 = -3 2024-09-16T04:04:05.370 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 8 + 1 2024-09-16T04:04:05.371 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=9 2024-09-16T04:04:05.371 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T04:04:05.371 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo 0 0 -1 -1 -2 -2 -3 -3 -4 -4 -5 -5 -6 -6 -7 -7 -8 -8 -9 -9 -10 2024-09-16T04:04:05.372 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $9 }' 2024-09-16T04:04:05.374 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=-4 2024-09-16T04:04:05.374 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test -4 = 0 2024-09-16T04:04:05.374 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test -4 = -4 2024-09-16T04:04:05.374 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 9 + 1 2024-09-16T04:04:05.374 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=10 2024-09-16T04:04:05.374 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T04:04:05.375 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo 0 0 -1 -1 -2 -2 -3 -3 -4 -4 -5 -5 -6 -6 -7 -7 -8 -8 -9 -9 -10 2024-09-16T04:04:05.375 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $10 }' 2024-09-16T04:04:05.377 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=-4 2024-09-16T04:04:05.377 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test -4 = 0 2024-09-16T04:04:05.377 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test -4 = -4 2024-09-16T04:04:05.377 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 10 + 1 2024-09-16T04:04:05.378 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=11 2024-09-16T04:04:05.378 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T04:04:05.378 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo 0 0 -1 -1 -2 -2 -3 -3 -4 -4 -5 -5 -6 -6 -7 -7 -8 -8 -9 -9 -10 2024-09-16T04:04:05.379 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $11 }' 2024-09-16T04:04:05.381 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=-5 2024-09-16T04:04:05.381 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test -5 = 0 2024-09-16T04:04:05.381 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test -5 = -5 2024-09-16T04:04:05.381 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 11 + 1 2024-09-16T04:04:05.382 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=12 2024-09-16T04:04:05.382 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T04:04:05.382 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo 0 0 -1 -1 -2 -2 -3 -3 -4 -4 -5 -5 -6 -6 -7 -7 -8 -8 -9 -9 -10 2024-09-16T04:04:05.382 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $12 }' 2024-09-16T04:04:05.384 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=-5 2024-09-16T04:04:05.384 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test -5 = 0 2024-09-16T04:04:05.385 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test -5 = -5 2024-09-16T04:04:05.385 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 12 + 1 2024-09-16T04:04:05.385 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=13 2024-09-16T04:04:05.385 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T04:04:05.386 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo 0 0 -1 -1 -2 -2 -3 -3 -4 -4 -5 -5 -6 -6 -7 -7 -8 -8 -9 -9 -10 2024-09-16T04:04:05.386 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $13 }' 2024-09-16T04:04:05.388 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=-6 2024-09-16T04:04:05.388 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test -6 = 0 2024-09-16T04:04:05.388 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test -6 = -6 2024-09-16T04:04:05.389 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 13 + 1 2024-09-16T04:04:05.389 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=14 2024-09-16T04:04:05.389 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T04:04:05.390 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo 0 0 -1 -1 -2 -2 -3 -3 -4 -4 -5 -5 -6 -6 -7 -7 -8 -8 -9 -9 -10 2024-09-16T04:04:05.390 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $14 }' 2024-09-16T04:04:05.391 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=-6 2024-09-16T04:04:05.391 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test -6 = 0 2024-09-16T04:04:05.391 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test -6 = -6 2024-09-16T04:04:05.392 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 14 + 1 2024-09-16T04:04:05.392 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=15 2024-09-16T04:04:05.392 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T04:04:05.393 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo 0 0 -1 -1 -2 -2 -3 -3 -4 -4 -5 -5 -6 -6 -7 -7 -8 -8 -9 -9 -10 2024-09-16T04:04:05.393 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $15 }' 2024-09-16T04:04:05.395 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=-7 2024-09-16T04:04:05.395 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test -7 = 0 2024-09-16T04:04:05.395 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test -7 = -7 2024-09-16T04:04:05.396 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 15 + 1 2024-09-16T04:04:05.396 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=16 2024-09-16T04:04:05.396 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T04:04:05.397 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo 0 0 -1 -1 -2 -2 -3 -3 -4 -4 -5 -5 -6 -6 -7 -7 -8 -8 -9 -9 -10 2024-09-16T04:04:05.397 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $16 }' 2024-09-16T04:04:05.399 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=-7 2024-09-16T04:04:05.399 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test -7 = 0 2024-09-16T04:04:05.399 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test -7 = -7 2024-09-16T04:04:05.399 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 16 + 1 2024-09-16T04:04:05.400 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=17 2024-09-16T04:04:05.400 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T04:04:05.400 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo 0 0 -1 -1 -2 -2 -3 -3 -4 -4 -5 -5 -6 -6 -7 -7 -8 -8 -9 -9 -10 2024-09-16T04:04:05.401 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $17 }' 2024-09-16T04:04:05.403 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=-8 2024-09-16T04:04:05.403 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test -8 = 0 2024-09-16T04:04:05.403 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test -8 = -8 2024-09-16T04:04:05.403 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 17 + 1 2024-09-16T04:04:05.403 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=18 2024-09-16T04:04:05.404 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T04:04:05.404 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo 0 0 -1 -1 -2 -2 -3 -3 -4 -4 -5 -5 -6 -6 -7 -7 -8 -8 -9 -9 -10 2024-09-16T04:04:05.404 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $18 }' 2024-09-16T04:04:05.406 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=-8 2024-09-16T04:04:05.407 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test -8 = 0 2024-09-16T04:04:05.407 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test -8 = -8 2024-09-16T04:04:05.407 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 18 + 1 2024-09-16T04:04:05.407 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=19 2024-09-16T04:04:05.407 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T04:04:05.408 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo 0 0 -1 -1 -2 -2 -3 -3 -4 -4 -5 -5 -6 -6 -7 -7 -8 -8 -9 -9 -10 2024-09-16T04:04:05.408 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $19 }' 2024-09-16T04:04:05.411 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=-9 2024-09-16T04:04:05.411 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test -9 = 0 2024-09-16T04:04:05.411 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test -9 = -9 2024-09-16T04:04:05.412 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 19 + 1 2024-09-16T04:04:05.412 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=20 2024-09-16T04:04:05.412 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T04:04:05.412 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo 0 0 -1 -1 -2 -2 -3 -3 -4 -4 -5 -5 -6 -6 -7 -7 -8 -8 -9 -9 -10 2024-09-16T04:04:05.413 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $20 }' 2024-09-16T04:04:05.414 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=-9 2024-09-16T04:04:05.414 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test -9 = 0 2024-09-16T04:04:05.414 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test -9 = -9 2024-09-16T04:04:05.414 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 20 + 1 2024-09-16T04:04:05.415 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=21 2024-09-16T04:04:05.415 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T04:04:05.416 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo 0 0 -1 -1 -2 -2 -3 -3 -4 -4 -5 -5 -6 -6 -7 -7 -8 -8 -9 -9 -10 2024-09-16T04:04:05.416 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $21 }' 2024-09-16T04:04:05.418 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=-10 2024-09-16T04:04:05.418 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test -10 = 0 2024-09-16T04:04:05.418 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test -10 = -10 2024-09-16T04:04:05.418 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 21 + 1 2024-09-16T04:04:05.419 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=22 2024-09-16T04:04:05.419 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:33: run: teardown td/osd-pool-create 2024-09-16T04:04:05.419 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-pool-create 2024-09-16T04:04:05.419 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T04:04:05.419 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-pool-create KILL 2024-09-16T04:04:05.420 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T04:04:05.420 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T04:04:05.420 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T04:04:05.420 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T04:04:05.420 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T04:04:05.528 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T04:04:05.529 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T04:04:05.529 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T04:04:05.530 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T04:04:05.530 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T04:04:05.531 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T04:04:05.531 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T04:04:05.532 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T04:04:05.532 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T04:04:05.533 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T04:04:05.533 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T04:04:05.533 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T04:04:05.534 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T04:04:05.534 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-pool-create 2024-09-16T04:04:05.559 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T04:04:05.559 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:04:05.559 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T04:04:05.559 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.128966 2024-09-16T04:04:05.561 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T04:04:05.561 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T04:04:05.561 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:30: run: for func in $funcs 2024-09-16T04:04:05.561 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:31: run: setup td/osd-pool-create 2024-09-16T04:04:05.561 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-pool-create 2024-09-16T04:04:05.561 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-pool-create 2024-09-16T04:04:05.561 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-pool-create 2024-09-16T04:04:05.561 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T04:04:05.561 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-pool-create KILL 2024-09-16T04:04:05.561 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T04:04:05.561 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T04:04:05.561 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T04:04:05.562 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T04:04:05.562 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T04:04:05.562 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T04:04:05.563 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T04:04:05.563 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T04:04:05.564 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T04:04:05.565 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T04:04:05.565 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T04:04:05.565 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T04:04:05.566 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T04:04:05.566 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T04:04:05.566 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T04:04:05.567 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T04:04:05.567 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T04:04:05.568 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T04:04:05.568 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-pool-create 2024-09-16T04:04:05.569 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T04:04:05.569 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:04:05.570 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T04:04:05.570 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.128966 2024-09-16T04:04:05.571 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T04:04:05.571 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T04:04:05.571 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-pool-create 2024-09-16T04:04:05.572 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T04:04:05.572 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:04:05.573 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T04:04:05.573 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.128966 2024-09-16T04:04:05.575 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T04:04:05.575 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2024-09-16T04:04:05.575 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T04:04:05.575 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-pool-create 1' TERM HUP INT 2024-09-16T04:04:05.576 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:32: run: TEST_pool_pos_only_prio td/osd-pool-create 2024-09-16T04:04:05.576 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:278: TEST_pool_pos_only_prio: local dir=td/osd-pool-create 2024-09-16T04:04:05.576 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:279: TEST_pool_pos_only_prio: check_pool_priority td/osd-pool-create 20 5 '0 0 1 1 2 2 3 3 4 4 5 5 6 6 7 7 8 8 9 9 10' 2024-09-16T04:04:05.576 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:215: check_pool_priority: local dir=td/osd-pool-create 2024-09-16T04:04:05.576 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:216: check_pool_priority: shift 2024-09-16T04:04:05.576 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:217: check_pool_priority: local pools=20 2024-09-16T04:04:05.576 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:218: check_pool_priority: shift 2024-09-16T04:04:05.576 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:219: check_pool_priority: local spread=5 2024-09-16T04:04:05.576 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:220: check_pool_priority: shift 2024-09-16T04:04:05.576 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:221: check_pool_priority: local 'results=0 0 1 1 2 2 3 3 4 4 5 5 6 6 7 7 8 8 9 9 10' 2024-09-16T04:04:05.576 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:223: check_pool_priority: setup td/osd-pool-create 2024-09-16T04:04:05.576 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-pool-create 2024-09-16T04:04:05.576 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-pool-create 2024-09-16T04:04:05.577 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-pool-create 2024-09-16T04:04:05.577 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T04:04:05.577 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-pool-create KILL 2024-09-16T04:04:05.577 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T04:04:05.577 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T04:04:05.577 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T04:04:05.577 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T04:04:05.577 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T04:04:05.577 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T04:04:05.578 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T04:04:05.578 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T04:04:05.578 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T04:04:05.579 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T04:04:05.579 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T04:04:05.580 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T04:04:05.580 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T04:04:05.580 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T04:04:05.581 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T04:04:05.581 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T04:04:05.582 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T04:04:05.582 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T04:04:05.583 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-pool-create 2024-09-16T04:04:05.584 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T04:04:05.584 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:04:05.584 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T04:04:05.584 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.128966 2024-09-16T04:04:05.585 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T04:04:05.585 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T04:04:05.585 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-pool-create 2024-09-16T04:04:05.586 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T04:04:05.587 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:04:05.587 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T04:04:05.587 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.128966 2024-09-16T04:04:05.588 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T04:04:05.589 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2024-09-16T04:04:05.589 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T04:04:05.589 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-pool-create 1' TERM HUP INT 2024-09-16T04:04:05.589 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:225: check_pool_priority: EXTRA_OPTS=--debug_allow_any_pool_priority=true 2024-09-16T04:04:05.589 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:226: check_pool_priority: export EXTRA_OPTS 2024-09-16T04:04:05.589 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:227: check_pool_priority: run_mon td/osd-pool-create a 2024-09-16T04:04:05.589 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-pool-create 2024-09-16T04:04:05.589 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T04:04:05.589 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T04:04:05.589 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T04:04:05.589 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-pool-create/a 2024-09-16T04:04:05.589 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-pool-create/a --run-dir=td/osd-pool-create 2024-09-16T04:04:06.055 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T04:04:06.055 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:04:06.055 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:04:06.056 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:04:06.056 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:04:06.056 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T04:04:06.056 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T04:04:06.057 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug_allow_any_pool_priority=true --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-pool-create/a '--log-file=td/osd-pool-create/$name.log' '--admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' --mon-cluster-log-file=td/osd-pool-create/log --run-dir=td/osd-pool-create '--pid-file=td/osd-pool-create/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-09-16T04:04:06.291 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T04:04:06.293 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T04:04:06.293 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T04:04:06.293 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T04:04:06.293 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T04:04:06.293 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T04:04:06.294 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T04:04:06.294 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T04:04:06.294 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T04:04:06.294 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T04:04:06.294 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:04:06.295 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T04:04:06.295 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.128966/ceph-mon.a.asok 2024-09-16T04:04:06.295 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T04:04:06.295 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.128966/ceph-mon.a.asok config get fsid 2024-09-16T04:04:06.413 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T04:04:06.413 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T04:04:06.413 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T04:04:06.413 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T04:04:06.414 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T04:04:06.414 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T04:04:06.414 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T04:04:06.414 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T04:04:06.414 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T04:04:06.414 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:04:06.414 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T04:04:06.414 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.128966/ceph-mon.a.asok 2024-09-16T04:04:06.415 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T04:04:06.415 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.128966/ceph-mon.a.asok config get mon_host 2024-09-16T04:04:06.524 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:228: check_pool_priority: run_mgr td/osd-pool-create x 2024-09-16T04:04:06.524 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-pool-create 2024-09-16T04:04:06.524 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2024-09-16T04:04:06.524 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2024-09-16T04:04:06.524 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2024-09-16T04:04:06.525 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-pool-create/x 2024-09-16T04:04:06.525 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2024-09-16T04:04:07.448 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2024-09-16T04:04:07.448 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:04:07.448 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:04:07.448 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:04:07.448 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:04:07.448 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T04:04:07.448 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T04:04:07.449 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T04:04:07.450 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --debug_allow_any_pool_priority=true --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-pool-create/x '--log-file=td/osd-pool-create/$name.log' '--admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' --run-dir=td/osd-pool-create '--pid-file=td/osd-pool-create/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T04:04:07.481 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:229: check_pool_priority: run_osd td/osd-pool-create 0 2024-09-16T04:04:07.481 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-pool-create 2024-09-16T04:04:07.481 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T04:04:07.481 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2024-09-16T04:04:07.481 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T04:04:07.481 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-pool-create/0 2024-09-16T04:04:07.481 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=38a92d84-8703-45d8-b5ef-7d976430f112 --auth-supported=none --mon-host=127.0.0.1:7105 ' 2024-09-16T04:04:07.481 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T04:04:07.481 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T04:04:07.481 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T04:04:07.482 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-pool-create/0' 2024-09-16T04:04:07.482 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-pool-create/0/journal' 2024-09-16T04:04:07.482 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T04:04:07.482 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+=--debug_allow_any_pool_priority=true 2024-09-16T04:04:07.482 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-pool-create' 2024-09-16T04:04:07.482 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T04:04:07.482 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:04:07.482 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:04:07.482 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:04:07.482 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:04:07.482 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T04:04:07.482 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T04:04:07.482 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T04:04:07.483 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T04:04:07.483 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T04:04:07.483 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T04:04:07.483 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-pool-create/$name.log' 2024-09-16T04:04:07.483 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-pool-create/$name.pid' 2024-09-16T04:04:07.483 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T04:04:07.483 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T04:04:07.483 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T04:04:07.483 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T04:04:07.483 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T04:04:07.483 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T04:04:07.483 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-pool-create/0 2024-09-16T04:04:07.483 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T04:04:07.484 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=b09dafaa-d533-4b95-b506-602dcfc2b32f 2024-09-16T04:04:07.484 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 b09dafaa-d533-4b95-b506-602dcfc2b32f' 2024-09-16T04:04:07.484 INFO:tasks.workunit.client.0.smithi096.stdout:add osd0 b09dafaa-d533-4b95-b506-602dcfc2b32f 2024-09-16T04:04:07.485 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T04:04:07.499 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQA3rudmTBqyHRAAVep7EZu1s3QSu0pWEm/sjw== 2024-09-16T04:04:07.499 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQA3rudmTBqyHRAAVep7EZu1s3QSu0pWEm/sjw=="}' 2024-09-16T04:04:07.499 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new b09dafaa-d533-4b95-b506-602dcfc2b32f -i td/osd-pool-create/0/new.json 2024-09-16T04:04:07.820 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T04:04:07.836 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-pool-create/0/new.json 2024-09-16T04:04:07.837 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=38a92d84-8703-45d8-b5ef-7d976430f112 --auth-supported=none --mon-host=127.0.0.1:7105 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-pool-create/0 --osd-journal=td/osd-pool-create/0/journal --chdir=--debug_allow_any_pool_priority=true --run-dir=td/osd-pool-create '--admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-pool-create/$name.log' '--pid-file=td/osd-pool-create/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQA3rudmTBqyHRAAVep7EZu1s3QSu0pWEm/sjw== --osd-uuid b09dafaa-d533-4b95-b506-602dcfc2b32f 2024-09-16T04:04:07.869 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:04:07.863+0000 7f5c0c2da7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:04:07.897 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:04:07.891+0000 7f5c0c2da7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:04:07.898 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:04:07.895+0000 7f5c0c2da7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:04:07.898 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:04:07.895+0000 7f5c0c2da7c0 -1 global_init_chdir: failed to chdir to directory: '--debug_allow_any_pool_priority=true': (2) No such file or directory 2024-09-16T04:04:07.898 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:04:07.895+0000 7f5c0c2da7c0 -1 bdev(0x55cacbfd9c00 td/osd-pool-create/0/block) open stat got: (1) Operation not permitted 2024-09-16T04:04:07.899 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:04:07.895+0000 7f5c0c2da7c0 -1 bluestore(td/osd-pool-create/0) _read_fsid unparsable uuid 2024-09-16T04:04:14.384 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-pool-create/0/keyring 2024-09-16T04:04:14.384 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T04:04:14.385 INFO:tasks.workunit.client.0.smithi096.stdout:adding osd0 key to auth repository 2024-09-16T04:04:14.386 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2024-09-16T04:04:14.386 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-pool-create/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T04:04:14.945 INFO:tasks.workunit.client.0.smithi096.stdout:start osd.0 2024-09-16T04:04:14.946 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2024-09-16T04:04:14.946 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=38a92d84-8703-45d8-b5ef-7d976430f112 --auth-supported=none --mon-host=127.0.0.1:7105 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-pool-create/0 --osd-journal=td/osd-pool-create/0/journal --chdir=--debug_allow_any_pool_priority=true --run-dir=td/osd-pool-create '--admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-pool-create/$name.log' '--pid-file=td/osd-pool-create/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T04:04:14.946 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T04:04:14.946 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T04:04:14.946 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T04:04:14.974 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:04:14.970+0000 7ff7a091a7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:04:15.010 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:04:15.006+0000 7ff7a091a7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:04:15.011 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:04:15.006+0000 7ff7a091a7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:04:15.011 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:04:15.006+0000 7ff7a091a7c0 -1 global_init_chdir: failed to chdir to directory: '--debug_allow_any_pool_priority=true': (2) No such file or directory 2024-09-16T04:04:15.388 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2024-09-16T04:04:15.388 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T04:04:15.388 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2024-09-16T04:04:15.388 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T04:04:15.388 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T04:04:15.388 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:04:15.389 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T04:04:15.389 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T04:04:15.389 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:04:15.389 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:04:15.833 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:04:16.236 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:04:16.230+0000 7ff7a091a7c0 -1 Falling back to public interface 2024-09-16T04:04:16.238 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:04:16.234+0000 7ff7a091a7c0 -1 global_init_chdir: failed to chdir to directory: '--debug_allow_any_pool_priority=true': (2) No such file or directory 2024-09-16T04:04:16.836 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:04:16.836 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:04:16.837 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T04:04:16.837 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T04:04:16.837 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:04:16.837 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:04:17.254 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:04:18.255 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:04:18.256 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:04:18.256 INFO:tasks.workunit.client.0.smithi096.stdout:2 2024-09-16T04:04:18.257 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T04:04:18.257 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:04:18.257 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:04:18.699 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:04:19.184 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:04:19.178+0000 7ff7a091a7c0 -1 osd.0 0 log_to_monitors true 2024-09-16T04:04:19.700 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:04:19.700 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:04:19.701 INFO:tasks.workunit.client.0.smithi096.stdout:3 2024-09-16T04:04:19.701 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T04:04:19.701 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:04:19.701 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:04:20.264 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:04:21.266 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:04:21.266 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:04:21.266 INFO:tasks.workunit.client.0.smithi096.stdout:4 2024-09-16T04:04:21.267 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T04:04:21.267 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:04:21.267 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:04:21.698 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:04:22.699 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:04:22.699 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:04:22.699 INFO:tasks.workunit.client.0.smithi096.stdout:5 2024-09-16T04:04:22.700 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T04:04:22.700 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:04:22.700 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:04:23.267 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:04:24.269 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:04:24.269 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:04:24.269 INFO:tasks.workunit.client.0.smithi096.stdout:6 2024-09-16T04:04:24.270 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T04:04:24.270 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:04:24.270 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:04:24.758 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:04:25.759 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:04:25.760 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:04:25.760 INFO:tasks.workunit.client.0.smithi096.stdout:7 2024-09-16T04:04:25.760 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T04:04:25.761 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:04:25.761 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:04:26.329 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:04:27.331 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:04:27.331 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:04:27.331 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T04:04:27.332 INFO:tasks.workunit.client.0.smithi096.stdout:8 2024-09-16T04:04:27.332 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:04:27.332 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:04:27.777 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:04:28.778 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:04:28.778 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:04:28.779 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T04:04:28.779 INFO:tasks.workunit.client.0.smithi096.stdout:9 2024-09-16T04:04:28.779 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:04:28.779 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:04:29.396 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:04:30.396 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:04:30.396 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:04:30.397 INFO:tasks.workunit.client.0.smithi096.stdout:10 2024-09-16T04:04:30.397 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T04:04:30.397 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:04:30.397 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:04:30.822 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:04:31.824 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:04:31.824 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:04:31.824 INFO:tasks.workunit.client.0.smithi096.stdout:11 2024-09-16T04:04:31.825 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T04:04:31.825 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:04:31.825 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:04:32.485 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:04:33.487 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:04:33.487 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:04:33.488 INFO:tasks.workunit.client.0.smithi096.stdout:12 2024-09-16T04:04:33.488 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T04:04:33.488 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:04:33.488 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:04:34.310 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:04:35.312 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:04:35.312 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:04:35.312 INFO:tasks.workunit.client.0.smithi096.stdout:13 2024-09-16T04:04:35.313 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T04:04:35.313 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:04:35.313 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:04:36.218 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:04:37.220 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:04:37.220 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:04:37.220 INFO:tasks.workunit.client.0.smithi096.stdout:14 2024-09-16T04:04:37.221 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T04:04:37.221 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:04:37.221 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:04:37.971 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:04:38.972 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:04:38.973 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:04:38.973 INFO:tasks.workunit.client.0.smithi096.stdout:15 2024-09-16T04:04:38.973 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T04:04:38.973 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:04:38.974 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:04:40.168 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:04:41.170 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:04:41.170 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:04:41.171 INFO:tasks.workunit.client.0.smithi096.stdout:16 2024-09-16T04:04:41.171 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T04:04:41.171 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:04:41.172 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:04:42.030 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:04:43.032 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:04:43.032 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:04:43.032 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T04:04:43.033 INFO:tasks.workunit.client.0.smithi096.stdout:17 2024-09-16T04:04:43.033 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:04:43.033 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:04:43.742 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:04:44.744 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:04:44.744 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:04:44.744 INFO:tasks.workunit.client.0.smithi096.stdout:18 2024-09-16T04:04:44.745 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 18 2024-09-16T04:04:44.745 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:04:44.745 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:04:45.159 INFO:tasks.workunit.client.0.smithi096.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/1181154569,v1:127.0.0.1:6803/1181154569] [v2:127.0.0.1:6804/1181154569,v1:127.0.0.1:6805/1181154569] exists,up b09dafaa-d533-4b95-b506-602dcfc2b32f 2024-09-16T04:04:45.162 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T04:04:45.162 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T04:04:45.162 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T04:04:45.162 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:230: check_pool_priority: run_osd td/osd-pool-create 1 2024-09-16T04:04:45.162 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-pool-create 2024-09-16T04:04:45.162 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T04:04:45.162 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2024-09-16T04:04:45.162 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T04:04:45.163 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-pool-create/1 2024-09-16T04:04:45.163 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=38a92d84-8703-45d8-b5ef-7d976430f112 --auth-supported=none --mon-host=127.0.0.1:7105 ' 2024-09-16T04:04:45.163 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T04:04:45.163 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T04:04:45.163 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T04:04:45.163 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-pool-create/1' 2024-09-16T04:04:45.163 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-pool-create/1/journal' 2024-09-16T04:04:45.163 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T04:04:45.163 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+=--debug_allow_any_pool_priority=true 2024-09-16T04:04:45.163 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-pool-create' 2024-09-16T04:04:45.163 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T04:04:45.163 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:04:45.163 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:04:45.163 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:04:45.164 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:04:45.164 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T04:04:45.164 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T04:04:45.165 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T04:04:45.165 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T04:04:45.165 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T04:04:45.165 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T04:04:45.166 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-pool-create/$name.log' 2024-09-16T04:04:45.166 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-pool-create/$name.pid' 2024-09-16T04:04:45.166 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T04:04:45.166 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T04:04:45.166 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T04:04:45.166 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T04:04:45.166 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T04:04:45.166 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T04:04:45.166 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-pool-create/1 2024-09-16T04:04:45.166 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T04:04:45.166 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=bb0dfb74-2f7c-4129-a212-5944638afd2f 2024-09-16T04:04:45.166 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 bb0dfb74-2f7c-4129-a212-5944638afd2f' 2024-09-16T04:04:45.167 INFO:tasks.workunit.client.0.smithi096.stdout:add osd1 bb0dfb74-2f7c-4129-a212-5944638afd2f 2024-09-16T04:04:45.167 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T04:04:45.185 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBdrudmpo8GCxAAm5FCly/wuovo8vBy3RHM+Q== 2024-09-16T04:04:45.185 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBdrudmpo8GCxAAm5FCly/wuovo8vBy3RHM+Q=="}' 2024-09-16T04:04:45.185 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new bb0dfb74-2f7c-4129-a212-5944638afd2f -i td/osd-pool-create/1/new.json 2024-09-16T04:04:45.731 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T04:04:45.748 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-pool-create/1/new.json 2024-09-16T04:04:45.750 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=38a92d84-8703-45d8-b5ef-7d976430f112 --auth-supported=none --mon-host=127.0.0.1:7105 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-pool-create/1 --osd-journal=td/osd-pool-create/1/journal --chdir=--debug_allow_any_pool_priority=true --run-dir=td/osd-pool-create '--admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-pool-create/$name.log' '--pid-file=td/osd-pool-create/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBdrudmpo8GCxAAm5FCly/wuovo8vBy3RHM+Q== --osd-uuid bb0dfb74-2f7c-4129-a212-5944638afd2f 2024-09-16T04:04:45.776 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:04:45.774+0000 7f0296b847c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:04:45.808 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:04:45.806+0000 7f0296b847c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:04:45.809 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:04:45.806+0000 7f0296b847c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:04:45.809 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:04:45.810+0000 7f0296b847c0 -1 global_init_chdir: failed to chdir to directory: '--debug_allow_any_pool_priority=true': (2) No such file or directory 2024-09-16T04:04:45.810 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:04:45.810+0000 7f0296b847c0 -1 bdev(0x55ee2c5c9c00 td/osd-pool-create/1/block) open stat got: (1) Operation not permitted 2024-09-16T04:04:45.810 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:04:45.810+0000 7f0296b847c0 -1 bluestore(td/osd-pool-create/1) _read_fsid unparsable uuid 2024-09-16T04:04:52.495 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-pool-create/1/keyring 2024-09-16T04:04:52.496 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T04:04:52.497 INFO:tasks.workunit.client.0.smithi096.stdout:adding osd1 key to auth repository 2024-09-16T04:04:52.498 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2024-09-16T04:04:52.498 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-pool-create/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T04:04:53.069 INFO:tasks.workunit.client.0.smithi096.stdout:start osd.1 2024-09-16T04:04:53.070 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2024-09-16T04:04:53.070 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T04:04:53.070 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T04:04:53.070 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=38a92d84-8703-45d8-b5ef-7d976430f112 --auth-supported=none --mon-host=127.0.0.1:7105 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-pool-create/1 --osd-journal=td/osd-pool-create/1/journal --chdir=--debug_allow_any_pool_priority=true --run-dir=td/osd-pool-create '--admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-pool-create/$name.log' '--pid-file=td/osd-pool-create/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T04:04:53.070 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T04:04:53.098 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:04:53.098+0000 7f8814b237c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:04:53.118 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:04:53.118+0000 7f8814b237c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:04:53.120 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:04:53.118+0000 7f8814b237c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:04:53.120 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:04:53.118+0000 7f8814b237c0 -1 global_init_chdir: failed to chdir to directory: '--debug_allow_any_pool_priority=true': (2) No such file or directory 2024-09-16T04:04:53.480 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2024-09-16T04:04:53.480 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T04:04:53.480 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2024-09-16T04:04:53.480 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T04:04:53.481 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T04:04:53.481 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:04:53.481 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T04:04:53.482 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T04:04:53.482 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:04:53.482 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:04:53.918 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:04:54.612 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:04:54.610+0000 7f8814b237c0 -1 Falling back to public interface 2024-09-16T04:04:54.616 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:04:54.614+0000 7f8814b237c0 -1 global_init_chdir: failed to chdir to directory: '--debug_allow_any_pool_priority=true': (2) No such file or directory 2024-09-16T04:04:54.920 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:04:54.920 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:04:54.920 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T04:04:54.921 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T04:04:54.921 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:04:54.921 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:04:55.348 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:04:56.350 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:04:56.350 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:04:56.350 INFO:tasks.workunit.client.0.smithi096.stdout:2 2024-09-16T04:04:56.351 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T04:04:56.351 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:04:56.351 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:04:56.801 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:04:57.386 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:04:57.385+0000 7f8814b237c0 -1 osd.1 0 log_to_monitors true 2024-09-16T04:04:57.803 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:04:57.803 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:04:57.803 INFO:tasks.workunit.client.0.smithi096.stdout:3 2024-09-16T04:04:57.804 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T04:04:57.804 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:04:57.804 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:04:58.338 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:04:59.340 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:04:59.360 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:04:59.360 INFO:tasks.workunit.client.0.smithi096.stdout:4 2024-09-16T04:04:59.360 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T04:04:59.361 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:04:59.361 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:04:59.773 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:05:00.775 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:05:00.775 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:05:00.775 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T04:05:00.775 INFO:tasks.workunit.client.0.smithi096.stdout:5 2024-09-16T04:05:00.776 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:05:00.776 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:05:01.328 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:05:02.330 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:05:02.330 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:05:02.330 INFO:tasks.workunit.client.0.smithi096.stdout:6 2024-09-16T04:05:02.331 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T04:05:02.331 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:05:02.331 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:05:02.862 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:05:03.864 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:05:03.864 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:05:03.864 INFO:tasks.workunit.client.0.smithi096.stdout:7 2024-09-16T04:05:03.865 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T04:05:03.865 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:05:03.865 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:05:04.560 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:05:05.561 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:05:05.562 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:05:05.562 INFO:tasks.workunit.client.0.smithi096.stdout:8 2024-09-16T04:05:05.562 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T04:05:05.563 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:05:05.563 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:05:06.022 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:05:07.024 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:05:07.024 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:05:07.024 INFO:tasks.workunit.client.0.smithi096.stdout:9 2024-09-16T04:05:07.025 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T04:05:07.025 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:05:07.025 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:05:07.537 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:05:08.539 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:05:08.539 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:05:08.539 INFO:tasks.workunit.client.0.smithi096.stdout:10 2024-09-16T04:05:08.540 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T04:05:08.540 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:05:08.540 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:05:08.984 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:05:09.985 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:05:09.986 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:05:09.986 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T04:05:09.986 INFO:tasks.workunit.client.0.smithi096.stdout:11 2024-09-16T04:05:09.986 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:05:09.987 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:05:10.551 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:05:11.553 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:05:11.553 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:05:11.553 INFO:tasks.workunit.client.0.smithi096.stdout:12 2024-09-16T04:05:11.554 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T04:05:11.554 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:05:11.554 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:05:12.099 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:05:13.101 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:05:13.101 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:05:13.101 INFO:tasks.workunit.client.0.smithi096.stdout:13 2024-09-16T04:05:13.102 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T04:05:13.102 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:05:13.102 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:05:13.921 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:05:14.923 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:05:14.923 INFO:tasks.workunit.client.0.smithi096.stdout:14 2024-09-16T04:05:14.924 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:05:14.924 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T04:05:14.924 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:05:14.924 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:05:16.109 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:05:17.111 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:05:17.111 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:05:17.111 INFO:tasks.workunit.client.0.smithi096.stdout:15 2024-09-16T04:05:17.112 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T04:05:17.112 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:05:17.112 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:05:17.958 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:05:18.960 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:05:18.960 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:05:18.960 INFO:tasks.workunit.client.0.smithi096.stdout:16 2024-09-16T04:05:18.961 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T04:05:18.961 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:05:18.961 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:05:19.644 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:05:20.646 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:05:20.646 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:05:20.646 INFO:tasks.workunit.client.0.smithi096.stdout:17 2024-09-16T04:05:20.647 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T04:05:20.647 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:05:20.647 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:05:21.946 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:05:22.947 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:05:22.948 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:05:22.948 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 18 2024-09-16T04:05:22.948 INFO:tasks.workunit.client.0.smithi096.stdout:18 2024-09-16T04:05:22.948 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:05:22.948 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:05:23.495 INFO:tasks.workunit.client.0.smithi096.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/1986661654,v1:127.0.0.1:6811/1986661654] [v2:127.0.0.1:6812/1986661654,v1:127.0.0.1:6813/1986661654] exists,up bb0dfb74-2f7c-4129-a212-5944638afd2f 2024-09-16T04:05:23.498 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T04:05:23.498 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T04:05:23.498 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T04:05:23.498 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:231: check_pool_priority: run_osd td/osd-pool-create 2 2024-09-16T04:05:23.498 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-pool-create 2024-09-16T04:05:23.498 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T04:05:23.498 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2024-09-16T04:05:23.498 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T04:05:23.499 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-pool-create/2 2024-09-16T04:05:23.499 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=38a92d84-8703-45d8-b5ef-7d976430f112 --auth-supported=none --mon-host=127.0.0.1:7105 ' 2024-09-16T04:05:23.499 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T04:05:23.499 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T04:05:23.499 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T04:05:23.499 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-pool-create/2' 2024-09-16T04:05:23.499 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-pool-create/2/journal' 2024-09-16T04:05:23.499 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T04:05:23.499 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+=--debug_allow_any_pool_priority=true 2024-09-16T04:05:23.499 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-pool-create' 2024-09-16T04:05:23.499 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T04:05:23.499 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:05:23.499 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:05:23.500 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:05:23.500 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:05:23.500 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T04:05:23.500 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T04:05:23.500 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T04:05:23.500 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T04:05:23.500 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T04:05:23.500 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T04:05:23.500 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-pool-create/$name.log' 2024-09-16T04:05:23.500 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-pool-create/$name.pid' 2024-09-16T04:05:23.500 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T04:05:23.500 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T04:05:23.500 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T04:05:23.501 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T04:05:23.501 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T04:05:23.501 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T04:05:23.501 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-pool-create/2 2024-09-16T04:05:23.502 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T04:05:23.502 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=81619181-aacf-4d1c-b19a-abf21ff61ab6 2024-09-16T04:05:23.502 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 81619181-aacf-4d1c-b19a-abf21ff61ab6' 2024-09-16T04:05:23.503 INFO:tasks.workunit.client.0.smithi096.stdout:add osd2 81619181-aacf-4d1c-b19a-abf21ff61ab6 2024-09-16T04:05:23.503 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T04:05:23.522 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCDrudmfZURHxAAwW9nvzMkzyAXK0U5DM1+xA== 2024-09-16T04:05:23.522 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCDrudmfZURHxAAwW9nvzMkzyAXK0U5DM1+xA=="}' 2024-09-16T04:05:23.522 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 81619181-aacf-4d1c-b19a-abf21ff61ab6 -i td/osd-pool-create/2/new.json 2024-09-16T04:05:24.035 INFO:tasks.workunit.client.0.smithi096.stdout:2 2024-09-16T04:05:24.050 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-pool-create/2/new.json 2024-09-16T04:05:24.052 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=38a92d84-8703-45d8-b5ef-7d976430f112 --auth-supported=none --mon-host=127.0.0.1:7105 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-pool-create/2 --osd-journal=td/osd-pool-create/2/journal --chdir=--debug_allow_any_pool_priority=true --run-dir=td/osd-pool-create '--admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-pool-create/$name.log' '--pid-file=td/osd-pool-create/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCDrudmfZURHxAAwW9nvzMkzyAXK0U5DM1+xA== --osd-uuid 81619181-aacf-4d1c-b19a-abf21ff61ab6 2024-09-16T04:05:24.083 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:05:24.081+0000 7f4ed15a87c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:05:24.085 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:05:24.085+0000 7f4ed15a87c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:05:24.087 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:05:24.085+0000 7f4ed15a87c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:05:24.087 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:05:24.085+0000 7f4ed15a87c0 -1 global_init_chdir: failed to chdir to directory: '--debug_allow_any_pool_priority=true': (2) No such file or directory 2024-09-16T04:05:24.087 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:05:24.085+0000 7f4ed15a87c0 -1 bdev(0x55f26054bc00 td/osd-pool-create/2/block) open stat got: (1) Operation not permitted 2024-09-16T04:05:24.088 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:05:24.085+0000 7f4ed15a87c0 -1 bluestore(td/osd-pool-create/2) _read_fsid unparsable uuid 2024-09-16T04:05:30.847 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-pool-create/2/keyring 2024-09-16T04:05:30.848 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T04:05:30.849 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2024-09-16T04:05:30.850 INFO:tasks.workunit.client.0.smithi096.stdout:adding osd2 key to auth repository 2024-09-16T04:05:30.850 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-pool-create/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T04:05:31.416 INFO:tasks.workunit.client.0.smithi096.stdout:start osd.2 2024-09-16T04:05:31.417 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2024-09-16T04:05:31.417 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=38a92d84-8703-45d8-b5ef-7d976430f112 --auth-supported=none --mon-host=127.0.0.1:7105 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-pool-create/2 --osd-journal=td/osd-pool-create/2/journal --chdir=--debug_allow_any_pool_priority=true --run-dir=td/osd-pool-create '--admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-pool-create/$name.log' '--pid-file=td/osd-pool-create/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T04:05:31.417 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T04:05:31.418 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T04:05:31.418 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T04:05:31.446 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:05:31.445+0000 7f6621faf7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:05:31.447 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:05:31.445+0000 7f6621faf7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:05:31.449 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:05:31.445+0000 7f6621faf7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:05:31.449 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:05:31.445+0000 7f6621faf7c0 -1 global_init_chdir: failed to chdir to directory: '--debug_allow_any_pool_priority=true': (2) No such file or directory 2024-09-16T04:05:31.854 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2024-09-16T04:05:31.854 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T04:05:31.854 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2024-09-16T04:05:31.854 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T04:05:31.855 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T04:05:31.855 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T04:05:31.855 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:05:31.855 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T04:05:31.855 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:05:31.855 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:05:32.311 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:05:33.016 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:05:33.013+0000 7f6621faf7c0 -1 Falling back to public interface 2024-09-16T04:05:33.021 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:05:33.021+0000 7f6621faf7c0 -1 global_init_chdir: failed to chdir to directory: '--debug_allow_any_pool_priority=true': (2) No such file or directory 2024-09-16T04:05:33.313 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:05:33.313 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:05:33.313 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T04:05:33.313 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T04:05:33.314 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:05:33.314 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:05:33.734 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:05:34.736 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:05:34.737 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:05:34.737 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T04:05:34.737 INFO:tasks.workunit.client.0.smithi096.stdout:2 2024-09-16T04:05:34.737 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:05:34.738 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:05:35.163 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:05:35.867 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:05:35.864+0000 7f6621faf7c0 -1 osd.2 0 log_to_monitors true 2024-09-16T04:05:36.165 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:05:36.165 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:05:36.165 INFO:tasks.workunit.client.0.smithi096.stdout:3 2024-09-16T04:05:36.166 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T04:05:36.166 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:05:36.166 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:05:36.841 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:05:37.843 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:05:37.843 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:05:37.843 INFO:tasks.workunit.client.0.smithi096.stdout:4 2024-09-16T04:05:37.844 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T04:05:37.844 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:05:37.844 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:05:38.316 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:05:39.317 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:05:39.317 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:05:39.318 INFO:tasks.workunit.client.0.smithi096.stdout:5 2024-09-16T04:05:39.318 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T04:05:39.318 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:05:39.318 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:05:39.822 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:05:40.824 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:05:40.824 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:05:40.825 INFO:tasks.workunit.client.0.smithi096.stdout:6 2024-09-16T04:05:40.825 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T04:05:40.825 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:05:40.825 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:05:41.282 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:05:42.281 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:05:42.282 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:05:42.282 INFO:tasks.workunit.client.0.smithi096.stdout:7 2024-09-16T04:05:42.282 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T04:05:42.283 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:05:42.283 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:05:42.898 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:05:43.900 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:05:43.901 INFO:tasks.workunit.client.0.smithi096.stdout:8 2024-09-16T04:05:43.901 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:05:43.901 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T04:05:43.901 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:05:43.901 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:05:44.415 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:05:45.416 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:05:45.416 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:05:45.417 INFO:tasks.workunit.client.0.smithi096.stdout:9 2024-09-16T04:05:45.417 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T04:05:45.417 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:05:45.417 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:05:45.904 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:05:46.905 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:05:46.906 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:05:46.906 INFO:tasks.workunit.client.0.smithi096.stdout:10 2024-09-16T04:05:46.906 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T04:05:46.907 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:05:46.907 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:05:47.319 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:05:48.321 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:05:48.321 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:05:48.322 INFO:tasks.workunit.client.0.smithi096.stdout:11 2024-09-16T04:05:48.322 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T04:05:48.322 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:05:48.322 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:05:48.835 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:05:49.837 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:05:49.837 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:05:49.837 INFO:tasks.workunit.client.0.smithi096.stdout:12 2024-09-16T04:05:49.838 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T04:05:49.838 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:05:49.838 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:05:50.608 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:05:51.610 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:05:51.610 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:05:51.610 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T04:05:51.610 INFO:tasks.workunit.client.0.smithi096.stdout:13 2024-09-16T04:05:51.611 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:05:51.611 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:05:52.421 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:05:53.423 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:05:53.423 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:05:53.423 INFO:tasks.workunit.client.0.smithi096.stdout:14 2024-09-16T04:05:53.424 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T04:05:53.424 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:05:53.424 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:05:54.209 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:05:55.211 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:05:55.211 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:05:55.211 INFO:tasks.workunit.client.0.smithi096.stdout:15 2024-09-16T04:05:55.212 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T04:05:55.212 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:05:55.212 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:05:56.008 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:05:57.010 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:05:57.010 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:05:57.010 INFO:tasks.workunit.client.0.smithi096.stdout:16 2024-09-16T04:05:57.011 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T04:05:57.011 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:05:57.011 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:05:58.066 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:05:59.068 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:05:59.068 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:05:59.068 INFO:tasks.workunit.client.0.smithi096.stdout:17 2024-09-16T04:05:59.069 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T04:05:59.069 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:05:59.069 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:05:59.851 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:06:00.852 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:06:00.853 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:06:00.853 INFO:tasks.workunit.client.0.smithi096.stdout:18 2024-09-16T04:06:00.853 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 18 2024-09-16T04:06:00.853 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:06:00.854 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:06:01.314 INFO:tasks.workunit.client.0.smithi096.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/651103641,v1:127.0.0.1:6819/651103641] [v2:127.0.0.1:6820/651103641,v1:127.0.0.1:6821/651103641] exists,up 81619181-aacf-4d1c-b19a-abf21ff61ab6 2024-09-16T04:06:01.314 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T04:06:01.314 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T04:06:01.314 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T04:06:01.315 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: seq 0 20 2024-09-16T04:06:01.315 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:06:01.315 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 0 + 1 2024-09-16T04:06:01.316 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=1 2024-09-16T04:06:01.316 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test1 1 1 2024-09-16T04:06:01.849 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test1' already exists 2024-09-16T04:06:01.867 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:06:01.867 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 1 + 1 2024-09-16T04:06:01.869 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=2 2024-09-16T04:06:01.869 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test2 1 1 2024-09-16T04:06:02.695 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test2' already exists 2024-09-16T04:06:02.713 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:06:02.713 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 2 + 1 2024-09-16T04:06:02.715 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=3 2024-09-16T04:06:02.715 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test3 1 1 2024-09-16T04:06:03.928 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test3' already exists 2024-09-16T04:06:03.949 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:06:03.950 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 3 + 1 2024-09-16T04:06:03.951 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=4 2024-09-16T04:06:03.951 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test4 1 1 2024-09-16T04:06:04.969 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test4' already exists 2024-09-16T04:06:04.988 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:06:04.988 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 4 + 1 2024-09-16T04:06:04.990 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=5 2024-09-16T04:06:04.990 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test5 1 1 2024-09-16T04:06:06.025 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test5' already exists 2024-09-16T04:06:06.043 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:06:06.044 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 5 + 1 2024-09-16T04:06:06.045 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=6 2024-09-16T04:06:06.045 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test6 1 1 2024-09-16T04:06:06.997 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test6' already exists 2024-09-16T04:06:07.014 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:06:07.014 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 6 + 1 2024-09-16T04:06:07.016 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=7 2024-09-16T04:06:07.016 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test7 1 1 2024-09-16T04:06:07.592 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test7' already exists 2024-09-16T04:06:07.607 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:06:07.608 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 7 + 1 2024-09-16T04:06:07.610 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=8 2024-09-16T04:06:07.610 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test8 1 1 2024-09-16T04:06:08.696 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test8' already exists 2024-09-16T04:06:08.718 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:06:08.719 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 8 + 1 2024-09-16T04:06:08.720 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=9 2024-09-16T04:06:08.720 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test9 1 1 2024-09-16T04:06:10.089 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test9' already exists 2024-09-16T04:06:10.107 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:06:10.107 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 9 + 1 2024-09-16T04:06:10.108 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=10 2024-09-16T04:06:10.108 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test10 1 1 2024-09-16T04:06:11.224 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test10' already exists 2024-09-16T04:06:11.242 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:06:11.242 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 10 + 1 2024-09-16T04:06:11.243 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=11 2024-09-16T04:06:11.243 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test11 1 1 2024-09-16T04:06:12.239 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test11' already exists 2024-09-16T04:06:12.256 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:06:12.256 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 11 + 1 2024-09-16T04:06:12.257 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=12 2024-09-16T04:06:12.257 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test12 1 1 2024-09-16T04:06:13.298 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test12' already exists 2024-09-16T04:06:13.316 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:06:13.317 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 12 + 1 2024-09-16T04:06:13.318 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=13 2024-09-16T04:06:13.318 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test13 1 1 2024-09-16T04:06:14.314 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test13' already exists 2024-09-16T04:06:14.330 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:06:14.331 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 13 + 1 2024-09-16T04:06:14.332 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=14 2024-09-16T04:06:14.332 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test14 1 1 2024-09-16T04:06:14.894 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test14' already exists 2024-09-16T04:06:14.910 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:06:14.911 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 14 + 1 2024-09-16T04:06:14.913 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=15 2024-09-16T04:06:14.913 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test15 1 1 2024-09-16T04:06:16.435 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test15' already exists 2024-09-16T04:06:16.459 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:06:16.460 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 15 + 1 2024-09-16T04:06:16.461 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=16 2024-09-16T04:06:16.461 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test16 1 1 2024-09-16T04:06:17.168 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test16' already exists 2024-09-16T04:06:17.184 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:06:17.185 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 16 + 1 2024-09-16T04:06:17.185 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=17 2024-09-16T04:06:17.185 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test17 1 1 2024-09-16T04:06:18.009 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test17' already exists 2024-09-16T04:06:18.026 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:06:18.027 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 17 + 1 2024-09-16T04:06:18.029 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=18 2024-09-16T04:06:18.029 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test18 1 1 2024-09-16T04:06:18.937 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test18' already exists 2024-09-16T04:06:18.955 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:06:18.955 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 18 + 1 2024-09-16T04:06:18.957 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=19 2024-09-16T04:06:18.957 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test19 1 1 2024-09-16T04:06:20.229 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test19' already exists 2024-09-16T04:06:20.245 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:06:20.246 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 19 + 1 2024-09-16T04:06:20.247 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=20 2024-09-16T04:06:20.247 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test20 1 1 2024-09-16T04:06:21.274 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test20' already exists 2024-09-16T04:06:21.291 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:234: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:06:21.291 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: expr 20 + 1 2024-09-16T04:06:21.293 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:236: check_pool_priority: num=21 2024-09-16T04:06:21.293 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:237: check_pool_priority: ceph osd pool create test21 1 1 2024-09-16T04:06:22.389 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'test21' already exists 2024-09-16T04:06:22.406 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:240: check_pool_priority: wait_for_clean 2024-09-16T04:06:22.406 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1633: wait_for_clean: local cmd= 2024-09-16T04:06:22.406 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1634: wait_for_clean: local num_active_clean=-1 2024-09-16T04:06:22.407 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1635: wait_for_clean: local cur_active_clean 2024-09-16T04:06:22.407 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: get_timeout_delays 90 .1 2024-09-16T04:06:22.407 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: shopt -q -o xtrace 2024-09-16T04:06:22.407 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: echo true 2024-09-16T04:06:22.408 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: local trace=true 2024-09-16T04:06:22.408 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: true 2024-09-16T04:06:22.408 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: shopt -u -o xtrace 2024-09-16T04:06:22.500 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-09-16T04:06:22.500 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: local -a delays 2024-09-16T04:06:22.500 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1637: wait_for_clean: local -i loop=0 2024-09-16T04:06:22.500 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1639: wait_for_clean: flush_pg_stats 2024-09-16T04:06:22.501 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: local timeout=300 2024-09-16T04:06:22.501 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ceph osd ls 2024-09-16T04:06:23.154 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ids='0 2024-09-16T04:06:23.155 INFO:tasks.workunit.client.0.smithi096.stderr:1 2024-09-16T04:06:23.155 INFO:tasks.workunit.client.0.smithi096.stderr:2' 2024-09-16T04:06:23.155 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2208: flush_pg_stats: seqs= 2024-09-16T04:06:23.155 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:06:23.155 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-09-16T04:06:23.330 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=21474836510 2024-09-16T04:06:23.330 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 21474836510 2024-09-16T04:06:23.330 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836510' 2024-09-16T04:06:23.330 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:06:23.330 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-09-16T04:06:23.516 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=42949672977 2024-09-16T04:06:23.517 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 42949672977 2024-09-16T04:06:23.517 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836510 1-42949672977' 2024-09-16T04:06:23.517 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:06:23.517 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-09-16T04:06:23.689 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=64424509449 2024-09-16T04:06:23.689 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 64424509449 2024-09-16T04:06:23.689 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836510 1-42949672977 2-64424509449' 2024-09-16T04:06:23.689 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:06:23.690 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 0-21474836510 2024-09-16T04:06:23.690 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:06:23.691 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=0 2024-09-16T04:06:23.691 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 0-21474836510 2024-09-16T04:06:23.692 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:06:23.693 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=21474836510 2024-09-16T04:06:23.693 INFO:tasks.workunit.client.0.smithi096.stdout:waiting osd.0 seq 21474836510 2024-09-16T04:06:23.693 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.0 seq 21474836510' 2024-09-16T04:06:23.693 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T04:06:24.211 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836508 -lt 21474836510 2024-09-16T04:06:24.211 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: flush_pg_stats: sleep 1 2024-09-16T04:06:25.213 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2224: flush_pg_stats: '[' 300 -eq 0 ']' 2024-09-16T04:06:25.214 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T04:06:25.664 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836510 -lt 21474836510 2024-09-16T04:06:25.664 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:06:25.664 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 1-42949672977 2024-09-16T04:06:25.665 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:06:25.666 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=1 2024-09-16T04:06:25.667 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 1-42949672977 2024-09-16T04:06:25.667 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:06:25.668 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=42949672977 2024-09-16T04:06:25.668 INFO:tasks.workunit.client.0.smithi096.stdout:waiting osd.1 seq 42949672977 2024-09-16T04:06:25.669 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.1 seq 42949672977' 2024-09-16T04:06:25.669 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 1 2024-09-16T04:06:26.162 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 42949672978 -lt 42949672977 2024-09-16T04:06:26.162 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:06:26.162 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 2-64424509449 2024-09-16T04:06:26.163 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:06:26.164 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=2 2024-09-16T04:06:26.164 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 2-64424509449 2024-09-16T04:06:26.165 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:06:26.166 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=64424509449 2024-09-16T04:06:26.166 INFO:tasks.workunit.client.0.smithi096.stdout:waiting osd.2 seq 64424509449 2024-09-16T04:06:26.166 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.2 seq 64424509449' 2024-09-16T04:06:26.167 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 2 2024-09-16T04:06:26.648 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 64424509449 -lt 64424509449 2024-09-16T04:06:26.649 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: get_num_pgs 2024-09-16T04:06:26.649 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T04:06:26.650 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T04:06:27.210 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: test 21 == 0 2024-09-16T04:06:27.210 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T04:06:27.211 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T04:06:27.211 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T04:06:27.211 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T04:06:27.211 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T04:06:27.211 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T04:06:27.211 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T04:06:27.620 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=20 2024-09-16T04:06:27.620 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T04:06:27.621 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T04:06:27.621 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T04:06:28.157 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 20 = 21 2024-09-16T04:06:28.157 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 20 '!=' -1 2024-09-16T04:06:28.157 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: loop=0 2024-09-16T04:06:28.157 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1652: wait_for_clean: num_active_clean=20 2024-09-16T04:06:28.157 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T04:06:28.157 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T04:06:28.258 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T04:06:28.258 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T04:06:28.259 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T04:06:28.259 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T04:06:28.259 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T04:06:28.259 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T04:06:28.260 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T04:06:28.260 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T04:06:28.670 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=21 2024-09-16T04:06:28.671 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T04:06:28.671 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T04:06:28.672 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T04:06:29.222 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 21 = 21 2024-09-16T04:06:29.222 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: break 2024-09-16T04:06:29.222 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: return 0 2024-09-16T04:06:29.222 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: seq 0 20 2024-09-16T04:06:29.223 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:06:29.223 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 0 + 1 2024-09-16T04:06:29.223 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=1 2024-09-16T04:06:29.224 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 0 '*' 5 2024-09-16T04:06:29.225 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test1 recovery_priority 0 2024-09-16T04:06:30.133 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 1 recovery_priority to 0 2024-09-16T04:06:30.155 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:06:30.156 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 1 + 1 2024-09-16T04:06:30.157 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=2 2024-09-16T04:06:30.158 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 1 '*' 5 2024-09-16T04:06:30.159 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test2 recovery_priority 5 2024-09-16T04:06:30.942 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 2 recovery_priority to 5 2024-09-16T04:06:30.963 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:06:30.963 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 2 + 1 2024-09-16T04:06:30.964 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=3 2024-09-16T04:06:30.966 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 2 '*' 5 2024-09-16T04:06:30.966 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test3 recovery_priority 10 2024-09-16T04:06:31.880 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 3 recovery_priority to 10 2024-09-16T04:06:31.900 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:06:31.901 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 3 + 1 2024-09-16T04:06:31.902 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=4 2024-09-16T04:06:31.904 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 3 '*' 5 2024-09-16T04:06:31.904 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test4 recovery_priority 15 2024-09-16T04:06:32.742 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 4 recovery_priority to 15 2024-09-16T04:06:32.765 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:06:32.765 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 4 + 1 2024-09-16T04:06:32.766 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=5 2024-09-16T04:06:32.767 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 4 '*' 5 2024-09-16T04:06:32.769 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test5 recovery_priority 20 2024-09-16T04:06:33.588 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 5 recovery_priority to 20 2024-09-16T04:06:33.606 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:06:33.606 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 5 + 1 2024-09-16T04:06:33.608 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=6 2024-09-16T04:06:33.608 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 5 '*' 5 2024-09-16T04:06:33.610 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test6 recovery_priority 25 2024-09-16T04:06:34.476 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 6 recovery_priority to 25 2024-09-16T04:06:34.498 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:06:34.498 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 6 + 1 2024-09-16T04:06:34.499 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=7 2024-09-16T04:06:34.500 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 6 '*' 5 2024-09-16T04:06:34.501 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test7 recovery_priority 30 2024-09-16T04:06:35.339 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 7 recovery_priority to 30 2024-09-16T04:06:35.361 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:06:35.361 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 7 + 1 2024-09-16T04:06:35.362 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=8 2024-09-16T04:06:35.363 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 7 '*' 5 2024-09-16T04:06:35.364 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test8 recovery_priority 35 2024-09-16T04:06:36.369 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 8 recovery_priority to 35 2024-09-16T04:06:36.392 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:06:36.392 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 8 + 1 2024-09-16T04:06:36.394 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=9 2024-09-16T04:06:36.394 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 8 '*' 5 2024-09-16T04:06:36.395 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test9 recovery_priority 40 2024-09-16T04:06:37.190 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 9 recovery_priority to 40 2024-09-16T04:06:37.210 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:06:37.210 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 9 + 1 2024-09-16T04:06:37.211 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=10 2024-09-16T04:06:37.212 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 9 '*' 5 2024-09-16T04:06:37.213 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test10 recovery_priority 45 2024-09-16T04:06:38.203 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 10 recovery_priority to 45 2024-09-16T04:06:38.228 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:06:38.229 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 10 + 1 2024-09-16T04:06:38.230 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=11 2024-09-16T04:06:38.231 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 10 '*' 5 2024-09-16T04:06:38.233 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test11 recovery_priority 50 2024-09-16T04:06:39.116 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 11 recovery_priority to 50 2024-09-16T04:06:39.137 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:06:39.138 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 11 + 1 2024-09-16T04:06:39.139 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=12 2024-09-16T04:06:39.139 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 11 '*' 5 2024-09-16T04:06:39.140 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test12 recovery_priority 55 2024-09-16T04:06:40.204 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 12 recovery_priority to 55 2024-09-16T04:06:40.227 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:06:40.227 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 12 + 1 2024-09-16T04:06:40.228 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=13 2024-09-16T04:06:40.229 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 12 '*' 5 2024-09-16T04:06:40.230 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test13 recovery_priority 60 2024-09-16T04:06:40.900 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 13 recovery_priority to 60 2024-09-16T04:06:40.920 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:06:40.921 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 13 + 1 2024-09-16T04:06:40.922 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=14 2024-09-16T04:06:40.923 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 13 '*' 5 2024-09-16T04:06:40.923 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test14 recovery_priority 65 2024-09-16T04:06:42.179 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 14 recovery_priority to 65 2024-09-16T04:06:42.202 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:06:42.203 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 14 + 1 2024-09-16T04:06:42.205 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=15 2024-09-16T04:06:42.206 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 14 '*' 5 2024-09-16T04:06:42.207 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test15 recovery_priority 70 2024-09-16T04:06:43.000 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 15 recovery_priority to 70 2024-09-16T04:06:43.023 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:06:43.024 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 15 + 1 2024-09-16T04:06:43.025 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=16 2024-09-16T04:06:43.026 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 15 '*' 5 2024-09-16T04:06:43.027 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test16 recovery_priority 75 2024-09-16T04:06:43.787 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 16 recovery_priority to 75 2024-09-16T04:06:43.812 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:06:43.812 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 16 + 1 2024-09-16T04:06:43.813 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=17 2024-09-16T04:06:43.813 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 16 '*' 5 2024-09-16T04:06:43.814 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test17 recovery_priority 80 2024-09-16T04:06:44.549 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 17 recovery_priority to 80 2024-09-16T04:06:44.569 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:06:44.570 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 17 + 1 2024-09-16T04:06:44.571 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=18 2024-09-16T04:06:44.571 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 17 '*' 5 2024-09-16T04:06:44.572 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test18 recovery_priority 85 2024-09-16T04:06:45.487 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 18 recovery_priority to 85 2024-09-16T04:06:45.511 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:06:45.511 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 18 + 1 2024-09-16T04:06:45.513 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=19 2024-09-16T04:06:45.513 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 18 '*' 5 2024-09-16T04:06:45.514 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test19 recovery_priority 90 2024-09-16T04:06:46.451 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 19 recovery_priority to 90 2024-09-16T04:06:46.472 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:06:46.473 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 19 + 1 2024-09-16T04:06:46.473 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=20 2024-09-16T04:06:46.474 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 19 '*' 5 2024-09-16T04:06:46.475 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test20 recovery_priority 95 2024-09-16T04:06:47.355 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 20 recovery_priority to 95 2024-09-16T04:06:47.377 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:241: check_pool_priority: for i in $(seq 0 $pools) 2024-09-16T04:06:47.378 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: expr 20 + 1 2024-09-16T04:06:47.379 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:243: check_pool_priority: num=21 2024-09-16T04:06:47.379 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: expr 20 '*' 5 2024-09-16T04:06:47.380 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:244: check_pool_priority: ceph osd pool set test21 recovery_priority 100 2024-09-16T04:06:48.270 INFO:tasks.workunit.client.0.smithi096.stderr:set pool 21 recovery_priority to 100 2024-09-16T04:06:48.292 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:249: check_pool_priority: bin/ceph osd dump 2024-09-16T04:06:48.293 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh: line 249: bin/ceph: No such file or directory 2024-09-16T04:06:48.293 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:252: check_pool_priority: kill_daemons 2024-09-16T04:06:48.294 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T04:06:48.294 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T04:06:48.294 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T04:06:48.294 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T04:06:48.294 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T04:06:49.607 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T04:06:49.607 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:253: check_pool_priority: run_mon td/osd-pool-create a 2024-09-16T04:06:49.608 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-pool-create 2024-09-16T04:06:49.608 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T04:06:49.608 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T04:06:49.608 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T04:06:49.608 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-pool-create/a 2024-09-16T04:06:49.608 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-pool-create/a --run-dir=td/osd-pool-create 2024-09-16T04:06:49.634 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:06:49.627+0000 7f20d6371e00 -1 'td/osd-pool-create/a' already exists and is not empty: monitor may already exist 2024-09-16T04:06:49.636 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T04:06:49.636 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:06:49.636 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:06:49.637 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:06:49.637 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:06:49.637 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T04:06:49.637 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T04:06:49.638 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug_allow_any_pool_priority=true --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-pool-create/a '--log-file=td/osd-pool-create/$name.log' '--admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' --mon-cluster-log-file=td/osd-pool-create/log --run-dir=td/osd-pool-create '--pid-file=td/osd-pool-create/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-09-16T04:06:49.893 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T04:06:49.894 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T04:06:49.894 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T04:06:49.895 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T04:06:49.895 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T04:06:49.896 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T04:06:49.896 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T04:06:49.896 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T04:06:49.896 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T04:06:49.896 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T04:06:49.896 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:06:49.896 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T04:06:49.897 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.128966/ceph-mon.a.asok 2024-09-16T04:06:49.897 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T04:06:49.897 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.128966/ceph-mon.a.asok config get fsid 2024-09-16T04:06:50.011 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T04:06:50.011 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T04:06:50.012 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T04:06:50.012 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T04:06:50.013 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T04:06:50.013 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T04:06:50.013 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T04:06:50.013 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T04:06:50.013 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T04:06:50.013 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:06:50.013 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T04:06:50.013 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.128966/ceph-mon.a.asok 2024-09-16T04:06:50.014 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T04:06:50.014 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.128966/ceph-mon.a.asok config get mon_host 2024-09-16T04:06:50.123 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:254: check_pool_priority: run_mgr td/osd-pool-create x 2024-09-16T04:06:50.124 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-pool-create 2024-09-16T04:06:50.124 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2024-09-16T04:06:50.124 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2024-09-16T04:06:50.124 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2024-09-16T04:06:50.124 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-pool-create/x 2024-09-16T04:06:50.124 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2024-09-16T04:06:50.542 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2024-09-16T04:06:50.542 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:06:50.542 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:06:50.542 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:06:50.542 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:06:50.543 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T04:06:50.543 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T04:06:50.543 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T04:06:50.544 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --debug_allow_any_pool_priority=true --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-pool-create/x '--log-file=td/osd-pool-create/$name.log' '--admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' --run-dir=td/osd-pool-create '--pid-file=td/osd-pool-create/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T04:06:50.580 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:255: check_pool_priority: activate_osd td/osd-pool-create 0 2024-09-16T04:06:50.581 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-pool-create 2024-09-16T04:06:50.581 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2024-09-16T04:06:50.581 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2024-09-16T04:06:50.581 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2024-09-16T04:06:50.581 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-pool-create/0 2024-09-16T04:06:50.581 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=38a92d84-8703-45d8-b5ef-7d976430f112 --auth-supported=none --mon-host=127.0.0.1:7105 ' 2024-09-16T04:06:50.581 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T04:06:50.581 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T04:06:50.581 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T04:06:50.581 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-pool-create/0' 2024-09-16T04:06:50.581 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-pool-create/0/journal' 2024-09-16T04:06:50.582 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2024-09-16T04:06:50.582 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+=--debug_allow_any_pool_priority=true 2024-09-16T04:06:50.582 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-pool-create' 2024-09-16T04:06:50.582 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2024-09-16T04:06:50.582 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:06:50.582 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:06:50.583 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:06:50.583 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:06:50.584 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T04:06:50.584 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T04:06:50.584 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T04:06:50.584 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2024-09-16T04:06:50.584 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-pool-create/$name.log' 2024-09-16T04:06:50.584 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-pool-create/$name.pid' 2024-09-16T04:06:50.584 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T04:06:50.584 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T04:06:50.584 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T04:06:50.584 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T04:06:50.584 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2024-09-16T04:06:50.584 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2024-09-16T04:06:50.584 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-pool-create/0 2024-09-16T04:06:50.585 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2024-09-16T04:06:50.585 INFO:tasks.workunit.client.0.smithi096.stdout:start osd.0 2024-09-16T04:06:50.586 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=38a92d84-8703-45d8-b5ef-7d976430f112 --auth-supported=none --mon-host=127.0.0.1:7105 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-pool-create/0 --osd-journal=td/osd-pool-create/0/journal --chdir=--debug_allow_any_pool_priority=true --run-dir=td/osd-pool-create '--admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-pool-create/$name.log' '--pid-file=td/osd-pool-create/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T04:06:50.586 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-pool-create/0/whoami 2024-09-16T04:06:50.586 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2024-09-16T04:06:50.586 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2024-09-16T04:06:50.586 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2024-09-16T04:06:50.586 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2024-09-16T04:06:50.609 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:06:50.603+0000 7f3e651ce7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:06:50.612 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:06:50.607+0000 7f3e651ce7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:06:50.614 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:06:50.611+0000 7f3e651ce7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:06:50.614 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:06:50.611+0000 7f3e651ce7c0 -1 global_init_chdir: failed to chdir to directory: '--debug_allow_any_pool_priority=true': (2) No such file or directory 2024-09-16T04:06:50.997 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2024-09-16T04:06:50.997 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T04:06:50.997 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2024-09-16T04:06:50.997 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T04:06:50.997 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T04:06:50.997 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:06:50.997 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T04:06:50.998 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T04:06:50.998 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:06:50.998 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:06:51.431 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:06:51.952 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:06:51.947+0000 7f3e651ce7c0 -1 Falling back to public interface 2024-09-16T04:06:51.953 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:06:51.947+0000 7f3e651ce7c0 -1 global_init_chdir: failed to chdir to directory: '--debug_allow_any_pool_priority=true': (2) No such file or directory 2024-09-16T04:06:52.433 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:06:52.433 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:06:52.434 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T04:06:52.435 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T04:06:52.435 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:06:52.435 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:06:52.859 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:06:53.864 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:06:53.864 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:06:53.864 INFO:tasks.workunit.client.0.smithi096.stdout:2 2024-09-16T04:06:53.865 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T04:06:53.865 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:06:53.865 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:06:54.295 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:06:55.296 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:06:55.297 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:06:55.297 INFO:tasks.workunit.client.0.smithi096.stdout:3 2024-09-16T04:06:55.297 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T04:06:55.297 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:06:55.298 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:06:55.852 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:06:55.869 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:06:55.862+0000 7f3e651ce7c0 -1 osd.0 106 log_to_monitors true 2024-09-16T04:06:56.854 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:06:56.854 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:06:56.854 INFO:tasks.workunit.client.0.smithi096.stdout:4 2024-09-16T04:06:56.855 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T04:06:56.855 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:06:56.855 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:06:57.314 INFO:tasks.workunit.client.0.smithi096.stdout:osd.0 up in weight 1 up_from 111 up_thru 111 down_at 108 last_clean_interval [5,106) [v2:127.0.0.1:6800/740085965,v1:127.0.0.1:6801/740085965] [v2:127.0.0.1:6802/740085965,v1:127.0.0.1:6803/740085965] exists,up b09dafaa-d533-4b95-b506-602dcfc2b32f 2024-09-16T04:06:57.317 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T04:06:57.317 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T04:06:57.317 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T04:06:57.317 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:256: check_pool_priority: activate_osd td/osd-pool-create 1 2024-09-16T04:06:57.317 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-pool-create 2024-09-16T04:06:57.317 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2024-09-16T04:06:57.318 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2024-09-16T04:06:57.318 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2024-09-16T04:06:57.318 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-pool-create/1 2024-09-16T04:06:57.318 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=38a92d84-8703-45d8-b5ef-7d976430f112 --auth-supported=none --mon-host=127.0.0.1:7105 ' 2024-09-16T04:06:57.318 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T04:06:57.318 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T04:06:57.318 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T04:06:57.318 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-pool-create/1' 2024-09-16T04:06:57.318 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-pool-create/1/journal' 2024-09-16T04:06:57.318 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2024-09-16T04:06:57.318 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+=--debug_allow_any_pool_priority=true 2024-09-16T04:06:57.318 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-pool-create' 2024-09-16T04:06:57.318 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2024-09-16T04:06:57.319 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:06:57.319 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:06:57.319 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:06:57.319 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:06:57.319 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T04:06:57.319 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T04:06:57.319 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T04:06:57.319 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2024-09-16T04:06:57.319 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-pool-create/$name.log' 2024-09-16T04:06:57.319 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-pool-create/$name.pid' 2024-09-16T04:06:57.319 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T04:06:57.319 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T04:06:57.319 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T04:06:57.320 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T04:06:57.320 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2024-09-16T04:06:57.320 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2024-09-16T04:06:57.320 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-pool-create/1 2024-09-16T04:06:57.320 INFO:tasks.workunit.client.0.smithi096.stdout:start osd.1 2024-09-16T04:06:57.321 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2024-09-16T04:06:57.321 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=38a92d84-8703-45d8-b5ef-7d976430f112 --auth-supported=none --mon-host=127.0.0.1:7105 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-pool-create/1 --osd-journal=td/osd-pool-create/1/journal --chdir=--debug_allow_any_pool_priority=true --run-dir=td/osd-pool-create '--admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-pool-create/$name.log' '--pid-file=td/osd-pool-create/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T04:06:57.321 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-pool-create/1/whoami 2024-09-16T04:06:57.321 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2024-09-16T04:06:57.321 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2024-09-16T04:06:57.321 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2024-09-16T04:06:57.322 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2024-09-16T04:06:57.341 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:06:57.334+0000 7f12c7b997c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:06:57.451 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:06:57.446+0000 7f12c7b997c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:06:57.452 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:06:57.446+0000 7f12c7b997c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:06:57.452 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:06:57.446+0000 7f12c7b997c0 -1 global_init_chdir: failed to chdir to directory: '--debug_allow_any_pool_priority=true': (2) No such file or directory 2024-09-16T04:06:57.786 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2024-09-16T04:06:57.787 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T04:06:57.787 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2024-09-16T04:06:57.787 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T04:06:57.787 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T04:06:57.787 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:06:57.787 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T04:06:57.787 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T04:06:57.788 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:06:57.788 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:06:58.242 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:06:58.513 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:06:58.506+0000 7f12c7b997c0 -1 Falling back to public interface 2024-09-16T04:06:58.515 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:06:58.510+0000 7f12c7b997c0 -1 global_init_chdir: failed to chdir to directory: '--debug_allow_any_pool_priority=true': (2) No such file or directory 2024-09-16T04:06:59.244 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:06:59.245 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:06:59.245 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T04:06:59.245 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T04:06:59.245 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:06:59.246 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:06:59.704 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:07:00.706 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:07:00.706 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:07:00.706 INFO:tasks.workunit.client.0.smithi096.stdout:2 2024-09-16T04:07:00.706 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T04:07:00.707 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:07:00.707 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:07:01.132 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:07:02.046 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:07:02.042+0000 7f12c7b997c0 -1 osd.1 106 log_to_monitors true 2024-09-16T04:07:02.133 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:07:02.134 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:07:02.134 INFO:tasks.workunit.client.0.smithi096.stdout:3 2024-09-16T04:07:02.134 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T04:07:02.134 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:07:02.135 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:07:02.571 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:07:03.571 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:07:03.571 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:07:03.571 INFO:tasks.workunit.client.0.smithi096.stdout:4 2024-09-16T04:07:03.572 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T04:07:03.572 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:07:03.572 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:07:04.205 INFO:tasks.workunit.client.0.smithi096.stdout:osd.1 up in weight 1 up_from 114 up_thru 114 down_at 108 last_clean_interval [10,106) [v2:127.0.0.1:6810/1480664392,v1:127.0.0.1:6811/1480664392] [v2:127.0.0.1:6812/1480664392,v1:127.0.0.1:6813/1480664392] exists,up bb0dfb74-2f7c-4129-a212-5944638afd2f 2024-09-16T04:07:04.206 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T04:07:04.206 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T04:07:04.206 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T04:07:04.207 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:257: check_pool_priority: activate_osd td/osd-pool-create 2 2024-09-16T04:07:04.207 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-pool-create 2024-09-16T04:07:04.207 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2024-09-16T04:07:04.207 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2024-09-16T04:07:04.207 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2024-09-16T04:07:04.207 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-pool-create/2 2024-09-16T04:07:04.207 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=38a92d84-8703-45d8-b5ef-7d976430f112 --auth-supported=none --mon-host=127.0.0.1:7105 ' 2024-09-16T04:07:04.207 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T04:07:04.207 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T04:07:04.207 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T04:07:04.207 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-pool-create/2' 2024-09-16T04:07:04.207 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-pool-create/2/journal' 2024-09-16T04:07:04.207 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2024-09-16T04:07:04.208 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+=--debug_allow_any_pool_priority=true 2024-09-16T04:07:04.208 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-pool-create' 2024-09-16T04:07:04.208 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2024-09-16T04:07:04.208 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:07:04.208 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:07:04.208 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:07:04.208 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:07:04.208 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T04:07:04.209 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T04:07:04.209 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T04:07:04.209 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2024-09-16T04:07:04.210 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-pool-create/$name.log' 2024-09-16T04:07:04.210 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-pool-create/$name.pid' 2024-09-16T04:07:04.210 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T04:07:04.210 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T04:07:04.210 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T04:07:04.210 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T04:07:04.210 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2024-09-16T04:07:04.210 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2024-09-16T04:07:04.210 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-pool-create/2 2024-09-16T04:07:04.210 INFO:tasks.workunit.client.0.smithi096.stdout:start osd.2 2024-09-16T04:07:04.211 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2024-09-16T04:07:04.211 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=38a92d84-8703-45d8-b5ef-7d976430f112 --auth-supported=none --mon-host=127.0.0.1:7105 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-pool-create/2 --osd-journal=td/osd-pool-create/2/journal --chdir=--debug_allow_any_pool_priority=true --run-dir=td/osd-pool-create '--admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-pool-create/$name.log' '--pid-file=td/osd-pool-create/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T04:07:04.212 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-pool-create/2/whoami 2024-09-16T04:07:04.212 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2024-09-16T04:07:04.212 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2024-09-16T04:07:04.212 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2024-09-16T04:07:04.212 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2024-09-16T04:07:04.238 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:07:04.234+0000 7f0bce9db7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:07:04.292 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:07:04.286+0000 7f0bce9db7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:07:04.294 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:07:04.290+0000 7f0bce9db7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:07:04.294 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:07:04.290+0000 7f0bce9db7c0 -1 global_init_chdir: failed to chdir to directory: '--debug_allow_any_pool_priority=true': (2) No such file or directory 2024-09-16T04:07:04.689 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2024-09-16T04:07:04.689 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T04:07:04.689 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2024-09-16T04:07:04.689 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T04:07:04.689 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T04:07:04.689 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:07:04.689 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T04:07:04.690 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T04:07:04.690 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:07:04.690 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:07:05.129 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:07:05.340 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:07:05.334+0000 7f0bce9db7c0 -1 Falling back to public interface 2024-09-16T04:07:05.345 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:07:05.338+0000 7f0bce9db7c0 -1 global_init_chdir: failed to chdir to directory: '--debug_allow_any_pool_priority=true': (2) No such file or directory 2024-09-16T04:07:06.130 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:07:06.130 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:07:06.131 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T04:07:06.131 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T04:07:06.131 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:07:06.131 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:07:06.558 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:07:07.559 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:07:07.559 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:07:07.560 INFO:tasks.workunit.client.0.smithi096.stdout:2 2024-09-16T04:07:07.560 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T04:07:07.560 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:07:07.560 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:07:08.005 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:07:08.910 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:07:08.906+0000 7f0bce9db7c0 -1 osd.2 107 log_to_monitors true 2024-09-16T04:07:09.007 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:07:09.007 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:07:09.007 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T04:07:09.007 INFO:tasks.workunit.client.0.smithi096.stdout:3 2024-09-16T04:07:09.008 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:07:09.008 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:07:09.424 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:07:10.426 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:07:10.426 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:07:10.426 INFO:tasks.workunit.client.0.smithi096.stdout:4 2024-09-16T04:07:10.427 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T04:07:10.427 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:07:10.427 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:07:11.102 INFO:tasks.workunit.client.0.smithi096.stdout:osd.2 up in weight 1 up_from 118 up_thru 118 down_at 108 last_clean_interval [15,107) [v2:127.0.0.1:6818/4109416430,v1:127.0.0.1:6819/4109416430] [v2:127.0.0.1:6820/4109416430,v1:127.0.0.1:6821/4109416430] exists,up 81619181-aacf-4d1c-b19a-abf21ff61ab6 2024-09-16T04:07:11.103 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T04:07:11.103 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T04:07:11.103 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T04:07:11.103 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:258: check_pool_priority: sleep 5 2024-09-16T04:07:16.104 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:260: check_pool_priority: grep convert td/osd-pool-create/mon.a.log 2024-09-16T04:07:16.133 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T04:04:06.859+0000 7fad72e6d640 20 mon.a@0(leader).osd e1 convert_pool_priorities nothing to fix 2024-09-16T04:07:16.133 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T04:06:49.971+0000 7fd536168e00 10 mon.a@0(leader).osd e108 convert_pool_priorities pool 2 recovery_priority adjusted 5 to 0 2024-09-16T04:07:16.133 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T04:06:49.971+0000 7fd536168e00 10 mon.a@0(leader).osd e108 convert_pool_priorities pool 3 recovery_priority adjusted 10 to 1 2024-09-16T04:07:16.133 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T04:06:49.971+0000 7fd536168e00 10 mon.a@0(leader).osd e108 convert_pool_priorities pool 4 recovery_priority adjusted 15 to 1 2024-09-16T04:07:16.133 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T04:06:49.971+0000 7fd536168e00 10 mon.a@0(leader).osd e108 convert_pool_priorities pool 5 recovery_priority adjusted 20 to 2 2024-09-16T04:07:16.133 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T04:06:49.971+0000 7fd536168e00 10 mon.a@0(leader).osd e108 convert_pool_priorities pool 6 recovery_priority adjusted 25 to 2 2024-09-16T04:07:16.133 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T04:06:49.971+0000 7fd536168e00 10 mon.a@0(leader).osd e108 convert_pool_priorities pool 7 recovery_priority adjusted 30 to 3 2024-09-16T04:07:16.133 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T04:06:49.971+0000 7fd536168e00 10 mon.a@0(leader).osd e108 convert_pool_priorities pool 8 recovery_priority adjusted 35 to 3 2024-09-16T04:07:16.134 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T04:06:49.971+0000 7fd536168e00 10 mon.a@0(leader).osd e108 convert_pool_priorities pool 9 recovery_priority adjusted 40 to 4 2024-09-16T04:07:16.134 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T04:06:49.971+0000 7fd536168e00 10 mon.a@0(leader).osd e108 convert_pool_priorities pool 10 recovery_priority adjusted 45 to 4 2024-09-16T04:07:16.134 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T04:06:49.971+0000 7fd536168e00 10 mon.a@0(leader).osd e108 convert_pool_priorities pool 11 recovery_priority adjusted 50 to 5 2024-09-16T04:07:16.134 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T04:06:49.971+0000 7fd536168e00 10 mon.a@0(leader).osd e108 convert_pool_priorities pool 12 recovery_priority adjusted 55 to 5 2024-09-16T04:07:16.134 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T04:06:49.971+0000 7fd536168e00 10 mon.a@0(leader).osd e108 convert_pool_priorities pool 13 recovery_priority adjusted 60 to 6 2024-09-16T04:07:16.134 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T04:06:49.971+0000 7fd536168e00 10 mon.a@0(leader).osd e108 convert_pool_priorities pool 14 recovery_priority adjusted 65 to 6 2024-09-16T04:07:16.134 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T04:06:49.971+0000 7fd536168e00 10 mon.a@0(leader).osd e108 convert_pool_priorities pool 15 recovery_priority adjusted 70 to 7 2024-09-16T04:07:16.134 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T04:06:49.971+0000 7fd536168e00 10 mon.a@0(leader).osd e108 convert_pool_priorities pool 16 recovery_priority adjusted 75 to 7 2024-09-16T04:07:16.134 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T04:06:49.971+0000 7fd536168e00 10 mon.a@0(leader).osd e108 convert_pool_priorities pool 17 recovery_priority adjusted 80 to 8 2024-09-16T04:07:16.134 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T04:06:49.971+0000 7fd536168e00 10 mon.a@0(leader).osd e108 convert_pool_priorities pool 18 recovery_priority adjusted 85 to 8 2024-09-16T04:07:16.134 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T04:06:49.971+0000 7fd536168e00 10 mon.a@0(leader).osd e108 convert_pool_priorities pool 19 recovery_priority adjusted 90 to 9 2024-09-16T04:07:16.134 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T04:06:49.971+0000 7fd536168e00 10 mon.a@0(leader).osd e108 convert_pool_priorities pool 20 recovery_priority adjusted 95 to 9 2024-09-16T04:07:16.134 INFO:tasks.workunit.client.0.smithi096.stdout:2024-09-16T04:06:49.971+0000 7fd536168e00 10 mon.a@0(leader).osd e108 convert_pool_priorities pool 21 recovery_priority adjusted 100 to 10 2024-09-16T04:07:16.135 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:261: check_pool_priority: ceph osd dump 2024-09-16T04:07:16.535 INFO:tasks.workunit.client.0.smithi096.stdout:epoch 120 2024-09-16T04:07:16.535 INFO:tasks.workunit.client.0.smithi096.stdout:fsid 38a92d84-8703-45d8-b5ef-7d976430f112 2024-09-16T04:07:16.535 INFO:tasks.workunit.client.0.smithi096.stdout:created 2024-09-16T04:04:06.658635+0000 2024-09-16T04:07:16.536 INFO:tasks.workunit.client.0.smithi096.stdout:modified 2024-09-16T04:07:10.228857+0000 2024-09-16T04:07:16.536 INFO:tasks.workunit.client.0.smithi096.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-16T04:07:16.536 INFO:tasks.workunit.client.0.smithi096.stdout:crush_version 10 2024-09-16T04:07:16.536 INFO:tasks.workunit.client.0.smithi096.stdout:full_ratio 0.99 2024-09-16T04:07:16.536 INFO:tasks.workunit.client.0.smithi096.stdout:backfillfull_ratio 0.99 2024-09-16T04:07:16.536 INFO:tasks.workunit.client.0.smithi096.stdout:nearfull_ratio 0.85 2024-09-16T04:07:16.536 INFO:tasks.workunit.client.0.smithi096.stdout:require_min_compat_client luminous 2024-09-16T04:07:16.536 INFO:tasks.workunit.client.0.smithi096.stdout:min_compat_client jewel 2024-09-16T04:07:16.536 INFO:tasks.workunit.client.0.smithi096.stdout:require_osd_release squid 2024-09-16T04:07:16.536 INFO:tasks.workunit.client.0.smithi096.stdout:stretch_mode_enabled false 2024-09-16T04:07:16.536 INFO:tasks.workunit.client.0.smithi096.stdout:pool 1 'test1' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 67 flags hashpspool stripe_width 0 read_balance_score 3.00 2024-09-16T04:07:16.536 INFO:tasks.workunit.client.0.smithi096.stdout:pool 2 'test2' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 109 flags hashpspool stripe_width 0 read_balance_score 3.00 2024-09-16T04:07:16.537 INFO:tasks.workunit.client.0.smithi096.stdout:pool 3 'test3' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 109 flags hashpspool stripe_width 0 recovery_priority 1 read_balance_score 3.00 2024-09-16T04:07:16.537 INFO:tasks.workunit.client.0.smithi096.stdout:pool 4 'test4' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 109 flags hashpspool stripe_width 0 recovery_priority 1 read_balance_score 3.00 2024-09-16T04:07:16.537 INFO:tasks.workunit.client.0.smithi096.stdout:pool 5 'test5' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 109 flags hashpspool stripe_width 0 recovery_priority 2 read_balance_score 3.00 2024-09-16T04:07:16.537 INFO:tasks.workunit.client.0.smithi096.stdout:pool 6 'test6' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 109 flags hashpspool stripe_width 0 recovery_priority 2 read_balance_score 3.00 2024-09-16T04:07:16.537 INFO:tasks.workunit.client.0.smithi096.stdout:pool 7 'test7' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 109 flags hashpspool stripe_width 0 recovery_priority 3 read_balance_score 3.00 2024-09-16T04:07:16.537 INFO:tasks.workunit.client.0.smithi096.stdout:pool 8 'test8' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 109 flags hashpspool stripe_width 0 recovery_priority 3 read_balance_score 3.00 2024-09-16T04:07:16.537 INFO:tasks.workunit.client.0.smithi096.stdout:pool 9 'test9' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 109 flags hashpspool stripe_width 0 recovery_priority 4 read_balance_score 3.00 2024-09-16T04:07:16.537 INFO:tasks.workunit.client.0.smithi096.stdout:pool 10 'test10' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 109 flags hashpspool stripe_width 0 recovery_priority 4 read_balance_score 3.00 2024-09-16T04:07:16.537 INFO:tasks.workunit.client.0.smithi096.stdout:pool 11 'test11' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 109 flags hashpspool stripe_width 0 recovery_priority 5 read_balance_score 3.00 2024-09-16T04:07:16.537 INFO:tasks.workunit.client.0.smithi096.stdout:pool 12 'test12' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 109 flags hashpspool stripe_width 0 recovery_priority 5 read_balance_score 3.00 2024-09-16T04:07:16.537 INFO:tasks.workunit.client.0.smithi096.stdout:pool 13 'test13' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 109 flags hashpspool stripe_width 0 recovery_priority 6 read_balance_score 3.00 2024-09-16T04:07:16.537 INFO:tasks.workunit.client.0.smithi096.stdout:pool 14 'test14' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 109 flags hashpspool stripe_width 0 recovery_priority 6 read_balance_score 3.00 2024-09-16T04:07:16.537 INFO:tasks.workunit.client.0.smithi096.stdout:pool 15 'test15' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 109 flags hashpspool stripe_width 0 recovery_priority 7 read_balance_score 3.00 2024-09-16T04:07:16.538 INFO:tasks.workunit.client.0.smithi096.stdout:pool 16 'test16' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 109 flags hashpspool stripe_width 0 recovery_priority 7 read_balance_score 3.00 2024-09-16T04:07:16.538 INFO:tasks.workunit.client.0.smithi096.stdout:pool 17 'test17' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 109 flags hashpspool stripe_width 0 recovery_priority 8 read_balance_score 3.00 2024-09-16T04:07:16.538 INFO:tasks.workunit.client.0.smithi096.stdout:pool 18 'test18' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 109 flags hashpspool stripe_width 0 recovery_priority 8 read_balance_score 3.00 2024-09-16T04:07:16.538 INFO:tasks.workunit.client.0.smithi096.stdout:pool 19 'test19' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 109 flags hashpspool stripe_width 0 recovery_priority 9 read_balance_score 3.00 2024-09-16T04:07:16.538 INFO:tasks.workunit.client.0.smithi096.stdout:pool 20 'test20' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 109 flags hashpspool stripe_width 0 recovery_priority 9 read_balance_score 3.00 2024-09-16T04:07:16.538 INFO:tasks.workunit.client.0.smithi096.stdout:pool 21 'test21' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 109 flags hashpspool stripe_width 0 recovery_priority 10 read_balance_score 3.00 2024-09-16T04:07:16.538 INFO:tasks.workunit.client.0.smithi096.stdout:max_osd 3 2024-09-16T04:07:16.538 INFO:tasks.workunit.client.0.smithi096.stdout:osd.0 up in weight 1 up_from 111 up_thru 118 down_at 108 last_clean_interval [5,106) [v2:127.0.0.1:6800/740085965,v1:127.0.0.1:6801/740085965] [v2:127.0.0.1:6802/740085965,v1:127.0.0.1:6803/740085965] exists,up b09dafaa-d533-4b95-b506-602dcfc2b32f 2024-09-16T04:07:16.538 INFO:tasks.workunit.client.0.smithi096.stdout:osd.1 up in weight 1 up_from 114 up_thru 118 down_at 108 last_clean_interval [10,106) [v2:127.0.0.1:6810/1480664392,v1:127.0.0.1:6811/1480664392] [v2:127.0.0.1:6812/1480664392,v1:127.0.0.1:6813/1480664392] exists,up bb0dfb74-2f7c-4129-a212-5944638afd2f 2024-09-16T04:07:16.538 INFO:tasks.workunit.client.0.smithi096.stdout:osd.2 up in weight 1 up_from 118 up_thru 118 down_at 108 last_clean_interval [15,107) [v2:127.0.0.1:6818/4109416430,v1:127.0.0.1:6819/4109416430] [v2:127.0.0.1:6820/4109416430,v1:127.0.0.1:6821/4109416430] exists,up 81619181-aacf-4d1c-b19a-abf21ff61ab6 2024-09-16T04:07:16.538 INFO:tasks.workunit.client.0.smithi096.stdout:blocklist 127.0.0.1:0/2982127084 expires 2024-09-17T04:06:55.248233+0000 2024-09-16T04:07:16.538 INFO:tasks.workunit.client.0.smithi096.stdout:blocklist 127.0.0.1:0/1858555347 expires 2024-09-17T04:06:55.248233+0000 2024-09-16T04:07:16.538 INFO:tasks.workunit.client.0.smithi096.stdout:blocklist 127.0.0.1:6801/2916435146 expires 2024-09-17T04:06:55.248233+0000 2024-09-16T04:07:16.538 INFO:tasks.workunit.client.0.smithi096.stdout:blocklist 127.0.0.1:6800/2916435146 expires 2024-09-17T04:06:55.248233+0000 2024-09-16T04:07:16.539 INFO:tasks.workunit.client.0.smithi096.stdout:blocklist 127.0.0.1:0/87831170 expires 2024-09-17T04:06:55.248233+0000 2024-09-16T04:07:16.553 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:263: check_pool_priority: pos=1 2024-09-16T04:07:16.553 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: ceph osd dump 2024-09-16T04:07:16.553 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: grep '^pool' 2024-09-16T04:07:16.554 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: sed 's/.*recovery_priority //' 2024-09-16T04:07:16.554 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: awk '{ print $1 }' 2024-09-16T04:07:16.980 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T04:07:16.980 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo 0 0 1 1 2 2 3 3 4 4 5 5 6 6 7 7 8 8 9 9 10 2024-09-16T04:07:16.980 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $1 }' 2024-09-16T04:07:16.982 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=0 2024-09-16T04:07:16.982 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test 0 = 0 2024-09-16T04:07:16.982 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:270: check_pool_priority: result=pool 2024-09-16T04:07:16.982 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test pool = pool 2024-09-16T04:07:16.983 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 1 + 1 2024-09-16T04:07:16.984 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=2 2024-09-16T04:07:16.984 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T04:07:16.985 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo 0 0 1 1 2 2 3 3 4 4 5 5 6 6 7 7 8 8 9 9 10 2024-09-16T04:07:16.985 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $2 }' 2024-09-16T04:07:16.987 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=0 2024-09-16T04:07:16.987 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test 0 = 0 2024-09-16T04:07:16.987 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:270: check_pool_priority: result=pool 2024-09-16T04:07:16.987 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test pool = pool 2024-09-16T04:07:16.988 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 2 + 1 2024-09-16T04:07:16.989 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=3 2024-09-16T04:07:16.989 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T04:07:16.990 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo 0 0 1 1 2 2 3 3 4 4 5 5 6 6 7 7 8 8 9 9 10 2024-09-16T04:07:16.990 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $3 }' 2024-09-16T04:07:16.992 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=1 2024-09-16T04:07:16.992 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test 1 = 0 2024-09-16T04:07:16.992 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test 1 = 1 2024-09-16T04:07:16.992 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 3 + 1 2024-09-16T04:07:16.993 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=4 2024-09-16T04:07:16.993 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T04:07:16.994 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo 0 0 1 1 2 2 3 3 4 4 5 5 6 6 7 7 8 8 9 9 10 2024-09-16T04:07:16.994 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $4 }' 2024-09-16T04:07:16.995 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=1 2024-09-16T04:07:16.996 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test 1 = 0 2024-09-16T04:07:16.996 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test 1 = 1 2024-09-16T04:07:16.996 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 4 + 1 2024-09-16T04:07:16.996 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=5 2024-09-16T04:07:16.996 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T04:07:16.997 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo 0 0 1 1 2 2 3 3 4 4 5 5 6 6 7 7 8 8 9 9 10 2024-09-16T04:07:16.997 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $5 }' 2024-09-16T04:07:16.999 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=2 2024-09-16T04:07:16.999 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test 2 = 0 2024-09-16T04:07:16.999 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test 2 = 2 2024-09-16T04:07:17.000 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 5 + 1 2024-09-16T04:07:17.001 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=6 2024-09-16T04:07:17.001 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T04:07:17.001 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo 0 0 1 1 2 2 3 3 4 4 5 5 6 6 7 7 8 8 9 9 10 2024-09-16T04:07:17.001 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $6 }' 2024-09-16T04:07:17.003 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=2 2024-09-16T04:07:17.004 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test 2 = 0 2024-09-16T04:07:17.004 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test 2 = 2 2024-09-16T04:07:17.004 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 6 + 1 2024-09-16T04:07:17.004 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=7 2024-09-16T04:07:17.004 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T04:07:17.005 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo 0 0 1 1 2 2 3 3 4 4 5 5 6 6 7 7 8 8 9 9 10 2024-09-16T04:07:17.005 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $7 }' 2024-09-16T04:07:17.007 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=3 2024-09-16T04:07:17.008 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test 3 = 0 2024-09-16T04:07:17.008 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test 3 = 3 2024-09-16T04:07:17.008 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 7 + 1 2024-09-16T04:07:17.008 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=8 2024-09-16T04:07:17.008 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T04:07:17.009 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo 0 0 1 1 2 2 3 3 4 4 5 5 6 6 7 7 8 8 9 9 10 2024-09-16T04:07:17.009 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $8 }' 2024-09-16T04:07:17.011 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=3 2024-09-16T04:07:17.011 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test 3 = 0 2024-09-16T04:07:17.011 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test 3 = 3 2024-09-16T04:07:17.012 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 8 + 1 2024-09-16T04:07:17.012 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=9 2024-09-16T04:07:17.012 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T04:07:17.013 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo 0 0 1 1 2 2 3 3 4 4 5 5 6 6 7 7 8 8 9 9 10 2024-09-16T04:07:17.013 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $9 }' 2024-09-16T04:07:17.015 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=4 2024-09-16T04:07:17.015 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test 4 = 0 2024-09-16T04:07:17.015 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test 4 = 4 2024-09-16T04:07:17.015 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 9 + 1 2024-09-16T04:07:17.016 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=10 2024-09-16T04:07:17.016 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T04:07:17.017 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo 0 0 1 1 2 2 3 3 4 4 5 5 6 6 7 7 8 8 9 9 10 2024-09-16T04:07:17.017 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $10 }' 2024-09-16T04:07:17.019 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=4 2024-09-16T04:07:17.019 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test 4 = 0 2024-09-16T04:07:17.019 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test 4 = 4 2024-09-16T04:07:17.019 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 10 + 1 2024-09-16T04:07:17.020 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=11 2024-09-16T04:07:17.020 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T04:07:17.021 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo 0 0 1 1 2 2 3 3 4 4 5 5 6 6 7 7 8 8 9 9 10 2024-09-16T04:07:17.021 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $11 }' 2024-09-16T04:07:17.023 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=5 2024-09-16T04:07:17.024 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test 5 = 0 2024-09-16T04:07:17.024 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test 5 = 5 2024-09-16T04:07:17.024 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 11 + 1 2024-09-16T04:07:17.024 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=12 2024-09-16T04:07:17.024 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T04:07:17.025 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo 0 0 1 1 2 2 3 3 4 4 5 5 6 6 7 7 8 8 9 9 10 2024-09-16T04:07:17.025 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $12 }' 2024-09-16T04:07:17.027 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=5 2024-09-16T04:07:17.027 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test 5 = 0 2024-09-16T04:07:17.027 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test 5 = 5 2024-09-16T04:07:17.027 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 12 + 1 2024-09-16T04:07:17.028 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=13 2024-09-16T04:07:17.028 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T04:07:17.029 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo 0 0 1 1 2 2 3 3 4 4 5 5 6 6 7 7 8 8 9 9 10 2024-09-16T04:07:17.029 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $13 }' 2024-09-16T04:07:17.031 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=6 2024-09-16T04:07:17.031 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test 6 = 0 2024-09-16T04:07:17.031 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test 6 = 6 2024-09-16T04:07:17.031 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 13 + 1 2024-09-16T04:07:17.032 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=14 2024-09-16T04:07:17.032 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T04:07:17.032 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo 0 0 1 1 2 2 3 3 4 4 5 5 6 6 7 7 8 8 9 9 10 2024-09-16T04:07:17.033 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $14 }' 2024-09-16T04:07:17.035 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=6 2024-09-16T04:07:17.035 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test 6 = 0 2024-09-16T04:07:17.035 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test 6 = 6 2024-09-16T04:07:17.035 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 14 + 1 2024-09-16T04:07:17.036 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=15 2024-09-16T04:07:17.036 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T04:07:17.036 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo 0 0 1 1 2 2 3 3 4 4 5 5 6 6 7 7 8 8 9 9 10 2024-09-16T04:07:17.036 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $15 }' 2024-09-16T04:07:17.038 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=7 2024-09-16T04:07:17.039 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test 7 = 0 2024-09-16T04:07:17.039 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test 7 = 7 2024-09-16T04:07:17.039 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 15 + 1 2024-09-16T04:07:17.039 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=16 2024-09-16T04:07:17.040 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T04:07:17.040 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo 0 0 1 1 2 2 3 3 4 4 5 5 6 6 7 7 8 8 9 9 10 2024-09-16T04:07:17.040 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $16 }' 2024-09-16T04:07:17.042 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=7 2024-09-16T04:07:17.042 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test 7 = 0 2024-09-16T04:07:17.042 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test 7 = 7 2024-09-16T04:07:17.043 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 16 + 1 2024-09-16T04:07:17.043 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=17 2024-09-16T04:07:17.044 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T04:07:17.044 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo 0 0 1 1 2 2 3 3 4 4 5 5 6 6 7 7 8 8 9 9 10 2024-09-16T04:07:17.044 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $17 }' 2024-09-16T04:07:17.046 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=8 2024-09-16T04:07:17.047 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test 8 = 0 2024-09-16T04:07:17.047 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test 8 = 8 2024-09-16T04:07:17.047 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 17 + 1 2024-09-16T04:07:17.047 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=18 2024-09-16T04:07:17.048 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T04:07:17.048 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo 0 0 1 1 2 2 3 3 4 4 5 5 6 6 7 7 8 8 9 9 10 2024-09-16T04:07:17.048 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $18 }' 2024-09-16T04:07:17.051 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=8 2024-09-16T04:07:17.051 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test 8 = 0 2024-09-16T04:07:17.051 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test 8 = 8 2024-09-16T04:07:17.051 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 18 + 1 2024-09-16T04:07:17.052 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=19 2024-09-16T04:07:17.052 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T04:07:17.052 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo 0 0 1 1 2 2 3 3 4 4 5 5 6 6 7 7 8 8 9 9 10 2024-09-16T04:07:17.052 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $19 }' 2024-09-16T04:07:17.055 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=9 2024-09-16T04:07:17.055 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test 9 = 0 2024-09-16T04:07:17.055 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test 9 = 9 2024-09-16T04:07:17.055 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 19 + 1 2024-09-16T04:07:17.056 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=20 2024-09-16T04:07:17.056 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T04:07:17.056 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo 0 0 1 1 2 2 3 3 4 4 5 5 6 6 7 7 8 8 9 9 10 2024-09-16T04:07:17.056 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $20 }' 2024-09-16T04:07:17.058 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=9 2024-09-16T04:07:17.058 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test 9 = 0 2024-09-16T04:07:17.059 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test 9 = 9 2024-09-16T04:07:17.059 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 20 + 1 2024-09-16T04:07:17.059 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=21 2024-09-16T04:07:17.060 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:264: check_pool_priority: for i in $(ceph osd dump | grep ^pool | sed 's/.*recovery_priority //' | awk '{ print $1 }') 2024-09-16T04:07:17.060 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: echo 0 0 1 1 2 2 3 3 4 4 5 5 6 6 7 7 8 8 9 9 10 2024-09-16T04:07:17.060 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: awk '{ print $21 }' 2024-09-16T04:07:17.062 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:266: check_pool_priority: result=10 2024-09-16T04:07:17.062 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:268: check_pool_priority: test 10 = 0 2024-09-16T04:07:17.063 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:272: check_pool_priority: test 10 = 10 2024-09-16T04:07:17.063 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: expr 21 + 1 2024-09-16T04:07:17.064 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:273: check_pool_priority: pos=22 2024-09-16T04:07:17.064 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:33: run: teardown td/osd-pool-create 2024-09-16T04:07:17.065 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-pool-create 2024-09-16T04:07:17.065 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T04:07:17.065 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-pool-create KILL 2024-09-16T04:07:17.065 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T04:07:17.065 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T04:07:17.065 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T04:07:17.065 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T04:07:17.065 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T04:07:17.375 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T04:07:17.375 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T04:07:17.376 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T04:07:17.377 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T04:07:17.378 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T04:07:17.378 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T04:07:17.379 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T04:07:17.380 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T04:07:17.380 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T04:07:17.380 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T04:07:17.380 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T04:07:17.381 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T04:07:17.382 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T04:07:17.383 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-pool-create 2024-09-16T04:07:17.413 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T04:07:17.413 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:07:17.413 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T04:07:17.413 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.128966 2024-09-16T04:07:17.415 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T04:07:17.415 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T04:07:17.415 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:30: run: for func in $funcs 2024-09-16T04:07:17.415 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:31: run: setup td/osd-pool-create 2024-09-16T04:07:17.416 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-pool-create 2024-09-16T04:07:17.416 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-pool-create 2024-09-16T04:07:17.416 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-pool-create 2024-09-16T04:07:17.416 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T04:07:17.416 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-pool-create KILL 2024-09-16T04:07:17.416 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T04:07:17.416 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T04:07:17.416 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T04:07:17.416 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T04:07:17.416 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T04:07:17.418 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T04:07:17.418 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T04:07:17.419 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T04:07:17.419 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T04:07:17.420 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T04:07:17.420 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T04:07:17.421 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T04:07:17.421 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T04:07:17.422 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T04:07:17.422 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T04:07:17.422 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T04:07:17.423 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T04:07:17.424 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T04:07:17.424 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-pool-create 2024-09-16T04:07:17.425 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T04:07:17.425 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:07:17.426 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T04:07:17.426 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.128966 2024-09-16T04:07:17.426 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T04:07:17.426 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T04:07:17.426 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-pool-create 2024-09-16T04:07:17.428 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T04:07:17.428 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:07:17.428 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T04:07:17.428 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.128966 2024-09-16T04:07:17.430 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T04:07:17.431 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2024-09-16T04:07:17.431 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T04:07:17.431 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-pool-create 1' TERM HUP INT 2024-09-16T04:07:17.431 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:32: run: TEST_replicated_pool td/osd-pool-create 2024-09-16T04:07:17.431 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:173: TEST_replicated_pool: local dir=td/osd-pool-create 2024-09-16T04:07:17.431 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:174: TEST_replicated_pool: run_mon td/osd-pool-create a 2024-09-16T04:07:17.431 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-pool-create 2024-09-16T04:07:17.431 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T04:07:17.431 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T04:07:17.431 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T04:07:17.431 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-pool-create/a 2024-09-16T04:07:17.431 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-pool-create/a --run-dir=td/osd-pool-create 2024-09-16T04:07:17.911 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T04:07:17.911 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:07:17.911 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:07:17.912 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:07:17.912 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:07:17.913 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T04:07:17.913 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T04:07:17.913 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug_allow_any_pool_priority=true --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-pool-create/a '--log-file=td/osd-pool-create/$name.log' '--admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' --mon-cluster-log-file=td/osd-pool-create/log --run-dir=td/osd-pool-create '--pid-file=td/osd-pool-create/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-09-16T04:07:18.111 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T04:07:18.112 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T04:07:18.112 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T04:07:18.112 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T04:07:18.112 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T04:07:18.113 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T04:07:18.114 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T04:07:18.114 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T04:07:18.114 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T04:07:18.114 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T04:07:18.114 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:07:18.114 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T04:07:18.114 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.128966/ceph-mon.a.asok 2024-09-16T04:07:18.114 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T04:07:18.115 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.128966/ceph-mon.a.asok config get fsid 2024-09-16T04:07:18.225 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T04:07:18.225 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T04:07:18.225 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T04:07:18.225 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T04:07:18.229 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T04:07:18.229 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T04:07:18.229 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T04:07:18.229 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T04:07:18.229 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T04:07:18.229 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:07:18.229 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T04:07:18.229 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.128966/ceph-mon.a.asok 2024-09-16T04:07:18.229 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T04:07:18.229 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.128966/ceph-mon.a.asok config get mon_host 2024-09-16T04:07:18.345 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:175: TEST_replicated_pool: ceph osd pool create replicated 12 12 replicated replicated_rule 2024-09-16T04:07:19.258 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'replicated' already exists 2024-09-16T04:07:19.276 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:176: TEST_replicated_pool: ceph osd pool create replicated 12 12 replicated replicated_rule 2024-09-16T04:07:19.276 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:177: TEST_replicated_pool: grep 'already exists' 2024-09-16T04:07:19.527 INFO:tasks.workunit.client.0.smithi096.stdout:pool 'replicated' already exists 2024-09-16T04:07:19.527 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:179: TEST_replicated_pool: ceph osd pool create replicated1 12 12 2024-09-16T04:07:19.869 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'replicated1' already exists 2024-09-16T04:07:19.886 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:181: TEST_replicated_pool: ceph osd pool create replicated2 12 2024-09-16T04:07:20.366 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'replicated2' already exists 2024-09-16T04:07:20.383 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:182: TEST_replicated_pool: ceph osd pool create replicated 12 12 erasure 2024-09-16T04:07:20.383 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:183: TEST_replicated_pool: grep 'cannot change to type erasure' 2024-09-16T04:07:20.613 INFO:tasks.workunit.client.0.smithi096.stdout:Error EINVAL: pool 'replicated' cannot change to type erasure 2024-09-16T04:07:20.614 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:33: run: teardown td/osd-pool-create 2024-09-16T04:07:20.614 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-pool-create 2024-09-16T04:07:20.614 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T04:07:20.614 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-pool-create KILL 2024-09-16T04:07:20.614 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T04:07:20.614 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T04:07:20.614 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T04:07:20.614 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T04:07:20.615 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T04:07:20.721 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T04:07:20.721 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T04:07:20.722 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T04:07:20.722 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T04:07:20.723 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T04:07:20.723 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T04:07:20.724 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T04:07:20.726 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T04:07:20.726 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T04:07:20.726 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T04:07:20.726 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T04:07:20.727 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T04:07:20.728 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T04:07:20.729 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-pool-create 2024-09-16T04:07:20.731 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T04:07:20.731 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:07:20.731 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T04:07:20.731 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.128966 2024-09-16T04:07:20.733 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T04:07:20.733 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T04:07:20.733 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:30: run: for func in $funcs 2024-09-16T04:07:20.734 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:31: run: setup td/osd-pool-create 2024-09-16T04:07:20.734 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-pool-create 2024-09-16T04:07:20.734 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-pool-create 2024-09-16T04:07:20.734 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-pool-create 2024-09-16T04:07:20.734 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T04:07:20.734 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-pool-create KILL 2024-09-16T04:07:20.734 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T04:07:20.734 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T04:07:20.734 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T04:07:20.734 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T04:07:20.735 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T04:07:20.735 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T04:07:20.736 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T04:07:20.737 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T04:07:20.737 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T04:07:20.738 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T04:07:20.739 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T04:07:20.739 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T04:07:20.740 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T04:07:20.740 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T04:07:20.740 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T04:07:20.741 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T04:07:20.742 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T04:07:20.743 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T04:07:20.743 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-pool-create 2024-09-16T04:07:20.744 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T04:07:20.744 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:07:20.744 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T04:07:20.745 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.128966 2024-09-16T04:07:20.746 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T04:07:20.746 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T04:07:20.746 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-pool-create 2024-09-16T04:07:20.747 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T04:07:20.747 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:07:20.747 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T04:07:20.748 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.128966 2024-09-16T04:07:20.750 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T04:07:20.750 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2024-09-16T04:07:20.750 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T04:07:20.750 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-pool-create 1' TERM HUP INT 2024-09-16T04:07:20.750 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:32: run: TEST_replicated_pool_with_rule td/osd-pool-create 2024-09-16T04:07:20.750 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:135: TEST_replicated_pool_with_rule: local dir=td/osd-pool-create 2024-09-16T04:07:20.750 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:136: TEST_replicated_pool_with_rule: run_mon td/osd-pool-create a 2024-09-16T04:07:20.750 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-pool-create 2024-09-16T04:07:20.750 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T04:07:20.750 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T04:07:20.751 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T04:07:20.751 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-pool-create/a 2024-09-16T04:07:20.751 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-pool-create/a --run-dir=td/osd-pool-create 2024-09-16T04:07:21.223 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T04:07:21.223 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:07:21.223 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:07:21.223 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:07:21.223 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:07:21.224 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T04:07:21.224 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T04:07:21.224 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug_allow_any_pool_priority=true --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-pool-create/a '--log-file=td/osd-pool-create/$name.log' '--admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' --mon-cluster-log-file=td/osd-pool-create/log --run-dir=td/osd-pool-create '--pid-file=td/osd-pool-create/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-09-16T04:07:21.442 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T04:07:21.443 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T04:07:21.444 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T04:07:21.444 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T04:07:21.444 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T04:07:21.444 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T04:07:21.445 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T04:07:21.445 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T04:07:21.445 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T04:07:21.445 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T04:07:21.445 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:07:21.446 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T04:07:21.446 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.128966/ceph-mon.a.asok 2024-09-16T04:07:21.446 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T04:07:21.446 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.128966/ceph-mon.a.asok config get fsid 2024-09-16T04:07:21.564 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T04:07:21.565 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T04:07:21.565 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T04:07:21.565 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T04:07:21.566 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T04:07:21.566 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T04:07:21.566 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T04:07:21.566 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T04:07:21.566 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T04:07:21.566 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:07:21.566 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T04:07:21.566 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.128966/ceph-mon.a.asok 2024-09-16T04:07:21.567 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T04:07:21.567 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.128966/ceph-mon.a.asok config get mon_host 2024-09-16T04:07:21.678 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:137: TEST_replicated_pool_with_rule: local rule=rule0 2024-09-16T04:07:21.678 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:138: TEST_replicated_pool_with_rule: local root=host1 2024-09-16T04:07:21.678 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:139: TEST_replicated_pool_with_rule: ceph osd crush add-bucket host1 host 2024-09-16T04:07:22.611 INFO:tasks.workunit.client.0.smithi096.stderr:bucket 'host1' already exists 2024-09-16T04:07:22.629 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:140: TEST_replicated_pool_with_rule: local failure_domain=osd 2024-09-16T04:07:22.630 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:141: TEST_replicated_pool_with_rule: local poolname=mypool 2024-09-16T04:07:22.630 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:142: TEST_replicated_pool_with_rule: ceph osd crush rule create-simple rule0 host1 osd 2024-09-16T04:07:23.132 INFO:tasks.workunit.client.0.smithi096.stderr:rule rule0 already exists 2024-09-16T04:07:23.152 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:143: TEST_replicated_pool_with_rule: ceph osd crush rule ls 2024-09-16T04:07:23.152 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:143: TEST_replicated_pool_with_rule: grep rule0 2024-09-16T04:07:23.422 INFO:tasks.workunit.client.0.smithi096.stdout:rule0 2024-09-16T04:07:23.422 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:144: TEST_replicated_pool_with_rule: ceph osd pool create mypool 12 12 replicated rule0 2024-09-16T04:07:23.790 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'mypool' already exists 2024-09-16T04:07:23.808 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:145: TEST_replicated_pool_with_rule: ceph osd crush rule dump rule0 2024-09-16T04:07:23.809 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:145: TEST_replicated_pool_with_rule: grep rule_id 2024-09-16T04:07:23.809 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:145: TEST_replicated_pool_with_rule: awk '-F[ :,]' '{print $4}' 2024-09-16T04:07:24.058 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:145: TEST_replicated_pool_with_rule: rule_id= 2024-09-16T04:07:24.058 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:146: TEST_replicated_pool_with_rule: ceph osd pool get mypool crush_rule 2024-09-16T04:07:24.058 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:147: TEST_replicated_pool_with_rule: grep 'crush_rule: ' 2024-09-16T04:07:24.304 INFO:tasks.workunit.client.0.smithi096.stdout:crush_rule: rule0 2024-09-16T04:07:24.305 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:150: TEST_replicated_pool_with_rule: grep 'doesn'\''t exist' 2024-09-16T04:07:24.305 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:149: TEST_replicated_pool_with_rule: ceph osd pool create newpool 12 12 replicated non-existent 2024-09-16T04:07:24.492 INFO:tasks.workunit.client.0.smithi096.stdout:Error ENOENT: specified rule non-existent doesn't exist 2024-09-16T04:07:24.493 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:33: run: teardown td/osd-pool-create 2024-09-16T04:07:24.493 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-pool-create 2024-09-16T04:07:24.493 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T04:07:24.493 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-pool-create KILL 2024-09-16T04:07:24.493 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T04:07:24.493 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T04:07:24.494 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T04:07:24.494 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T04:07:24.494 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T04:07:24.600 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T04:07:24.601 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T04:07:24.601 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T04:07:24.602 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T04:07:24.604 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T04:07:24.604 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T04:07:24.605 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T04:07:24.605 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T04:07:24.606 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T04:07:24.606 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T04:07:24.606 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T04:07:24.607 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T04:07:24.608 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T04:07:24.608 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-pool-create 2024-09-16T04:07:24.611 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T04:07:24.611 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:07:24.611 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T04:07:24.611 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.128966 2024-09-16T04:07:24.613 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T04:07:24.613 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T04:07:24.613 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:30: run: for func in $funcs 2024-09-16T04:07:24.613 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:31: run: setup td/osd-pool-create 2024-09-16T04:07:24.613 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-pool-create 2024-09-16T04:07:24.613 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-pool-create 2024-09-16T04:07:24.613 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-pool-create 2024-09-16T04:07:24.613 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T04:07:24.613 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-pool-create KILL 2024-09-16T04:07:24.613 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T04:07:24.614 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T04:07:24.614 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T04:07:24.614 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T04:07:24.614 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T04:07:24.615 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T04:07:24.616 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T04:07:24.616 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T04:07:24.617 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T04:07:24.618 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T04:07:24.618 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T04:07:24.618 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T04:07:24.619 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T04:07:24.619 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T04:07:24.620 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T04:07:24.620 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T04:07:24.621 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T04:07:24.622 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T04:07:24.622 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-pool-create 2024-09-16T04:07:24.623 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T04:07:24.623 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:07:24.624 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T04:07:24.624 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.128966 2024-09-16T04:07:24.624 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T04:07:24.625 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T04:07:24.625 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-pool-create 2024-09-16T04:07:24.626 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T04:07:24.626 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:07:24.626 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T04:07:24.626 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.128966 2024-09-16T04:07:24.628 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T04:07:24.629 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2024-09-16T04:07:24.629 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T04:07:24.629 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-pool-create 1' TERM HUP INT 2024-09-16T04:07:24.629 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:32: run: TEST_utf8_cli td/osd-pool-create 2024-09-16T04:07:24.629 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:197: TEST_utf8_cli: local dir=td/osd-pool-create 2024-09-16T04:07:24.629 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:198: TEST_utf8_cli: run_mon td/osd-pool-create a 2024-09-16T04:07:24.629 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-pool-create 2024-09-16T04:07:24.629 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T04:07:24.630 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T04:07:24.630 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T04:07:24.630 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-pool-create/a 2024-09-16T04:07:24.630 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-pool-create/a --run-dir=td/osd-pool-create 2024-09-16T04:07:25.142 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T04:07:25.142 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:07:25.142 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:07:25.143 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:07:25.143 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:07:25.143 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T04:07:25.143 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.128966/$cluster-$name.asok' 2024-09-16T04:07:25.143 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug_allow_any_pool_priority=true --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-pool-create/a '--log-file=td/osd-pool-create/$name.log' '--admin-socket=/tmp/ceph-asok.128966/$cluster-$name.asok' --mon-cluster-log-file=td/osd-pool-create/log --run-dir=td/osd-pool-create '--pid-file=td/osd-pool-create/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-09-16T04:07:25.363 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T04:07:25.364 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T04:07:25.364 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T04:07:25.364 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T04:07:25.364 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T04:07:25.365 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T04:07:25.365 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T04:07:25.365 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T04:07:25.365 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T04:07:25.365 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T04:07:25.365 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:07:25.366 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T04:07:25.366 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.128966/ceph-mon.a.asok 2024-09-16T04:07:25.366 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T04:07:25.366 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.128966/ceph-mon.a.asok config get fsid 2024-09-16T04:07:25.482 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T04:07:25.482 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T04:07:25.482 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T04:07:25.482 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T04:07:25.483 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T04:07:25.484 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T04:07:25.484 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T04:07:25.484 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T04:07:25.484 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T04:07:25.484 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:07:25.484 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T04:07:25.484 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.128966/ceph-mon.a.asok 2024-09-16T04:07:25.484 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T04:07:25.485 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.128966/ceph-mon.a.asok config get mon_host 2024-09-16T04:07:25.593 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:203: TEST_utf8_cli: OLDLANG=en_US 2024-09-16T04:07:25.594 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:204: TEST_utf8_cli: export LANG=en_US.UTF-8 2024-09-16T04:07:25.594 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:204: TEST_utf8_cli: LANG=en_US.UTF-8 2024-09-16T04:07:25.617 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:205: TEST_utf8_cli: ceph osd pool create 黄 16 2024-09-16T04:07:26.524 INFO:tasks.workunit.client.0.smithi096.stderr:pool '黄' already exists 2024-09-16T04:07:26.542 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:206: TEST_utf8_cli: ceph osd lspools 2024-09-16T04:07:26.542 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:207: TEST_utf8_cli: grep 黄 2024-09-16T04:07:26.797 INFO:tasks.workunit.client.0.smithi096.stdout:1 黄 2024-09-16T04:07:26.798 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:208: TEST_utf8_cli: ceph -f json-pretty osd dump 2024-09-16T04:07:26.798 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:209: TEST_utf8_cli: python3 -c 'import json; import sys; json.load(sys.stdin)' 2024-09-16T04:07:27.031 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:210: TEST_utf8_cli: ceph osd pool delete 黄 黄 --yes-i-really-really-mean-it 2024-09-16T04:07:27.359 INFO:tasks.workunit.client.0.smithi096.stderr:pool '黄' does not exist 2024-09-16T04:07:27.376 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:211: TEST_utf8_cli: export LANG=en_US 2024-09-16T04:07:27.376 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:211: TEST_utf8_cli: LANG=en_US 2024-09-16T04:07:27.376 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh:33: run: teardown td/osd-pool-create 2024-09-16T04:07:27.376 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-pool-create 2024-09-16T04:07:27.376 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T04:07:27.376 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-pool-create KILL 2024-09-16T04:07:27.377 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T04:07:27.377 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T04:07:27.377 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T04:07:27.377 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T04:07:27.377 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T04:07:27.483 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T04:07:27.483 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T04:07:27.484 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T04:07:27.485 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T04:07:27.486 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T04:07:27.487 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T04:07:27.487 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T04:07:27.488 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T04:07:27.489 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T04:07:27.489 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T04:07:27.489 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T04:07:27.490 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T04:07:27.491 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T04:07:27.491 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-pool-create 2024-09-16T04:07:27.493 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T04:07:27.493 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:07:27.493 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T04:07:27.494 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.128966 2024-09-16T04:07:27.495 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T04:07:27.495 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T04:07:27.495 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2322: main: code=0 2024-09-16T04:07:27.495 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2326: main: teardown td/osd-pool-create 0 2024-09-16T04:07:27.495 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-pool-create 2024-09-16T04:07:27.495 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2024-09-16T04:07:27.495 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-pool-create KILL 2024-09-16T04:07:27.495 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T04:07:27.496 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T04:07:27.496 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T04:07:27.496 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T04:07:27.496 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T04:07:27.498 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T04:07:27.498 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T04:07:27.499 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T04:07:27.500 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T04:07:27.500 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T04:07:27.500 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T04:07:27.501 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T04:07:27.501 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T04:07:27.502 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T04:07:27.502 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T04:07:27.502 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T04:07:27.503 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T04:07:27.504 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2024-09-16T04:07:27.504 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-pool-create 2024-09-16T04:07:27.505 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T04:07:27.505 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:07:27.506 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.128966 2024-09-16T04:07:27.506 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.128966 2024-09-16T04:07:27.506 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T04:07:27.506 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T04:07:27.507 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2327: main: return 0 2024-09-16T04:07:27.508 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-16T04:07:27.508 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-16T04:07:27.520 INFO:tasks.workunit:Running workunit mon/osd-pool-df.sh... 2024-09-16T04:07:27.520 DEBUG:teuthology.orchestra.run.smithi096:workunit test mon/osd-pool-df.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7498493279982dfe87f00616198a5967475f6169 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-df.sh 2024-09-16T04:07:27.573 INFO:tasks.workunit.client.0.smithi096.stderr:stty: 'standard input': Inappropriate ioctl for device 2024-09-16T04:07:27.578 INFO:tasks.workunit.client.0.smithi096.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2024-09-16T04:07:27.578 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2315: main: export PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-16T04:07:27.578 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2315: main: PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-16T04:07:27.578 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2316: main: export PYTHONWARNINGS=ignore 2024-09-16T04:07:27.579 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2316: main: PYTHONWARNINGS=ignore 2024-09-16T04:07:27.579 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2317: main: export CEPH_CONF=/dev/null 2024-09-16T04:07:27.579 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2317: main: CEPH_CONF=/dev/null 2024-09-16T04:07:27.579 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2318: main: unset CEPH_ARGS 2024-09-16T04:07:27.579 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2320: main: local code 2024-09-16T04:07:27.579 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2321: main: run td/osd-pool-df 2024-09-16T04:07:27.579 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-df.sh:20: run: local dir=td/osd-pool-df 2024-09-16T04:07:27.579 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-df.sh:21: run: shift 2024-09-16T04:07:27.579 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-df.sh:23: run: export CEPH_MON=127.0.0.1:7113 2024-09-16T04:07:27.579 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-df.sh:23: run: CEPH_MON=127.0.0.1:7113 2024-09-16T04:07:27.579 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-df.sh:24: run: export CEPH_ARGS 2024-09-16T04:07:27.579 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-df.sh:25: run: uuidgen 2024-09-16T04:07:27.580 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-df.sh:25: run: CEPH_ARGS+='--fsid=08441216-87d9-4ad7-867a-9e068a2a833e --auth-supported=none ' 2024-09-16T04:07:27.580 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-df.sh:26: run: CEPH_ARGS+='--mon-host=127.0.0.1:7113 ' 2024-09-16T04:07:27.580 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-df.sh:28: run: set 2024-09-16T04:07:27.580 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-df.sh:28: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2024-09-16T04:07:27.582 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-df.sh:28: run: local funcs=TEST_ceph_df 2024-09-16T04:07:27.582 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-df.sh:29: run: for func in $funcs 2024-09-16T04:07:27.583 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-df.sh:30: run: setup td/osd-pool-df 2024-09-16T04:07:27.583 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-pool-df 2024-09-16T04:07:27.583 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-pool-df 2024-09-16T04:07:27.583 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-pool-df 2024-09-16T04:07:27.583 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T04:07:27.583 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-pool-df KILL 2024-09-16T04:07:27.583 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T04:07:27.583 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T04:07:27.583 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T04:07:27.583 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T04:07:27.583 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T04:07:27.584 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T04:07:27.585 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T04:07:27.586 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T04:07:27.586 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T04:07:27.587 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T04:07:27.587 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T04:07:27.587 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T04:07:27.588 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T04:07:27.588 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T04:07:27.589 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T04:07:27.589 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T04:07:27.590 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T04:07:27.591 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T04:07:27.591 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-pool-df 2024-09-16T04:07:27.592 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T04:07:27.592 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:07:27.592 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.177369 2024-09-16T04:07:27.593 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.177369 2024-09-16T04:07:27.593 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T04:07:27.593 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T04:07:27.594 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-pool-df 2024-09-16T04:07:27.595 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T04:07:27.595 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:07:27.595 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.177369 2024-09-16T04:07:27.595 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.177369 2024-09-16T04:07:27.596 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T04:07:27.598 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2024-09-16T04:07:27.598 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2024-09-16T04:07:27.598 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T04:07:27.598 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-pool-df 1' TERM HUP INT 2024-09-16T04:07:27.598 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-df.sh:31: run: TEST_ceph_df td/osd-pool-df 2024-09-16T04:07:27.599 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-df.sh:37: TEST_ceph_df: local dir=td/osd-pool-df 2024-09-16T04:07:27.599 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-df.sh:38: TEST_ceph_df: setup td/osd-pool-df 2024-09-16T04:07:27.599 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-pool-df 2024-09-16T04:07:27.599 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-pool-df 2024-09-16T04:07:27.599 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-pool-df 2024-09-16T04:07:27.599 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T04:07:27.599 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-pool-df KILL 2024-09-16T04:07:27.599 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T04:07:27.599 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T04:07:27.599 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T04:07:27.599 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T04:07:27.599 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T04:07:27.600 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T04:07:27.600 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T04:07:27.601 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T04:07:27.601 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T04:07:27.602 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T04:07:27.602 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T04:07:27.603 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T04:07:27.604 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T04:07:27.604 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T04:07:27.604 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T04:07:27.604 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T04:07:27.605 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T04:07:27.606 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T04:07:27.606 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-pool-df 2024-09-16T04:07:27.608 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T04:07:27.608 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:07:27.608 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.177369 2024-09-16T04:07:27.608 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.177369 2024-09-16T04:07:27.609 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T04:07:27.609 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T04:07:27.609 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-pool-df 2024-09-16T04:07:27.610 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T04:07:27.611 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:07:27.611 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.177369 2024-09-16T04:07:27.611 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.177369 2024-09-16T04:07:27.612 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T04:07:27.613 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2024-09-16T04:07:27.613 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T04:07:27.613 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-pool-df 1' TERM HUP INT 2024-09-16T04:07:27.613 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-df.sh:40: TEST_ceph_df: run_mon td/osd-pool-df a 2024-09-16T04:07:27.613 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-pool-df 2024-09-16T04:07:27.613 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T04:07:27.613 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T04:07:27.614 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T04:07:27.614 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-pool-df/a 2024-09-16T04:07:27.614 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-pool-df/a --run-dir=td/osd-pool-df 2024-09-16T04:07:28.078 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T04:07:28.078 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:07:28.078 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:07:28.079 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:07:28.079 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:07:28.079 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.177369 2024-09-16T04:07:28.079 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.177369/$cluster-$name.asok' 2024-09-16T04:07:28.079 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-pool-df/a '--log-file=td/osd-pool-df/$name.log' '--admin-socket=/tmp/ceph-asok.177369/$cluster-$name.asok' --mon-cluster-log-file=td/osd-pool-df/log --run-dir=td/osd-pool-df '--pid-file=td/osd-pool-df/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-09-16T04:07:28.290 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T04:07:28.291 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T04:07:28.291 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T04:07:28.291 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T04:07:28.291 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T04:07:28.292 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T04:07:28.292 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T04:07:28.292 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T04:07:28.292 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T04:07:28.292 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T04:07:28.292 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:07:28.292 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.177369 2024-09-16T04:07:28.293 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.177369/ceph-mon.a.asok 2024-09-16T04:07:28.293 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T04:07:28.293 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.177369/ceph-mon.a.asok config get fsid 2024-09-16T04:07:28.408 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T04:07:28.409 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T04:07:28.409 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T04:07:28.409 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T04:07:28.410 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T04:07:28.410 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T04:07:28.410 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T04:07:28.410 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T04:07:28.410 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T04:07:28.410 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:07:28.410 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.177369 2024-09-16T04:07:28.410 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.177369/ceph-mon.a.asok 2024-09-16T04:07:28.410 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T04:07:28.410 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.177369/ceph-mon.a.asok config get mon_host 2024-09-16T04:07:28.522 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-df.sh:41: TEST_ceph_df: run_osd td/osd-pool-df 0 2024-09-16T04:07:28.522 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-pool-df 2024-09-16T04:07:28.522 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T04:07:28.522 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2024-09-16T04:07:28.523 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T04:07:28.523 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-pool-df/0 2024-09-16T04:07:28.523 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=08441216-87d9-4ad7-867a-9e068a2a833e --auth-supported=none --mon-host=127.0.0.1:7113 ' 2024-09-16T04:07:28.523 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T04:07:28.523 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T04:07:28.523 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T04:07:28.523 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-pool-df/0' 2024-09-16T04:07:28.523 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-pool-df/0/journal' 2024-09-16T04:07:28.523 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T04:07:28.523 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T04:07:28.523 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-pool-df' 2024-09-16T04:07:28.523 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T04:07:28.523 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:07:28.524 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:07:28.525 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:07:28.525 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:07:28.525 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.177369 2024-09-16T04:07:28.525 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.177369/$cluster-$name.asok' 2024-09-16T04:07:28.526 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.177369/$cluster-$name.asok' 2024-09-16T04:07:28.526 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T04:07:28.526 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T04:07:28.526 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T04:07:28.526 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-pool-df/$name.log' 2024-09-16T04:07:28.526 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-pool-df/$name.pid' 2024-09-16T04:07:28.526 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T04:07:28.526 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T04:07:28.526 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T04:07:28.527 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T04:07:28.527 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T04:07:28.527 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T04:07:28.527 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-pool-df/0 2024-09-16T04:07:28.527 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T04:07:28.527 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=49a56d3f-c7f6-4ea0-90b6-09e33754ee3f 2024-09-16T04:07:28.527 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 49a56d3f-c7f6-4ea0-90b6-09e33754ee3f' 2024-09-16T04:07:28.528 INFO:tasks.workunit.client.0.smithi096.stdout:add osd0 49a56d3f-c7f6-4ea0-90b6-09e33754ee3f 2024-09-16T04:07:28.528 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T04:07:28.547 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAAr+dmTqOSIBAAAtKKTBkF35N7JbKL+wkvFA== 2024-09-16T04:07:28.547 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAAr+dmTqOSIBAAAtKKTBkF35N7JbKL+wkvFA=="}' 2024-09-16T04:07:28.547 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 49a56d3f-c7f6-4ea0-90b6-09e33754ee3f -i td/osd-pool-df/0/new.json 2024-09-16T04:07:29.451 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T04:07:29.466 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-pool-df/0/new.json 2024-09-16T04:07:29.468 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=08441216-87d9-4ad7-867a-9e068a2a833e --auth-supported=none --mon-host=127.0.0.1:7113 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-pool-df/0 --osd-journal=td/osd-pool-df/0/journal --chdir= --run-dir=td/osd-pool-df '--admin-socket=/tmp/ceph-asok.177369/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-pool-df/$name.log' '--pid-file=td/osd-pool-df/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAAr+dmTqOSIBAAAtKKTBkF35N7JbKL+wkvFA== --osd-uuid 49a56d3f-c7f6-4ea0-90b6-09e33754ee3f 2024-09-16T04:07:29.501 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:07:29.498+0000 7f7ab2fea7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:07:29.528 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:07:29.526+0000 7f7ab2fea7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:07:29.530 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:07:29.530+0000 7f7ab2fea7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:07:29.530 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:07:29.530+0000 7f7ab2fea7c0 -1 bdev(0x558b0b8d5c00 td/osd-pool-df/0/block) open stat got: (1) Operation not permitted 2024-09-16T04:07:29.530 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:07:29.530+0000 7f7ab2fea7c0 -1 bluestore(td/osd-pool-df/0) _read_fsid unparsable uuid 2024-09-16T04:07:35.800 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-pool-df/0/keyring 2024-09-16T04:07:35.800 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T04:07:35.802 INFO:tasks.workunit.client.0.smithi096.stdout:adding osd0 key to auth repository 2024-09-16T04:07:35.802 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2024-09-16T04:07:35.802 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-pool-df/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T04:07:36.043 INFO:tasks.workunit.client.0.smithi096.stdout:start osd.0 2024-09-16T04:07:36.044 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2024-09-16T04:07:36.044 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T04:07:36.044 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T04:07:36.044 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=08441216-87d9-4ad7-867a-9e068a2a833e --auth-supported=none --mon-host=127.0.0.1:7113 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-pool-df/0 --osd-journal=td/osd-pool-df/0/journal --chdir= --run-dir=td/osd-pool-df '--admin-socket=/tmp/ceph-asok.177369/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-pool-df/$name.log' '--pid-file=td/osd-pool-df/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T04:07:36.044 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T04:07:36.073 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:07:36.070+0000 7f14a73477c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:07:36.077 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:07:36.074+0000 7f14a73477c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:07:36.078 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:07:36.078+0000 7f14a73477c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:07:36.264 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2024-09-16T04:07:36.264 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T04:07:36.264 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2024-09-16T04:07:36.264 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T04:07:36.264 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T04:07:36.264 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:07:36.264 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T04:07:36.265 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T04:07:36.265 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:07:36.265 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:07:36.482 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:07:37.317 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:07:37.313+0000 7f14a73477c0 -1 Falling back to public interface 2024-09-16T04:07:37.484 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:07:37.484 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:07:37.484 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T04:07:37.485 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T04:07:37.485 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:07:37.485 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:07:37.719 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:07:38.721 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:07:38.721 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:07:38.721 INFO:tasks.workunit.client.0.smithi096.stdout:2 2024-09-16T04:07:38.722 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T04:07:38.722 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:07:38.722 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:07:38.948 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:07:39.950 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:07:39.950 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:07:39.951 INFO:tasks.workunit.client.0.smithi096.stdout:3 2024-09-16T04:07:39.951 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T04:07:39.951 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:07:39.951 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:07:40.069 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:07:40.065+0000 7f14a73477c0 -1 osd.0 0 log_to_monitors true 2024-09-16T04:07:40.291 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:07:41.293 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:07:41.294 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:07:41.294 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T04:07:41.294 INFO:tasks.workunit.client.0.smithi096.stdout:4 2024-09-16T04:07:41.294 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:07:41.294 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:07:41.529 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:07:42.530 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:07:42.531 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:07:42.531 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T04:07:42.531 INFO:tasks.workunit.client.0.smithi096.stdout:5 2024-09-16T04:07:42.531 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:07:42.531 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:07:42.765 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:07:43.767 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:07:43.767 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:07:43.767 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T04:07:43.768 INFO:tasks.workunit.client.0.smithi096.stdout:6 2024-09-16T04:07:43.768 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:07:43.768 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:07:44.003 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:07:45.005 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:07:45.005 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:07:45.005 INFO:tasks.workunit.client.0.smithi096.stdout:7 2024-09-16T04:07:45.006 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T04:07:45.006 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:07:45.006 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:07:45.247 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:07:46.248 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:07:46.249 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:07:46.249 INFO:tasks.workunit.client.0.smithi096.stdout:8 2024-09-16T04:07:46.250 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T04:07:46.250 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:07:46.250 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:07:46.486 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:07:47.488 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:07:47.488 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:07:47.488 INFO:tasks.workunit.client.0.smithi096.stdout:9 2024-09-16T04:07:47.488 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T04:07:47.489 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:07:47.489 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:07:47.717 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:07:48.719 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:07:48.719 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:07:48.719 INFO:tasks.workunit.client.0.smithi096.stdout:10 2024-09-16T04:07:48.720 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T04:07:48.720 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:07:48.720 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:07:48.961 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:07:49.963 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:07:49.963 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:07:49.964 INFO:tasks.workunit.client.0.smithi096.stdout:11 2024-09-16T04:07:49.964 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T04:07:49.965 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:07:49.965 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:07:50.199 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:07:51.201 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:07:51.201 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:07:51.201 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T04:07:51.202 INFO:tasks.workunit.client.0.smithi096.stdout:12 2024-09-16T04:07:51.202 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:07:51.202 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:07:51.437 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:07:52.439 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:07:52.439 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:07:52.439 INFO:tasks.workunit.client.0.smithi096.stdout:13 2024-09-16T04:07:52.440 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T04:07:52.440 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:07:52.440 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:07:52.679 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:07:53.681 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:07:53.682 INFO:tasks.workunit.client.0.smithi096.stdout:14 2024-09-16T04:07:53.682 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:07:53.682 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T04:07:53.682 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:07:53.682 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:07:53.916 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:07:54.917 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:07:54.917 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:07:54.918 INFO:tasks.workunit.client.0.smithi096.stdout:15 2024-09-16T04:07:54.918 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T04:07:54.918 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:07:54.918 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:07:55.141 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:07:56.142 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:07:56.143 INFO:tasks.workunit.client.0.smithi096.stdout:16 2024-09-16T04:07:56.143 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:07:56.143 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T04:07:56.143 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:07:56.143 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:07:56.375 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:07:57.377 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:07:57.377 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:07:57.378 INFO:tasks.workunit.client.0.smithi096.stdout:17 2024-09-16T04:07:57.378 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T04:07:57.379 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:07:57.379 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:07:57.607 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:07:58.609 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:07:58.609 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:07:58.609 INFO:tasks.workunit.client.0.smithi096.stdout:18 2024-09-16T04:07:58.610 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 18 2024-09-16T04:07:58.610 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:07:58.610 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:07:58.847 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:07:59.849 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:07:59.849 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:07:59.850 INFO:tasks.workunit.client.0.smithi096.stdout:19 2024-09-16T04:07:59.850 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 19 2024-09-16T04:07:59.850 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:07:59.850 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:08:00.082 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:08:01.084 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:08:01.084 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:08:01.084 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 20 2024-09-16T04:08:01.084 INFO:tasks.workunit.client.0.smithi096.stdout:20 2024-09-16T04:08:01.085 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:08:01.085 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:08:01.319 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:08:02.320 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:08:02.320 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:08:02.321 INFO:tasks.workunit.client.0.smithi096.stdout:21 2024-09-16T04:08:02.321 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 21 2024-09-16T04:08:02.321 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:08:02.321 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:08:02.587 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:08:03.589 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:08:03.589 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:08:03.589 INFO:tasks.workunit.client.0.smithi096.stdout:22 2024-09-16T04:08:03.590 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 22 2024-09-16T04:08:03.590 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:08:03.590 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:08:03.824 INFO:tasks.workunit.client.0.smithi096.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/615999446,v1:127.0.0.1:6801/615999446] [v2:127.0.0.1:6802/615999446,v1:127.0.0.1:6803/615999446] exists,up 49a56d3f-c7f6-4ea0-90b6-09e33754ee3f 2024-09-16T04:08:03.827 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T04:08:03.827 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T04:08:03.828 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T04:08:03.828 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-df.sh:42: TEST_ceph_df: run_osd td/osd-pool-df 1 2024-09-16T04:08:03.828 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-pool-df 2024-09-16T04:08:03.828 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T04:08:03.828 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2024-09-16T04:08:03.828 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T04:08:03.828 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-pool-df/1 2024-09-16T04:08:03.828 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=08441216-87d9-4ad7-867a-9e068a2a833e --auth-supported=none --mon-host=127.0.0.1:7113 ' 2024-09-16T04:08:03.828 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T04:08:03.828 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T04:08:03.828 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T04:08:03.828 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-pool-df/1' 2024-09-16T04:08:03.829 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-pool-df/1/journal' 2024-09-16T04:08:03.829 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T04:08:03.829 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T04:08:03.829 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-pool-df' 2024-09-16T04:08:03.829 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T04:08:03.829 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:08:03.829 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:08:03.829 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:08:03.829 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:08:03.829 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.177369 2024-09-16T04:08:03.829 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.177369/$cluster-$name.asok' 2024-09-16T04:08:03.829 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.177369/$cluster-$name.asok' 2024-09-16T04:08:03.830 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T04:08:03.830 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T04:08:03.830 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T04:08:03.830 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-pool-df/$name.log' 2024-09-16T04:08:03.830 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-pool-df/$name.pid' 2024-09-16T04:08:03.830 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T04:08:03.830 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T04:08:03.830 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T04:08:03.830 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T04:08:03.830 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T04:08:03.830 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T04:08:03.830 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-pool-df/1 2024-09-16T04:08:03.830 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T04:08:03.831 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=b82548dc-5394-40f8-b439-22f4d71d8ff6 2024-09-16T04:08:03.831 INFO:tasks.workunit.client.0.smithi096.stdout:add osd1 b82548dc-5394-40f8-b439-22f4d71d8ff6 2024-09-16T04:08:03.831 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 b82548dc-5394-40f8-b439-22f4d71d8ff6' 2024-09-16T04:08:03.831 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T04:08:03.851 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAjr+dmPVipMhAAT/GzQlTwYAzuYWZbqDXPzA== 2024-09-16T04:08:03.851 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAjr+dmPVipMhAAT/GzQlTwYAzuYWZbqDXPzA=="}' 2024-09-16T04:08:03.851 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new b82548dc-5394-40f8-b439-22f4d71d8ff6 -i td/osd-pool-df/1/new.json 2024-09-16T04:08:04.317 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T04:08:04.335 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-pool-df/1/new.json 2024-09-16T04:08:04.336 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=08441216-87d9-4ad7-867a-9e068a2a833e --auth-supported=none --mon-host=127.0.0.1:7113 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-pool-df/1 --osd-journal=td/osd-pool-df/1/journal --chdir= --run-dir=td/osd-pool-df '--admin-socket=/tmp/ceph-asok.177369/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-pool-df/$name.log' '--pid-file=td/osd-pool-df/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAjr+dmPVipMhAAT/GzQlTwYAzuYWZbqDXPzA== --osd-uuid b82548dc-5394-40f8-b439-22f4d71d8ff6 2024-09-16T04:08:04.369 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:08:04.365+0000 7fe09a4b87c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:08:04.407 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:08:04.405+0000 7fe09a4b87c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:08:04.409 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:08:04.405+0000 7fe09a4b87c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:08:04.410 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:08:04.409+0000 7fe09a4b87c0 -1 bdev(0x55cdc3697c00 td/osd-pool-df/1/block) open stat got: (1) Operation not permitted 2024-09-16T04:08:04.410 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:08:04.409+0000 7fe09a4b87c0 -1 bluestore(td/osd-pool-df/1) _read_fsid unparsable uuid 2024-09-16T04:08:10.581 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-pool-df/1/keyring 2024-09-16T04:08:10.581 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T04:08:10.583 INFO:tasks.workunit.client.0.smithi096.stdout:adding osd1 key to auth repository 2024-09-16T04:08:10.583 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2024-09-16T04:08:10.583 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-pool-df/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T04:08:10.823 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2024-09-16T04:08:10.823 INFO:tasks.workunit.client.0.smithi096.stdout:start osd.1 2024-09-16T04:08:10.824 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T04:08:10.824 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=08441216-87d9-4ad7-867a-9e068a2a833e --auth-supported=none --mon-host=127.0.0.1:7113 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-pool-df/1 --osd-journal=td/osd-pool-df/1/journal --chdir= --run-dir=td/osd-pool-df '--admin-socket=/tmp/ceph-asok.177369/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-pool-df/$name.log' '--pid-file=td/osd-pool-df/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T04:08:10.824 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T04:08:10.825 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T04:08:10.854 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:08:10.853+0000 7fe1ef6177c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:08:10.856 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:08:10.853+0000 7fe1ef6177c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:08:10.857 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:08:10.853+0000 7fe1ef6177c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:08:11.052 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2024-09-16T04:08:11.052 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T04:08:11.052 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2024-09-16T04:08:11.052 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T04:08:11.052 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T04:08:11.053 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:08:11.053 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T04:08:11.053 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T04:08:11.053 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:08:11.053 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:08:11.279 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:08:12.280 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:08:12.280 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:08:12.280 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T04:08:12.281 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T04:08:12.281 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:08:12.281 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:08:12.388 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:08:12.385+0000 7fe1ef6177c0 -1 Falling back to public interface 2024-09-16T04:08:12.503 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:08:13.504 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:08:13.504 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:08:13.504 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T04:08:13.505 INFO:tasks.workunit.client.0.smithi096.stdout:2 2024-09-16T04:08:13.505 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:08:13.505 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:08:13.733 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:08:14.735 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:08:14.735 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:08:14.735 INFO:tasks.workunit.client.0.smithi096.stdout:3 2024-09-16T04:08:14.736 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T04:08:14.736 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:08:14.736 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:08:14.973 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:08:15.222 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:08:15.221+0000 7fe1ef6177c0 -1 osd.1 0 log_to_monitors true 2024-09-16T04:08:15.974 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:08:15.975 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:08:15.975 INFO:tasks.workunit.client.0.smithi096.stdout:4 2024-09-16T04:08:15.975 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T04:08:15.976 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:08:15.976 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:08:16.362 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:08:17.364 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:08:17.364 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:08:17.364 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T04:08:17.365 INFO:tasks.workunit.client.0.smithi096.stdout:5 2024-09-16T04:08:17.365 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:08:17.365 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:08:17.600 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:08:18.602 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:08:18.603 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:08:18.603 INFO:tasks.workunit.client.0.smithi096.stdout:6 2024-09-16T04:08:18.603 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T04:08:18.603 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:08:18.604 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:08:18.839 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:08:19.841 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:08:19.841 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:08:19.841 INFO:tasks.workunit.client.0.smithi096.stdout:7 2024-09-16T04:08:19.842 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T04:08:19.842 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:08:19.842 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:08:20.078 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:08:21.080 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:08:21.081 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:08:21.081 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T04:08:21.081 INFO:tasks.workunit.client.0.smithi096.stdout:8 2024-09-16T04:08:21.082 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:08:21.082 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:08:21.322 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:08:22.324 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:08:22.324 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:08:22.325 INFO:tasks.workunit.client.0.smithi096.stdout:9 2024-09-16T04:08:22.325 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T04:08:22.326 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:08:22.326 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:08:22.559 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:08:23.561 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:08:23.561 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:08:23.561 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T04:08:23.561 INFO:tasks.workunit.client.0.smithi096.stdout:10 2024-09-16T04:08:23.562 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:08:23.562 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:08:23.800 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:08:24.803 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:08:24.803 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:08:24.803 INFO:tasks.workunit.client.0.smithi096.stdout:11 2024-09-16T04:08:24.803 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T04:08:24.804 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:08:24.804 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:08:25.040 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:08:26.042 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:08:26.042 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:08:26.043 INFO:tasks.workunit.client.0.smithi096.stdout:12 2024-09-16T04:08:26.043 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T04:08:26.044 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:08:26.044 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:08:26.279 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:08:27.280 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:08:27.280 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:08:27.281 INFO:tasks.workunit.client.0.smithi096.stdout:13 2024-09-16T04:08:27.281 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T04:08:27.281 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:08:27.281 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:08:27.514 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:08:28.515 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:08:28.516 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:08:28.516 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T04:08:28.516 INFO:tasks.workunit.client.0.smithi096.stdout:14 2024-09-16T04:08:28.516 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:08:28.516 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:08:28.752 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:08:29.754 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:08:29.754 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:08:29.754 INFO:tasks.workunit.client.0.smithi096.stdout:15 2024-09-16T04:08:29.755 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T04:08:29.755 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:08:29.755 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:08:29.990 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:08:30.992 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:08:30.992 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:08:30.992 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T04:08:30.993 INFO:tasks.workunit.client.0.smithi096.stdout:16 2024-09-16T04:08:30.993 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:08:30.993 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:08:31.234 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:08:32.235 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:08:32.235 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:08:32.236 INFO:tasks.workunit.client.0.smithi096.stdout:17 2024-09-16T04:08:32.237 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T04:08:32.237 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:08:32.237 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:08:32.471 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:08:33.473 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:08:33.474 INFO:tasks.workunit.client.0.smithi096.stdout:18 2024-09-16T04:08:33.474 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:08:33.474 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 18 2024-09-16T04:08:33.474 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:08:33.474 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:08:33.707 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:08:34.709 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:08:34.709 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:08:34.709 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 19 2024-09-16T04:08:34.710 INFO:tasks.workunit.client.0.smithi096.stdout:19 2024-09-16T04:08:34.710 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:08:34.711 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:08:34.950 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:08:35.953 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:08:35.953 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:08:35.953 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 20 2024-09-16T04:08:35.953 INFO:tasks.workunit.client.0.smithi096.stdout:20 2024-09-16T04:08:35.954 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:08:35.954 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:08:36.190 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:08:37.191 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:08:37.191 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:08:37.191 INFO:tasks.workunit.client.0.smithi096.stdout:21 2024-09-16T04:08:37.192 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 21 2024-09-16T04:08:37.192 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:08:37.192 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:08:37.427 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:08:38.429 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:08:38.429 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:08:38.429 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 22 2024-09-16T04:08:38.429 INFO:tasks.workunit.client.0.smithi096.stdout:22 2024-09-16T04:08:38.430 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:08:38.430 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:08:38.669 INFO:tasks.workunit.client.0.smithi096.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6808/4068588042,v1:127.0.0.1:6809/4068588042] [v2:127.0.0.1:6810/4068588042,v1:127.0.0.1:6811/4068588042] exists,up b82548dc-5394-40f8-b439-22f4d71d8ff6 2024-09-16T04:08:38.672 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T04:08:38.672 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T04:08:38.673 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T04:08:38.673 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-df.sh:43: TEST_ceph_df: run_osd td/osd-pool-df 2 2024-09-16T04:08:38.673 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-pool-df 2024-09-16T04:08:38.673 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T04:08:38.673 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2024-09-16T04:08:38.673 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T04:08:38.673 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-pool-df/2 2024-09-16T04:08:38.673 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=08441216-87d9-4ad7-867a-9e068a2a833e --auth-supported=none --mon-host=127.0.0.1:7113 ' 2024-09-16T04:08:38.673 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T04:08:38.674 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T04:08:38.674 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T04:08:38.674 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-pool-df/2' 2024-09-16T04:08:38.674 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-pool-df/2/journal' 2024-09-16T04:08:38.674 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T04:08:38.674 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T04:08:38.674 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-pool-df' 2024-09-16T04:08:38.674 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T04:08:38.674 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:08:38.674 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:08:38.675 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:08:38.675 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:08:38.675 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.177369 2024-09-16T04:08:38.675 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.177369/$cluster-$name.asok' 2024-09-16T04:08:38.675 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.177369/$cluster-$name.asok' 2024-09-16T04:08:38.675 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T04:08:38.675 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T04:08:38.675 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T04:08:38.675 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-pool-df/$name.log' 2024-09-16T04:08:38.675 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-pool-df/$name.pid' 2024-09-16T04:08:38.675 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T04:08:38.676 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T04:08:38.676 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T04:08:38.676 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T04:08:38.676 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T04:08:38.676 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T04:08:38.676 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-pool-df/2 2024-09-16T04:08:38.677 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T04:08:38.677 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=8c342c7d-5073-4b1a-9221-2a24fa552c0d 2024-09-16T04:08:38.677 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 8c342c7d-5073-4b1a-9221-2a24fa552c0d' 2024-09-16T04:08:38.677 INFO:tasks.workunit.client.0.smithi096.stdout:add osd2 8c342c7d-5073-4b1a-9221-2a24fa552c0d 2024-09-16T04:08:38.677 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T04:08:38.695 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBGr+dmK5NnKRAAgD/M5fPm1//gG7G0t87yRw== 2024-09-16T04:08:38.695 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBGr+dmK5NnKRAAgD/M5fPm1//gG7G0t87yRw=="}' 2024-09-16T04:08:38.695 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 8c342c7d-5073-4b1a-9221-2a24fa552c0d -i td/osd-pool-df/2/new.json 2024-09-16T04:08:39.026 INFO:tasks.workunit.client.0.smithi096.stdout:2 2024-09-16T04:08:39.043 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-pool-df/2/new.json 2024-09-16T04:08:39.045 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=08441216-87d9-4ad7-867a-9e068a2a833e --auth-supported=none --mon-host=127.0.0.1:7113 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-pool-df/2 --osd-journal=td/osd-pool-df/2/journal --chdir= --run-dir=td/osd-pool-df '--admin-socket=/tmp/ceph-asok.177369/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-pool-df/$name.log' '--pid-file=td/osd-pool-df/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBGr+dmK5NnKRAAgD/M5fPm1//gG7G0t87yRw== --osd-uuid 8c342c7d-5073-4b1a-9221-2a24fa552c0d 2024-09-16T04:08:39.072 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:08:39.068+0000 7f6b3c8737c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:08:39.113 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:08:39.108+0000 7f6b3c8737c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:08:39.115 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:08:39.112+0000 7f6b3c8737c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:08:39.115 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:08:39.112+0000 7f6b3c8737c0 -1 bdev(0x5641847d4800 td/osd-pool-df/2/block) open stat got: (1) Operation not permitted 2024-09-16T04:08:39.115 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:08:39.112+0000 7f6b3c8737c0 -1 bluestore(td/osd-pool-df/2) _read_fsid unparsable uuid 2024-09-16T04:08:45.639 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-pool-df/2/keyring 2024-09-16T04:08:45.639 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T04:08:45.641 INFO:tasks.workunit.client.0.smithi096.stdout:adding osd2 key to auth repository 2024-09-16T04:08:45.641 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2024-09-16T04:08:45.641 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-pool-df/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T04:08:45.883 INFO:tasks.workunit.client.0.smithi096.stdout:start osd.2 2024-09-16T04:08:45.884 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2024-09-16T04:08:45.884 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=08441216-87d9-4ad7-867a-9e068a2a833e --auth-supported=none --mon-host=127.0.0.1:7113 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-pool-df/2 --osd-journal=td/osd-pool-df/2/journal --chdir= --run-dir=td/osd-pool-df '--admin-socket=/tmp/ceph-asok.177369/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-pool-df/$name.log' '--pid-file=td/osd-pool-df/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T04:08:45.886 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T04:08:45.886 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T04:08:45.886 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T04:08:45.913 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:08:45.908+0000 7f44bc3307c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:08:45.915 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:08:45.912+0000 7f44bc3307c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:08:45.916 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:08:45.912+0000 7f44bc3307c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:08:46.119 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2024-09-16T04:08:46.119 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T04:08:46.119 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2024-09-16T04:08:46.119 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T04:08:46.119 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T04:08:46.119 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:08:46.119 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T04:08:46.120 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T04:08:46.120 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:08:46.120 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:08:46.348 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:08:46.996 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:08:46.992+0000 7f44bc3307c0 -1 Falling back to public interface 2024-09-16T04:08:47.350 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:08:47.350 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:08:47.350 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T04:08:47.351 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T04:08:47.351 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:08:47.351 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:08:47.587 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:08:48.588 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:08:48.588 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:08:48.589 INFO:tasks.workunit.client.0.smithi096.stdout:2 2024-09-16T04:08:48.589 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T04:08:48.589 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:08:48.590 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:08:48.823 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:08:49.825 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:08:49.826 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:08:49.826 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T04:08:49.826 INFO:tasks.workunit.client.0.smithi096.stdout:3 2024-09-16T04:08:49.826 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:08:49.827 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:08:49.979 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:08:49.976+0000 7f44bc3307c0 -1 osd.2 0 log_to_monitors true 2024-09-16T04:08:50.091 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:08:51.093 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:08:51.093 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:08:51.093 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T04:08:51.094 INFO:tasks.workunit.client.0.smithi096.stdout:4 2024-09-16T04:08:51.094 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:08:51.094 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:08:51.328 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:08:52.330 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:08:52.330 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:08:52.330 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T04:08:52.330 INFO:tasks.workunit.client.0.smithi096.stdout:5 2024-09-16T04:08:52.331 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:08:52.331 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:08:52.569 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:08:53.571 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:08:53.571 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:08:53.571 INFO:tasks.workunit.client.0.smithi096.stdout:6 2024-09-16T04:08:53.572 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T04:08:53.572 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:08:53.572 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:08:53.806 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:08:54.808 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:08:54.808 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:08:54.808 INFO:tasks.workunit.client.0.smithi096.stdout:7 2024-09-16T04:08:54.809 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T04:08:54.809 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:08:54.809 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:08:55.044 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:08:56.044 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:08:56.044 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:08:56.045 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T04:08:56.045 INFO:tasks.workunit.client.0.smithi096.stdout:8 2024-09-16T04:08:56.045 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:08:56.045 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:08:56.278 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:08:57.280 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:08:57.280 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:08:57.280 INFO:tasks.workunit.client.0.smithi096.stdout:9 2024-09-16T04:08:57.280 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T04:08:57.281 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:08:57.281 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:08:57.516 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:08:58.517 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:08:58.517 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:08:58.518 INFO:tasks.workunit.client.0.smithi096.stdout:10 2024-09-16T04:08:58.518 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T04:08:58.518 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:08:58.518 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:08:58.755 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:08:59.757 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:08:59.757 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:08:59.757 INFO:tasks.workunit.client.0.smithi096.stdout:11 2024-09-16T04:08:59.758 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T04:08:59.758 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:08:59.758 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:08:59.990 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:09:00.992 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:09:00.992 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:09:00.992 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T04:09:00.992 INFO:tasks.workunit.client.0.smithi096.stdout:12 2024-09-16T04:09:00.993 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:09:00.993 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:09:01.233 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:09:02.234 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:09:02.234 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:09:02.235 INFO:tasks.workunit.client.0.smithi096.stdout:13 2024-09-16T04:09:02.235 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T04:09:02.235 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:09:02.235 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:09:02.475 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:09:03.478 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:09:03.478 INFO:tasks.workunit.client.0.smithi096.stdout:14 2024-09-16T04:09:03.479 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:09:03.479 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T04:09:03.479 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:09:03.480 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:09:03.706 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:09:04.708 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:09:04.708 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:09:04.708 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T04:09:04.709 INFO:tasks.workunit.client.0.smithi096.stdout:15 2024-09-16T04:09:04.709 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:09:04.709 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:09:04.949 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:09:05.951 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:09:05.951 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:09:05.951 INFO:tasks.workunit.client.0.smithi096.stdout:16 2024-09-16T04:09:05.951 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T04:09:05.952 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:09:05.952 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:09:06.189 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:09:07.190 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:09:07.190 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:09:07.190 INFO:tasks.workunit.client.0.smithi096.stdout:17 2024-09-16T04:09:07.191 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T04:09:07.191 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:09:07.191 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:09:07.427 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:09:08.429 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:09:08.429 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:09:08.430 INFO:tasks.workunit.client.0.smithi096.stdout:18 2024-09-16T04:09:08.430 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 18 2024-09-16T04:09:08.430 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:09:08.430 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:09:08.660 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:09:09.661 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:09:09.662 INFO:tasks.workunit.client.0.smithi096.stdout:19 2024-09-16T04:09:09.662 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:09:09.662 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 19 2024-09-16T04:09:09.662 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:09:09.662 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:09:09.899 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:09:10.901 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:09:10.901 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:09:10.902 INFO:tasks.workunit.client.0.smithi096.stdout:20 2024-09-16T04:09:10.902 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 20 2024-09-16T04:09:10.902 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:09:10.902 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:09:11.139 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:09:12.142 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:09:12.142 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:09:12.142 INFO:tasks.workunit.client.0.smithi096.stdout:21 2024-09-16T04:09:12.143 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 21 2024-09-16T04:09:12.143 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:09:12.143 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:09:12.420 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:09:13.422 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:09:13.422 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:09:13.422 INFO:tasks.workunit.client.0.smithi096.stdout:22 2024-09-16T04:09:13.423 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 22 2024-09-16T04:09:13.423 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:09:13.423 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:09:13.656 INFO:tasks.workunit.client.0.smithi096.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6816/1811985254,v1:127.0.0.1:6817/1811985254] [v2:127.0.0.1:6818/1811985254,v1:127.0.0.1:6819/1811985254] exists,up 8c342c7d-5073-4b1a-9221-2a24fa552c0d 2024-09-16T04:09:13.658 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T04:09:13.658 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T04:09:13.659 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T04:09:13.659 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-df.sh:44: TEST_ceph_df: run_osd td/osd-pool-df 3 2024-09-16T04:09:13.659 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-pool-df 2024-09-16T04:09:13.659 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T04:09:13.659 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2024-09-16T04:09:13.659 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T04:09:13.659 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-pool-df/3 2024-09-16T04:09:13.659 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=08441216-87d9-4ad7-867a-9e068a2a833e --auth-supported=none --mon-host=127.0.0.1:7113 ' 2024-09-16T04:09:13.659 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T04:09:13.659 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T04:09:13.659 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T04:09:13.659 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-pool-df/3' 2024-09-16T04:09:13.660 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-pool-df/3/journal' 2024-09-16T04:09:13.660 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T04:09:13.660 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T04:09:13.660 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-pool-df' 2024-09-16T04:09:13.660 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T04:09:13.660 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:09:13.660 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:09:13.660 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:09:13.660 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:09:13.660 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.177369 2024-09-16T04:09:13.660 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.177369/$cluster-$name.asok' 2024-09-16T04:09:13.661 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.177369/$cluster-$name.asok' 2024-09-16T04:09:13.661 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T04:09:13.662 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T04:09:13.662 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T04:09:13.662 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-pool-df/$name.log' 2024-09-16T04:09:13.662 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-pool-df/$name.pid' 2024-09-16T04:09:13.662 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T04:09:13.662 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T04:09:13.662 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T04:09:13.662 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T04:09:13.662 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T04:09:13.662 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T04:09:13.662 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-pool-df/3 2024-09-16T04:09:13.662 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T04:09:13.663 INFO:tasks.workunit.client.0.smithi096.stdout:add osd3 529c3a77-ba16-46af-8da4-99d5984ed24f 2024-09-16T04:09:13.663 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=529c3a77-ba16-46af-8da4-99d5984ed24f 2024-09-16T04:09:13.663 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 529c3a77-ba16-46af-8da4-99d5984ed24f' 2024-09-16T04:09:13.663 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T04:09:13.678 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBpr+dmK8RtKBAAA+Ip95Lm0Jjw1N1K3P8jnA== 2024-09-16T04:09:13.678 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBpr+dmK8RtKBAAA+Ip95Lm0Jjw1N1K3P8jnA=="}' 2024-09-16T04:09:13.679 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 529c3a77-ba16-46af-8da4-99d5984ed24f -i td/osd-pool-df/3/new.json 2024-09-16T04:09:14.033 INFO:tasks.workunit.client.0.smithi096.stdout:3 2024-09-16T04:09:14.049 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-pool-df/3/new.json 2024-09-16T04:09:14.050 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=08441216-87d9-4ad7-867a-9e068a2a833e --auth-supported=none --mon-host=127.0.0.1:7113 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-pool-df/3 --osd-journal=td/osd-pool-df/3/journal --chdir= --run-dir=td/osd-pool-df '--admin-socket=/tmp/ceph-asok.177369/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-pool-df/$name.log' '--pid-file=td/osd-pool-df/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBpr+dmK8RtKBAAA+Ip95Lm0Jjw1N1K3P8jnA== --osd-uuid 529c3a77-ba16-46af-8da4-99d5984ed24f 2024-09-16T04:09:14.080 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:09:14.075+0000 7f63426c17c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:09:14.127 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:09:14.123+0000 7f63426c17c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:09:14.128 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:09:14.123+0000 7f63426c17c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:09:14.129 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:09:14.123+0000 7f63426c17c0 -1 bdev(0x55933f281c00 td/osd-pool-df/3/block) open stat got: (1) Operation not permitted 2024-09-16T04:09:14.129 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:09:14.123+0000 7f63426c17c0 -1 bluestore(td/osd-pool-df/3) _read_fsid unparsable uuid 2024-09-16T04:09:20.867 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-pool-df/3/keyring 2024-09-16T04:09:20.868 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T04:09:20.869 INFO:tasks.workunit.client.0.smithi096.stdout:adding osd3 key to auth repository 2024-09-16T04:09:20.869 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2024-09-16T04:09:20.869 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-pool-df/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T04:09:21.117 INFO:tasks.workunit.client.0.smithi096.stdout:start osd.3 2024-09-16T04:09:21.118 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2024-09-16T04:09:21.118 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=08441216-87d9-4ad7-867a-9e068a2a833e --auth-supported=none --mon-host=127.0.0.1:7113 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-pool-df/3 --osd-journal=td/osd-pool-df/3/journal --chdir= --run-dir=td/osd-pool-df '--admin-socket=/tmp/ceph-asok.177369/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-pool-df/$name.log' '--pid-file=td/osd-pool-df/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T04:09:21.118 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T04:09:21.118 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T04:09:21.118 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T04:09:21.143 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:09:21.139+0000 7fa1545fa7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:09:21.145 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:09:21.139+0000 7fa1545fa7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:09:21.146 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:09:21.143+0000 7fa1545fa7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:09:21.351 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2024-09-16T04:09:21.351 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T04:09:21.351 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2024-09-16T04:09:21.351 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T04:09:21.351 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T04:09:21.351 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:09:21.351 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T04:09:21.352 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T04:09:21.352 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:09:21.352 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:09:21.579 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:09:22.581 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:09:22.581 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:09:22.582 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T04:09:22.582 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T04:09:22.582 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:09:22.582 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:09:22.668 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:09:22.663+0000 7fa1545fa7c0 -1 Falling back to public interface 2024-09-16T04:09:22.811 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:09:23.813 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:09:23.813 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:09:23.813 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T04:09:23.814 INFO:tasks.workunit.client.0.smithi096.stdout:2 2024-09-16T04:09:23.814 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:09:23.814 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:09:24.046 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:09:25.047 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:09:25.048 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:09:25.048 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T04:09:25.048 INFO:tasks.workunit.client.0.smithi096.stdout:3 2024-09-16T04:09:25.048 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:09:25.048 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:09:25.285 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:09:25.381 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:09:25.375+0000 7fa1545fa7c0 -1 osd.3 0 log_to_monitors true 2024-09-16T04:09:26.287 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:09:26.287 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:09:26.287 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T04:09:26.287 INFO:tasks.workunit.client.0.smithi096.stdout:4 2024-09-16T04:09:26.288 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:09:26.288 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:09:26.662 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:09:27.664 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:09:27.664 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:09:27.665 INFO:tasks.workunit.client.0.smithi096.stdout:5 2024-09-16T04:09:27.665 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T04:09:27.665 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:09:27.665 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:09:27.900 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:09:28.902 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:09:28.902 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:09:28.902 INFO:tasks.workunit.client.0.smithi096.stdout:6 2024-09-16T04:09:28.903 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T04:09:28.903 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:09:28.903 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:09:29.214 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:09:30.216 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:09:30.216 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:09:30.216 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T04:09:30.216 INFO:tasks.workunit.client.0.smithi096.stdout:7 2024-09-16T04:09:30.217 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:09:30.217 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:09:30.453 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:09:31.455 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:09:31.455 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:09:31.455 INFO:tasks.workunit.client.0.smithi096.stdout:8 2024-09-16T04:09:31.456 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T04:09:31.456 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:09:31.456 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:09:31.691 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:09:32.692 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:09:32.693 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:09:32.693 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T04:09:32.693 INFO:tasks.workunit.client.0.smithi096.stdout:9 2024-09-16T04:09:32.694 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:09:32.694 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:09:32.931 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:09:33.932 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:09:33.933 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:09:33.933 INFO:tasks.workunit.client.0.smithi096.stdout:10 2024-09-16T04:09:33.933 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T04:09:33.933 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:09:33.933 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:09:34.298 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:09:35.301 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:09:35.302 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:09:35.302 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T04:09:35.302 INFO:tasks.workunit.client.0.smithi096.stdout:11 2024-09-16T04:09:35.303 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:09:35.303 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:09:35.536 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:09:36.539 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:09:36.539 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:09:36.539 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T04:09:36.540 INFO:tasks.workunit.client.0.smithi096.stdout:12 2024-09-16T04:09:36.540 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:09:36.540 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:09:36.778 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:09:37.779 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:09:37.780 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:09:37.780 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T04:09:37.780 INFO:tasks.workunit.client.0.smithi096.stdout:13 2024-09-16T04:09:37.781 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:09:37.781 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:09:38.013 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:09:39.015 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:09:39.015 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:09:39.015 INFO:tasks.workunit.client.0.smithi096.stdout:14 2024-09-16T04:09:39.016 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T04:09:39.016 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:09:39.016 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:09:39.342 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:09:40.344 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:09:40.344 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:09:40.344 INFO:tasks.workunit.client.0.smithi096.stdout:15 2024-09-16T04:09:40.345 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T04:09:40.345 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:09:40.345 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:09:40.577 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:09:41.579 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:09:41.579 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:09:41.579 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T04:09:41.579 INFO:tasks.workunit.client.0.smithi096.stdout:16 2024-09-16T04:09:41.580 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:09:41.580 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:09:41.814 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:09:42.816 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:09:42.816 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:09:42.816 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T04:09:42.816 INFO:tasks.workunit.client.0.smithi096.stdout:17 2024-09-16T04:09:42.817 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:09:42.817 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:09:43.049 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:09:44.051 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:09:44.051 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:09:44.052 INFO:tasks.workunit.client.0.smithi096.stdout:18 2024-09-16T04:09:44.053 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 18 2024-09-16T04:09:44.053 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:09:44.053 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:09:44.356 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:09:45.358 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:09:45.358 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:09:45.358 INFO:tasks.workunit.client.0.smithi096.stdout:19 2024-09-16T04:09:45.359 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 19 2024-09-16T04:09:45.359 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:09:45.359 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:09:45.593 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:09:46.595 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:09:46.595 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:09:46.595 INFO:tasks.workunit.client.0.smithi096.stdout:20 2024-09-16T04:09:46.596 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 20 2024-09-16T04:09:46.596 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:09:46.596 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:09:46.830 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:09:47.832 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:09:47.832 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:09:47.832 INFO:tasks.workunit.client.0.smithi096.stdout:21 2024-09-16T04:09:47.833 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 21 2024-09-16T04:09:47.833 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:09:47.833 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:09:48.066 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:09:49.067 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:09:49.067 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:09:49.068 INFO:tasks.workunit.client.0.smithi096.stdout:22 2024-09-16T04:09:49.068 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 22 2024-09-16T04:09:49.068 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:09:49.068 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:09:49.407 INFO:tasks.workunit.client.0.smithi096.stdout:osd.3 up in weight 1 up_from 20 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6824/4179892329,v1:127.0.0.1:6825/4179892329] [v2:127.0.0.1:6826/4179892329,v1:127.0.0.1:6827/4179892329] exists,up 529c3a77-ba16-46af-8da4-99d5984ed24f 2024-09-16T04:09:49.410 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T04:09:49.410 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T04:09:49.410 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T04:09:49.410 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-df.sh:45: TEST_ceph_df: run_osd td/osd-pool-df 4 2024-09-16T04:09:49.410 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-pool-df 2024-09-16T04:09:49.410 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T04:09:49.410 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=4 2024-09-16T04:09:49.410 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T04:09:49.410 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-pool-df/4 2024-09-16T04:09:49.410 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=08441216-87d9-4ad7-867a-9e068a2a833e --auth-supported=none --mon-host=127.0.0.1:7113 ' 2024-09-16T04:09:49.410 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T04:09:49.411 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T04:09:49.411 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T04:09:49.411 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-pool-df/4' 2024-09-16T04:09:49.411 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-pool-df/4/journal' 2024-09-16T04:09:49.411 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T04:09:49.411 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T04:09:49.411 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-pool-df' 2024-09-16T04:09:49.411 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T04:09:49.411 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:09:49.411 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:09:49.411 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:09:49.411 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:09:49.411 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.177369 2024-09-16T04:09:49.412 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.177369/$cluster-$name.asok' 2024-09-16T04:09:49.412 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.177369/$cluster-$name.asok' 2024-09-16T04:09:49.412 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T04:09:49.412 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T04:09:49.412 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T04:09:49.412 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-pool-df/$name.log' 2024-09-16T04:09:49.412 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-pool-df/$name.pid' 2024-09-16T04:09:49.412 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T04:09:49.412 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T04:09:49.412 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T04:09:49.412 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T04:09:49.412 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T04:09:49.412 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T04:09:49.413 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-pool-df/4 2024-09-16T04:09:49.413 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T04:09:49.413 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=5544396f-0a15-478e-bba6-75199558a336 2024-09-16T04:09:49.413 INFO:tasks.workunit.client.0.smithi096.stdout:add osd4 5544396f-0a15-478e-bba6-75199558a336 2024-09-16T04:09:49.414 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd4 5544396f-0a15-478e-bba6-75199558a336' 2024-09-16T04:09:49.414 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T04:09:49.428 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCNr+dmwsKBGRAAGn0Uheq0umN44F3W4R2k/w== 2024-09-16T04:09:49.428 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCNr+dmwsKBGRAAGn0Uheq0umN44F3W4R2k/w=="}' 2024-09-16T04:09:49.428 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 5544396f-0a15-478e-bba6-75199558a336 -i td/osd-pool-df/4/new.json 2024-09-16T04:09:49.761 INFO:tasks.workunit.client.0.smithi096.stdout:4 2024-09-16T04:09:49.780 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-pool-df/4/new.json 2024-09-16T04:09:49.781 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 4 --fsid=08441216-87d9-4ad7-867a-9e068a2a833e --auth-supported=none --mon-host=127.0.0.1:7113 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-pool-df/4 --osd-journal=td/osd-pool-df/4/journal --chdir= --run-dir=td/osd-pool-df '--admin-socket=/tmp/ceph-asok.177369/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-pool-df/$name.log' '--pid-file=td/osd-pool-df/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCNr+dmwsKBGRAAGn0Uheq0umN44F3W4R2k/w== --osd-uuid 5544396f-0a15-478e-bba6-75199558a336 2024-09-16T04:09:49.814 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:09:49.811+0000 7f548c72c7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:09:49.847 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:09:49.843+0000 7f548c72c7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:09:49.849 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:09:49.843+0000 7f548c72c7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:09:49.849 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:09:49.843+0000 7f548c72c7c0 -1 bdev(0x556d51acbc00 td/osd-pool-df/4/block) open stat got: (1) Operation not permitted 2024-09-16T04:09:49.849 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:09:49.847+0000 7f548c72c7c0 -1 bluestore(td/osd-pool-df/4) _read_fsid unparsable uuid 2024-09-16T04:09:56.488 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-pool-df/4/keyring 2024-09-16T04:09:56.489 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T04:09:56.490 INFO:tasks.workunit.client.0.smithi096.stdout:adding osd4 key to auth repository 2024-09-16T04:09:56.491 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd4 key to auth repository 2024-09-16T04:09:56.491 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-pool-df/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T04:09:56.741 INFO:tasks.workunit.client.0.smithi096.stdout:start osd.4 2024-09-16T04:09:56.741 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.4 2024-09-16T04:09:56.742 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 4 --fsid=08441216-87d9-4ad7-867a-9e068a2a833e --auth-supported=none --mon-host=127.0.0.1:7113 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-pool-df/4 --osd-journal=td/osd-pool-df/4/journal --chdir= --run-dir=td/osd-pool-df '--admin-socket=/tmp/ceph-asok.177369/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-pool-df/$name.log' '--pid-file=td/osd-pool-df/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T04:09:56.742 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T04:09:56.742 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T04:09:56.742 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T04:09:56.767 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:09:56.762+0000 7fc75c1ad7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:09:56.775 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:09:56.770+0000 7fc75c1ad7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:09:56.776 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:09:56.770+0000 7fc75c1ad7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:09:56.970 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 4 2024-09-16T04:09:56.971 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T04:09:56.971 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=4 2024-09-16T04:09:56.971 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T04:09:56.971 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T04:09:56.971 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:09:56.971 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T04:09:56.972 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T04:09:56.972 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:09:56.972 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:09:57.198 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:09:58.044 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:09:58.038+0000 7fc75c1ad7c0 -1 Falling back to public interface 2024-09-16T04:09:58.199 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:09:58.199 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:09:58.199 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T04:09:58.200 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T04:09:58.200 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:09:58.200 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:09:58.422 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:09:59.423 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:09:59.423 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:09:59.424 INFO:tasks.workunit.client.0.smithi096.stdout:2 2024-09-16T04:09:59.424 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T04:09:59.425 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:09:59.425 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:09:59.656 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:10:00.657 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:10:00.658 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:10:00.658 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T04:10:00.658 INFO:tasks.workunit.client.0.smithi096.stdout:3 2024-09-16T04:10:00.658 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:10:00.658 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:10:00.723 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:10:00.718+0000 7fc75c1ad7c0 -1 osd.4 0 log_to_monitors true 2024-09-16T04:10:00.976 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:10:01.977 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:10:01.978 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:10:01.978 INFO:tasks.workunit.client.0.smithi096.stdout:4 2024-09-16T04:10:01.979 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T04:10:01.979 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:10:01.979 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:10:02.217 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:10:03.219 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:10:03.219 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:10:03.219 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T04:10:03.220 INFO:tasks.workunit.client.0.smithi096.stdout:5 2024-09-16T04:10:03.220 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:10:03.221 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:10:03.457 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:10:04.459 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:10:04.459 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:10:04.459 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T04:10:04.459 INFO:tasks.workunit.client.0.smithi096.stdout:6 2024-09-16T04:10:04.460 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:10:04.460 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:10:04.697 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:10:05.699 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:10:05.699 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:10:05.699 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T04:10:05.699 INFO:tasks.workunit.client.0.smithi096.stdout:7 2024-09-16T04:10:05.700 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:10:05.700 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:10:05.935 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:10:06.937 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:10:06.937 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:10:06.937 INFO:tasks.workunit.client.0.smithi096.stdout:8 2024-09-16T04:10:06.938 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T04:10:06.938 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:10:06.938 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:10:07.174 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:10:08.176 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:10:08.176 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:10:08.176 INFO:tasks.workunit.client.0.smithi096.stdout:9 2024-09-16T04:10:08.177 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T04:10:08.177 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:10:08.177 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:10:08.412 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:10:09.413 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:10:09.413 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:10:09.414 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T04:10:09.414 INFO:tasks.workunit.client.0.smithi096.stdout:10 2024-09-16T04:10:09.414 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:10:09.414 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:10:09.698 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:10:10.699 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:10:10.700 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:10:10.700 INFO:tasks.workunit.client.0.smithi096.stdout:11 2024-09-16T04:10:10.700 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T04:10:10.700 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:10:10.700 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:10:10.936 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:10:11.938 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:10:11.938 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:10:11.938 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T04:10:11.939 INFO:tasks.workunit.client.0.smithi096.stdout:12 2024-09-16T04:10:11.939 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:10:11.939 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:10:12.176 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:10:13.177 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:10:13.178 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:10:13.178 INFO:tasks.workunit.client.0.smithi096.stdout:13 2024-09-16T04:10:13.178 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T04:10:13.178 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:10:13.178 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:10:13.414 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:10:14.415 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:10:14.416 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:10:14.416 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T04:10:14.416 INFO:tasks.workunit.client.0.smithi096.stdout:14 2024-09-16T04:10:14.416 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:10:14.417 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:10:14.853 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:10:15.855 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:10:15.855 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:10:15.855 INFO:tasks.workunit.client.0.smithi096.stdout:15 2024-09-16T04:10:15.856 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T04:10:15.856 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:10:15.856 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:10:16.092 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:10:17.093 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:10:17.094 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:10:17.094 INFO:tasks.workunit.client.0.smithi096.stdout:16 2024-09-16T04:10:17.094 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T04:10:17.095 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:10:17.095 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:10:17.330 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:10:18.332 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:10:18.332 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:10:18.332 INFO:tasks.workunit.client.0.smithi096.stdout:17 2024-09-16T04:10:18.333 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T04:10:18.333 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:10:18.333 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:10:18.569 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:10:19.571 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:10:19.571 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:10:19.572 INFO:tasks.workunit.client.0.smithi096.stdout:18 2024-09-16T04:10:19.572 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 18 2024-09-16T04:10:19.572 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:10:19.572 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:10:19.979 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:10:20.980 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:10:20.980 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:10:20.981 INFO:tasks.workunit.client.0.smithi096.stdout:19 2024-09-16T04:10:20.981 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 19 2024-09-16T04:10:20.981 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:10:20.981 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:10:21.217 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:10:22.219 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:10:22.219 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:10:22.220 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 20 2024-09-16T04:10:22.220 INFO:tasks.workunit.client.0.smithi096.stdout:20 2024-09-16T04:10:22.220 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:10:22.220 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:10:22.453 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:10:23.455 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:10:23.455 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:10:23.455 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 21 2024-09-16T04:10:23.456 INFO:tasks.workunit.client.0.smithi096.stdout:21 2024-09-16T04:10:23.456 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:10:23.456 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:10:23.681 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:10:24.683 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:10:24.683 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:10:24.683 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 22 2024-09-16T04:10:24.683 INFO:tasks.workunit.client.0.smithi096.stdout:22 2024-09-16T04:10:24.684 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:10:24.684 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:10:24.989 INFO:tasks.workunit.client.0.smithi096.stdout:osd.4 up in weight 1 up_from 25 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6832/3809175034,v1:127.0.0.1:6833/3809175034] [v2:127.0.0.1:6834/3809175034,v1:127.0.0.1:6835/3809175034] exists,up 5544396f-0a15-478e-bba6-75199558a336 2024-09-16T04:10:24.991 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T04:10:24.992 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T04:10:24.992 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T04:10:24.992 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-df.sh:46: TEST_ceph_df: run_osd td/osd-pool-df 5 2024-09-16T04:10:24.992 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-pool-df 2024-09-16T04:10:24.992 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T04:10:24.992 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=5 2024-09-16T04:10:24.992 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T04:10:24.992 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-pool-df/5 2024-09-16T04:10:24.992 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=08441216-87d9-4ad7-867a-9e068a2a833e --auth-supported=none --mon-host=127.0.0.1:7113 ' 2024-09-16T04:10:24.992 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T04:10:24.992 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T04:10:24.993 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T04:10:24.993 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-pool-df/5' 2024-09-16T04:10:24.993 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-pool-df/5/journal' 2024-09-16T04:10:24.993 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T04:10:24.993 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T04:10:24.993 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-pool-df' 2024-09-16T04:10:24.993 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T04:10:24.993 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:10:24.993 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:10:24.993 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:10:24.993 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:10:24.993 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.177369 2024-09-16T04:10:24.993 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.177369/$cluster-$name.asok' 2024-09-16T04:10:24.995 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.177369/$cluster-$name.asok' 2024-09-16T04:10:24.995 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T04:10:24.996 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T04:10:24.996 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T04:10:24.996 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-pool-df/$name.log' 2024-09-16T04:10:24.996 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-pool-df/$name.pid' 2024-09-16T04:10:24.996 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T04:10:24.996 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T04:10:24.996 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T04:10:24.996 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T04:10:24.996 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T04:10:24.996 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T04:10:24.996 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-pool-df/5 2024-09-16T04:10:24.996 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T04:10:24.996 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=14e0e6e2-5437-4a19-8221-e9aeac34040b 2024-09-16T04:10:24.997 INFO:tasks.workunit.client.0.smithi096.stdout:add osd5 14e0e6e2-5437-4a19-8221-e9aeac34040b 2024-09-16T04:10:24.997 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd5 14e0e6e2-5437-4a19-8221-e9aeac34040b' 2024-09-16T04:10:24.997 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T04:10:25.016 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCxr+dmg5DgABAAAPQ43y2xo31xR3MLltoiWg== 2024-09-16T04:10:25.016 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCxr+dmg5DgABAAAPQ43y2xo31xR3MLltoiWg=="}' 2024-09-16T04:10:25.016 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 14e0e6e2-5437-4a19-8221-e9aeac34040b -i td/osd-pool-df/5/new.json 2024-09-16T04:10:25.389 INFO:tasks.workunit.client.0.smithi096.stdout:5 2024-09-16T04:10:25.405 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-pool-df/5/new.json 2024-09-16T04:10:25.406 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 5 --fsid=08441216-87d9-4ad7-867a-9e068a2a833e --auth-supported=none --mon-host=127.0.0.1:7113 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-pool-df/5 --osd-journal=td/osd-pool-df/5/journal --chdir= --run-dir=td/osd-pool-df '--admin-socket=/tmp/ceph-asok.177369/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-pool-df/$name.log' '--pid-file=td/osd-pool-df/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCxr+dmg5DgABAAAPQ43y2xo31xR3MLltoiWg== --osd-uuid 14e0e6e2-5437-4a19-8221-e9aeac34040b 2024-09-16T04:10:25.436 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:10:25.434+0000 7fcd71d4c7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:10:25.508 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:10:25.506+0000 7fcd71d4c7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:10:25.510 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:10:25.510+0000 7fcd71d4c7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:10:25.510 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:10:25.510+0000 7fcd71d4c7c0 -1 bdev(0x55f980d5bc00 td/osd-pool-df/5/block) open stat got: (1) Operation not permitted 2024-09-16T04:10:25.510 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:10:25.510+0000 7fcd71d4c7c0 -1 bluestore(td/osd-pool-df/5) _read_fsid unparsable uuid 2024-09-16T04:10:32.507 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-pool-df/5/keyring 2024-09-16T04:10:32.507 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T04:10:32.508 INFO:tasks.workunit.client.0.smithi096.stdout:adding osd5 key to auth repository 2024-09-16T04:10:32.508 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd5 key to auth repository 2024-09-16T04:10:32.508 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-pool-df/5/keyring auth add osd.5 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T04:10:32.757 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.5 2024-09-16T04:10:32.757 INFO:tasks.workunit.client.0.smithi096.stdout:start osd.5 2024-09-16T04:10:32.758 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 5 --fsid=08441216-87d9-4ad7-867a-9e068a2a833e --auth-supported=none --mon-host=127.0.0.1:7113 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-pool-df/5 --osd-journal=td/osd-pool-df/5/journal --chdir= --run-dir=td/osd-pool-df '--admin-socket=/tmp/ceph-asok.177369/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-pool-df/$name.log' '--pid-file=td/osd-pool-df/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T04:10:32.758 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T04:10:32.758 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T04:10:32.758 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T04:10:32.782 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:10:32.782+0000 7fcce94cb7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:10:32.785 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:10:32.782+0000 7fcce94cb7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:10:32.786 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:10:32.786+0000 7fcce94cb7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:10:32.981 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 5 2024-09-16T04:10:32.982 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T04:10:32.982 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=5 2024-09-16T04:10:32.982 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T04:10:32.982 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T04:10:32.982 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:10:32.982 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T04:10:32.983 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T04:10:32.983 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:10:32.983 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:10:33.201 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:10:34.069 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:10:34.066+0000 7fcce94cb7c0 -1 Falling back to public interface 2024-09-16T04:10:34.203 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:10:34.203 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:10:34.203 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T04:10:34.203 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T04:10:34.204 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:10:34.204 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:10:34.441 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:10:35.442 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:10:35.442 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:10:35.442 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T04:10:35.443 INFO:tasks.workunit.client.0.smithi096.stdout:2 2024-09-16T04:10:35.443 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:10:35.443 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:10:35.677 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:10:36.679 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:10:36.679 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:10:36.679 INFO:tasks.workunit.client.0.smithi096.stdout:3 2024-09-16T04:10:36.680 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T04:10:36.680 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:10:36.680 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:10:36.913 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:10:37.141 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:10:37.137+0000 7fcce94cb7c0 -1 osd.5 0 log_to_monitors true 2024-09-16T04:10:37.915 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:10:37.915 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:10:37.915 INFO:tasks.workunit.client.0.smithi096.stdout:4 2024-09-16T04:10:37.916 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T04:10:37.916 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:10:37.916 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:10:38.355 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:10:39.356 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:10:39.356 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:10:39.357 INFO:tasks.workunit.client.0.smithi096.stdout:5 2024-09-16T04:10:39.357 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T04:10:39.357 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:10:39.357 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:10:39.591 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:10:40.592 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:10:40.593 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:10:40.593 INFO:tasks.workunit.client.0.smithi096.stdout:6 2024-09-16T04:10:40.593 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T04:10:40.593 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:10:40.593 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:10:40.827 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:10:41.829 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:10:41.829 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:10:41.829 INFO:tasks.workunit.client.0.smithi096.stdout:7 2024-09-16T04:10:41.830 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T04:10:41.830 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:10:41.830 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:10:42.068 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:10:43.070 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:10:43.070 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:10:43.070 INFO:tasks.workunit.client.0.smithi096.stdout:8 2024-09-16T04:10:43.071 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T04:10:43.071 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:10:43.071 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:10:43.306 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:10:44.307 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:10:44.307 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:10:44.308 INFO:tasks.workunit.client.0.smithi096.stdout:9 2024-09-16T04:10:44.308 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T04:10:44.308 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:10:44.308 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:10:44.543 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:10:45.545 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:10:45.545 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:10:45.545 INFO:tasks.workunit.client.0.smithi096.stdout:10 2024-09-16T04:10:45.546 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T04:10:45.546 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:10:45.546 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:10:45.783 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:10:46.784 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:10:46.784 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:10:46.785 INFO:tasks.workunit.client.0.smithi096.stdout:11 2024-09-16T04:10:46.785 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T04:10:46.785 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:10:46.785 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:10:47.019 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:10:48.021 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:10:48.021 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:10:48.021 INFO:tasks.workunit.client.0.smithi096.stdout:12 2024-09-16T04:10:48.022 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T04:10:48.022 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:10:48.022 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:10:48.251 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:10:49.253 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:10:49.253 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:10:49.253 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T04:10:49.253 INFO:tasks.workunit.client.0.smithi096.stdout:13 2024-09-16T04:10:49.253 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:10:49.254 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:10:49.488 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:10:50.490 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:10:50.490 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:10:50.490 INFO:tasks.workunit.client.0.smithi096.stdout:14 2024-09-16T04:10:50.491 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T04:10:50.491 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:10:50.491 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:10:51.031 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:10:52.033 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:10:52.033 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:10:52.033 INFO:tasks.workunit.client.0.smithi096.stdout:15 2024-09-16T04:10:52.034 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T04:10:52.034 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:10:52.035 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:10:52.282 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:10:53.284 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:10:53.284 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:10:53.284 INFO:tasks.workunit.client.0.smithi096.stdout:16 2024-09-16T04:10:53.285 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T04:10:53.285 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:10:53.285 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:10:53.519 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:10:54.521 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:10:54.521 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:10:54.522 INFO:tasks.workunit.client.0.smithi096.stdout:17 2024-09-16T04:10:54.522 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T04:10:54.522 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:10:54.522 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:10:54.891 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:10:55.893 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:10:55.893 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:10:55.893 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 18 2024-09-16T04:10:55.893 INFO:tasks.workunit.client.0.smithi096.stdout:18 2024-09-16T04:10:55.894 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:10:55.894 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:10:56.127 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:10:57.128 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:10:57.128 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:10:57.128 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 19 2024-09-16T04:10:57.129 INFO:tasks.workunit.client.0.smithi096.stdout:19 2024-09-16T04:10:57.129 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:10:57.129 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:10:57.500 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:10:58.501 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:10:58.502 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:10:58.502 INFO:tasks.workunit.client.0.smithi096.stdout:20 2024-09-16T04:10:58.502 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 20 2024-09-16T04:10:58.503 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:10:58.503 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:10:58.737 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:10:59.739 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:10:59.739 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:10:59.739 INFO:tasks.workunit.client.0.smithi096.stdout:21 2024-09-16T04:10:59.740 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 21 2024-09-16T04:10:59.740 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:10:59.740 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:11:00.052 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:11:01.054 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:11:01.054 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:11:01.054 INFO:tasks.workunit.client.0.smithi096.stdout:22 2024-09-16T04:11:01.055 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 22 2024-09-16T04:11:01.055 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:11:01.055 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:11:01.370 INFO:tasks.workunit.client.0.smithi096.stdout:osd.5 up in weight 1 up_from 30 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6840/2759917344,v1:127.0.0.1:6841/2759917344] [v2:127.0.0.1:6842/2759917344,v1:127.0.0.1:6843/2759917344] exists,up 14e0e6e2-5437-4a19-8221-e9aeac34040b 2024-09-16T04:11:01.372 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T04:11:01.372 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T04:11:01.372 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T04:11:01.372 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-df.sh:47: TEST_ceph_df: run_mgr td/osd-pool-df x 2024-09-16T04:11:01.372 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-pool-df 2024-09-16T04:11:01.372 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2024-09-16T04:11:01.372 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2024-09-16T04:11:01.372 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2024-09-16T04:11:01.372 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-pool-df/x 2024-09-16T04:11:01.372 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2024-09-16T04:11:01.686 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2024-09-16T04:11:01.686 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:11:01.686 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:11:01.686 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:11:01.686 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:11:01.687 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.177369 2024-09-16T04:11:01.687 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.177369/$cluster-$name.asok' 2024-09-16T04:11:01.687 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T04:11:01.687 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-pool-df/x '--log-file=td/osd-pool-df/$name.log' '--admin-socket=/tmp/ceph-asok.177369/$cluster-$name.asok' --run-dir=td/osd-pool-df '--pid-file=td/osd-pool-df/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T04:11:01.724 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-df.sh:49: TEST_ceph_df: profile+=' plugin=jerasure' 2024-09-16T04:11:01.725 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-df.sh:50: TEST_ceph_df: profile+=' technique=reed_sol_van' 2024-09-16T04:11:01.725 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-df.sh:51: TEST_ceph_df: profile+=' k=4' 2024-09-16T04:11:01.725 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-df.sh:52: TEST_ceph_df: profile+=' m=2' 2024-09-16T04:11:01.725 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-df.sh:53: TEST_ceph_df: profile+=' crush-failure-domain=osd' 2024-09-16T04:11:01.725 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-df.sh:55: TEST_ceph_df: ceph osd erasure-code-profile set ec42profile plugin=jerasure technique=reed_sol_van k=4 m=2 crush-failure-domain=osd 2024-09-16T04:11:02.135 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-df.sh:57: TEST_ceph_df: local rep_poolname=testcephdf_replicate 2024-09-16T04:11:02.135 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-df.sh:58: TEST_ceph_df: local ec_poolname=testcephdf_erasurecode 2024-09-16T04:11:02.135 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-df.sh:59: TEST_ceph_df: create_pool testcephdf_replicate 6 6 replicated 2024-09-16T04:11:02.135 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create testcephdf_replicate 6 6 replicated 2024-09-16T04:11:02.622 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'testcephdf_replicate' already exists 2024-09-16T04:11:02.638 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2024-09-16T04:11:03.640 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-df.sh:60: TEST_ceph_df: create_pool testcephdf_erasurecode 6 6 erasure ec42profile 2024-09-16T04:11:03.640 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create testcephdf_erasurecode 6 6 erasure ec42profile 2024-09-16T04:11:05.820 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'testcephdf_erasurecode' already exists 2024-09-16T04:11:05.835 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2024-09-16T04:11:06.837 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-df.sh:61: TEST_ceph_df: flush_pg_stats 2024-09-16T04:11:06.837 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: local timeout=300 2024-09-16T04:11:06.838 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ceph osd ls 2024-09-16T04:11:07.272 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ids='0 2024-09-16T04:11:07.273 INFO:tasks.workunit.client.0.smithi096.stderr:1 2024-09-16T04:11:07.273 INFO:tasks.workunit.client.0.smithi096.stderr:2 2024-09-16T04:11:07.273 INFO:tasks.workunit.client.0.smithi096.stderr:3 2024-09-16T04:11:07.273 INFO:tasks.workunit.client.0.smithi096.stderr:4 2024-09-16T04:11:07.273 INFO:tasks.workunit.client.0.smithi096.stderr:5' 2024-09-16T04:11:07.273 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2208: flush_pg_stats: seqs= 2024-09-16T04:11:07.273 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:11:07.274 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-09-16T04:11:07.530 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=21474836483 2024-09-16T04:11:07.530 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 21474836483 2024-09-16T04:11:07.531 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836483' 2024-09-16T04:11:07.531 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:11:07.531 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-09-16T04:11:07.825 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=42949672963 2024-09-16T04:11:07.826 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 42949672963 2024-09-16T04:11:07.826 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836483 1-42949672963' 2024-09-16T04:11:07.826 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:11:07.826 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-09-16T04:11:07.971 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=64424509443 2024-09-16T04:11:07.972 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 64424509443 2024-09-16T04:11:07.972 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836483 1-42949672963 2-64424509443' 2024-09-16T04:11:07.972 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:11:07.972 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-09-16T04:11:08.145 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=85899345923 2024-09-16T04:11:08.145 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 85899345923 2024-09-16T04:11:08.145 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836483 1-42949672963 2-64424509443 3-85899345923' 2024-09-16T04:11:08.145 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:11:08.145 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-09-16T04:11:08.315 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=107374182403 2024-09-16T04:11:08.316 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 107374182403 2024-09-16T04:11:08.316 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836483 1-42949672963 2-64424509443 3-85899345923 4-107374182403' 2024-09-16T04:11:08.316 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:11:08.316 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2024-09-16T04:11:08.565 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=128849018883 2024-09-16T04:11:08.565 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 128849018883 2024-09-16T04:11:08.565 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836483 1-42949672963 2-64424509443 3-85899345923 4-107374182403 5-128849018883' 2024-09-16T04:11:08.565 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:11:08.566 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 0-21474836483 2024-09-16T04:11:08.566 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:11:08.567 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=0 2024-09-16T04:11:08.568 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 0-21474836483 2024-09-16T04:11:08.568 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:11:08.569 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=21474836483 2024-09-16T04:11:08.570 INFO:tasks.workunit.client.0.smithi096.stdout:waiting osd.0 seq 21474836483 2024-09-16T04:11:08.570 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.0 seq 21474836483' 2024-09-16T04:11:08.570 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T04:11:08.995 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836483 -lt 21474836483 2024-09-16T04:11:08.995 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:11:08.996 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 1-42949672963 2024-09-16T04:11:08.997 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:11:08.998 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=1 2024-09-16T04:11:08.999 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 1-42949672963 2024-09-16T04:11:08.999 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:11:09.000 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=42949672963 2024-09-16T04:11:09.000 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.1 seq 42949672963' 2024-09-16T04:11:09.001 INFO:tasks.workunit.client.0.smithi096.stdout:waiting osd.1 seq 42949672963 2024-09-16T04:11:09.001 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 1 2024-09-16T04:11:09.458 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 42949672963 -lt 42949672963 2024-09-16T04:11:09.458 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:11:09.459 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 2-64424509443 2024-09-16T04:11:09.459 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:11:09.460 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=2 2024-09-16T04:11:09.461 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 2-64424509443 2024-09-16T04:11:09.462 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:11:09.463 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=64424509443 2024-09-16T04:11:09.463 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.2 seq 64424509443' 2024-09-16T04:11:09.463 INFO:tasks.workunit.client.0.smithi096.stdout:waiting osd.2 seq 64424509443 2024-09-16T04:11:09.463 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 2 2024-09-16T04:11:09.891 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 64424509443 -lt 64424509443 2024-09-16T04:11:09.891 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:11:09.892 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 3-85899345923 2024-09-16T04:11:09.893 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:11:09.894 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=3 2024-09-16T04:11:09.895 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 3-85899345923 2024-09-16T04:11:09.895 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:11:09.896 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=85899345923 2024-09-16T04:11:09.896 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.3 seq 85899345923' 2024-09-16T04:11:09.896 INFO:tasks.workunit.client.0.smithi096.stdout:waiting osd.3 seq 85899345923 2024-09-16T04:11:09.896 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 3 2024-09-16T04:11:10.378 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 85899345923 -lt 85899345923 2024-09-16T04:11:10.378 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:11:10.380 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 4-107374182403 2024-09-16T04:11:10.381 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:11:10.381 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=4 2024-09-16T04:11:10.382 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 4-107374182403 2024-09-16T04:11:10.382 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:11:10.383 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=107374182403 2024-09-16T04:11:10.383 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.4 seq 107374182403' 2024-09-16T04:11:10.383 INFO:tasks.workunit.client.0.smithi096.stdout:waiting osd.4 seq 107374182403 2024-09-16T04:11:10.384 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 4 2024-09-16T04:11:10.832 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 107374182403 -lt 107374182403 2024-09-16T04:11:10.832 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:11:10.832 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 5-128849018883 2024-09-16T04:11:10.833 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:11:10.834 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=5 2024-09-16T04:11:10.835 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 5-128849018883 2024-09-16T04:11:10.835 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:11:10.837 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=128849018883 2024-09-16T04:11:10.837 INFO:tasks.workunit.client.0.smithi096.stdout:waiting osd.5 seq 128849018883 2024-09-16T04:11:10.838 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.5 seq 128849018883' 2024-09-16T04:11:10.838 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 5 2024-09-16T04:11:11.240 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 128849018883 -lt 128849018883 2024-09-16T04:11:11.242 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-df.sh:63: TEST_ceph_df: ceph df -f json 2024-09-16T04:11:11.242 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-df.sh:63: TEST_ceph_df: jq .stats.total_avail_bytes 2024-09-16T04:11:11.781 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-df.sh:63: TEST_ceph_df: local global_avail=644077985792 2024-09-16T04:11:11.781 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-df.sh:64: TEST_ceph_df: ceph df -f json 2024-09-16T04:11:11.782 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-df.sh:64: TEST_ceph_df: jq '.pools | map(select(.name == "testcephdf_replicate"))[0].stats.max_avail' 2024-09-16T04:11:12.319 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-df.sh:64: TEST_ceph_df: local rep_avail=212545159168 2024-09-16T04:11:12.320 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-df.sh:65: TEST_ceph_df: ceph df -f json 2024-09-16T04:11:12.321 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-df.sh:65: TEST_ceph_df: jq '.pools | map(select(.name == "testcephdf_erasurecode"))[0].stats.max_avail' 2024-09-16T04:11:12.925 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-df.sh:65: TEST_ceph_df: local ec_avail=425090318336 2024-09-16T04:11:12.925 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-df.sh:67: TEST_ceph_df: echo '644077985792 >= 212545159168*3' 2024-09-16T04:11:12.925 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-df.sh:67: TEST_ceph_df: bc 2024-09-16T04:11:12.965 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T04:11:12.965 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-df.sh:68: TEST_ceph_df: echo '644077985792 >= 425090318336*1.5' 2024-09-16T04:11:12.965 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-df.sh:68: TEST_ceph_df: bc 2024-09-16T04:11:12.966 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T04:11:12.966 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-df.sh:70: TEST_ceph_df: ceph osd pool delete testcephdf_replicate testcephdf_replicate --yes-i-really-really-mean-it 2024-09-16T04:11:13.503 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'testcephdf_replicate' does not exist 2024-09-16T04:11:13.520 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-df.sh:71: TEST_ceph_df: ceph osd pool delete testcephdf_erasurecode testcephdf_erasurecode --yes-i-really-really-mean-it 2024-09-16T04:11:14.405 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'testcephdf_erasurecode' does not exist 2024-09-16T04:11:14.425 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-df.sh:72: TEST_ceph_df: ceph osd erasure-code-profile rm ec42profile 2024-09-16T04:11:15.499 INFO:tasks.workunit.client.0.smithi096.stderr:erasure-code-profile ec42profile does not exist 2024-09-16T04:11:15.521 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-df.sh:73: TEST_ceph_df: teardown td/osd-pool-df 2024-09-16T04:11:15.521 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-pool-df 2024-09-16T04:11:15.521 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T04:11:15.521 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-pool-df KILL 2024-09-16T04:11:15.522 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T04:11:15.523 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T04:11:15.523 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T04:11:15.523 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T04:11:15.523 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T04:11:15.836 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T04:11:15.836 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T04:11:15.838 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T04:11:15.838 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T04:11:15.840 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T04:11:15.840 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T04:11:15.840 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T04:11:15.841 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T04:11:15.841 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T04:11:15.842 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T04:11:15.842 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T04:11:15.843 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T04:11:15.845 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T04:11:15.845 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-pool-df 2024-09-16T04:11:15.877 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T04:11:15.878 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:11:15.878 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.177369 2024-09-16T04:11:15.878 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.177369 2024-09-16T04:11:15.879 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T04:11:15.879 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T04:11:15.879 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-df.sh:32: run: teardown td/osd-pool-df 2024-09-16T04:11:15.880 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-pool-df 2024-09-16T04:11:15.880 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T04:11:15.880 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-pool-df KILL 2024-09-16T04:11:15.880 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T04:11:15.880 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T04:11:15.880 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T04:11:15.880 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T04:11:15.880 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T04:11:15.882 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T04:11:15.882 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T04:11:15.883 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T04:11:15.883 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T04:11:15.884 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T04:11:15.884 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T04:11:15.885 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T04:11:15.886 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T04:11:15.886 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T04:11:15.886 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T04:11:15.886 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T04:11:15.887 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T04:11:15.888 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T04:11:15.888 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-pool-df 2024-09-16T04:11:15.890 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T04:11:15.890 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:11:15.890 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.177369 2024-09-16T04:11:15.890 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.177369 2024-09-16T04:11:15.891 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T04:11:15.892 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T04:11:15.892 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2322: main: code=0 2024-09-16T04:11:15.892 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2326: main: teardown td/osd-pool-df 0 2024-09-16T04:11:15.892 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-pool-df 2024-09-16T04:11:15.892 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2024-09-16T04:11:15.892 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-pool-df KILL 2024-09-16T04:11:15.892 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T04:11:15.892 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T04:11:15.892 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T04:11:15.892 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T04:11:15.892 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T04:11:15.894 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T04:11:15.894 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T04:11:15.895 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T04:11:15.896 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T04:11:15.896 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T04:11:15.896 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T04:11:15.897 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T04:11:15.898 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T04:11:15.898 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T04:11:15.898 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T04:11:15.899 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T04:11:15.899 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T04:11:15.900 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2024-09-16T04:11:15.901 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-pool-df 2024-09-16T04:11:15.902 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T04:11:15.902 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:11:15.902 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.177369 2024-09-16T04:11:15.902 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.177369 2024-09-16T04:11:15.903 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T04:11:15.903 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T04:11:15.903 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2327: main: return 0 2024-09-16T04:11:15.904 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-16T04:11:15.905 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-16T04:11:15.957 INFO:tasks.workunit:Running workunit mon/test_pool_quota.sh... 2024-09-16T04:11:15.958 DEBUG:teuthology.orchestra.run.smithi096:workunit test mon/test_pool_quota.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7498493279982dfe87f00616198a5967475f6169 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/test_pool_quota.sh 2024-09-16T04:11:16.013 INFO:tasks.workunit.client.0.smithi096.stderr:stty: 'standard input': Inappropriate ioctl for device 2024-09-16T04:11:16.018 INFO:tasks.workunit.client.0.smithi096.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2024-09-16T04:11:16.018 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2315: main: export PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-16T04:11:16.018 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2315: main: PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-16T04:11:16.019 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2316: main: export PYTHONWARNINGS=ignore 2024-09-16T04:11:16.019 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2316: main: PYTHONWARNINGS=ignore 2024-09-16T04:11:16.019 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2317: main: export CEPH_CONF=/dev/null 2024-09-16T04:11:16.019 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2317: main: CEPH_CONF=/dev/null 2024-09-16T04:11:16.019 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2318: main: unset CEPH_ARGS 2024-09-16T04:11:16.019 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2320: main: local code 2024-09-16T04:11:16.019 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2321: main: run td/testpoolquota 2024-09-16T04:11:16.019 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/test_pool_quota.sh:13: run: local dir=td/testpoolquota 2024-09-16T04:11:16.019 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/test_pool_quota.sh:14: run: shift 2024-09-16T04:11:16.019 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/test_pool_quota.sh:16: run: export CEPH_MON=127.0.0.1:17108 2024-09-16T04:11:16.019 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/test_pool_quota.sh:16: run: CEPH_MON=127.0.0.1:17108 2024-09-16T04:11:16.020 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/test_pool_quota.sh:17: run: export CEPH_ARGS 2024-09-16T04:11:16.020 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/test_pool_quota.sh:18: run: uuidgen 2024-09-16T04:11:16.020 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/test_pool_quota.sh:18: run: CEPH_ARGS+='--fsid=822e999c-833d-47f5-86bd-d98647f0b44e --auth-supported=none ' 2024-09-16T04:11:16.020 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/test_pool_quota.sh:19: run: CEPH_ARGS+='--mon-host=127.0.0.1:17108 ' 2024-09-16T04:11:16.020 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/test_pool_quota.sh:21: run: set 2024-09-16T04:11:16.020 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/test_pool_quota.sh:21: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2024-09-16T04:11:16.023 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/test_pool_quota.sh:21: run: local funcs=TEST_pool_quota 2024-09-16T04:11:16.024 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/test_pool_quota.sh:22: run: for func in $funcs 2024-09-16T04:11:16.024 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/test_pool_quota.sh:23: run: TEST_pool_quota td/testpoolquota 2024-09-16T04:11:16.024 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/test_pool_quota.sh:28: TEST_pool_quota: local dir=td/testpoolquota 2024-09-16T04:11:16.024 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/test_pool_quota.sh:29: TEST_pool_quota: setup td/testpoolquota 2024-09-16T04:11:16.024 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/testpoolquota 2024-09-16T04:11:16.024 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/testpoolquota 2024-09-16T04:11:16.024 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/testpoolquota 2024-09-16T04:11:16.024 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T04:11:16.024 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/testpoolquota KILL 2024-09-16T04:11:16.024 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T04:11:16.024 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T04:11:16.024 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T04:11:16.025 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T04:11:16.025 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T04:11:16.025 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T04:11:16.026 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T04:11:16.027 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T04:11:16.027 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T04:11:16.028 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T04:11:16.028 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T04:11:16.028 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T04:11:16.029 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T04:11:16.029 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T04:11:16.030 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T04:11:16.030 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T04:11:16.031 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T04:11:16.034 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T04:11:16.034 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/testpoolquota 2024-09-16T04:11:16.034 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T04:11:16.034 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:11:16.034 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.189528 2024-09-16T04:11:16.034 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.189528 2024-09-16T04:11:16.035 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T04:11:16.035 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T04:11:16.035 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/testpoolquota 2024-09-16T04:11:16.037 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T04:11:16.037 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:11:16.037 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.189528 2024-09-16T04:11:16.037 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.189528 2024-09-16T04:11:16.038 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T04:11:16.039 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2024-09-16T04:11:16.039 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2024-09-16T04:11:16.040 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T04:11:16.040 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/testpoolquota 1' TERM HUP INT 2024-09-16T04:11:16.040 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/test_pool_quota.sh:31: TEST_pool_quota: run_mon td/testpoolquota a 2024-09-16T04:11:16.040 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/testpoolquota 2024-09-16T04:11:16.040 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T04:11:16.040 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T04:11:16.040 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T04:11:16.040 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/testpoolquota/a 2024-09-16T04:11:16.040 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/testpoolquota/a --run-dir=td/testpoolquota 2024-09-16T04:11:16.514 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T04:11:16.514 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:11:16.514 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:11:16.515 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:11:16.515 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:11:16.515 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.189528 2024-09-16T04:11:16.515 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.189528/$cluster-$name.asok' 2024-09-16T04:11:16.516 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/testpoolquota/a '--log-file=td/testpoolquota/$name.log' '--admin-socket=/tmp/ceph-asok.189528/$cluster-$name.asok' --mon-cluster-log-file=td/testpoolquota/log --run-dir=td/testpoolquota '--pid-file=td/testpoolquota/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-09-16T04:11:16.759 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T04:11:16.760 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T04:11:16.760 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T04:11:16.760 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T04:11:16.761 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T04:11:16.761 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T04:11:16.762 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T04:11:16.762 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T04:11:16.762 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T04:11:16.762 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T04:11:16.762 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:11:16.762 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.189528 2024-09-16T04:11:16.762 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.189528/ceph-mon.a.asok 2024-09-16T04:11:16.762 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T04:11:16.762 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.189528/ceph-mon.a.asok config get fsid 2024-09-16T04:11:16.881 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T04:11:16.881 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T04:11:16.881 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T04:11:16.884 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T04:11:16.884 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T04:11:16.885 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T04:11:16.885 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T04:11:16.885 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T04:11:16.885 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T04:11:16.885 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:11:16.885 INFO:tasks.workunit.client.0.smithi096.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.189528 2024-09-16T04:11:16.885 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.189528/ceph-mon.a.asok 2024-09-16T04:11:16.885 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T04:11:16.886 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.189528/ceph-mon.a.asok config get mon_host 2024-09-16T04:11:16.985 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/test_pool_quota.sh:32: TEST_pool_quota: run_osd td/testpoolquota 0 2024-09-16T04:11:16.985 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/testpoolquota 2024-09-16T04:11:16.985 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T04:11:16.985 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2024-09-16T04:11:16.986 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T04:11:16.986 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/testpoolquota/0 2024-09-16T04:11:16.986 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=822e999c-833d-47f5-86bd-d98647f0b44e --auth-supported=none --mon-host=127.0.0.1:17108 ' 2024-09-16T04:11:16.986 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T04:11:16.986 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T04:11:16.986 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T04:11:16.986 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/testpoolquota/0' 2024-09-16T04:11:16.986 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/testpoolquota/0/journal' 2024-09-16T04:11:16.986 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T04:11:16.986 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T04:11:16.986 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/testpoolquota' 2024-09-16T04:11:16.987 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T04:11:16.987 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:11:16.987 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:11:16.987 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:11:16.987 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:11:16.987 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.189528 2024-09-16T04:11:16.987 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.189528/$cluster-$name.asok' 2024-09-16T04:11:16.988 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.189528/$cluster-$name.asok' 2024-09-16T04:11:16.988 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T04:11:16.988 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T04:11:16.988 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T04:11:16.988 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/testpoolquota/$name.log' 2024-09-16T04:11:16.988 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/testpoolquota/$name.pid' 2024-09-16T04:11:16.988 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T04:11:16.988 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T04:11:16.988 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T04:11:16.988 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T04:11:16.988 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T04:11:16.989 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T04:11:16.989 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/testpoolquota/0 2024-09-16T04:11:16.989 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T04:11:16.989 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=4f7d1939-eec9-491e-9185-08e27819de47 2024-09-16T04:11:16.989 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 4f7d1939-eec9-491e-9185-08e27819de47' 2024-09-16T04:11:16.990 INFO:tasks.workunit.client.0.smithi096.stdout:add osd0 4f7d1939-eec9-491e-9185-08e27819de47 2024-09-16T04:11:16.990 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T04:11:17.009 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDlr+dmhJ58ABAAzgILaEKGS8o2nZ1iuGLnoA== 2024-09-16T04:11:17.009 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDlr+dmhJ58ABAAzgILaEKGS8o2nZ1iuGLnoA=="}' 2024-09-16T04:11:17.009 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 4f7d1939-eec9-491e-9185-08e27819de47 -i td/testpoolquota/0/new.json 2024-09-16T04:11:18.036 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T04:11:18.053 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/testpoolquota/0/new.json 2024-09-16T04:11:18.054 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=822e999c-833d-47f5-86bd-d98647f0b44e --auth-supported=none --mon-host=127.0.0.1:17108 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/testpoolquota/0 --osd-journal=td/testpoolquota/0/journal --chdir= --run-dir=td/testpoolquota '--admin-socket=/tmp/ceph-asok.189528/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/testpoolquota/$name.log' '--pid-file=td/testpoolquota/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDlr+dmhJ58ABAAzgILaEKGS8o2nZ1iuGLnoA== --osd-uuid 4f7d1939-eec9-491e-9185-08e27819de47 2024-09-16T04:11:18.088 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:11:18.085+0000 7fd7f2b127c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:11:18.096 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:11:18.093+0000 7fd7f2b127c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:11:18.097 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:11:18.097+0000 7fd7f2b127c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:11:18.098 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:11:18.097+0000 7fd7f2b127c0 -1 bdev(0x555f14a04800 td/testpoolquota/0/block) open stat got: (1) Operation not permitted 2024-09-16T04:11:18.098 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:11:18.097+0000 7fd7f2b127c0 -1 bluestore(td/testpoolquota/0) _read_fsid unparsable uuid 2024-09-16T04:11:24.286 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/testpoolquota/0/keyring 2024-09-16T04:11:24.286 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T04:11:24.287 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2024-09-16T04:11:24.287 INFO:tasks.workunit.client.0.smithi096.stdout:adding osd0 key to auth repository 2024-09-16T04:11:24.287 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/testpoolquota/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T04:11:24.537 INFO:tasks.workunit.client.0.smithi096.stdout:start osd.0 2024-09-16T04:11:24.538 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2024-09-16T04:11:24.538 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T04:11:24.538 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T04:11:24.538 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T04:11:24.538 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=822e999c-833d-47f5-86bd-d98647f0b44e --auth-supported=none --mon-host=127.0.0.1:17108 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/testpoolquota/0 --osd-journal=td/testpoolquota/0/journal --chdir= --run-dir=td/testpoolquota '--admin-socket=/tmp/ceph-asok.189528/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/testpoolquota/$name.log' '--pid-file=td/testpoolquota/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T04:11:24.567 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:11:24.564+0000 7f6a9352f7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:11:24.570 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:11:24.568+0000 7f6a9352f7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:11:24.571 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:11:24.568+0000 7f6a9352f7c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:11:24.765 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2024-09-16T04:11:24.765 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T04:11:24.765 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2024-09-16T04:11:24.765 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T04:11:24.765 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T04:11:24.765 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:11:24.766 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T04:11:24.766 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T04:11:24.766 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:11:24.766 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:11:24.993 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:11:25.860 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:11:25.856+0000 7f6a9352f7c0 -1 Falling back to public interface 2024-09-16T04:11:25.995 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:11:25.995 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:11:25.995 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T04:11:25.996 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T04:11:25.996 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:11:25.996 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:11:26.232 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:11:27.234 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:11:27.234 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:11:27.234 INFO:tasks.workunit.client.0.smithi096.stdout:2 2024-09-16T04:11:27.234 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T04:11:27.235 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:11:27.235 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:11:27.469 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:11:28.471 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:11:28.471 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:11:28.471 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T04:11:28.471 INFO:tasks.workunit.client.0.smithi096.stdout:3 2024-09-16T04:11:28.472 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:11:28.472 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:11:28.574 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:11:28.572+0000 7f6a9352f7c0 -1 osd.0 0 log_to_monitors true 2024-09-16T04:11:28.738 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:11:29.739 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:11:29.739 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:11:29.740 INFO:tasks.workunit.client.0.smithi096.stdout:4 2024-09-16T04:11:29.740 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T04:11:29.740 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:11:29.740 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:11:29.971 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:11:30.973 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:11:30.973 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:11:30.973 INFO:tasks.workunit.client.0.smithi096.stdout:5 2024-09-16T04:11:30.974 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T04:11:30.974 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:11:30.974 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:11:31.210 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:11:32.212 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:11:32.212 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:11:32.212 INFO:tasks.workunit.client.0.smithi096.stdout:6 2024-09-16T04:11:32.213 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T04:11:32.213 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:11:32.213 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:11:32.446 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:11:33.447 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:11:33.448 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:11:33.448 INFO:tasks.workunit.client.0.smithi096.stdout:7 2024-09-16T04:11:33.449 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T04:11:33.449 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:11:33.449 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:11:33.683 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:11:34.685 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:11:34.685 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:11:34.685 INFO:tasks.workunit.client.0.smithi096.stdout:8 2024-09-16T04:11:34.686 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T04:11:34.686 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:11:34.686 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:11:34.921 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:11:35.922 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:11:35.923 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:11:35.923 INFO:tasks.workunit.client.0.smithi096.stdout:9 2024-09-16T04:11:35.924 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T04:11:35.924 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:11:35.924 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:11:36.161 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:11:37.160 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:11:37.160 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:11:37.160 INFO:tasks.workunit.client.0.smithi096.stdout:10 2024-09-16T04:11:37.161 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T04:11:37.161 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:11:37.161 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:11:37.394 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:11:38.396 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:11:38.396 INFO:tasks.workunit.client.0.smithi096.stdout:11 2024-09-16T04:11:38.397 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:11:38.397 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T04:11:38.397 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:11:38.397 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:11:38.635 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:11:39.636 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:11:39.637 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:11:39.637 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T04:11:39.637 INFO:tasks.workunit.client.0.smithi096.stdout:12 2024-09-16T04:11:39.637 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:11:39.637 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:11:39.874 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:11:40.876 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:11:40.876 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:11:40.876 INFO:tasks.workunit.client.0.smithi096.stdout:13 2024-09-16T04:11:40.877 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T04:11:40.877 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:11:40.877 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:11:41.113 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:11:42.115 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:11:42.116 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:11:42.116 INFO:tasks.workunit.client.0.smithi096.stdout:14 2024-09-16T04:11:42.116 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T04:11:42.116 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:11:42.117 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:11:42.352 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:11:43.354 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:11:43.354 INFO:tasks.workunit.client.0.smithi096.stdout:15 2024-09-16T04:11:43.354 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:11:43.354 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T04:11:43.355 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:11:43.355 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:11:43.591 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:11:44.593 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:11:44.593 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:11:44.593 INFO:tasks.workunit.client.0.smithi096.stdout:16 2024-09-16T04:11:44.594 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T04:11:44.594 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:11:44.594 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:11:44.829 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:11:45.830 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:11:45.831 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:11:45.831 INFO:tasks.workunit.client.0.smithi096.stdout:17 2024-09-16T04:11:45.832 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T04:11:45.832 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:11:45.832 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:11:46.067 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:11:47.069 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:11:47.069 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:11:47.069 INFO:tasks.workunit.client.0.smithi096.stdout:18 2024-09-16T04:11:47.070 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 18 2024-09-16T04:11:47.070 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:11:47.070 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:11:47.304 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:11:48.305 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:11:48.305 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:11:48.306 INFO:tasks.workunit.client.0.smithi096.stdout:19 2024-09-16T04:11:48.306 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 19 2024-09-16T04:11:48.306 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:11:48.306 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:11:48.531 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:11:49.532 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:11:49.533 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:11:49.533 INFO:tasks.workunit.client.0.smithi096.stdout:20 2024-09-16T04:11:49.533 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 20 2024-09-16T04:11:49.533 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:11:49.534 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:11:49.767 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:11:50.769 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:11:50.769 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:11:50.769 INFO:tasks.workunit.client.0.smithi096.stdout:21 2024-09-16T04:11:50.770 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 21 2024-09-16T04:11:50.770 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:11:50.770 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:11:51.008 INFO:tasks.workunit.client.0.smithi096.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/524395642,v1:127.0.0.1:6801/524395642] [v2:127.0.0.1:6802/524395642,v1:127.0.0.1:6803/524395642] exists,up 4f7d1939-eec9-491e-9185-08e27819de47 2024-09-16T04:11:51.010 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T04:11:51.010 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T04:11:51.010 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T04:11:51.011 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/test_pool_quota.sh:33: TEST_pool_quota: run_osd td/testpoolquota 1 2024-09-16T04:11:51.011 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/testpoolquota 2024-09-16T04:11:51.011 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T04:11:51.011 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2024-09-16T04:11:51.011 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T04:11:51.011 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/testpoolquota/1 2024-09-16T04:11:51.011 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=822e999c-833d-47f5-86bd-d98647f0b44e --auth-supported=none --mon-host=127.0.0.1:17108 ' 2024-09-16T04:11:51.011 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T04:11:51.011 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T04:11:51.011 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T04:11:51.011 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/testpoolquota/1' 2024-09-16T04:11:51.011 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/testpoolquota/1/journal' 2024-09-16T04:11:51.012 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T04:11:51.012 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T04:11:51.012 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/testpoolquota' 2024-09-16T04:11:51.012 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T04:11:51.012 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:11:51.012 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:11:51.012 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:11:51.012 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:11:51.012 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.189528 2024-09-16T04:11:51.012 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.189528/$cluster-$name.asok' 2024-09-16T04:11:51.012 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.189528/$cluster-$name.asok' 2024-09-16T04:11:51.012 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T04:11:51.013 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T04:11:51.013 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T04:11:51.013 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/testpoolquota/$name.log' 2024-09-16T04:11:51.013 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/testpoolquota/$name.pid' 2024-09-16T04:11:51.013 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T04:11:51.013 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T04:11:51.013 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T04:11:51.013 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T04:11:51.013 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T04:11:51.013 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T04:11:51.013 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/testpoolquota/1 2024-09-16T04:11:51.014 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T04:11:51.014 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=72a43448-56bf-4b6b-87b4-4fc169ea3b1e 2024-09-16T04:11:51.014 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 72a43448-56bf-4b6b-87b4-4fc169ea3b1e' 2024-09-16T04:11:51.014 INFO:tasks.workunit.client.0.smithi096.stdout:add osd1 72a43448-56bf-4b6b-87b4-4fc169ea3b1e 2024-09-16T04:11:51.015 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T04:11:51.034 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAHsOdmNAb5ARAAh9HB6+Qas1cNKC76G141Xg== 2024-09-16T04:11:51.034 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAHsOdmNAb5ARAAh9HB6+Qas1cNKC76G141Xg=="}' 2024-09-16T04:11:51.034 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 72a43448-56bf-4b6b-87b4-4fc169ea3b1e -i td/testpoolquota/1/new.json 2024-09-16T04:11:51.420 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T04:11:51.437 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/testpoolquota/1/new.json 2024-09-16T04:11:51.437 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=822e999c-833d-47f5-86bd-d98647f0b44e --auth-supported=none --mon-host=127.0.0.1:17108 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/testpoolquota/1 --osd-journal=td/testpoolquota/1/journal --chdir= --run-dir=td/testpoolquota '--admin-socket=/tmp/ceph-asok.189528/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/testpoolquota/$name.log' '--pid-file=td/testpoolquota/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAHsOdmNAb5ARAAh9HB6+Qas1cNKC76G141Xg== --osd-uuid 72a43448-56bf-4b6b-87b4-4fc169ea3b1e 2024-09-16T04:11:51.465 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:11:51.460+0000 7fcbed2a47c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:11:51.467 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:11:51.464+0000 7fcbed2a47c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:11:51.468 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:11:51.464+0000 7fcbed2a47c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:11:51.469 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:11:51.464+0000 7fcbed2a47c0 -1 bdev(0x55d96b68c800 td/testpoolquota/1/block) open stat got: (1) Operation not permitted 2024-09-16T04:11:51.469 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:11:51.464+0000 7fcbed2a47c0 -1 bluestore(td/testpoolquota/1) _read_fsid unparsable uuid 2024-09-16T04:11:58.153 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/testpoolquota/1/keyring 2024-09-16T04:11:58.153 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T04:11:58.154 INFO:tasks.workunit.client.0.smithi096.stdout:adding osd1 key to auth repository 2024-09-16T04:11:58.154 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2024-09-16T04:11:58.155 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/testpoolquota/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T04:11:58.404 INFO:tasks.workunit.client.0.smithi096.stdout:start osd.1 2024-09-16T04:11:58.404 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2024-09-16T04:11:58.405 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T04:11:58.405 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=822e999c-833d-47f5-86bd-d98647f0b44e --auth-supported=none --mon-host=127.0.0.1:17108 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/testpoolquota/1 --osd-journal=td/testpoolquota/1/journal --chdir= --run-dir=td/testpoolquota '--admin-socket=/tmp/ceph-asok.189528/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/testpoolquota/$name.log' '--pid-file=td/testpoolquota/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T04:11:58.405 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T04:11:58.405 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T04:11:58.435 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:11:58.432+0000 7f3bda6897c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:11:58.437 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:11:58.432+0000 7f3bda6897c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:11:58.438 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:11:58.436+0000 7f3bda6897c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:11:58.620 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2024-09-16T04:11:58.621 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T04:11:58.621 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2024-09-16T04:11:58.621 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T04:11:58.621 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T04:11:58.622 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T04:11:58.622 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:11:58.622 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T04:11:58.622 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:11:58.623 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:11:58.841 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:11:59.842 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:11:59.843 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:11:59.843 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T04:11:59.843 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T04:11:59.843 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:11:59.844 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:11:59.967 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:11:59.964+0000 7f3bda6897c0 -1 Falling back to public interface 2024-09-16T04:12:00.073 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:12:01.075 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:12:01.075 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:12:01.075 INFO:tasks.workunit.client.0.smithi096.stdout:2 2024-09-16T04:12:01.076 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T04:12:01.076 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:12:01.076 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:12:01.304 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:12:02.306 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:12:02.306 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:12:02.306 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T04:12:02.306 INFO:tasks.workunit.client.0.smithi096.stdout:3 2024-09-16T04:12:02.307 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:12:02.307 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:12:02.539 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:12:02.756 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:12:02.752+0000 7f3bda6897c0 -1 osd.1 0 log_to_monitors true 2024-09-16T04:12:03.541 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:12:03.541 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:12:03.541 INFO:tasks.workunit.client.0.smithi096.stdout:4 2024-09-16T04:12:03.542 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T04:12:03.542 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:12:03.542 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:12:03.951 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:12:04.953 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:12:04.953 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:12:04.953 INFO:tasks.workunit.client.0.smithi096.stdout:5 2024-09-16T04:12:04.954 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T04:12:04.954 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:12:04.954 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:12:05.187 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:12:06.189 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:12:06.189 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:12:06.189 INFO:tasks.workunit.client.0.smithi096.stdout:6 2024-09-16T04:12:06.190 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T04:12:06.190 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:12:06.190 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:12:06.427 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:12:07.429 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:12:07.429 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:12:07.429 INFO:tasks.workunit.client.0.smithi096.stdout:7 2024-09-16T04:12:07.429 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T04:12:07.430 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:12:07.430 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:12:07.667 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:12:08.669 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:12:08.669 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:12:08.669 INFO:tasks.workunit.client.0.smithi096.stdout:8 2024-09-16T04:12:08.670 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T04:12:08.670 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:12:08.670 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:12:08.907 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:12:09.909 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:12:09.909 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:12:09.909 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T04:12:09.910 INFO:tasks.workunit.client.0.smithi096.stdout:9 2024-09-16T04:12:09.910 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:12:09.910 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:12:10.150 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:12:11.152 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:12:11.152 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:12:11.152 INFO:tasks.workunit.client.0.smithi096.stdout:10 2024-09-16T04:12:11.153 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T04:12:11.153 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:12:11.153 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:12:11.386 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:12:12.388 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:12:12.388 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:12:12.388 INFO:tasks.workunit.client.0.smithi096.stdout:11 2024-09-16T04:12:12.389 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T04:12:12.389 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:12:12.389 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:12:12.626 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:12:13.628 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:12:13.628 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:12:13.628 INFO:tasks.workunit.client.0.smithi096.stdout:12 2024-09-16T04:12:13.629 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T04:12:13.629 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:12:13.629 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:12:13.862 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:12:14.864 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:12:14.864 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:12:14.864 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T04:12:14.864 INFO:tasks.workunit.client.0.smithi096.stdout:13 2024-09-16T04:12:14.864 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:12:14.865 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:12:15.098 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:12:16.101 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:12:16.101 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:12:16.101 INFO:tasks.workunit.client.0.smithi096.stdout:14 2024-09-16T04:12:16.102 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T04:12:16.102 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:12:16.102 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:12:16.332 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:12:17.333 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:12:17.334 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:12:17.334 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T04:12:17.334 INFO:tasks.workunit.client.0.smithi096.stdout:15 2024-09-16T04:12:17.334 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:12:17.334 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:12:17.571 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:12:18.572 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:12:18.572 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:12:18.572 INFO:tasks.workunit.client.0.smithi096.stdout:16 2024-09-16T04:12:18.573 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T04:12:18.573 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:12:18.573 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:12:18.810 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:12:19.811 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:12:19.811 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:12:19.812 INFO:tasks.workunit.client.0.smithi096.stdout:17 2024-09-16T04:12:19.812 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T04:12:19.812 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:12:19.812 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:12:20.047 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:12:21.048 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:12:21.049 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:12:21.049 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 18 2024-09-16T04:12:21.049 INFO:tasks.workunit.client.0.smithi096.stdout:18 2024-09-16T04:12:21.049 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:12:21.050 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:12:21.285 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:12:22.287 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:12:22.287 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:12:22.287 INFO:tasks.workunit.client.0.smithi096.stdout:19 2024-09-16T04:12:22.288 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 19 2024-09-16T04:12:22.288 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:12:22.288 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:12:22.520 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:12:23.522 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:12:23.522 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:12:23.522 INFO:tasks.workunit.client.0.smithi096.stdout:20 2024-09-16T04:12:23.523 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 20 2024-09-16T04:12:23.523 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:12:23.523 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:12:23.763 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:12:24.765 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:12:24.765 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:12:24.765 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 21 2024-09-16T04:12:24.765 INFO:tasks.workunit.client.0.smithi096.stdout:21 2024-09-16T04:12:24.765 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:12:24.765 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:12:25.007 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:12:26.009 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:12:26.009 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:12:26.010 INFO:tasks.workunit.client.0.smithi096.stdout:22 2024-09-16T04:12:26.010 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 22 2024-09-16T04:12:26.010 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:12:26.010 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:12:26.283 INFO:tasks.workunit.client.0.smithi096.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6808/273930906,v1:127.0.0.1:6809/273930906] [v2:127.0.0.1:6810/273930906,v1:127.0.0.1:6811/273930906] exists,up 72a43448-56bf-4b6b-87b4-4fc169ea3b1e 2024-09-16T04:12:26.291 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T04:12:26.291 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T04:12:26.291 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T04:12:26.291 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/test_pool_quota.sh:34: TEST_pool_quota: run_osd td/testpoolquota 2 2024-09-16T04:12:26.292 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/testpoolquota 2024-09-16T04:12:26.292 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T04:12:26.292 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2024-09-16T04:12:26.292 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T04:12:26.292 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/testpoolquota/2 2024-09-16T04:12:26.293 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=822e999c-833d-47f5-86bd-d98647f0b44e --auth-supported=none --mon-host=127.0.0.1:17108 ' 2024-09-16T04:12:26.293 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T04:12:26.293 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T04:12:26.293 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T04:12:26.293 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/testpoolquota/2' 2024-09-16T04:12:26.293 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/testpoolquota/2/journal' 2024-09-16T04:12:26.294 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T04:12:26.294 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T04:12:26.294 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/testpoolquota' 2024-09-16T04:12:26.294 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T04:12:26.294 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:12:26.295 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:12:26.295 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:12:26.295 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:12:26.295 INFO:tasks.workunit.client.0.smithi096.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.189528 2024-09-16T04:12:26.295 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.189528/$cluster-$name.asok' 2024-09-16T04:12:26.296 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.189528/$cluster-$name.asok' 2024-09-16T04:12:26.296 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T04:12:26.296 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T04:12:26.296 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T04:12:26.296 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/testpoolquota/$name.log' 2024-09-16T04:12:26.296 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/testpoolquota/$name.pid' 2024-09-16T04:12:26.297 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T04:12:26.297 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T04:12:26.297 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T04:12:26.297 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T04:12:26.297 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T04:12:26.298 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T04:12:26.298 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/testpoolquota/2 2024-09-16T04:12:26.298 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T04:12:26.298 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=4cb4eaa9-7bf3-4f14-9d2f-da2ef1beaa90 2024-09-16T04:12:26.298 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 4cb4eaa9-7bf3-4f14-9d2f-da2ef1beaa90' 2024-09-16T04:12:26.299 INFO:tasks.workunit.client.0.smithi096.stdout:add osd2 4cb4eaa9-7bf3-4f14-9d2f-da2ef1beaa90 2024-09-16T04:12:26.299 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T04:12:26.310 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAqsOdmULhuEhAARcQJDlyKECxutEi91TT6gw== 2024-09-16T04:12:26.310 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAqsOdmULhuEhAARcQJDlyKECxutEi91TT6gw=="}' 2024-09-16T04:12:26.310 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 4cb4eaa9-7bf3-4f14-9d2f-da2ef1beaa90 -i td/testpoolquota/2/new.json 2024-09-16T04:12:26.671 INFO:tasks.workunit.client.0.smithi096.stdout:2 2024-09-16T04:12:26.688 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/testpoolquota/2/new.json 2024-09-16T04:12:26.690 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=822e999c-833d-47f5-86bd-d98647f0b44e --auth-supported=none --mon-host=127.0.0.1:17108 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/testpoolquota/2 --osd-journal=td/testpoolquota/2/journal --chdir= --run-dir=td/testpoolquota '--admin-socket=/tmp/ceph-asok.189528/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/testpoolquota/$name.log' '--pid-file=td/testpoolquota/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAqsOdmULhuEhAARcQJDlyKECxutEi91TT6gw== --osd-uuid 4cb4eaa9-7bf3-4f14-9d2f-da2ef1beaa90 2024-09-16T04:12:26.724 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:12:26.719+0000 7f167f1d37c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:12:26.724 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:12:26.719+0000 7f167f1d37c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:12:26.726 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:12:26.723+0000 7f167f1d37c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:12:26.726 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:12:26.723+0000 7f167f1d37c0 -1 bdev(0x564f48125c00 td/testpoolquota/2/block) open stat got: (1) Operation not permitted 2024-09-16T04:12:26.726 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:12:26.723+0000 7f167f1d37c0 -1 bluestore(td/testpoolquota/2) _read_fsid unparsable uuid 2024-09-16T04:12:33.190 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/testpoolquota/2/keyring 2024-09-16T04:12:33.190 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T04:12:33.191 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2024-09-16T04:12:33.192 INFO:tasks.workunit.client.0.smithi096.stdout:adding osd2 key to auth repository 2024-09-16T04:12:33.192 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/testpoolquota/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T04:12:33.437 INFO:tasks.workunit.client.0.smithi096.stdout:start osd.2 2024-09-16T04:12:33.438 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2024-09-16T04:12:33.438 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=822e999c-833d-47f5-86bd-d98647f0b44e --auth-supported=none --mon-host=127.0.0.1:17108 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/testpoolquota/2 --osd-journal=td/testpoolquota/2/journal --chdir= --run-dir=td/testpoolquota '--admin-socket=/tmp/ceph-asok.189528/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/testpoolquota/$name.log' '--pid-file=td/testpoolquota/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T04:12:33.438 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T04:12:33.438 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T04:12:33.438 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T04:12:33.469 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:12:33.463+0000 7fa3f86b37c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:12:33.470 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:12:33.467+0000 7fa3f86b37c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:12:33.472 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:12:33.467+0000 7fa3f86b37c0 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:12:33.661 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2024-09-16T04:12:33.661 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T04:12:33.661 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2024-09-16T04:12:33.661 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T04:12:33.661 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T04:12:33.661 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:12:33.661 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T04:12:33.662 INFO:tasks.workunit.client.0.smithi096.stdout:0 2024-09-16T04:12:33.662 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:12:33.662 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:12:33.886 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:12:34.536 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:12:34.531+0000 7fa3f86b37c0 -1 Falling back to public interface 2024-09-16T04:12:34.887 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:12:34.887 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:12:34.888 INFO:tasks.workunit.client.0.smithi096.stdout:1 2024-09-16T04:12:34.888 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T04:12:34.888 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:12:34.888 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:12:35.122 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:12:36.124 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:12:36.124 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:12:36.124 INFO:tasks.workunit.client.0.smithi096.stdout:2 2024-09-16T04:12:36.125 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T04:12:36.125 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:12:36.125 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:12:36.359 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:12:37.315 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T04:12:37.311+0000 7fa3f86b37c0 -1 osd.2 0 log_to_monitors true 2024-09-16T04:12:37.360 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:12:37.361 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:12:37.361 INFO:tasks.workunit.client.0.smithi096.stdout:3 2024-09-16T04:12:37.361 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T04:12:37.361 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:12:37.362 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:12:37.900 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:12:38.901 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:12:38.902 INFO:tasks.workunit.client.0.smithi096.stdout:4 2024-09-16T04:12:38.902 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:12:38.902 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T04:12:38.902 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:12:38.902 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:12:39.130 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:12:40.132 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:12:40.133 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:12:40.133 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T04:12:40.133 INFO:tasks.workunit.client.0.smithi096.stdout:5 2024-09-16T04:12:40.133 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:12:40.133 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:12:40.370 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:12:41.372 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:12:41.372 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:12:41.373 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T04:12:41.373 INFO:tasks.workunit.client.0.smithi096.stdout:6 2024-09-16T04:12:41.373 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:12:41.373 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:12:41.615 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:12:42.617 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:12:42.617 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:12:42.617 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T04:12:42.617 INFO:tasks.workunit.client.0.smithi096.stdout:7 2024-09-16T04:12:42.618 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:12:42.618 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:12:42.862 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:12:43.863 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:12:43.864 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:12:43.864 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T04:12:43.864 INFO:tasks.workunit.client.0.smithi096.stdout:8 2024-09-16T04:12:43.864 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:12:43.864 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:12:44.103 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:12:45.105 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:12:45.105 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:12:45.105 INFO:tasks.workunit.client.0.smithi096.stdout:9 2024-09-16T04:12:45.106 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T04:12:45.106 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:12:45.106 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:12:45.339 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:12:46.341 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:12:46.341 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:12:46.341 INFO:tasks.workunit.client.0.smithi096.stdout:10 2024-09-16T04:12:46.342 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T04:12:46.342 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:12:46.342 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:12:46.574 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:12:47.575 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:12:47.575 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:12:47.576 INFO:tasks.workunit.client.0.smithi096.stdout:11 2024-09-16T04:12:47.576 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T04:12:47.576 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:12:47.576 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:12:47.812 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:12:48.814 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:12:48.814 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:12:48.814 INFO:tasks.workunit.client.0.smithi096.stdout:12 2024-09-16T04:12:48.815 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T04:12:48.815 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:12:48.815 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:12:49.049 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:12:50.051 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:12:50.052 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:12:50.052 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T04:12:50.052 INFO:tasks.workunit.client.0.smithi096.stdout:13 2024-09-16T04:12:50.052 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:12:50.052 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:12:50.291 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:12:51.293 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:12:51.293 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:12:51.293 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T04:12:51.294 INFO:tasks.workunit.client.0.smithi096.stdout:14 2024-09-16T04:12:51.294 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:12:51.294 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:12:51.535 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:12:52.536 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:12:52.536 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:12:52.537 INFO:tasks.workunit.client.0.smithi096.stdout:15 2024-09-16T04:12:52.537 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T04:12:52.537 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:12:52.537 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:12:52.771 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:12:53.774 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:12:53.774 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:12:53.774 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T04:12:53.775 INFO:tasks.workunit.client.0.smithi096.stdout:16 2024-09-16T04:12:53.775 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:12:53.776 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:12:54.000 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:12:55.003 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:12:55.003 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:12:55.003 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T04:12:55.003 INFO:tasks.workunit.client.0.smithi096.stdout:17 2024-09-16T04:12:55.004 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:12:55.004 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:12:55.233 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:12:56.234 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:12:56.235 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:12:56.235 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 18 2024-09-16T04:12:56.235 INFO:tasks.workunit.client.0.smithi096.stdout:18 2024-09-16T04:12:56.235 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:12:56.235 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:12:56.465 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:12:57.466 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:12:57.466 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:12:57.467 INFO:tasks.workunit.client.0.smithi096.stdout:19 2024-09-16T04:12:57.467 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 19 2024-09-16T04:12:57.467 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:12:57.467 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:12:57.702 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:12:58.703 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:12:58.703 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:12:58.703 INFO:tasks.workunit.client.0.smithi096.stdout:20 2024-09-16T04:12:58.704 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 20 2024-09-16T04:12:58.704 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:12:58.704 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:12:58.930 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:12:59.932 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:12:59.932 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:12:59.932 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 21 2024-09-16T04:12:59.932 INFO:tasks.workunit.client.0.smithi096.stdout:21 2024-09-16T04:12:59.933 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:12:59.933 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:13:00.166 INFO:tasks.workunit.client.0.smithi096.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6816/2887630648,v1:127.0.0.1:6817/2887630648] [v2:127.0.0.1:6818/2887630648,v1:127.0.0.1:6819/2887630648] exists,up 4cb4eaa9-7bf3-4f14-9d2f-da2ef1beaa90 2024-09-16T04:13:00.167 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T04:13:00.167 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T04:13:00.167 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T04:13:00.167 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/test_pool_quota.sh:36: TEST_pool_quota: local poolname=testquota 2024-09-16T04:13:00.167 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/test_pool_quota.sh:37: TEST_pool_quota: create_pool testquota 20 2024-09-16T04:13:00.167 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create testquota 20 2024-09-16T04:13:00.594 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'testquota' already exists 2024-09-16T04:13:00.613 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2024-09-16T04:13:01.616 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/test_pool_quota.sh:38: TEST_pool_quota: ceph df detail 2024-09-16T04:13:01.617 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/test_pool_quota.sh:38: TEST_pool_quota: grep -w testquota 2024-09-16T04:13:01.617 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/test_pool_quota.sh:38: TEST_pool_quota: awk '{print $3}' 2024-09-16T04:13:02.047 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/test_pool_quota.sh:38: TEST_pool_quota: local objects= 2024-09-16T04:13:02.048 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/test_pool_quota.sh:39: TEST_pool_quota: ceph df detail 2024-09-16T04:13:02.048 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/test_pool_quota.sh:39: TEST_pool_quota: grep -w testquota 2024-09-16T04:13:02.048 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/test_pool_quota.sh:39: TEST_pool_quota: awk '{print $4}' 2024-09-16T04:13:02.505 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/test_pool_quota.sh:39: TEST_pool_quota: local bytes= 2024-09-16T04:13:02.505 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/test_pool_quota.sh:41: TEST_pool_quota: echo 2024-09-16T04:13:02.505 INFO:tasks.workunit.client.0.smithi096.stdout: 2024-09-16T04:13:02.506 INFO:tasks.workunit.client.0.smithi096.stdout: 2024-09-16T04:13:02.506 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/test_pool_quota.sh:42: TEST_pool_quota: echo 2024-09-16T04:13:02.506 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/test_pool_quota.sh:43: TEST_pool_quota: '[' '!=' N/A ']' 2024-09-16T04:13:02.506 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/test_pool_quota.sh: line 43: [: !=: unary operator expected 2024-09-16T04:13:02.506 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/test_pool_quota.sh:43: TEST_pool_quota: '[' '!=' N/A ']' 2024-09-16T04:13:02.506 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/test_pool_quota.sh: line 43: [: !=: unary operator expected 2024-09-16T04:13:02.506 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/test_pool_quota.sh:48: TEST_pool_quota: ceph osd pool set-quota testquota max_objects 1000 2024-09-16T04:13:03.125 INFO:tasks.workunit.client.0.smithi096.stderr:set-quota max_objects = 1000 for pool testquota 2024-09-16T04:13:03.145 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/test_pool_quota.sh:49: TEST_pool_quota: ceph osd pool set-quota testquota max_bytes 1024 2024-09-16T04:13:03.753 INFO:tasks.workunit.client.0.smithi096.stderr:set-quota max_bytes = 1024 for pool testquota 2024-09-16T04:13:03.776 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/test_pool_quota.sh:51: TEST_pool_quota: ceph df detail 2024-09-16T04:13:03.777 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/test_pool_quota.sh:51: TEST_pool_quota: grep -w testquota 2024-09-16T04:13:03.777 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/test_pool_quota.sh:51: TEST_pool_quota: awk '{print $3}' 2024-09-16T04:13:04.140 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/test_pool_quota.sh:51: TEST_pool_quota: objects= 2024-09-16T04:13:04.141 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/test_pool_quota.sh:52: TEST_pool_quota: ceph df detail 2024-09-16T04:13:04.141 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/test_pool_quota.sh:52: TEST_pool_quota: grep -w testquota 2024-09-16T04:13:04.141 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/test_pool_quota.sh:52: TEST_pool_quota: awk '{print $4}' 2024-09-16T04:13:04.478 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/test_pool_quota.sh:52: TEST_pool_quota: bytes= 2024-09-16T04:13:04.478 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/test_pool_quota.sh:54: TEST_pool_quota: '[' '!=' 1000 ']' 2024-09-16T04:13:04.478 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/test_pool_quota.sh: line 54: [: !=: unary operator expected 2024-09-16T04:13:04.478 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/test_pool_quota.sh:54: TEST_pool_quota: '[' '!=' 1K ']' 2024-09-16T04:13:04.478 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/test_pool_quota.sh: line 54: [: !=: unary operator expected 2024-09-16T04:13:04.478 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/test_pool_quota.sh:59: TEST_pool_quota: ceph osd pool delete testquota testquota --yes-i-really-really-mean-it 2024-09-16T04:13:04.848 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'testquota' does not exist 2024-09-16T04:13:04.866 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/test_pool_quota.sh:60: TEST_pool_quota: teardown td/testpoolquota 2024-09-16T04:13:04.866 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/testpoolquota 2024-09-16T04:13:04.866 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T04:13:04.866 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/testpoolquota KILL 2024-09-16T04:13:04.867 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T04:13:04.867 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T04:13:04.867 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T04:13:04.867 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T04:13:04.867 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T04:13:05.177 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T04:13:05.178 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T04:13:05.179 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T04:13:05.180 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T04:13:05.181 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T04:13:05.181 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T04:13:05.182 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T04:13:05.183 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T04:13:05.183 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T04:13:05.183 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T04:13:05.184 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T04:13:05.185 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T04:13:05.186 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T04:13:05.187 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/testpoolquota 2024-09-16T04:13:05.204 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T04:13:05.204 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:13:05.204 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.189528 2024-09-16T04:13:05.205 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.189528 2024-09-16T04:13:05.207 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T04:13:05.207 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T04:13:05.207 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2322: main: code=0 2024-09-16T04:13:05.207 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2326: main: teardown td/testpoolquota 0 2024-09-16T04:13:05.207 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/testpoolquota 2024-09-16T04:13:05.207 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2024-09-16T04:13:05.207 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/testpoolquota KILL 2024-09-16T04:13:05.207 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T04:13:05.208 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T04:13:05.208 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T04:13:05.208 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T04:13:05.208 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T04:13:05.209 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T04:13:05.209 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T04:13:05.210 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T04:13:05.210 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T04:13:05.212 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T04:13:05.212 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T04:13:05.212 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T04:13:05.213 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T04:13:05.213 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T04:13:05.214 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T04:13:05.214 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T04:13:05.215 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T04:13:05.216 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2024-09-16T04:13:05.216 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/testpoolquota 2024-09-16T04:13:05.217 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T04:13:05.217 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:13:05.218 INFO:tasks.workunit.client.0.smithi096.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.189528 2024-09-16T04:13:05.218 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.189528 2024-09-16T04:13:05.218 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T04:13:05.218 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T04:13:05.219 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2327: main: return 0 2024-09-16T04:13:05.220 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-16T04:13:05.220 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-16T04:13:05.276 INFO:tasks.workunit:Stopping ['mon'] on client.0... 2024-09-16T04:13:05.276 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-16T04:13:05.643 DEBUG:teuthology.parallel:result is None 2024-09-16T04:13:05.644 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-16T04:13:05.657 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-16T04:13:05.658 DEBUG:teuthology.orchestra.run.smithi096:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-16T04:13:05.728 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-16T04:13:05.728 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-16T04:13:05.741 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-16T04:13:05.741 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-16T04:13:05.806 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-16T04:13:05.814 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-16T04:13:05.814 DEBUG:teuthology.orchestra.run.smithi096:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T04:13:05.842 INFO:teuthology.orchestra.run.smithi096.stdout: remote refid st t when poll reach delay offset jitter 2024-09-16T04:13:05.842 INFO:teuthology.orchestra.run.smithi096.stdout:============================================================================== 2024-09-16T04:13:05.842 INFO:teuthology.orchestra.run.smithi096.stdout:*hv01.front.sepi 67.205.162.81 3 u 29 64 377 0.106 -1.385 0.164 2024-09-16T04:13:05.842 INFO:teuthology.orchestra.run.smithi096.stdout:+hv02.front.sepi 63.231.80.2 3 u 19 64 377 0.088 -2.640 0.241 2024-09-16T04:13:05.842 INFO:teuthology.orchestra.run.smithi096.stdout:+hv03.front.sepi 74.6.168.72 3 u 10 64 377 0.101 -1.003 0.127 2024-09-16T04:13:05.842 INFO:teuthology.orchestra.run.smithi096.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-09-16T04:13:05.842 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-16T04:13:05.851 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-16T04:13:05.851 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-16T04:13:05.861 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-16T04:13:05.870 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-16T04:13:05.878 INFO:teuthology.task.internal:Duration was 4535.434752 seconds 2024-09-16T04:13:05.879 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-16T04:13:06.038 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-16T04:13:06.039 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-16T04:13:06.084 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-16T04:13:06.084 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi096.front.sepia.ceph.com 2024-09-16T04:13:06.084 DEBUG:teuthology.orchestra.run.smithi096:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-16T04:13:06.134 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-16T04:13:06.134 DEBUG:teuthology.orchestra.run.smithi096:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-16T04:13:06.211 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-16T04:13:06.211 DEBUG:teuthology.orchestra.run.smithi096:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-16T04:13:06.309 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-16T04:13:06.318 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-16T04:13:06.319 DEBUG:teuthology.orchestra.run.smithi096:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-16T04:13:06.331 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-16T04:13:06.341 DEBUG:teuthology.orchestra.run.smithi096:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-16T04:13:06.385 INFO:teuthology.orchestra.run.smithi096.stdout:kernel.core_pattern = core 2024-09-16T04:13:06.399 DEBUG:teuthology.orchestra.run.smithi096:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-16T04:13:06.445 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T04:13:06.446 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-16T04:13:06.456 INFO:teuthology.task.internal:Transferring archived files... 2024-09-16T04:13:06.458 DEBUG:teuthology.misc:Transferring archived files from smithi096:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-15_20:00:16-rados-main-distro-default-smithi/7905827/remote/smithi096 2024-09-16T04:13:06.459 DEBUG:teuthology.orchestra.run.smithi096:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-16T04:13:06.512 INFO:teuthology.task.internal:Removing archive directory... 2024-09-16T04:13:06.513 DEBUG:teuthology.orchestra.run.smithi096:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-16T04:13:06.555 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-16T04:13:06.565 INFO:teuthology.task.internal:Not uploading archives. 2024-09-16T04:13:06.566 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-16T04:13:06.579 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-16T04:13:06.579 DEBUG:teuthology.orchestra.run.smithi096:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-16T04:13:06.606 INFO:teuthology.orchestra.run.smithi096.stdout: 658638 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 16 04:13 /home/ubuntu/cephtest 2024-09-16T04:13:06.607 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-16T04:13:06.617 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-16T04:13:06.738 INFO:teuthology.run:Summary data: description: rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/mon} duration: 4535.434752464294 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-16T04:13:06.739 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-16T04:13:06.826 INFO:teuthology.run:pass